We investigated the extent to which language tests developed for native speakers (L1) can be used with advanced speakers of a second language (L2). We compared the performance of Dutch–English bilinguals with that of native English speakers on a series of English language tests, looking at vocabulary knowledge, crystallized intelligence, reading comprehension, and reading speed. It was found that advanced L2 speakers know fewer L2 words than native speakers and take longer to read texts but perform equally well on text comprehension. Tests optimized for native English-speakers predicted text comprehension less well than tests better adapted to the skill level of the bilinguals (which include the Lextale test). An exploratory graphical analysis suggested that L2 users’ performance on challenging vocabulary tests, along with performance on an English author recognition test, forms a distinct cluster – arguably also measuring interest in English language and culture besides knowledge in general (also called crystallized intelligence).