In the present study, we assessed the sponge fauna, sponge-associated, and planktonic prokaryotic communities residing in Burgers' Zoo Ocean aquarium, Arnhem, the Netherlands. The Ocean aquarium consisted of separate displays and life support systems, and included fish-only systems in addition to a large, 750,000 L tank containing a living, tropical coral reef ecosystem. Sponges were observed throughout the aquarium system and were identified as belonging to the genera Chalinula, Chondrilla, Chondrosia, Cinachyrella, Stylissa, Suberites and Tethya. There was a highly significant difference in composition between sponge-associated and planktonic prokaryotic communities. The tanks in which the sponges were sampled appeared to have a secondary structural effect on prokaryotic composition with sponges and water from the same tanks sharing several microorganisms. Both sponge-associated and planktonic prokaryotic communities housed prokaryotic taxa, which were highly similar to microorganisms previously recorded in sponges or coral reef environments, including taxa potentially involved in nitrification, denitrification, sulphur oxidation, and antibiotic biosynthesis. Several abundant microorganisms were only recorded in sponges and these may play a role in maintaining water quality in the aquarium system. Potential pathogens, e.g. related to Photobacterium damselae, and beneficial organisms, e.g. related to Pseudovibrio denitrificans, were also detected. The present study showed that Burgers' Zoo Ocean aquarium housed diverse free-living and host-associated prokaryotic communities. Future research should focus on identifying conditions and microbial communities conducive to a healthy aquarium environment.