This chapter focuses on how diverse societies came to attach themselves to Bagamoyo and, thus, became “owners of the town” in their own unique ways. It argues that, even though various peoples settled at different times, each was just as significant to the town’s growth as the others; to think in dichotomous terms of insiders and outsiders, core and peripheral, civilized and heathen, frustrates a more informed understanding of how Bagamoyo evolved from a fishing village to a trading entrepôt. Although the Shomvi did think in these dichotomous terms to maintain their elite status and protect their privileges, their actual interactions and ties with Bagamoyo’s other communities belied a greater level of tolerance than their posturing might otherwise have indicated. The acceptance of groups of people from different cultural backgrounds could prove economically – and even politically – beneficial for the Shomvi, so long as the newcomers did not threaten their influence.