In a sort of conceptual history in action, this chapter looks at the labels attached to the settlers-turned-migrants that were hotly contested. The most prominent among them, retornados (returnees) and refugiados (refugees), inferred conflicting views about the nature of their mobility and belonging and thus evoked divergent emotional and political responses. By disentangling how domestic, foreign, and international actors, notably the UNHCR, fought over these labels, the chapter demonstrates how the mechanisms of the international postwar refugee regime were compatible with and helped reinforce an ethnic reordering of citizenship and the postcolonial nation in Portugal. Conceptually, the chapter argues that historicizing these battles over how to name, interpret, and handle those who were leaving the colonies can provide fresh vistas for the broader scholarly discussion about coerced migration.