Breastfeeding represents a strong selective factor for shaping the infant gut microbiota. Besides providing nutritional requirements for the infant, human milk is a key source of oligosaccharides, human milk oligosaccharides (HMOs), and diverse microbes in early life. This study aimed to evaluate the influence of human milk microbiota and oligosaccharides on the composition of infant faecal microbiota at one, three, and nine months postpartum. We profiled milk microbiota, HMOs, and infant faecal microbiota from 23 mother–infant pairs at these time points. The predominant genera in milk samples were Streptococcus, Staphylococcus, and an unclassified Enterobacteriaceae genus-level taxon (Enterobacteriaceae uncl.), whereas the infant faecal microbiota was predominated by Bifidobacterium, Bacteroides, and Enterobacteriaceae uncl. Mother–infant dyads frequently shared bacterial amplicon sequence variants (ASVs) belonging to the genera Bifidobacterium, Streptococcus, Enterobacteriaceae uncl., Veillonella, Bacteroides, and Haemophilus. The individual HMO concentrations in the milk showed either no change or decreased over the lactation period, except for 3-fucosyllactose (3-FL), which increased. Neither maternal secretor status nor HMO concentrations were significantly associated with microbiota composition at the different ages or the bacterial ASVs of maternal milk and infant faeces. This study suggests an age-dependent role of milk microbes in shaping the gut microbiota, while variations in HMO concentrations show limited influence.