On the evening of March 20, 1828, a group of free men of color organized a society that had as its purpose “the mental improvement of the people of color in the neighborhood of Philadelphia.” This organization was to be known as the “Reading Room Society.” Immediately a library was established and the librarian instructed to lend books to members for no longer than a week. Books were to be withdrawn or returned at the society's weekly meeting. Freedoms Journal, the earliest Negro newspaper, the first issue of which appeared in March, 1827, and Lundy's Genius of Universal Emancipation, an antislavery publication, were among the first works circulated. In May, 1833, the Philadelphia Library Company of Colored Persons appealed for “such books and other donations as will facilitate the object of this institution.” By 1838, this library had 600 volumes. Since Negroes could not enjoy the same privileges as whites in libraries, they established for themselves some 45 literary societies between 1828 and 1846 in several large cities, mainly in the East, most of which maintained reading rooms and circulating libraries.

As a consequence of these activities many Negroes were stimulated to assemble private libraries. In 1838, in Philadelphia and nearby cities, there were 8333 volumes in private libraries. In New York City, David Ruggles, a Negro abolitionist, pamphleteer, and printer, was probably the first Negro book collector. He maintained a circulating library and made antislavery and colonization publications available to many readers. He charged a fee of less than twenty-five cents a month for renting books relating to the Negro and slavery.