Algebraic limit cycles in quadratic polynomial differential systems started to be studied in 1958, and a few years later the following conjecture appeared: quadratic polynomial differential systems have at most one algebraic limit cycle. We prove that a quadratic polynomial differential system having an invariant algebraic curve with at most one pair of diametrically opposite singular points at infinity has at most one algebraic limit cycle. Our result provides a partial positive answer to this conjecture.