In models with a representative infinitely lived household, tax smoothing implies that the steady state of government debt should follow a random walk. This is unlikely to be the case in overlapping generations (OLG) economies, where the equilibrium interest rate may differ from the policy maker's rate of time preference. It may therefore be optimal to reduce debt today to reduce distortionary taxation in the future. In addition, the level of the capital stock in these economies is likely to be suboptimally low, and reducing government debt will crowd in additional capital. Using a version of the Blanchard-Yaari model of perpetual youth, with both public and private capital, we show that it is optimal in steady state for the government to hold assets. However, we also show how and why this level of government assets can fall short of both the level of debt that achieves the optimal capital stock and the level that eliminates income taxes. Finally, we compute the optimal adjustment path to this steady state.