In the distant past, the solar system was rife with impacts and collisions. Millions of rocky objects zoomed chaotically through the system, smashing into each other in collisional cascades. Over time, many of them eventually became part of the rocky planets. What's left of the space rocks are mostly gathered in the main asteroid belt.
