The majority of knees without radiographic osteoarthritis experience an increase in structural damage over time, with the most frequent changes being observed in the patellofemoral joint.