Mesenchymal stem cell (MSC)-based engineering is promising for cartilage repair. However, the compositional mechanical relationship of the engineered structures has not been extensively studied, given the importance of such relationship in native cartilage tissues. In this study, a novel human MSC-collagen microsphere system was used to study the compositional mechanical relationship during in vitro chondrogenic differentiation using histological and biochemical methods and a microplate compression assay. The mechanical property was found positively correlating with newly deposited cartilage-relevant matrices, glycosaminoglycan, and type II collagen, and with the collagen crosslinker density, in agreement with the presence of thick collagen bundles upon structural characterization. On the other hand, the mechanical property negatively correlates with type I collagen and total collagen, suggesting that the initial collagen matrix scaffold of the microsphere system was being remodeled by the differentiating human MSCs. This study also demonstrated the application of a simple, sensitive, and nondestructive tool for monitoring the progression of chondrogenic differentiation of MSCs in tissue-engineered constructs and therefore contributes to future development of novel cartilage repair strategies.