Osteoblasts differentiate from mesodermal progenitors and play a pivotal role in bone formation and mineralization. Several transcription factors including runt‐related transcription factor 2 (RUNX2), Osterix (OSX), and activating transcription factor4 (ATF4) are known to be crucial for the process, whereas the upstream signal transduction controlling the osteoblast differentiation sequence is largely unknown. Here, we explored the role of c‐jun N‐terminal kinase (JNK) in osteoblast differentiation using in vitro differentiation models of primary osteoblasts and MC3T3‐E1 cells with ascorbic acid/β‐glycerophosphate treatment. Terminal osteoblast differentiation, represented by matrix mineralization, was significantly inhibited by the inactivation of JNK with its specific inhibitor and exogenous overexpression of MKP‐M (MAP kinase phosphatase isolated from macrophages), which preferentially inactivates JNK. Conversely, enhanced mineral deposition was observed by inducible overexpression of p54^JNK2, whereas it was not observed by the overexpression of p46^JNK1 or p46^JNK2, indicating a distinct enhancing role of p54^JNK2 in osteoblast differentiation. Inactivation of JNK significantly inhibited late‐stage molecular events of osteoblast differentiation, including gene expression of osteocalcin (Ocn) and bone sialoprotein (Bsp). In contrast, earlier differentiation events including alkaline phosphatase (ALP) activation and osteopontin (Opn) expression were not inhibited by JNK inactivation. Although the expression levels of two transcription factor genes, Runx2 and Osx, were not significantly affected by JNK inactivation, induction of Atf4 mRNA during osteoblast differentiation was significantly inhibited. Taken together, these data indicate that JNK activity is specifically required for the late‐stage differentiation events of osteoblasts.