Original Article · Open access
Professional experience and reliability of cervical vertebral maturation staging among unfamiliar raters
Abstract
Objectives: This study aims to evaluate the reliability of cervical vertebral maturation (CVM) staging in determining skeletal maturity in patients with adolescent idiopathic scoliosis (AIS), focusing on the effect of professional experience among orthopedic surgeons.
Patients and methods: Between January 2023 and January 2025, this reliability and agreement study included a total of 72 patients aged between nine and 16 years who were diagnosed with AIS. Intra- and inter-rater reliability were analyzed using weighted kappa (κ) statistics with standard errors (SEs) and 95% confidence intervals (CIs). A total of 72 full-spine lateral radiographs were independently assessed by 10 raters with varying levels of orthopedic expertise, including medical students, residents, consultants, and spinal surgeons. None of the raters had prior experience with the CVM classification. Each rater performed CVM staging twice with a four-week interval between assessments.
Results: Of the patients, 33 were male and 39 were female with a mean age of 13.07 ± 1.97 (range, 9 to 16) years. Overall intra-rater reliability was substantial (κ = 0.64, SE = 0.032, 95% CI: 0.569-0.714), and overall inter-rater reliability was moderate (κ = 0.52). Although spinal surgeons showed slightly higher intra-rater reliability overall, inter-rater reliability declined between assessments (first assessment κ = 0.61 vs. second assessment κ = 0.34). Consultants exhibited the highest inter-rater agreement (κ = 0.62), whereas residents showed improvement between assessments (κ = 0.40 vs. 0.52); however, no significant difference observed between groups.
Conclusion: The reliability of CVM staging for assessing skeletal maturity in AIS patients does not significantly differ across levels of orthopedic expertise. While CVM staging has potential as a radiation-sparing method, the overall moderate agreement, particularly among physicians without prior experience, indicates that reliability is not significantly influenced by professional experience.
Declarations
Author Contributions
Y.U.C.: Idea/concept; Y.U.C., M.D.: Design, writing the article; K.S., O.Ö.: Control/supervision; A.E.T.B., D.G., E.K., M.O.Ç., M.D., K.S., O.Ö.: Data collection and/or processing; M.D., O.Ö.: Analysis and/or interpretation; Y.U.C., M.D., K.S., M.O.Ç.: Literature review; O.Ö., K.S.: Critical review; Y.U.C., M.O.Ç.: References and fundings; M.O.Ç.: Materials. All authors approve of the content of the manuscript and agree to be held accountable for the work.
Conflict of Interest
The authors declared no conflicts of interest with respect to the authorship and/or publication of this article.
Financial Disclosure
The authors received no financial support for the research and/or authorship of this article.
Data Sharing Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
AI Disclosure
The authors declare that artificial intelligence (AI) tools were not used, or were used solely for language editing, and had no role in data analysis, interpretation, or the formulation of conclusions. All scientific content, data interpretation, and conclusions are the sole responsibility of the authors. The authors further confirm that AI tools were not used to generate, fabricate, or ‘hallucinate’ references, and that all references have been carefully verified for accuracy.
References
- Lenz M, Oikonomidis S, Harland A, Fürnstahl P, Farshad M, Bredow J, et al. Scoliosis and prognosis-a systematic review regarding patient-specific and radiological predictive factors for curve progression. Eur Spine J 2021;30:1813-22. DOI: 10.1007/s00586-021-06817-0.
- Weinstein SL, Dolan LA, Cheng JC, Danielsson A, Morcuende JA. Adolescent idiopathic scoliosis. Lancet 2008;371:1527-37. DOI: 10.1016/S0140-6736(08)60658-3.
- Charles YP, Daures JP, de Rosa V, Diméglio A. Progression risk of idiopathic juvenile scoliosis during pubertal growth. Spine (Phila Pa 1976) 2006;31:1933-42. DOI: 10.1097/01.brs.0000229230.68870.97.
- Tan KJ, Moe MM, Vaithinathan R, Wong HK. Curve progression in idiopathic scoliosis: Follow-up study to skeletal maturity. Spine (Phila Pa 1976) 2009;34:697-700. DOI: 10.1097/BRS.0b013e31819c9431.
- Weinstein SL, Dolan LA, Wright JG, Dobbs MB. Effects of bracing in adolescents with idiopathic scoliosis. N Engl J Med 2013;369:1512-21. DOI: 10.1056/NEJMoa1307337.
- Manzetti M, Ruffilli A, Barile F, Viroli G, Traversari M, Vita F, et al. Is there a skeletal age index that can predict accurate curve progression in adolescent idiopathic scoliosis? A systematic review. Pediatr Radiol 2024;54:299-315. DOI: 10.1007/s00247-023-05834-z.
- Cheung JPY, Cheung PWH, Samartzis D, Luk KD. Curve progression in adolescent idiopathic scoliosis does not match skeletal growth. Clin Orthop Relat Res 2018;476:429- 36. DOI: 10.1007/s11999.0000000000000027.
- Gerdhem P. CORR Insights®: Curve progression in adolescent idiopathic scoliosis does not match skeletal growth. Clin Orthop Relat Res 2018;476:437-8. DOI: 10.1007/s11999.0000000000000128.
- Huang LF, Furdock RJ, Uli N, Liu RW. Estimating skeletal maturity using wrist radiographs during preadolescence: The epiphyseal: Metaphyseal ratio. J Pediatr Orthop 2022;42:e801-5. DOI: 10.1097/BPO.0000000000002174.
- Cheung JP, Cheung PW, Samartzis D, Cheung KM, Luk KD. The use of the distal radius and ulna classification for the prediction of growth: peak growth spurt and growth cessation. Bone Joint J 2016;98-B:1689-96. DOI: 10.1302/0301-620X.98B12.BJJ-2016-0158.R1.
- Lamparski DG. Skeletal age assessment utilizing cervical vertebrae. Am J Orthod 1975;67:458-9.
- Baccetti T, Franchi L, McNamara JA. The cervical vertebral maturation (CVM) method for the assessment of optimal treatment timing in dentofacial orthopedics. Semin Orthod 2005;11:119-29.
- Kahan JB, Li DT, Schneble CA, Elabd A, Attia E, Esparza R, et al. Measuring proximal tibial metaphyseal width and lateral epiphyseal height improves determination of remaining growth in children. J Pediatr Orthop 2021;41:e739-44. DOI: 10.1097/BPO.0000000000001853.
- Ronckers CM, Land CE, Miller JS, Stovall M, Lonstein JE, Doody MM. Cancer mortality among women frequently exposed to radiographic examinations for spinal disorders. Radiat Res 2010;174:83-90. DOI: 10.1667/RR2022.1.
- Gabriel DB, Southard KA, Qian F, Marshall SD, Franciscus RG, Southard TE. Cervical vertebrae maturation method: Poor reproducibility. Am J Orthod Dentofacial Orthop 2009;136:478.e1-7. DOI: 10.1016/j.ajodo.2007.08.028.
- Predko-Engel A, Kaminek M, Langova K, Kowalski P, Fudalej PS. Reliability of the Cervical Vertebrae Maturation (CVM) method. Bratisl Lek Listy 2015;116:222-6. DOI: 10.4149/bll_2015_043.
- Sohrabi A, Babay Ahari S, Moslemzadeh H, Rafighi A, Aghazadeh Z. The reliability of clinical decisions based on the cervical vertebrae maturation staging method. Eur J Orthod 2016;38:8-12. DOI: 10.1093/ejo/cjv030.
- Santiago RC, de Miranda Costa LF, Vitral RW, Fraga MR, Bolognese AM, Maia LC. Cervical vertebral maturation as a biologic indicator of skeletal maturity. Angle Orthod 2012;82:1123-31. DOI: 10.2319/103111-673.1.
- Obuchowski NA. How many observers are needed in clinical studies of medical imaging? AJR Am J Roentgenol 2004;182:867-9. DOI: 10.2214/ajr.182.4.1820867.
- McNamara JA Jr, Franchi L. The cervical vertebral maturation method: A user's guide. Angle Orthod 2018;88:133-43. DOI: 10.2319/111517-787.1.
- Baccetti T, Franchi L, McNamara JA Jr. An improved version of the Cervical Vertebral Maturation (CVM) method for the assessment of mandibular growth. Angle Orthod 2002;72:316-23. DOI: 10.1043/0003-3219(2002)0722.0.CO;2.
- Cicchetti DV. Testing the normal approximation and minimal sample size requirements of weighted kappa when the number of categories is large. Appl Psychol Meas 1981;5:101-4.
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
- Ferrillo M, Curci C, Roccuzzo A, Migliario M, Invernizzi M, de Sire A. Reliability of cervical vertebral maturation compared to hand-wrist for skeletal maturation assessment in growing subjects: A systematic review. J Back Musculoskelet Rehabil 2021;34:925-36. DOI: 10.3233/BMR210003.
- Qi H, Tian X, Zu F, Zhao Z, Wang C, Wang C, et al. Evaluating the feasibility of cervical vertebral maturation stages as an alternative to risser sign in assessing skeletal maturity in adolescent idiopathic scoliosis patients. World Neurosurg 2024;192:e523-32. DOI: 10.1016/j.wneu.2024.10.014.
- Soegiharto BM, Moles DR, Cunningham SJ. Discriminatory ability of the skeletal maturation index and the cervical vertebrae maturation index in detecting peak pubertal growth in Indonesian and white subjects with receiver operating characteristics analysis. Am J Orthod Dentofacial Orthop 2008;134:227-37. DOI: 10.1016/j.ajodo.2006.09.062.
- Uysal T, Ramoglu SI, Basciftci FA, Sari Z. Chronologic age and skeletal maturation of the cervical vertebrae and handwrist: Is there a relationship? Am J Orthod Dentofacial Orthop 2006;130:622-8. DOI: 10.1016/j.ajodo.2005.01.031.
- Gandini P, Mancini M, Andreani F. A comparison of handwrist bone and cervical vertebral analyses in measuring skeletal maturation. Angle Orthod 2006;76:984-9. DOI: 10.2319/070605-217.
- Szemraj A, Wojtaszek-Słomińska A, Racka-Pilszak B. Is the Cervical Vertebral Maturation (CVM) method effective enough to replace the Hand-Wrist Maturation (HWM) method in determining skeletal maturation?-A systematic review. Eur J Radiol 2018;102:125-8. DOI: 10.1016/j.ejrad.2018.03.012.
- Yucekul A, Yilgor C, Demirci N, Gurel IE, Orhun O, Karaman MI, et al. A comparative analysis of axial and appendicular skeletal maturity staging systems through assessment of longitudinal growth and curve modulation after VBT surgery. Eur Spine J 2025;34:251-62. DOI: 10.1007/s00586-024-08488-z.
- Cheung STY, Cheung GCC, Cheung JPY, Cheung PWH. The utility of cervical vertebral maturation method for staging skeletal growth and curve progression in patients with adolescent idiopathic scoliosis. JB JS Open Access 2025;10:e25.00184. DOI: 10.2106/JBJS.OA.25.00184.
- Yıldırım C, Muratoğlu OG, Turan K, Ergün T, Mısır A, Aydın M. The intra- and interobserver reliability of five commonly used intertrochanteric femur fracture classification systems. Jt Dis Relat Surg 2022;33:187-92. DOI: 10.52312/jdrs.2022.498.
- Demirel M, Yenigün MY, Mert L, Kendirci AŞ, Yağci TF, Demir TB, et al. Intra- and inter-observer reliability of DiasTachdjian classification in pediatric ankle fractures: Do clinical experience and expertise matter? J Pediatr Orthop B 2024;33:240-5. DOI: 10.1097/BPB.0000000000001097.
- Prevezas N, Antypas G, Louverdis D, Konstas A, Papasotiriou A, Sbonias G. Proposed guidelines for increasing the reliability and validity of Letournel classification system. Injury 2009;40:1098-103. DOI: 10.1016/j.injury.2009.06.005.
- Alkhal HA, Wong RW, Rabie AB. Correlation between chronological age, cervical vertebral maturation and Fishman’s skeletal maturity indicators in southern Chinese. Angle Orthod 2008;78:591-6. doi: 10.2319/0003-3219(2008)078[0591:CBCACV]2.0.CO;2.
- Flores-Mir C, Burgess CA, Champney M, Jensen RJ, Pitcher MR, Major PW. Correlation of skeletal maturation stages determined by cervical vertebrae and hand-wrist evaluations. Angle Orthod 2006;76:1-5. doi: 10.1043/0003-3219(2006)076[0001:COSMSD]2.0.CO;2.
- Zhang Y, Shu S, Gu Q, Liu Z, Zhu Z, Qiu Y, et al. Cervical Vertebral Maturation (CVM) stage as a supplementary indicator for the assessment of Peak Height Velocity (PHV) in Adolescent Idiopathic Scoliosis (AIS). Quant Imaging Med Surg 2020;10:96-105. DOI: 10.21037/qims.2019.11.07.
- Cunha AC, Cevidanes LH, Sant'Anna EF, Guedes FR, Luiz RR, McNamara JA, et al. Staging hand-wrist and cervical vertebrae images: A comparison of reproducibility. Dentomaxillofac Radiol 2018;47:20170301. DOI: 10.1259/dmfr.20170301.
- Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol 2011;64:96-106. DOI: 10.1016/j.jclinepi.2010.03.002.
- Hussain U, Ul Hassan F, Kamran MA, Alnazeh AA, Ullah I, Alam S. Inter-observer and intra-observer agreement of cervical vertebral maturation staging: A systematic review and meta-analysis. Int Orthod 2024;22:100874. DOI: 10.1016/j.ortho.2024.100874.
- Rainey BJ, Burnside G, Harrison JE. Reliability of cervical vertebral maturation staging. Am J Orthod Dentofacial Orthop 2016;150:98-104. DOI: 10.1016/j.ajodo.2015.12.013.
- Jaqueira LM, Armond MC, Pereira LJ, Alcântara CE, Marques LS. Determining skeletal maturation stage using cervical vertebrae: Evaluation of three diagnostic methods. Braz Oral Res 2010;24:433-7. DOI: 10.1590/s1806-83242010000400010.
- Rongo R, Valleta R, Bucci R, Bonetti GA, Michelotti A, D'Antò V. Does clinical experience affect the reproducibility of cervical vertebrae maturation method? Angle Orthod 2015;85:841-7. DOI: 10.2319/080414-544.1.
