Purpose
(1) To evaluate the quality of knee articular cartilage surgery literature using established
methodologic quality instruments, and (2) to assess whether study quality has improved
with time.
Methods
A systematic review was performed using PRISMA (Preferred Reporting Items for Systematic
Reviews and Meta-Analyses) guidelines. Studies of autologous chondrocyte implantation
(ACI), osteochondral autograft and allograft transplant, and microfracture were analyzed.
Study methodologic quality was assessed by the level of evidence and 9 different methodologic
quality questionnaires. Comparisons were made between different surgical technique
groups by use of Student's t tests. Assessment of study quality improvement with time was performed by comparison
of the Coleman Methodology Score (CMS) from the included studies (2004 to present)
and CMS from a prior study assessing quality of articular cartilage studies (1985
to 2004). Furthermore, assessment of study quality improvement with time was performed
over the period of the included studies (2004 to present).
Results
We included 194 studies (11,787 subjects). Most evidence was Level IV (76%) and nonrandomized
(91%). ACI was the most commonly reported technique (62% of studies). Only 34% of
studies denied the presence of a financial conflict of interest. The mean subject
age was 33.5 ± 8.2 years, and the mean length of follow-up was 3.7 ± 2.3 years. By
use of study quality questionnaires, the methodologic quality of articular cartilage
studies was poor. However, study quality (after 2004) was significantly improved versus
that reported from a prior study (before 2004) using the CMS (P < .01). The mean level of evidence, CMS, CONSORT (Consolidated Standards of Reporting
Trials) score, and Jadad score showed no significant improvement over the period of
the included studies (P > .05). The quality of randomized controlled trials (RCTs) was significantly higher
than that of non-RCTs (P < .05). The most common study weaknesses included blinding, subject selection process,
study type, sample size calculation, and outcome measures and assessment.
Conclusions
The methodologic quality of knee articular cartilage surgery studies was poor overall
and also for individual techniques (ACI, osteochondral autograft transplant, osteochondral
allograft transplant, and microfracture). However, the overall quality of the investigations
in this review (after June 2004) has significantly improved in comparison to those
published before 2004. The quality of RCTs was significantly higher than that of non-RCTs.
Level of evidence, CMS, CONSORT score, and Jadad score did not significantly improve
with later publication date within the period of the studies analyzed. Methodologic
quality deficiencies identified in this investigation may be used to guide future
articular cartilage studies’ design, conduct, and reporting.
Level of Evidence
Level IV, systematic review of studies with Levels of Evidence I-IV.
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to ArthroscopyAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Cartilage injuries: A review of 31,516 knee arthroscopies.Arthroscopy. 1997; 13: 456-460
- Articular cartilage defects: Study of 25,124 knee arthroscopies.Knee. 2007; 14: 177-182
- Factors influencing the outcome of ACI: A systematic review.J Knee Surg. 12 November, 2012; ([Epub ahead of print.])
- Sensitivity of magnetic resonance imaging for detection of patellofemoral articular cartilage defects.Arthroscopy. 2012; 28: 1728-1737
- Focal cartilage defects in the knee impair quality of life as much as severe osteoarthritis.Am J Sports Med. 2010; 38: 231-237
CfMMS (CMS [Center for Medicare & Medicaid Services]). Hospital care quality information from the consumer perspective. Available from: www.hcahpsonline.org. Accessed May 6, 2012.
- An analysis of the quality of cartilage repair studies.J Bone Joint Surg Am. 2005; 87: 2232-2239
- Limitations and sources of bias in clinical knee cartilage research.Arthroscopy. 2012; 28: 1315-1325
- Failures, re-operations, and complications after autologous chondrocyte implantation—A systematic review.Osteoarthritis Cartilage. 2011; 19: 779-791
- Autologous chondrocyte implantation: A systematic review.J Bone Joint Surg Am. 2010; 92: 2220-2233
- Adhesive capsulitis of the shoulder: A systematic review of the effectiveness of intra-articular corticosteroid injections.J Bone Joint Surg Am. 2011; 93: 1727-1733
- Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement.J Clin Epidemiol. 2009; 62: 1006-1012
- Levels of evidence in orthopaedic journals.J Bone Joint Surg Am. 2005; 87: 2632-2638
- Studies of surgical outcome after patellar tendinopathy: Clinical significance of methodological deficiencies and guidelines for future studies.Scand J Med Sci Sports. 2000; 10: 2-11
- Outcome of surgery for chronic Achilles tendinopathy. A critical review.Am J Sports Med. 2001; 29: 315-320
- Measuring shoulder function: A systematic review of four questionnaires.Arthritis Rheum. 2009; 61: 623-632
Trials TCG-TRo (The CONSORT Group - Transparent Reporting of Trials). The CONSORT statement. January 20, 2012. Available from: http://www.consort-statement.org/consort-statement/overview0/#checklist. Accessed November 3, 2012.
- Jadad A. Enkin M. Randomized controlled trials: Questions, answers, and musings. Ed 2. Blackwell, Hoboken, New Jersey2007
- Incorporating variations in the quality of individual randomized trials into meta-analysis.J Clin Epidemiol. 1992; 45: 255-265
Cochrane Collaboration. Cochrane Bone, Joint and Muscle Trauma Group. Resources for developing a review. Available from: http://bjmtg.cochrane.org/sites/bjmtg.cochrane.org/files/uploads/Quality%20assessment%20tool.pdf. Accessed January 8, 2013.
- The Delphi list: A criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi Consensus.J Clin Epidemiol. 1998; 51: 1235-1241
- A checklist to evaluate a report of a nonpharmacological trial (CLEAR NPT) was developed using consensus.J Clin Epidemiol. 2005; 58: 1233-1240
- Introducing levels of evidence to the journal.J Bone Joint Surg Am. 2003; 85: 1-3
- Relationship between declared funding support and level of evidence.J Bone Joint Surg Am. 2010; 92: 1647-1651
- Conflict of interest in orthopaedic research. An association between findings and funding in scientific presentations.J Bone Joint Surg Am. 2007; 89: 608-613
- Can we trust studies published by authors with financial conflicts? Using the decline of metal-on-metal total hip arthroplasty to investigate.J Arthroplasty. 2012; 27: 41-45.e1
- A correlation between the timing of biopsy after autologous chondrocyte implantation and the histological appearance.J Bone Joint Surg Br. 2009; 91: 1172-1177
- Characteristics of repair tissue in second-look and third-look biopsies from patients treated with engineered cartilage: Relationship to symptomatology and time after implantation.Arthritis Res Ther. 2008; 10: R132
- Treatment of chondral defects in the athlete’s knee.Arthroscopy. 2010; 26: 841-852
- Osteochondral autologous transplantation versus microfracture for the treatment of articular cartilage defects in the knee joint in athletes.Knee Surg Sports Traumatol Arthrosc. 2006; 14: 834-842
- High-impact athletics after knee articular cartilage repair: A prospective evaluation of the microfracture technique.Am J Sports Med. 2006; 34: 1413-1418
- Treatment of full thickness chondral lesions of the knee with microfracture in a group of athletes.Knee Surg Sports Traumatol Arthrosc. 2005; 13: 213-221
- Treatment of articular cartilage defects in athletes: An analysis of functional outcome and lesions appearance.Orthopedics. 1998; 21: 761-767
- Arthroscopic partial meniscectomy: A long-term follow-up.Arthroscopy. 1992; 8: 345-349
- Knee joint changes after meniscectomy.J Bone Joint Surg Br. 1948; 30: 664-670
- Increased failure rate of autologous chondrocyte implantation after previous treatment with marrow stimulation techniques.Am J Sports Med. 2009; 37: 902-908
- Predictors of radiographic knee osteoarthritis after anterior cruciate ligament reconstruction.Am J Sports Med. 2011; 39: 2595-2603
- High tibial osteotomy for the treatment of unicompartmental knee osteoarthritis: A review of the literature, indications, and technique.Phys Sportsmed. 2011; 39: 45-54
- Triad of cartilage restoration for unicompartmental arthritis treatment in young patients: Meniscus allograft transplantation, cartilage repair and osteotomy.J Knee Surg. 2009; 22: 137-141
- Biological knee reconstruction: A systematic review of combined meniscal allograft transplantation and cartilage repair or restoration.Arthroscopy. 2011; 27: 409-418
- Management of knee articular cartilage injuries.in: Dragoo J. Modern arthroscopy. InTech, New York2011: 103-128
- Treatment of deep cartilage defects in the knee with autologous chondrocyte transplantation.N Engl J Med. 1994; 331: 889-895
- Surgical management of juvenile osteochondritis dissecans of the knee.Knee Surg Sports Traumatol Arthrosc. 2012; 20: 2419-2429
- Patient-reported outcome measures for the knee.J Knee Surg. 2011; 23: 137-151
- Advanced MRI of articular cartilage.Imaging Med. 2011; 3: 541-555
- The clinical utility and diagnostic performance of MRI for identification and classification of knee osteochondritis dissecans.J Bone Joint Surg Am. 2012; 94: 1036-1044
- The clinical utility and diagnostic performance of magnetic resonance imaging for identification of early and advanced knee osteoarthritis: A systematic review.Am J Sports Med. 2011; 39: 1557-1568
Article info
Publication history
Published online: April 29, 2013
Accepted:
February 20,
2013
Received:
January 10,
2013
Footnotes
The authors report that they have no conflicts of interest in the authorship and publication of this article.
Note: To access the supplementary tables accompanying this report, visit the July issue of Arthroscopy at www.arthroscopyjournal.org.
Identification
Copyright
© 2013 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.
