Advertisement

How Should We Define Clinically Significant Improvement on Patient-Reported Outcomes Measurement Information System Test for Patients Undergoing Knee Meniscal Surgery?

      Purpose

      The purpose of the study was to define the minimal clinically important difference (MCID), substantial clinical benefit (SCB), and patient acceptable symptomatic state (PASS) thresholds for the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) computerized adaptive test (CAT) instrument in patients undergoing arthroscopic meniscal surgery.

      Methods

      The PROMIS PF CAT was administered preoperatively and postoperatively to patients undergoing arthroscopic meniscal surgery. At 6 months postoperatively, patients graded their knee function based on a domain-specific anchor question. A satisfaction anchor question was used to indicate achievement of the PASS. Receiver operating characteristic analysis determined the relevant psychometric values. Cutoff analysis was performed to find preoperative patient-reported outcome scores predicting achievement of clinically significant outcomes (CSOs).

      Results

      A total of 73 patients (41.1% female patients) were included, with a mean age of 44.9 ± 12.8.0 years and average follow-up period of 24.0 ± 1.2 weeks. The MCID on the PROMIS PF CAT was calculated to be 2.09 (area under the curve [AUC], 0.75; 95% CI, 0.57-0.94). Net score improvement equivalent to achievement of SCB was found to be 6.50 (AUC, 0.77; 95% CI, 0.55-0.99). The PASS was found to be 46.1 (AUC, 0.86; 95% CI, 0.76-0.96). A preoperative score below 37.6 on the PROMIS PF CAT predicted achievement of the MCID (AUC, 0.76; 95% CI, 0.62-0.87), whereas scores above 41.9 predicted achievement of the PASS (AUC, 0.77; 95% CI, 0.65-0.90). Higher baseline functional status and the absence of pre-existing arthritis were also found to be statistically significant predictors of achieving CSOs.

      Conclusions

      Our study defined the MCID, SCB, and PASS for the PROMIS PF CAT. We found that a preoperative score below 37.6 was predictive of achieving a meaningful clinical change with surgery whereas a preoperative score above 41.9 was predictive of patients who would attain an acceptable postoperative health state. In addition, exercising more days per week and the absence of arthritis increased the likelihood of achieving postoperative CSOs.

      Level of Evidence

      Level III, retrospective cohort.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Arthroscopy
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Kim S.
        • Bosque J.
        • Meehan J.P.
        • Jamali A.
        • Marder R.
        Increase in outpatient knee arthroscopy in the United States: A comparison of National Surveys of Ambulatory Surgery, 1996 and 2006.
        J Bone Joint Surg Am. 2011; 93: 994-1000
        • Brignardello-Petersen R.
        • Guyatt G.H.
        • Buchbinder R.
        • et al.
        Knee arthroscopy versus conservative management in patients with degenerative knee disease: A systematic review.
        BMJ Open. 2017; 7: e016114
        • Salzler M.J.
        • Lin A.
        • Miller C.D.
        • Herold S.
        • Irrgang J.J.
        • Harner C.D.
        Complications after arthroscopic knee surgery.
        Am J Sports Med. 2014; 42: 292-296
        • Pihl K.
        • Englund M.
        • Lohmander L.S.
        • et al.
        Signs of knee osteoarthritis common in 620 patients undergoing arthroscopic surgery for meniscal tear.
        Acta Orthop. 2017; 88: 90-95
        • Cella D.
        • Yount S.
        • Rothrock N.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap cooperative group during its first two years.
        Med Care. 2007; 45: S3-S11
        • Fries J.F.
        • Bruce B.
        • Cella D.
        The promise of PROMIS: Using item response theory to improve assessment of patient-reported outcomes.
        Clin Exp Rheumatol. 2005; 23: S53-S57
        • Senders A.
        • Hanes D.
        • Bourdette D.
        • Whitham R.
        • Shinto L.
        Reducing survey burden: Feasibility and validity of PROMIS measures in multiple sclerosis.
        Mult Scler. 2014; 20: 1102-1111
        • Spiegel B.M.
        • Hays R.D.
        • Bolus R.
        • et al.
        Development of the NIH Patient-Reported Outcomes Measurement Information System (PROMIS) gastrointestinal symptom scales.
        Am J Gastroenterol. 2014; 109: 1804-1814
        • Hancock K.J.
        • Glass N.
        • Anthony C.A.
        • et al.
        Performance of PROMIS for healthy patients undergoing meniscal surgery.
        J Bone Joint Surg Am. 2017; 99: 954-958
        • Anthony C.A.
        • Glass N.A.
        • Hancock K.
        • Bollier M.
        • Wolf B.R.
        • Hettrich C.M.
        Performance of PROMIS instruments in patients with shoulder instability.
        Am J Sports Med. 2017; 45: 449-453
        • Zuke W.A.
        • Leroux T.S.
        • Gregory B.P.
        • et al.
        Establishing maximal medical improvement after arthroscopic rotator cuff repair.
        Am J Sports Med. 2018; 46: 1000-1007
        • Jaeschke R.
        • Singer J.
        • Guyatt G.H.
        Measurement of health status. Ascertaining the minimal clinically important difference.
        Control Clin Trials. 1989; 10: 407-415
        • Werner B.C.
        • Chang B.
        • Nguyen J.T.
        • Dines D.M.
        • Gulotta L.V.
        What change in American Shoulder and Elbow Surgeons score represents a clinically important change after shoulder arthroplasty?.
        Clin Orthop Relat Res. 2016; 474: 2672-2681
        • Cook C.E.
        Clinimetrics corner: The minimal clinically important change score (MCID): A necessary pretense.
        J Man Manip Ther. 2008; 16: E82-E83
        • Nwachukwu B.U.
        • Chang B.
        • Fields K.
        • et al.
        Defining the "substantial clinical benefit" after arthroscopic treatment of femoroacetabular impingement.
        Am J Sports Med. 2017; 45: 1297-1303
        • Glassman S.D.
        • Copay A.G.
        • Berven S.H.
        • Polly D.W.
        • Subach B.R.
        • Carreon L.Y.
        Defining substantial clinical benefit following lumbar spine arthrodesis.
        J Bone Joint Surg Am. 2008; 90: 1839-1847
        • Katz N.P.
        • Paillard F.C.
        • Ekman E.
        Determining the clinical importance of treatment benefits for interventions for painful orthopedic conditions.
        J Orthop Surg Res. 2015; 10: 24
        • Maksymowych W.P.
        • Richardson R.
        • Mallon C.
        • van der Heijde D.
        • Boonen A.
        Evaluation and validation of the patient acceptable symptom state (PASS) in patients with ankylosing spondylitis.
        Arthritis Rheum. 2007; 57: 133-139
        • Nwachukwu B.U.
        • Chang B.
        • Kahlenberg C.A.
        • et al.
        Arthroscopic treatment of femoroacetabular impingement in adolescents provides clinically significant outcome improvement.
        Arthroscopy. 2017; 33: 1812-1818
        • Nwachukwu B.U.
        • Chang B.
        • Rotter B.Z.
        • Kelly B.T.
        • Ranawat A.S.
        • Nawabi D.H.
        Minimal clinically important difference and substantial clinical benefit after revision hip arthroscopy.
        Arthroscopy. 2018; 34: 1862-1868
        • Nwachukwu B.U.
        • Fields K.
        • Chang B.
        • Nawabi D.H.
        • Kelly B.T.
        • Ranawat A.S.
        Preoperative outcome scores are predictive of achieving the minimal clinically important difference after arthroscopic treatment of femoroacetabular impingement.
        Am J Sports Med. 2017; 45: 612-619
        • Sihvonen R.
        • Paavola M.
        • Malmivaara A.
        • et al.
        Arthroscopic partial meniscectomy versus sham surgery for a degenerative meniscal tear.
        N Engl J Med. 2013; 369: 2515-2524
        • Perruccio A.V.
        • Stefan Lohmander L.
        • Canizares M.
        • et al.
        The development of a short measure of physical function for knee OA KOOS-Physical Function Shortform (KOOS-PS)—An OARSI/OMERACT initiative.
        Osteoarthritis Cartilage. 2008; 16: 542-550
        • Park K.B.
        • Shin J.S.
        • Lee J.
        • et al.
        Minimum clinically important difference and substantial clinical benefit in pain, functional, and quality of life scales in failed back surgery syndrome patients.
        Spine (Phila Pa 1976). 2017; 42: E474-E481
        • Juniper E.F.
        • Guyatt G.H.
        • Willan A.
        • Griffith L.E.
        Determining a minimal important change in a disease-specific quality of life questionnaire.
        J Clin Epidemiol. 1994; 47: 81-87
        • Simovitch R.
        • Flurin P.H.
        • Wright T.
        • Zuckerman J.D.
        • Roche C.P.
        Quantifying success after total shoulder arthroplasty: The minimal clinically important difference.
        J Shoulder Elbow Surg. 2018; 27: 298-305
        • Berliner J.L.
        • Brodke D.J.
        • Chan V.
        • SooHoo N.F.
        • Bozic K.J.
        John Charnley Award: Preoperative patient-reported outcome measures predict clinically meaningful improvement in function after THA.
        Clin Orthop Relat Res. 2016; 474: 321-329
        • Hung M.
        • Bounsanga J.
        • Voss M.W.
        • Saltzman C.L.
        Establishing minimum clinically important difference values for the Patient-Reported Outcomes Measurement Information System Physical Function, hip disability and osteoarthritis outcome score for joint reconstruction, and Knee Injury and Osteoarthritis Outcome Score for joint reconstruction in orthopaedics.
        World J Orthop. 2018; 9: 41-49
        • Lee A.C.
        • Driban J.B.
        • Price L.L.
        • Harvey W.F.
        • Rodday A.M.
        • Wang C.
        Responsiveness and minimally important differences for 4 patient-reported outcomes measurement information system short forms: Physical function, pain interference, depression, and anxiety in knee osteoarthritis.
        J Pain. 2017; 18: 1096-1110
        • Yost K.J.
        • Eton D.T.
        • Garcia S.F.
        • Cella D.
        Minimally important differences were estimated for six Patient-Reported Outcomes Measurement Information System-Cancer scales in advanced-stage cancer patients.
        J Clin Epidemiol. 2011; 64: 507-516
        • Thissen D.
        • Liu Y.
        • Magnus B.
        • et al.
        Estimating minimally important difference (MID) in PROMIS pediatric measures using the scale-judgment method.
        Qual Life Res. 2016; 25: 13-23
        • Hung M.
        • Saltzman C.L.
        • Kendall R.
        • et al.
        What are the MCIDs for PROMIS, NDI, and ODI instruments among patients with spinal conditions?.
        Clin Orthop Relat Res. 2018; 476: 2027-2036
        • Escobar A.
        • Gonzalez M.
        • Quintana J.M.
        • et al.
        Patient acceptable symptom state and OMERACT-OARSI set of responder criteria in joint replacement. Identification of cut-off values.
        Osteoarthritis Cartilage. 2012; 20: 87-92
        • Escobar A.
        • Riddle D.L.
        Concordance between important change and acceptable symptom state following knee arthroplasty: The role of baseline scores.
        Osteoarthritis Cartilage. 2014; 22: 1107-1110
        • Hamrin Senorski E.
        • Sundemo D.
        • Svantesson E.
        • et al.
        Preoperative and intraoperative predictors of long-term acceptable knee function and osteoarthritis after anterior cruciate ligament reconstruction: An analysis based on 2 randomized controlled trials.
        Arthroscopy. 2019; 35: 489-499
        • Hamrin Senorski E.
        • Svantesson E.
        • Beischer S.
        • et al.
        Factors affecting the achievement of a patient-acceptable symptom state 1 year after anterior cruciate ligament reconstruction: A cohort study of 343 patients from 2 registries.
        Orthop J Sports Med. 2018; 6 (2325967118764317)
        • Ingelsrud L.H.
        • Granan L.P.
        • Terwee C.B.
        • Engebretsen L.
        • Roos E.M.
        Proportion of patients reporting acceptable symptoms or treatment failure and their associated KOOS values at 6 to 24 months after anterior cruciate ligament reconstruction: A study from the Norwegian Knee Ligament Registry.
        Am J Sports Med. 2015; 43: 1902-1907
        • Keurentjes J.C.
        • Van Tol F.R.
        • Fiocco M.
        • et al.
        Patient acceptable symptom states after total hip or knee replacement at mid-term follow-up: Thresholds of the Oxford hip and knee scores.
        Bone Joint Res. 2014; 3: 7-13
        • Muller B.
        • Yabroudi M.A.
        • Lynch A.
        • et al.
        Defining thresholds for the patient acceptable symptom state for the IKDC Subjective Knee Form and KOOS for patients who underwent ACL reconstruction.
        Am J Sports Med. 2016; 44: 2820-2826
        • Paulsen A.
        • Roos E.M.
        • Pedersen A.B.
        • Overgaard S.
        Minimal clinically important improvement (MCII) and patient-acceptable symptom state (PASS) in total hip arthroplasty (THA) patients 1 year postoperatively.
        Acta Orthop. 2014; 85: 39-48
        • Chiowchanwisawakit P.
        • Thaweeratthakul P.
        • Wattanamongkolsil L.
        • et al.
        Relationship between health-related quality of life and patient acceptable symptom state with disease activity and functional status in patients with ankylosing spondylitis in Thailand: A cross-sectional study.
        J Clin Rheumatol. 2019; 25: 16-23
        • Bernholt D.
        • Wright R.W.
        • Matava M.J.
        • Brophy R.H.
        • Bogunovic L.
        • Smith M.V.
        Patient reported outcomes measurement information system scores are responsive to early changes in patient outcomes following arthroscopic partial meniscectomy.
        Arthroscopy. 2018; 34: 1113-1117
        • Liu S.
        • Schwab F.
        • Smith J.S.
        • et al.
        Likelihood of reaching minimal clinically important difference in adult spinal deformity: A comparison of operative and nonoperative treatment.
        Ochsner J. 2014; 14: 67-77
        • Kronzer V.L.
        • Jerry M.R.
        • Ben Abdallah A.
        • et al.
        Changes in quality of life after elective surgery: An observational study comparing two measures.
        Qual Life Res. 2017; 26: 2093-2102
        • Greco N.J.
        • Anderson A.F.
        • Mann B.J.
        • et al.
        Responsiveness of the International Knee Documentation Committee Subjective Knee Form in comparison to the Western Ontario and McMaster Universities Osteoarthritis Index, modified Cincinnati Knee Rating System, and Short Form 36 in patients with focal articular cartilage defects.
        Am J Sports Med. 2010; 38: 891-902
        • Irrgang J.J.
        • Anderson A.F.
        • Boland A.L.
        • et al.
        Responsiveness of the International Knee Documentation Committee Subjective Knee Form.
        Am J Sports Med. 2006; 34: 1567-1573
        • Roos E.M.
        • Lohmander L.S.
        The Knee injury and Osteoarthritis Outcome Score (KOOS): From joint injury to osteoarthritis.
        Health Qual Life Outcomes. 2003; 1: 64
        • Papuga M.O.
        • Beck C.A.
        • Kates S.L.
        • Schwarz E.M.
        • Maloney M.D.
        Validation of GAITRite and PROMIS as high-throughput physical function outcome measures following ACL reconstruction.
        J Orthop Res. 2014; 32: 793-801
        • Bin Abd Razak H.R.
        • Tan C.S.
        • Chen Y.J.
        • et al.
        Age and preoperative knee society score are significant predictors of outcomes among Asians following total knee arthroplasty.
        J Bone Joint Surg Am. 2016; 98: 735-741
        • Chen R.E.
        • Papuga M.O.
        • Voloshin I.
        • et al.
        Preoperative PROMIS scores predict postoperative outcomes after primary ACL reconstruction.
        Orthop J Sports Med. 2018; 6 (2325967118771286)
        • Nwachukwu B.U.
        • Chang B.
        • Voleti P.B.
        • et al.
        Preoperative Short Form Health Survey score is predictive of return to play and minimal clinically important difference at a minimum 2-year follow-up after anterior cruciate ligament reconstruction.
        Am J Sports Med. 2017; 45: 2784-2790
        • Calatayud J.
        • Casana J.
        • Ezzatvar Y.
        • Jakobsen M.D.
        • Sundstrup E.
        • Andersen L.L.
        High-intensity preoperative training improves physical and functional recovery in the early post-operative periods after total knee arthroplasty: A randomized controlled trial.
        Knee Surg Sports Traumatol Arthrosc. 2017; 25: 2864-2872
        • Phruetthiphat O.A.
        • Koehler D.M.
        • Karam M.D.
        • Rungprai C.
        • Gao Y.
        • Marsh J.L.
        Preinjury aerobic fitness predicts postoperative outcome and activity level after acetabular fracture fixation.
        J Orthop Trauma. 2016; 30: e267-e272
        • Covall D.J.
        • Wasilewski S.A.
        Roentgenographic changes after arthroscopic meniscectomy: Five-year follow-up in patients more than 45 years old.
        Arthroscopy. 1992; 8: 242-246
        • Englund M.
        • Roos E.M.
        • Lohmander L.S.
        Impact of type of meniscal tear on radiographic and symptomatic knee osteoarthritis: A sixteen-year followup of meniscectomy with matched controls.
        Arthritis Rheum. 2003; 48: 2178-2187
        • Ghislain N.A.
        • Wei J.N.
        • Li Y.G.
        Study of the clinical outcome between traumatic and degenerative (non-traumatic) meniscal tears after arthroscopic surgery: A 4-years follow-up study.
        J Clin Diagn Res. 2016; 10: RC01-RC04
        • Menetrey J.
        • Siegrist O.
        • Fritschy D.
        Medial meniscectomy in patients over the age of fifty: A six year follow-up study.
        Swiss Surg. 2002; 8: 113-119
        • Thorlund J.B.
        • Englund M.
        • Christensen R.
        • et al.
        Patient reported outcomes in patients undergoing arthroscopic partial meniscectomy for traumatic or degenerative meniscal tears: Comparative prospective cohort study.
        BMJ. 2017; 356: j356