Content Validity of Self-Report Measurement Instruments: An Illustration From the Development of the Brain Tumor Module of the M.D. Anderson Symptom Inventory
Purpose/Objectives: To illustrate one technique for establishing content validity of measurements using the initial development and testing of the M.D. Anderson Symptom Inventory Brain Tumor Module.
Data Sources: Published articles, book chapters, and subjective judgments of experts.
Data Synthesis: Content validity is the essential first step in the development of items to be included in a measurement instrument. Content validity is a criterion-referenced process that is judged by how well each item in a newly developed instrument reflects its respective objective or content domain. The stages in addressing content validity include a developmental stage and a judgment-quantification stage. Steps involved in the developmental stage include domain identification, item generation, and instrument formation. The judgment-quantification stage is when experts review the items and either report validity of the items subjectively or with an empirically referenced method, such as calculation of the content validity index. The content validity of a set of questions designed to measure symptoms in a population of patients with primary brain tumors was ascertained by using the calculation of the content validity index.
Conclusions: The final version of the M.D. Anderson Symptom Inventory Brain Tumor Module consists of the 13 core items and 18 additional items designated as valid by a panel of experts. The instrument will be administered to a group of patients to determine construct validity and reliability of the items.
Implications for Nursing: Self-report instruments are used to measure various health outcomes in oncology. Oncology nurses are in a key position to develop such instruments to be used in clinical care and research of symptoms associated with cancer. Understanding the process of content validation is an essential first step in developing new instruments.
Jump to a section
References
Armstrong, C., Mollman, J., Corn, B.W., Alavi, J., & Grossman, M. (1993). Effects of radiation therapy on adult brain behavior: Evidence for a rebound phenomenon in a phase 1 trial. Neurology, 43, 1961-1965.
Armstrong, T.S. (2003). Symptoms experience: A concept analysis. Oncology-Nursing Forum, 30, 601-606.
Armstrong, T.S., & Gilbert, M.R. (1996). Glial neoplasms: Classification, treatment, and pathways for the future. Oncology Nursing Forum, 23, 615-625.
Armstrong, T.S., Kanusky, J.T., & Gilbert, M.R. (2003). Seize the moment to learn about epilepsy in people with cancer. Clinical Journal of Oncology Nursing, 7, 163-169.
Beck, C.T., & Gable, R.K. (2001). Ensuring content validity: An illustration of the process. Journal of Nursing Measurement, 9(2), 201-215.
Cleeland, C.S., Mendoza, T.R., Wang, X.S., Chou, C., Harle, M.T., Morrissey, M., et al. (2000). Assessing symptom distress in cancer patients: The M.D. Anderson Symptom Inventory. Cancer, 89, 1634-1646.
Davis, L. (1992). Instrument review: Getting the most from your panel of experts. Applied Nursing Research, 5, 104-107.
Dropcho, E.J. (1991). Central nervous system injury by therapeutic irradiation. Neurologic Clinics, 9, 969-988.
Faithfull, S. (1991). Patients' experiences following cranial radiotherapy: A study of the somnolence syndrome. Journal of Advanced Nursing, 16, 939-946.
Gable, R.K., & Wolfe, M.B. (1993). Instrument development in the affective domain: Measuring attitudes and values in corporate and school settings. Boston: Kluwer Academic.
Grant, J.S., & Davis, L.L. (1997). Selection and use of content experts for instrument development. Research in Nursing and Health, 20, 269-274.
Grant, J.S., & Kinney, M.R. (1992). Using the Delphi technique to examine the content validity of nursing diagnoses. Nursing Diagnosis, 3, 12-22.
Guttman, L. (1969). Integration of test design and analysis. In Proceedings of the 1969 invitational conference on testing problems (pp. 15-18). Princeton, NJ: Educational Testing Services.
Kiebert, G.M., Curran, D., Aaronson, N.K., Bolla, M., Menten, J., & Rutten, E.H., et al. (1998). Quality of life after radiation therapy of cerebral low-grade gliomas of the adult: Results of a randomised phase III trial on dose response (EORTC trial 22844). European Journal of Cancer, 34, 1902-1909.
Lee, Y.Y., Nauert, C., & Glass, J.P. (1986). Treatment-related white matter changes in cancer patients. Cancer, 57, 1473-1482.
Lenz, E.R., Pugh, L.C., Milligan, R.A., Gift, A., & Suppe, F. (1997). The middle-range theory of unpleasant symptoms: An update. Advances in Nursing Science, 19(3), 14-27.
Lynn, M.R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382-385.
Maire, J.P., Coudin, B., Guerin, J., & Caudry, M. (1987). Neuropsychologic impairment in adults with brain tumors. American Journal of Clinical Oncology, 10, 156-162.
McKeran, R.O., & Thomas, D.G. (1980). The clinical study of glioma. In D.G. Thomas & D.L. Graham (Eds.), Brain tumors: Scientific basis, clinical investigation, and current therapy (pp. 194-230). Baltimore: Lippincott.
Osburn, H.G. (1968). Item sampling for achievement testing. Educational and Psychological Measurement, 28, 95-107.
Popham, W.J. (1978). Criterion-referenced measurement. Englewood Cliffs, NJ: Prentice-Hall.
Rabbitt, J.E., & Page, M.S. (1998). Selected complications in neuro-oncology patients. Seminars in Oncology Nursing, 14(1), 53-60.
Radhakrishnan, K., Mokri, B., Parisi, J.E., O'Fallon, W.M., Sunku, J., & Kurland, L.T. (1995). The trends in incidence of primary brain tumors in the population of Rochester, Minnesota. Annals of Neurology, 37(1), 67-73.
Saw, S.M., & Ng, T.P. (2001). The design and assessment of questionnaires in clinical research. Singapore Medical Journal, 42(3), 131-135.
Scheibel, R.S., Meyers, C.A., & Levin, V.A. (1996). Cognitive dysfunction following surgery for intracerebral glioma: Influence of histopathology, lesion location, and treatment. Journal of Neuro-Oncology, 30, 61-69.
Strohl, R.A. (1998). Radiation therapy in tumors of the central nervous system. Seminars in Oncology Nursing, 14(1), 26-33.
Tilden, V.P., Nelson, C.A., & May, B.A. (1990Use of qualitative methods to enhance content validity. Nursing Research, 39, 172-175.
Waltz, C.F., Strickland, O., & Lenz, E. (1991). Measurement in nursing research (2nd ed.). Philadelphia: F.A. Davis.
Waltz, C.W., & Bausell, R.B. (1981). Nursing research: Design, statistics, and computer analysis. Philadelphia: F.A. Davis