Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders

Angela J. Hobson, David Sterling, Brett Emo, Bradley A. Evanoff, Callen S. Sterling, Laura Good, Noah Seixas, Harvey Checkoway, Brad A. Racette

Research output: Contribution to journalArticleResearchpeer-review

17 Citations (Scopus)

Abstract

This study assessed the validity and test-retest reliability of a medical and occupational history questionnaire for workers performing welding in the shipyard industry. This self-report questionnaire was developed for an epidemiologic study of the risk of parkinsonism in welders. Validity participants recruited from three similar shipyards were asked to give consent for access to personnel files and complete the questionnaire. Responses on the questionnaire were compared with information extracted from personnel records. Reliability participants were recruited from the same shipyards and were asked to complete the questionnaire at two different times approximately 4 weeks apart. Percent agreement, kappa, intraclass correlation coefficient (ICC), and sensitivity and specificity were used as measures of validity and/or reliability. Personnel files were obtained for 101 of 143 participants (70%) in the validity study, and 56 of the 95 (58.9%) participants in the reliability study completed the retest of the questionnaire. Validity scores for items extracted from personnel files were high. Percent agreement for employment dates and job titles ranged from 83-100%, while ICC for start and stop dates ranged from 0.93-0.99. Sensitivity and specificity for current job title ranged from 0.5-1.0. Reliability scores for demographic, medical and health behavior items were mainly moderate or high, but ranged from 0.19 to 1.0. Most recent job/title items such as title, types of welding performed, and material used showed substantial to perfect agreement. Certain determinants of exposure such as days and hours per week exposed to welding fumes demonstrated mainly moderate agreement (κ = 0.42-0.47, percent agreement 63-77%); however, mean days and hours reported did not differ between test and retest. The results of this study suggest that participants' self-report for job title and dates employed are valid compared with employer records. While kappa scores were low for some medical conditions and for caffeine consumption, high kappa scores for job title, dates worked, types of welding, and materials welded suggest participants generated reproducible answers important for occupational exposure assessment.

Original languageEnglish
Pages (from-to)324-331
Number of pages8
JournalJournal of Occupational and Environmental Hygiene
Volume6
Issue number6
DOIs
StatePublished - 1 Jun 2009

Fingerprint

Parkinsonian Disorders
Occupational Exposure
Reproducibility of Results
Welding
Self Report
Sensitivity and Specificity
Health Behavior
Caffeine
Surveys and Questionnaires
Epidemiologic Studies
Industry
Demography

Keywords

  • Parkinsonism
  • Self-report questionnaire
  • Test-retest reliability
  • Validity
  • Welding exposures

Cite this

Hobson, Angela J. ; Sterling, David ; Emo, Brett ; Evanoff, Bradley A. ; Sterling, Callen S. ; Good, Laura ; Seixas, Noah ; Checkoway, Harvey ; Racette, Brad A. / Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders. In: Journal of Occupational and Environmental Hygiene. 2009 ; Vol. 6, No. 6. pp. 324-331.
@article{8f112bc8ff1d4990a2c569ef32c6c9b5,
title = "Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders",
abstract = "This study assessed the validity and test-retest reliability of a medical and occupational history questionnaire for workers performing welding in the shipyard industry. This self-report questionnaire was developed for an epidemiologic study of the risk of parkinsonism in welders. Validity participants recruited from three similar shipyards were asked to give consent for access to personnel files and complete the questionnaire. Responses on the questionnaire were compared with information extracted from personnel records. Reliability participants were recruited from the same shipyards and were asked to complete the questionnaire at two different times approximately 4 weeks apart. Percent agreement, kappa, intraclass correlation coefficient (ICC), and sensitivity and specificity were used as measures of validity and/or reliability. Personnel files were obtained for 101 of 143 participants (70{\%}) in the validity study, and 56 of the 95 (58.9{\%}) participants in the reliability study completed the retest of the questionnaire. Validity scores for items extracted from personnel files were high. Percent agreement for employment dates and job titles ranged from 83-100{\%}, while ICC for start and stop dates ranged from 0.93-0.99. Sensitivity and specificity for current job title ranged from 0.5-1.0. Reliability scores for demographic, medical and health behavior items were mainly moderate or high, but ranged from 0.19 to 1.0. Most recent job/title items such as title, types of welding performed, and material used showed substantial to perfect agreement. Certain determinants of exposure such as days and hours per week exposed to welding fumes demonstrated mainly moderate agreement (κ = 0.42-0.47, percent agreement 63-77{\%}); however, mean days and hours reported did not differ between test and retest. The results of this study suggest that participants' self-report for job title and dates employed are valid compared with employer records. While kappa scores were low for some medical conditions and for caffeine consumption, high kappa scores for job title, dates worked, types of welding, and materials welded suggest participants generated reproducible answers important for occupational exposure assessment.",
keywords = "Parkinsonism, Self-report questionnaire, Test-retest reliability, Validity, Welding exposures",
author = "Hobson, {Angela J.} and David Sterling and Brett Emo and Evanoff, {Bradley A.} and Sterling, {Callen S.} and Laura Good and Noah Seixas and Harvey Checkoway and Racette, {Brad A.}",
year = "2009",
month = "6",
day = "1",
doi = "10.1080/15459620902836856",
language = "English",
volume = "6",
pages = "324--331",
journal = "Journal of Occupational and Environmental Hygiene",
issn = "1545-9624",
publisher = "Taylor and Francis Ltd.",
number = "6",

}

Hobson, AJ, Sterling, D, Emo, B, Evanoff, BA, Sterling, CS, Good, L, Seixas, N, Checkoway, H & Racette, BA 2009, 'Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders', Journal of Occupational and Environmental Hygiene, vol. 6, no. 6, pp. 324-331. https://doi.org/10.1080/15459620902836856

Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders. / Hobson, Angela J.; Sterling, David; Emo, Brett; Evanoff, Bradley A.; Sterling, Callen S.; Good, Laura; Seixas, Noah; Checkoway, Harvey; Racette, Brad A.

In: Journal of Occupational and Environmental Hygiene, Vol. 6, No. 6, 01.06.2009, p. 324-331.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders

AU - Hobson, Angela J.

AU - Sterling, David

AU - Emo, Brett

AU - Evanoff, Bradley A.

AU - Sterling, Callen S.

AU - Good, Laura

AU - Seixas, Noah

AU - Checkoway, Harvey

AU - Racette, Brad A.

PY - 2009/6/1

Y1 - 2009/6/1

N2 - This study assessed the validity and test-retest reliability of a medical and occupational history questionnaire for workers performing welding in the shipyard industry. This self-report questionnaire was developed for an epidemiologic study of the risk of parkinsonism in welders. Validity participants recruited from three similar shipyards were asked to give consent for access to personnel files and complete the questionnaire. Responses on the questionnaire were compared with information extracted from personnel records. Reliability participants were recruited from the same shipyards and were asked to complete the questionnaire at two different times approximately 4 weeks apart. Percent agreement, kappa, intraclass correlation coefficient (ICC), and sensitivity and specificity were used as measures of validity and/or reliability. Personnel files were obtained for 101 of 143 participants (70%) in the validity study, and 56 of the 95 (58.9%) participants in the reliability study completed the retest of the questionnaire. Validity scores for items extracted from personnel files were high. Percent agreement for employment dates and job titles ranged from 83-100%, while ICC for start and stop dates ranged from 0.93-0.99. Sensitivity and specificity for current job title ranged from 0.5-1.0. Reliability scores for demographic, medical and health behavior items were mainly moderate or high, but ranged from 0.19 to 1.0. Most recent job/title items such as title, types of welding performed, and material used showed substantial to perfect agreement. Certain determinants of exposure such as days and hours per week exposed to welding fumes demonstrated mainly moderate agreement (κ = 0.42-0.47, percent agreement 63-77%); however, mean days and hours reported did not differ between test and retest. The results of this study suggest that participants' self-report for job title and dates employed are valid compared with employer records. While kappa scores were low for some medical conditions and for caffeine consumption, high kappa scores for job title, dates worked, types of welding, and materials welded suggest participants generated reproducible answers important for occupational exposure assessment.

AB - This study assessed the validity and test-retest reliability of a medical and occupational history questionnaire for workers performing welding in the shipyard industry. This self-report questionnaire was developed for an epidemiologic study of the risk of parkinsonism in welders. Validity participants recruited from three similar shipyards were asked to give consent for access to personnel files and complete the questionnaire. Responses on the questionnaire were compared with information extracted from personnel records. Reliability participants were recruited from the same shipyards and were asked to complete the questionnaire at two different times approximately 4 weeks apart. Percent agreement, kappa, intraclass correlation coefficient (ICC), and sensitivity and specificity were used as measures of validity and/or reliability. Personnel files were obtained for 101 of 143 participants (70%) in the validity study, and 56 of the 95 (58.9%) participants in the reliability study completed the retest of the questionnaire. Validity scores for items extracted from personnel files were high. Percent agreement for employment dates and job titles ranged from 83-100%, while ICC for start and stop dates ranged from 0.93-0.99. Sensitivity and specificity for current job title ranged from 0.5-1.0. Reliability scores for demographic, medical and health behavior items were mainly moderate or high, but ranged from 0.19 to 1.0. Most recent job/title items such as title, types of welding performed, and material used showed substantial to perfect agreement. Certain determinants of exposure such as days and hours per week exposed to welding fumes demonstrated mainly moderate agreement (κ = 0.42-0.47, percent agreement 63-77%); however, mean days and hours reported did not differ between test and retest. The results of this study suggest that participants' self-report for job title and dates employed are valid compared with employer records. While kappa scores were low for some medical conditions and for caffeine consumption, high kappa scores for job title, dates worked, types of welding, and materials welded suggest participants generated reproducible answers important for occupational exposure assessment.

KW - Parkinsonism

KW - Self-report questionnaire

KW - Test-retest reliability

KW - Validity

KW - Welding exposures

UR - http://www.scopus.com/inward/record.url?scp=66949171816&partnerID=8YFLogxK

U2 - 10.1080/15459620902836856

DO - 10.1080/15459620902836856

M3 - Article

VL - 6

SP - 324

EP - 331

JO - Journal of Occupational and Environmental Hygiene

JF - Journal of Occupational and Environmental Hygiene

SN - 1545-9624

IS - 6

ER -