Reliability and Validity of the Korean Version of the Somatic Symptom Disorder-B Criteria Scale in a Clinical Population

Article information

Psychiatry Investig. 2024;21(2):165-173
Publication date (electronic) : 2024 February 22
doi : https://doi.org/10.30773/pi.2023.0352
1Department of Psychiatry, Korea University Ansan Hospital, Ansan, Republic of Korea
2Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea
3Department of Psychiatry and Behavioral Sciences, Seoul National University College of Medicine, Seoul, Republic of Korea
4Seoul Regional Military Manpower Administration, Seoul, Republic of Korea
5Department of Psychiatry, Armed Forces Hampyeong Hospital, Hampyeong, Republic of Korea
6Department of Psychiatry, Korea Army Training Center District Hospital, Nonsan, Republic of Korea
7Department of Psychiatry, Dongguk University Ilsan Hospital, Goyang, Republic of Korea
8Institute of Human Behavioral Medicine, Medical Research Center, Seoul National University, Seoul, Republic of Korea
9Department of Psychiatry, Uijeongbu Eulji Medical Center, Eulji University School of Medicine, Uijeongbu, Republic of Korea
Correspondence: Chan-Woo Yeom, MD Department of Psychiatry, Uijeongbu Eulji Medical Center, Eulji University School of Medicine, 712 Dongil-ro, Uijeongbu 11759, Republic of Korea Tel: +82-31-951-2379, Fax: +82-31-951-1093, E-mail: chwoye@gmail.com
Received 2023 October 6; Accepted 2023 November 26.

Abstract

Objective

This study aimed to develop and validate the Korean version of the Somatic Symptom Disorder-B Criteria Scale (SSD-12) in outpatients at a psychiatric clinic and assess its diagnostic accuracy.

Methods

A total of 207 patients completed SSD-12. For the diagnostic accuracy of SSD-12, the somatic symptom disorder (SSD) section of the structured clinical interview for DSM-5 disorders-research version (SCID-5-RV) was used. The SSD-12 construct and concurrent validity were assessed by examining the correlations with Generalized Anxiety Disorder-7 (GAD-7), Patient Health Questionnaire-9 (PHQ-9), PHQ-15, 5-level EQ-5D version (EQ-5D-5L), and World Health Organization Quality of Life Brief Version (WHOQOL-BREF).

Results

The SSD-12 had excellent internal consistency (Cronbach α=0.90). Confirmatory factor analysis revealed good fit indices for a general factor model (comparative fit index [CFI]=0.92, Tucker-Lewis index [TLI]=0.88, root mean square error of approximation [RMSEA]=0.10; 95% confidence interval [CI], 0.08–0.11) and a three-factor model (CFI=0.94, TLI=0.91, RMSEA=0.08; 95% CI, 0.07–0.10). The total SSD-12 score was significantly correlated with anxiety (GAD-7: r=0.53, p<0.001), depression (PHQ-9: r=0.52, p<0.001), physical symptom burden (PHQ-15: r=0.36, p<0.001), and quality of life (EQ-5D-5L: r=-0.40, p<0.001; WHOQOL-BREF: r=-0.51, p<0.001). SSD-12 demonstrated good accuracy (area under the curve=0.75, standard error=0.04; 95% CI, 0.68–0.82) with an optimal cut-off of 29.

Conclusion

The Korean SSD-12 demonstrates reliability and validity for diagnosing SSD in clinical setting.

INTRODUCTION

The Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition (DSM-5) introduced a new diagnosis, somatic symptom disorder (SSD), which marked a significant change in the concept of somatoform disorders in the DSM-Fourth Edition (DSM-IV) [1]. The DSM-IV emphasized that a somatoform disorder cannot be diagnosed if there was an underlying medically explainable condition [2]. However, in the new diagnostic classification, the diagnosis of SSD is based on the presence of distressing physical and positive symptoms such as abnormal thoughts, feelings, and behaviors in response to those physical symptoms, rather than the absence of medical evidence of physical symptoms. In other words, patients diagnosed with SSD are characterized by “excessiveness in the way they express and interpret physical symptoms” which is what Criterion B implies [1].

Several studies have supported the clinical use of DSM-5 diagnostic criteria for SSD, particularly the introduction of Criterion B [3-7]. The psychological characteristics of SSD assessed by Criterion B have been identified as risk factors for the development of SSD [8-10]. Moreover, the severity of SSD, as assessed by the number of symptoms in Criterion B, has also been associated with the degree of global functional impairment [5,11]. Therefore, Criterion B in DSM-5 is likely important for diagnosing and assessing SSD.

In Korea, the Patient Health Questionnaire-15 (PHQ-15), Somatic Symptom Severity Scale-8, Hamilton Depression Rating Scale, and the Depression and Somatic Symptom Scale were developed to assess the type and severity of physical symptoms [12-15]. However, for the DSM-5 SSD, these scales are only useful for Criterion A, which assesses the presence of one or more physical symptoms that are distressing or significantly interfere with daily life. Therefore, a need exists for a scale to assess Criterion B symptoms for DSM-5 SSD. The Somatic Symptom Disorder-B Criteria Scale (SSD-12) was developed as a self-reporting questionnaire to assess Criterion B. The questionnaire has demonstrated good reliability and validity in studies with different population samples from multiple countries [11,16-19]. A study conducted among community-dwelling in Korea also demonstrated significant reliability [20]. However, no studies have standardized SSD-12 in the clinical population in Korea. Therefore, we developed a Korean version of the SSD-12 and examined the reliability and validity of the scale with patients visiting outpatient psychiatric clinics.

METHODS

Sampling strategy and subjects

This study included outpatient who visited the Department of Psychiatry at Seoul National University Hospital, a tertiary hospital in Seoul, South Korea, between March 2021 to February 2022. Patients aged 18 years or older with sufficient cognitive capacity to understand and follow the researcher’s instructions were eligible if they had a history of having been diagnosed with somatic symptom and related disorders or if their current complaints included distress related to physical symptoms. Participation was voluntary and consensual. Those who did not agree to participate in the study, who were unable to maintain a sitting position for more than 30 minutes due to disability, and who had difficulty communicating because they did not speak Korean were excluded from the study. Furthermore, those who had difficulty maintaining attention and alertness, such as those with major neurocognitive disorders, delirium, acute episodes of psychotic disorders, substance addiction, or withdrawal, and those who were currently at a high risk of suicide and required psychiatric crisis intervention, were also excluded. The number of participants was calculated to be a minimum of 200 to ensure the stability of the factor analysis results, and 250 participants represented a 25% dropout rate [21,22]. A minimum of 101 subjects were required to obtain a moderate intraclass correlation coefficient with a 95% confidence interval (CI) in two repeated measures; therefore, we aimed to retest 101 of the total study population (n=250) for test-retest reliability [23-25]. This study was approved by the Institutional Review Board of Seoul National University Hospital (IRB No: H-2109-166-1260) and conducted following the principles of the Declaration of Helsinki.

Instruments

Development of the Korean version of the SSD-12

The SSD-12 consists of 12 items reflecting DSM-5 diagnostic Criterion B and is divided into three sub-criteria (cognitive: 1, 4, 7, 10; affective: 2, 5, 8, 12; and behavioral: 3, 6, 9, 11). Each item is measured on a five-point Likert scale (0, never; 4, very often), with a total score ranging from 0 to 48. Internal consistency reliability was excellent with Cronbach’s α=0.95 [11]. The adaptation process followed the “Guidelines for Test Translation and Adaptation, Second Edition” of the International Test Commission [26]. Permission was obtained from the original author to use the original text before adaptation. A committee consisted of six English-Korean bilingual psychiatrists with subspecialties in psychosomatic medicine and one clinical psychologist. Three psychiatrists independently conducted forward translations (English to Korean). The committee identified inconsistencies between Korean translations and adjusted them in a single version. Subsequently, a psychiatrist who had not seen the original English version of SSD-12, performed backward translation (from Korean to English). The committee then compared the backward translation with the original English version for accuracy. The final version of the Korean version of SSD-12 (Supplementary Material in the online-only Data Supplement) was developed using this process.

Other measurements

Structured clinical interview for DSM-5 disorders-research version (SCID-5-RV) is a semi-structured interview tool for DSM-5 diagnosis and optimal gold standard [27]. We received approval from the American Psychiatric Association to use the English version of the SCID-5-RV and translated the tool based on the diagnostic criteria for SSD in the Korean version of DSM-5.

PHQ-15 is a self-reported questionnaire that assesses the extent to which one has been bothered by physical symptoms in the past 4 weeks and consist of 15 items of physical symptoms. The questionnaire has been used to diagnose somatoform disorders. Each item is rated on a 3-point scale (0 to 2, not bothered at all to bothered a lot), with a total score of 0 to 30, which determines the severity of physical symptom burden [28]. The PHQ-15 has been validated in Korea, with a Cronbach’s α of 0.87 [12].

PHQ-9 is a self-reported questionnaire used to screen for depression in primary care settings and is designed to align with the diagnostic criteria of the DSM-IV, for major depressive disorder and consists of nine questions. Each item asks respondents to indicate how often they have experienced depressive symptoms in the last 2 weeks, with a total score ranging from 0 to 27 on a 4-point scale (0 to 3, not at all to nearly every day) [29]. The internal consistency of the Korean version of PHQ-9 was excellent, with a Cronbach’s α of 0.86 [30].

Generalized Anxiety Disorder-7 (GAD-7) is a seven-item self-reported questionnaire that requires subjects to rate their experience of anxiety-related problems in the past 2 weeks. The questionnaire is based on a 4-point scale (0 to 3, not at all to nearly every day), with a total score of 0 to 21, and has been used as a valid measurement for general anxiety [31]. A validation study of the Korean version of GAD-7 exhibited good internal consistency, with Cronbach’s α of 0.92 [32].

The 5-level EQ-5D version (EQ-5D-5L) was used to assess the health-related quality of life. EQ-5D-5L consists of five dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression), each of which is evaluated at five levels (no problems, slight problems, moderate problems, severe problems, and extreme problems) and is represented by a 1-digit number. The digits of the five dimensions can be combined into a five-digit number that describes the patient’s health [33]. A Korean version was released and weights were provided in EQ-5D-5L validity studies. The EQ-5D-5L index was calculated using the mapping method proposed by the EuroQol group [34].

The World Health Organization Quality of Life Brief Version (WHOQOL-BREF) was used to assess quality of life. This is a 26-item instrument consisting of four domains (physical health, psychological health, social relationships, and environment). Each question is rated on a 5-point scale, with higher scores indicating a more positive response to quality of life [35]. Standardization studies were conducted in Korea [36]. In this study, 18 of the 26 items were used, excluding eight items related to the environmental domain.

Procedures

The study consisted of the completion of self-reported questionnaires (SSD-12, PHQ-15, PHQ-9, GAD-7, EQ-5D-5L, and WHOQOL-BREF) and diagnostic interview. A psychiatrist with a subspecialty in psychosomatic medicine diagnosed SSD using SCID-5-RV. The psychiatrist who conducted the interview was blinded to the results of the questionnaire of the participants. The same self-reported questionnaires were re-administered at a minimum interval of 1 to 4 weeks to establish test-retest reliability [37].

Statistical analysis

Exploratory data analysis for SSD-12 was performed to examine mean scores, standard deviations (SD), skewness, and kurtosis [38]. For internal consistency, Cronbach’s α and corrected item-total correlations were examined [39]. Pearson’s correlation analysis was performed between the scores obtained from the initial test and those from the retest of the same self-reported questionnaire to evaluate test-retest reliability [40]. For factorial validity, confirmatory factor analyses (CFA) were performed to determine the comparative fit index (CFI), Tucker-Lewis index (TLI), and root mean square error of approximation (RMSEA) [41]. In the development and validation study of SSD-12, two models were proposed based on the diagnostic criteria of the DSM-5 SSD, specifically the “Criterion B” structure. The first model is a one-factor general factor model where all items are loaded onto a single “general factor” representing the DSM-5 SSD Criterion B, and the second model is a three-factor model with latent variables corresponding to three subcriteria [11]. We validated whether our results fit these two models. Receiver operating characteristic (ROC) curve analysis was performed to validate the criterion validity of the SSD-12. Through this analysis, we determined the accuracy level at which SSD-12 could predict the diagnosis of SSD and calculated the optimal cut-off value [42]. For construct validity, Pearson’s correlation coefficients were calculated by correlation analysis between the SSD-12 and PHQ-15, PHQ-9, and GAD-7 scores related to the burden of physical symptom, depression, and anxiety [43]. Concurrent validity was examined with Pearson’s correlation analysis between SSD-12 and WHOQOL-BREF, and EQ-5D-5L. A multiple linear hierarchical regression analysis was performed using WHOQOL-BREF and EQ-5D-5L as dependent variables to explore incremental validity. In the first step, PHQ-15 and sociodemographic characteristics were included as predictor variables, followed by SSD-12 in the second step. All data was analyzed using SPSS, version 23.0 and SPSS AMOS, version 23.0 (IBM Corp., Armonk, NY, USA).

RESULTS

A total of 214 subjects consented to participate in the study and were enrolled. Of these, seven dropped out and 207 patients were included in the analysis. Among them, 75.0% were female, with a mean age of 54.5±15.3 years. The sociodemographic characteristics of the participants are presented in Table 1.

Sociodemographic characteristics of the outpatient sample in general hospitals of Korea (N=207)

Reliability of the SSD-12

High internal consistency reliability was demonstrated with a Cronbach’s α of 0.90. Except for items 7 and 10, corrected item-total correlation coefficients were above 0.50 for all other items, indicating a high correlation with the total score. The corrected item-total correlation for item 7 (“Others tell me that my physical problems are not serious”) on the cognitive aspects subscale was 0.02, indicating little correlation with the total score. The corrected item-total correlation for item 10 (“I think that doctors do not take my physical complaints seriously”) in the same subscale was 0.38, suggesting moderate correlation with the total score. When item 7 was removed, the Cronbach’s α increased to 0.92. The overall item characteristics of the items are listed in Table 2. The test-retest reliability was reliable, with a Pearson’s correlation coefficient of 0.89.

Item characteristics of the SSD-12 (range, 0–4 for all items) (N=207)

Validity of the SSD-12

Factorial validity

In the general factor model and three-factor model, the path coefficient values of all items were statistically significant, except for item 7. When evaluating the fit of the general factor model, the RMSEA value, a measure of absolute fit, was below 0.1, indicating a mediocre fit, and the incremental fit indices, TLI and CFI, were both above 0.9, indicating an acceptable fit. Similarly, in the three-factor model, the absolute fit index RMSEA was below 0.1, and the χ2 (chi-square)/df (degrees of freedom) was below 3, indicating a favorable fit. The incremental fit indices, TLI and CFI were also above 0.9, indicating an acceptable fit. Strong correlations were present between the three subscales (cognitive and behavioral domains: effect size [ES]=0.87; affective and behavioral domains: ES=0.90; cognitive and affective domains: ES=0.91). The CFA results are displayed in Table 3 and the three-factor model is illustrated in Figure 1.

Fit indices for two different CFA models of the SSD-12 in the overall sample (N=207)

Figure 1.

Path diagram illustrating the 3-factor model estimates (N=207).

Criterion validity

Diagnostic evaluation using SCID-5-RV and in-depth interview revealed that 65 (30.4%) participants were diagnosed with SSD. In our study, the mean (SD) of SSD-12 were 25.9 (10.8). The optimal cut-off point was 29, with a Youden index of 0.396 (sensitivity=0.656, specificity=0.739). The sensitivity and specificity of SSD-12 in the moderate range are displayed in Table 4. The ROC analysis demonstrated that the area under the curve (AUC) was 0.75 (standard error=0.04, 95% CI, 0.68–0.82), indicating a favorable level of predictive ability (Figure 2). This suggests that there is a 75% probability of distinguishing the SSD from the non-SSD, when a total score is 29 or higher on SSD-12.

Sensitivity and specificity for the SSD-12 within the middle range

Figure 2.

Diagnostic performance of SSD-12. SSD-12, Somatic Symptom Disorder-B Criteria Scale; AUC, area under the curve; CI, confidence interval.

Construct validity

PHQ-15, which evaluates the burden of physical symptoms, had a mean (SD) of 11.4 (5.8) and exhibited a weak positive correlation with the SSD-12 total score (r=0.36, p<0.001). Whereas, PHQ-9, which evaluates depressive symptoms, had a mean (SD) of 10.2 (7.1) and GAD-7, which evaluates anxiety symptoms, had a mean (SD) of 6.8 (5.9), both of which displayed moderate positive correlations with the SSD-12 total score (PHQ-9: r=0.52, p<0.001; GAD-7: r=0.53, p<0.001).

Concurrent validity

Significant correlations were observed between the SSD-12 total score and the WHOQOL-BREF and EQ-5D-5L total scores, which reflect the degree of quality of life and impairment in daily functioning. Both the total scores of WHOQOL-BREF (r=-0.48, p<0.001) and EQ-5D-5L (r=-0.40, p<0.001) had moderate negative correlations with the SSD-12 total score. When examining the correlations between the SSD-12 total score and the WHOQOL-BREF subdomain scores, a significant negative correlation was present with the total score of the physical health domain (r=-0.55, p<0.001) and the total score of the psychological health domain (r=-0.43, p<0.001), but not with the total score of the social relationships domain.

Incremental validity

Multiple linear hierarchical regression analysis was performed to test the incremental validity of SSD-12 beyond PHQ-15 in predicting the quality of life and daily life functioning impairment evaluated by WHOQOL-BREF and EQ-5D-5L. The regression models for each stage fit when the WHOQOL-BREF score was the dependent variable (Step 1: F=75.364, p<0.001; Step 2: F=65.189, p<0.001). Furthermore, we observed a significant increase in the explained variance when the SSD-12 total score was introduced as an independent variable at Step 2 (Step 1: R=0.52, adjusted R2=0.27; Step 2: R=0.63, adjusted R2=0.39). Using EQ-5D-5L scores as the dependent variable, the regression models were also fitted at each stage (Step 1: F=83.641, p<0.001; Step 2: F=52.452, p<0.001). The explained variance increased significantly when the SSD-12 total score was added as an independent variable in step 2 (Step 1: R=0.54, adjusted R2=0.30; Step 2: R=0.59, adjusted R2=0.35). When controlling for PHQ-15, SSD-12 had a negative influence of 37% on quality of life assessed using WHOQOL-BREF BREF (PHQ-15: β=-0.35; SSD-12: β=-0.36), and a negative influence of 24% on daily life functioning impairment assessed using EQ-5D (PHQ-15: β=-0.46; SSD-12: β=-0.24).

DISCUSSION

This study aimed to develop a Korean version of the SSD-12, designed for screening of SSD, and to assess the reliability and validity to determine its suitability as an evidence-based assessment instrument. In this study, the SSD-12 items were strongly interrelated and consistently measured the diagnostic Criterion B of SSD with a high internal consistency reliability coefficient. This is comparable to those assessed in other countries, such as Europe and China [11,17-19,44]. Unlike other items in SSD-12, item 7 “Others tell me that my physical problems are not serious” displayed a very weak correlation with the total score, and similarly, item 10 “I think that doctors do not take my physical complaints seriously” had a moderate correlation with the total score. In reliability and validity studies targeting community-dwelling adults in Korea, items 7 and 10 also exhibited very weak correlations with the total score, with corrected item-total correlations of 0.04 and 0.26, respectively [20]. Furthermore, this is similar to studies in other countries that have consistently identified that item 7 has the lowest correlation with total score compared to other items, followed by item [10 11,17-19,44]. These consistent results are likely to occur, as item 7 and 10 ask for thoughts about the perspectives or reactions of others to the physical symptoms experienced by patients with SSD. Patients with SSD are characterized by an excessive focus on their physical symptoms and may not be aware of the discrepancy between their perceived severity of physical symptoms and the perspectives of others [1]. In previous studies, patients with somatoform disorder have displayed functional impairment in a theory-of-mind task that assesses their ability to recognize and interpret other perspectives in social interactions [45,46]. Paradoxically, items 7 and 10 may not adequately reflect the cognitive aspects of Criterion B for SSD. The test-retest reliability of the SSD-12 was high, confirming that the SSD-12 is the instrument that produces relatively consistent results over time and situations.

Factorial validity

CFA indicated an acceptable fit for the general factor and three-factor models, encompassing the three sub-criteria of Criteria B for SSD as latent constructs. Therefore, the total score of SSD-12 can be used, and it was confirmed that the structure of SSD-12 is consistent with Criterion B for SSD. Strong correlations were observed between the cognitive, emotional, and behavioral subscales of the SSD-12, suggesting that some overlap may exist in the content of items within these three subscales. This is consistent with the results of previous studies [11,19,44]. Further research is needed to explore the structural implications of categorizing symptoms into three sub-criteria for diagnosing SSD and to investigate how they interact and manifest in clinical practice.

Criterion validity

In our study, the cut-off SSD-12 score was 29. The cut-off scores for SSD-12 varied according to the characteristics of the participants, such as sex and age, as well as the setting in which the participants were recruited. In a study of population-based norms conducted by the original author, a 55-year-old female had a cut-off of 29 for a very high psychological burden [47]. In a study involving patients referred by primary care physicians for rare and undiagnosed diseases, the cut-off was 23 [48]. Furthermore, in a study involving outpatients who came to a psychosomatic medicine clinic, a cut-off score of 26 displayed the highest diagnostic efficiency value [16]. The mean age of our study population was 54 years, 75% of the study population were female; the fact that our study only included outpatients in the Department of Psychiatry in a tertiary hospital may have influenced the cut-off score.

Construct validity

When convergent validity was examined, SSD-12 demonstrated a moderate level of correlation with the PHQ-9 and GAD-7. This suggests that depression and anxiety about health or physical symptoms, latent constructs of SSD-12, are related, but not completely redundant to depression and anxiety as symptoms of depressive and anxiety disorders, as measured by PHQ-9 and GAD-7. In other words, SSD-12 appears to reflect the unique characteristics of the symptoms observed in SSD. In contrast, a low correlation was present between SSD-12 and PHQ-15 scores. A study in the Netherlands also found a significant but low correlation between SSD-12 and PHQ-15 scores [49]. This can be interpreted as providing evidence of discriminant validity between SSD-12, which reflects the revised DSM-5 diagnostic criteria for SSD, and PHQ-15, reflecting the severity of the physical symptom burden. In other words, the SSD-12 measures the excessive cognitive, affective, and behavioral symptoms related to physical symptoms rather than the severity of physical symptom burden.

Concurrent validity and incremental validity

Concurrent validity demonstrated moderate negative correlations between SSD-12 and EQ-5D-5L, and WHOQOL-BREF, confirming that SSD symptoms, as defined by Criterion B, significantly predicted poor daily functioning and reduced quality of life. This finding is consistent with previous studies displaying negative correlations between physical and mental quality of life as measured by SF-12 and SSD-12 total score [19]. Therefore, based on the theoretical prediction that SSD-12 score would affect daily functioning and quality of life, we examined the incremental validity with the EQ-5D-5L and WHOQOL-BREF scores as dependent variables. The results revealed that SSD-12 could explain the decline in daily functioning and quality of life beyond by PHQ-15.

The use of SSD-12, which can screen for SSD, can enhance the diagnostic approach to SSD in clinical settings. The cut-off of the SSD-12 presented in this study could provide some evidence of the degree of “excessiveness” that may warrant psychiatric evaluation and treatment. How the degree of “excessiveness” specified in Criterion B can be precisely explained concerning thoughts, emotions, and behaviors associated with physical symptoms remains unclear. For an accurate diagnosis of SSD, the most crucial requirement is to establish an operational definition of the degree of “excessiveness” that is measurable [6,50]. Appropriate screening for SSD is important because these disorders are associated with increased individual and societal healthcare burdens [51,52]. Additionally, SSD-12 is a self-reported questionnaire that can be applied not only in psychiatry but also in other departments, making it easy to identify SSD and make referrals for consultation.

Limitations

The study has some limitations. First, this study was conducted in a psychiatric outpatient setting and limitations to generalizing the results to other populations may exist. Second, since reliability, validity, and cut-off values vary between different samples, more studies should be conducted with diverse samples, including psychiatric inpatients and outpatients from other medical departments.

In conclusion, the results of this study confirmed that the Korean version of the SSD-12 is a reliable and valid instrument in a clinical setting. Furthermore, we provided a cut-off point of 29 for diagnosing SSD, enabling the utilization of SSD-12 as a screening tool. Therefore, this scale is expected to be useful for diagnosing and evaluating SSD in clinical settings.

Supplementary Materials

The online-only Data Supplement is available with this article athttps://doi.org/10.30773/pi.2023.0352.

Notes

Availability of Data and Material

The datasets generated or analyzed during the study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors have no potential conflicts of interest to disclose.

Author Contributions

Conceptualization: Saim Jung, Bong-Jin Hahm. Data curation: Saim Jung, Bong-Jin Hahm, Chan-Woo Yeom. Formal analysis: Saim Jung, Chan-Woo Yeom. Funding acquisition: Saim Jung. Supervision: Bong-Jin Hahm. Writing—original draft: Saim Jung, Chan-Woo Yeom. Writing—review & editing: all authors.

Funding Statement

This study was supported by the Jisan Cultural Psychiatry Research Fund from the Korean Neuropsychiatric Association.

References

1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, fifth edition (DSM-5) Arlington: American Psychiatric Publishing; 2013.
2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, fourth edition, text revision (DSM-IV-TR) Washington, DC: American Psychiatric Publishing; 2000.
3. Dimsdale JE, Creed F, Escobar J, Sharpe M, Wulsin L, Barsky A, et al. Somatic symptom disorder: an important change in DSM. J Psychosom Res 2013;75:223–228.
4. Regier DA, Kuhl EA, Kupfer DJ. The DSM-5: classification and criteria changes. World Psychiatry 2013;12:92–98.
5. Wollburg E, Voigt K, Braukhaus C, Herzog A, Löwe B. Construct validity and descriptive validity of somatoform disorders in light of proposed changes for the DSM-5. J Psychosom Res 2013;74:18–24.
6. Rief W, Martin A. How to use the new DSM-5 somatic symptom disorder diagnosis in research and practice: a critical evaluation and a proposal for modifications. Annu Rev Clin Psychol 2014;10:339–367.
7. Hüsing P, Löwe B, Toussaint A. Comparing the diagnostic concepts of ICD-10 somatoform disorders and DSM-5 somatic symptom disorders in patients from a psychosomatic outpatient clinic. J Psychosom Res 2018;113:74–80.
8. Klaus K, Rief W, Brähler E, Martin A, Glaesmer H, Mewes R. Validating psychological classification criteria in the context of somatoform disorders: a one- and four-year follow-up. J Abnorm Psychol 2015;124:1092–1101.
9. Limburg K, Sattel H, Dinkel A, Radziej K, Becker-Bense S, Lahmann C. Course and predictors of DSM-5 somatic symptom disorder in patients with vertigo and dizziness symptoms - a longitudinal study. Compr Psychiatry 2017;77:1–11.
10. Schumacher S, Rief W, Klaus K, Brähler E, Mewes R. Medium- and long-term prognostic validity of competing classification proposals for the former somatoform disorders. Psychol Med 2017;47:1719–1732.
11. Toussaint A, Murray AM, Voigt K, Herzog A, Gierk B, Kroenke K, et al. Development and validation of the Somatic Symptom Disorder–B Criteria Scale (SSD-12). Psychosom Med 2016;78:5–12.
12. Han C, Pae CU, Patkar AA, Masand PS, Kim KW, Joe SH, et al. Psychometric properties of the Patient Health Questionnaire-15 (PHQ-15) for measuring the somatic symptoms of psychiatric outpatients. Psychosomatics 2009;50:580–585.
13. Yang CM, Hwang KS, Lee SY, Seo JS, Jang SH. Reliability and validity of the Korean version of Somatic Symptom Scale-8. Psychiatry Investig 2020;17:814–821.
14. Yi JS, Bae SO, Ahn YM, Park DB, Noh KS, Shin HK, et al. Validity and reliability of the Korean version of the Hamilton Depression Rating Scale (K-HDRS). J Korean Neuropsychiatr Assoc 2005;44:456–465.
15. Kim KW, Hong JP, Park SJ, Choi JH, Choi HR. Reliability and validity of Korean version of Depression and Somatic Symptom Scale (DSSS). Anxiety Mood 2011;7:9–15.
16. Toussaint A, Hüsing P, Kohlmann S, Löwe B. Detecting DSM-5 somatic symptom disorder: criterion validity of the Patient Health Questionnaire-15 (PHQ-15) and the Somatic Symptom Scale-8 (SSS-8) in combination with the Somatic Symptom Disorder - B Criteria Scale (SSD-12). Psychol Med 2020;50:324–333.
17. Toussaint A, Löwe B, Brähler E, Jordan P. The Somatic Symptom Disorder - B Criteria Scale (SSD-12): factorial structure, validity and population-based norms. J Psychosom Res 2017;97:9–17.
18. Toussaint A, Riedl B, Kehrer S, Schneider A, Löwe B, Linde K. Validity of the Somatic Symptom Disorder-B Criteria Scale (SSD-12) in primary care. Fam Pract 2018;35:342–347.
19. Li T, Wei J, Fritzsche K, Toussaint AC, Jiang Y, Cao J, et al. Validation of the Chinese version of the Somatic Symptom Disorder-B Criteria Scale for detecting DSM-5 somatic symptom disorders: a multicenter study. Psychosom Med 2020;82:337–344.
20. Lim YJ. Validation of the Somatic Symptom Disorder-B Criteria Scale for adults in South Korea. Alpha Psychiatry 2022;23:230–234.
21. Smith EV Jr. Evidence for the reliability of measures and validity of measure interpretation: a Rasch measurement perspective. J Appl Meas 2001;2:281–311.
22. Linacre JM. Optimizing rating scale category effectiveness. J Appl Meas 2002;3:85–106.
23. Donner A, Eliasziw M. Sample size requirements for reliability studies. Stat Med 1987;6:441–448.
24. Giraudeau B, Mary JY. Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 percent confidence interval of the intraclass correlation coefficient. Stat Med 2001;20:3205–3214.
25. Shoukri MM, Asyali MH, Donner A. Sample size requirements for the design of reliability study: review and new results. Stat Methods Med Res 2004;13:251–271.
26. Gregoire J. ITC guidelines for translating and adapting tests (2nd ed). Int J Test 2018;18:101–134.
27. Jiang Y, Wei J, Fritzsche K, Toussaint AC, Li T, Cao J, et al. Assessment of the structured clinical interview (SCID) for DSM-5 for somatic symptom disorder in general hospital outpatient clinics in China. BMC Psychiatry 2021;21:144.
28. Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry 2010;32:345–359.
29. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–613.
30. Han C, Jo SA, Kwak JH, Pae CU, Steffens D, Jo I, et al. Validation of the Patient Health Questionnaire-9 Korean version in the elderly population: the Ansan Geriatric study. Compr Psychiatry 2008;49:218–223.
31. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006;166:1092–1097.
32. Seo JG, Park SP. Validation of the Generalized Anxiety Disorder-7 (GAD-7) and GAD-2 in patients with migraine. J Headache Pain 2015;16:97.
33. Feng YS, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res 2021;30:647–673.
34. Kim SH, Ahn J, Ock M, Shin S, Park J, Luo N, et al. The EQ-5D-5L valuation study in Korea. Qual Life Res 2016;25:1845–1852.
35. Development of the World Health Organization WHOQOL-BREF quality of life assessment. The WHOQOL Group. Psychol Med 1998;28:551–558.
36. Min SK, Lee CI, Kim KI, Suh SY, Kim DK. Development of Korean version of WHO quality of life scale abbreviated version (WHOQOL-BREF). J Korean Neuropsychiatr Assoc 2000;39:571–579.
37. Polit DF. Getting serious about test-retest reliability: a critique of retest research and some recommendations. Qual Life Res 2014;23:1713–1720.
38. Morgenthaler S. Exploratory data analysis. Wiley Interdiscip Rev Comput Stat 2009;1:33–44.
39. Henson RK. Understanding internal consistency reliability estimates: a conceptual primer on coefficient alpha. Meas Eval Couns Dev 2001;34:177–189.
40. Guttman L. A basis for analyzing test-retest reliability. Psychometrika 1945;10:255–282.
41. DiStefano C, Hess B. Using confirmatory factor analysis for construct validation: an empirical review. J Psychoeduc Assess 2005;23:225–241.
42. Hajian-Tilaki K. Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Caspian J Intern Med 2013;4:627–635.
43. Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull 1955;52:281–302.
44. Husing P, Bassler M, Löwe B, Koch S, Toussaint A. Validity and sensitivity to change of the Somatic Symptom Disorder-B Criteria Scale (SSD-12) in a clinical population. Gen Hosp Psychiatry 2018;55:20–26.
45. Subic-Wrana C, Beutel ME, Knebel A, Lane RD. Theory of mind and emotional awareness deficits in patients with somatoform disorders. Psychosom Med 2010;72:404–411.
46. Preis MA, Golm D, Kröner-Herwig B, Barke A. Examining differences in cognitive and affective theory of mind between persons with high and low extent of somatic symptoms: an experimental study. BMC Psychiatry 2017;17:200.
47. Kop WJ, Toussaint A, Mols F, Löwe B. Somatic symptom disorder in the general population: associations with medical status and health care utilization using the SSD-12. Gen Hosp Psychiatry 2019;56:36–41.
48. Mund M, Uhlenbusch N, Rillig F, Weiler-Normann C, Herget T, Kubisch C, et al. Psychological distress of adult patients consulting a center for rare and undiagnosed diseases: a cross-sectional study. Orphanet J Rare Dis 2023;18:82.
49. van der Feltz-Cornelis CM, Sweetman J, van Eck van der Sluijs JF, Kamp CAD, de Vroege L, de Beurs E. Diagnostic accuracy of the Dutch version of the Somatic Symptom Disorder - B Criteria Scale (SSD-12) compared to the Whiteley Index (WI) and PHQ-15 in a clinical population. J Psychosom Res 2023;173:111460.
50. Barsky AJ. Assessing the new DSM-5 diagnosis of somatic symptom disorder. Psychosom Med 2016;78:2–4.
51. Jacobi F, Wittchen HU, Hölting C, Höfler M, Pfister H, Müller N, et al. Prevalence, co-morbidity and correlates of mental disorders in the general population: results from the German Health Interview and Examination Survey (GHS). Psychol Med 2004;34:597–611.
52. Barsky AJ, Orav EJ, Bates DW. Somatization increases medical utilization and costs independent of psychiatric and medical comorbidity. Arch Gen Psychiatry 2005;62:903–910.

Article information Continued

Figure 1.

Path diagram illustrating the 3-factor model estimates (N=207).

Figure 2.

Diagnostic performance of SSD-12. SSD-12, Somatic Symptom Disorder-B Criteria Scale; AUC, area under the curve; CI, confidence interval.

Table 1.

Sociodemographic characteristics of the outpatient sample in general hospitals of Korea (N=207)

Characteristic Value
Age (yr) 54.47±15.30
Sex, female 156 (75.0)
Health insurance
 Locally or employer-provided 180 (88.2)
 Eligible for medical care 18 (8.9)
 Uninsured 6 (3.0)
Number of family members living together
 One-person household 42 (20.6)
 Multi-person household 164 (79.4)
Marital status
 Never married 51 (24.6)
 Married or cohabiting 118 (57.0)
 Widowed, separated, or divorced 38 (18.3)
Monthly family income, million won*
 Low, <200 59 (28.9)
 Middle, 200–600 84 (41.2)
 High, >600 61 (29.9)
Education level
 <High school 32 (15.4)
 High school 84 (40.6)
 ≥Some collage 91 (44.0)
Occupation
 Employed/student 66 (31.9)
 Unemployed 77 (37.2)
 Retired 64 (31.0)

Means±standard deviations are presented for the continuous variables and the number of patients (N) and percentage (%) are presented for the categorical variables.

*

following Household Trend Survey (Korea Statistics, 2020)

Table 2.

Item characteristics of the SSD-12 (range, 0–4 for all items) (N=207)

Item Mean±SD Skewness (SE) Kurtosis (SE) CoriT Cron. αid
1 2.28±1.20 -0.25 (0.17) -0.73 (0.33) 0.61 0.89
2 2.66±1.12 -0.58 (0.17) -0.39 (0.33) 0.55 0.89
3 1.96±1.35 0.09 (0.17) -1.17 (0.33) 0.75 0.88
4 2.09±1.32 -0.10 (0.17) -1.10 (0.33) 0.71 0.89
5 2.23±1.27 -0.07 (0.17) -1.00 (0.33) 0.67 0.89
6 1.82±1.45 0.27 (0.17) -1.31 (0.33) 0.78 0.88
7 2.00±1.34 -0.04 (0.17) -1.14 (0.33) 0.02 0.92
8 2.31±1.31 -0.25 (0.17) -0.98 (0.33) 0.77 0.88
9 1.91±1.41 0.09 (0.17) -1.27 (0.33) 0.76 0.88
10 1.91±1.28 0.12 (0.17) -1.03 (0.33) 0.38 0.90
11 2.12±1.36 -0.16 (0.17) -1.15 (0.33) 0.72 0.89
12 2.62±1.21 -0.42 (0.17) -0.88 (0.33) 0.73 0.89
Total 25.92±10.77 0.45 (0.17) -0.78 (0.33)

SSD-12, Somatic Symptom Disorder-B Criteria Scale; SE, standard error; CoriT, corrected item total correlation; Cron. αid, Cronbach α if item deleted

Table 3.

Fit indices for two different CFA models of the SSD-12 in the overall sample (N=207)

General factor model 3-factor model
Cognitive Affective Behavioral
Loadings
 Item 1 0.65** 0.70**
 Item 2 0.57** 0.59**
 Item 3 0.79** 0.81**
 Item 4 0.76** 0.83**
 Item 5 0.71** 0.73**
 Item 6 0.82** 0.82**
 Item 7 0.02 -0.01
 Item 8 0.82** 0.85**
 Item 9 0.82** 0.82**
 Item 10 0.38** 0.35**
 Item 11 0.77** 0.65**
 Item 12 0.75** 0.78**
Factor correlations
 Cognitive 1
 Affective 0.91 1
 Behavioral 0.87 0.90 1
Model fit
 χ2 (df) 162.461 (54) 127.295 (51)
 RMSEA (95% CI) 0.097 (0.080–0.114) 0.084 (0.066–0.102)
 TLI 0.882 0.912
 CFI 0.919 0.943
**

p<0.001.

CFA, confirmatory factor analysis; SSD-12, Somatic Symptom Disorder-B Criteria Scale; RMSEA, root mean square error of approximation; CI, confidence interval; TLI, Tucker-Lewis index; CFI, comparative fit index

Table 4.

Sensitivity and specificity for the SSD-12 within the middle range

Cut-off Youden index Sensitivity Specificity
24 0.360 0.797 0.563
25 0.350 0.766 0.585
26 0.377 0.750 0.627
27 0.379 0.703 0.676
28 0.390 0.672 0.718
29* 0.396* 0.656* 0.739*
30 0.356 0.609 0.746
31 0.361 0.594 0.768
32 0.322 0.547 0.775
33 0.273 0.484 0.789
*

the authors suggest a cut-off of approximately 29 and higher.

SSD-12, Somatic Symptom Disorder–B Criteria Scale