Psychiatry Investig Search

CLOSE


Psychiatry Investig > Volume 22(6); 2025 > Article
Çelik, Arslan, Özarslan, and Mart: Psychometric Properties of the Social Attribution Task and Its Relationship With Cognitive Functions

Abstract

Objective

The Social Attribution Task-Multiple Choice (SAT-MC) battery is one of tests used to evaluate social cognitive capacity. This study aimed to examine the reliability and validity of the SAT-MC for the first time in healthy adults and in individuals diagnosed with schizophrenia, then to investigate the effect on SAT-MC performance of clinical variables in schizophrenia patients.

Methods

The study included 207 volunteers; 157 healthy adults, and 50 individuals diagnosed with schizophrenia. All the study participants were applied with the Raven Standard Progressive Matrices Test (RSPM), the Reading the Mind in the Eyes Test (RMET), and the SAT-MC.

Results

The results of the analyses showed that the SAT-MC had content and criteria validity in both the individuals diagnosed with schizophrenia and in the healthy control group. Internal consistency of test was calculated as McDonald’s omega coefficient 0.81, and the test-retest reliability was found to be 0.75. Hierarchical multivariate regression analysis showed a predictive effect of RSPM and RMET on the SAT points.

Conclusion

The results of this study demonstrated that SAT was valid and reliable in evaluating social attribution skills in both a healthy and a schizophrenia sample group. Social attribution skill was found to be related to the perceptual reasoning and abstract thinking skills of neurocognition. The social cognition dimension was determined to be related to the theory of mind skills. Insufficient social attribution skills, seen especially in schizophrenia patients, can lead to social withdrawal and isolation by disrupting interactions and relationships with others.

INTRODUCTION

Social cognition has been defined as “the mental processes underlying social interactions, including the perception and evaluation of the intentions, tendencies, and behaviours of others, and producing responses to these” [1]. It can be understood from this definition that when a process related to social cognition occurs, there is a series of mental processes related to the event/situation. These evaluations include: 1) perception of the social information related to the event/situation, 2) understanding the cognitive and affective status of the other person, and 3) making a decision considering the aims of the other person [2,3]. Therefore, for social cognition to able to emerge successfully, there is a need for the cognition and neurocognition components of perception, attention, and problem-solving to work perfectly [4,5].
Social cognition is multi-dimensional and includes many components such as theory of mind, mentalisation, emotion processing, social attribution, and social processing [6,7]. This study focuses on the social attribution skill, which is an important component of social cognition. Social attribution was first described and examined by Heider and Simmel [8]. Heider described social attribution as “person perception,” referring to how an individual explains the behaviour of others and what meaning they give to it, rather than the actual reasons for the behavio [9]. A model has been recommended in which social attribution is evaluated in the context of intentional and unintentional behaviours, where intentional behaviour is defined as intention. Malle [10] stated that there were six assumptions in this model, defined as the assumptions and distinctions that an individual uses when attributing behaviour to themselves or others.
Consequently, with the importance of social attribution skills in both the cognitive psychological context and in the evaluation of clinical skills there is a need for tools with proven validity and reliability. The Social Attribution Test (SAT), developed by Klin [11], may be able to fulfil this need as it uses ambiguous visual representations with no verbal clue [12]. SAT aims to evaluate the skill of an individual in giving social meaning to ambiguous visual stimuli. The test material is the Heider and Simmel [8] animation portraying a social drama using mobile geometric shapes. The use of a silent animation reduces the need for auditory processing and verbal memory loading while the animation design also minimises dependence on visual processing. Although the animation contains implied rather than clear clues, the participants assign social identity to the objects and form a social pattern from the movements of the objects, and thus evaluate the video by attributing social meaning within the social context of the movements of the geometric shapes.
The Social Attribution Task-Multiple Choice (SAT-MC) developed by Klin [11] as a multiple choice version of the Heider and Simmel [8] animation is formed of 19 questions [13]. The “correct” responses in the SAT coding scheme for the multiple choice questions, were formed with reference to the Salience Index. By attributing social meaning to ambiguous visual stimuli (images), the participant watching the video identifies social relationships and patterns between mobile geometric shapes (large triangle, small triangle, square, and rectangle) without any verbal contextual clues [12].
It has been shown in literature that the SAT-MC battery is used in the measurement of social cognition and more than one of the subdimensions of social cognition [14,15]. In the context of SAT-MC, there are studies in literature that have examined social attribution skills [3,16-18], social perception [5,19-22], and theory of mind [23]. In a study by Brown et al. [24], SAT-MC was used in the examination of social intelligence structure. There are also panel opinions given by specialists with the aim of determining social cognition measurements and leading future quantitative research [21,22]. SAT-MC is among the potential measures. Although not recommended in the social cognition psychometric evaluation study [19], SAT-MC has been shown to be a strong candidate by panel specialists because of factors such as the form being affected very little by language and cultural differences, and that it is non-verbal [22,23,25-27].
From an examination of studies in the Turkish literature, although some scales and batteries evaluate social cognition and different dimensions of social cognition [28,29], there is no scale or test battery for the evaluation of social attribution skills that has proven psychometric properties. Therefore, the first aim of this study was to contribute to the Turkish literature about the SAT-MC battery.
Different versions of the SAT-MC battery and scoring charts have been used in international literature. The first was the SAT developed by Klin [11], in which there is prominent difficulty in scoring and coding as the points are obtained from 7 different indices. To overcome these limitations, the SAT-MC was developed as a multiple-choice version of the SAT. A new version of the SAT-MC formed by Klin and Jones [13] was then introduced into the literature as the SAT-MC II by Johannesen et al. [27] This was in the same format as the original SAT-MC and used similar mobile geometric shapes. The object movements in the SAT-MC II were designed to enact a new social drama, different from that of the original.
In recent research, an experimental study was conducted on the new meanings attributed to the moving shapes [30]. The aim of the study was to determine whether or not similar observations were obtained by forming a different version from the several forms made by Klin [11] and Klin and Jones [13]. The new set developed was formed of 32 coloured animated shape videos and each video represented a different social situation [30]. Finally, it was observed that although the SAT versions differed in respect of the content and movement patterns of the geometric shapes, the participants spontaneously attributed social meaning to the images they watched.

Social cognition in schizophrenia

In recent years, social cognition has become an increasingly prioritised area in psychiatric research and evaluation, examined under the headings of neurodevelopmental, neurodegenerative, and neuropsychiatric disorders [12,31-38].
Schizophrenia, which is a neuropsychiatric disorder, is referred to as a network disease in which neural and social networks are impaired [39]. There are studies in the literature showing that social cognition is impaired in schizophrenia, which is characterized by social functionality disorders [40-43]. It has been reported that, especially when functional results are examined, the effect of social cognition has a relatively greater share than neurocognition [32,44]. Therefore, interest has increased in social cognition in schizophrenia studies [45].
In comparisons of SAT-MC performances of individuals diagnosed with schizophrenia and autism spectrum disorder, which are known to encompass social cognition disorders such as primarily mentalisation and understanding the thoughts and emotions of others, the points obtained by these two clinical groups have been determined to be significantly lower than those of a healthy control group, and these low points have been reported to be associated with a deficiency in social attribution skills in these clinical groups [3,12,14,18,20,25]. In a study by Bell et al. [25], the SAT-MC points of a schizophrenia sample showed statistically significant relationships with functions such as theory of mind, social problem-solving, and emotion recognition, but no links were found with processes such as verbal and visual learning, attention and alertness. In this context, Klin 11 determined that individuals who had difficulty understanding social intentions, meanings, and consequences focused on the physical properties rather than the social dimensions of the elements in the SAT material.
When psychometric measurement findings were examined in studies conducted with individuals diagnosed with schizophrenia, it was reported that SAT-MC was open to the learning/practice effect [46] and that test-retest reliability and internal consistency levels [19] were weak.
The primary aim of this study was to examine the reliability and validity of the Turkish version of the SAT-MC battery in individuals diagnosed with schizophrenia and a healthy control group. Then the link was examined between social attribution skills and the relationship between socio-demographic characteristics and cognitive functions. Finally, the social attribution skills of individuals diagnosed with schizophrenia were compared with those of the healthy control group and the effect of schizophrenia symptoms on SAT-MC points was evaluated.

METHODS

Research design

The research was conducted as two independent studies with a healthy control group sample and a schizophrenia patient group sample. First, the reliability and validity of the scale were proven with all sample groups (n=207). After seeing that the reliability and validity criteria of the SAT-MC were met, the group comparisons (n=50 for both groups) and predictive variables were examined.

Ethical approval statement

Approval for the study was granted by the Social Sciences and Humanities Ethics Committee of Bartin University (decision no: 2022-SBB-0378, Approval date:19.09.2022; decision no for study 2: 2024-SBB-0674).

Participants

The sample size required for the study was calculated using G*Power software (version 3.1; Heinrich Heine University), with reference to the study by Johannesen et al. [46] In the study by Johannesen et al. [46], the authors tested the psychometric properties of SAT-MC among schizophrenia and healthy adult groups and reported the mean scores pinpointed and effect sizes. In this study, the sample size was calculated based on the sample size of the cited study and the scores obtained. Accordingly, according to the independent samples t-test statistical method, considering the power as 0.95 and the Type I error rate as 0.05, the total sample size was found to be 100.
To compensate for losses and withdrawals, as seen in every study, the sample size was increased by 10%. The control group comprised 78.3% women and 21.7% men with a mean age of 26.32±8.98 years. For the clinical group, a sample size of 50 was determined and these subjects comprised 30% women and 70% men with a mean age of 37.18±10.85 years. The analyses were completed with 157 healthy adults and 50 patients diagnosed with schizophrenia. Table 1 presents the socio-demographic characteristics of the sample groups.
The study inclusion criteria for the control group were determined as, 1) age 18-64 years, 2) no active neurological or psychiatric complaints, 3) no use of any stimulant substance within the last 6 months, 4) no use of any anti-depressants, anxiolytic or psychotropic drugs within the last 6 months, and 5) no history of head trauma. Subjects were excluded from the study if they had a first-degree relative with a neurological or psychiatric disease diagnosis, obtained a score of >9 points on the Beck Depression Inventory (BDI), or a score of >7 points on the Beck Anxiety Inventory. The healthy control group was administered clinical scales to assess only the severity of depression and anxiety symptoms. Participants were considered healthy based on their self-reports of other mental and neurological disorders.
The study included patients with a known diagnosis of schizophrenia who were admitted to the psychiatry outpatient clinic of Mersin City Training and Research Hospital between August 2023 and August 2024. The Structured Clinical Interview for DSM-5-Clinician Version was applied to these patients, and individuals with a confirmed diagnosis of schizophrenia were invited to participate in the study by a psychiatrist. According to the results of the evaluations done, the data collected from the first 50 volunteers who met the inclusion and exclusion criteria and agreed to participate in the study were included in the analyses. Accordingly, 38 of the individuals collected from the clinical population were diagnosed with paranoid schizophrenia, six with residual schizophrenia, fore with atypical schizophrenia, and two with schizoaffective disorder.
The inclusion criteria for the clinical sample group were defined as, 1) age 18-64 years, 2) meeting the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) schizophrenia diagnostic criteria, and 3) to be at least a primary school graduate. Patients were excluded from the study if they 1) had any accompanying neurological or psychiatric disease, 2) were in a manic, psychotic, or depressive attack period which would prevent test compliance, 3) had a history of alcohol or substance abuse, 4) had any change in medical treatment within the last month, 5) had undergone electroconvulsive therapy within the last 6 months, or 6) had any additional physical disease disrupting their general condition.
The study was conducted in the provinces of Bartin and Mersin, and data were collected between April 2023 and May 2024. All the study participants provided written informed consent stating voluntary participation in the study. The study was conducted with separate interviews of each participant. In the study, initial data were collected from healthy individuals. Subsequently, with the inclusion of the schizophrenia group as part of a secondary investigation (Study 2), approval was obtained from two separate ethics committees.

Data collection tools

Sociodemographic data form

All the study participants were administered this form that included questions about age, gender, education level, psychiatric history, and substance use. For the schizophrenia patient group there were also questions about the diagnosis and treatment process of the current pathology.

Scale for the Assessment of Positive Symptoms

This scale was developed to evaluate the level, distribution, and change in severity of positive symptoms in schizophrenia, and is evaluated by a psychiatrist conducting an interview with the schizophrenia patient [46]. In this study it was used to examine the relationship between positive symptoms in schizophrenia and social attribution skills.

Scale for the Assessment of Negative Symptoms

This scale was developed to evaluate the level, distribution, and change in severity of negative symptoms in schizophrenia, and is evaluated by a psychiatrist conducting an interview with the schizophrenia patient [47]. In this study it was used to examine the relationship between the negative symptoms in the schizophrenia group and social attribution skills.

SAT-MC

The SAT-MC Turkish version used in this study was the version revised by Burger-Caplan et al. [12] of the SAT-MC developed by Klin and Jones [13]. The test material used was formed of an animation varying in length from 60-100 seconds and 19 multiple choice questions. The animation was a short, silent video portraying a social drama in the form of four moving geometric shapes [8]. The 19 questions in the test are used to evaluate social attribution skill [12]. Each question has 4 options of response. In the original battery, a total of 19 questions were asked and for each question a correct response was scored as 1 point, to give total points of 0-19.

Raven Standard Progressive Matrices Test

This test was developed by Raven [48] to measure visual spatial perception, perceptual reasoning and abstract thinking, processing memory and deliberation. As there is a relationship with the intelligence component known as fluid intelligence, it then started to be used as a non-verbal intelligence test [49,50]. In this study, the test was used to examine the social meaning attributed to the geometric shapes, and the relationship with perceptual reasoning and abstract thinking of the concept.

Reading the Mind in the Eyes Test

This test was developed by Baron-Cohen et al. [51] to evaluate the skill of making an inference about the mental state of others from a certain part of the face, primarily the eyes, in children with autism or Asperger’s syndrome [52]. The Turkish version consists of 32 pictures and this test was used in this study to evaluate the affective dimension of social cognition.

BDI

This 21-item test, published by Beck et al. [53] in 1961, aims to rapidly acquire information about the level of depression. In this study it was used to exclude individuals with depressive symptoms, using the cutoff point recommended by Hisli.

Beck Anxiety Inventory

This inventory, developed by Beck et al. [54] in 1988, is used to grade the current anxiety symptoms of an individual. As for the BDI, it was used as an exclusion criterion in this study. Subjects with a score <8 points were included in the study.

Procedure

After obtaining permission from the test developers, first the SAT form was translated. Then, the research team restructured the SAT version used in this study by using Adobe Illustrator and Adobe After Effects software. The reason for this was that in the previously used versions the image quality was insufficient and for translation to Turkish of the SAT questions in the sections related to the animation. In this context, the shapes in the animation were re-structured with vectoral-based drawings without disrupting the original structure in the Adobe Illustrator software. The vector-based shapes formed were then made into an animation video in 1920-1080 Full HD format in Adobe After Effects software, taking the original content into consideration. The SAT questions were added to the sections related to the animation video with the Adobe After Effects software. Finally, the video was updated in accordance with the aim of the research with both Adobe Illustrator and Adobe After Effects software. Thus, the SAT test material was converted to test material formed of 19 multiple choice questions integrated with a 71-second silent animation.
The SAT, which was planned in a fully appropriate to the original, consisted of a first video with no questions, then by integrating the questions, a second video to which responses were requested. Thus, the total running time of the two videos was 8 minutes and 55 seconds. Unlike the reference study of Burger-Caplan et al. [12], the multiple choice questions in the video were not pre-recorded and read aloud by a tester. Taking similar application principles into consideration in this adaptation, each participant completed the test on a computer following the test instructions themselves, and therefore this scale cannot be applied to illiterate individuals.

Statistical methods

In the descriptive statistical analyses, results were stated as arithmetic mean, median, and standard deviation values for continuous variables and as numbers and percentages for categorical variables. The conformity of the data to normal distribution was examined using the Shapiro-Wilk test. The known-groups method was used within the scope of construct validity of the study. For this purpose, whether the difference between the schizophrenia and control groups in terms of SAT-MC scores was tested with the independent t-test. Comparisons of categorical variables with normal distribution were examined with the chi-square test. Although the content validity of the social attribution tasks has been performed, the content validity of the test was re-evaluated because there may have been minor differences due to the reconstruction of the stimulus set and because it has exhibited low psychometric properties in validity studies in the literature. The Content Validity Index (CVI) was calculated for content validity, and Pearson correlation analysis was performed for criteria validity. While Polit and Beck [55] and Shi et al. [56] were taken into consideration in the interpretation of the obtained CVI values, Schober et al. [57] were taken into consideration in the interpretation of the correlation values. McDonald’s omega & Cronbach’s alpha coefficient were calculated for internal consistency of the scale, and the Pearson correlation coefficient was examined for test-retest reliability. The Osburn [58] article was considered for internal consistency coefficients. Accordingly, if the internal reliability coefficient is determined between 0.70-0.80, it is acceptable; if it is between 0.80-0.90, it is reported as “good.” Receiver operating characteristic (ROC) curve analysis was performed to determine the cutoff point and power of the scale in differentiating the healthy control group and the schizophrenia patient group. The Youden’s Index was used to determine the cutoff point, and the sensitivity and specificity values of the optimal cutoff point were determined. Hierarchical multivariate regression analysis was used in the examination of the role of age, education level, Raven Standard Progressive Matrices Test (RSPM), and Reading the Mind in the Eyes Test (RMET) in the evaluation of the social attribution skill, and this analysis was based only on the schizophrenia patient group.

RESULTS

Validity of the measurement tool

Language validity

The SAT was first translated from English to Turkish by the research team. This was then checked in terms of language appropriacy by an English teacher and a psychologist with an advanced level of English. The necessary corrections were made in accordance with the recommendations, and the final version of the scale was produced.

Content validity

An expert panel was consulted for content validity. The scale was evaluated by the expert panel in respect of the content of the test and the aim of use. As it was also thought that the test adapted from the expert panel could be applied in the future in Türkiye in individuals with other neuropsychiatric diagnoses (schizophrenia, autism, dementia), evaluations that took the understanding and conceptual capacity of these individuals into account were requested. The expert panel comprised 6 members who were specialists in the fields of pediatric and adolescent mental health, developmental psychology, experimental psychology, and neuroscience. A CVI based on expert opinions was used to calculate content validity [55]. The expert opinions in this study were evaluated with the CVI, and the S-CVI/Ave value was found to be 1.16. Although the acceptable values of the CVI/Ave values calculated for content validity differ from each other [55,59,60], the S-CVI/Ave value calculated in this study is considered above acceptable values.

Criterion validity

In the determination of the criteria validity of the scale, the concurrent validity method was used. The relationship between social attribution skills and perceptual reasoning was assessed with the RSPM, and the relationship with mentalizing skills was assessed with the RMET test. A positive, moderate-level, significant correlation was determined between the RSPM and SAT scores (r=0.583, p<0.001) in all participants. In the calculation of the relationship between the SAT score and RMET, the Pearson correlation coefficient was used, and there was determined to be a positive, moderate level, significant correlation (r=0.564, p<0.001).

Reliability of the measurement tool

Reliability

First, the McDonald’s omega and Cronbach’s alpha internal consistency coefficient of the adapted test was calculated and was determined to be 0.81 and 0.80 (95% confidence interval [CI], 0.77-0.84), respectively. When the correlations of the items with each other and the relationships with the total scale points were examined, it was seen that the internal consistency coefficient of each item made a similar contribution.

Test-retest reliability

For the evaluation of test-retest reliability, the test was repeated after two weeks on 45 control subjects and 16 schizophrenia patients. Using the Pearson correlation coefficient, a high correlation was determined between the two measurements (r=0.755, p<0.001). The test-retest reliability was determined to be at an acceptable level.

Variables predicting social attribution skill in both groups

Hierarchical multiple regression was used to evaluate the ability of the RSPM and the RMET to predict social attribution skills after controlling the effects of age and education level. To evaluate the suitability of the data for regression analysis, linearity, multicollinearity, normality, and whether or not the assumptions of equal variance were met, were checked first. Multicollinearity was checked by first checking correlations between variables. The highest correlation coefficients were 0.67, which were much lower values than the value of 0.90, which is a sign of multicollinearity [61]. To decide on the presence of multicollinearity, the cutoff values for the tolerance and variance inflation factor (VIF) were taken as a reference. A tolerance value of <0.10 and, VIF value >10 indicate a high correlation between the variables in question [62]. The tolerance values were calculated as 0.319-0.760, and the VIF values as 1.266-3.181. Then the autocorrelation value was examined with the Durbin-Watson test and was calculated as 1.926. This value, which is recommended to be 1.5-2.5 [63], was recorded as close to 2, and thus there was understood to be no autocorrelation between the variables. Therefore, it was seen that the multiple collinearity proposition was not violated. The normal P-P graph showed no significant deviations from normality. A scatter graph for linearity was evaluated, and it was seen that the linearity assumption was not violated. Thus, the preliminary regression analyses assumptions were not violated.
Hierarchical multivariate regression analysis was then performed. Age and education level were included in the first block, and these were seen to explain 15.4% of the variance in SAT. RSPM and RMET scores were included in the second block, and variance was found to be 36.5% (F(4,197)=28.345, p<0.001). After controlling age and education level, the RSPM and RMET explained 21.1% of the variance in SAT (R2 change=0.211, F change (2.197)=32.767, p<0.001). In the final model, RSPM and RMET were statistically significant. The beta value of RSPM (beta=0.38, p<0.001) was higher than the beta values of RMET (beta=0.28, p<0.001). The results of the hierarchical multivariate regression analysis are shown in Table 2.

Group comparisons in social attribution skills

The final analysis conducted within the scope of the construct validity of SAT-MC was the comparison of the difference in test scores between schizophrenia and control groups using the known-groups method [64]. As it is known, individuals diagnosed with schizophrenia perform worse by comparison to healthy controls in many social cognition tasks, especially theory of mind skills [3.20,25,40,65]. Based on this, it was also hypothesized that individuals diagnosed with schizophrenia would obtain lower SAT-MC scores than the control group in this study. Therefore, firstly, a matched control group was selected for the schizophrenia group with respect to sociodemographic characteristics such as age, gender, and education level (p>0.05). The Independent samples t-test was used to compare the mean SAT points between the schizophrenia patients and healthy control groups. The mean SAT points of the healthy control group (12.64±3.40) were determined to be statistically significantly higher than those of the schizophrenia group (7.28±3.63) (t(98)=7.62, p<0.001). In determining the size of the difference between the groups, Cohen’s d value was calculated, and there was seen to be a large effect size (Cohen’s d=1.52).

Sensitivity, specificity, and cutoff point of SAT

A ROC curve was drawn to evaluate the ability of SAT to differentiate individuals diagnosed with schizophrenia. The results showed that SAT had the power of differentiation at an acceptable level (area under the curve=0.853; 95% CI=0.780-0.926, p<0.005). The optimal cutoff point for SAT was determined using the Youden’s Index [66], and was calculated as 12 points with sensitivity of 0.920 and specificity of 0.680 [67].

DISCUSSION

The aim of this study was to adapt the SAT-MC to Turkish for a healthy control group and a schizophrenia group. After examining the reliability and validity of the SAT-MC in both sample groups, differences in SAT performance were examined between the groups. Finally, the effects of sociodemographic and clinical variables predicting SAT performance in schizophrenia patients were examined.
Validity analyses were performed first. Validity analyses began with content validity, as the visual stimulus set in the SAT was faithfully re-created, and the multiple-choice questions were translated into Turkish. Content validity encompasses the evaluation of the extent to which the measurement tool and each of its components serve the purpose [68]. However, as evaluations based on expert opinion are qualitative studies, conversion of the evaluation to statistical findings should provide the opportunity for a quantitative study [69]. The CVI and the content validity rates are evaluated in the calculation of the quantitative data obtained [70,71]. There are different approaches that can be used in the examination of content validity [59,72,73]. In the current study, a CVI based on expert opinion was calculated. The S-CVI/ Ave value was 1.16, and as this was over the recommended value of 0.90 [55], it was concluded that the content validity was sufficient.
Taking into consideration the need for more than one approach to validity analyses, criteria validity was also examined [74]. The RSPM and RMET tests were used to calculate the validity of the criteria. The findings obtained from the RSPM test showed that there was an association between perceptual reasoning skills and social attribution skills. In previous studies that have examined the relationship between verbal IQ and social attribution skill, it has been reported that verbal IQ does not predict social attribution skill [11-13,25]. However, in the current study, there was seen to be a relationship of social attribution skill with the aspect of intelligence defined as fluid intelligence. According to the psychometric-based intelligence theory of Cattell [49], fluid intelligence encompasses skills such as abstract thinking in the face of new problems, logic, and reasoning [75]. Within the neuropsychological tests, RSPM is the tool most frequently used to evaluate fluid intelligence [76]. As previously stated, it is necessary to perceive the social information related to the event/situation to successfully reveal social attribution skills [1,17]. This information should be interpreted as a whole, and finally, the decision should be made related to the most recent perception of the situation. This is similar to completing what is missing from the visuals in RSPM, and thus, a relationship is seen between SAT and intelligence in aspects such as perceptual reasoning and abstract thinking.
Secondly, the relationship was examined between social attribution skill and the RMET, which is a test often used in the evaluation of theory of mind skills with the aim of examining the relationship with social cognition in addition to the neurocognitive dimension. In this context, a significant moderate correlation was determined between the RMET and the SAT scores. Statistically significant moderate correlations were found between cognitive measurement tools and SAT points, especially in schizophrenia, in which social cognitive disorders are known to be seen [77]. Consequently, in the context of criteria validity, a relationship was determined between two different measurement tools with Turkish validity and reliability, which evaluated both neurocognition and social cognition with the aim of evaluating the cognitive functions of the SAT adaptation; it was concluded that criteria validity was provided.
The internal consistency of the SAT-MC test has been examined through McDonald’s omega and Cronbach’s alpha reliability coefficients, and this study found that the SAT-MC test showed good reliability. Previous studies have reported that test-retest reliability is not at an acceptable level [25], while studies report the opposite findings [7,46]. In the current study, a high correlation was found in test-retest reliability. In addition to this finding and the correlation obtained from the entire sample covering both groups, when the groups were examined separately, no evidence was found that the effect of practice was detected at the end of the pre-test-post-test process (p>0.05).
The SAT points of the schizophrenia patient group were seen to be much lower than those of the healthy control group. Although these low points were not correlated with the positive symptom measurements of schizophrenia, there was a moderate level correlation with the negative symptom measurements. Negative symptoms have been associated with social function disorders, such as social isolation and lack of empathy [78]. Publications in this field have also reported that SAT scores are not associated with schizophrenia symptoms [25]. However, many researchers have found the lack of association between schizophrenia symptoms and social cognitive disorders to be “structural,” and have reported that it can be found even in the relatives of schizophrenia patients [79].
Patients with schizophrenia often have difficulty interpreting the emotions and intentions of others, and this is known to cause problems in social interactions [80,81]. This leads to various difficulties, such as patients’ inability to interpret social cues correctly, difficulty understanding the perspectives of others, and inappropriate behavior in social situations. Here, social attribution, which tests the ability to infer the intentions of others, is also an indicator of social functioning. Since the SAT does not contain verbal cues, it may better indicate social cognitive functioning. Moreover, since it is well known that verbal skills are impaired in patients with schizophrenia, the use of tests free of verbal skills allows for a more reliable assessment of social cognition [78].
The effects of negative symptoms and cognition on social functioning in schizophrenia patients are clear [32,78]. In addition, it has been found that there are also structural and functional abnormalities in brain regions related to some social cognitive areas in schizophrenia patients [82]. Therefore, treatments and assessments targeting deficiencies in the impairment of social cognition in schizophrenia come to the forefront [83]. In this context, it has been reported that SAT may be promising in clinical studies in the evaluation of social attribution skills in schizophrenia patients [23,25,46]. In the study by Jung et al. [3], empathy and social attribution skills were evaluated in schizophrenia patients with reduced temporal lobe volume and the ability to recognize facial emotion. Here, SAT-MC was used to examine social attribution. It has been suggested that empathy and social attribution training may be effective. As a result, interventions such as social skills training and cognitive enhancement may help schizophrenia patients improve their social interaction skills and live more independent and satisfying lives [84].
The relationship of the SAT scores with demographic variables was examined. No statistically significant findings in respect of age, gender, and education level were found in both the schizophrenia patient group and the healthy control group in this study. In the literature that has examined the relationship between age and the SAT battery, there can be seen to have been different results according to the developmental period. Research conducted on school-age children in particular has shown that in parallel with cognitive development, the scores obtained from SAT increased together with age towards the end of adolescence [7,12]. However, in the limited number of studies conducted on both healthy adults and schizophrenia patients, no significant relationship has been determined between SAT scores and age [7,25,27,46]. In this respect, the current study is consistent with research conducted on adult samples.
When differentiation of social attribution skill between the genders is examined, it can be seen that as for age, there is a statistically significant difference between the genders up to the end of adolescence as the developmental period extends [85,86] and the gender difference is eliminated in adulthood [25,46]. Consistent with previous studies, no significant difference was found between the variable of education level and SAT points for both of the current study sample groups [25,46]. However, education level included as an independent variable in the hierarchical multivariate regression model applied to the schizophrenia patient group was seen to be a predictor of SAT points.
The results of the hierarchical multivariate regression analysis showed that RSPM and RMET were predictive of social attribution skill. Education level and age included in the model in the first block provided a significant contribution to the model. There are studies in the literature supporting that there is no statistical difference in SAT points according to education level [25,46]. The variable of age has also been reported to have no effect on the SAT score [7,25,27,46]. In the second block, RSPM was added to the model based on the literature reporting that social cognitive deficits in schizophrenia are associated with fluid intelligence, and RMET was added as an assessor of the affective dimension of social cognition [87]. RSPM and RMET made a significant contribution to the model and the age and education level variables were not significant.
It has been previously stated that RSPM, which has been found to be a strong predictor of the SAT, is a frequently used measurement tool for fluid intelligence. Deficiencies in fluid intelligence, characterized by complex social behaviours and executive functions [88,89], are associated with cognitive impairments in patients with schizophrenia [90]. These cognitive impairments can disrupt the cognitive processes necessary for social interactions, such as processing social cues, adapting to social contexts, and understanding other people’s perspectives [88]. This relationship established with fluid intelligence supports the understanding of neurocognitive processes affecting the social cognition skills of patients with schizophrenia and makes its use in treatment valuable [5]. The relationship between fluid intelligence and social attribution measured by RPSM may be due to structural or functional abnormalities in the brain prefrontal cortex, which processes social cognition and neurocognition. Furthermore, fluid intelligence may be an essential ability in social functioning. Thus, it can be thought that individuals with more vital abstraction may be better able to interpret non-verbal behaviours and evaluate social cues better. There may be common processing characteristics and pathways between these two tests since both tests require the inference of meaningful relationships between geometric shapes and patterns. However, the SAT is dynamic, and the RSPM is static.
ROC curve analysis is a method used in the determination of the best cutoff point of a scale and in the calculation of the benefits of correct and incorrect responses [91]. In the current study, the capacity of the SAT to differentiate healthy individuals from schizophrenia patients was determined to be at an acceptable level. Using the Youden’s Index, the cutoff point has been calculated to be 12 [92]. In the study by Bell et al. [25], the optimal cutoff point for SAT was found to be 12 points. Although the sensitivity and specificity values obtained were close, the sensitivity value was higher. Bell et al. [25] stated that specificity should be preferred to sensitivity.
This study had some important limitations, primarily that the gender distributions were not equal in both groups, and the control group included more young adults. In addition, it was not possible to represent all education levels equally. The participants completed the scales on a computer by themselves, which required at least a basic level of literacy. Therefore, the results obtained cannot be generalised to illiterate individuals. It has also been reported that in computer-based neuropsychological tests, the ability of the individual in computer use could affect test performance [93]. However, during the data collection process, no participant reported any difficulty in completing the SAT to the researchers. This could be attributed to the participants being relatively young. Therefore, in future studies, computer use skills should be taken into consideration when evaluating the performance of older individuals with neurodegenerative disorders.
In conclusion, the findings obtained in this study demonstrated that the Turkish version of the SAT is a valid and reliable tool for measuring social attribution skills and social cognition skills in healthy individuals and patients diagnosed with schizophrenia. The SAT points were correlated with cognitive skills, and the education level, RSPM, and RMET scores were determined to be predictors of social attribution skills in the schizophrenia patient group. Therefore, the difficulty experienced by schizophrenia patients in understanding clues and the intentions of others can adversely affect negative symptoms such as lack of interest and social withdrawal. It can be said that in addition to pharmacological treatments, treatments that target negative symptoms and social-cognitive functions could be of benefit to patients with schizophrenia. It can be recommended that the test is performed using the original scoring of the cutoff point of 12.

Notes

Availability of Data and Material

If requested by the authors, the anonymized data, the material of the developed scale, and the registration form can be shared with the publisher and third parties in accordance with ethical principles.

Conflicts of Interest

The authors have no potential conflicts of interest to disclose.

Author Contributions

Conceptualization: Samet Çelik. Data curation: Samet Çelik, Leyla Arslan, Mehmet Mart. Formal analysis: Samet Çelik, Leyla Arslan. Funding acquisition: Samet Çelik, Leyla Arslan. Investigation: Samet Çelik, Leyla Arslan, Mehmet Mart. Methodology: Samet Çelik, Leyla Arslan, Caner Özarslan. Project administration: Samet Çelik. Resources: Mehmet Mart, Leyla Arslan, Caner Özarslan. Software: Samet Çelik, Leyla Arslan. Supervision: Samet Çelik. Validation: Samet Çelik. Visualization: Caner Özarslan. Writing—original draft: Leyla Arslan, Caner Özarslan, Mehmet Mart. Writing—review & editing: Samet Çelik.

Funding Statement

This study was supported within the scope of TUBITAK 2209-A program project no: 1919B012206375.

Acknowledgments

None

Table 1.
The socio-demographic characteristics for sample groups
Control group (N=157) Schizophrenia group (N=50)
Age (yr) 26.32±8.98 37.18±10.85
Gender
 Woman 123 (78.3) 15 (30.0)
 Man 34 (21.7) 35 (70.0)
Marital status
 Married 33 (21.0) 10 (20.0)
 Single 124 (79.0) 40 (80.0)
Education level
 Primary 10 (6.4) 18 (36.0)
 Secondary 15 (9.6) 6 (12.0)
 Higher 132 (84.1) 26 (52.0)
Duration of illness (yr) 10.46±7.54 (1-30)*
Number of hospitalizations 4.48±4.28 (0-20)
SAPS 54.02±15.17 (21-84)
SANS 65.46±10.66 (36-85)

Data are presented as mean±standard deviation, number (%), or mean±standard deviation (range).

* median, minimum, and maximum values are given.

SAPS, Scale for Assessment of Positive Symptoms; SANS, Scale for Assessment of Negative Symptoms

Table 2.
Regression coefficients for hierarchical multiple regression of SAT scores (N=207)
Variables Model 1
Model 2
B SE p B SE p
Age -0.110 0.028 <0.001 0.008 0.029 0.773
Education level 0.870 0.373 0.021 -0.039 0.346 0.911
RSPM 0.103 0.028 <0.001
RMET 0.183 0.067 0.007
R2 0.350

RMET, Reading the Mind in the Eyes Test; RSPM, Raven Standard Progressive Matrices Test; SAT, Social Attribution Task; SE, standard error

REFERENCES

1. Green MF, Penn DL, Bentall R, Carpenter WT, Gaebel W, Gur RC, et al. Social cognition in schizophrenia: an NIMH workshop on definitions, assessment, and research opportunities. Schizophr Bull 2008;34:1211-1220.
crossref pmid pmc
2. Arioli M, Crespi C, Canessa N. Social cognition through the lens of cognitive and clinical neuroscience. Biomed Res Int 2018;2018:4283427
crossref pmid pmc pdf
3. Jung M, Baik SY, Kim Y, Kim S, Min D, Kim JY, et al. Empathy and social attribution skills moderate the relationship between temporal lobe volume and facial expression recognition ability in schizophrenia. Clin Psychopharmacol Neurosci 2020;18:362-374.
crossref pmid pmc
4. Van Rest MM, Matthys W, Van Nieuwenhuijzen M, De Moor MHM, Vriens A, Schuengel C. Social information processing skills link executive functions to aggression in adolescents with mild to borderline intellectual disability. Child Neuropsychol 2019;25:573-598.
crossref pmid
5. Riccardi C, Montemagni C, Del Favero E, Bellino S, Brasso C, Rocca P. Pharmacological treatment for social cognition: current evidence. Int J Mol Sci 2021;22:7457
crossref pmid pmc
6. Savla GN, Vella L, Armstrong CC, Penn DL, Twamley EW. Deficits in domains of social cognition in schizophrenia: a meta-analysis of the empirical evidence. Schizophr Bull 2013;39:979-992.
crossref pmid
7. García-Guerrero MA, Peña Lasa J, Zubiaurre-Elorza L, Benitez Baz D, Marina Hernández A, Ojeda Del Pozo N. Spanish adaptation and validation of the social attribution task-multiple choice (SAT-MC) versions I and II for children and adolescents. Actas Esp Psiquiatr 2021;49:236-243.
pmid pmc
8. Heider F, Simmel M. An experimental study of apparent behavior. Am J Psychol 1944;57:243-259.
crossref
9. Heider F. The psychology of interpersonal relations. New York: John Wiley & Sons; 1958.

10. Malle BF. How the mind explains behavior: folk explanations, meaning, and social interaction. Cambridge: MIT Press; 2004.

11. Klin A. Attributing social meaning to ambiguous visual stimuli in higher-functioning autism and Asperger syndrome: the social attribution task. J Child Psychol Psychiatry 2000;41:831-846.
crossref pmid
12. Burger-Caplan R, Saulnier C, Jones W, Klin A. Predicting social and communicative ability in school-age children with autism spectrum disorder: a pilot study of the social attribution task, multiple choice. Autism 2016;20:952-962.
crossref pmid pdf
13. Klin A, Jones W. Attributing social and physical meaning to ambiguous visual displays in individuals with higher-functioning autism spectrum disorders. Brain Cogn 2006;61:40-53.
crossref pmid
14. Shan P, Li G, Jiang D, Chen C, Wang L, Tian H, el al. Supportive family environments can improve treatment compliance, social cognition, brain activity in patients with schizophrenia—a pilot study. Psychiatry Clin Psychopharmacol 2020;30:362-368.
crossref
15. Krolikowski T. Borderline traits in mothers and their adolescent daughters: associations between emotion regulation, relationship quality, and social cognition [Masters Thesis] Lewisburg, Bucknell University. 2020.

16. Qian S. Functional MRI of emotional face processing in schizophrenia and the social cognition psychometric correlates. New Haven: Yale University; 2012.

17. Bell MD, Corbera S, Johannesen JK, Fiszdon JM, Wexler BE. Social cognitive impairments and negative symptoms in schizophrenia: are there subtypes with distinct functional correlates? Schizophr Bull 2013;39:186-196.
crossref pmid
18. Corbera S, Wexler BE, Ikezawa S, Bell MD. Factor structure of social cognition in schizophrenia: is empathy preserved? Schizophr Res Treatment 2013;2013:409205
crossref pmid pmc pdf
19. Pinkham AE, Harvey PD, Penn DL. Social cognition psychometric evaluation: results of the final validation study. Schizophr Bull 2018;44:737-748.
crossref
20. Lim JE, Kwon YJ, Jung SY, Park K, Lee W, Lee SH, et al. Benefits of social cognitive skills training within routine community mental health services: evidence from a non-randomized parallel controlled study. Asian J Psychiatr 2020;54:102314
crossref pmid
21. Kubota R, Okubo R, Akiyama H, Okano H, Ikezawa S, Miyazaki A, et al. Study protocol: the evaluation study for social cognition measures in Japan (ESCoM). J Pers Med 2021;11:667
crossref pmid pmc
22. Okano H, Kubota R, Okubo R, Hashimoto N, Ikezawa S, Toyomaki A, et al. Evaluation of social cognition measures for Japanese patients with schizophrenia using an expert panel and modified Delphi method. J Pers Med 2021;11:275
crossref pmid pmc
23. Lee HS, Corbera S, Poltorak A, Park K, Assaf M, Bell MD, et al. Measuring theory of mind in schizophrenia research: cross-cultural validation. Schizophr Res 2018;201:187-195.
crossref pmid
24. Brown MI, Heck PR, Chabris CF. The social shapes test as a self-administered, online measure of social intelligence: two studies with typically developing adults and adults with autism spectrum disorder. J Autism Dev Disord 2024;54:1804-1819.
crossref pmid pdf
25. Bell MD, Fiszdon JM, Greig TC, Wexler BE. Social attribution test—multiple choice (SAT-MC) in schizophrenia: comparison with community sample and relationship to neurocognitive, social cognitive and symptom measures. Schizophr Res 2010;122:164-171.
crossref pmid pmc
26. Horan WP, Nuechterlein KH, Wynn JK, Lee J, Castelli F, Green MF. Disturbances in the spontaneous attribution of social meaning in schizophrenia. Psychol Med 2009;39:635-643.
crossref pmid
27. Johannesen JK, Lurie JB, Fiszdon JM, Bell MD. The social attribution task-multiple choice (SAT-MC): a psychometric and equivalence study of an alternate form. ISRN Psychiatry 2013;2013:830825
crossref pmid pmc pdf
28. Erol A, Ünal EK, Gülpek D, Mete L. [The reliability and validity of facial emotion identification and facial emotion discrimination tests in Turkish culture]. Anadolu Psikiyatri Derg 2009;10:116-123. Turkish.

29. Değirmencioğlu B, Alptekin K, Akdede BB, Erdil N, Aktener A, Mantar A, et al. [The validity and reliability study of the Dokuz Eylül theory of mind index (DEZİKÖ) in patients with schizophrenia]. Turk Psikiyatri Derg 2018;29:193-201. Turkish.
pmid
30. Ratajska A, Brown MI, Chabris CF. Attributing social meaning to animated shapes: a new experimental study of apparent behavior. Am J Psychol 2020;133:295-312.
crossref pmid pmc pdf
31. Brekke JS, Hoe M, Long J, Green MF. How neurocognition and social cognition influence functional change during community-based psychosocial rehabilitation for individuals with schizophrenia. Schizophr Bull 2007;33:1247-1256.
crossref pmid pmc
32. Fett AK, Viechtbauer W, Dominguez MD, Penn DL, van Os J, Krabbendam L. The relationship between neurocognition and social cognition with functional outcomes in schizophrenia: a meta-analysis. Neurosci Biobehav Rev 2011;35:573-588.
crossref pmid
33. Fiszdon JM, Johannesen JK. Functional significance of preserved affect recognition in schizophrenia. Psychiatry Res 2010;176:120-125.
crossref pmid pmc
34. Kurtz MM, Richardson CL. Social cognitive training for schizophrenia: a meta-analytic investigation of controlled research. Schizophr Bull 2012;38:1092-1104.
crossref pmid
35. Ecker C, Schmeisser MJ, Loth E, Murphy DG. Neuroanatomy and neuropathology of autism spectrum disorder in humans. Adv Anat Embryol Cell Biol 2017;224:27-48.
crossref pmid
36. Lee S, Jacobsen EP, Jia Y, Snitz BE, Chang CH, Ganguli M. Reading the mind in the eyes: a population-based study of social cognition in older adults. Am J Geriatr Psychiatry 2021;29:634-642.
crossref pmid
37. Vogel A, Jørgensen K, Larsen IU. Normative data for emotion hexagon test and frequency of impairment in behavioral variant frontotemporal dementia, Alzheimer’s disease and Huntington’s disease. Appl Neuropsychol Adult 2022;29:127-132.
crossref pmid
38. Orso B, Lorenzini L, Arnaldi D, Girtler N, Brugnolo A, Doglione E, et al. The role of hub and spoke regions in theory of mind in early Alzheimer’s disease and frontotemporal dementia. Biomedicines 2022;10:544
crossref pmid pmc
39. Torous J, Keshavan M. The role of social media in schizophrenia: evaluating risks, benefits, and potential. Curr Opin Psychiatry 2016;29:190-195.
pmid
40. Brüne M. “Theory of mind” in schizophrenia: a review of the literature. Schizophr Bull 2005;31:21-42.
crossref pmid
41. Penn DL, Sanna LJ, Roberts DL. Social cognition in schizophrenia: an overview. Schizophr Bull 2008;34:408-411.
crossref pmid pmc
42. Bora E, Yucel M, Pantelis C. Theory of mind impairment in schizophrenia: meta-analysis. Schizophr Res 2009;109:1-9.
crossref pmid
43. Fiszdon JM, Bell MD. Effects of presentation modality and valence on affect recognition performance in schizophrenia and healthy controls. Psychiatry Res 2009;170:114-118.
crossref pmid
44. Vauth R, Rüsch N, Wirtz M, Corrigan PW. Does social cognition influence the relation between neurocognitive deficits and vocational functioning in schizophrenia? Psychiatry Res 2004;128:155-165.
crossref pmid
45. Pinkham AE, Penn DL. Neurocognitive and social cognitive predictors of interpersonal skill in schizophrenia. Psychiatry Res 2006;143:167-178.
crossref pmid
46. Johannesen JK, Fiszdon JM, Weinstein A, Ciosek D, Bell MD. The social attribution task - multiple choice (SAT-MC): psychometric comparison with social cognitive measures for schizophrenia research. Psychiatry Res 2018;262:154-161.
crossref pmid
47. Andreasen NC. Methods for assessing positive and negative symptoms. Mod Probl Pharmacopsychiatry 1990;24:73-88.
pmid
48. Raven JC. Raven’s progressive matrices (1938) : sets A, B, C, D, E. Melbourne: Australian Council for Educational Research; 1938.

49. Cattell RB. Theory of fluid and crystallized intelligence: a critical experiment. J Educ Psychol 1963;54:1-22.
crossref
50. Bilker WB, Hansen JA, Brensinger CM, Richard J, Gur RE, Gur RC. Development of abbreviated nine-item forms of the Raven’s standard progressive matrices test. Assessment 2012;19:354-369.
crossref pmid pmc pdf
51. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The “reading the mind in the eyes” test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry 2001;42:241-251.
crossref pmid
52. Bora E, Eryavuz A, Kayahan B, Sungu G, Veznedaroglu B. Social functioning, theory of mind and neurocognition in outpatients with schizophrenia; mental state decoding may be a better predictor of social functioning than mental state reasoning. Psychiatry Res 2006;145:95-103.
crossref pmid
53. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry 1961;4:561-571.
crossref pmid
54. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol 1988;56:893-897.
crossref pmid
55. Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health 2006;29:489-497.
crossref pmid
56. Shi J, Mo X, Sun Z. [Content validity index in scale development]. Zhong Nan Da Xue Xue Bao Yi Xue Ban 2012;37:152-155. Chinese.
pmid
57. Schober P, Boer C, Schwarte LA. Correlation coefficients: appropriate use and interpretation. Anesth Analg 2018;126:1763-1768.
crossref pmid
58. Osburn HG. Coefficient alpha and related internal consistency reliability coefficients. Psychol Methods 2000;5:343-355.
crossref pmid
59. Davis LL. Instrument review: getting the most from a panel of experts. Appl Nurs Res 1992;5:194-197.
crossref
60. Lynn MR. Determination and quantification of content validity. Nurs Res 1986;35:382-386.
crossref pmid
61. Pallant J. SPSS survival manual: a step by step guide to data analysis using SPSS for Windows. McGraw Hill; 2016.

62. Dormann CF, Elith J, Bacher S, Buchmann C, Carl G, Carré G, et al. Collinearity: a review of methods to deal with it and a simulation study evaluating their performance. Ecography 2013;36:27-46.
crossref
63. Field A. Discovering statistics using SPSS (3rd ed). Los Angeles: Sage Publications; 2009.

64. Rodrigues IB, Adachi JD, Beattie KA, Lau A, MacDermid JC. Determining known-group validity and test-retest reliability in the PEQ (personalized exercise questionnaire). BMC Musculoskelet Disord 2019;20:373
crossref pmid pmc pdf
65. Weng Y, Lin J, Ahorsu DK, Tsang HWH. Neuropathways of theory of mind in schizophrenia: a systematic review and meta-analysis. Neurosci Biobehav Rev 2022;137:104625
crossref pmid
66. Li C, Chen J, Qin G. Partial Youden index and its inferences. J Biopharm Stat 2019;29:385-399.
crossref pmid
67. Polit D, Yang F. Measurement and the measurement of change: a primer for the health professions. Philadelphia: Wolters Kluwer; 2016.

68. Tekin H. Eğitimde Ölçme ve Değerlendirme. Ankara: Mars Matbaası; 1977.

69. Yurdugül H. Ölçek geliştirme çalışmalarında kapsam geçerliği için kapsam geçerlik İndekslerinin kullanılması [Internet]. Available at: https://yunus.hacettepe.edu.tr/~yurdugul/3/indir/PamukkaleBildiri.pdf. Accessed April 27, 2024.

70. Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: conducting a content validity study in social work research. Soc Work Res 2003;27:94-104.
crossref
71. Ayre C, Scally AJ. Critical values for Lawshe’s content validity ratio: revisiting the original methods of calculation. Meas Eval Couns Dev 2014;47:79-86.

72. Cohen JA. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960;20:37-46.
crossref pdf
73. Lawshe CH. A quantitative approach to content validity. Pers Psychol 1975;28:563-575.

74. Hinkin TR. A review of scale development practices in the study of organizations. J Manag 1995;21:967-988.
crossref
75. Horn JL, Cattell RB. Age differences in fluid and crystallized intelligence. Acta Psychol (Amst) 1967;26:107-129.
crossref pmid
76. Wright SB, Matlen BJ, Baym CL, Ferrer E, Bunge SA. Neural correlates of fluid reasoning in children and adults. Front Hum Neurosci 2008;1:8
crossref pmid pmc
77. Kharawala S, Hastedt C, Podhorna J, Shukla H, Kappelhoff B, Harvey PD. The relationship between cognition and functioning in schizophrenia: a semi-systematic review. Schizophr Res Cogn 2021;27:100217
crossref pmid pmc
78. Okruszek Ł, Piejka A, Chrustowicz M, Krawczyk M, Jarkiewicz M, Schudy A, et al. Social cognitive bias increases loneliness both directly and by decreasing social connection in patients with schizophrenia. Schizophr Res 2023;256:72-78.
crossref pmid
79. Çimentepe Sezer Ç. [Şizofreni-bipolar spektrumdaki yüksek riskli bireylerdenegatif belirtilerin sosyal işlevsellik ve bilişselbozuklukla ilişkisi] [Masters Thesis]. İzmir: Dokuz Eylül University; 2021. Turkish.

80. Penn DL, Mueser KT, Spaulding W. Information processing, social skill, and gender in schizophrenia. Psychiatry Res 1996;59:213-220.
crossref pmid
81. Addington J, Addington D. Neurocognitive and social functioning in schizophrenia: a 2.5 year follow-up study. Schizophr Res 2000;44:47-56.
crossref pmid
82. Green MF, Horan WP, Lee J. Social cognition in schizophrenia. Nat Rev Neurosci 2015;16:620-631.
crossref pmid pdf
83. Kimoto S, Makinodan M, Kishimoto T. Neurobiology and treatment of social cognition in schizophrenia: bridging the bed-bench gap. Neurobiol Dis 2019;131:104315
crossref pmid
84. Bechi M, Bosia M, Spangaro M, Buonocore M, Cocchi F, Pigoni A, et al. Combined social cognitive and neurocognitive rehabilitation strategies in schizophrenia: neuropsychological and psychopathological influences on theory of mind improvement. Psychol Med 2015;45:3147-3157.
crossref pmid
85. Putallaz M, Hellstern L, Sheppard BH, Grimes CL, Glodis KA. Conflict, social competence, and gender: maternal and peer contexts. Early Educ Dev 1995;6:433-447.
crossref
86. Hu Z, Chan RC, McAlonan GM. Maturation of social attribution skills in typically developing children: an investigation using the social attribution task. Behav Brain Funct 2010;6:10
crossref pmid pmc pdf
87. Chen KW, Lee YC, Yu TY, Cheng LJ, Chao CY, Hsieh CL. Test-retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia. BMC Psychiatry 2021;21:39
crossref pmid pmc pdf
88. Roca M, Manes F, Cetkovich M, Bruno D, Ibáñez A, Torralva T, et al. The relationship between executive functions and fluid intelligence in schizophrenia. Front Behav Neurosci 2014;8:46
crossref pmid pmc
89. Huepe D, Roca M, Salas N, Canales-Johnson A, Rivera-Rei ÁA, Zamorano L, et al. Fluid intelligence and psychosocial outcome: from logical problem solving to social adaptation. PLoS One 2011;6:e24858.
crossref pmid pmc
90. Van Rheenen TE, Cropley V, Fagerlund B, Wannan C, Bruggemann J, Lenroot RK, et al. Cognitive reserve attenuates age-related cognitive decline in the context of putatively accelerated brain ageing in schizophrenia-spectrum disorders. Psychol Med 2020;50:1475-1489.
crossref pmid
91. Kaftandjieva F. Methods for setting cut scores in criterion-referenced achievement tests. Arnhem: Cito; 2010.

92. Unal I. Defining an optimal cut-point value in ROC analysis: an alternative approach. Comput Math Methods Med 2017;2017:3762651
crossref pmid pmc pdf
93. Çelik S, Oğuz M, Konur U, Köktürk F, Atasoy N. Comparison of computerized and manual versions of the Wisconsin card sorting test on schizophrenia and healthy samples. Psychol Assess 2021;33:562-567.
crossref pmid


ABOUT
AUTHOR INFORMATION
ARTICLE CATEGORY

Browse all articles >

BROWSE ARTICLES
Editorial Office
#522, 27, Seochojungang-ro 24-gil, Seocho-gu, Seoul 06601, Korea
Tel: +82-2-717-5543    E-mail: psychiatryinvest@gmail.com                

Copyright © 2025 by Korean Neuropsychiatric Association.

Developed in M2PI

Close layer
prev next