For the proper treatment of first-episode psychosis, assessment of treatment response, remission, relapse, and recovery is important. Therefore, the present study aimed to develop operational definitions of clinical outcomes in first-episode psychosis.
A questionnaire was developed by a panel of experts and underwent three revisions. The final survey was presented to 150 psychiatrists who were members of the Korean Society for Schizophrenia Research. Respondents selected factors that they believed were important to consider while defining treatment response, remission, relapse, and recovery using a 6-point Likert scale. Selected factors that constituted each definition were statistically extracted, and operational definitions were developed.
A total of 91 experts responded to the survey. The extent of reduction in psychopathology, socio-occupational functioning, and duration of each state were the core factors of each definition. Outcomes obtained from discussions and consultations by experts have been summarized and proposed.
The criteria developed in this survey tended to be somewhat stricter than those used by other studies. The fundamental reason for this is that this survey focused on first-episode psychosis. A better understanding of each definition in first-episode psychosis is necessary to improve effective treatment outcomes.
The goals in treating first-episode psychosis (FEP) include targeting symptoms, preventing relapse, and increasing adaptive functioning so that the patient can be integrated back into the community as a normally functioning individual [
In general, researchers use rating scales such as the Positive and Negative Syndrome Scale (PANSS) [
This lack of uniformity in the definitions of clinical outcomes has had an impact on the clinical guidelines that seek to distill evidence from various studies. Not surprisingly, given the variation used in the criteria among studies, treatment guidelines use vague definitions that are open to a wide range of interpretations, potentially leading to inconsistent clinical management and treatment delays. Complicating this, inconsistent results have been reported with the application of the same definition. For example, the reported rates of remission in FEP range between 17% and 78% [
An intensive approach was adopted to develop criteria for the definitions of treatment response, remission, relapse, and recovery in FEP. First, we performed a literature review of these definitions. We searched articles and abstracts using the following keywords: first-episode psychosis, treatment response, remission, relapse, recovery, and outcome in PubMed from January 1980 to January 2016. We included studies that involved patients with first-episode schizophrenia spectrum psychotic disorder, namely schizophrenia, schizophreniform disorder, nonaffective psychosis, delusional disorder, and psychotic disorder not otherwise specified. Titles and abstracts were reviewed to initially determine eligibility. The reference lists of relevant original research and review articles were also searched to further identify potential studies. We conducted a systematic review to judge which factors were appropriate for each definition. A total of 93 studies were identified, of which 66 met the selection criteria and were used to develop a questionnaire. Operationalized criteria of treatment response [
This study was approved by the Medical Research Ethics Committee and Institutional Review Board of the Inje University Haeundae Paik Hospital (2016-06-019).
First, we recorded whether the criteria from the literature review were operationalized. Next, the key factors that constituted each definition were finely extracted. Subsequently, a committee composed of 10 expert members of the treatment guideline committee for first-episode psychosis of the Korean Society for Schizophrenia Research (KSSR) was established. The committee met four times in 2016 and mapped out the key criteria for each definition and operationalized them. Following this, the committee developed a survey, which was defined and modified three times. In its final version, it was composed of four parts with a total of 48 items, including four items for demographic data. Respondents were asked how strongly they agreed or disagreed with each statement on a 6-point Likert scale (strongly agree: 5 to strongly disagree: 0). In addition, respondents were asked to rank their preferences regarding various operational criteria. A brief introduction of the meaning and methods was provided to the respondents. Subjects were instructed to respond to questions for individuals with FEP and were informed that several commonly used instruments were included as part of the survey items. Finally, respondents were instructed that each item itself was not a definition but factors constituting a definition and which specific factors have been used by the researchers.
We recruited all KSSR members to take part in the survey to identify the key areas of agreement and disagreement. The survey was conducted via mail. One hundred and fifty members were invited via telephone and asked to participate in the survey. During the 30-day collection period, 91 responses (60.7%), covering all areas of South Korea, were received. Ten members of the KSSR refused to respond. Responses were synthesized and refined during subsequent discussions among the committee to derive a consensus recommendation. Following this, the committee met to consider and revise the criteria for which there was a lack of consensus. The revised criteria were circulated to all KSSR members and presented as part of an open workshop at a special interest meeting for further discussion, input, and refinement. Finally, consensus was reached regarding this publication through review by all authors. The results of the survey were presented and discussed at the UK-Asian Symposium on Biomarkers of Psychosis (2016) and the 2016 KSSR autumn meeting.
PANSS is an internationally validated assessment tool based on 30 items that measure positive and negative psychotic symptoms and general psychopathology symptoms. Each item is rated based on seven categories of severity, resulting in a total score that ranges from 30 to 210 [
Most of the survey consisted of assessing specific items using a 6-point (0–5) Likert scale. We scored the answers to these questions as follows: if the response was >3 points (neutral), it was determined that the item was appropriate. Responses were summarized by frequency and percentage and mean±standard deviation. Differences were tested using Fisher’s exact test for categorical data and the Mann-Whitney’s U test or Kruskal-Wallis test for numeric data. For ranked preferences, the percentage of the first ranked item was calculated. In addition, a weighted-average ranking was calculated for each answer to evaluate the most preferred answer. Statistical analysis was performed using IBM SPSS Statistics version 21.0 (IBM Corp., Armonk, NY, USA). p<0.05 was considered statistically significant. This study was exploratory by nature, and therefore no adjustment for multiple testing was applied.
A total of 91 experts (60.7%) participated in the survey. The mean (standard deviation [
Instead of positive symptoms alone, simultaneously evaluating both positive and negative symptoms to judge the treatment response showed a statistically high level of consensus (p<0.001). For the PANSS total score, “30% or 50% reduction” was statistically higher than “20% reduction” (p<0.001). In the case of positive symptoms, the most appropriate criteria were surveyed, and most respondents held that all seven PANSS positive items should be evaluated. On the CGI-Improvement (CGI-I), there was no statistically significant difference between the options “improved to ≥2 points when the baseline CGI-Severity (CGI-S) score was ≥4 (moderate), and improved to ≥1 point when the baseline CGI-S score was 3” and “improved to ≥2 points” (p=0.453). When asked regarding the appropriate time to decide on a treatment response after initiation of medication, 53.3% of the respondents selected 4, followed by 6 (21.1%) and then 2 (15.6%) weeks.
The mean±SD of the consensus on the inclusion of social and occupational function to the criteria of remission was 4.08± 1.05. Most respondents answered “≤2 (minimal) than≤3 (mild)” to judge the severity of each PANSS item score for the remission criteria (p<0.001). For positive symptoms, the most appropriate criteria were surveyed and most respondents agreed that all seven PANSS positive items should be used. The use of the SANS for the evaluation of negative symptoms showed a level of agreement of approximately 3.66±1.05, and when the SANS (76) was used, the criterion of severity was “≤2 (minimal) than≤3 (mild)” to judge the severity of each SANS item score (p<0.001). The agreement level for using a CGI-S score of 3 or lower was 3.66±0.79 for symptom improvement. The most frequent response regarding the maintenance period of the remission state was 12 months (56%), followed by 6 (33.0%) and 3 (6.6%) months.
The degree of consent on defining relapse based on the patient being admitted to the hospital due to aggravation of psychiatric symptoms was very high (4.53±0.81). The agreement on an increase of 25%≥PANSS total score showed statistically significance than the “increase of more than 20%” (p=0.001). The degree of agreement on the clinically significant suicidal attempt or suicide was 4.20±1.02 and on intentional self-injury behavior, 4.00±0.97. In the case of 2 or more consecutive days, on the Hostility or Uncooperation PANSS items, the level of consent was significantly higher for “6 points or higher” than for “5 points” (p=0.005). Moreover, the degree of consent was 4.60±0.61 when the CGI-I was 6 or 7, 4.00±0.72 when the CGI-S was 4 or higher, but 3.06±0.99 for higher levels of psychiatric treatment (increasing number of visits to the clinic) and 3.07±1.04 when there was increase of ≥25% in maintained medication dose.
In addition, when relapse was defined using the PANSS, 44.3% of the respondents selected “4 points ≥any of the four PANSS positive items (P1, P2, P3, P6) with increase ≥2 points” as their first priority. The respondents reported that the duration of the stable condition prior to relapse should be at least 6 (59.3%) or 12 (28.6%) months.
The degree of consent on dividing recovery into partial and full was 3.94±1.22 and 3.37±0.99, respectively, for a PANSS total score ≤36 points.
For the criteria of social functioning, “having age-appropriate interpersonal relationships” (46.0%), followed by “meeting with an acquaintance more than twice a month or making phone calls” (40.2%) were selected as the definition for partial recovery. However, for full recovery, most respondents selected “having age-appropriate interpersonal relationships” (85.7%). The difference between the two definitions was statistically significant (p<0.001). For the criteria of occupational functioning, “when working or preparing for work or when the students went to school somewhat regularly and homemakers performed some housework” was highly selected at 46.5% for partial recovery and for full recovery, “having appropriate occupational or academic function and homemakers performing appropriate housework” was selected (68.5%). This difference was also statistically significant (p<0.001). The response to the question regarding the cutoff value for the general function assessment of full remission with the Global Assessment of Functioning (GAF) [
Every decision in clinical practice and clinical trials for the treatment of FEP should consider the outcomes. Because there is no clear definition of clinical outcomes in FEP, we sought to determine them and describe the subjective opinions of experts as objectively as possible.
Our results showed that besides our generally moderate rigor of development, the results of this survey might be difficult to apply simply and had a low legitimization base for clear use in clinical practice and research. The respondents’ opinions regarding factors that could be used to build definitions showed that, in practice, it may be challenging to develop operational definitions. However, the originality of our study lies in determining factors that could construct each definition based on literature review and the interpretation of responses from a nationwide survey of key representatives in Korea.
Treatment response denotes the extent to which a patient improves, irrespectively of the presence or absence of symptoms [
According to one meta-analysis of PANSS factor structure, P2, Conceptual Disorganization, and P4, Excitement, are not included in the positive symptoms of schizophrenia [
On remission, the results of the survey were partially different from those of the RSWG. According to the results of our survey, most respondents agreed to include the concept of social occupational function in the definition of remission. Including the concept of improvement of functioning to the criteria of remission could cause confusion with the criteria of recovery. Several studies prior to the definition of the RSWG included functional improvement in the concept of remission [
Instead of a score of 3 points, respondents defined a PANSS score of ≤2 points (minimal) as the cutoff for positive and negative symptoms for remission. This suggests that the survey respondents in this study tended to apply stricter criteria. Chung et al. [
Many relapse definitions have been used by numerous studies and are presented in
Recovery has been operationalized as a multidimensional concept, incorporating symptomatic and functional improvement in the social, occupational, and educational domains, with a necessary duration component [
Considering psychopathology, dosage of medication, and the CGI scale, the guidelines suggested by our Korean experts were somewhat strict compared with other definitions. This can be explained by our specificity of assessing FEP. On the duration of recovery, our results showed that it should be set at 1 year, which is consistent with the proposal by Lally et al. [
It is of note that a small number of experts participated in the survey. This may have excluded many opinions of experts with sufficient experience in the field of FEP. Furthermore, it is not common for the PANSS or related objective instruments to be administered in routine clinical practice in Korea. Most general and psychiatric training hospitals have a residency program for psychiatrists. Fortunately, the respondents’ working environment was biased toward general and psychiatric hospitals and were often exposed to incidents of psychosis and objective instruments for assessing the symptoms of psychosis. Although general psychometric properties cannot be examined with the CGI scale, one alternative would be to replace the PANSS with the CGI score that can be quickly and easily evaluated [
In conclusion, as shown in
The results of this study are outcomes obtained from various discussions and consultations after we reviewed domestic and foreign literature regarding the clinical evaluations of FEP, followed by a collection of informed opinions from Korean experts. Therefore, these results may improve the interpretation of assessment measures in FEP research. We hope that these can be widely shared among psychiatrists and play a significant role in the clinical care of patients with FEP.
The online-only Data Supplement is available with this article at
This research was supported by a grant of the Korean Mental Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HM14C2608) and a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (HI18C2383).
The authors have no potential conflicts of interest to disclose.
Conceptualization: Young-Chul Chung. Data curation: Kunhyung Kim, Bong Ju Lee. Formal analysis: Kunhyung Kim. Funding acquisition: Young-Chul Chung. Investigation: Young-Chul Chung, Bong Ju Lee. Methodology: Young-Chul Chung, Sung-Wan Kim, Bong Ju Lee. Project administration: Young-Chul Chung, Yang Hong Piao. Resources: Sung-Wan Kim, Jung Jin Kim, Je-Chun Yu, Kyu Young Lee, Seung-Hee Won, Seung-Hwan Lee, Seung-Hyun Kim, Shi Hyun Kang, Euitae Kim. Software: Kunhyung Kim. Supervision: Young-Chul Chung. Validation: Young-Chul Chung, Bong Ju Lee. Visualization: Kunhyung Kim, Bong Ju Lee. Writing—original draft: Bong Ju Lee. Writing—review & editing: Young-Chul Chung, Bong Ju Lee.
Definition of treatment response, remission, relapse, and recovery
Treatment response | ||
1. Considering positive and negative symptoms simultaneously | ||
2. ≥30% or ≥50% decrease in the total PANSS score | ||
3. All seven positive items on the PANSS could be used for decision | ||
4. Score of 1 or 2 on the CGI-I | ||
5. After 4 weeks for decision making | ||
Remission | ||
1. Score of ≤2 on positive and negative PANSS items simultaneously | ||
2. All seven positive items on the PANSS could be used for decision | ||
3. In case of using the SANS, score of ≤2 on all items | ||
4. CGI-S score ≤3 | ||
5. Maintaining 12 months of symptom stabilization period | ||
Relapse (any of one with exacerbation of symptoms ≥6 months after remission) | ||
1. Psychiatric hospitalization | ||
2. ≥25% increase in the total PANSS score | ||
3. Deliberate self-injury, clinically serious suicide or homicide ideation, or suicide attempt | ||
4. Violent behavior resulting in significant injury to another person or property | ||
5. Score ≥6 for a PANSS item (P7 hostility or G8 uncooperativeness) within 2 consecutive days | ||
6. CGI-I score ≥6 (much worse) or 7 (very much worse) | ||
7. Score ≥4 for CGI-S with an increase ≥2 points | ||
8. Exacerbation of symptoms ≥6 months after remission | ||
Recovery | ||
Partial | ||
1. All criteria fulfilled for ≥1 year | ||
2. a) Maintaining age-appropriate interpersonal relationships | ||
b) Employment for entire remission period or homemakers performing housework to some extent | ||
3. Score of ≤3 on PANSS or SANS items | ||
4. ≤300 mg of chlorpromazine (or 3 mg of risperidone) equivalent dose | ||
5. CGI-S score ≤3 (mildly ill) | ||
6. GAF or SOFAS ≥61 | ||
Full | ||
1. All criteria fulfilled for ≥1 year | ||
2. Maintaining age-appropriate socio-occupational functioning | ||
3. Absent on PANSS or SANS items | ||
4. No medication | ||
5. CGI-S score ≤1 (normal, not at all ill) | ||
6. GAF or SOFAS ≥71 |
CGI-S: Clinical Global Impression-Severity, CGI-I: Clinical Global Impression of Improvement, PANSS: Positive and Negative Syndrome Scale, SANS: Scale for the Assessment of Negative Symptoms, GAF: Global Assessment of Functioning, SOFAS: Social and Occupational Functioning Assessment Scale
Relapse definitions used by different studies
Authors | Criteria for relapse (one of the following cases) |
|||||||
---|---|---|---|---|---|---|---|---|
Hospitalization | Increased number of psychiatric treatments | Change in the PANSS score | Change in the CGI score | Self-injury | Homicidal thoughts | Suicide or murder accident | Damage to property by violent behaviour | |
Csernansky et al. [ |
O | O | ≥25% in total; ≥10 points, when the baseline score <40 | Much worse or very much worse | O | O | - | O |
Schooler et al. [ |
- | - | ≥25% in total; ≥10 points, when baseline score is below 40 | Much worse or very much worse | O | - | O | O |
Simpson et al. [ |
- | - | ≥4 in five items (P1, P3, P5, P6, and P9) for at least 1 week | - | - | - | - | - |
Chung et al. [ |
- | - | ≥20% in total; ≥4 points in P1, P2, P3, P6 | ≥2 points compared with the baseline score | - | - | - | - |
Lee et al. [ |
- | - | ≥5 points in positive items and GAF score <30 | - | - | - | - | - |
Kim et al. [ |
O | - | ≥25% in total; ≥10 points, when baseline score is below 40; ≥4 points due to increase of ≥2 points in P1, P2, P3, and P6 | ≥4 points in the CGI-S due to increase of 2 points; ≥6 in CGI-I | O | - | O | O |
CGI: Clinical Global Impression, -: Not reported, PANSS: Positive and Negative Syndrome Scale, O: Reported
Recovery definitions used by different studies
Authors | Criteria for recovery | Recovery |
---|---|---|
McGlashan et al. [ |
No symptoms, being employed, and maintaining a meaningful relationship with family members as the normal state. | 6% |
Torgalsboen et al. [ |
Reliable diagnosis of schizophrenia, Not fulfilling criteria at present; had been out of hospital for at least 5 years; present psychosocial functioning was within a “normal range” (e.g., ≥65 on the GAS) and no neuroleptic drug use or only at a low dosage (<1/2 DDD). | NR |
Liberman et al. [ |
≥4 points on the BPRS for 2 consecutive years. Ability to successfully hold at least a part-time job or successfully attend school at least part-time for 2 consecutive years. During the age of retirement, participating actively in recreational, family, or volunteer activities. Living independently without day-to-day supervision for money management, shopping, food preparation, laundry, personal hygiene, or need for structured recreational or vocational activities. Ability to initiate own activities and schedule one’s time without reminders from family or other caregivers. While most individuals will be living on their own or with a roommate, partner, or friend, some individuals could meet this criterion if they are living at home with family if that is considered culturally and age appropriate. The individual may be receiving disability benefits as long as he/she is participating constructively in instrumental activities for half or more of the total duration. In the context of the individual’s cultural background and given the constraints of geographical distance and socio-economic factors, the individual has cordial relations with his/her family. This may be limited to phone calls, correspondence, or occasional visits (e.g., on holidays and family events). At least once per week, having a meeting, social event, meal, recreational activity, phone conversation, or other joint interaction with a peer outside of the family. | NR |
Modestin et al. [ |
Full employment, reassumed social roles, and no psychosis symptoms on examination except for some eccentricity or symptom residue for 5 years | 12–24% |
Robinson et al. [ |
For 2 consecutive years: no worse than mild in some SADS-C and in some SANS items, appropriate role functioning ability to perform day-to-day living tasks without supervision, social interactions. | 16.4% |
Harrow et al. [ |
Absence of major symptoms throughout the follow-up year (absence of psychosis activity and absence of negative symptoms), adequate psychosocial functioning, including instrumental (or paid) work for at least half of the time during the follow-up year, and absence of a very poor social activity level, no psychiatric re-hospitalization during the follow-up year. | 41% |
Lauronen et al. [ |
For full recovery, 1 or 2 points on the CGI, ≥71 points on the SOFAS, ≤36 total score on the PANSS, ≤2 points in each item of the positive or negative scale of the PANSS, no psychiatric hospitalizations during the last 2 years of follow-up, no or low-dose antipsychotic medication at the study moment, ability to work. For partial recovery, 1 or 2 points on the CGI, ≤36 total score on the PANSS, ≥61 points on the SOFAS | 9.9% |
Jaaskelainen et al. [ |
Having improvements in both the clinical and social domains, with improvements in at least one of the domains persisting for at least 2 years, and current symptoms no worse than mild. | 13.50% |
Full in Kim et al. [ |
Five items maintained for ≥1 year: all psychosis (P1, P2, P3, G5, G9) and negative (N1, N4, N6) items of the PANSS ≤2 (minimal); SOFAS score ≥71; appropriate social functions maintained (active meeting with an acquaintance more than twice a month, but meeting by accident or seeing or greeting at a church are excluded); appropriate occupational functions maintained, such as employment for at least half of the standard period (regardless of type of employment), job-seeking activities, students going to school/library on a regular basis, or homemakers taking appropriate responsibility for household chores. | NR |
Partial in Kim et al. [ |
Five items maintained for ≥1 year: all psychosis (P1, P2, P3, G5, G9) and negative (N1, N4, N6) items of PANSS ≤3 (mild); SOFAS score ≥61; appropriate social functions maintained (active meeting with an acquaintance more than once a month or conversation over the phone more than twice a month (texting or SMS are excluded); and appropriate occupational functions maintained, such as employment for at least one third of the standard period, job-seeking activities, students going to school/library on a regular basis, or homemakers taking appropriate responsibility for household chores. | NR |
NR: Not reported, GAS: Global Assessment Scale, DDD: Defined Daily Doses, BPRS: Brief Psychiatric Rating Scale; CGI: Clinical Global Impression, SOFAS: Social and Occupational Functioning Assessment Scale, PANSS: Positive and Negative Syndrome Scale, SADS-C: the Schedule of Affective Disorders and Schizophrenia-Change Version, SANS: the Scale for the Assessment of Negative Symptom