What Are the Differences in Psychological Outcomes Between People Who Posted COVID-19-Related Content on Social Media and Those Who Did Not?
Article information
Abstract
Objective
During the lockdown of cities and home quarantine, media became the only way for people to conveniently get coronavirus disease-2019 (COVID-19)-related information. And media engagement was closely related to psychological outcomes. But fewer researchers took COVID-19-related posting behaviors into consideration. Therefore, the present study aimed at examining the differences in psychological outcomes between people who posted COVID-19-related content on social media and those who did not.
Methods
The present study included 917 participants (304 males, 613 females) who had answered the questionnaires of media engagement, positive affect, negative affect, depression, anxiety, stress, satisfaction with life, death anxiety, and meaning in life.
Results
Results of t-tests showed that the Post group had lower levels of negative affect, anxiety, stress, and death anxiety than the Not Post (Npost) group. Network comparison tests indicated that the Npost group’s network and the Post group’s network differed in global strength, two edge-weights, and node centrality indices.
Conclusion
The results indicated that more attention should be paid to people who did not post any COVID-19-related content, especially when they have higher levels of stress and depression to prevent comorbidities. And for people who posted content, more attention should be paid when they have a higher level of negative affect.
INTRODUCTION
At the beginning of 2020, the disease caused by a novel coronavirus spread rapidly around the world. To control the spread of COVID-19, people were asked to stay at home and keep distance from others. Even so, as shown in the real-time data of John Hopkins University, by January 18, 2022, there were over 330 million confirmed cases globally.
Since the beginning of this outbreak, the Chinese government has provided daily updates about surveillance and confirmed cases on websites and social media to emphasize the need for prevention [1]. A survey conducted by the Chinese Academy of Social Science showed that many people in China spent a lot of time searching and reading COVID-19-related media content per day [2]. Social media is a group of Internet-based applications that allow the creation and exchange of user-generated content [3]. And social media engagement usually represents users’ interactions with the content, including views, likes, comments, shares, and postings [4]. But a high level of disaster-related media engagement would cause public panic and mental health problems [5].
According to the conservation of resources theory, individuals’ awareness of the loss of valued entities (such as objects, personal characteristics, conditions, and energies) would lead to negative psychological outcomes [6]. A previous experiment had proved that exposure to a video clip depicting terror attacks could increase individuals’ levels of the perceived threat and negative affect [7]. As for the current COVID-19 pandemic, it is a threat to all the people around the world. And media content of this life-threatening event makes people think about their inevitable death [8], thus leading to feelings of helplessness and lowering one’s sense of meaning in life and satisfaction with life [7].
Previous empirical studies had found that viewing negative disaster-related content was associated with negative psychological outcomes, such as increases of depression [9], anxiety [10], stress [11], and death anxiety [12]. And people who frequently reading COVID-19-related media content had more COVID-19-related anxiety symptoms than those who had less media exposure [13]. However, some recent studies found that compared with negative content, positive ones have opposite results. Content like hero acts and information about the disaster itself was associated with increases of positive affect [14] and lower odds of post-traumatic stress disorder [15].
Generally, postings and views are two kinds of media engagement. Views are private engagement by viewing social media posts or videos, while postings are spreading content through public sharing into public networks or platforms [4]. Therefore, they are two completely distinct kinds of behaviors. However, previous studies mostly focused on exploring relationships between viewing the disaster-related media content and psychological outcomes, while ignoring the associations between posting behaviors and psychological outcomes. For example, LaRose et al. [16] indicated that individuals having higher levels of negative affect and stress would relieve these negative experiences by using social media. And according to the uses-and-gratifications theory, people have specific needs to be satisfied when using social media [17]. During the lockdown and home quarantine, their need may be social interactions. Therefore, it is conceivable that people could maintain social interactions with others by posting COVID-19-related content on their social media [18]. And these would increase support from their friends, which was good for mental health [19]. While people who did not post content on their social media did not take this advantage. Thus, the hypothesis of the present study was that people who posted COVID-19-related content would have fewer negative experiences than people who did not.
Furthermore, although many studies have already been conducted to determine whether different levels of disaster-related media engagement had different impacts on psychological outcomes, they only detected a few psychological outcomes at one time [5,13]. For example, a survey aimed to find out whether there were differences in anxiety and depression between the participants who had higher media engagement and those who had lower one by using logistic regression analyses [20]. Due to the limitation of traditional analysis methods (e.g., t-tests and analysis of variances), the relationships among many (more than five) variables cannot be clarified clearly at one time.
As mentioned above, many kinds of psychological outcomes were associated with disaster-related media engagement. Network analysis is particularly useful for visualizing complex relationships between many variables [21,22]. Previously, researchers mostly focused on describing the characteristics of nodes and edges in a single network generated from a single population. For example, a prior study investigated 196 adults with bulimia nervosa (BN). And then a correlation network was generated from these adults’ responses to identify the central symptoms of BN [23]. Recently, researchers’ focuses have shifted to compare the structure of the networks generated from different subpopulations [24].
Therefore, in the present study, first, participants were divided into two groups by their posting behaviors. Individuals who have posted COVID-19-related media content were in one group, and the remaining individuals without posting behaviors were in the other group. Then two networks were generated separately to examine the relationships between positive affect, negative affect, depression, anxiety, stress, satisfaction with life, death anxiety, and meaning in life. At last, network comparison tests were conducted to examine whether there were differences between those two networks.
METHOD
Procedure and participants
To control the spread of COVID-19, the public were asked to stay at home and keep distance from others by the Chinese government in January 2020. At this time, the present survey was conducted online (wj.qq.com). At first, the link of our questionnaire was shared in WeChat Moment by several teachers and students from Tianjin Normal University. People who saw the link were encouraged to complete the questionnaire and then share this link with others. Finally, the present study included 917 participants (304 males, 613 females), and the average age of them was 28.6 (standard deviation=9.5). All the participants had given consent for using their data in the study, and this study received ethical approval by the ethics committee of Tianjin Normal University (code: XL2020-12).
Measures
The present survey consisted of six parts to examine participants’ COVID-19-related posting behaviors and psychological outcomes. To fit the context of the COVID-19 outbreak, the questionnaires of media engagement, death anxiety, and meaning in life were adapted from previous studies. To verify these three adapted questionnaires, another two groups of participants were recruited (one group consisted of 713 participants, and the other group consisted of 934 participants). The results of these empirical samples confirmed that these questionnaires were reliable and valid.
Media engagement
One item was used to investigate whether the participants had ever posted any COVID-19-related content on their social media. The question only has two answers, one is “yes,” the other one is “no.”
Positive and negative affect
The Positive Affect and Negative Affect Scale (PANAS) had two ten-item subscales for evaluating respondents’ positive affect and negative affect [25]. The present study utilized the Chinese version of PANAS [26], which was confirmed to be reliable and valid in many other studies [27,28]. Items were rated on a fivepoint scale, from 1 (almost none) to 5 (extremely much). Higher scores indicate higher levels of positive affect or negative affect. The Cronbach’s alpha coefficients for each subscale in this study were as follows: positive, 0.84; and negative, 0.90.
Depression, anxiety, and stress
The Chinese version of 21-item Depression Anxiety Stress Scale (DASS-21) [29,30] was used to measure individuals’ psychological distress. DASS-21 has three seven-item subscales for depression, anxiety, and stress. A four-point scale is used, ranging from 1 (never) to 4 (always). Higher scores indicate higher levels of psychological distress. The Cronbach’s alpha coefficients for each subscale in this study were as follows: depression, 0.82; anxiety, 0.78; and stress, 0.83.
Satisfaction with life
The Satisfaction with Life Scale (SWLS) assessed respondents’ satisfaction with their own life [31]. The Chinese version of SWLS had five items, rated on a five-point scale of 1 (totally disagree) to 5 (totally agree) [32]. With higher scores on this scale, individuals would be more satisfied with their own life. The Cronbach’s alpha coefficient for this questionnaire was 0.84.
Death anxiety
The death anxiety questionnaire was composed of four revised items from the Chinese version of the death anxiety scale [33,34], which were rated on a five-point scale of 1 (totally disagree) to 5 (totally agree). One example question is “I’m afraid of dying of COVID-19.” The higher scores on this questionnaire, the more concerned individuals were about their own safety. The Cronbach’s alpha coefficient for this questionnaire was 0.78.
The results of confirmatory factor analysis (CFA) based on another group of 713 participants showed a good fit for one-factor model (χ2=2.77, df=1, Comparative Fit Index [CFI]=0.998, Tucker‐Lewis Index [TLI]=0.987, Root Mean Square Error of Approximation [RMSEA]=0.05, Standardized Root Mean Square Residual [SRMR]=0.01). And the Cronbach’s alpha coefficient was 0.79.
Meaning in life
Four items were adapted from the Chinese version of the Meaning in Life Questionnaire [35,36] to fit the context of the COVID-19 outbreak. One example of these four items is “in the face of the severe outbreak, I still understand my life’s meaning” (more details in [37,38]). Each item was rated on a seven-point scale, from 1 (absolutely untrue) to 7 (absolutely true). Higher scores indicated individuals were more likely to create meaning in his or her own life. The Cronbach’s alpha coefficient for this questionnaire was 0.85.
In the other study of 934 participants, the result of CFA showed a good fit for one-factor model (χ2=10.29, df=2, CFI=0.997, TLI=0.990, RMSEA=0.07, SRMR=0.01). And the Cronbach’s alpha coefficient was 0.91.
Data analysis
Data preprocessing and general differences
Firstly, 20 participants were excluded from further analyses because they have missing values or they all chose one value throughout one scale or more than one entire scales. Consequently, the final sample of this study consisted of 917 participants.
Secondly, all the participants were separated into two groups based on their answers to the media engagement question. People who had posted COVID-19-related content on their social media were called “Post group,” the others were named after “not post (Npost).”
Thirdly, the differences between these two groups in psychological outcomes were tested by using independent sample t-tests and bootstrap analyses (bootstrap=5,000) in IBM SPSS 25.0 (IBM Corp., Armonk, NY, USA).
Correlation network analysis
In the current study, estimateNetwork function from the bootnet package (version 1.5) for R (version 4.0.5) was used to generate correlation networks [39], and the qgraph function in the qgraph package (version 1.6.9) [40] was utilized to visualize these networks. An edge in a correlation network usually represents the correlation or partial correlation relationship between two variables. In an unregularized network, the weight of an edge was equal to the correlation coefficients between these two nodes connected by the focal edge.
The present study removed spurious partial correlation relationships (i.e., only displaying strong partial correlations in the correlation network) by using Graphic Least Absolute Shrinkage and Selection Operator [41]. All the edges which were not shrunk to zero remained in the networks.
To generate an appropriate sparse network, it is critical to select a good value for the tuning parameter (λ). In qgraph package, λ can be obtained automatically by using the extended Bayesian information criterion (EBIC). But EBIC involves a hyperparameter (γ) which controls the impact of the shrinkage penalty [42]. The present study set γ to be 0.5, according to previous research [43,44]. Besides, since participants had already been divided into two groups, two networks were generated separately.
The centrality indices make correlation network analysis provide a unique way to depict the relationships between the focal variable (i.e., node) and others. There are three most used centrality indices, which are strength centrality, betweenness centrality, and closeness centrality. Strength centrality is the sum of weights connected to the given node. Betweenness centrality indicates the number of times the given node is on the shortest path between two other nodes. Closeness centrality is the inverse total length of the shortest path from the given node to all other nodes [45-47]. In general, the higher these centrality indices a node has, the more central it is in the network. That is, a node with higher centrality indices indicates that the variable represented by this node is closely connected with other variables.
Moreover, the stability of node centrality was examined by bootnet function and corStability function (cor argument set to be 0.6) from the bootnet package based on the case-dropping bootstrap [48]. The CS-coefficient quantifies how susceptible correlation networks are to sampling variation. The previous research suggested that the CS-coefficient should not be below 0.25 and preferably above 0.50 [48]. In the present study, the number of bootstraps was set to be 10,000. The accuracy of the edge-estimates was also examined by bootnet function but based on the nonparametric bootstrap analysis (bootstrap=10,000) [48].
Network structure comparisons
The NCT argument in NetworkComparisonTest package (version 2.2.1) [49] for R provided a way to compare differences between two networks based on a two-tailed permutation test. In the present study, 100,000 permutations were performed for randomly regroup participants.
Firstly, differences in overall connectivity between these two networks were tested. The overall connectivity (or global strength) is the weighted absolute sum of all edges in the network [42]. In this test, the significant difference indicated that one network could be denser than the other one. However, the results could not reveal which edges were different.
Then, edge strength invariance and node centrality invariance were tested. In this step, each edge and node were tested individually. Since the present study had no prior hypotheses about differences in specific edges and nodes, the current analyses were exploratory. And as suggested by previous research, the present study tested all the edges and nodes without applying a correction for multiple comparisons [42,50].
Discrimination validity and common method bias test
Confirmatory factor analyses were conducted in Mplus 8.3 (Muthén & Muthén, Los Angeles, CA, USA) to evaluate the discriminating validity between variables. Considering that sample-size-to-parameter ratio would affect the validity of model fit statistics, item parcels were formed [51]. For example, DASS-21 has three dimensions, so it was modeled using three parcels. And the results showed that the five-factor model provided a good fit, indicating these variables had good discrimination validity (Table 1).
Results of the Harman’s single factor test showed that there were 10 factors with eigenvalues greater than 1 and the first factor only accounted for 21.57% of the total variance, suggesting there was no serious common method variance in this study.
RESULTS
General differences
In the present sample, 474 participants had posted COVID-19-related content on their social media and 443 participants who never posted any COVID-19-related content. As shown in Table 2, the results indicated that Npost group had higher levels of negative affect, anxiety, stress, and death anxiety than Post group.
Network structure comparisons
The correlation networks of the Npost group and the Post group were shown in Figure 1. The results of the examination of the stability of node centrality showed that centrality indices (CSStrength_Post=0.75, CSBetweenness_Post=0.28, CSCloseness_Post=0.26; CSStrength_Npost=0.75, CSBetweenness_ Npost=0.28, CSCloseness_ Npost=0.67) of the networks were stable under subsetting cases. The results of the examination of the accuracy of the edge-estimates was shown in the Supplementary Figures 1 and 2 (in the online-only Data Supplement) following the reporting standards for psychological network analyses [39,52]. The results showed that most edges were significantly different from zero with relatively narrow confidence intervals. In sum, the present correlation networks were stable and accurate.
Visual inspections of Figure 1 revealed that Post group seemed to have a denser network than Npost group. And there are six edges of Post group’s network that were absent in Npost group’s network, including positive affect–stress, negative affect–meaning in life, negative affect–satisfaction with life, depression–death anxiety, stress–meaning in life, and stress–death anxiety. Besides, there was a positive edge between negative affect and depression in Npost group’s network, but no such edge in Post group’s network. Since these interpretations only came from visual inspections, network comparison tests were conducted to provide some statistical supports.
Firstly, the overall connectivity invariance was tested. Results showed that the overall connectivity of Post group’s network is significantly higher than that of Npost group’ network (SPost group=3.58, SNpost group=2.79, p=0.016). However, these results could not reveal which edges were different.
Consequently, edge strength invariance tests were conducted. Results showed that two edges differed significantly. As shown in Figure 2, these two edges were meaning in life–positive affect (E=-0.14, p=0.031) and negative affect–anxiety (E=-0.12, p=0.045). That is, the correlation between positive affect and meaning in life in Post group’s network was stronger than that in the Npost group’s network. So did the correlation between negative affect and anxiety.
Finally, to get more details about differences in local connectivity, the present study compared these two networks on three node centrality measures, including strength centrality, betweenness centrality, and closeness centrality (Figure 3). Regarding strength centrality, both networks had a similar pattern. The difference tests showed that positive affect (p=0.016) and negative affect (p=0.008) had significantly higher values in the Post group’s network than in the Npost group’s network. As for betweenness centrality, these two networks differed quite a lot from each other. In the Npost group’s network, stress had the highest value, and it was significantly higher than that of the Npost group’s network (p=0.044). While in the Npost group’s network, negative affect had the highest betweenness centrality. Considering closeness centrality, there were also great differences between the two networks. In the Npost group’s network, depression had the highest value. But in the Post group’s network, negative affect had the highest closeness centrality, and it was significantly higher than that of the Npost group’s network. These results indicated that these two networks had different central nodes. In the Npost group’s network, the central node was negative affect. While in the Post group’s network, stress and depression were in the center.
DISCUSSION
Firstly, results of independent t-tests indicated that the Post group had lower levels of negative affect, anxiety, stress, and death anxiety. Then, the present study generated two networks for the Npost group and the Post group to depict the relationships between positive affect, negative affect, depression, anxiety, stress, satisfaction with life, death anxiety, and meaning in life. And network comparison tests were conducted to compare the differences between these two networks. Results showed that these two networks differed in global strength, two edges (meaning in life–positive affect and negative affect–anxiety), and node centrality indices. In the Npost group’s network, stress and depression were central nodes, while in the Post group’s network, negative affect was the central one.
The present study found that people who posted COVID-19-related content on their social media had lower levels of negative affect, anxiety, stress, and death anxiety. Being involved in a pandemic would certainly lead to negative psychological outcome [1,6], but individuals tended to relieve these negative feelings by using social media [16]. Previous research suggested that active social media use such as posting content was different from negative social media use which was just scrolling through news feeds or browsing photographs of friends. And results showed that active social media use could decrease negative experiences such as fatigue [53]. Additionally, although the difference in depression symptoms between these two groups was not significant, the mean score of the Post group was still lower than that of the Npost group. Besides, no significant differences were found in positive affect, satisfaction with life, and meaning in life between these two groups. One potential explanation was that during the lockdown or self-quarantine, people spent more time caring for family and their friends [54,55]. Thus, most of them felt more satisfied with their life.
In the Npost group’s network, stress had the highest strength and betweenness centrality and the second-highest closeness centrality, indicating that it was the central node. Consistent with other studies, the present study found stress, anxiety, depression, and negative affect were positively correlated with each other [14]. And stress was also negatively associated with satisfaction with life in the pandemic context in line with previous research under normal situations [56,57], but this negative relationship was weak. Depression was also a central node, having the highest closeness centrality and the second-highest strength and betweenness centrality. And consistent with previous studies, it was negatively correlated with positive affect and meaning in life [14,37,58]. Meaning in life is a psychological source for enhancing healthy coping [59], and it had a strong correlation with more positive wellbeing [60]. Thus, in the disaster context, the higher level of meaning in life would negatively correlate with depression and anxiety but positively correlate with satisfaction with life and positive affect. While anxiety had the lowest betweenness centrality and the third-highest strength and closeness centrality. Lower betweenness centrality and higher strength and closeness centrality indicated that anxiety was not the only node close to many other nodes, and it was not on the shortest path between the other nodes. That meant anxiety was not the central node of this network despite its higher strength and closeness centrality. And satisfaction with life, death anxiety, meaning in life, and positive affect had lower centrality indices, having fewer associations with other variables.
Compared with the Npost group’s network, negative affect had significantly higher closeness centrality in the Post group’s network. And it was the central node of the Post group’s network, having the highest betweenness and closeness centrality. Similar to the Npost group’s network, negative affect was related to anxiety and death anxiety in the Post group’s network. Surprisingly, it had a positive association with positive affect. Generally, people would think negative and positive affect naturally negatively correlated with each other. But indeed, these are two independent processes [61,62]. And the previous study had found that COVID-19-related media exposure was associated with increases of both negative and positive affect [14]. Stress had the highest strength centrality in the Post group’s network, but lowest betweenness centrality, indicating it lay on no shortest path between other variables. This was different from the Npost group’s network, where stress was the central node. But like the Npost group’s network, in the Post group’s network, satisfaction with life, death anxiety, and meaning in life were still at the edge. Furthermore, because the Post group’s network had higher global strength, each node in the Post group’s network had a higher strength centrality than that in the Npost group’s network. Especially for positive and negative affect, they were significant at the levels of α=0.05 and α=0.01. The potential explanation for this significant result may be that the weight of meaning in life–positive affect and negative affect–anxiety in the Post group’s network is significantly larger than that in the Npost group’s network.
There were still some limitations in the present study. First, this study was a cross-sectional design, so no causal relationship could be revealed. Although time-series data can be analyzed by using multilevel vector autoregressive time-series models to examine potential causal associations [63], data collection for this analysis method is very difficult [53,64]. Besides, network comparison tests are not developed for this kind of network. Secondly, the participants were not chosen at random, so the parameters of interest may vary from one sample to another [65]. And all the participants were from China, the generalization of conclusion for residents in other countries is still unexplored. Finally, some other psychological factors were also proved to be associated with the COVID-19 outbreak, but all these studies were published after the beginning of the survey, such as fear of COVID-19 [66] and intolerance of uncertainty [65]. So, these factors were not taken into consideration in the present study.
Nevertheless, the results of the present study indicated that the posting behavior on social media was related to decreases of negative affect, anxiety, stress, and death anxiety. And two networks for the Npost group and the Post group had different central nodes. The central nodes were stress and depression, for Npost network, while negative affect instead for Post network. Therefore, for individuals who posted COVID-19-related content on social media, more attention should be paid when having a higher level of negative affect to prevent comorbidities. While for individuals who did not post this content, pay attention to higher levels of stress and depression.
Supplementary materials
The online-only Data Supplement is available with this article at https://doi.org/10.30773/pi.2022.0146.
Notes
Availability of Data and Material
Data and code can be made available upon reasonable request to the corresponding author.
Conflicts of Interest
The authors have no potential conflicts of interest to disclose.
Author Contributions
Conceptualization: Tour Liu, Miao Chao. Data curation: Tour Liu. Formal analysis: Shu Zhang. Funding acquisition: Tour Liu. Investigation: Yanwen Zhang, Dini Xue, Huan Zhang, Miao Chao, Tour Liu. Methodology: Tour Liu, Shu Zhang. Project administration: Tour Liu. Resources: Tour Liu, Miao Chao, Huan Zhang, Dini Xue, Yanwen Zhang. Software: Shu Zhang. Supervision: Tour Liu. Validation: Shu Zhang. Visualization: Shu Zhang. Writing—original draft: Shu Zhang. Writing—review & editing: Shu Zhang, Yanwen Zhang, Dini Xue, Tour Liu.
Funding Statement
This study was supported by the National Natural Science Foundation of China (Grant No. 31800945).