Psychometric Assessment of the Motives for Online Gaming Questionnaire Among Iranian Gamers
Article information
Abstract
Objective
Gaming motivations are crucial aspects of healthy and problematic video gaming behavior. The aim of this study was to assess the psychometric properties of the widely used Motives for Online Gaming Questionnaire (MOGQ).
Methods
Test-retest reliability was evaluated in a sample of 66 university students. Data from 791 participants in an online survey of Iranian online gamers were examined to assess convergent validity and construct validity using confirmatory factor analysis. Internal consistency of MOGQ factors was assessed in both samples.
Results
The item content validity index (I-CVI) and the scale content validity index (S-CVI) were between 0.8 and 1.0 for clarity and relevancy. The test-retest reliability of the 27-item questionnaire was 0.85 and internal consistency was 0.94. After incorporating additional error paths, model fit improved to an acceptable level. The MOGQ factors had acceptable correlations with relevant motivational scales such as Gaming Motivation Scale and Player Experience of Need Satisfaction. Recreation motives had the highest average score in the sample and social ones had the lowest, and males scored higher than females across all motivation domains except escape.
Conclusion
The MOGQ is a suitable instrument for the assessment of online gaming motivations in the Iranian population.
INTRODUCTION
Given the increasing popularity of video games, interest in understanding the underlying bases, associated behaviors and consequences of video game playing has been growing [1]. It has been estimated that by the end of 2017 there were 2.21 billion active gamers around the world [2], and more than 28 million Iranians reported playing for at least one hour per week in a recent national survey [3]. After decades of research, a consensus is emerging that players relate to video games in nuanced complex contexts, shaped by the characteristics of players, games, and the gaming environment [4,5]. Relatedly, while it appears that most players are not adversely impacted by their gaming behavior [6,7], a minority of players report potentially pathological patterns of gaming [8]. This has led to the recent formulation of the diagnostic entity of internet gaming disorder (IGD), and calls for its recognition as an important emerging public health issue globally [9,10]. While data is scarce, IGD is also considered a potential public health concern in Iran [11,12] and it has been estimated to impact about 3.7% of Iranian online gamers [13]. Thus, investigations of important aspects of gaming behavior seem warranted.
It is increasingly recognized that different individuals play online and offline games with a variety of different motives, and that these motives may constitute an important aspect of gaming behavior [14]. Besides general entertainment and enjoyment of the games they play, players may engage with games to form social connections, to feel a sense of progress, to modulate low mood, to detach from and escape daily life, to learn new skills, to compete and to feel competent, and to explore and sate their curiosity [15]. Among these diverse motivational profiles, some might be more strongly associated with problematic gaming than others [16]. For example, it has been demonstrated that individuals who engage in online games to compete [17], to escape life issues [18-20], and to stimulate fantasies [18,21] may be at greater risk of pathological gaming and associated psychiatric comorbidities [21]. Investigating and better theorizing about the motivations of players for online gaming may thus aid in understanding and distinguishing problematic patterns of play, and preventing or treating the problems associated with harmful online gaming [17].
Different theories of motivation have been applied to conceptualize online gaming behavior. Self-determination theory (SDT) proposes two general categories of intrinsic and extrinsic motivation for gaming; gamers who play for enjoyment, exploration and improve their skills would be intrinsically motivated, while those who play for game-related rewards, competition, or social connection are extrinsically motivated [22]. On the other hand, Bartle’s framework [23] would suggest four different motivations associated with the playing styles of achievers, explorers, socializers, and killers, and Yee [24] has developed this framework to propose the motivation categories of achievement (including advancement, mechanics, competition), social (socializing, relationship, teamwork), and immersion (discovery, role playing, customization, escapism). A number of instruments have been developed to assess gaming motives based on these theories, such as the 27-item Motivation for Online Games Questionnaire [25,26], the 18-item Gaming Motivation Scale (GAMS) [22] with a 15-item version proposed recently, the 12-item Online Gaming Motivations Scale [27], and the 10-item Player Experience of Need Satisfaction (PENS) Questionnaire [28].
Considering the increasing national and global popularity of online games and the importance of gaming motives to understand healthy and disordered gaming, this study is an attempt at translating the Motives for Online Gaming Questionnaire (MOGQ) into the Persian language, assessing its psychometric properties, and investigating the distribution of gaming motives based on the MOGQ in a sample of Iranian online gamers. We chose MOGQ since it is a comprehensive questionnaire that explores the aims of online gaming and can be used in a wide age range [25], and has been translated into a number of different languages and validated across different cultures [18,21,26,29-32].
METHODS
Procedure and participants
The study was conducted in three stages: 1) translation and assessment of the content validity of the translated questionnaire, 2) assessment of the internal consistency and test-retest reliability, and 3) investigation of convergent and construct validity.
At the first step the questionnaire was translated from English to Persian, in compliance with World Health Organization guidelines [33] and using the forward-backward translation method. Content validity was assessed by a group of 15 experts which consisted of content experts, lay experts, and a psychometrist, for relevancy, clarity, and comprehensiveness. Relevancy and clarity indices were calculated using the universal agreement (UA) approach and the mean approach, for each item as well as the entire instrument. Content validity ratio (CVR) was also assessed. Values above 0.80 were regarded as acceptable for content validity indices.
To evaluate the test-retest reliability in the first stage, 120 undergraduate students were recruited from five classes of Allameh University in Tehran after providing informed consent to participate in the study. Of these, 96 had a history of online gaming in the past year. In the retest phase, all individuals who met the inclusion criteria were asked to retake the retest, and 66 completed the MOGQ for the second time after a 10- to 14- day interval. Convenience sampling was used without randomization. For all MOGQ factors, intraclass correlation coefficients (ICCs) were assessed to estimate test-retest reliability.
An online survey was carried out among 791 Iranian online gamers in 2016 to test convergent and construct validity [34]. The Persian versions of the instruments were uploaded to a website with open public access. The Iranian National Center for Addiction Studies (INCAS) advertised the URL and recruited participants in several rounds of announcements via the INCAS website. Calls for participation were also made on social media platforms popular in Iranian and flyers and pamphlets distributed in several universities. Upon clicking the questionnaire URL, participants were greeted and given a detailed description of the study objectives and criteria for inclusion, and assured that measures would be taken to anonymize their data which would only be used towards the study’s stated purposes. No sample size calculation or randomization was performed, with the objective of recruiting as large a convenience sample as possible.
The construct validity of the MOGQ was assessed using confirmatory factor analysis (CFA) for the data from this survey. For the CFA, chi-square values and fitness indices were calculated. To assess the convergent validity of the questionnaire, we calculated correlations between MOGQ factors and relevant domains from the PENS and GAMS instruments. The internal consistency of MOGQ (based on Cronbach’s alpha) was calculated in both samples. We have also provided the results of the MOGQ testing among the 791 online gamers based on gender and different age groups. The IBM SPSS Statistics 25 (IBM Co., Armonk, NY, USA) and the AMOS 24 (IBM Co.) software programs were used for the analyses.
Measures
The MOGQ [25] is a 27-item self-administered instrument assessing an individual’s motivations for gaming. The instrument consists of the following domains: escape, coping, fantasy, skill development, recreation, competition, and social motivation. Each item has a 5-point Likert scale, with higher scores showing greater motivation in that domain. The MOGQ has been assessed in several languages and shown to have acceptable to very good psychometric properties [25,26,29].
The PENS is a 10-item questionnaire assessing gamers’ experience across five dimensions: presence/immersion, autonomy, competence, relatedness, and intuitive controls. Items in the PENS are rated by on a 7-point Likert scale which shows participants agreement [28].
The GAMS is an 18-item questionnaire, designed to identify individuals’ motives for playing video games, measuring six domains of motivation using three questions for each domain with a 7-point Likert scale [22]. GAMS was constructed within the theoretical framework of SDT. Within SDT, behaviors depend on six types of motivations; namely intrinsic motivation, integrated regulation, identified regulation, introjected regulation, external regulation, and amotivation. The GAMS was developed and validated to measure the extent to which participants’ gaming behavior relies on each of the SDT’s six motivation domains [9].
Informed consent and confidentiality
Participants in both samples were informed that provided data would remain confidential. Only those involved in statistical analyses had access to complete participant information. Institutional review board approval was sought and the research protocol was approved by the Ethics Committee of Tehran University of Medical Sciences in Iran (no. IR.TUMS. VCR.REC.1395.800).
RESULTS
Content validity
For the Persian version of the MOGQ-27, the item content validity index (I-CVI) for clarity was 0.8 for question 5, 0.93 for question 13 and 27, and 1.0 for the rest of the questions. I-CVI for relevancy was 1.0 for all items. The scale content validity index (S-CVI) for clarity using the UA approach and the mean approach were 0.89 and 0.99, respectively. S-CVI for relevancy was 1.0 in both approaches. The CVR for all items and questionnaire comprehensiveness were 1.0. CVI values of 0.80 or more were interpreted as indicating acceptable validity, following the widely cited suggestion of Davis [35].
Reliability
Data from the sample of university students was used to assess test-retest reliability. Sixty-six individuals completed the questionnaire twice with a 10- to 14-day interval. Among these, 47 (71.2%) were females. Fifty-one (77.3%) were undergraduate students and the rest (22.7%) were graduate students. In terms of marital status, only three were married and the rest (95.5%) were single. The age distribution of 66 people was between 19 and 40 years and their age was 22.1±3.2 (mean± standard deviation [SD]) years.
Besides item 11 “…because it helps me get rid of stress” which had a test-retest reliability of 0.45, the test-retest reliability of MOGQ items ranged from 0.64 to 0.87. The reliability of all factors was between 0.79 (coping) and 0.87 (skill development), and the ICC of the entire questionnaire was 0.85 that considers good [36]. The internal consistency of the MOGQ factors was also assessed in this sample, and ranged from 0.68 (social) to 0.87 (recreation). The ICC between 0.50–0.75 and between 0.75–0.90 are indicated as moderate and good reliability, respectively (Table 1) [36].
Internal consistency and test-retest reliability of the Motives for Online Gaming Questionnaire (N=66)
Convergent validity and internal consistency
A total of 791 participants in the online survey, including 592 (75.4%) males. The age of participants ranged from 18 to 50 years, with a mean of 23.4±8.8 years. To investigate the validity of the Persian version of the MOGQ and its internal consistency, we used the data from 758 participants in the online survey who had no missing values. Correlations between the MOGQ factors ranged from 0.24 to 0.71, with the lowest correlation observed between the escape and recreation factors and the highest observed between escape and coping. The internal consistency of MOGQ factors based on Cronbach’s alpha ranged from 0.78 for the social motives factor to 0.91 for the recreation factor (Table 2). Cronbach’s alpha for the entire questionnaire was 0.94.
Mean, SD, internal consistency of the Motives for Online Gaming Questionnaire factors (N=791)
There were significant correlations between the social factor from the MOGQ and relatedness from the PENS (r=0.546, p<0.001), the competition factor from the MOGQ and competence from the PENS (r=0.494, p<0.001), the escape factor from the MOGQ and introjected regulation from the GAMS (r=0.567, p<0.001), the competition factor from the MOGQ and external regulation from the GAMS (r=0.482, p<0.001), and the skill development factor from the MOGQ and identified regulation from the GAMS (r=0.577, p<0.001). Regarding the other three MOGQ motivation factors, i.e., fantasy, coping, and recreation, we were not able to find corresponding domains in other instruments to assess convergent validity.
Construct validity
To explore the dimensionality of the MOGQ, we ran a CFA testing a first-order model with seven factors as suggested during the original development of the MOGQ [25]. Each of the seven factors consisted of three or four corresponding items. According to the CFA, the model had the following fit indices: chi-square=1,746.6 (df=303, n=758, p<0.001), comparative fit index (CFI)=0.897, incremental fit index (IFI)=0.897, normed fit index (NFI)=0.878, root-mean-square error of approximation (RMSEA)=0.079 (90% confidence interval [CI], 0.076–0.083), Akaike information criterion=1896.61, and Bayesian information criterion=2,243.91.
When searching for partial misfits, modification indices (MI) suggested the addition of error paths between item 9 “…because it makes me forget real life” and item 16 “…because gaming helps me escape reality” (MI=82.28), between item 13 “…to feel as if I was somebody else” and item 20 “…to be somebody else for a while” (MI=38.61), and then between item 1 “…because I can get to know new people” and item 8 “…because I can meet many different people” (MI=19.96). Incorporating the proposed additional error paths improved the model fit to an acceptable level: chi-square=1,422.7 (df=300, n=758, p<0.001), CFI=0.920, IFI=0.920, NFI=0.901, RMSEA=0.070 (90% CI: 0.067–0.074). Standardized factor loadings for all items were higher than 0.6 and the highest correlation was between escape and coping motives (Figure 1).
Estimates of standardized factor loadings and correlations among the factors of the Motives for Online Gaming Questionnaire.
Demographic correlates
Considering the distribution of MOGQ factor scores across genders and age groups, male online gamers scored significantly higher than female ones in all motivational dimensions (p<0.05) except for escape, in which males had an average score of 8.48±4.25 and females had an average score of 8.17± 4.13. Compared to other age groups, the 18–20 age group scored significantly higher in all motivational dimensions (p<0.05), again except for escape (Table 3).
Motivation scores of the Motives for Online Gaming Questionnaire by sex and age
DISCUSSION
In this study, we translated and assessed the content validity, test-retest and internal reliability, and construct and convergent validity of the Persian version of the MOGQ and described the distribution of motivation domain scores in a population of Iranian online players. The results showed that the Persian MOGQ has very good content validity and suitable internal and external reliability (Cronbach’s alpha=0.94). Notably, we are not aware of any prior study on the test-retest reliability of the MOGQ and our study showed that it has good test-retest reliability for both the individual factors and the entire questionnaire. The MOGQ was originally developed in English, and has since been translated and validated in several other languages. The psychometric properties of the English version as well as the Chinese, Indonesian, Turkish, Korean, and Italian versions have also been assessed [18,25,26,29,32].
In the original English version, the internal consistency for all 7 dimensions ranged from 0.79 to 0.90 (Cronbach’s alpha=0.91) [25]. The internal consistency was between 0.83–0.90 in the Chinese version (Cronbach’s alpha=0.95) [26], between 0.80–0.87 for the Korean version [18] and between 0.88–0.92 for the Turkish version [32] for dimensions. In the Italian version, the internal consistency of all factors was observed to be appropriate [21]. Lastly, the Indonesian version of the MOGQ was reported to be valid and reliable and with a Cronbach’s alpha of 0.94 [29]. In both our samples, the social motives factor had the lowest internal consistency and recreation motives the highest, which diverges from the English [25] and Chinese questionnaires [26] and might reflect variations resulting from translation or sample differences. On the other hand, these results are consistent with a psychometric assessment of the Turkish version of MOGQ [32], potentially reflecting greater cultural similarities between Iranian and Turkish samples.
Some versions of the questionnaire reduce the number of factors from 7 to 6. For example, the coping and escape dimensions are merged into one dimension in the Turkish MOGQ [32] and the coping factor was eliminated from the Korean after exploratory and confirmatory factor analyses favored a six-factor structure [18]. We observed a high correlation between the escape and coping factors (0.712), similar to the Turkish study [32], but decided to keep the original structure intact given factor analysis results. This high correlation may indicate that the coping and escape, although conceptually distinct, can be considered overlapping constructs. Indeed, some studies before the development of the MOGQ considered the escape factor a coping factor. Demetrovics et al. [25] also observed a strong correlation between the two factors (0.602) but proposed that the two factors be separated considering the results of their factor analysis. A discussion of the differences between coping and escape would be warranted given these results.
Escape indicates a desire to escape certain situations or environments and is thus focused on escaping real life, ultimately helping the player manage unwanted moods and emotions such as stress, aggression, and anxiety [37]. In many studies, this kind of escape is what is considered important as a motivation for seeking entertainment [38]. On the other hand, coping is often defined as a conscious, active effort to resolve or overcome personal and interpersonal problems [39]. Two notable differences emerge between escape and coping. First, coping refers to strategies aiming to reduce, eliminate, or manage the stressor, while escape implies disengagement, in which the main goal is to ignore, avoid, or withdraw from the stressor or its emotional consequences [37]. Second, escape is an emotion-focused strategy whereas coping is an action-focused one [40]. While further investigations are required to clarify this distinction, our factor analysis suggests that the 7-factor model is preferable after a few modifications, and a 6-factor model may result in notable information loss.
In terms of demographic correlates of gaming motivations, males in our sample scored significantly higher than females across all motivational dimensions except escape. This is consistent with the results of the Chinese version of the MOGQ and also a recent meta-analysis which suggests that males have greater motivation to play video games across a variety of motivation domains [26,41]. Interestingly, several other studies have also found that the score for the escape motive specifically is not higher in males than in females [42] or that females have higher scores on escapist motives [22]. Wu et al. [26] also reported that males generally scored higher on MOGQ motives, but not on the escape domain. Interestingly, the pattern was repeated for those in the 18–20 age group, who scored significantly higher than other in all motivational dimensions (p<0.05) except in the escape dimension. Since participant ages are truncated at 18 (based on our inclusion criteria), our results may suggest that gaming motivations decline with age. This may happen since cognitive maturity could render many major games less appealing and enjoyable [43], or since individuals take on increasing responsibilities and challenges as they age and enter the job market. It seems the only motivation that does not decrease significantly with age is the escape. This may be since some players increasingly use video games to escape routine tensions which increase with age and responsibility. However, this result has not been reported in any study so far and requires future studies [44].
We observed several significant correlations between certain motivational factors from the MOGQ and domains which appear to correspond to them from the PENS and GAMS measures. Ballabio et al. [21] similarly assessed the convergent validity of MOGQ, and have observed a close association between the social, competition, and fantasy factors in MOGQ and the social, achievement, and immersion factors in OGMS, respectively. The recreation and coping factors were developed in the MOGQ for the very first time, so they have not been compared with any other subscales to the best of our knowledge.
Conclusion and limitations
Overall, this study investigated multiple reliability and validity indices of the Persian version of the MOGQ questionnaire, and results indicate that it has appropriate psychometric properties for the assessment of online gaming motivations in our samples. However, the present study also had several major limitations. Firstly, we mainly sampled populations of university students, and even the online survey was advertised mainly on platforms which may be used more regularly by those with better education. We also utilized convenience samples which are not necessarily representative of the sampled populations, and future studies are needed to investigate the generalizability of our findings. Furthermore, the test-retest reliability of the questionnaire was investigated in the smaller of our two samples and after only a two-week interval, and studies of larger samples across longer follow-up periods are required to establish test-retest reliability with greater confidence. Lastly, we did not have access to data on a variety of demographic, socioeconomic and clinical variables, or objective measure of playing behavior that may be relevant to gaming motives and their relationship to problematic gaming. Longitudinal studies collecting data on multiple variables of interest across time would be necessary to further explore the dynamic relationships between gaming motives and such factors.
Notes
Availability of Data and Material
The datasets generated or analyzed during the study are available from the corresponding author on reasonable request.
Conflicts of Interest
The authors have no potential conflicts of interest to disclose.
Author Contributions
Conceptualization: Marziyeh Hamzehzadeh, Rabert Farnam, Hosein Rafiemanesh, Masoumeh Amin-Esmaeili, Zsolt Demetrovics, Orsolya Király, Afarin Rahimi-Movaghar. Data curation: Marziyeh Hamzehzadeh, Hosein Rafiemanesh, Kamyar Ghani, Maral Mardaneh Jobehdar, Jamileh Rahimi. Formal analysis: Marziyeh Hamzehzadeh, Hosein Rafiemanesh, Behrang Shadloo, Arshiya Sangchooli. Investigation: Marziyeh Hamzehzadeh, Rabert Farnam, Hosein Rafiemanesh, Behrang Shadloo, Arshiya Sangchooli, Masoumeh Amin-Esmaeili, Afarin Rahimi-Movaghar. Methodology: Rabert Farnam, Hosein Rafiemanesh, Zsolt Demetrovics, Orsolya Király, Afarin Rahimi-Movaghar. Project administration: Marziyeh Hamzehzadeh, Rabert Farnam, Hosein Rafiemanesh, Afarin Rahimi-Movaghar. Resources: Afarin Rahimi-Movaghar. Software: Hosein Rafiemanesh. Supervision: Rabert Farnam, Hosein Rafiemanesh, Masoumeh Amin-Esmaeili, Zsolt Demetrovics, Orsolya Király, Afarin Rahimi-Movaghar. Validation: Marziyeh Hamzehzadeh, Hosein Rafiemanesh, Afarin Rahimi-Movaghar. Visualization: Hosein Rafiemanesh. Writing—original draft: Marziyeh Hamzehzadeh, Hosein Rafiemanesh, Behrang Shadloo. Writing—review & editing: all authors.
Funding Statement
This study was supported financially by Tehran University of Medical Sciences (Grant number. 95-02-49-32102).