Abstract
The Difficulties in Emotion Regulation Scale (DERS) was developed to assess the multidimensional structure of emotion dysregulation. This study investigated the validity of a brief version for the DERS (DERS-18) and its revised version (DERS-15). We proposed a bifactor model for representing the unidimensional construct underlying the multi-facets of emotion dysregulation and examined the fit of the bifactor structure for DERS-18 and DERS-15 by estimating and comparing a series of measurement models suggested by previous studies, using a non-clinical sample of 907 Chinese college students. The bifactor model fits the data best compared to other competing models for DERS-18. Findings indicated that the majority variance of the clustered manifestations of emotion regulation deficits could be explained by one general emotion dysregulation factor, supporting the use of the total score of the DERS-18. The specific factors Awareness, Clarity, Goals, and Non-acceptance in DERS-18 demonstrated their specificity after controlling the effect of the general factor. The DERS-18 demonstrated good composite reliability, test-retest reliability, discriminant validity, and good criterion validity when connected with regulatory emotional self-efficacy and wellbeing indicators. The DERS-15 showed equally good model fit and reliability, and a small diminution in discriminant and criterion validity. Implications of the findings are discussed.
Similar content being viewed by others
References
Bardeen, J. R., & Fergus, T. A. (2014). An examination of the incremental contribution of emotion regulation difficulties to health anxiety beyond specific emotion regulation strategies. Journal of Anxiety Disorders, 28(4), 394–401. https://doi.org/10.1016/J.JANXDIS.2014.03.002.
Bardeen, J. R., Fergus, T. A., Hannan, S. M., & Orcutt, H. K. (2016). Addressing psychometric limitations of the difficulties in emotion regulation scale through item modification. Journal of Personality Assessment, 98(3), 298–309. https://doi.org/10.1080/00223891.2015.1091774.
Bardeen, J. R., Fergus, T. A., & Orcutt, H. K. (2012). An examination of the latent structure of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 34(3), 382–392. https://doi.org/10.1007/S10862-012-9280-Y.
Beauchaine, T. P. (2015). Future directions in emotion dysregulation and youth psychopathology. Journal of Clinical Child and Adolescent Psychology, 44(5), 875–896. https://doi.org/10.1080/15374416.2015.1038827.
Bjureberg, J., Ljótsson, B., Tull, M. T., Hedman, E., Sahlin, H., Lundh, L. G., Bjärehed, J., DiLillo, D., Messman-Moore, T., Gumpert, C. H., & Gratz, K. L. (2016). Development and validation of a brief version of the difficulties in emotion regulation scale: The DERS-16. Journal of Psychopathology and Behavioral Assessment, 38(2), 284–296. https://doi.org/10.1007/S10862-015-9514-X.
Caprara, G. V., Giunta, L. D., Eisenberg, N., Gerbino, M., Pastorelli, C., & Tramontano, C. (2008). Assessing regulatory emotional self-efficacy in three countries. Psychological Assessment, 20(3), 227–237. https://doi.org/10.1037/1040-3590.20.3.227.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834.
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://doi.org/10.1037/1040-3590.7.3.309
Cole, P. M., Hall, S. E., & Hajal, N. J. (2013). Emotion dysregulation as a risk factor for psychopathology. In T. P. Beauchaine & S. P. Hinshaw (Eds.), Child and adolescent psychopathology (2nd ed., pp. 341–343). Wiley.
Dan-Glauser, E. S., & Scherer, K. R. (2013). The difficulties in emotion regulation scale (DERS) factor structure and consistency of a French translation. Swiss Journal of Psychology, 72(1), 5–11. https://doi.org/10.1024/1421-0185/A000093.
DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2(3), 292–307. https://doi.org/10.1037/1082-989X.2.3.292.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272.
Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014). Construct validity and factor structure of the difficulties in emotion regulation scale among adults with severe mental illness. Journal of Psychiatric Research, 58, 175–180. https://doi.org/10.1016/J.JPSYCHIRES.2014.07.029.
Gómez-Simón, I., Penelo, E., & Osa, N. d. l. (2014). Factor structure and measurement invariance of the difficulties emotion regulation scale (DERS) in Spanish adolescents. Psicothema, 26(3), 401–408. https://doi.org/10.7334/PSICOTHEMA2013.324.
Gong, X., Xie, X., Xu, R., & Luo, Y. (2010). 抑郁-焦虑-压力量表简体中文版(DASS-21)在中国大学生中的测试报告 (psychometric properties of the Chinese versions of DASS-21 in Chinese college students). Chinese Journal of Clinical Psychology, 18(4), 443–446.
Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 30(4), 315–354. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
Gustafsson, J.-E., & Åberg-Bengtsson, L. (2009). Unidimensionality and interpretability of psychological instruments. In S. E. Embretson (Ed.), Measuring psychological constructs (pp. 97–121). American Psychological Association. https://doi.org/10.1037/12074-005.
Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the difficulties in emotion regulation scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, 539–539. https://doi.org/10.3389/FPSYG.2018.00539.
Hu, L.-t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Innamorati, M., Quinto, R. M., Imperatori, C., Lora, V., Graceffa, D., Fabbricatore, M., Lester, D., Contardi, A., & Bonifati, C. (2016). Health-related quality of life and its association with alexithymia and difficulties in emotion regulation in patients with psoriasis. Comprehensive Psychiatry, 70, 200–208. https://doi.org/10.1016/J.COMPPSYCH.2016.08.001.
Lee, D. J., Witte, T. K., Bardeen, J. R., Davis, M. T., & Weathers, F. W. (2016). A factor analytic evaluation of the difficulties in emotion regulation scale. Journal of Clinical Psychology, 72(9), 933–946. https://doi.org/10.1002/JCLP.22297.
Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd. ed.) Psychology Foundation.
McLaughlin, L. E., Luberto, C. M., O ' Bryan, E. M., Kraemer, K. M., & McLeish, A. C. (2019). The indirect effect of positive affect in the relationship between trait mindfulness and emotion dysregulation. Personality and Individual Differences, 145, 70–74. https://doi.org/10.1016/J.PAID.2019.03.020.
Mekawi, Y., Watson-Singleton, N. N., Dixon, H. D., Fani, N., Michopoulos, V., & Powers, A. (2021). Validation of the difficulties with emotion regulation scale in a sample of trauma-exposed black women. Journal of Clinical Psychology, 77(3), 587–606. https://doi.org/10.1002/JCLP.23036.
Miao, Y. (2003). 心理学视野中的幸福 (Happiness in Psychology Field ) [doctoral dissertation, Tianjin People ' s publishing house.
Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the difficulties in emotion regulation scale - short form (DERS-SF) in a sample of adolescents and adults. Current Psychology, 1–26. https://doi.org/10.1007/S12144-019-00602-5.
Muthén, L. K., & Muthén, B. O. (1998-2007). Mplus User’s Guide. Eighth Edition.
Neumann, A., van Lier, P. A. C., Gratz, K. L., & Koot, H. M. (2010). Multidimensional assessment of emotion regulation difficulties in adolescents using the difficulties in emotion regulation scale. Assessment, 17(1), 138–149. https://doi.org/10.1177/1073191109349579.
Nordgren, L., Monell, E., Birgegård, A., Bjureberg, J., & Hesser, H. (2020). Factor structure of the difficulties in emotion regulation scale in treatment seeking adults with eating disorders. Journal of Psychopathology and Behavioral Assessment, 42(1), 111–126. https://doi.org/10.1007/S10862-019-09765-8.
Osborne, T. L., Michonski, J., Sayrs, J., Welch, S. S., & Anderson, L. K. (2017). Factor structure of the difficulties in emotion regulation scale (DERS) in adult outpatients receiving dialectical behavior therapy (DBT). Journal of Psychopathology and Behavioral Assessment, 39(2), 355–371. https://doi.org/10.1007/S10862-017-9586-X.
Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013a). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437.
Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013b). Multidimensionality and structural coefficient Bias in structural equation modeling: A Bifactor perspective. Educational and Psychological Measurement, 73(1), 5–26. https://doi.org/10.1177/0013164412449831.
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying Bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249.
Rosellini, A. J., Fairholme, C. P., & Brown, T. A. (2011). The temporal course of anxiety sensitivity in outpatients with anxiety and mood disorders: Relationships with behavioral inhibition and depression. Journal of Anxiety Disorders, 25(4), 615–621. https://doi.org/10.1016/J.JANXDIS.2011.02.001.
Sarıtaş-Atalar, D., Gençöz, T., & Özen, A. (2015). Confirmatory factor analyses of the difficulties in emotion regulation scale (DERS) in a Turkish adolescent sample. European Journal of Psychological Assessment, 31(1), 12–19. https://doi.org/10.1027/1015-5759/A000199.
Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/S10862-019-09736-Z.
Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the difficulties in emotion regulation scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/S10862-016-9547-9.
Wang, L., Liu, H., Du, W., & Li, Z. (2007). 情绪调节困难量表在中国人群中的初步测试 (test of difficulties in emotion regulation in Chinese people). China Journal of Health Psychology, 15(4), 336–340.
Wang, Y., Dou, K., & Liu, Y. (2013). 情绪调节自我效能感量表的修订 (revision of the scale of regulatory emotional self-efficacy). Journal of Guangzhou University (Social Science Edition), 12(01), 45–50.
Ware, J. E. (1993). SF-36 health survey: Manual and interpretation guide. The Health Institute, .
Weinberg, A., & Klonsky, E. D. (2009). Measurement of emotion dysregulation in adolescents. Psychological Assessment, 21(4), 616–621. https://doi.org/10.1037/A0016669.
Zhao, L., Yang, Z., Hu, X., He, Y., Liu, D., & Li, N. (2018). SF-12v2与SF-36v2在成都市居民人群中的等效性评价(equivalence of SF-12v2 and SF-36v2 in assessing health related quality of life in a general population in Chengdu). Journal of Sichuan University, Medical Edition, (1), 87–92.
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s Alpha, Revelle’s Beta, McDonald ' s Omega: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123–133. https://doi.org/10.1007/s12144-019-00602-5
Funding
This study was funded by the Ministry of Education of the People’s Republic of China (grant number 18YJC190034) and the Education Department of Henan Province (the 13th Five-year Plan of Educational Science, project number 2018-JKGHYB-0022).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Yanhua Zhao, Kai Wu, Yuanyuan Wang, Guoxiang Zhao, and Entao Zhang declare that they have no conflict of interest.
Availability of Data and Material
All data were available based on reasonable request.
Code Availability
All Mplus codes were available based on reasonable request.
Human Participants
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
ESM 1
(DOCX 16 kb)
Rights and permissions
About this article
Cite this article
Zhao, Y., Wu, K., Wang, Y. et al. Construct validity of brief difficulties in emotion regulation scale and its revised version: evidence for a general factor. Curr Psychol 41, 1085–1096 (2022). https://doi.org/10.1007/s12144-021-02056-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-021-02056-0