Psychometric Characteristics of the Intergroup Anxiety Scale among International Students in Indonesia
DOI:
https://doi.org/10.59188/eduvest.v4i5.1258Keywords:
Intergroup Anxiety, Validity, ReliabilityAbstract
When someone perceives significant differences in others, they may feel anxious about the potential for negative interactions or undesirable outcomes that may arise from such interactions. This is referred to as intergroup anxiety. It is important to research the validity and reliability of the intergroup anxiety scale for international students in Indonesia because intergroup anxiety affects various psychological variables in them. One of the most commonly used instruments to measure intergroup anxiety is the Intergroup Anxiety Scale (IAS) by Walter G. Stephan and Cookie White Stephan, developed since 1985. This study aims to evaluate the psychometric properties of the IAS in the context of international students in Indonesia. From the analysis of 100 collected data points, the results show that the IAS used in this study meets the criteria for content validity, construct validity, and reliability. The results indicate that the IAS meets four Goodness of Fit criteria, with RMSEA = 0.079, SRMR = 0.074, NFI = 0.90, and CFI = 0.95. Furthermore, the reliability of the IAS was evaluated with an Average Variance Extracted (AVE) value of 0.57. The overall Composite Reliability (CR) value reached 0.93. Therefore, it can be concluded that the IAS is a valid and reliable tool for measuring self-construal among international students in Indonesia.
References
Ab Hamid, M. R., Sami, W., & Mohmad Sidek, M. H. (2017). Discriminant Validity Assessment: Use of Fornell & Larcker criterion versus HTMT Criterion. Journal of Physics: Conference Series, 890, 012163. https://doi.org/10.1088/1742-6596/890/1/012163
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Binder, J., Zagefka, H., Brown, R., Funke, F., Kessler, T., Mummendey, A., Maquil, A., Demoulin, S., & Leyens, J.-P. (2009). Does contact reduce prejudice or does prejudice reduce contact? A longitudinal test of the contact hypothesis among majority and minority groups in three european countries. Journal of Personality and Social Psychology, 96(4), 843–856. https://doi.org/10.1037/a0013470
Budiastuti, D., & Bandur, A. (2018). Validitas dan Reliabilitas Penelitian. In Mitra Wacana Media (1st ed.). Mitra Wacana Media.
Cheah, J.-H., Sarstedt, M., Ringle, C. M., Ramayah, T., & Ting, H. (2018). Convergent validity assessment of formatively measured constructs in PLS-SEM. International Journal of Contemporary Hospitality Management, 30(11), 3192–3210. https://doi.org/10.1108/IJCHM-10-2017-0649
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2023). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management. https://doi.org/10.1007/s10490-023-09871-y
Ferreira, T., Geiser, C., Cadima, J., Matias, M., Leal, T., & Mena Matos, P. (2021). The strengths and difficulties questionnaire: An examination of factorial, convergent, and discriminant validity using multitrait-multirater data. Psychological Assessment, 33(1), 45–59. https://doi.org/10.1037/pas0000961
Ghozali, I. (2014). Structural Equation Modeling Metode Alternatif dengan Partial Least Squares (PLS). Badan Penerbit Universitas Diponegoro.
Guilford, J. P., & Fruchter, B. (1978). Fundamental Statistics in Psychology and Education (6 (ed.)). McGraw-Hill.
Hair, J. . F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate Data Analysis. In Pearson Education. https://doi.org/10.3390/polym12123016
Haji-Othman, Y., & Yusuff, M. S. S. (2022). Assessing reliability and validity of attitude construct using Partial Least Squares Structural Equation Modeling (PLS-SEM). International Journal of Academic Research in Business and Social Sciences, 12(5), 1–8. https://doi.org/10.6007/IJARBSS/v12-i5/13289
Hopkins, P. D., & Shook, N. J. (2017). Development of an intergroup anxiety toward Muslims scale. International Journal of Intercultural Relations, 61(July 2016), 7–20. https://doi.org/10.1016/j.ijintrel.2017.08.002
Jansen, M., Doornebosch, A. J., de Waal, M. W., Wattel, E. M., Visser, D., Spek, B., & Smit, E. B. (2021). Psychometrics of the observational scales of the Utrecht Scale for Evaluation of Rehabilitation (USER): Content and structural validity, internal consistency and reliability. Archives of Gerontology and Geriatrics, 97(1), 104509. https://doi.org/10.1016/j.archger.2021.104509
Kim, H., Ku, B., Kim, J. Y., Park, Y. J., & Park, Y. B. (2016). Confirmatory and exploratory factor analysis for validating the phlegm pattern questionnaire for healthy subjects. Evidence-Based Complementary and Alternative Medicine, 2016. https://doi.org/10.1155/2016/2696019
Leighton, K., Kardong-Edgren, S., Schneidereith, T., & Foisy-Doll, C. (2021). Using social media and snowball sampling as an alternative recruitment strategy for research. Clinical Simulation in Nursing, 55(1), 37–42. https://doi.org/10.1016/j.ecns.2021.03.006
Marcus, B., Weigelt, O., Hergert, J., Gurt, J., & Gelléri, P. (2017). The use of snowball sampling for multi source organizational research: Some cause for concern. Personnel Psychology, 70(3), 635–673. https://doi.org/10.1111/peps.12169
Ortiz, M., & Harwood, J. (2007). A social cognitive theory approach to the effects of mediated intergroup contact on intergroup attitudes. Journal of Broadcasting & Electronic Media, 51(4), 615–631. https://doi.org/10.1080/08838150701626487
Ozkok, O., Zyphur, M. J., Barsky, A. P., Theilacker, M., Donnellan, M. B., & Oswald, F. L. (2019). Modeling Measurement as a Sequential Process: Autoregressive Confirmatory Factor Analysis (AR-CFA). Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02108
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Rodrigues, I. B., Adachi, J. D., Beattie, K. A., & MacDermid, J. C. (2017). Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskeletal Disorders, 18(1), 1–9. https://doi.org/10.1186/s12891-017-1914-5
Shrotryia, V. K., & Dhanda, U. (2019). Content Validity of Assessment Instrument for Employee Engagement. SAGE Open, 9(1). https://doi.org/10.1177/2158244018821751
Stelmach, M., de Almeida Medeiros, K. A., Carvalho, B. J., Pipek, L. Z., de Mesquita, G. H. A., Nii, F., Martines, D. R., Iuamoto, L. R., D’Albuquerque, L. A. C., Meyer, A., & Andraus, W. (2021). Instrument to evaluate the knowledge of patient with cirrhosis on his disease: construction and validity. BMC Gastroenterology, 21(1), 83. https://doi.org/10.1186/s12876-021-01665-0
Stephan, W. G. (2014). Intergroup Anxiety. Personality and Social Psychology Review, 18(3), 239–255. https://doi.org/10.1177/1088868314530518
Stephan, W. G., & Stephan, C. W. (1985). Intergroup anxiety. Journal of Social Issues, 41(3), 157–175. https://doi.org/10.1111/j.1540-4560.1985.tb01134.x
Stephan, W. G., Ybarra, O., & Bachman, G. (1999). Prejudice Toward Immigrants 1. Journal of Applied Social Psychology, 29(11), 2221–2237. https://doi.org/10.1111/j.1559-1816.1999.tb00107.x
Tavakol, M., & Wetzel, A. (2020). Factor Analysis: a means for theory and instrument development in support of construct validity. International Journal of Medical Education, 11, 245–247. https://doi.org/10.5116/ijme.5f96.0f4a
Vetter, T. R., & Cubbin, C. (2019). Psychometrics: Trust, but verify. Anesthesia & Analgesia, 128(1), 176–181. https://doi.org/10.1213/ANE.0000000000003859
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
Zapata-Ospina, J. P., & García-Valencia, J. (2022). Validity based on content: A challenge in health measurement scales. Journal of Health Psychology, 27(2), 481–493. https://doi.org/10.1177/1359105320953477
Published
Issue
Section
License
Copyright (c) 2024 Nugraha Arif Karyanta, Suryanto, Andik Matulessy
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
