Determining youths’ computational thinking skills using confirmatory factor analysis
Determining youths’ computational thinking skills using confirmatory factor analysis
Corresponding Author:
Indrajit Ajit Doddanavar
Jain College of MCA & MBA, Rani Channamma University
Karnataka 591156, India
Email: [email protected]
1. INTRODUCTION
Computational thinking has emerged as a progressive field of study in recent years. Its significance
is acknowledged by educational reforms worldwide, as it plays a crucial role in preparing individuals for the
demands of the 21st-century economy. Computational thinking skills (CTS) are important in making
advancements in science, technology, engineering, and mathematics (STEM) fields and are highly demand
by industries undergoing the transformative changes of industry 4.0 [1]. Developing CTS can enhance
employability by providing individuals with valuable skills for technology-driven industries. Lacking these
skills may contribute to higher unemployment rates due to automation. According to previous study [2], it is
projected that highly demanded positions in the country by 2025 will include data analysts, software
engineers, and application developers.
These roles are expected to be in high demand due to the increasing reliance on technology and
data-driven decision-making in various industries. Several studies [3]–[7] on CTS were not explicitly focused
on the research subjects of robotics coding and software with professional career planning. As a result, a new
scale has been developed to serve the purpose [8]. The scale is designed with an interdisciplinary approach in
mind, allowing its application across various fields and subjects. This study determines youths’ CTS using
the instrument adapted from Ertugrul-Akyol [8] in Malaysia. The research aims to identify professional
development and career planning that is likely expected to mediate the relationship between robotic coding
and software and computational thinking. Exploring the influence of computational thinking on youth can
provide valuable insights into its long-term effects on their educational and career pathways. It can help
identify how CTS contribute to their academic success, career readiness and developing skills relevant to the
digital age of industry 4.0.
The rapid evolution of technologies in industry 4.0 presents a significant challenge for organizations
as they strive to acquire the high value skills to adapt to the changing job functions brought by technological
disruptions [9]. A study [10] cited various reasons for the gap in graduate skills, including graduates'
preparedness to enter the workforce, a lack of job creation and a skills gap. The rapid advancement of
technologies in Malaysia has created a demand for professionals with expertise in areas like AI, IoT, robotics
and cybersecurity. However, a shortage of qualified workers in these fields results in a skills gap. The limited
availability of skilled professionals in these areas poses challenges to Malaysia's ability to exploit the
opportunities presented by industry 4.0 and the ongoing digital transformation [11]. Therefore, in order to
harness the potential of youths as a dynamic asset for development, it is essential to formulate a youth
strategy aiming to capitalize on the capabilities and energy of young people to drive progress and growth
[12]. While many previous researchers have contributed significant work to a growing knowledge base on
teaching and learning computational thinking, studies do not often focus from the youth's perspective.
Previous researchers prioritized the perspectives of educators, curriculum designers and policymakers rather
than comprehensively examined the influence of computational thinking on youths. Thus, there is limited
research that has comprehensively examined the influence of computational thinking and how to nurture it in
today’s youth [13]. Exploring this issue may help shed light on how to promote awareness on the importance
of CTS among youth as preparation for their future job hunting and successful career.
2. LITERATURE REVIEW
2.1. Computational thinking
The field of computational thinking has been a subject of active exploration and research in recent
years. Scholars have dedicated their efforts to understanding and advancing this field, leading to significant
advancements and progress. This area of study has become a focal point for educational reforms worldwide,
as many countries recognize the importance of computer technology in preparing their citizens for the
demands of the 21st-century economy [14], [15]. Computational thinking has long been recognized as a
valuable skill set that contributes to breakthroughs in STEM fields. By applying principles and concepts from
computer science, experts have been able to make significant advancements in their respective domains.
As a result, students who possess knowledge of computational thinking and understand its
underlying concepts are more likely to pursue further education in STEM-related disciplines and consider
careers in STEM fields upon graduation. This is particularly relevant in the context of the labor needs in the
era of industry 4.0, where skills related to computational thinking are in high demand. The term
“computational thinking” was initially defined by Wing [16] as the ability to solve problems, build systems,
and understand human behavior using principles derived from computer science. Regardless, a recent study
has expanded upon this definition. They describe computational thinking as a set of thinking skills that can be
effectively taught, implemented and utilized in real-world scenarios and large-scale problem-solving
processes [17].
grow. Proficiency in these areas can enhance one’s employability by providing the skills needed to work in
robotics, artificial intelligence, software development and data analysis. Therefore, by developing CTS since
they were in school, youths may enhance their job prospects and reduce the risk of unemployment. Industries
that require technological expertise often seek individuals with strong CTS, making these individuals more
competitive in the job market [22]. Thus, the first hypothesis of the study: Robotic coding and software have
a significant positive relationship with computational thinking skills (H1).
H2
H3
H1
Direct effect
Indirect effect
3. RESEARCH METHOD
This study employed a quantitative research study via survey online questionnaire using non-
probability and convenience sampling techniques. Regardless of gender and educational level, 308 young
individuals (aged 15 to 30) from different states in Malaysia took part in this study. A total of 30 items were
measured through a five-point Likert scale ranging from 1 signifying ‘strongly disagree’ to 5 signifying
‘strongly agree’. The 30 items represent constructs of computational thinking (CT) (15 items), robotic coding
(RC) (10 items), and personal development (PD) (5 items). The items were adapted from a scale development
study by Ertugrul-Akyol [8], in which the author established a questionnaire set to measure computational
thinking scale. The proposed hypotheses were analyzed using SmartPLS (v.3.3.9) software to perform PLS-
SEM. SPSS (v27) was used for demographic analysis. The total sample size of 308 met the requirement to
apply SEM since a minimum sample size of 200 is considered suitable [24]. First, we used the two-stage
approach to analyze the constructs' reliability and validity. In the second stage, we tested the hypotheses by
running bootstrapping in SmartPLS.
Int J Eval & Res Educ, Vol. 13, No. 4, August 2024: 2060-2067
Int J Eval & Res Educ ISSN: 2252-8822 2063
Determining youths’ computational thinking skills using confirmatory … (Mira Qerul Barriah Muhamad)
2064 ISSN: 2252-8822
According to Table 1, no multicollinearity was found between the constructs. The outer and inner
models of Variance Inflation Factor (VIF) values must be less than 10 [24], [27]. The values were ranging
from 1.930 to 3.360, supporting the assessment of low multicollinearity. Since the collinearity value VIF < 3
except one (RC_03=3.360), the collinearity issues in this study are uncritical. All indicators are significantly
and accurately assessing their respective latent variables. According to the rule of thumb, the outside loading
values must exceed 0.7 [29]. Hence, it can be concluded that the outer loading, which ranges from 0.704 to
0.859 with a p-value <0.001, indicates that the convergent validity has been reached or indicator reliability
exists, and all the latent variables of this study are valid and reliable. Consequently, all reflective indicators
have been retained in the study.
The internal consistency reliability is evaluated using composite reliability and Cronbach’s alpha
values. The acceptable range for composite reliability is typically between 0.70 and 0.90 [30]. Values
exceeding 0.90 to 0.95 may indicate redundant effects on the content validity of the measures [31]. In this
study, the composite reliability value for computational thinking approaches 0.95, but it does not have an
adverse impact on the model. Convergent validity is established when a significant amount of variance is
shared among the indicators, indicating convergence on a specific construct. This can be assessed through the
AVE. The AVE value should exceed 0.5 to establish convergent validity [24]. We observed sufficient outer
loadings, and all AVE values exceed 0.5, indicating that convergent validity has been achieved.
Table 2 summarizes the findings, indicating that factors such as robotic coding software,
professional development, and career planning collectively account for 65.70% of the variation in the
computational thinking construct. Professional development and career planning contribute to 53.90% of the
robotic coding and software construct variation. The R2 values, which exceed 0.50, indicate that the
independent variable moderately explains the dependent variable [28]. In a similar vein, the R2 values imply
that the model may be overly tailored to the data, indicating an appropriate fit for the proposed theoretical
framework [24]. The impact of the exogenous constructs on the endogenous constructs is moderate, as
evidenced by f2 values ranging from 0.15 to 0.34, in accordance with Cohen [32]. The Q2 value, which
reflects the predictive relevance of the model, is 0.407 for computational thinking and 0.327 for robotic
coding and software. These values surpass the threshold of 0.350, thus indicating a substantial level of
predictive relevance in the study.
Int J Eval & Res Educ, Vol. 13, No. 4, August 2024: 2060-2067
Int J Eval & Res Educ ISSN: 2252-8822 2065
Table 3 presents the path coefficients, standard deviations, absolute T values, and significance
values. The significance of the coefficients was determined through bootstrapping, considering a significance
level of 5% and critical values of 1.96 for two-tailed tests. All T values exceed 1.96, and the p-values are
<0.05, indicating the significance of the relationships between the latent variables. The path coefficients are
examined to evaluate the strength of these significant relationships. Notably, the path coefficients from
professional development and career planning to computational thinking and from robotic coding and
software to computational thinking are moderately strong, surpassing 0.4. The path coefficient from
professional development and career planning to robotic coding and software demonstrates a strong
relationship with a coefficient of 0.734. Consequently, we draw a conclusion that the three proposed paths
are relevant and significant. According to Awang [27], when path coefficients are close to +1, it indicates a
robust positive relationship. Apart from assessing the sizes of the path coefficients, it is crucial to establish
their statistical significance. Based on the path coefficient values presented in Table 4 for the theoretical
model, all estimated values exceed 0.4 and are statistically significant (p<0.05).
With reference to the Table 4, the researchers found that the indirect effect size is 0.324, and it is
statistically significant (p value<0.05). This suggests that professional development and career planning
partially mediate the relationship between the role of robotic coding and software and computational
thinking. Additionally, the researchers found that the direct path from professional development and career
planning to computational thinking has a coefficient of 0.430 and is statistically significant (p value<0.05).
This indicates that there is also a direct effect of professional development and career planning on
computational thinking. Overall, based on the results of the mediation analysis, the researchers have
established that the independent latent variable (role of robotic coding and software) predicts the dependent
variable (computational thinking) both directly and indirectly through the mediator variable (career
planning). The significant indirect effect size supports the mediation effect, while a significant direct path
suggests a partial mediation effect.
5. CONCLUSION
It is concluded that professional development and career planning moderately mediate the
relationship between robotic coding and software and computational thinking. The findings are hoped to
assist educators, higher education institutions and policymakers in developing new insights relevant to
Determining youths’ computational thinking skills using confirmatory … (Mira Qerul Barriah Muhamad)
2066 ISSN: 2252-8822
identifying the requirements for continually improving future industrial employability. This study was
undertaken to validate a survey instrument for measuring CTS among Malaysian youths. The CFA then
confirmed that the survey instrument fulfils the requirements for convergent, construct and discriminant
validity. The scale is deemed valid and reliable for measuring the CTS, adding to the advancement of
research and practice in this area. The instrument developed to assess CTS among Malaysian youths has
potential interdisciplinary applications. Therefore, it may be applicable in various research settings, allowing
for comparative studies and the examination of CTS across different populations. However, it is essential to
consider cultural and contextual factors when applying the instrument in different settings. Some adaptations
and modifications may be necessary to ensure its validity and reliability in specific cultural or educational
contexts. Certainly, future research can explore additional factors that may influence young individuals’ CTS.
Understanding these factors can provide a more nuanced comprehension of the determinants of the
computational thinking scale. Regarding mediating variable, future scholars can explore additional variables
that may enhance the strengths of the CTS instrument and provide a more inclusive perspective of the
relationship between different constructs.
REFERENCES
[1] C. Wang, J. Shen, and J. Chao, “Integrating Computational Thinking in STEM Education: A Literature Review,” International
Journal of Science and Mathematics Education, vol. 20, no. 8, pp. 1949–1972, Dec. 2022, doi: 10.1007/s10763-021-10227-5.
[2] J. Nadarajah, “Measuring the Gap in Employability Skills Among Malaysian Graduates,” International Journal of Modern
Trends in Social Sciences, vol. 4, no. 15, pp. 81–87, Mar. 2021, doi: 10.35631/IJMTSS.415007.
[3] D. A. Whetten and K. S. Cameron, Developing management skills, 8th ed. Upper Saddle River, N.J: Prentice Hall/Pearson, 2011.
[4] Ö. Korkmaz, R. Çakir, and M. Y. Özden, “A validity and reliability study of the computational thinking scales (CTS),”
Computers in Human Behavior, vol. 72, pp. 558–569, Jul. 2017, doi: 10.1016/j.chb.2017.01.005.
[5] Ö. Korkmaz and X. Bai, “Adapting Computational Thinking Scale (CTS) for Chinese High School Students and Their Thinking
Scale Skills Level,” Participatory Educational Research, vol. 6, no. 1, pp. 10–26, Jun. 2019, doi: 10.17275/per.19.2.6.1.
[6] M. Yagci, “A valid and reliable tool for examining computational thinking skills,” Education and Information Technologies,
vol. 24, no. 1, pp. 929–951, Jan. 2019, doi: 10.1007/s10639-018-9801-8.
[7] Y. Gulbahar, S. B. Kert, and F. Kalelioğlu, “The Self-Efficacy Perception Scale for Computational Thinking Skill: Validity and
Reliability Study,” Turkish Journal of Computer and Mathematics Education (TURCOMAT), vol. 10, no. 1, pp. 1–29, Oct. 2018,
doi: 10.16949/turkbilmat.385097.
[8] B. Ertugrul-Akyol, “Development of Computational Thinking Scale: Validity and Reliability Study,” International Journal of
Educational Methodology, vol. 5, no. 3, pp. 421–432, Aug. 2019, doi: 10.12973/ijem.5.3.421.
[9] M. A. Mokhtar and N. Noordin, “An exploratory study of industry 4.0 in Malaysia: a case study of higher education institution in
Malaysia,” Indonesian Journal of Electrical Engineering and Computer Science (IJEECS), vol. 16, no. 2, pp. 978–987, Nov.
2019, doi: 10.11591/ijeecs.v16.i2.pp978-987.
[10] Department of Statistics Malaysia, “Press Release Labour Force Survey Report, Malaysia, 2020,” Department of Statistics
Malaysia, Apr. 2021. [Online]. Available: https://www.dosm.gov.my/v1/index.php
[11] Y. M. Ling, N. A. Abdul Hamid, and L. T. Chuan, “Is Malaysia ready for Industry 4.0? Issues and Challenges in Manufacturing
Industry,” International Journal of Integrated Engineering, vol. 12, no. 7, Oct. 2020, doi: 10.30880/ijie.2020.12.07.016.
[12] H. M. Kaidi et al., “Engaging youths in skill development through network system wiring workshop in rural area,” Indonesian
Journal of Electrical Engineering and Computer Science (IJEECS), vol. 16, no. 2, pp. 950–955, Nov. 2019, doi:
10.11591/ijeecs.v16.i2.pp950-955.
[13] I. Lee et al., “Computational thinking for youth in practice,” ACM Inroads, vol. 2, no. 1, pp. 32–37, Feb. 2011, doi:
10.1145/1929887.1929902.
[14] A. Yadav, H. Hong, and C. Stephenson, “Computational Thinking for All: Pedagogical Approaches to Embedding 21st Century
Problem Solving in K-12 Classrooms,” TechTrends, vol. 60, no. 6, pp. 565–568, Nov. 2016, doi: 10.1007/s11528-016-0087-7.
[15] J. Nouri, L. Zhang, L. Mannila, and E. Norén, “Development of computational thinking, digital competence and 21st century
skills when learning programming in K-9,” Education Inquiry, vol. 11, no. 1, pp. 1–17, Jan. 2020, doi:
10.1080/20004508.2019.1627844.
[16] J. M. Wing, “Computational thinking,” Commun. ACM, vol. 49, no. 3, pp. 33–35, Mar. 2006, doi: 10.1145/1118178.1118215.
[17] M. Román-González, J. Moreno-León, and G. Robles, “Combining Assessment Tools for a Comprehensive Evaluation of
Computational Thinking Interventions,” in Computational Thinking Education, Singapore: Springer Singapore, 2019, pp. 79–98.
doi: 10.1007/978-981-13-6528-7_6.
[18] W. H. Stewart, Y. Baek, G. Kwid, and K. Taylor, “Exploring Factors That Influence Computational Thinking Skills in
Elementary Students’ Collaborative Robotics,” Journal of Educational Computing Research, vol. 59, no. 6, pp. 1208–1239, Oct.
2021, doi: 10.1177/0735633121992479.
[19] G. Chen, J. Shen, L. Barth-Cohen, S. Jiang, X. Huang, and M. Eltoukhy, “Assessing elementary students’ computational thinking
in everyday reasoning and robotics programming,” Computers & Education, vol. 109, pp. 162–175, Jun. 2017, doi:
10.1016/j.compedu.2017.03.001.
[20] Y. Baek, S. Wang, D. Yang, Y.-H. Ching, S. Swanson, and B. Chittoori, “Revisiting Second Graders’ Robotics with an
Understand/Use-Modify-Create (U2MC) Strategy,” European Journal of STEM Education, vol. 4, no. 1, May 2019, doi:
10.20897/ejsteme/5772.
[21] M. U. Bers, C. González-González, and M. B. Armas–Torres, “Coding as a playground: Promoting positive learning experiences
in childhood classrooms,” Computers & Education, vol. 138, pp. 130–145, Sep. 2019, doi: 10.1016/j.compedu.2019.04.013.
[22] S. Othman and A. H. A. Hamid, “Exploring Women’s Transformational Leadership Style and Competency: A Higher Education
Malaysia Perspective,” Asian Journal of University Education, vol. 19, no. 2, 2023.
[23] K. Gökoğlan and U. Kaval, “A study on students’ career strategies: example of Dicle University,” Turkish Business Journal,
vol. 1, no. 1, pp. 15–28, 2020.
Int J Eval & Res Educ, Vol. 13, No. 4, August 2024: 2060-2067
Int J Eval & Res Educ ISSN: 2252-8822 2067
[24] J. F. Hair, J. J. Risher, M. Sarstedt, and C. M. Ringle, “When to use and how to report the results of PLS-SEM,” European
Business Review, vol. 31, no. 1, pp. 2–24, Jan. 2019, doi: 10.1108/EBR-11-2018-0203.
[25] S. Atmatzidou and S. Demetriadis, “Advancing students’ computational thinking skills through educational robotics: A study on
age and gender relevant differences,” Robotics and Autonomous Systems, vol. 75, pp. 661–670, Jan. 2016, doi:
10.1016/j.robot.2015.10.008.
[26] S. Abrahim, B. A. Mir, H. Suhara, F. A. Mohamed, and M. Sato, “Structural equation modeling and confirmatory factor analysis
of social media use and education,” International Journal of Educational Technology in Higher Education, vol. 16, no. 1, p. 32,
Dec. 2019, doi: 10.1186/s41239-019-0157-y.
[27] Z. Awang, SEM Made Simple. MPWS Publisher, 2015.
[28] J. F. Hair, Ed., A primer on partial least squares structural equation modeling (PLS-SEM), 2nd ed. Los Angeles: Sage, 2017.
[29] M. Sarstedt, C. M. Ringle, and J. F. Hair, “Partial Least Squares Structural Equation Modeling,” in Handbook of Market
Research, Cham: Springer International Publishing, 2021, pp. 1–47. doi: 10.1007/978-3-319-05542-8_15-2.
[30] J. C. Nunnally, Psychometric Theory 3E. New York, NY: Tata McGraw-Hill Education, 1994.
[31] J. R. Rossiter, “The C-OAR-SE procedure for scale development in marketing,” International Journal of Research in Marketing,
vol. 19, no. 4, pp. 305–335, Dec. 2002, doi: 10.1016/S0167-8116(02)00097-6.
[32] J. Cohen, “Quantitative Methods in Psychology,” Psychological Bulletin, vol. 112, no. 1, pp. 155–159, 1992.
BIOGRAPHIES OF AUTHORS
Mira Qerul Barriah Muhamad has just graduated with a PhD in Business
Management from the Faculty of Business and Management, Universiti Teknologi Mara Shah
Alam, Selangor, Malaysia. She has a strong interest in the domain of Industry 4.0 from the
conceptual towards the applications of Industry 4.0 technologies in education, businesses and
industries. She worked as a University Tutor for 2 years and a half. She is looking forward to
opportunities in pursuing meaningful research collaborations in modern methods of
construction. She can be contacted at email: [email protected].
Determining youths’ computational thinking skills using confirmatory … (Mira Qerul Barriah Muhamad)