An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education

Huda Alrashidi; Thomas Daniel Ullman; Mike Joy

doi:10.1109/FIE44824.2020.9273975

An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education

Huda Alrashidi
, Thomas Daniel Ullman
, Mike Joy

Arab Open University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

Reflective writing is vital in learning professional skills and particularly in Computer Science (CS). However, there appears to be a lack of literature relating to a reliable of the current reflective writing frameworks used for CS education. This paper describes a novel Reflective Writing Framework (RWF) that has been applied to the manual content analysis of CS students' reflective writings. The paper aims to empirically examine this RWF in terms of reflection indicators and levels that can be manually assessed by raters. The results of this manual content analysis showed empirically that the coding scheme of the RWF is valid and reliable. The results were that the inter-rater reliability (IRR) of the overall coding scheme of the RWF increased from 0.5 to 0.8 in pilot tests and ranged between 0.40 and 0.75 in terms reflection indicators and levels; substantially, this means ranged from moderate to substantial agreement. This research contributes to CS education an RWF that can be reliably annotated and was validated by CS experts.

Original language	English
Title of host publication	2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728189611
DOIs	https://doi.org/10.1109/FIE44824.2020.9273975
State	Published - 21 Oct 2020
Event	2020 IEEE Frontiers in Education Conference, FIE 2020 - Uppsala, Sweden Duration: 21 Oct 2020 → 24 Oct 2020

Publication series

Name	Proceedings - Frontiers in Education Conference, FIE
Volume	2020-October
ISSN (Print)	1539-4565

Conference

Conference	2020 IEEE Frontiers in Education Conference, FIE 2020
Country/Territory	Sweden
City	Uppsala
Period	21/10/20 → 24/10/20

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 4 Quality Education

Keywords

Annotation
Coding Scheme
Computer Science Education
Framework
Reflective writing

Funding Agency

Kuwait Foundation for the Advancement of Sciences

Access to Document

10.1109/FIE44824.2020.9273975

Cite this

Alrashidi, H., Ullman, T. D., & Joy, M. (2020). An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education. In 2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings Article 9273975 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2020-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE44824.2020.9273975

@inproceedings{f19077a766744862bf774139e04020ac,

title = "An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education",

abstract = "Reflective writing is vital in learning professional skills and particularly in Computer Science (CS). However, there appears to be a lack of literature relating to a reliable of the current reflective writing frameworks used for CS education. This paper describes a novel Reflective Writing Framework (RWF) that has been applied to the manual content analysis of CS students' reflective writings. The paper aims to empirically examine this RWF in terms of reflection indicators and levels that can be manually assessed by raters. The results of this manual content analysis showed empirically that the coding scheme of the RWF is valid and reliable. The results were that the inter-rater reliability (IRR) of the overall coding scheme of the RWF increased from 0.5 to 0.8 in pilot tests and ranged between 0.40 and 0.75 in terms reflection indicators and levels; substantially, this means ranged from moderate to substantial agreement. This research contributes to CS education an RWF that can be reliably annotated and was validated by CS experts.",

keywords = "Annotation, Coding Scheme, Computer Science Education, Framework, Reflective writing",

author = "Huda Alrashidi and Ullman, \{Thomas Daniel\} and Mike Joy",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 IEEE Frontiers in Education Conference, FIE 2020 ; Conference date: 21-10-2020 Through 24-10-2020",

year = "2020",

month = oct,

day = "21",

doi = "10.1109/FIE44824.2020.9273975",

language = "English",

series = "Proceedings - Frontiers in Education Conference, FIE",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings",

}

Alrashidi, H, Ullman, TD & Joy, M 2020, An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education. in 2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings., 9273975, Proceedings - Frontiers in Education Conference, FIE, vol. 2020-October, Institute of Electrical and Electronics Engineers Inc., 2020 IEEE Frontiers in Education Conference, FIE 2020, Uppsala, Sweden, 21/10/20. https://doi.org/10.1109/FIE44824.2020.9273975

An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education. / Alrashidi, Huda; Ullman, Thomas Daniel; Joy, Mike.
2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2020. 9273975 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2020-October).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education

AU - Alrashidi, Huda

AU - Ullman, Thomas Daniel

AU - Joy, Mike

PY - 2020/10/21

Y1 - 2020/10/21

N2 - Reflective writing is vital in learning professional skills and particularly in Computer Science (CS). However, there appears to be a lack of literature relating to a reliable of the current reflective writing frameworks used for CS education. This paper describes a novel Reflective Writing Framework (RWF) that has been applied to the manual content analysis of CS students' reflective writings. The paper aims to empirically examine this RWF in terms of reflection indicators and levels that can be manually assessed by raters. The results of this manual content analysis showed empirically that the coding scheme of the RWF is valid and reliable. The results were that the inter-rater reliability (IRR) of the overall coding scheme of the RWF increased from 0.5 to 0.8 in pilot tests and ranged between 0.40 and 0.75 in terms reflection indicators and levels; substantially, this means ranged from moderate to substantial agreement. This research contributes to CS education an RWF that can be reliably annotated and was validated by CS experts.

AB - Reflective writing is vital in learning professional skills and particularly in Computer Science (CS). However, there appears to be a lack of literature relating to a reliable of the current reflective writing frameworks used for CS education. This paper describes a novel Reflective Writing Framework (RWF) that has been applied to the manual content analysis of CS students' reflective writings. The paper aims to empirically examine this RWF in terms of reflection indicators and levels that can be manually assessed by raters. The results of this manual content analysis showed empirically that the coding scheme of the RWF is valid and reliable. The results were that the inter-rater reliability (IRR) of the overall coding scheme of the RWF increased from 0.5 to 0.8 in pilot tests and ranged between 0.40 and 0.75 in terms reflection indicators and levels; substantially, this means ranged from moderate to substantial agreement. This research contributes to CS education an RWF that can be reliably annotated and was validated by CS experts.

KW - Annotation

KW - Coding Scheme

KW - Computer Science Education

KW - Framework

KW - Reflective writing

UR - https://www.scopus.com/pages/publications/85098583594

U2 - 10.1109/FIE44824.2020.9273975

DO - 10.1109/FIE44824.2020.9273975

M3 - Conference contribution

AN - SCOPUS:85098583594

T3 - Proceedings - Frontiers in Education Conference, FIE

BT - 2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2020 IEEE Frontiers in Education Conference, FIE 2020

Y2 - 21 October 2020 through 24 October 2020

ER -

Alrashidi H, Ullman TD, Joy M. An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education. In 2020 IEEE Frontiers in Education Conference, FIE 2020 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2020. 9273975. (Proceedings - Frontiers in Education Conference, FIE). doi: 10.1109/FIE44824.2020.9273975

An empirical evaluation of a Reflective Writing Framework (RWF) for Reflective Writing in Computer Science Education

Abstract

Publication series

Conference

UN SDGs

Keywords

Funding Agency

Access to Document

Other files and links

Fingerprint

Cite this