A Tool for Introducing Computer Science with Automatic Formative Assessment
In this paper we present a software platform called Chatbot designed to introduce high school students to Computer Science (CS) concepts in an innovative way: by programming chatbots. A chatbot is a bot that can be programmed to have a conversation with a human or robotic partner in some natural lan...
Guardado en:
| Autor principal: | |
|---|---|
| Otros Autores: | , |
| Formato: | Capítulo de libro |
| Lenguaje: | Inglés |
| Publicado: |
Institute of Electrical and Electronics Engineers
2018
|
| Acceso en línea: | Registro en Scopus DOI Handle Registro en la Biblioteca Digital |
| Aporte de: | Registro referencial: Solicitar el recurso aquí |
| Sumario: | In this paper we present a software platform called Chatbot designed to introduce high school students to Computer Science (CS) concepts in an innovative way: by programming chatbots. A chatbot is a bot that can be programmed to have a conversation with a human or robotic partner in some natural language such as English or Spanish. While programming their chatbots, students use fundamental CS constructs such as variables, conditionals, and finite state automata, among others. Chatbot uses pattern matching, state of the art lemmatization techniques, and finite state automata in order to provide automatic formative assessment to the students. When an error is found, the formative feedback generated is immediate and task-level. We evaluated Chatbot in two observational studies. An online nation-wide competition where more than 10,000 students participated. And, a mandatory in-class 15-lesson pilot course in three high schools. We measured indicators of student engagement (task completion, participation, self reported interest, etc.) and found that girls' engagement with Chatbot was higher than boys' for most indicators. Also, in the online competition, the task completion rate for the students that decided to use Chatbot was five times higher than for the students that chose to use the renowned animation and game programming tool Alice. Our results suggest that the availability of automatic formative assessment may have an impact on task completion and other engagement indicators among high school students. © 2008-2011 IEEE. |
|---|---|
| Bibliografía: | Alonso, M.L., Molino, G., S-ntesis de informaci-on estad-stica universitaria Argentina 2014-2015 (2016) Secretar-a de Pol-ticas Universitarias, Ministerio de Educaci-on de la Naci-on, Argentina, pp. 1-27 Estado y Perspectivas de la Transformaci-on Digital en las Empresas Argentinas (2016) C-amara de la Industria Argentina Del Software, , Observatorio Permanente de la Industria del Software y Servicios Inform-aticos Carter, L., Why students with an apparent aptitude for computer science don't choose to major in computer science (2006) ACM SIGCSE Bulletin, 38 (1), pp. 27-31 Grover, S., Pea, R., Cooper, S., Remedying misperceptions of computer science among middle school students (2014) Proc. 45th ACM Tech. Symp. Comput. Sci. Educ, pp. 343-348 Wilson, C., Sudol, L.A., Stephenson, C., Stehlik, M., Running on empty: The failure to teach K-12 computer science in the digital age. Association for computing machinery (2010) Comput. Sci. Teachers Assoc, , New York, NY Furber, S., Shut down or restart the way forward for computing in UK schools (2012) Roy. Soc, , London, U.K., Tech. Rep. DES2448 Bell, T., Andreae, P., Lambert, L., Computer science in New Zealand high schools (2010) Proc. 12th Australasian Conf. Comput. Educ, pp. 15-22 Zur Bargury, I., A new curriculum for junior-high in computer science (2012) Proc. 17th ACM Annu. Conf. Innovation Technol. Comput. Sci. Educ, pp. 204-208 Computer Science for All Iniative, , https://www.whitehouse.gov/blog/2016/01/30/computer-science-all, Accessed on: Sep. 24 2016 Bell, T., Establishing a nationwide CS curriculum in New Zealand high schools (2014) Commun. Assoc. Comput. Machinery, 57 (2), pp. 28-30 Cooper, S., Dann, W., Pausch, R., Teaching objects-first in introductory computer science (2003) Proc. 34th SIGCSE Tech. Symp. Comput. Sci. Educ, pp. 191-195 Dann, W., Cooper, S., Slater, D., Alice 3.1 (abstract only) (2013) Proc. 44th ACM Tech. Symp. Comput. Sci. Educ, p. 757 Bonder, G., Youth, gender & ICT: Imaginaries in the construction of information society in Latin america (2008) Arbor, 184 (733), pp. 917-934 Espinosa, R.S.C., Medina, I.G., Gonzalez, Z., Consumption of digital media by children and pre-teenagers in Catalonia, Spain (2015) Zer: Revista de Estudios de Comunicacion, 20 (39), pp. 145-162 Newmann, F., (1992) Student Engagement and Achievement in American Secondary Schools, , New York, NY, USA: Teachers College Press Wilson, C., Hour of code: We can solve the diversity problem in computer science (2014) ACMInroads, 5 (4), p. 22. , Dec Bell, T., Curzon, P., Cutts, Q., Dagiene, V., Haberman, B., Introducing students to computer science with programmes that don't emphasise programming (2011) Proc. 16th ACM Annu. Joint Conf. Innovation Technol. Comput. Sci. Edu, p. 391 Doran, K., Boyce, A., Finkelstein, S., Barnes, T., Outreach for improved student performance: A game design and development curriculum (2012) Proc. 17th ACM Annu. Conf. Innovation Technol. Comput. Sci. Educ, pp. 209-214 Resnick, M., Scratch: Programming for all (2009) Commun. ACM, 52 (11), pp. 60-67. , Nov Kerly, A., Hall, P., Bull, S., Bringing chatbots into education: Towards natural language negotiation of open learner models (2007) Knowl. Based Syst, 20 (2), pp. 177-185. , Mar Latham, A., Crockett, K., McLean, D., Edmonds, B., (2011) Oscar: An Intelligent Adaptive Conversational Agent Tutoring System, pp. 563-572. , Berlin, Germany: Springer Graesser, A.C., Chipman, P., Haynes, B.C., Olney, A., AutoTutor: An intelligent tutoring system with mixed-initiative dialogue (2005) IEEE Trans. Educ, 48 (4), pp. 612-618. , Nov Shaw, A., Using chatbots to teach socially intelligent computing principles in introductory computer science courses (2012) Proc. IEEE 9th Int. Conf. Inf. Technol, pp. 850-851 Keegan, M., Boyle, R.D., Dee, H.M., Turi: Chatbot software for schools in the turing centenary (2012) Proc. 7th Workshop Primary Secondary Comput. Educ, pp. 153-154 Bigham, J.P., Aller, M.B., Brudvik, J.T., Leung, J.O., Yazzolino, L.A., Ladner, R.E., Inspiring blind high school students to pursue computer science with instant messaging chatbots (2008) Proc. 39th SIGCSE Tech. Symp. Comput. Sci. Educ, pp. 449-453 Margolis, J., Fisher, A., (2003) Unlocking the Clubhouse: Women in Computing, , Cambridge, MA, USA: MIT Press Gross, E.F., Adolescent internet use: What we expect, what teens report (2004) J. Appl. Develop. Psychology, 25 (6), pp. 633-649 Voyles, M.M., Haller, S.M., Fossum, T.V., Teacher responses to student gender differences (2007) Proc. 12th Annu. SIGCSE Conf. Innovation Technol. Comput. Sci. Educ, pp. 226-230 Black, J., Brodie, J., Curzon, P., Myketiak, C., McOwan, P.W., Meagher, L.R., Making computing interesting to school students: Teachers' perspectives (2013) Proc. 18th ACM Conf. Innovation Technol. Comput. Sci. Educ, pp. 255-260 Lemaire, M., Incorporating computer science into an elementary school curriculum (2014) Student Projects, Computer Science Undergraduate Society, McGill University Wille, S.J., Kim, D., Factors affecting high school student engagement in introductory computer science classes (abstract only) (2015) Proc. 46th ACM Tech. Symp. Comput. Sci. Educ, p. 675 Papastergiou, M., Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation (2009) Comput. Educ, 52 (1), pp. 1-12. , Jan Carolyn Yang, Y.-T., Chang, C.-H., Empowering students through digital game authorship: Enhancing concentration, critical thinking, and academic achievement (2013) Comput. Edu, (68), pp. 334-344. , Oct Murphy, L., Richards, B., McCauley, R., Morrison, B.B., Westbrook, S., Fossum, T., Women catch up: Gender differences in learning programming concepts (2006) ACM SIGCSE Bulletin, 38 (1), pp. 17-21 Barron, B., Learning ecologies for technological fluency: Gender and experience differences (2004) J. Educational Comput. Res, 31 (1), pp. 1-36 Pattis, R.E., (1981) Karel the Robot: A Gentle Introduction to the Art of Programming, , 1st ed. New York, NY, USA: Wiley Harvey, B., (1985) Computer Science LOGOStyle No. I: Intermediate Programming, , Cambridge,MA, USA: Massachusetts Inst. Technol Utting, I., Cooper, S., Kolling, M., Maloney, J., Resnick, M., Alice, greenfoot, and scratch-a discussion (2010) Trans. Comput. Educ, 10 (4), pp. 171-1711. , Nov Kolling, M., The greenfoot programming environment (2010) ACM Trans. Comput. Educ, 10 (4), pp. 141-1421. , Nov Dann, W., Cosgrove, D., Slater, D., Culyba, D., Cooper, S., Mediated transfer: Alice 3 to Java (2012) Proc. 43rd ACM Tech. Symp. Comput. Sci. Educ, pp. 141-146 Brusilovsky, P., Calabrese, E., Hvorecky, J., Kouchnirenko, A., Miller, P., Mini-languages: A way to learn programming principles (1998) Educ. Inf. Technol, 2 (1), pp. 65-83. , Jan Kelleher, C., Pausch, R., Lowering the barriers to programming: A taxonomy of programming environments and languages for novice programmers (2005) ACM Comput. Surveys, 37 (2), pp. 83-137. , Jun Brusilovsky, P., Increasing adoption of smart learning content for computer science education (2014) Proc. Working Group Rep. Innovation Technol. Comput. Sci. Educ. Conf, pp. 31-57 Hartmann, W., Nievergelt, J., Reichert, R., Kara, finite state machines, and the case for programming as part of general education (2001) Proc. IEEE Symposia Human Centric Comput. Languages Environ, pp. 135-141 Seals, C., Rosson, M.B., Carroll, J.M., Lewis, T., Colson, L., Fun learning Stagecast Creator: An exercise in minimalism and collaboration (2002) Proc. IEEE Symposia Human Centric Comput. Languages Environ, pp. 177-191 Koller, D., Ng, A., Do, C., Chen, Z., Retention and intention in massive open online courses: In depth (2013) Educause Rev., Louisville, CO, USA, Tech. Re, , 3613 Wiliam, D., Five" key strategies" for effective formative assessment (2007) The Nat. Council Teachers Math, , Reston, VA, USA Shute, V.J., Focus on formative feedback (2008) Rev. Educational Res, (78), pp. 153-189 Black, P., Wiliam, D., Developing the theory of formative assessment (2009) Educational Assessment Eval. Accountability, 21 (1), pp. 5-31 Wiliam, D., What is assessment for learning (2011) Studies Educational Eval, 37 (1), pp. 3-14 Butler, R., Task-involving and ego-involving properties of evaluation: Effects of different feedback conditions on motivational perceptions, interest, and performance (1987) J. Educational Psychology, 79 (4), pp. 474-482 Padr, L., Stanilovsky, E., Freeling 3.0: Towards wider multilinguality (2012) The Language Resources Eval. Conf, , Istanbul, Turkey, May Pears, A., A survey of literature on the teaching of introductory programming (2007) ACM SIGCSE Bulletin, 39 (4), pp. 204-223 Prince, M.J., Felder, R.M., Inductive teaching and learning methods: Definitions, comparisons, and research bases (2006) J. Eng. Educ, 95 (2), pp. 123-138 O'Kelly, J., Gibson, J.P., RoboCode & problem-based learning: A non-prescriptive approach to teaching programming (2006) ACM SIGCSE Bulletin, 38 (3), pp. 217-221 Naps, T.L., Exploring the role of visualization and engagement in computer science education (2002) ACM SIGCSE Bulletin, 35 (2), pp. 131-152 Marangunic, N., Granic, A., Technology acceptance model: A literature review from 1986 to (2013) Universal Access Inf. Soc, 14 (1), pp. 81-95. , 2015 Creswell, J., (2013) Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, , 4th ed. Newbury Park, CA, USA: Sage Berglund, A., Daniels, M., Pears, A., Qualitative research projects in computing education research: An overview (2006) Proc. 8th Australasian Conf. Comput. Educ, pp. 25-33 |
| ISSN: | 19391382 |
| DOI: | 10.1109/TLT.2017.2682084 |