File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Conference Paper: Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models

TitleToward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models
Authors
Keywordsadversarial example
ChatGPT
exercise
mutation
Issue Date31-Aug-2023
Abstract

We propose a new methodology, the Exercise Creation Methodology (ECM), that leverages recent AI technology advancements to create ChatGPT-assisted programming exercises for beginners. ECM takes an existing exercise as input and mutates it by removing some contents into semantically equivalent but syntactically different versions. The pair of versions are labeled as answered correctly and misleadingly by ChatGPT. The removed contents are re-inserted incrementally with further mutation, ensuring the labels remain unchanged. Using the version with the misleading answer and the ChatGPT elaboration on the other version, we construct a ChatGPT-assisted exercise. The latter version may also serve as a solution. We illustrate ECM using a case study.


Persistent Identifierhttp://hdl.handle.net/10722/357299

 

DC FieldValueLanguage
dc.contributor.authorChan, W K-
dc.contributor.authorYu, Y T-
dc.contributor.authorKeung, Jacky W-
dc.contributor.authorLee, Victor CS-
dc.date.accessioned2025-06-23T08:54:36Z-
dc.date.available2025-06-23T08:54:36Z-
dc.date.issued2023-08-31-
dc.identifier.urihttp://hdl.handle.net/10722/357299-
dc.description.abstract<p>We propose a new methodology, the Exercise Creation Methodology (ECM), that leverages recent AI technology advancements to create ChatGPT-assisted programming exercises for beginners. ECM takes an existing exercise as input and mutates it by removing some contents into semantically equivalent but syntactically different versions. The pair of versions are labeled as answered correctly and misleadingly by ChatGPT. The removed contents are re-inserted incrementally with further mutation, ensuring the labels remain unchanged. Using the version with the misleading answer and the ChatGPT elaboration on the other version, we construct a ChatGPT-assisted exercise. The latter version may also serve as a solution. We illustrate ECM using a case study.</p>-
dc.languageeng-
dc.relation.ispartof2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T) (07/08/2023-09/08/2023, Tokyo, Japan)-
dc.subjectadversarial example-
dc.subjectChatGPT-
dc.subjectexercise-
dc.subjectmutation-
dc.titleToward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models-
dc.typeConference_Paper-
dc.identifier.doi10.1109/CSEET58097.2023.00028-
dc.identifier.scopuseid_2-s2.0-85173599193-
dc.identifier.volume2023-August-
dc.identifier.spage132-
dc.identifier.epage136-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats