Amazing Grades for Free: Investigating AI’s Capability to Solve Course Assignments

In this talk, Melkior Ornik and Max Fowler reports were discussed on their efforts to test this hypothesis: is it possible to "excel" in a course without absolutely any knowledge? While there is variability across courses and assignment types, large language models are indeed often able to achieve a strong grade in a course without any meaningful help from human users or course material. This finding naturally brings up questions about our future assessment methods, and even about the value of the material that we are teaching: while obviously yet unresolved, Melkior and Max described some possible ways forward during this session.