In an article on the impact of AI on computer science education, the general conclusion is that all jobs will have a generative AI component and it will be necessary in most jobs to understand computer science. The piece opens with an experiment conducted by a professor with one of his computer science classes.
One group was allowed to use ChatGPT to solve the problem, the second group was told to use Meta’s Code Llama large language model (LLM), and the third group could only use Google. The group that used ChatGPT, predictably, solved the problem quickest, while it took the second group longer to solve it. It took the group using Google even longer, because they had to break the task down into components.
Then, the students were tested on how they solved the problem from memory, and the tables turned. The ChatGPT group “remembered nothing, and they all failed,” recalled Klopfer, a professor and director of the MIT Scheller Teacher Education Program and The Education Arcade.
Meanwhile, half of the Code Llama group passed the test. The group that used Google? Every student passed.
Read more