College professors are going back to paper exams and handwritten essays to fight students using ChatGPT::The growing number of students using the AI program ChatGPT as a shortcut in their coursework has led some college professors to reconsider their lesson plans for the upcoming fall semester.
This isn’t exactly novel. Some professors allow a cheat sheet. But that just means that the exam will be harder.
Physics exam that allows a cheat sheet asks you to derive the law of gravity. Well, OK, you write the answer at the bottom pulled from you cheat sheet. Now what? If you recall how it was originally created you probably write Newtons three laws at the top of your paper… And then start doing some math.
Calculus exam that let’s you use wolfram alpha? Just a really hard exam where you must show all of your work.
Now, with ChatGPT, it’s no longer enough to have a take home essay to force students to engage with the material, so you find news ways to do so. Written, in person essays are certainly a way to do that.
You can always write down what gpt shows on the screen onto a paper
Not in class though. The idea is teaching has always had to adjust to new technology, realities and goals.
Yeah you can always just write down the bots shitty answer
Hate to break it to you, but you picked probably the one law in physics that is empirically derived. There is no mathematical equation to derive newton’s law of gravity.
Yes but you can still start with Kepler and newton’s three laws and with basic math skills recreate the equation. I know, because it was on a physics exam I took ten years ago.
Or you have the classic, “you can write anything down that you’d like, but it won’t tell you how to answer the questions”.
And, in fact, it doesn’t help at all beyond a few formulas. I was ChemE, our cheat sheets never saved us.
You can still have AI write the paper and you copy it from text to paper. If anything, this will make AI harder to detect because it’s now AI + human error during the transferring process rather than straight copying and pasting for students.
Noooo. That’s a genious countermeasure without any obvious drawbacks!!1! /s
Wouldn’t it make more sense to find ways on how to utilize the tool of AI and set up criteria that would incorporate the use of it?
There could still be classes / lectures that cover the more classical methods, but I remember being told “you won’t have a calculator in your pocket”.
My point use, they should prepping students for the skills to succeed with the tools they will have available and then give them the education to cover the gaps that AI can’t solve. For example, you basically need to review what the AI outputs for accuracy. So maybe a focus on reviewing output and better prompting techniques? Training on how to spot inaccuracies? Spotting possible bias in the system which is skewed by training data?
That’s just what we tell kids so they’ll learn to do basic math on their own. Otherwise you’ll end up with people who can’t even do 13+24 without having to use a calculator.
people who can’t even do 13+24 without having to use a calculator
More importantly, you end up with people who don’t recognize that 13+24=87 is incorrect. Math->calculator is not about knowing the math, per se, but knowing enough to recognize when it’s wrong.
I don’t envy professors/teachers who are hacing to figure out novel ways of determining the level of mastery of a class of 30, 40, or 100 students in the era of online assistance. Because, really, we still need people who can turn out top level, accurate, well researched documentation. If we lose them, who will we train the next gen LLM on? ;-)
end up with people who don’t recognize that 13+24=87 is incorrect
I had a telecom teacher who would either allow you to use a calculator, but you had to get everything right.
Or go without and you could get away with rougher estimates.Doing stuff like decibels by hand isn’t too bad if you can get away with a ballpark and it’s a much more useful skill to develop than just punching numbers in a calculator.
When will people need to do basic algebra in their head? The difficulty between 13+24 and 169+ 742 rises dramatically. Yeah it makes your life convenient if you can add simple numbers, but is it necessary when everyone has a calculator?
Like someone said. It’s not just about knowing what something is, but having the ability to recognize what something isn’t.
The ability to look at a result and be skeptical if it doesn’t look reasonable.
169+742. Just by looking I can tell it has to be pretty close to 900 because 160+740 is 900. That gives me a good estimate to go by. So when I arrive at 911. I can look at it and say. Yeah. That’s probably correct, it looks reasonable.
Yes.
How so?
That sounds like ot could be a focused lesson. Why try to skirt around what the desired goal is?
That also could be placed into detecting if something is wrong with AI too. Teach people things to just help spot these errors.
In my experience, it’s so much more effective to learn how to find the answers and spot the issues than to memorize how to do everything. There’s too much now to know it all yourself.
37? In a row?
Training how to use “AI” (LLMs demonstrably possess zero actual reasoning ability) feels like it should be a seperate pursuit from (or subset of) general education to me. In order to effectively use “AI”, you need to be able to evaluate its output and reason for yourself whether it makes any sense or simply bears a statitstical resemblance to human language. Doing that requires solid critical reasoning skills, which you can only develop by engaging personally with countless unique problems over the course of years and working them out for yourself. Even prior to the rise of ChatGPT and its ilk, there was emerging research showing diminishing reasoning skills in children.
Without some means of forcing students to engage cognitively, there’s little point in education. Pen and paper seems like a pretty cheap way to get that done.
I’m all for tech and using the tools available, but without a solid educational foundation (formal or not), I fear we end up a society snakeoil users in search of the blinker fluid.
There are some universities looking at AI from this perspective, finding ways to teach proper usage of AI. Then building testing methods around the knowledge of students using it.
Your point on checking for accuracy is on point. AI doesn’t always puke out good information, and ensuring students don’t just blindly believe it NEEDS to be taught. Otherwise wise you end up being these guys… https://apnews.com/article/artificial-intelligence-chatgpt-courts-e15023d7e6fdf4f099aa122437dbb59b
It’s like the calculator in the 80s and 90s. Teacher would constantly tell us “no jobs just gonna let you use a calulator, they’re paying you to work”…
I graduated, and really thought companies were gonna make me do stuff by hand, cause calulators made it easy. Lol.
Why would any job requrie employees to do math by hand, without a calculator?
Chat GPT - answer this question, add 4 consistent typos. Then hand transcribe it.
They’re about to find out that gen Z has horrible penmanship.
I have horrible penmanship as a millennial, I was typing from around 6 on
Isn’t this kind of ableist? I remember when I was in school I had special accommodations to type instead of write, because I had wrists too weak to write legibly, but fingers fast enough to type expediently, they legitimately thought that I was a really stupid kid, until they realized that my spelling tests were not incorrect.
They just couldn’t read that I had spelled it correctly. Somehow I wrote the word fly, and the teacher mistook my y for a v. I went from being the dumbest kid to the smartest kid as soon as the accommodation was put in place.
Your comment is full of errors, interestingly enough…
It’s so bad lol. There’s multiple errors in each sentence
Yeah, I was using the speech to text on my phone, and it fucks shit up.
I assumed it was text to speech or something?
I’m assuming ESL
Your username a Waterboys reference I assume?
Of course! 😁 love them
You became the smartest kid because everyone else had a stroke trying to read what you wrote.
I see what you did. Lol.
Universities have accomodation systems for issues like this. People with disabilities can go to the accomodations office and get what they need to be able to do the work
Big brain
This thinking just feels like moving in the wrong direction. As an elementary teacher, I know that by next year all my assessments need to be practical or interview based. LLMs are here to stay and the quicker we learn to work with them the better off students will be.
And forget about having any sort of integrity or explaining to kids why it’s important for them to know how to do shit themselves instead of being wholly dependent on corporate proprietary software whose accessibility can and will be manipulated to serve the ruling class on a whim 🤦
wholly dependent on corporate proprietary software
FLOSS would want a word with you.
The way we have allowed corporations to take over the internet as a whole is deeply problematic for those reasons too, I agree with you. And it’s awful seeing what we’ve become.
Good luck doing one on one assessments in a uni course of 300+
has led some college professors to reconsider their lesson plans for the upcoming fall semester.
I’m sure they’ll write exams that actually require an actual understanding of the material rather than regurgitating the seminar PowerPoint presentations as accurately as possible…
No? I’m shocked!
We get in trouble if we fail everyone because we made them do a novel synthesis, instead of just repeating what we told them.
Particularly for an intro course, remembering what you were told is good enough.
Thats a shitty system from both sides.
Meh. I haven’t been in Uni in over 20 years. But it honestly seems kind of practical to me.
Your first year is usually when you haven’t even settled on a major. Intro classes are less about learning and more about finding out if you CAN learn, and if you’ll actually like the college experience or drop out after your first year.
The actual learning comes when the crowd has been whittled to those who have the discipline to be there.
I’m glad you had a better experience than mine on academia. Still wanting that time back.
if you CAN learn
I always found this argument completely unsatisfactory…
Imagine someone coming up to you and saying “you must learn to juggle otherwise you can’t be a fisherman” and then after 14 years of learning to juggle, they say “you don’t actually need to know how to juggle, we just had to see if you CAN learn. Now I can teach you to fish.”
You’d be furious. But, because we all grew up with this nonsense we just accept it. Everyone can learn, there’s just tons of stuff that people find uninteresting to learn, and thus don’t unless forced; especially when the format is extremely dry, unengaging, and you’ve already realized… You’re never going to need to know how to juggle to be a fisherman… ever.
The show “Are you smarter than a fifth grader?” (IMO) accurately captures just how worthless 90% of that experience is to the average adult. I’ve forgotten so much from school, and that’s normal.
The actual learning comes when the crowd has been whittled to those who have the discipline to be there.
Also this is just ridiculous, “Everyone is a genius. But if you judge a fish by its ability to climb a tree, it will live its whole life believing that it is stupid.”
You do realize you get to choose which courses to take in undergrad right? Universities aren’t forcing you to take any of the courses, you choose ones in subjects you are interested in, and first year is to get you up to speed/introduce you to those subjects, so you can decide if you want to study them further.
once you have a major or specialist, then yeah, you have some required courses, but they do tend to be things very relevant to what you want to do.
You do realize you get to choose which courses to take in undergrad right? Universities aren’t forcing you to take any of the courses, you choose ones in subjects you are interested in, and first year is to get you up to speed/introduce you to those subjects, so you can decide if you want to study them further.
That’s not true at all, every degree has a required core curriculum at every university I’ve ever heard of (e.g., humanities, some amount of math, some amount of English, etc). It also says nothing for the K-12 years.
In my university you had breadth requirements, but it was 1 humanities course, 1 social science, and 1 science, and you could pick any course within those areas to fulfill the requirement. So you had a lot of choice within the core curriculum. Man, if other unis aren’t doing that, that sucks.
deleted by creator
Can we just go back to calling this shit Algorithms and stop pretending its actually Artificial Intelligence?
It actually is artificial intelligence. What are you even arguing against man?
Machine learning is a subset of AI and neural networks are a subset of machine learning. Saying an LLM (based on neutral networks for prediction) isn’t AI because you don’t like it is like saying rock and roll isn’t music
I am arguing against this marketing campaign, that’s what. Who decides what “AI” is and how did we come to decide what fits that title? The concept of AI has been around a long time, like since the Greeks, and it had always been the concept of a made-made man. In modern times, it’s been represented as a sci-fi fantasy of sentient androids. “AI” is a term with heavy association already cooked into it. That’s why calling it “AI” is just a way to make it sound high tech futuristic dreams-come-true. But a predictive text algorithm is hardly “intelligence”. It’s only being called that to make it sound profitable. Let’s stop calling it “AI” and start calling out their bullshit. This is just another crypto currency scam. It’s a concept that could theoretically work and be useful to society, but it is not being implemented in such a way that lives up to its name.
Who decides what “AI” is
Appearently you.
The field of computer science decided what AI is. It has a very specific set of meanings and some rando on the Internet isn’t going to upend decades of usage just because it doesn’t fit their idea of what constitutes AI or because they think it’s a marketing gimmick.
It’s not. It’s a very specific field in computer science that’s been worked on since the 1950s at least.
The issue is to laypeople the term AI presents the idea of actual intelligence at a human level. Which computer science doesn’t require for something to qualify as AI
Leads to lay people attributing more ability to the llm than they actually posses.
Agreed. That said, I am uncomfortable with the idea that policing language is the correct or only solution to the problem.
Do the LLMs of the current craze meet that specific definition?
Yes.
Fair enough then.
Who decides what “AI” is and how did we come to decide what fits that title?
Language is ever-evolving, but a good starting point would be McCarthy et al., who wrote a proposal back in the 50s. See http://www-formal.stanford.edu/jmc/history/dartmouth/dartmouth.html
Techniques have come into and gone out of fashion, and obviously technology has improved, but the principles have not fundamentally changed.
Maybe machine learning models technically fit the definition of “algorithm” but it suits them very poorly. An algorithm is traditionally a set of instructions written by someone, with connotations of being high level, fully understood conceptually, akin to a mathematical formula.
A machine learning model is a soup of numbers that maybe does something approximately like what the people training it wanted it to do, using arbitrary logic nobody can expect to follow. “Algorithm” is not a great word to describe that.
Please let’s not defame Djikstra and other Algorithms like this. Just call them “corporate crap”, like what they are.
Am I wrong in thinking student can still generate an essay and then copy it by hand?
Not during class. Most likely a proctored exam. No laptops, no phones, teacher or proctor watching.
…then why can’t you do that with a school laptop that can’t access the web…?
Because laptops cost money lol
And so do colleges. If they don’t want to invest $2000 every 5/6 years for a hundred dumpster windows 95 PCs it shouldn’t be the paying student to suffer.
As an anecdote I used to do k-12 sysadmin and we once had a major issue during grade 12 English exam and the students had to handwrite their essays. Almost everyone failed. Most did not even finish. Most students can hardly even handwrite anymore and it makes sense
When I was in College for Computer Programming (about 6 years ago) I had to write all my exams on paper, including code. This isn’t exactly a new development.
So what you’re telling me is that written tests have, in fact, existed before?
What are you some kind of education historian?
Joke’s on you, I can’t write by hand without severe pain after a short while!
Because the presence of free chatgpt is so comfortable and easy to use, students can freely approach it.
