Meeting 9
Meeting 9
Get in groups of 4 or 5. It’s ok if the group is a little smaller. If your group is 6 or more, I will come tell you to split up.
First activity: Review LLM differences
Open up Gemini, Claude, and ChatGPT in separate windows. (You might open DeepSeek, Grok, and Mistral (available in ZotGPT) as well if you want.) Re-try some prompts from the Week 2 activity, or from your Assignment 1 (link removed) on all of them, especially if you noticed there were some of these prompts that revealed their differences, or that they did badly on. Talk to the other people in your group about what you’re seeing and what you think are the important differences between different systems on these prompts.
It’s worth trying the same prompt multiple times on new blank chats to get a sense of the range of types of response it gives, and also comparing whether it gives the same response for different people in your group. It’s also worth continuing the conversation to see how it responds to pushback.
Once your group has some refreshed memory of the differences, move on to the next activity.
Second activity: Identify the LLM
One person in your group will be the “guesser” - that person should step out of the room for a moment. The rest of you should each select a different model (Gemini, Claude, and GPT if there are three of you, adding DeepSeek, Grok, or Mistral if there’s another). Then the guesser should come back and give a prompt to everyone that they should each put into their chat. (The prompt shouldn’t ask directly about which model it is or who made it or anything like that!) Share the results with the guesser. See if the guesser can guess which is which based on the details or the style of the response, or if they need more conversation.
Repeat this process with other people as guesser.
If you want, see if you can use an LLM as guesser, explaining that it’s supposed to identify which of the responses it gets are from which of the other LLMs, showing it the responses of several others to the prompt it supplies.
Third activity: Discuss this module’s ideas
Open up the Canvas page for module 9 (link removed) to remind yourselves of the videos for this module. Discuss these videos with each other.
Were there any ideas from any of them that you found particularly surprising, or interesting? Were there things you didn’t understand?
Did any of you look at any of the “Further watching/reading” links below the actual assignments? Were there any interesting things you learned? Are there any that you want to look at after this discussion?