# How to Teach and Learn with ChatGPT: AI and new horizons for assistive technologies Canonical page: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023 - SlideShare title: How to Teach and Learn with ChatGPT - BETT 2023 - Talk date: Not established - SlideShare upload: 2023-04-02 (upload date, not the delivery date) - Event: Not established - Place: Not established - Topics: Teaching & technology - Language: en - Slides in the original listing: 155 - Coverage: Full text of all 155 slides, each paired with its original slide image (slide N is section N). - Original listing: https://www.slideshare.net/slideshow/how-to-teach-and-learn-with-chatgpt-bett-2023/257111297 - Cover image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-01.png - Reader data (JSON): https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/presentation.json - TalkWeaver package (outline and images, ZIP): https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023/how-to-teach-and-learn-with-chatgpt-bett-2023-talkweaver.zip - TalkWeaver outline: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023/talkweaver/how-to-teach-and-learn-with-chatgpt-bett-2023-outline.md ## Slide 1: How to Teach and Learn with ChatGPT: AI and new horizons for assistive technologies Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-1 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-01.png Dominik Lukes, EduTools.fyi ## Slide 2: Lots of developments since we scheduled the session Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-2 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-02.png ![A rocket icon beside the slide’s statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-0e87b9594ee3535e.png) ## Slide 3: What has changed Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-3 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-03.png - Bing Chat - GPT-4 - Google Bard - Office ‘Co-Pilot’s - GPT-4 Plugins ## Slide 4: bit.ly/academic-ai-newsletter Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-4 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-04.png ![Screenshot of the LinkedIn newsletter “AI in Academic Practice” with a cartoon computer with a puzzled face and question marks, beside a QR code.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-04.png) ## Slide 5: Poll: What is your experience with ChatGPT? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-5 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-05.png ![A raised-hand icon beside the poll question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-0397ac4c9fdd92a0.png) ## Slide 6: Poll: Experience? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-6 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-06.png - Use it every day - Played around with it - Heard a LOT about it - I heard something about it ## Slide 7: Comparison from a recent talk Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-7 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-07.png ![A poll result from an earlier talk: a pie chart beside the answers Use ChatGPT in my work (5), Have used once or twice (32), Have heard a lot and seen examples (21), Have heard something but not sure (23) and Other (share in chat) (1).](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-03089ab548b5a99a.png) ## Slide 8: Poll: What do you think AI might be best at? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-8 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-08.png ![A raised-hand icon beside the poll question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-0397ac4c9fdd92a0.png) ## Slide 9: What do you think AI might be best at? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-9 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-09.png - Looking up facts - Performing complex calculations - Writing computer code based on text - Making complex decisions from data - Writing poetry - Making beautiful art ## Slide 10: Comparison with a recent talk Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-10 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-10.png ![A horizontal bar chart of poll results for what AI might be best at, listing Looking up facts, Performing complex calculations, Writing computer code based on text, Making complex decisions based on data, Writing poetry and Creating beautiful photos, with a pop-up for “Creating beautiful photos”: 1st choice 2 (2%), 2nd choice 3 (4%), 3rd choice 6 (7%), 4th choice 7 (8%), 5th choice 18 (21%), 6th choice 48 (57%).](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-16b83dfda6118351.png) ## Slide 11: What it is actually good at? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-11 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-11.png ![A superhero-flying icon beside the question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-a6cf7f656bfc570d.png) ## Slide 12: Nobody expected AI to be any good at this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-12 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-12.png ![Two ChatGPT conversations side by side. Left: the prompt asks for a poem to remember the bones in the hand and the answer is a four-stanza rhyming poem. Right: the prompt asks for a mnemonic for the carpals and the answer is the sentence “She Left The Party To Take Cathy Home” with each carpal bone matched to a word.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-12.png) **Prompt (left):** Write a poem to help me remember the bones in the hand. In the realm of hands, a tale unfolds,\ Of bones and joints, a story told,\ Listen close, my friend, and hear,\ The names of bones, so you'll endear. Twenty-seven bones, a framework grand,\ Form the structure of our hand,\ Three groups of bones to memorize,\ Carpals, metacarpals, phalanges arise. Begin with carpals, eight in sum,\ In the wrist, they're not cumbersome,\ Proximal row, four in row,\ From lateral to medial, here's how they go: Scaphoid, lunate, triquetrum align,\ Pisiform, a small pea, so benign,\ Distal row, to continue the tour,\ Trapezium, trapezoid, capitate, hamate ensure. **Prompt (right):** Make a mnemonic for the carpals Recall the carpals, eight in all,\ With this mnemonic, you'll never stall: She Left The Party\ To Take Cathy Home - Scaphoid - She - Lunate - Left - Triquetrum - The - Pisiform - Party - Trapezium - To - Trapezoid - Take - Capitate - Cathy - Hamate - Home ## Slide 13: Or this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-13 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-13.png ![A collage of AI-generated pictures: a man sitting beside a hole in a wall, colourful retro robot and computer characters, a smiling person with a tree of leaves for hair, and a robot reading in a hollow.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-13.png) ## Slide 14: We thought AI could do this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-14 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-14.png ![A ChatGPT conversation about the arithmetic “4^2 - 234 \* (-23) \* 329870134987”: it works through the steps and its answer reads 10825535722618; beside it a calculator shows 1775361066500050.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-14.png) ## Slide 15: But it is also unexpectedly good at this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-15 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-15.png ![A ChatGPT conversation. The prompt is “Write code to add two numbers in python”. The answer explains the + operator and gives a short Python program with an add_numbers function, followed by an explanation of the code.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-61cd9a2a20779e93.png) **Prompt:** Write code to add two numbers in python In Python, you can add two numbers by simply using the `+` operator. Here's a simple function to add two numbers: `def add_numbers(a, b):`     `return a + b` `number1 = float(input("Enter the first number: "))` `number2 = float(input("Enter the second number: "))` `result = add_numbers(number1, number2)` `print("The sum of the two numbers is:", result)` In this code, the `add_numbers` function takes two arguments, `a` and `b`, and returns their sum. The user is prompted to enter two numbers, which are then passed to the function to perform the addition. The result is then printed. ## Slide 16: How do we know what modern AI will be good or bad at? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-16 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-16.png ![A puzzle-piece icon beside the question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-55c2aba161dd1561.png) ## Slide 17: We have evaluate it systematically. Almost as a new organism. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-17 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-17.png ![A microscope icon beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-ee366269d242127c.png) ## Slide 18: Hofstadter, 1979: Questions Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-18 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-18.png **Question:** Will a thinking computer be able to add fast? ![Cover of “Gödel, Escher, Bach: an Eternal Golden Braid” by Douglas R. Hofstadter, orange with a block-letter title.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-1336fbc549ff9bd3.jpeg) ## Slide 19: Hofstadter, 1979, Speculations Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-19 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-19.png > **Speculation:** Perhaps not. We ourselves are composed of hardware which does fancy calculations but that doesn't mean that our symbol level, where "we" are, knows how to carry out the same fancy calculations. ## Slide 20: Let’s keep this in mind Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-20 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-20.png ![A tweet by Sam Altman: “here is GPT-4, our most capable and aligned model yet. it is available today in our API (with a waitlist) and in ChatGPT+. openai.com/research/gpt-4 … it is still flawed, still limited, and it still seems more impressive on first use than it does after you spend more time with it.”](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-9f25bd3f7f44c539.png) ## Slide 21: What ChatGPT can do for YOU? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-21 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-21.png ![A light-bulb-in-head icon beside the question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-37d01dc27e04f77c.png) ## Slide 22: Better at poetry than math still means it can be incredibly useful. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-22 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-22.png ## Slide 23: Anyone can use it to help with reading Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-23 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-23.png ![Screenshots of a university web page with a chat panel: the user selects text and asks the assistant to explain, simplify it with easier language and explain it to a 12-year-old; the assistant’s replies appear in the side panel.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-23.png) ## Slide 24: A student can use this for help Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-24 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-24.png ![A ChatGPT conversation in which a student asks the model to explain a line of NumPy array code and it explains each element.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-ad8300321e79657b.png) ## Slide 25: A teacher can use it to create tools Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-25 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-25.png ![A teacher’s prompt asking for a tool that compares two translations of the same text and a web form with two text boxes below it, with the differences between the two texts highlighted in yellow.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-25.png) ## Slide 26: There are limits but also, we can use it to assist us in real ways. But we should understand what it is doing. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-26 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-26.png ## Slide 27: 5 Things about ChatGPT in 15(ish) Minutes Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-27 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-27.png - Dominik.Lukes@ctl.ox.ac.uk ## Slide 28: 5 things about ChatGPT in 15 minutes Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-28 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-28.png 1. It has many building blocks 2. It does not reason, it predicts 3. It is limited by the context window 4. It has no database, copy or paste or memory 5. It does not learn but you can correct it ## Slide 29: Building blocks of modern AI Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-29 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-29.png ## Slide 30: What does ChatGPT stand for? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-30 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-30.png - Chat: answers questions rather than continues - G - generative: creates strings rather than labels - P - pretrained: can be fine-tuned on much less data - T - transformer: can be trained to predict from long context Foundation model ## Slide 31: Building blocks of the AI revolution Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-31 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-31.png - Foundation Models - Products: ChatGPT, Consensus, … - Features: Notion …, PowerPoint…, … ## Slide 32: Language model universe in 2022 Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-32 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-32.png ![A bubble chart, “Language model sizes to Dec/2022”, of large language models by parameter count: from BERT and GPT-2 to GPT-3 (175 billion), Jurassic-1, MT-NLG (530 billion), PaLM (540 billion) and BLOOM, with the source LifeArchitect.ai/models.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-fdd923e5a326859e.png) ## Slide 33: Building blocks of a product Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-33 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-33.png - Foundation Model API - Fine tuning on custom data - Finetuning by human feedback - Custom Workflow / Interface - Consensus (OpenAI) - Notion (Anthropic) - Smart Reply (Google) - ChatGPT (Open AI) - Claude (Anthropic) - Bard (Google) - TeacherMatic - LangChain… ![Original slide 33 as rendered: a wide dark blue base bar “Foundation Model API”; above it three orange boxes, Fine tuning on custom data, Finetuning by human feedback and Custom Workflow / Interface; above those a row of eight small green boxes, Consensus (OpenAI), Notion (Anthropic), Smart Reply (Google), ChatGPT (Open AI), Claude (Anthropic), Bard (Google), TeacherMatic and LangChain…](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-33.png) ## Slide 34: For example Consensus (now with GPT-4) Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-34 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-34.png ![Two screenshots of Consensus, a search tool: a question about whether it is possible to improve working memory, with a summary of the evidence and a list of papers with their findings.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-34.png) ## Slide 35: ChatGPT is just another product on top of GPT Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-35 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-35.png ![Two screenshots: on the left, the TeacherMatic tool with a learning objectives generator; on the right, ChatGPT asked to write 10 learning objectives for a beginner course about web design, which it lists.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-35.png) ## Slide 36: All of these work the same way Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-36 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-36.png ![Two overlapping news articles: “Introducing Microsoft 365 Copilot—A whole new way to work” and “Google announces AI features in Gmail, Docs, and more to rival Microsoft”.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-36.png) ## Slide 37: Big API providers Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-37 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-37.png - OpenAI - Anthropic - Google - Amazon - Microsoft - Meta ## Slide 38: Although there are many smaller ones on HuggingFace Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-38 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-38.png ![The Hugging Face model listing page with filters on the left and a list of model names such as bert-base-uncased and gpt2.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-940aaee695c85b36.png) ## Slide 39: Thousands API customers Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-39 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-39.png ![The website “There’s an AI for that”: “2,675 AIs for 603 tasks. Updated daily”, “Just launched” and a grid of small tool cards on a dark page.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-25aadc0873eab158.png) ## Slide 40: And thousands more Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-40 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-40.png ![The website FutureTools: “FutureTools Collects & Organizes All The Best AI Tools So YOU Too Can Become Superhuman!”, with a search box and a grid of category filters and tool cards.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-f6b5cd10ea4fd651.png) ## Slide 41: Always ask what API a product uses! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-41 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-41.png ## Slide 42: It does not reason, it predicts Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-42 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-42.png ## Slide 43: It is easy to be deceived by appearances. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-43 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-43.png ## Slide 44: ChatGPT can do this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-44 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-44.png ![Two ChatGPT answers. First, a list of tropical fruits grouped by region, South America and Central America & Mexico. Second, the same fruits in a table with columns Fruit Name, Region of Origin and Definition.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-44.png) ## Slide 45: How do we solve these kinds of problems? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-45 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-45.png ## Slide 46: Cognition = Computation Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-46 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-46.png **Logic** - Compare - Organise - Transform **Memory** - Store - Retrieve ## Slide 47: Something like this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-47 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-47.png ![A flowchart: Find tropical fruits, Look up fruit in memory, Is it tropical? (No loops back; Yes goes to Write to list).](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-02b3425b68ba3856.png) ## Slide 48: How does ChatGPT solve these kinds of problems? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-48 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-48.png ## Slide 49: ChatGPT does not have cognition or computation Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-49 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-49.png ~~**Logic**~~ - Compare - Organise - Transform ~~**Memory**~~ - Store - Retrieve ![Original slide 49 as rendered: the Logic (database icon) and Memory (floppy disk icon) columns of the previous slide, each crossed out with a large red X.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-49.png) ## Slide 50: ChatGPT Process Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-50 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-50.png 1. Break all preceding text into tokens 2. Assign each token number 3. Predict next token 4. Repeat with the new token ## Slide 51: What and why of tokens? And why it matters. A lot! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-51 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-51.png ![A ticket icon beside the question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-070b5eedaa0d7f30.png) ## Slide 52: How we see text? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-52 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-52.png **Humans** - Letters - Words - Sentences - Paragraphs - Texts **ChatGPT** - Tokens ## Slide 53: OpenAI: ChatGPT only sees tokens Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-53 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-53.png ![Two overlapping screenshots of OpenAI’s Tokenizer: the text “Many words map to one token, but some don’t: indivisible.” with 64 tokens and 252 characters, with each token highlighted in a different colour, and an explanation of how the models see tokens.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-53.png) ## Slide 54: Actually, this is what ChatGPT sees Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-54 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-54.png Unicode ![A line of numbers in square brackets, the token IDs of a text, with a large arrow from the word “Unicode” to the group of token numbers 3118, 291 and 1098 that stand for it.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-54.png) ## Slide 55: Numbers are not digits, just tokens Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-55 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-55.png ![Two token-ID displays. The sum “1 + 2 \* 3654 = 123,565” with each number and sign coloured as its own token, and “2 + 1 / 43^43.245645”; below them a list of token numbers, with arrows from each number to the tokens it is split into.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-55.png) ## Slide 56: Fun facts about OpenAI tokens Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-56 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-56.png - About 50,000 in total - Only 3,000 English words - Most parts of words incl. letters, spaces - About 140 tokens per 100 English words - Much more for other languages ## Slide 57: Word and tokens are only accidentally identical Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-57 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-57.png ![A stack of overlapping tokenizer screenshots comparing one sentence in several languages: the token counts shown are 119, 240, 317, 396 and 523, and the last, longest text is split into many small coloured fragments.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-57.png) ## Slide 58: Unexpected consequence: More tokens more money Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-58 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-58.png - English - French - Czech - Chinese - Arabic ![A rising curved arrow from English, through French, Czech and Chinese, to Arabic: the more tokens the text needs, the higher the cost.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-58.png) ## Slide 59: Consequences of tokens Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-59 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-59.png - Limited rhyming - Bad at letter tasks - Unreliable numbers - More grammar mistakes in some languages ## Slide 60: It’s not good at this BUT it shouldn’t be able to do this at all. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-60 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-60.png ![A ChatGPT conversation. The prompt asks for 10 Czech nouns where ‘ů’ changes to ‘o’ as the noun is declined, with the examples ‘stůl’ - ‘stolu’ and ‘dům’ - ‘domu’. The answer is a numbered list of ten nouns with their declined forms and English glosses. The Czech characters in this image are displayed correctly.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-0fde601a3536d25a.png) **Prompt:** Give me 10 Czech nouns where ‘ů’ changes to ‘o’ as the noun is declined. For example, ‘stůl’ - ‘stolu’, dům - domu. Certainly! Here are 10 Czech nouns that follow the pattern of the vowel ‘ů’ changing to ‘o’ as the noun is declined: 1. Kůň - koně (horse) 2. Důl - dolu (mine) 3. Hůl - holí (cane) 4. Stroj - stroje (machine) 5. Můstek - mostky (little bridge) 6. Vůz - vozy (carriage) 7. Sůl - soli (salt) 8. Nůž - nože (knife) 9. Kroužek - kroužky (ringlet) 10. Úkol - úkoly (task) **Tokeniser view on the original slide:** beside the screenshot, the slide shows the same ten answers as coloured tokens in which every accented letter appears as one or two replacement characters: K���� - kon�� (horse); D��l - dolu (mine); H��l - holí (cane); Stroj - stroje (machine); M��stek - mostky (little bridge); V��z - vozy (carriage); S��l - soli (salt); N���� - no��e (knife); Krou��ek - krou��ky (ringlet); ��kol - ��koly (task). ## Slide 61: BTW: GPT-4 is not much better at this. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-61 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-61.png ![A ChatGPT answer about Czech noun declension, listing ten nouns with their singular genitive forms and noting that the list is not exhaustive.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-099b295cf7f64657.png) ## Slide 62: Tokens are not graphics, but they can still produce this. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-62 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-62.png ![A ChatGPT conversation: asked to convert a text into a Mermaid diagram, it returns Mermaid code, shown beside the resulting flowchart of the fruit-lookup process.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-62.png) ## Slide 63: Embeddings: Give tokens meaning Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-63 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-63.png ![A network-of-nodes icon beside the heading.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-e2ec108c23100701.png) ## Slide 64: What are embeddings? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-64 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-64.png Embeddings show how tokens relate to each other in **multidimensional-dimensional** space. ![Icon of a network of connected nodes.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-21ef9e00675b63e2.png) ## Slide 65: Language embeddings Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-65 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-65.png ![The illustration “The Illustrated Word2vec” showing word embeddings: a list of 50 numbers for the word “king”, and colour strips for king, man and woman.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-65.png) ## Slide 66: You do maths on matrices and you get Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-66 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-66.png king − man + woman = queen ## Slide 67: But all of this is happening in 100s or 1000s or dimensions. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-67 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-67.png ![A scatter plot of word embeddings projected into two dimensions: clouds of small labelled words coloured by cluster.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-87eacc341c63f6fa.png) ## Slide 68: More complicated than simple matrix addition Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-68 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-68.png ![A Dash word-embeddings app: a network of related words around “california − state + country” and a bar chart of nearest neighbours by cosine similarity.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-68.png) ## Slide 69: Add it all up Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-69 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-69.png ![An abacus icon beside the heading.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-d9014f29d8875947.png) ## Slide 70: All it is doing on the inside is multiplying matrices. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-70 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-70.png ![Four overlapping copies of an icon of a grid of small squares.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-70.png) ## Slide 71: Really big ones, for every single token in the context window! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-71 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-71.png ![An icon of a large grid, beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-71.png) ## Slide 72: On hundreds or thousands of expensive graphics cards. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-72 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-72.png ![Photograph of a red-and-black graphics card with two fans.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-4216c01426002066.png) ## Slide 73: This means it costs $$$ every time you ask it to do something. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-73 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-73.png ![An icon of banknotes and coins.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-ef32e62f12a77e1c.png) ## Slide 74: Generate predictions Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-74 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-74.png ![A line-chart-with-points icon beside the heading.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-03b5d0573360a834.png) ## Slide 75: The we predict what comes next (from Wolfram) Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-75 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-75.png ![A table of the most likely next words after the sentence beginning “The best thing about AI is its ability to”: learn 4.5%, predict 3.5%, make 3.2%, understand 3.1%, do 2.9%.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-a929996d0506a6aa.png) ## Slide 76: The top item is not always selected Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-76 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-76.png ![A text generator with a pop-up of next-word probabilities after “I went back over to the library and got a book on Civil War”: house 4.35%, other 2.32%, window 1.47%, hospital 1.26%, old 1.17% and library 0.41%, with “library” highlighted.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-76.png) ## Slide 77: Turn up the temperature: Randomness Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-77 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-77.png ![A dice icon beside the heading.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-91ee6a99953201c8.png) ## Slide 78: With heat Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-78 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-78.png ![Overlapping text-generation screenshots: a settings panel with a temperature slider beside three different continuations of text that begin “I went…”.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-78.png) ## Slide 79: What it looks like with temperature 1 Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-79 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-79.png ![The same next-word probability pop-up, now headed as the case of temperature 1: after “I went back over to the library and got a book on Civil War” the alternatives are house, other, window, hospital, old and library 0.41%.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-79.png) ## Slide 80: Without heat Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-80 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-80.png ![Several overlapping text outputs of “I went to the store to buy some groceries. I bought milk, eggs, bread, and some fruit. I also picked up some snacks for later.”, which are the same each time.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-80.png) ## Slide 81: What it looks like with temperature 0 Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-81 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-81.png ![A text-generation display for “I went to the store”: the next word “store” has probability 98.84 per cent, ahead of grocery 1.10, local 0.05, supermarket 0.01 and convenience 0.00; total logprob -0.01.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-8d39baeeb160b0df.png) ## Slide 82: Remember all of this happens for each new token Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-82 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-82.png ![The four-step ChatGPT process diagram from an earlier slide: break all preceding text into tokens, assign each token a number, predict the next token, repeat with the new token.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-82.png) ## Slide 83: Context window is a limit on prediction Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-83 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-83.png ## Slide 84: GPT-3.5 has a context window of 2,000 tokens. GPT-4 has 8,000 – 32,000. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-84 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-84.png ![A round badge of waves and gulls beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-34d9a370988f6563.png) ## Slide 85: Every new token generated, eats into the context window! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-85 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-85.png ![A Pac-Man-like shape eating dots, beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-b877d7e85007a200.png) ## Slide 86: 2,000 word summary by GPT-3.5 with 2k token window Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-86 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-86.png ![Three overlapping ChatGPT (GPT-3.5) screenshots in which the model lists the people mentioned in an article, first correctly, then when asked for five more it invents names such as Mark Zuckerberg, Jeff Bezos, Elon Musk, Tim Cook and Larry Page.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-86.png) ## Slide 87: Same summary by GPT-4 with 8k token window Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-87 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-87.png ![Two ChatGPT (GPT-4) screenshots in which the model lists the people mentioned in the article and then adds a table with name, institution, role and how they were mentioned.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-87.png) ## Slide 88: There is no database Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-88 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-88.png ## Slide 89: It looks like it’s looking things up, copying them and pasting them. BUT Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-89 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-89.png ## Slide 90: It always just predicts Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-90 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-90.png https://what-if.xkcd.com/34 ![An xkcd comic: a sign reads “OH MY GOD, THE VOLCANO IS ERU\_” and three people look at it; one says “ERUDITE?”.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-32fbf9366b4bb19e.png) ## Slide 91: But because it was trained on almost trillion tokens and has 175 billion parameters, it can do this. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-91 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-91.png ![A ChatGPT conversation: asked for a table of European countries sorted by their 2018 PISA score, it returns a table with country, reading, mathematics and science scores.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-e24a7c20c639dc21.png) ## Slide 92: It can even do this! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-92 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-92.png ![Two ChatGPT screenshots: a story about Captain Smith’s fleet of five ships, asked how many ships did he leave the expedition with and how many returned, and then asked to add a row to a table with the statuses set out, returned and lost at sea.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-92.png) ## Slide 93: But it because it always just predicts: No fact can be trusted. No common sense can be expected! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-93 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-93.png ![A table of capital cities with a distance column, with the rows for Rome (1181) and Vatican City (920) boxed in red.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-4a25feaaf5074f8a.png) ## Slide 94: It really cannot copy and compare any information!!! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-94 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-94.png ## Slide 95: Is there a number? DO NOT TRUST? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-95 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-95.png ![Two tables of distances of European capitals from Prague: the table produced by ChatGPT with columns for capital, distance, population and local-language name, beside the capitals with distances, and a note that “distances are calculated using Google Maps and may vary based on the mode of transportation used”, boxed in red.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-95.png) ## Slide 96: Can we trust the results of a search? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-96 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-96.png ![A Bing Chat conversation asked for a table of European capitals sorted by distance from Prague, with population and name in the local language; it shows a table and a note that the table was limited to six rows.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-929d5a55e4cafdf4.png) ## Slide 97: It can count some things but not very far Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-97 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-97.png ![A word-count task: a short story and Word’s Word Count dialog showing 234 words, beside ChatGPT’s answer, “There are 181 words in this story.”](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-97.png) ## Slide 98: Bing will give references but the information is not there Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-98 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-98.png ![A Bing Chat answer to “Can I have more idioms in Czech featuring animals?”, listing idioms with literal translations and a Learn more row of source links.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-ee727f73e53aa425.png) ## Slide 99: It does not even have access to its own training data! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-99 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-99.png ## Slide 100: Bret Devereaux Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-100 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-100.png > \[ChatGPT\] has **read every book in the library once** and distilled the statistical relationships between the words in that library and then **burned the library**. ## Slide 101: ChatGPT does not even try Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-101 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-101.png ![A ChatGPT answer: “Sure, here are some common Czech idioms involving animals, including cats and dogs”, followed by a numbered list of ten Czech idioms, each with an English translation and an explanation of its meaning.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-6cd1eb8c4fe19701.png) Sure, here are some common Czech idioms involving animals, including cats and dogs: 1. “Mít husí kůži” - This idiom translates to “to have goosebumps” and is used to describe a feeling of intense fear or anxiety. 2. “Být jako ryba v síti” - This means “to be like a fish in a net” and is used to describe someone who is trapped or stuck in a situation with no way out. 3. “Být jako pes s kočkou” - This translates to “to be like a dog with a cat” and is used to describe two people who cannot get along or are constantly arguing. 4. “Být jako slepý k houslím” - This means “to be like a blind person to a violin” and is used to describe someone who is completely clueless or oblivious to what is going on around them. 5. “Mít oči jako sokol” - This translates to “to have eyes like a hawk” and is used to describe someone who has very sharp or observant eyesight. 6. “Být jako kůň před kostelem” - This means “to be like a horse in front of a church” and is used to describe someone who is nervous or restless, usually due to anticipation or excitement. 7. “Mluvit do větru” - This translates to “to speak into the wind” and is used to describe someone who is talking to no one in particular, or whose words have no effect. 8. “Být zdravý jako ryba” - This means “to be healthy as a fish” and is used to describe someone who is in excellent health. 9. “Mít oči jako kráva” - This translates to “to have eyes like a cow” and is used to describe someone who has a very passive or docile personality. 10. “Mít kočku ve vaku” - This means “to have a cat in a bag” and is used to describe a situation that is not fully understood or is uncertain. ## Slide 102: ChatGPT sometimes hallucinates! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-102 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-102.png ![A smiling face with raised eyebrows beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-d127ec8cf3afcb4f.png) ## Slide 103: ChatGPT always hallucinates! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-103 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-103.png ![A red face with a wide, strained smile beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-0efff1bc2503c0fa.png) ## Slide 104: It just happens to match what we need often enough to be really useful. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-104 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-104.png ![A green thumbs-up icon beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-c3f9f27b71245a86.png) ## Slide 105: How much does predicting the next token get us? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-105 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-105.png ![A line-chart-with-points icon beside the question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-03b5d0573360a834.png) ## Slide 106: Surely, it could not count how many things are mentioned in text just by predicting the next token! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-106 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-106.png ## Slide 107: How good is it at counting things Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-107 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-107.png ![Overlapping ChatGPT screenshots: the ships story and a table of ships set out, returned and lost at sea; asked to write out the reasoning step by step, the model counts the ships in five steps.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-107.png) ## Slide 108: How good is it at counting intentions Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-108 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-108.png ![Overlapping ChatGPT screenshots: a thread of email replies to a party invitation and a table of names, reply status and reply text; asked to add a column sorting by who is coming and then by name, it fills a table.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-108.png) ## Slide 109: Can it take a hint? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-109 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-109.png ![A ChatGPT table of invitation replies, with names and reply text; the user asks it to update the table with a new message, “Hi Dominik, I’m travelling on Friday but I’ll see you at the next one.”](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-713e4b8d9527c2aa.png) ## Slide 110: How good is it at sorting? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-110 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-110.png ![Two ChatGPT tables of party replies: first sorted into a name and status list, then, when asked to use the name as a secondary sort, ordered by status and then name.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-110.png) ## Slide 111: Can it do metalanguage? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-111 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-111.png ![Overlapping ChatGPT screenshots: asked how many words are in a sentence, the model produces a table of words with definitions and miscounts; asked whether the question mark is a word, it explains, then revises its count.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-111.png) ## Slide 112: GPT-4 Improves things Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-112 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-112.png ![A ChatGPT (GPT-4) exchange: asked “How many words are in this sentence?”, it says it cannot see the sentence; told the sentence is self-referential, it answers that there are 7 words.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-6e029e93091db1db.png) ## Slide 113: But only up to a point Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-113 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-113.png ![The word-count task: the short story, Word’s Word Count dialog showing 234 words and 1,168 characters, and ChatGPT’s answer that there are 181 words.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-113.png) ## Slide 114: But it is close Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-114 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-114.png ![A ChatGPT (GPT-4) exchange: asked how many characters are in a sentence, it says 39 characters including spaces and 33 without; beside it Word’s Word Count dialog shows 35 characters without spaces and 41 with spaces.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-114.png) ## Slide 115: Every time you try a number try it more than once Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-115 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-115.png ![Three overlapping ChatGPT screenshots in which the same questions about the number of characters and words in a sentence get different answers: 49 and 39 characters, and 8, 9 and 7 words.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-115.png) ## Slide 116: Agrawal Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-116 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-116.png ![Cover of “Prediction Machines: The Simple Economics of Artificial Intelligence” by Ajay Agrawal, Joshua Gans and Avi Goldfarb, pink with two stylised eyes.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-c8769ef0ef09ee5a.png) - Computer graphics = Cheap arithmetic - AI = Cheap prediction ## Slide 117: In 1950s we could not imagine all the things cheap arithmetic would gets. Today, we can’t appreciate what cheap predictions will bring. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-117 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-117.png **Computer room in 1949** ![Black-and-white photograph of a woman working at a large computer in a computer room, captioned Computer room in 1949.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-21017c8a1901eae6.jpeg) ## Slide 118: We did not have good intuitions about what cheap arithmetic will get us. What will cheap prediction? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-118 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-118.png ## Slide 119: Four years ago, Google made a big announcement Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-119 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-119.png ![A page from Google’s blog, “Understanding searches better than ever before”, with several paragraphs of text.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-4f0ac81f092d40f0.png) ## Slide 120: Major progress in 2019 Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-120 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-120.png ![Two phone screenshots, Before and After, for the search “2019 brazil traveler to usa need a visa”: before, a news article about visas for Brazilians; after, a result that explains that a Brazilian traveller needs a visa.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-5a3b6368cafe8436.jpeg) ## Slide 121: And 4 years later Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-121 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-121.png ![A Bing Chat conversation: asked whether a traveller to the US from Brazil needs a visa, it answers that Brazilians need a visa, with sources listed below.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-ca4c5b95614e3d68.png) ## Slide 122: Also Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-122 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-122.png - No idea of spatial relations - No idea of social relations - No understanding of physics ## Slide 123: Space is a problem: Some attempts at a bicycle Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-123 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-123.png ![Four attempts at a bicycle drawn by the model in code: a brown rectangle between two red circles with blue centres; a blue rectangle on two red wheels with a red top; a blue rectangle with two red dots below it; and a red frame with two crossed blue wheels and a green handlebar.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-123.png) ## Slide 124: Social relations are a problem Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-124 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-124.png **Customer:** Take me downtown Prague. **Taxi driver:** How much does the trip cost? ## Slide 125: It does not LEARN live but can be corrected Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-125 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-125.png ## Slide 126: What it took to train the foundation model Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-126 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-126.png - 21 days - \$1+ million ## Slide 127: What it took to fine tune it with human feedback Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-127 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-127.png - X months - \$\$\$ million ## Slide 128: But it is a few-shot learner: It can follow examples Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-128 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-128.png ## Slide 129: And then… (GPT-3) Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-129 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-129.png ![Two pages from the paper “Language Models are Few-Shot Learners”: the title page with its abstract, and a figure with zero-shot, one-shot and few-shot prompts for translating English to French.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-129.png) ## Slide 130: Take it through a problem step by step. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-130 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-130.png ![Overlapping ChatGPT screenshots: the model is asked to count characters, says 39, then lists the characters one by one and, asked whether it wants to revise its answer, apologises and says there are actually 41.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-130.png) ## Slide 131: Time to do some prompt engineering Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-131 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-131.png ![A scientist-in-a-lab-coat icon beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-9e3444c6bcfc6163.png) ## Slide 132: The key lesson for practical use Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-132 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-132.png ![A teacher-at-a-board icon beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-dcb9fef344ee4070.png) ## Slide 133: Keep 2 things in mind at once Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-133 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-133.png - Give it prompts as to a human being - Interpret the results as if autocomplete ![Two large block arrows pointing outwards: an orange one to the left, “Give it prompts as to a human being”, and a green one to the right, “Interpret the results as if autocomplete”.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-133.png) ## Slide 134: What ChatGPT can do is a matter of experimentation. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-134 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-134.png ![A maze icon beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-cd9da653c67969dc.png) ## Slide 135: Prompt engineering should aim towards giving more examples and context. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-135 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-135.png ![A scientist-in-a-lab-coat icon beside the statement.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-9e9216c9ee6b74f8.png) ## Slide 136: Key lessons from prompt engineers Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-136 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-136.png 1. Narrow down context 2. Give examples 3. Specify style 4. Specify persona 5. Ask for corrections ## Slide 137: Don’t just ask, don’t just tell. Iterate! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-137 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-137.png ![Icon of a cycle of a circle, a diamond and a square joined by arrows.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-137.png) ## Slide 138: Or in the words of ChatGPT Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-138 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-138.png ![A GPT-4 conversation: asked to write a limerick about five lessons of prompt engineering (narrow down context, give examples, specify style, specify persona, ask for corrections), it returns a four-line verse.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-da961ebfcf59bfe0.png) ## Slide 139: LearnPrompting Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-139 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-139.png ![The Learn Prompting website: “Learn Prompting: A Free, Open Source Course on Communicating with Artificial Intelligence”, with Join the Discord and Start Learning buttons and three illustrations.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-7eef45428e0772e8.png) ## Slide 140: Three levels of editing Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-140 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-140.png 1. Shallow prompt 2. Fine-tuned prompt 3. Co-editing ## Slide 141: Chain of Thought Prompts Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-141 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-141.png Chain of Thought = - more accuracy - easier review ## Slide 142: But it can do this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-142 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-142.png ![Two ChatGPT screenshots: asked for a numbered list of all the characters including spaces and punctuation in a sentence, it lists them; asked whether it wants to revise its answer, it apologises and says there are actually 41 characters.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-142.png) ## Slide 143: And this Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-143 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-143.png ![Two ChatGPT screenshots: the model numbers the characters of a sentence up to 49, listing spaces separately; asked how many there are if trailing spaces are not counted, it answers 41.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-143.png) ## Slide 144: Asking for structure is better than prose! Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-144 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-144.png ## Slide 145: Outlines are very context-based Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-145 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-145.png ![A ChatGPT desktop window titled “ChatGPT in Education Poll”, with the chat history in a sidebar on the left. The prompt asks for poll questions and options about educators' existing experience and knowledge of ChatGPT; the reply is a numbered list of poll questions with bulleted answer options, cut off at question 4.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-848e7ffd25d22e64.png) **Prompt:** I'm doing a presentation about what should educators know about ChatGPT. I want to open with a poll about their existing experience and knowledge. Can you suggest some questions and poll options? Sure, here are some potential poll questions and options for educators regarding their experience and knowledge of ChatGPT: 1. How familiar are you with ChatGPT? - Not at all familiar - Somewhat familiar - Very familiar 2. Have you used ChatGPT in your teaching or curriculum? - No, I have not used it - Yes, I have used it in a limited capacity - Yes, I have used it extensively 3. In your opinion, what are the potential benefits of using ChatGPT in education? - Improved student engagement - Increased efficiency of tasks such as grading and providing feedback - Enhanced opportunities for personalized learning - Other (please specify) 4. Have you encountered any challenges when using ChatGPT in education? (The screenshot ends here; the options for question 4 are not visible.) **Sidebar chats visible:** ChatGPT in Education Poll (current), People Coming to Party, Party RSVP Confirmations, London To New York Flight Ti…, ASCII car art creation, LLM Language Model Training…, Dagmar Skálová: A Heroine, Story task and activities, Deduplicate Fruits List, Table Words Request Confuse… ## Slide 146: You can convert them into interactive things Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-146 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-146.png ![A multiple-choice quiz made from an outline: “What type of fruit is grown on the highest mountain?” with options Apples, Pears, Stone fruit and Berries, and a Submit button, followed by further questions.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-6fc28b9f2551d724.png) ## Slide 147: Asking for concepts and examples Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-147 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-147.png ![Two ChatGPT screenshots: asked for a table with examples of each of Grice’s maxims, it produces a table with columns Maxim, Definition and Example of when the maxim is met; a follow-up adds a column for when the maxim is broken.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-147.png) ## Slide 148: Asking for timelines better than narratives Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-148 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-148.png ![Two ChatGPT (GPT-4) answers: a step-by-step account of how hieroglyphics were deciphered, and a timeline of key discoveries and contributions with years and names.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-148.png) ## Slide 149: Asking to adopt a persona is also very useful, Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-149 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-149.png ![A ChatGPT role-play. The prompt asks for a conversation in English at level A1 in which ChatGPT is a shopkeeper and the user a student buying bread, with simplified speech. The reply is a short shopkeeper-and-student dialogue about white, whole wheat and rye bread, one loaf at \$2.50.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-43d8d5ebdf4bedcb.png) **Prompt:** Let's have a conversation in English at the level of A1. You are a shopkeeper and I am a student. I'm trying to buy bread. You need to simplify the way you speak so that I can understand. **Shopkeeper:** Hello, how can I help you? **Student:** Hi, I want to buy bread. **Shopkeeper:** Sure, what type of bread would you like? We have white bread, whole wheat bread, and rye bread. **Student:** What's the difference? **Shopkeeper:** White bread is made with flour that has been stripped of its nutrients. Whole wheat bread is made with flour that includes the bran and germ, which makes it healthier. Rye bread is made with rye flour and has a distinctive flavor. **Student:** I want the healthier one. Can I have whole wheat bread? **Shopkeeper:** Sure, how many loaves would you like? **Student:** Just one loaf, please. **Shopkeeper:** That will be \$2.50. Would you like anything else? **Student:** No, that's all. Thank you. **Shopkeeper:** You're welcome. Have a nice day! ## Slide 150: You can even have a back and forth Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-150 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-150.png ![Two ChatGPT conversations: a role-play in which the user plays a shopkeeper in a small German village and the model plays a customer in German, then a request to correct the user’s German, answered with a corrected version of what they said.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-150.png) ## Slide 151: Where to learn more? Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-151 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-151.png ![A book icon beside the question.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-324ebbc52bee3a4f.png) ## Slide 152: Edutools.FYI Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-152 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-152.png ![The Edutools.fyi website, a Notion page with “ChatGPT and other Artificial intelligence Tools”, a tools database and readings, beside a QR code.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-152.png) ## Slide 153: bit.ly/academic-ai-newsletter Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-153 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-153.png https://bit.ly/academic-ai-newsletter ![The LinkedIn newsletter “AI in Academic Practice” with a cartoon computer with a puzzled face, beside a QR code.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/page-153.png) ## Slide 154: Tools change, people remain the same Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-154 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-154.png EduTools.fyi ## Slide 155: This presentation is licensed under Creative Commons By Attribution license except where otherwise noted. Icons and stock photos licensed under Microsoft Premium Content and cannot be reused outside this document. Cite: https://slides.dominiklukes.net/how-to-teach-and-learn-with-chatgpt-bett-2023#section-155 · Original slide image: https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/pages/page-155.png ![Creative Commons Attribution licence badge.](https://slides.dominiklukes.net/readers/how-to-teach-and-learn-with-chatgpt-bett-2023/media/img-cd64f44f67f59813.png) Collections: [Artificial intelligence](https://slides.dominiklukes.net/?collection=ai), [Reading, writing and accessibility](https://slides.dominiklukes.net/?collection=access), [Teaching and learning](https://slides.dominiklukes.net/?collection=teaching)