Session Spotlight

Barry Stahl

Camp Counselor

GPT Under the Covers

Event Logo

Wednesday, July 31, 2024 - 6:00 PM UTC, for 1 hour.

Regular, 60 minute presentation

Room: African 60

AI
algorithm
ML
GPT

Generative Pre-trained Transformers (GPT) have revolutionized the field of natural language processing, enabling machines to generate human-like text with remarkable coherence. This presentation delves into the intricacies of GPT models, shedding light on the underlying mechanisms that enable these tools to predict tokens and generate text. We will unravel the architecture of GPT, from embedding layers to attention mechanisms, and provide a clear understanding of the processes that contribute to the model's performance. Beyond the technical deep dive, we will explore practical applications, discussing valid use-cases where GPT models excel, such as chatbots, content creation, and language translation. We will also critically evaluate scenarios where GPT models may fall short or prove unsuitable, addressing common myths and misconceptions. By bridging technical expertise with real-world application, this talk aims to equip programmers and other software creators with a nuanced understanding of GPT models, empowering them to harness these tools responsibly and effectively. Join us for an engaging session filled with insights, interactive discussions, and forward-thinking perspectives on one of today's most groundbreaking technological advancements.

Prerequisites

A basic familiarity with GPT or other chatbot from a user perspective. Some experimentation with ChatGPT or one of the other LLMs available (Bing Copilot, Meta, Gemini, etc) is sufficient.

Take Aways

  • An understanding of the tokenization process
  • Knowledge of the transformer architecture and how GPT models use it
  • Awareness of the token prediction process
  • Insight into which use-cases are valid for LLM models, and which aren't
  • Practical strategies for implementing GPT models responsibly
favorited by:
Benjamin Gavin Robert Derman Elizabeth Groom Adam Morsa Josh Gretz