Session 1: Introduction to Generative AI (1 Hour)

• Definition & Types (Text, Image, Video, Music)
• Generative vs. Discriminative Models
• Applications: GPT, BERT, Chatbots, Summarization, Translation

Session 2: Introduction to Transformers (1.5 Hours)

• Transformer Architecture & Attention Mechanism
• Pre-training vs. Fine-tuning LLMs

Session 3: Using Pre-trained Models (1.5 Hours)

• Hugging Face Library & APIs
• Hands-on Lab: Using pre-trained models for text generation

Session 4: Text Generation with LLMs (2 Hours)

• Sampling Strategies (Top-K, Top-P), Temperature Control
• Fine-tuning LLMs for summarization & Q&A

Hands-on Lab: Generating AI-based text using GPT & BERT