Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Machine Learning with Hugging Face Bootcamp: Zero to Mastery
Introduction
Machine Learning with Hugging Face Bootcamp: Zero to Mastery (1:48)
Exercise: Meet Your Classmates and Instructor
Understanding Your Video Player
Course Resources
Set Your Learning Streak Goal
Course Overview
Overview (5:02)
Project 0 - Introduction to Text Classification
Introduction to Text Classification (5:43)
What We're Going To Build! (7:21)
Project 0 - Let's Get Started!
Getting Setup: Adding Hugging Face Tokens to Google Colab (5:52)
Getting Setup: Importing Necessary Libraries to Google Colab (9:35)
Downloading a Text Classification Dataset from Hugging Face Datasets (16:00)
Project 0 - Preparing Text Data & Evaluation Metric
Preparing Text Data for Use with a Model - Part 1: Turning Our Labels into Numbers (12:48)
Preparing Text Data for Use with a Model - Part 2: Creating Train and Test Sets (6:18)
Preparing Text Data for Use with a Model - Part 3: Getting a Tokenizer (12:53)
Preparing Text Data for Use with a Model - Part 4: Exploring Our Tokenizer (10:26)
Preparing Text Data for Use with a Model - Part 5: Creating a Function to Tokenize Our Data (17:57)
Setting Up an Evaluation Metric (to measure how well our model performs) (8:53)
Let's Have Some Fun (+ More Resources)
Project 0 - Model Training
Introduction to Transfer Learning (a powerful technique to get good results quickly) (7:10)
Model Training - Part 1: Setting Up a Pretrained Model from the Hugging Face Hub (12:19)
Model Training - Part 2: Counting the Parameters in Our Model (12:27)
Model Training - Part 3: Creating a Folder to Save Our Model (3:53)
Model Training - Part 4: Setting Up Our Training Arguments with TrainingArguments (14:59)
Model Training - Part 5: Setting Up an Instance of Trainer with Hugging Face Transformers (5:05)
Model Training - Part 6: Training Our Model and Fixing Errors Along the Way (13:34)
Model Training - Part 7: Inspecting Our Models Loss Curves (14:39)
Model Training - Part 8: Uploading Our Model to the Hugging Face Hub (8:01)
Unlimited Updates
Project 0 - Making Predictions
Making Predictions on the Test Data with Our Trained Model (5:58)
Turning Our Predictions into Prediction Probabilities with PyTorch (12:48)
Sorting Our Model's Predictions by Their Probability (5:10)
Project 0 - Performing Inference
Performing Inference - Part 1: Discussing Our Options (9:40)
Performing Inference - Part 2: Using a Transformers Pipeline (one sample at a time) (10:01)
Performing Inference - Part 3: Using a Transformers Pipeline on Multiple Samples at a Time (Batching) (6:38)
Performing Inference - Part 4: Running Speed Tests to Compare One at a Time vs. Batched Predictions (10:33)
Performing Inference - Part 5: Performing Inference with PyTorch (12:06)
OPTIONAL - Putting It All Together: from Data Loading, to Model Training, to making Predictions on Custom Data (34:28)
Implement a New Life System
Project 0 - Launching Our Model!
Turning Our Model into a Demo - Part 1: Gradio Overview (3:47)
Turning Our Model into a Demo - Part 2: Building a Function to Map Inputs to Outputs (7:07)
Turning Our Model into a Demo - Part 3: Getting Our Gradio Demo Running Locally (6:46)
Making Our Demo Publicly Accessible - Part 1: Introduction to Hugging Face Spaces and Creating a Demos Directory (8:01)
Making Our Demo Publicly Accessible - Part 2: Creating an App File (12:14)
Making Our Demo Publicly Accessible - Part 3: Creating a README File (7:07)
Making Our Demo Publicly Accessible - Part 4: Making a Requirements File (3:33)
Making Our Demo Publicly Accessible - Part 5: Uploading Our Demo to Hugging Face Spaces and Making it Publicly Available (18:43)
Summary Exercises and Extensions (5:55)
Course Check-In
Project 1 - Building a Custom Object Detection Model with Hugging Face Transformers
Project 1 Overview and Resources
Introduction (10:03)
Setting Up Google Colab with Hugging Face Tokens (5:51)
Installing Necessary Dependencies (3:43)
Getting an Object Detection Dataset (7:37)
Inspecting the Features of Our Dataset (6:23)
Creating a Colour Palette to Visualize Our Classes (9:35)
Creating a Helper Function to Halve Our Image Sizes (4:24)
Creating a Helper Function to Halve Our Box Sizes (6:01)
Testing our Helper Functions (4:33)
Outlining the Steps to Draw Boxes on an Image (6:26)
Plotting Bounding Boxes on a Single Image Step by Step (19:04)
Different Bounding Box Formats (8:17)
Project 1 - Getting and Object Detection Model and Image Preprocessor
Getting an Object Detection Model (6:15)
Transfer Learning Overview (6:08)
Downloading our Model from the Hugging Face Hub and Trying it Out (9:26)
Inspecting the Layers of Our Model (6:53)
Counting the Number of Parameters in Our Model (10:54)
Creating a Function to Build Our Custom Model (13:15)
Passing a Single Image Sample Through Our Model - Part 1 (15:47)
OPTIONAL: Data Preprocessor Model Workflow (8:46)
Loading Our Models Image Preprocessor and Customizing it for Our Use Case (20:10)
Exercise: Imposter Syndrome (2:55)
Project 1 - Getting Hands-on with Different Bounding Box Formats
Bounding Box Formats 101
Discussing the Format Our Model Expects Our Annotations In (COCO) (6:17)
Creating Dataclasses to Hold the COCO Format (9:54)
Creating a Function to Turn Our Annotations into COCO Format (12:05)
Preprocessing a Single Image Sample and COCO Formatted Annotations (7:26)
Post Processing a Single Output (12:02)
Plotting a Single Post Processed Sample onto an Image (12:44)
Project 1 - OPTIONAL: Reproducing our Model's Post Processed Outputs by Hand
OPTIONAL: Reproducing Our Models Post Processed Outputs by Hand - Part 1: Overview (10:44)
OPTIONAL: Reproducing Our Models Post Processed Outputs by Hand - Part 2: Replicating Scores by Hand (28:32)
OPTIONAL: Reproducing Our Models Post Processed Outputs by Hand - Part 3: Replicating Labels by Hand (12:32)
OPTIONAL: Reproducing Our Models Post Processed Outputs by Hand - Part 4: Replicating Boxes by Hand Overview (10:23)
OPTIONAL: Reproducing Our Models Post Processed Outputs by Hand - Part 5: Replicating Boxes by Hand Implementation (17:41)
OPTIONAL: Reproducing Our Models Post Processed Outputs by Hand - Part 6: Plotting Our Manual Post Processed Outputs on an Image (6:44)
Project 1 - Preparing our Data for Training our Object Detection Model
Preparing Our Data at Scale - Part 1: Concept Overview (9:21)
Preparing Our Data at Scale - Part 2: Creating Train Validation and Test Splits (12:13)
Preparing Our Data at Scale - Part 3: Preprocessing Multiple Samples at a Time Overview (8:16)
Preparing our Data at Scale - Part 4: Making a Function to Preprocess Multiple Samples at a Time (21:37)
Preparing our Data at Scale - Part 5: Applying Our Preprocessing Function to Our Datasets (9:37)
Preparing Our Data at Scale - Part 6: Creating a Data Collation Function (12:20)
Project 1 - Training a Custom Object Detection Model for Trashify
Training a Custom Model - Part 1: Overview (7:42)
Training a Custom Model - Part 2: Creating a Model and Folder to Save Our Model to (4:11)
Training a Custom Model - Part 3: Creating TrainingArguments for Our Model Overview (12:53)
Training a Custom Model - Part 4: Creating our First TrainingArguments (11:11)
Training a Custom Model - Part 5: Finishing Off the TrainingArguments (12:39)
Training a Custom Model - Part 6: OPTIONAL - Creating a Custom Optimizer for Different Learning Rates (16:05)
Training a Custom Model - Part 7: Creating an Evaluation Function for Our Model Overview (13:09)
Training a Custom Model - Part 8: Creating an Evaluation Function for Our Model Targets Processing (22:49)
Training a Custom Model - Part 9: Creating an Evaluation Function for Our Model Predictions Processing (13:52)
Training a Custom Model - Part 10: Training Our Model with Trainer (12:53)
Training a Custom Model - Part 11: Plotting Our Models Loss Curves (8:35)
Project 1 - Evaluating our Trained Object Detection Model
Evaluating Our Model on the Test Dataset (11:13)
Making Predictions on Test Data and Visualizing Them (24:20)
Plotting Our Models Predictions vs. the Ground Truth Images (12:00)
Trying Our Model on Images from the Wild (9:49)
Uploading Our Trained Model to the Hugging Face Hub (10:46)
Project 1 - Bringing Trashify to Life: Turning our Custom Model into a Shareable Demo
Turning Our Model into a Demo - Part 1: Gradio and Hugging Face Spaces Overview (10:10)
Turning Our Model into a Demo - Part 2: Creating an App File Overview (7:10)
Turning Our Model into a Demo - Part 3: Building the Main Function of Our App File (27:32)
Turning Our Model into a Demo - Part 4: Finishing Off Our App File and Testing Our Demo (9:56)
Turning Our Model into a Demo - Part 5: Creating a Readme and Requirements File (3:31)
Turning Our Model into a Demo - Part 6: Getting Example Images for Our Demo (8:19)
Turning Our Model into a Demo - Part 7: Uploading Our Demo to the Hugging Face Hub (17:18)
Turning Our Model into a Demo - Part 8: Embedding Our Demo into Our Notebook (3:44)
Summary, Extensions and Extra-Curriculum (6:15)
Project 2 - Fully Fine-tuning a Small Language Model (SLM) with Hugging Face Transformers
Overview and Introduction to Small Language Models (SLMs) + Resources (10:32)
What We're Going to Cover (8:39)
Setting Up Google Colab with Hugging Face Tokens (5:52)
Getting Our Google Colab Instance Ready for Coding (6:18)
Summary: Extensions and Extra Curriculum (9:56)
Project 2 - Setting up a Small Language Model and Getting a Dataset
Setting Up Our Base Model and Inspecting the Tokenizer (14:07)
How to Convert Input and Output Tokens to Text (10:31)
Counting the Parameters in Our Model and Comparing it to the Teacher Model (12:07)
Downloading a Text Dataset for Our Model (14:24)
Project 2 - Preparing a text dataset for language model fine-tuning
Formatting Our Dataset Ready to Be Used with a Language Model (12:17)
Splitting Our Dataset into Train and Test Sets (5:01)
Project 2 - Testing our Small Language Model (before fine-tuning)
Using Our Base Model with a Hugging Face Pipeline (16:05)
Attempt 0: Trying the Base Model Pipeline with One of Our Own Samples (8:59)
Attempt 1: Trying the Base Model Pipeline with One of Our Own Samples and an Instruction Prompt (15:20)
Project 2 - Fine-Tuning Our Model On Custom Data
Fine-Tuning Our Model - Part 1: Discussing the Ingredients We Need for Fine-Tuning (5:09)
Fine-Tuning Our Model - Part 2: Setting Up Our SFTConfig with Hyperparameters for Model Training (17:53)
Fine-Tuning Our Model - Part 3: Setting Up Our SFTTrainer and Fine-Tuning Our Model and Fixing Errors Along the Way (15:21)
Fine-Tuning Our Model - Part 4: Plotting Our Models Loss Curves (5:54)
Fine-Tuning Our Model - Part 5: Saving Our Best Model to File (4:42)
Project 2 - Loading Our Fine-Tuned Model and Making Predictions
Loading In Our Best Model from File and Preparing to Make Predictions (5:08)
Making Predictions on Test Samples with Our Loaded Fine-tuned Model (5:28)
Project 2 - Evaluating Our Fine-Tuned Small Language Model
Comparing Our Fine-Tuned Model's Predictions to the Test Labels (7:45)
Writing a Helper Function to Make Predictions on Any Sample and Inspecting the Results (9:57)
Project 2 - Uploading Our Model to the Hugging Face Hub
Discussing what Uploading Our Model to the Hugging Face Hub Looks Like (5:49)
Creating a Hugging Face Hub Model Repo to Store Our Model (3:41)
Creating a README Model Card for Our Fine Tuned Model (6:04)
Uploading Our Fine-Tuned Model to the Hugging Face Hub (6:14)
Project 2 - Turning Our Fine-Tuned Model Into a Shareable Demo
Turning Our Model into a Demo - Part 1: Discussing the Required Components (6:13)
Turning Our Model into a Demo - Part 2: Building an app.py File to Launch Our Demo (18:09)
Turning Our Model into a Demo - Part 3: Creating Requirements and README Files for Our Demo (4:11)
Turning Our Model into a Demo - Part 4: Uploading Our Demo to the Hugging Face Hub and Publishing it (13:05)
Turning Our Model into a Demo - Part 5: Embedding Our Demo Right within Google Colab (4:31)
Where To Go From Here?
Thank You! (1:17)
Review This Course!
Become An Alumni
Learning Guideline
ZTM Events Every Month
LinkedIn Endorsements
Counting the Parameters in Our Model and Comparing it to the Teacher Model
This lecture is available exclusively for ZTM Academy members.
If you're already a member,
you'll need to login
.
Join ZTM To Unlock All Lectures