Skip to content

Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.

Notifications You must be signed in to change notification settings

roboflow/notebooks

Repository files navigation

👋 hello

Over the years we have created dozens of Computer Vision tutorials. This repository contains examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO, SAM, and GPT-4 Vision.

Curious to learn more about GPT-4 Vision?Check out our GPT-4V experiments 🧪 repository.

🚀 model tutorials (39 notebooks)

notebook open in colab / kaggle / sagemaker studio lab complementary materials repository / paper
Segment Images with SAM2 ColabKaggle RoboflowYouTube GitHubarXiv
Segment Videos with SAM2 ColabKaggle RoboflowYouTube GitHubarXiv
RT-DETR Object Detection ColabKaggle Roboflow GitHubarXiv
Fine-Tune Florence-2 on Object Detection Dataset ColabKaggle RoboflowYouTube arXiv
Run Different Vision Tasks with Florence-2 ColabKaggle RoboflowYouTube arXiv
Fine-Tune PaliGemma on Object Detection Dataset ColabKaggle RoboflowYouTube GitHubarXiv
YOLOv10 Object Detection ColabKaggle Roboflow GitHubarXiv
Zero-Shot Object Detection with YOLO-World ColabKaggle RoboflowYouTube GitHubarXiv
YOLOv9 Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
RTMDet Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
Fast Segment Anything Model (FastSAM) ColabKaggle RoboflowYouTube GitHubarXiv
YOLO-NAS Object Detection ColabKaggle RoboflowYouTube GitHub
Segment Anything Model (SAM) ColabKaggle RoboflowYouTube GitHubarXiv
Zero-Shot Object Detection with Grounding DINO ColabKaggle RoboflowYouTube GitHubarXiv
DETR Transformer Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
DINOv2 Image Classification ColabKaggle Roboflow GitHubarXiv
YOLOv8 Object Detection ColabKaggle RoboflowYouTube GitHub
YOLOv8 Pose Estimation ColabKaggle Roboflow GitHub
YOLOv8 Oriented Bounding Boxes ColabKaggle Roboflow GitHub
YOLOv8 Instance Segmentation ColabKaggle RoboflowYouTube GitHub
YOLOv8 Classification ColabKaggle Roboflow GitHub
YOLOv7 Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
YOLOv7 Instance Segmentation ColabKaggle RoboflowYouTube GitHubarXiv
YOLOv7 Object Detection OpenVINO + TorchORT ColabKaggle Roboflow GitHubarXiv
MT-YOLOv6 Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
YOLOv5 Object Detection ColabKaggle RoboflowYouTube GitHub
YOLOv5 Classification ColabKaggle RoboflowYouTube GitHub
YOLOv5 Instance Segmentation ColabKaggle RoboflowYouTube GitHub
Detection2 Instance Segmentation ColabKaggle RoboflowYouTube GitHubarXiv
SegFormer Instance Segmentation ColabKaggle RoboflowYouTube GitHubarXiv
Vision Transformer Classification ColabKaggle RoboflowYouTube GitHubarXiv
Scaled-YOLOv4 Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
YOLOS Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
YOLOR Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
YOLOX Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
Resnet34 fast.ai Classification ColabKaggle RoboflowYouTube
OpenAI Clip Classification ColabKaggle RoboflowYouTube GitHubarXiv
YOLOv4-tiny Darknet Object Detection ColabKaggle RoboflowYouTube GitHubarXiv
Train a YOLOv8 Classification Model with No Labeling ColabKaggle Roboflow GitHub

📸 computer vision skills (20 notebooks)

notebook open in colab / kaggle / sagemaker studio lab complementary materials repository / paper
Football AI ColabKaggle RoboflowYouTube GitHub
Automated Dataset Annotation with GroundedSAM 2 ColabKaggle Roboflow GitHub
How to Estimate Vehicle Speed ColabKaggle RoboflowYouTube GitHub
Detect and Count Objects in Polygon Zone with YOLOv5 / YOLOv8 / Detectron2 + Supervision ColabKaggle RoboflowYouTube GitHub
Track and Count Vehicles with YOLOv8 + ByteTRACK + Supervision ColabKaggle RoboflowYouTube GitHubarXiv
Football Players Tracking with YOLOv5 + ByteTRACK ColabKaggle RoboflowYouTube GitHubarXiv
Auto Train YOLOv8 Model with Autodistill ColabKaggle RoboflowYouTube GitHub
Image Embeddings Analysis - Part 1 ColabKaggle YouTube GitHubarXiv
Automated Dataset Annotation and Evaluation with Grounding DINO and SAM ColabKaggle RoboflowYouTube GitHubarXiv
Automated Dataset Annotation and Evaluation with Grounding DINO ColabKaggle YouTube GitHubarXiv
Roboflow Video Inference with Custom Annotators ColabKaggle Roboflow GitHub
DINO-GPT-4V Object Detection ColabKaggle Roboflow
Train a Segmentation Model with No Labeling ColabKaggle Roboflow GitHub
DINOv2 Image Retrieval ColabKaggle GitHubarXiv
Vector Analysis with Scikit-learn and Bokeh ColabKaggle Roboflow
RF100 Object Detection Model Benchmarking ColabKaggle RoboflowYouTube GitHubarXiv
Create Segmentation Masks with Roboflow ColabKaggle Roboflow
How to Use PolygonZone and Roboflow Supervision ColabKaggle Roboflow
Train a Package Detector With Two Labeled Images ColabKaggle Roboflow GitHub
Image-to-Image Search with CLIP and faiss ColabKaggle Roboflow

🎬 videos

Almost every week we create tutorials showing you the hottest models in Computer Vision. 🔥 Subscribe,and stay up to date with our latest YouTube videos!

How to Choose the Best Computer Vision Model for Your Project How to Choose the Best Computer Vision Model for Your Project

Created: 26 May 2023|Updated: 26 May 2023

In this video, we will dive into the complexity of choosing the right computer vision model for your unique project. From the importance of high-quality datasets to hardware considerations, interoperability, benchmarking, and licensing issues, this video covers it all...


Accelerate Image Annotation with SAM and Grounding DINO Accelerate Image Annotation with SAM and Grounding DINO

Created: 20 Apr 2023|Updated: 20 Apr 2023

Discover how to speed up your image annotation process using Grounding DINO and Segment Anything Model (SAM). Learn how to convert object detection datasets into instance segmentation datasets, and see the potential of using these models to automatically annotate your datasets for real-time detectors like YOLOv8...


SAM - Segment Anything Model by Meta AI: Complete Guide SAM - Segment Anything Model by Meta AI: Complete Guide

Created: 11 Apr 2023|Updated: 11 Apr 2023


Discover the incredible potential of Meta AI's Segment Anything Model (SAM)! We dive into SAM, an efficient and promptable model for image segmentation, which has revolutionized computer vision tasks. With over 1 billion masks on 11M licensed and privacy-respecting images, SAM's zero-shot performance is often superior to prior fully supervised results...

💻 run locally

We try to make it as easy as possible to run Roboflow Notebooks in Colab and Kaggle, but if you still want to run them locally, below you will find instructions on how to do it. Remember don't install your dependencies globally, use venv.

#clone repository and navigate to root directory
git clone [email protected]:roboflow-ai/notebooks.git
cd notebooks

#setup python environment and activate it
python3 -m venv venv
source venv/bin/activate

#install and run jupyter notebook
pip install notebook
jupyter notebook

☁️ run in sagemaker studio lab

You can now open our tutorial notebooks inAmazon SageMaker Studio Lab- a free machine learning development environment that provides the compute, storage, and security—all at no cost—for anyone to learn and experiment with ML.

Stable Diffusion Image Generation YOLOv5 Custom Dataset Training YOLOv7 Custom Dataset Training
SageMaker SageMaker SageMaker

🐞 bugs & 🦸 contribution

Computer Vision moves fast! Sometimes our notebooks lag a tad behind the ever-pushing forward libraries. If you notice that any of the notebooks is not working properly, create a bug report and let us know.

If you have an idea for a new tutorial we should do, create a feature request. We are constantly looking for new ideas. If you feel up to the task and want to create a tutorial yourself, please take a peek at ourcontribution guide.There you can find all the information you need.

We are here for you, so don't hesitate toreach out.