Edge AI resources
Frameworks & runtimes
| # | Link | Description |
|---|---|---|
| 1 | LiteRT (TensorFlow Lite) | on-device ML runtime by Google |
| 2 | TensorFlow Lite Micro | ML on microcontrollers |
| 3 | ExecuTorch | PyTorch on-device inference |
| 4 | ONNX Runtime | cross-platform inference engine |
| 5 | OpenVINO | Intel toolkit for optimized inference |
| 6 | TensorRT | NVIDIA high-performance inference |
| 7 | MediaPipe | on-device ML solutions |
| 8 | llama.cpp | LLM inference on local hardware |
| 9 | Apache TVM | ML compiler for edge devices |
Platforms & hardware
| # | Link | Description |
|---|---|---|
| 1 | NVIDIA Jetson | edge AI computing platform |
| 2 | Google Coral | Edge TPU devices |
| 3 | Raspberry Pi AI Kit | Hailo accelerator for RPi |
| 4 | Hailo | developer zone |
| 5 | Edge Impulse | platform for embedded ML |
| 6 | Luxonis OAK | spatial AI cameras |
| 7 | ST Edge AI Suite | AI tools for STM32 |
Tutorials & courses
| # | Link | Description |
|---|---|---|
| 1 | Edge Impulse tutorials | end-to-end embedded ML projects |
| 2 | TinyML course | by HarvardX |
| 3 | Introduction to On-Device AI | by DeepLearning.AI & Qualcomm |
| 4 | Jetson AI courses | by NVIDIA |
| 5 | Jetson AI Lab | generative AI on the edge |
| 6 | Model optimization | quantization & pruning guide |
Books online
| # | Link | Description |
|---|---|---|
| 1 | Machine Learning Systems | by Vijay Janapa Reddi (Harvard) |
| 2 | TinyML at Harvard | course materials |
Communities & news
| # | Link | Description |
|---|---|---|
| 1 | EDGE AI Foundation | formerly tinyML Foundation |
| 2 | TinyML papers & projects | curated list |
| 3 | Awesome Edge ML | curated list of resources |
| 4 | Hugging Face Optimum | hardware-optimized models |