AI that sees your screen, listens to your conversations and tells you what to do
npx skills add https://github.com/BasedHardware/omi --skill omi-plugin-developmentCLI를 사용하여 이 스킬을 설치하고 작업 공간에서 SKILL.md 워크플로 사용을 시작하세요.
Omi captures your screen and conversations, transcribes in real-time, generates summaries and action items, and gives you an AI chat that remembers everything you've seen and heard. Works on desktop, phone and wearables. Fully open source.
Trusted by 300,000+ professionals.
git clone https://github.com/BasedHardware/omi.git && cd omi/desktop && ./run.sh --yolo
Builds the macOS app, connects to the cloud backend, and launches. No env files, no credentials, no local backend.
Requirements: macOS 14+, Xcode (includes Swift & code signing), Node.js
For local development with the full backend stack:
xcode-select --install
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
git clone https://github.com/BasedHardware/omi.git
cd omi/desktop
cp Backend-Rust/.env.example Backend-Rust/.env
./run.sh
See desktop/README.md for environment variables and credential setup.
cd app && bash setup.sh ios # or: bash setup.sh android
┌─────────────────────────────────────────────────────────┐
│ Your Devices │
│ │
│ ┌──────────┐ ┌──────────────┐ ┌───────────────────┐ │
│ │ Omi │ │ macOS App │ │ Mobile App │ │
│ │ Wearable │ │ (Swift/Rust) │ │ (Flutter) │ │
│ └────┬─────┘ └──────┬───────┘ └────────┬──────────┘ │
│ │ BLE │ HTTPS/WS │ │
└───────┼────────────────┼───────────────────┼─────────────┘
│ │ │
▼ ▼ ▼
┌─────────────────────────────────────────────────────────┐
│ Omi Backend (Python) │
│ │
│ ┌─────────┐ ┌──────────┐ ┌─────────┐ ┌──────────┐ │
│ │ Listen │ │ Pusher │ │ VAD │ │ Diarizer │ │
│ │ (REST) │ │ (WS) │ │ (GPU) │ │ (GPU) │ │
│ └─────────┘ └──────────┘ └─────────┘ └──────────┘ │
│ │
│ ┌─────────┐ ┌──────────┐ ┌─────────┐ ┌──────────┐ │
│ │ Deepgram│ │ Firestore│ │ Redis │ │ LLMs │ │
│ │ (STT) │ │ (DB) │ │ (Cache) │ │ (AI) │ │
│ └─────────┘ └──────────┘ └─────────┘ └──────────┘ │
└─────────────────────────────────────────────────────────┘
| Component | Path | Stack |
|---|---|---|
| macOS app | desktop/ |
Swift, SwiftUI, Rust backend |
| Mobile app | app/ |
Flutter (iOS & Android) |
| Backend API | backend/ |
Python, FastAPI, Firebase |
| Firmware | omi/ |
nRF, Zephyr, C |
| Omi Glass | omiGlass/ |
ESP32-S3, C |
| SDKs | sdks/ |
React Native, Swift, Python |
| AI Personas | web/personas-open-source/ |
Next.js |
Open-source AI wearables that pair with the mobile app for 24h+ continuous capture.
MIT — see LICENSE