jain777/claude-eyes
4 stars · Last commit 2026-06-02
Give Claude smarter eyes for video. /see watches videos with scene-aware frame extraction + OCR; /skillgen scaffolds Claude Code skills from tutorial videos.
README preview
# claude-eyes
Give Claude Code smarter eyes for video. Two skills, one plugin:
- **`/claude-eyes:see`** — watch a video (URL or local file) and answer questions about it. Scene-aware frame extraction with perceptual deduplication keeps token cost low; optional OCR replaces expensive high-res frame inspection for text-heavy content; contact-sheet preview mode summarizes long videos in a single image.
- **`/claude-eyes:skillgen`** — watch a tutorial or demo video and scaffold a runnable Claude Code skill from it.
Designed to spend as few image tokens as possible on long or static video, while staying accurate:
| Capability | How claude-eyes does it |
|---|---|
| Frame sampling | Scene-change + minimum-cadence selection after `mpdecimate` perceptual dedup — one ffmpeg pass, no duplicate frames in static stretches |
| Per-frame timestamps | PTS-in-filename via `-frame_pts 1`, correct even when sampling is non-uniform |
| Long-video preview | One `tile=4x6` contact sheet (~1k vision tokens) to orient before spending on full extraction |
| OCR | Optional `tesseract` pass; auto-on for text-related questions, so on-screen text is read cheaply instead of via high-res frames |
| Transcript input | `--transcript` accepts user-supplied VTT/SRT/JSON/TXT first; falls back to captions, then Whisper |
| Cache | sha256-keyed under `${CLAUDE_PLUGIN_DATA}/cache` — re-runs skip download and extraction |
| Skill-from-video | `/skillgen` scaffolds a working SKILL.md + plugin.json from a tutorial |
## Install