Skip to content

About

🎬 AI-powered viral clip extraction from livestreams using multi-signal guest detection, speaker diarization, and advanced LLM engineering (Chain-of-Thought, Multi-Agent Debate, Self-Consistency)

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

Nick Matau AI Content Clipper

AI-powered content clipping system that automatically identifies viral-worthy moments from livestreams.

Features

  • 🎀 Transcription: Deepgram Nova-3 with word-level timestamps
  • 🧠 AI Analysis: Gemini 2.5 Pro identifies clip-worthy moments
  • βœ‚οΈ Precise Extraction: FFmpeg keyframe-accurate cutting
  • πŸ“Š Review Queue: Google Sheets integration for approval workflow

Quick Start

# Clone the repo
git clone https://github.com/seqora/nick-matau-clipper.git
cd nick-matau-clipper

# Create virtual environment
python -m venv venv
source venv/bin/activate  # or `venv\Scripts\activate` on Windows

# Install dependencies
pip install -r requirements.txt

# Copy environment variables
cp .env.example .env
# Edit .env with your API keys

# Run the pipeline
python main.py process video.mp4 --output ./clips

Project Structure

nick-matau-clipper/
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ ingester.py      # Video input + audio extraction
β”‚   β”œβ”€β”€ transcriber.py   # Deepgram Nova-3 integration
β”‚   β”œβ”€β”€ analyzer.py      # Gemini 2.5 Pro clip detection
β”‚   β”œβ”€β”€ extractor.py     # FFmpeg precise clip cutting
β”‚   β”œβ”€β”€ sheets.py        # Google Sheets review queue
β”‚   └── timestamp_utils.py
β”œβ”€β”€ prompts/
β”‚   β”œβ”€β”€ base_prompt.md   # Master clip detection prompt
β”‚   └── nick_preferences.md
β”œβ”€β”€ docs/
β”‚   β”œβ”€β”€ PRD.md           # Product requirements
β”‚   β”œβ”€β”€ ARCHITECTURE.md  # System design
β”‚   └── TASKS.md         # Implementation tasks
β”œβ”€β”€ main.py              # CLI entry point
└── CLAUDE.md            # AI assistant instructions

CLI Commands

# Full pipeline
python main.py process video.mp4 --output ./clips

# Just transcribe
python main.py transcribe video.mp4 --output transcript.json

# Just analyze (from existing transcript)
python main.py analyze transcript.json --output clips.json

# Just extract clips
python main.py extract video.mp4 --clips clips.json --output ./clips

Configuration

Create a config/config.yaml:

deepgram:
  model: nova-3

gemini:
  model: gemini-2.5-pro
  temperature: 0.3

extraction:
  quality: medium  # fast, medium, high
  padding_start: 0.3
  padding_end: 0.5

Development

# Run tests
pytest tests/ -v

# Type check
mypy src/

# Format code
black src/ tests/

# Lint
ruff check src/ tests/

Team

  • Gabriel (AI Engineer): Transcription, AI analysis, prompts, orchestration
  • Jake (Integration Engineer): FFmpeg modules, Google Sheets

Cost

Video Length Deepgram Gemini Total
2 hours $0.52 $0.25 $0.77
4 hours $1.03 $0.40 $1.43

License

Proprietary - Seqora AI

About

🎬 AI-powered viral clip extraction from livestreams using multi-signal guest detection, speaker diarization, and advanced LLM engineering (Chain-of-Thought, Multi-Agent Debate, Self-Consistency)

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages