Sound Engineer AI

Sound Engineer AI is an open-source AI assistant for music producers, artists, and beginner sound engineers.

The goal of the project is to build a standalone web service powered by the OpenAI API. The assistant helps users understand mixing, mastering, vocal chains, DAW workflows, plugin settings, screenshots, and audio feedback.

This project started as a ChatGPT Project Pack and is now being developed into a full API-based open-source service.

Vision

Independent artists often cannot afford professional mix feedback, mastering engineers, or personal audio engineering education.

Sound Engineer AI aims to make practical audio engineering help more accessible by combining:

• OpenAI API workflows
• DAW-specific knowledge
• Plugin-specific guidance
• Screenshot analysis
• Audio feedback workflows
• Mix and master checklists
• User plugin profiles
• Educational explanations for beginners

Planned Features

AI Chat Assistant

A web-based assistant for music production and sound engineering questions.

Planned support:

• Logic Pro
• Ableton Live
• FL Studio
• FabFilter plugins
• Waves plugins
• iZotope RX
• iZotope Ozone
• Vocal tuning workflows
• Mixing and mastering chains

User Plugin Profile

Users will be able to define which plugins they own.

The assistant will then give advice based only on the user's available plugins.

Example:

{
  "daw": "Logic Pro",
  "plugins": ["FabFilter Pro-Q 3", "Waves Tune Real-Time", "Ozone 12", "RX 10"]
}

Screenshot Analysis

Users will be able to upload screenshots from their DAW or plugin chains.

The assistant will explain:

• what each setting does
• what may be wrong
• what should be changed
• how to improve the chain

Audio Feedback

The project will include workflows for uploading audio files and receiving structured feedback.

Planned analysis areas:

• vocal clarity
• low-end balance
• harsh frequencies
• muddiness
• stereo width
• loudness
• master readiness

Repository Structure

apps/
  web/
    Frontend web application

  api/
    Backend API service

packages/
  prompts/
    Prompt workflows for mixing, mastering, plugins, DAWs, and screenshots

  audio-analysis/
    Audio analysis helpers and experiments

docs/
  Architecture, setup guides, roadmap, and contribution docs

examples/
  Example plugin profiles, prompts, and user workflows

Roadmap

v0.1.0

• Prepare project architecture
• Add documentation
• Add first prompt workflows
• Add example plugin profile
• Define API service plan

v0.2.0

• Build basic web interface
• Add OpenAI API chat integration
• Add environment variable setup
• Add first user profile format

v0.3.0

• Add screenshot analysis workflow
• Add DAW-specific response modes
• Add Logic Pro, Ableton Live, and FL Studio sections

v0.4.0

• Add audio upload workflow
• Add structured mix feedback
• Add basic loudness and frequency feedback helpers

v0.5.0

• Add plugin-aware recommendations
• Add user preset system
• Add saved project sessions

Why Open Source

The project is open source because music production knowledge should be easier to access.

Many beginner artists struggle with unclear tutorials, random plugin chains, bad presets, and expensive feedback. This project aims to create a practical AI tool that helps users learn faster and make better creative decisions.

Status

Early-stage project.

The repository is currently being prepared for active development, issue tracking, public roadmap, and API-based implementation.

License

MIT License