Home > Features
Features
Sound Forge Alchemy is a full-stack audio processing platform built on Phoenix LiveView. This section catalogs every user-facing feature, from Spotify import through AI-powered music intelligence.
Feature Catalog
Spotify Import Pipeline
The import pipeline accepts any Spotify track or playlist URL and drives the entire download workflow. SpotDL fetches metadata (title, artist, album, ISRC, BPM, key) from the Spotify API, then locates and downloads the highest-quality audio source. Each import becomes an Oban background job with live progress updates streamed to the browser via Phoenix PubSub, so users can monitor queued, running, and completed downloads in real time.
Stem Separation
Stem separation isolates individual instrument layers from a mixed audio file. Sound Forge Alchemy supports two engines: local Demucs (running on CPU or GPU) and cloud-based lalal.ai. The local engine ships four model variants — htdemucs, htdemucs_ft, htdemucs_6s, and mdx_extra — each with different tradeoffs between speed and quality. The lalal.ai integration unlocks up to nine discrete stem types (vocals, drums, bass, electric guitar, acoustic guitar, piano, synthesizer, strings, wind instruments) and offers a 60-second preview without consuming a full processing credit.
Audio Analysis
The analysis module runs a Python/librosa pipeline over downloaded tracks and stores quantitative audio features in PostgreSQL. Extracted features include BPM, key, energy, valence, spectral centroid, zero-crossing rate, MFCCs, chroma vectors, and beat frames. Five D3.js visualization hooks render the data directly in the browser: AnalysisRadar, AnalysisChroma, AnalysisBeats, AnalysisMFCC, and AnalysisSpectral. Analysis runs automatically after download completes or can be triggered manually per track.
DJ Deck
The DJ Deck is a browser-native two-deck mixer implemented as a Phoenix LiveComponent with instantaneous playback via a JS.dispatch + JS.push dual-path architecture. Each deck loads a downloaded track through the Web Audio API and exposes individual-stem channel controls. Features include AI cue detection (26+ cues per track), stem loop decks, crossfader with multiple curve modes, SMPTE/bar-beat transport, master sync, metronome, Chef AI set builder, virtual controller, and chromatic pads. A Spotify SDK toggle lets users audition tracks that have not yet been downloaded.
MIDI Integration
Hardware MIDI controller support built on the Midiex NIF library. Includes a MIDI Learn mode for binding physical controls to software actions, device management with automatic port scanning, and mapping persistence in PostgreSQL. Supports popular controllers (Pioneer DDJ, Akai MPC, Traktor Kontrol) with planned universal auto-detection.
DAW Preview
The DAW Preview component provides a lightweight multi-track editor view for tracks that have completed stem separation. Each stem appears as its own horizontal lane with per-lane gain control, mute, and solo. Stems are aligned on a shared timeline and play back in sync via the Web Audio API. The DAW is accessible from the dashboard via ?tab=daw and receives the active track context through LiveView assigns. This is a preview/editing surface, not a full offline DAW — it is designed for rapid stem review and rough arrangement.
AI Agents
The AI agent system provides music-intelligence capabilities powered by a multi-LLM routing layer. An Orchestrator agent dispatches tasks to six specialist agents: Track Analyst, Mix Engineer, Music Theory, Genre Classifier, Production Assistant, and Lyrics Analyzer. The routing layer supports multiple LLM providers (configurable in admin) with automatic fallback. Agents are invoked from a chat panel in the dashboard and respond with structured analysis, suggested stems, mix recommendations, and music theory observations about the loaded track.
Admin Portal
The Admin Portal is accessible to users with admin, super_admin, or platform_admin roles. It provides user management (list, search, role assignment), a six-tier role hierarchy (user → pro → enterprise → admin → super_admin → platform_admin), audit log review, LLM provider health monitoring, and system-level configuration. The admin panel uses Phoenix LiveView with server-side filtering and pagination. Role changes take effect on the target user’s next page load via session revalidation.
Platform Admin
Platform Admin is a restricted cross-tenant view available exclusively to users with the platform_admin role. It renders at /platform/library via CombinedLibraryLive and displays every track across all user accounts in a unified searchable table. This is intended for infrastructure-level oversight — debugging download failures, reviewing separation queue depth, and auditing storage usage — rather than day-to-day user activity.
Feature Matrix
| Feature | Status | Requires |
|---|---|---|
| Spotify Import Pipeline | Production | SPOTIFY_CLIENT_ID, SPOTIFY_CLIENT_SECRET, SpotDL |
| Stem Separation — Local | Production | Python 3.10+, Demucs, sufficient disk space |
| Stem Separation — Cloud (lalal.ai) | Production | LALALAI_API_KEY |
| Audio Analysis | Production | Python 3.10+, librosa |
| DJ Deck | Production | Downloaded track or Spotify SDK |
| MIDI Integration | Production | Midiex, connected MIDI controller |
| DAW Preview | Production | Completed stem separation |
| AI Agents | Production | LLM API key configured in admin |
| Admin Portal | Production | admin role or higher |
| Platform Admin | Production | platform_admin role |