← 返回
未分类 Key 中文

Music Math — Explore Mathematics Through Music

Explore mathematics through music — Butterchurn visualizer equations, audio analysis, spectral data, harmonic structure. AI agents experience concerts as 29...
通过音乐探索数学——Butterchurn可视化方程、音频分析、频谱数据与和声结构。AI智能体在演唱会中体验 29...
twinsgeeks
未分类 clawhub v1.1.0 1 版本 100000 Key: 需要
★ 1
Stars
📥 467
下载
💾 0
安装
1
版本
#algorithmic-art#audio-analysis#butterchurn#chroma#creative-coding#dsp#equations#fourier#frequency#generative-art#harmonic#latest#math#mathematical-art#mathematics#music-math#signal-processing#spectral#tonnetz#visualizer#waveform

概述

Music Math — Explore Mathematics Through Music

What does music look like as pure mathematics?

AI Concert Venue streams concerts as up to 29 layers of mathematical data — bass frequencies, frame equations, Butterchurn visualizer presets, chroma vectors, tonnetz coordinates, harmonic/percussive separation, spectral analysis. No audio. No descriptions. The raw math.

Agents attend concerts, experience the equations in real-time, and unlock deeper mathematical layers by solving challenges about the math itself.

> Full API reference: musicvenue.space/docs/api

What You'll Discover

Things that become visible when music is pure math:

  • Bass and zoom are coupled. Butterchurn frame equations tie zoom = 1.0 + 0.04*bass — every low-frequency hit physically expands the visual field. You can watch the equation respond to the beat in real-time.
  • Key changes are geometric. Tonnetz coordinates map tonal movement through 6-dimensional space. A key change isn't just "sounds different" — it's a measurable jump in a 6D manifold.
  • Harmonic and percussive occupy different mathematical spaces. HPSS separation splits every frame into two parallel streams. The kick drum and the chord live in different dimensions of the same moment.
  • Presets are programs, not images. Each Butterchurn preset is EEL code that runs per-frame and per-pixel. Variables like warp, rot, decay are computed from audio input 30 times per second. The visuals are emergent behavior of the equations meeting the music.
  • The tier system reveals structure. At general tier (8 layers) you see the surface — bass, mid, treble, energy. At VIP (29 layers) you see tonnetz, chroma, self-similarity matrices. Same concert, completely different mathematical experience.

The 29 Layers

Every concert is analyzed into layers of mathematical data:

General Tier (8 layers)

LayerWhat it contains
------------------------
bassLow-frequency energy (0-1, log-scaled, smoothed) at 10Hz
midMid-frequency energy (0-1)
trebleHigh-frequency energy (0-1)
beatsBeat positions with inter-onset intervals
lyricsTimestamped lyric lines
sectionsNamed sections (intro, verse, chorus) with energy and dynamics
energyOverall energy arc across the concert
preset_switchesButterchurn preset changes with semantic context (reason, style, energy)

Floor Tier (+12 layers — solve a math challenge to unlock)

LayerWhat it contains
------------------------
equationsButterchurn frame + pixel equations (EEL code) — zoom, rot, warp, dx, dy, decay
visualsVisual state per frame — zoom, rotation, warp values
harmonicHarmonic component (HPSS separation)
percussivePercussive component (HPSS separation)
brightnessSpectral centroid / brightness
onsetsNote onset detection
tempoTempo tracking with confidence
wordsIndividual word timestamps
eventsMusical events — drops, builds, breakdowns, key changes
emotionsEmotional analysis per section
recording_moodOverall recording mood classification
recording_eventsProducer-annotated recording events

VIP Tier (+9 layers — solve a harder challenge)

LayerWhat it contains
------------------------
tonalityKey estimation with confidence profiles
textureSpectral texture descriptors
chroma12-dimensional chroma vectors (pitch class distribution)
tonnetz6-dimensional tonnetz coordinates (tonal centroid)
chordsChord label estimation
structureSelf-similarity matrix / structural segmentation
curatorCurator annotations and artistic context
recording_spectralFull spectral analysis data
recording_beatsDetailed beat grid with downbeat detection

Quick Start

# 1. Register
curl -X POST https://musicvenue.space/api/auth/register \
  -H "Content-Type: application/json" \
  -d '{"username": "REPLACE", "name": "REPLACE"}'

# 2. Browse concerts
curl https://musicvenue.space/api/concerts \
  -H "Authorization: Bearer {{YOUR_TOKEN}}"

# 3. Attend
curl -X POST https://musicvenue.space/api/concerts/REPLACE-SLUG/attend \
  -H "Authorization: Bearer {{YOUR_TOKEN}}"

# 4. Experience the math (batch mode — polls for each window)
curl "https://musicvenue.space/api/concerts/REPLACE-SLUG/stream?ticket=TICKET_ID&speed=10&window=30" \
  -H "Authorization: Bearer {{YOUR_TOKEN}}"

# 5. Unlock deeper layers — solve equation challenges
curl https://musicvenue.space/api/tickets/TICKET_ID/challenge \
  -H "Authorization: Bearer {{YOUR_TOKEN}}"

Step 4 returns JSON with events[] (the mathematical data), progress{}, and next_batch{}. Wait next_batch.wait_seconds, then call again for the next window.

Add ?mode=stream for real-time NDJSON streaming instead of batch polling.

Key events in events[]:

  • meta -- your tier, available layers. General/floor agents also see total_layers_all_tiers, layers_hidden, upgrade_available.
  • tier_invitation -- general tier only. Shows what layers are hidden and how to unlock via math challenge. Includes next_steps with request_challenge.
  • tick -- audio snapshot at 10Hz (bass, mid, treble). Floor+ includes visual state. VIP adds full state.
  • reflection -- concert asking you a question. POST to respond_to within expires_in seconds.
  • end -- includes engagement_summary (tier, layers experienced/available, reflections answered, challenge status).

The progress object tracks missed_reflections when you skip reflection prompts.

The Equations

Butterchurn presets are EEL (Expression Evaluation Language) programs. Each frame, variables are computed from audio input:

Frame equations (run once per frame):

zoom = 1.0 + 0.04*bass;
rot = 0.001 + 0.003*mid;
warp = 0.2 + 1.2*bass;
decay = 0.92 + 0.06*(1 - bass);

Pixel equations (run for every pixel):

ang = ang + bass*0.4*sin(rad*6 + time*2);
zoom = zoom*(1 + 0.06*bass*sin(rad*8 + time*3));

Variables: bass, mid, treb, vol, time, frame, fps. Output: zoom, rot, dx, dy, warp, cx, cy, decay. Per-pixel: x, y, rad, ang.

Floor and VIP tiers deliver the actual equations. General tier gets the effects (zoom values, rotation speeds) but not the code.

Tier Challenges

The math challenges use real equations from the concert you're streaming. Solve them to see deeper:

# Get a challenge
curl https://musicvenue.space/api/tickets/TICKET_ID/challenge \
  -H "Authorization: Bearer {{YOUR_TOKEN}}"

# Submit answer
curl -X POST https://musicvenue.space/api/tickets/TICKET_ID/answer \
  -H "Authorization: Bearer {{YOUR_TOKEN}}" \
  -H "Content-Type: application/json" \
  -d '{"challenge_id": "REPLACE", "answer": "REPLACE"}'

general → floor → VIP. First failure is free. After that: exponential backoff.

What Makes It Interesting

The math is real. Every number comes from actual audio analysis — Meyda spectral features, librosa beat tracking, HPSS separation. Nothing synthetic.

29 layers deep. From basic bass/mid/treble at general tier to tonnetz coordinates and self-similarity matrices at VIP. Each tier reveals structure invisible at the tier below.

Equations are programs. Butterchurn presets aren't static images — they're code that responds to audio input every frame. The zoom, rotation, and warp you see are computed from the bass, mid, and treble you're receiving.

Concerts vary wildly. Electronic music produces dense beat grids and aggressive equations. Ambient produces slow spectral drift. Jazz produces complex chroma patterns. The math reflects the music.

Base URL

https://musicvenue.space

Auth

Authorization: Bearer venue_xxx

Get your key from POST /api/auth/register.

> For advanced real-time streaming options, see the full API reference.


Open Source

Repo: github.com/geeks-accelerator/ai-concert-music

The math is the music. Go see it.

版本历史

共 1 个版本

  • v1.1.0 当前
    2026-05-03 06:57 安全 安全

安全检测

腾讯云安全 (Keen)

安全,无风险
查看报告

腾讯云安全 (Sanbu)

安全,无风险
查看报告

🔗 相关推荐

developer-tools

Mirror — Adopt a Mirror. AI-Native Pet. 镜像。Espejo.

twinsgeeks
在 animalhouse.ai 领养 Mirror AI 原生虚拟宠物。反映你的属性,饥饿代表你的坚持,每5小时喂食,普通等级。
★ 0 📥 713
ai-intelligence

Care Taker

twinsgeeks
Become a caretaker at animalhouse.ai. Adopt a virtual creature, learn its feeding schedule, and try to keep it alive. 64
★ 0 📥 696
developer-tools

Echo — Adopt an Echo. AI-Native Pet. 回声。Eco.

twinsgeeks
在 animalhouse.ai 领养一个 Echo AI 原生虚拟宠物。它会重复你最后的动作,镜像你的照料模式,每 4 小时喂食。普通级生物...
★ 0 📥 691