Where the work happens
0G's mainnet has twenty-two inference providers. Nineteen serve chat models, one serves Whisper, one images, one video. None of them synthesises speech or music. So 0G is the entire brain — it writes the words, the tune and the dance — and only the vocal cords are local.
On 0G
- Hearing a spoken request —
whisper-large-v3 - Writing the lyrics —
glm-5.2 - Composing the melody, syllable by syllable
- Writing the chords and the choreography
On the robot
- Turning notes into a singing voice
- Bass, harmony and the beat
- Dancing on the beat grid
- Everything, when the network is gone
How it works
-
1
You ask
Type it on the web page, or bend one of the robot's antennas and speak. The antennas are motors, so their position doubles as a push-to-talk button — cheaper than a wake word, and a television in the background cannot set it off.
-
2
0G writes a score
One request, one whole song: a pitch and a length for every syllable, plus a chord track and a list of dance moves with the beat each one starts on. Notation crosses the network, not audio.
-
3
The robot learns to sing it
A synthesiser puts a falling intonation on an isolated word, so a syllable arrives sliding downward, most of an octave below the same voice reading a sentence. Aya tracks that pitch contour frame by frame and reads the syllable back at a varying speed, landing it flat on the note. Measured across a melody: 23 cents of error, where a semitone is 100.
-
4
It performs
Bass, chords and a beat pulse go under the voice, and the robot dances. Playback and choreography share one clock, so the head is still landing on the beat at the end of a long song.
Whose song is it
Aya will not reproduce the lyrics of a copyrighted song. Ask for one by name, or for a particular artist, and it writes an original song in that artist's idiom — and says so out loud before singing.
"Here is an original song in the style of Burna Boy, written just now."
Traditional and public-domain songs are sung faithfully. Your own lyrics are set exactly as you wrote them.
Running it
pip install -e .
npm install -g @0glabs/0g-serving-broker
0g-compute-cli login
aya # then open http://localhost:8042
Aya starts the 0G signing proxy itself, so the app never handles your private key. With no network at all it still sings — it knows Twinkle Twinkle and Row Your Boat by heart, and an unfunded provider degrades into one of those rather than into silence.