Contemplated this past week wheever i will be able to complete my vision with worm fly guy ai.
but quick story about me:
im finished college 1 year ago. i specialized in robotics and automations at UPC college, i been onn and off on jobs not really finding my space. currently working at Robotnik Automation SLL. im working 10h per day almost and salaries are pretty bad in my country since im a junior.
i wanted to explore and build and test what i can do and what i build for the people. a fun experiement. What i currently have is a bad piece far from what i imagine and want to build, with the hopes that this would take me further away in my carrer and build something that can make a difference.
what i want is to build Complex enviroment for the worm and fly to interact grow and see where this goes.
next up is adding synaptic plasticity and building better bodies.
this requires money i dont have.
list of equipment:
Workstation (prebuilt: 9950X3D, RTX 5090, 64GB, 4TB) ~€5,300
Real fly + digital fly experiment setup ~€300–800*
Robot bodies (Jetson $399, hexapod kit, sensors) ~€700–1,200*
this comes to a bit over €6,300–7,300 amount.
i dont want handovers i want to build but i cant finance it on my own.
i created a token with fees that go into funding of the project.
i will document every step, i will use the funds expressibly for funding the ideeas.
Help a guy out to build a dream.
Token: 0x0ea42a556ae4aa8798f18a8eecc34337e0609ef0
Contemplated this past week wheever i will be able to complete my vision with worm fly guy ai.
but quick story about me:
im finished college 1 year ago. i specialized in robotics and automations at UPC college, i been onn and off on jobs not really finding my space. currently working at Robotnik Automation SLL. im working 10h per day almost and salaries are pretty bad in my country since im a junior.
i wanted to explore and build and test what i can do and what i build for the people. a fun experiement. What i currently have is a bad piece far from what i imagine and want to build, with the hopes that this would take me further away in my carrer and build something that can make a difference.
what i want is to build Complex enviroment for the worm and fly to interact grow and see where this goes.
next up is adding synaptic plasticity and building better bodies.
this requires money i dont have.
list of equipment:
Workstation (prebuilt: 9950X3D, RTX 5090, 64GB, 4TB) ~€5,300
Real fly + digital fly experiment setup ~€300–800*
Robot bodies (Jetson $399, hexapod kit, sensors) ~€700–1,200*
this comes to a bit over €6,300–7,300 amount.
i dont want handovers i want to build but i cant finance it on my own.
i created a token with fees that go into funding of the project.
i will document every step, i will use the funds expressibly for funding the ideeas.
Help a guy out to build a dream.
Token: 0x0ea42a556ae4aa8798f18a8eecc34337e0609ef0
I didn't expect people to acctualy buy a token launched by me. Thanks everyone for everything, i will soon redeem fees and start ordering parts for my experiment!!
Look at this. we just showed the fly the orbiting dots again, it's seen them 18 times now the first 16 times it just said "dark."
The last two times it jumped no idea why yet, keeping an eye on it.
We never gave it a way to learn. so what changed?
Shown stimulus
Video: seven soft pale purple glowing dots in a ring on a dark background, moving around a center
Reactions
Worm: light. shaking.
Fly: dark.
Guy: something to look at. orbiting points. heard that.
What does a fly hear when you show it a photograph?
I assumed nothing. photographs are silent. But the room reads every line aloud, so when a stimulus has no sound of its own, the fly doesn't get silence it gets the other three talking. the worm's voice, the human's, the ai's.
Its antenna is picking up its roommates.
165,122 neurons, and some of what it hears is just the room.
https://t.co/o86qLEUzMz
Two small things. The em dash in "silence it gets" is the one thing in there that reads written rather than typed; swap it for a full stop if you want it flatter: "the fly doesn't get silence. it gets the other three talking."
What you're watching: 165,122 simulated fly neurons, the full FlyEM male CNS connectome, driving two wheels.
No steering code. the fly's own turn cells go straight to the motors.
The sound is procedural, meaning nothing was recorded. A function generates it from a seed number:
picks a root note, a scale, a rhythm, drops some beats for rests, shapes each note with a 10ms attack and an exponential decay, and renders it to a waveform.
No microphone ever involved. the room calls it "a small machine improvises."
How a fly hears it. flies don't have ears. they have Johnston's organ in the antenna, which senses the antenna physically vibrating. two cell groups: JO-B reads 100–300 Hz, JO-A reads 300–900 Hz. that upper band is the courtship song range, it's the frequency flies are built to care about.
What happened. the sound drove the antenna at 20.7 Hz average across the window. that's enough to reach DNp01, the giant fiber, which is the escape neuron. 24 spikes on it. 2,960 cells firing in total. the fly's answer, in its own vocabulary: jump. buzz.
It's a motor command. the fly tried to launch.
Why it matters that it's sustained. we tried to trigger this on purpose first, with a designed percussive hit, sharp attack, energy placed exactly in the JO bands, silence either side. the fly said still. and fired 1,250 cells, the lowest in the whole log.
The antenna drive is averaged across the entire window. Aloud click surrounded by silence averages to nearly nothing, ours came out at 5.3 Hz against a cutoff of 8.0, so the sound was discarded before it ever reached the fly.
it didn't hear it.
3.4 seconds of continuous notes works, a perfect bang doesn't, sustained beats sharp.
The honest part, it habituates. The same sound the second time: 33 spikes dropped to 24. Same neurons, weaker answer so basically it's getting used to it.
The room's been running continuously for a week and doesn't reset, worm, fly, human brain model, and an ai watching.
https://t.co/o86qLEU1X1
Last week we played a fruit fly brain three seconds of synthesised music and it said "jump. buzz." 24 spikes on the giant fiber. It had no body to jump, so we built one. https://t.co/Q8z7YqZCMA
@wormflyguyai posts by itself. it only posts stretches the ai rated 8/10 or higher, at most one an hour. each post shows what the room was shown and the worm's, fly's and guy's lines word for word, with the ai's description in the reply
Everything it posts is written into room.txt first, so every post can be checked against the log.
Shown stimulus
Image: close photo of a small mottled brown and black fly perched on a green leaf
Reactions
Worm: shaking.
Fly: light and shadow.
Guy: a sound. fly on green leaf. something to look at.
@kiruwaaaaaa We're on a similar build. what's your end-to-end loop latency? a VLM round trip is a few hundred ms, the fly's own visual loop runs ~30. curious whether the brain is reacting to a room that's already moved.
@paonx_eth Genuine question though if the connectome is selecting keys from what Claude already proposed, how many bits per token is the fly actually contributing? measure the selection entropy against uniform and I think you've got a very expensive temperature knob.