herakoi

A motion-sensing sonification experiment.
Created with 🧡 by @lucadimascolo and @micginolfi

[herakoi @herakoi_]

print('Hello Twitter, this is herakoi, a motion-sensing sonification experiment 🙂')

Wouldn't it be cool to hear images and colors?
Well, herakoi is here for this! you can "touch" images and hear the sound of their pixels 🤯

Want to know more? Here is a short 🧵

1/n

[herakoi @herakoi_]

Best compliment ever 🥹

[Margherita Giustini @marghez]

Playing with @herakoi_ is like seeing a pirarucú for the first time, it divides your life in a "before" and an "after".
I cannot recommend enough to type "pip install herakoi" in your terminal, people.

[herakoi @herakoi_]

here is a link to the pre-print
https://t.co/2oB20MO2wB

[herakoi @herakoi_]

yesterday, the #ICAD2023 proceeding on #edukoi – the educational version of @herakoi_ – was out on the @arxiv!

Led by Lucrezia Guiotto Nai Fovino, this project aims at exploring how sonification can be used for astronomy teaching and to foster students' interest in STEM

[Michele Ginolfi @micginolfi]

@herakoi_ risponde presente al Bright-Night 2023 "Notte europea delle ricercatrici e dei ricercatori". Vi aspettiamo a Firenze il 29 Settembre, dalle 17 alle 23, presso l'area espositiva di @UNI_FIRENZE - stand "Galassie in luce e musica"! info nel link
https://t.co/7OL5FFgjIw

[herakoi @herakoi_]

🥁✈️🇿🇦
😍

[dr thabs (sthabile.bsky.social) @sthabile_kolwa]

It would be wonderful to have you exhibit @herakoi_ at the IAU General Assembly next year in Cape Town!!

[herakoi @herakoi_]

😎😎

[Dr. Soheb Mandhai 💫 @TheAstroPhoenix]

It was fantastic to try out and play with herakoi. Will definitely be showing this off at parties and be the cool kid 😎

[herakoi @herakoi_]

What better way to celebrate the first sonic year of #herakoi than sonifying the @SciArtSessions at #EASkrakow2023?

Thank you all for the enthusiastic response, and for all the great inputs and discussion.

🪐👋🔊

[herakoi @herakoi_]

Future astronomers (hopefully 🙂) at #ScienzEstate @fisica_UNIFI @UNI_FIRENZE
learning about rotating galaxies using sound and #herakoi.
🎼🎵🥁🎷🎻

[herakoi @herakoi_]

#herakoi is getting famous. We even reached big stadiums. Here, Manchester United's fans showing their appreciation 🤯. Very proud of this 😜

[herakoi @herakoi_]

@apolitosb ...and ready to install herakoi :)

[herakoi @herakoi_]

The new #herakoi mode 'adaptive' tracks two fingers and allows you to better explore the image that you want to sonify, from its macro properties to very small details.

Here is the electronic sound of the Southern Ring Nebula, recently observed by #JWST NIRCam.

[herakoi @herakoi_]

It is amazing to see people enjoying #herakoi and finding it useful for educational, inclusivity, and accessibility purposes.
We're so proud of it, and we're having a lot of fun collecting feedback and ideas, as you can see from this photo :)
#AudibleUniverse2 @lorentzcenter

[Aishwarya Girdhar @AishGirdhar]

Have been enjoying @herakoi so much! #AudioUniverse2 inspired us to differentiate between spiral galaxies and elliptical galaxies. Some exciting conclusions emerged:
1.On using Pitch for mapping surface brightness instead of Volume, it was much easier to hear the differences.

[herakoi @herakoi_]

@kruksandor came to say hello during the #AudibleUniverse2 workshop at @lorentzcenter and he is now a great fan of #herakoi 🎼🎶🥁
Here Sandor plays a @NASAWebb image!

[☯Evil Jim O'Donnell @pekingspring]

Using both hands to play the JWST galaxies image like a theremin. Hand-tracking music generated by @herakoi_, photo by @kruksandor.

[herakoi @herakoi_]

We are attending the #AudibleUniverse2 workshop on sonification of data at @lorentzcenter to present #herakoi. People find it cooool! But also many ideas on how to make it more useful for visually impaired users. We filled a whole whiteboard with ideas :) :)

[herakoi @herakoi_]

Jonathan, a professional musician, plays a musical scale with herakoi, using the Keynote color palette as input image 😁
In addition to exploring the sound of your favourite images, with an ad-hoc input #herakoi becomes a music instrument 🎶🎵🎷🎸🥁

Like a virtual theremin 🤯

[herakoi @herakoi_]

*MIDI-drum roll please* 🥁
#herakoi is now on @pypi and pip-installable!

https://t.co/edxtZ4b5yT

[herakoi @herakoi_]

A big thank you to @CMHarrisonAstro, who gave us the chance to test the code in this event.
Also, the whole idea of #herakoi came to life after an inspiring talk on “Sonification and Sound Design for Research, Communication and Education of Astronomy” that Chris gave at @ESO

[herakoi @herakoi_]

This was the first time that herakoi was used in a big educational event, in the UK, at @GNM_Hancock
In the video, a little girl plays with #herakoi to explore different sounds coming from our pale blue dot and Mars, our red neighbor 🙂