Charlamagne: I feel like I heard more on this network about “is Kamala Harris Black” than I do about Trump being a fascist
Cooper: That’s bullshit
Charlamagne: That’s bullshit to say you don’t have those conversations
SALMONN: Towards Generic Hearing Abilities for Large Language Models
paper page: https://t.co/MiNJbu7pHl
Hearing is arguably an essential ability of artificial intelligence (AI) agents in the physical world, which refers to the perception and understanding of general auditory information consisting of at least three types of sounds: speech, audio events, and music. In this paper, we propose SALMONN, a speech audio language music open neural network, built by integrating a pre-trained text-based large language model (LLM) with speech and audio encoders into a single multimodal model. SALMONN enables the LLM to directly process and understand general audio inputs and achieve competitive performances on a number of speech and audio tasks used in training, such as automatic speech recognition and translation, auditory-information-based question answering, emotion recognition, speaker verification, and music and audio captioning etc. SALMONN also has a diverse set of emergent abilities unseen in the training, which includes but is not limited to speech translation to untrained languages, speech-based slot filling, spoken-query-based question answering, audio-based storytelling, and speech audio co-reasoning etc. The presence of the cross-modal emergent abilities is studied, and a novel few-shot activation tuning approach is proposed to activate such abilities of SALMONN. To our knowledge, SALMONN is the first model of its type and can be regarded as a step towards AI with generic hearing abilities.
@Cererean @ArmandDoma Also you should be introspective at why you’re so defensive about being told Europeans have been more violent than any other culture throughout history— i haven’t read guns, germs, and steel but does it seek to understand what confluence of factors made them this way?
@Cererean @ArmandDoma You’re completely ignoring what I’m saying. Eurocentrism is still well ingrained in how we view history and science and even the questions we ask presuppose Europeans must be superior— we need to be objective in even figuring out what to ask
@Cererean @ArmandDoma But the bigger issue is that the violent tendencies of Europeans are implicitly framed as being a “superiority” trait and the expansion over the world must have been a good goal for a culture to have
And I’ll repeat I don’t think Europeans are genetically prone to violence
@Cererean @ArmandDoma I don’t recall those groups sailing across the ocean to slaughter entire islands of people, or fire bombing entire cities, or dropping not one, but 2 nuclear bombs when their enemy was on the verge of surrender…
@ArmandDoma It could also be inferior genetics too
I would agree the evidence would indicate it’s probably environmental, but there’s never been any study why Europeans seem to be so intrinsically violent and genocidal, with a pervasive desire to expand their geographic domain
@Andercot This doesn’t look like flux pinning though based on the bounce
The other suspicious thing is the 2 magnets— pyrolitic graphene requires multiple magnets to so it can get trapped between the perturbations
If this is pinning they should be able to do it with 1 magnet
@paulg Tragic that he killed himself, but Jackson was basically right in everything she said— maybe a little harsh at worst
Some people struggle to deal with the truth, we can all be more considerate of this
@andrewmccalip If it’s (super)diamagnetic you should be able to put it near a paramagnetic substance like steel when it’s near the magnet and it attracts to the steel, then remove the permanent magnet and it falls away
@glen@gimjiun79102152 They have the biggest sample by far. Other labs would be lucky to figure out how to make them that big in 6 months
But definitely the race is on to see who can learn the most the fastest now