Today Sergi Marsol presents preliminary results of the work he has done in recent months in @MKrallinger group at @BSC_CNS. He has worked on the development of the KeyCARE library for keyword extraction and categorization, great work!
Acabo de llegar de Islandia. Precioso. He visitado 4 glaciares. En todos, la misma historia: "en los 80 calculamos el ritmo de deshielo, y dijimos que el glaciar desaparecerá en el año x. Cada año, acortamos la predicción. Desaparecerán mucho antes, el proceso acelera". (Sigo)
LLaMA 2 released! 🚨🔔 @Meta just released LLaMa 2 the next iteration of LLaMA with a commercial-friendly license.🤯😍 LLaMA 2 comes in 3 different sizes, 7B, 13B, and 70B. The 7B & 13B use the same architecture as LLaMA 1 and are a 1-to-1 replacement for commercial use🔥
🧵1/4
📢Aguila-7B, a new open source transformer language model for Spanish, Catalan & English. Based on the Falcon-7B model, it has been trained on a 26B token trilingual corpus collected from available corpora.
🚀https://t.co/mkpfaye2Tj
@projecte_aina@SEDIAgob@tic@BSC_CNS@PLNnet
Rather than asking AI researchers how soon machines will become "smarter than people", perhaps we should be asking cognitive scientists, who actually know something about human intelligence?
📢New Spanish longformer model for general domain. Trained with data from the @BNE_biblioteca starting from the Spanish roberta base checkpoint as part of the @SEDIAgob's PlanTL
🚀https://t.co/iaq56Gdn8D
#NLProc@sepln@PLNnet@NLP_SINAI
What is possible in cognitive systems? Why not ants with large brains, amorphous cortical structures, technology in cephalopods or extended plant minds? Check the "Alternative Brains" site (my drawings) within the @cececebe exhibition BRAIN(S) https://t.co/7PGRXp9Yyo
🔥 Excited to share new research from @huggingface & @IntelAIResearch on few-shot learning with language models 🔥
We introduce SetFit - a simple, yet sample efficient approach based on Sentence Transformers 🤖
https://t.co/hT8Z7tHss1
A 🧵 on what it's all about ...
There has been an explosion of NLP research in prompting techniques for communicating tasks to language models.
But writing and sharing good prompts is awkward.
PromptSource is a tool that was developed as part of @BigscienceW to tackle this challenge.
🧵1/11
Exciting news 🎉
Document Question Answering is now a first class citizen in @huggingface transformers! With just 3 lines of code, you can process any document like so:
Next Wednesday 28, I will be teaching a class about Transformers in the Postgraduate Course in Artificial Intelligence with Deep Learning.
This is an open class, if you are interested and want to learn about this architecture, register here: https://t.co/KJrMss2cFO
Neural networks often pack many unrelated concepts into a single neuron – a puzzling phenomenon known as 'polysemanticity' which makes interpretability much more challenging. In our latest work, we build toy models where the origins of polysemanticity can be fully understood.
Diffusion models like #DALLE and #StableDiffusion are state of the art for image generation, yet our understanding of them is in its infancy. This thread introduces the basics of how diffusion models work, how we understand them, and why I think this understanding is broken.🧵