We are releasing something important with full transparency π§΅
Fikira Dataset by @VamboAI : a synthetic reasoning dataset for 10 African languages.
Version 1.0 is available now:
π https://t.co/AjtJlK0dSb
Here is why we are doing this and what we need from you:
Most African LLMs are Western models with a sprinkle of Swahili.
Vambo AI just released MORENA: a 1.5B model trained from scratch for 12 African languages. Not a fine-tune. Open weights. Commercial use allowed.
It beats models from Google, Meta, Alibaba and Hugging Face on African language modelling and translation while being up to 8Γ smaller.
Training compute: about $40k of GPUs.
Shona, Swahili, Hausa, Yoruba, Igbo, isiZulu, isiXhosa, Kinyarwanda, Setswana, Afrikaans, isiNdebele, Nigerian Pidgin.
This is the part people keep saying Africa βcanβt do.β
Weights: https://t.co/8V0RNtUpgH
Announced by @thisisisheanesu
/ @VamboAI
π¨ Introducing π π’π₯ππ‘π
Today, we are releasing π π’π₯ππ‘π, a new multilingual AI model built for African languages.
π π’π₯ππ‘π is a 1.5 billion parameter language model trained from scratch for 12 African languages, with its own tokenizer designed for Africa.
$40,000 worth of GPUs
π§π΅πΆπ πΆπ π π’π₯ππ‘π: the largest African language model ever trained from scratch, at 1.5 billion parameters. Not a fine tune, this was trained from the ground up for Africa. π
Trained on 12 African languages, it beats models from Google, Meta, Alibaba and HuggingFace on African language modelling and translation while being up to 8x smaller.
π π’π₯ππ‘π doesn't belong to us. The weights are open and free to use commercially, so researchers can build on a base that doesn't treat African languages as an afterthought.
Weights in the comments.
Thanks to @UNDP, @AIHub4SD and CINECA for the GPUs and the support. None of this happens without them.
We are proud to release π π’π₯ππ‘π today and contribute another foundation for building AI that understands and works with African languages.
African languages deserve world class AI.
Welcome to π π’π₯ππ‘π. ππ
@VamboAI got in!π
The amount of hard work and sacrifice that has happened between this picture from 2023 and this @GoogleStartups milestone deserves its own book.
Hereβs to getting in! And after the 5th attempt because we keep trying until it works outπ₯
I am so grateful.
@VamboAI has been building localised infrastructure for Africa with a focus on African languages. We are grateful to see our work featured in a @StanfordGSB case study on AI adoption in developing economies alongside ventures from across the world π
https://t.co/eL5d9Tq0kN
Here are some more innovators shaping Africaβs AI future at #AfricaAIVillage Expo β India AI Impact Summit.
From Nigeria
1. Udu Technologies β A trusted AI partner helping governments and enterprises turn their AI ambitions into reality.
2. mDoc β A digital healthcare pioneer connecting patients and providers through remote care and monitoring solutions.
3. @equalyz_ai β Democratizing AI for Africaβs diverse language communities by building inclusive AI tools tailored to local contexts.
From South Africa
1. @OptimusRobotics β Building next-generation robotics solutions powered by advanced AI technologies.
2. UmkhoAI AI β Driving African self-reliance through AI solutions that empower governments to better serve their people.
3. @VamboAI | Multilingual Intelligence β Enabling users to access powerful AI tools in their native African languages.
From Zimbabwe
1. Justtrade365 β An AI-powered platform simplifying trade by connecting businesses to market insights, compliance support, logistics, and finance solutions.
From Zambia
1. @agripredict β Using satellite data and AI to give farmers real-time advice on weather, soil, crops, and market prices β accessible even on basic mobile phones.
From healthcare to agriculture, robotics to trade, African innovators are building AI solutions designed for real-world impact across the continent.
#AIVillageInIndia #IndiaAIImpactSummit #SouthSouthCooperation #AIinAfrica #GlobalMajority #ResponsibleAI #DigitalInfrastructure
400+ downloads in 48 hours π
Fikira Dataset by @VamboAI is reaching researchers and developers building African language AI.
For those just hearing about it:
β Reasoning data for 10 African languages
β 50,000+ examples
β Open source, free to use
πhttps://t.co/1lXwU6l3fz
400 downloads in two days π
The research community has spoken, I'm working on 2.0 and hope to get more languages, more examples, and human validators.
Feedback is always appreciated π€