Aboubacar DIALLO

Research Scientist | Tech4Good | AI4Good

[Sebastian Raschka @rasbt]

I put together a new article on setting up local coding agents with open-weight models. Everything runs 100% locally.

I thought it might be useful putting this together because many people asked me about my setup in the past, and I thought it would also motivate people to get started tinkering with local models for serious work (yes, things got incredibly capable this year with better LLMs and better harnesses).

So, here's a walkthrough of how to connect a local LLM to a local coding harness (could be Claude Code or Codex, which you may already be familiar with).

I also included some assessment notes that are useful as a checklist to select between and consider certain LLMs over others:

- Checking RAM usage at long contexts to see if the model is suitable for real work
- Measuring prefill and decoding tok/sec to see whether it's fast enough to not be annoying
- Making sure the model has sufficient tool-calling capabilities in theory
- Assessing whether the model can solve some more challenging tasks when used in a coding harness.

Of course, there are always more specialized tools that can squeeze a bit more performance out of things, but I hope this is a good starter kit that stays flexible; that is you can easily switch to newer models as they are released or even tap into cloud models in your familiar harness if the current ones are not sufficient enough for a given task.

[Allan Pead 🇿🇦 #mvpbuzz @adpead]

Today is the day! Microsoft AI Tour Johannesburg! 🎉🎉

Going to be EPIC!!! 😎

Hope to see all the developers today! 😍

#MicrosoftAITour #MicrosoftAITourSouthAfrica #MicrosoftAI #AITourJHB #ai .NET Developers @MicrosoftSA #community #mvpbuzz

[Aboubacar DIALLO @abcdiallo]

🎉 Heureux de contribuer à cette étude : « Faisabilité et acceptabilité d’un outil numérique pour soutenir le dépistage communautaire du COVID-19 et d’autres affections médicales prioritaires dans les communautés rurales et périurbaines en Guinée ». https://t.co/1Fw0tPmQId

[OpenFn @openfn]

🎉 Our team has been hard at work, and we're excited to share our new video! Dive into the future of workflow automation. Join OpenFn at https://t.co/PuzjdBQyfl to start your digital transformation journey today!
#workflowautomation #dataintegration #interoperability #opensource

[Aboubacar DIALLO @abcdiallo]

Cette semaine, en tant que GPSDD Data Research Fellow, j'ai assisté à la conférence « Drones, IA et SIG » à Cape Town avec SAFL, WeRobotics et Esri SA. La tech n’est plus un frein, mais l’engagement politique et des cadres clairs sont essentiels.#DisasterManagement #Geospatial

[Aboubacar DIALLO @abcdiallo]

Attending to GPSDrones, AI and GIS in Disaster Management Conference and Workshop.

[Aboubacar DIALLO @abcdiallo]

@eliaswalyba Since 2012 doing ICT for development. Impacting projects.

[Aboubacar DIALLO @abcdiallo]

AWS Summit Johannesburg 2024

[Aboubacar DIALLO @abcdiallo]

@walyfirst Tu veux nous faire peur Moussa 😉

[Aboubacar DIALLO @abcdiallo]

@eliaswalyba Oh sorry for your loss. Paix a leurs âmes amine.

[Aboubacar DIALLO @abcdiallo]

@eliaswalyba Bon séjour. Ping me in case you pass by Joburg 😉

[Milos Vukadinovic @milos_ai]

KAN: Kolmogorov–Arnold Networks is a really elegant paper. It's refreshing to see that things worked by design rather than by accident in ML. I made a small KAN experiment comparing it to MLP and spline fitting. (notebook in comments!)

[Aboubacar DIALLO @abcdiallo]

Bioinformatics skills-up journey. Fascinating world, but a bit tricky as a computer scientist by background with just a sprinkle of biology knowledge.
https://t.co/IEYBVxPz12 via @DataCamp

[Aboubacar DIALLO @abcdiallo]

I just completed Introduction to Bioconductor in R by DataCamp #Bioinformatics #Genomics #Bioconductor #R https://t.co/UWQLyKTjMj via @DataCamp

[Aboubacar DIALLO @abcdiallo]

DATA AND AI COMMUNITY DAY JOBURG

[Aboubacar DIALLO @abcdiallo]

@schumacherbj 😂😂

[DataCamp @DataCamp]

How to choose the right model for a new LLM-based application or project. 👇

Dive into the diverse array of available models, uncovering the key capabilities to consider when choosing the right model for your project.

👉 https://t.co/eeL5EkMZFO

[Aboubacar DIALLO @abcdiallo]

@diallotafsir52 Profite bien, surtout don't forget up-skills time to time.

[Aboubacar DIALLO @abcdiallo]

I just completed Developing Large Language Models by DataCamp https://t.co/9ricGP61Ir via @DataCamp

[Aboubacar DIALLO @abcdiallo]

@fmbangoura7 Ah ok, c'est récent ça 😉. Quand nous étions au primaire, on arrêtait les cours pour la nage. Je connais par cœur tous ces marigots. Triste de les voir ainsi, les conséquences de l'exploitation anarchique des mines.