Precious Oluwafemi Sani

AI Governance & Responsible AI | Security Engineer | Data & Analytics | Sponsorship Lead, Data Community Africa | Building trustworthy AI systems

[Precious Oluwafemi Sani @pfemis]

Just seeing this today. Curious to know if model cards were updated based on this 🤔

[Joel Becker @joel_bkr]

new @METR_Evals research note from @whitfill_parker, @cherylwoooo, nate rush, and me. (chiefly parker!)

we find that *half* of SWE-bench Verified solutions from Sonnet 3.5-to-4.5 generation AIs *which are graded as passing* are rejected by project maintainers.

[Precious Oluwafemi Sani @pfemis]

@Brii_toe_knee Congratulations 🎊

[Precious Oluwafemi Sani @pfemis]

@dillonplunkett @MATSprogram Fingers crossed on this. Following you in the meantime

[Precious Oluwafemi Sani @pfemis]

@andyw_ais Can you share some of them? If possible too, tips for getting into Astra especially for those who have tried and gotten rejected.

[Precious Oluwafemi Sani @pfemis]

@celestepoasts Would like to tailor interp towards low resource languages. Why guardrails might fail and what happens when they do

[Precious Oluwafemi Sani @pfemis]

@Badboy1B cqq

[Precious Oluwafemi Sani @pfemis]

Legit!!

[terminally onλine εngineer @tekbog]

people misunderstand what AI does
it accelerates everything
even incompetence

[Andy Wang @andyw_ais]

People who want to get into AI safety should do more than just apply to fellowships. Applications are pretty random and might not reflect your actual abilities. Instead, be agentic! There are many paths to success that require only a bit more proactivity than applications. (1/4)

[Precious Oluwafemi Sani @pfemis]

@andyw_ais Thank you @andyw_ais. This is the validation I needed and timely. I am currently working on extending 1 paper and was wondering if I was on the right path.

[Precious Oluwafemi Sani @pfemis]

Now this is it!

Who takes responsibility for AI failures or mistakes?

[Polymarket @Polymarket]

NEW: Pizza Hut franchisee sues for $100 million, claiming the company’s AI delivery system made deliveries up to 50% slower.

[Precious Oluwafemi Sani @pfemis]

We will be seeing many more instances like this. Organizations need to calibrate their risks before letting AI into the driver seat. AI safety is here to stay

[Polymarket @Polymarket]

JUST IN: Starbucks retires AI inventory tool across North America after it reportedly miscounted & mislabeled store items.

[Precious Oluwafemi Sani @pfemis]

@Microsoft released two open source tools to help Agentic AI Engineers to build agents safely. This is huge and will shape the AI security and safety landscape for the next few months

The tools are called RAMPART and Clarity.
https://t.co/Ebn4gVgOqr

[Precious Oluwafemi Sani @pfemis]

Bad actors can smuggle malicious instructions right at the point where the model's faithfulness starts to collapse. LLM-as-a-judge handles the evaluation.
Code is open source. Try it out. https://t.co/3yZK9WVsy8"

[Precious Oluwafemi Sani @pfemis]

Built an AI safety related project. So it has been found that LLMs degrade as context windows expand. It has been shown empirically so it is not just theory.
I built a tool to find the exact breaking point where local LLMs start hallucinating. You can run it on your local machine

[Precious Oluwafemi Sani @pfemis]

You can plug in your own models too.
Planning to expand it to more models and larger contexts when compute allows. There's also a red teaming angle here that I think is underexplored. As a model weakens at long contexts, that's a window for prompt injection attacks.

[Precious Oluwafemi Sani @pfemis]

You have a point but not at the current rate or with the very low barrier to entry we have now. People are legit vibe coding their way into effective attacks. Mini shai hulud is now open source and there are even monetary incentives ($1000 Monero) for successful breaches

[Justin Elze @HackingLZ]

For those of you just now paying attention to cybersecurity, large companies got hacked before AI.

Colonial Pipeline, SolarWinds, OPM, Kaseya, Aramco, Change Healthcare, Equifax, Target, Home Depot, TJX, etc

[Precious Oluwafemi Sani @pfemis]

@techspence And that is slowly fading away as attention span has been tanking recently

[Precious Oluwafemi Sani @pfemis]

@gozkybrain4u It was a supply chain attack. Same people behind most of the attacks since march. TeamPCP. They did Trivy, litellm, Mistral AI and Grafana. And GitHub most recently

[Precious Oluwafemi Sani @pfemis]

I guess the era of Security by obscurity is fading or has faded away. The barrier to entry has been removed by AI and threat actors can even vibe code their way into breaching your critical systems. Now can we all give cybersecurity the deserved budgets and attention it needs?

[Gabriel Odusanya @gabbytech01]

CyberSecurity is now getting the attention that has always been required of it 2026 really made a big impact in cyber security