Eltayeb Ahmed

PhD student at Oxford Uni. Ex: Google Research, FAIR. University of Khartoum and AIMS Rwanda Alumni.

[Eltayeb Ahmed @clockwk7]

Unlock the Hidden Diversity in Your Language Model.

In our new paper, Intent Factored Generation (IFG), we propose an inference time method to increase the diversity of generations from LLMs. IFG leads to improvements in searching for solutions to maths and code problems. (1/6)

[Uljad @uljadb99]

Unlock real diversity in your LLM! 🚀

LLM outputs can be boring and repetitive. Today, we release Intent Factored Generation (IFG) to:

- Sample conceptually diverse outputs💡
- Improve performance on math and code reasoning tasks🤔
- Get more engaging conversational agents 🤖

[British Open-ended Learning and Discovery Lab @bold_lab_ai]

Hello world :)
We are BOLD — the British Open-ended Learning and Discovery Lab!

BOLD is a new academic research lab fully focussed on paradigm breaking discoveries in fundamental AI. We work towards more efficient & open AI that is built around human needs and capabilities.

To pursue these breakthroughs, we pioneer new modes of collaboration in academia that are more focussed, resourced, agile, and collaborative. Rather than fragmenting resources, today we are sunsetting 5 of the UKs leading AI labs to join forces under our joined scientific vision.

Our vision is centered around three pillars:
⚡ Beyond backpropagation – questioning the foundations of the field.
🤝 Human-centric learning & discovery – treating humans as core to our algorithms
🤖 Embodied learning – fast learning and adapting methods that deal with the messy real world

BOLD is backed by @UKRI_News and @EPSRC with £30M – and this is just the beginning. We are urgently looking for partners and sponsors to 10x this.

👉 https://t.co/eFVFW31mqz

👉 https://t.co/Eoad4G18KL

@j_foerst, @CULLYAntoine, @tonizza82, @shimon8282, @tonizza82, Ani Calinescu & @_rockt

[Eltayeb Ahmed @clockwk7]

@doodlestein @bidiptas13

[Eltayeb Ahmed @clockwk7]

Ray? Hadoop? The infamous weBsCaLe MongoDB?

Sometimes all you need is the good old command line tool `xargs` with parallelism `-P > 1` to make your map-reduce go brrr.

[Andrej Karpathy @karpathy]

I don't know what labs are doing to these poor LLMs during RL but they are mortally terrified of exceptions, in any infinitesimally likely case. Exceptions are a normal part of life and healthy dev process. Sign my LLM welfare petition for improved rewards in cases of exceptions.

[finbarr @finbarrtimbers]

my goal in life is to join Anthropic, delete all try/except clauses from Claude’s training data, and then quit.

[Eltayeb Ahmed @clockwk7]

@nrehiew_ Reject the arXiv, put your technical report pdf on github.

[Eltayeb Ahmed @clockwk7]

@owainkenway This tweet is basically the only result for googling the 'ptxas' error I am getting 18 months later on a Grace Hopper Machine.

[Eltayeb Ahmed @clockwk7]

@jxmnop Legendary!

[Alex Goldie @AlexDGoldie]

🥳 It’s an honour to have been awarded the Outstanding Paper for Scientific Understanding in RL at RLC for our work, ‘How Should We Meta-Learn RL Algorithms?’

Thank you to the organisers @RL_Conference for putting on a great conference, and congratulations to the other winners!

[Vishishta @vishishtagoyal]

My LinkedIn account was permanently restricted without warning or explanation. 10+ years of professional connections, gone. As an Oxford MBA student actively job hunting, this is not just inconvenient- it’s crippling.
@LinkedInHelp -I’m begging for support.
Case: #250726-017259

[Eltayeb Ahmed @clockwk7]

This work was done with my amazing colleague Uljad @uljadb99, collaborators at the BBC @BBCRD, and my supervisor @j_foerst

[Eltayeb Ahmed @clockwk7]

Unlock the Hidden Diversity in Your Language Model.

In our new paper, Intent Factored Generation (IFG), we propose an inference time method to increase the diversity of generations from LLMs. IFG leads to improvements in searching for solutions to maths and code problems. (1/6)

[Uljad @uljadb99]

Unlock real diversity in your LLM! 🚀

LLM outputs can be boring and repetitive. Today, we release Intent Factored Generation (IFG) to:

- Sample conceptually diverse outputs💡
- Improve performance on math and code reasoning tasks🤔
- Get more engaging conversational agents 🤖

[Eltayeb Ahmed @clockwk7]

For further results in conversational and language modelling tasks take a look at the thread linked in the first tweet.

For further details here are some links.

🌐 Website: https://t.co/Ek5CwExK0a
💻 Code: https://t.co/lPt07PrO0y
📝 Paper: https://t.co/Hk9ND6TSQ3

[Eltayeb Ahmed @clockwk7]

@nikhilchandak29 The decrease is within the bounds of the error bars (95% CI) and hence it is not significant. Each point in computed from an independent seed so some variance is to be expected.

[Eltayeb Ahmed @clockwk7]

We also look at IFG on exploration on the MATH dataset, using a similar methodology and we find that IFG leads to an increase in pass@k. We then combine IFG with RLVF and we see that the improved diversity leads to better exploration and better final performance. (6/6)