Andrew Budker

Engineering Leader GenAI @ Meta

[Andrew Budker @abudker]

@avimakesrobots Hell yes!

[Andrej Karpathy @karpathy]

+1 for "context engineering" over "prompt engineering".

People associate prompts with short task descriptions you'd give an LLM in your day-to-day use. When in every industrial-strength LLM app, context engineering is the delicate art and science of filling the context window with just the right information for the next step. Science because doing this right involves task descriptions and explanations, few shot examples, RAG, related (possibly multimodal) data, tools, state and history, compacting... Too little or of the wrong form and the LLM doesn't have the right context for optimal performance. Too much or too irrelevant and the LLM costs might go up and performance might come down. Doing this well is highly non-trivial. And art because of the guiding intuition around LLM psychology of people spirits.

On top of context engineering itself, an LLM app has to:
- break up problems just right into control flows
- pack the context windows just right
- dispatch calls to LLMs of the right kind and capability
- handle generation-verification UIUX flows
- a lot more - guardrails, security, evals, parallelism, prefetching, ...

So context engineering is just one small piece of an emerging thick layer of non-trivial software that coordinates individual LLM calls (and a lot more) into full LLM apps. The term "ChatGPT wrapper" is tired and really, really wrong.

[Alex Graveley @alexgraveley]

Future organizations are probably like an elaborate self-improving ETL pipeline. Where input is every piece of data both internal and external, transforms are created/optimized by AI, and outputs fed back in.

[Jack Morris @jxmnop]

https://t.co/5wmGKHRxDv

[Raph. H. @Rapahelz]

@Carnage4Life Behaviors that are rewarded in the zoo are suicidal in the jungle.

[Nick St. Pierre @nickfloats]

I am genuinely blown away by the prompt coherence of Midjourney v6.

This is an insanely detailed prompt with 8 specific color assignments, and it's absolutely nailing it.

If you run the same prompt in --v 5.2 it won't even come close.

--v 6 is seriously incredible ✨

💬 35mm film still, two-shot of a 50 year old black man with a grey beard wearing a brown jacket and red scarf standing next to a 20 year old white woman wearing a navy blue and cream houndstooth coat and black knit beanie. They are walking down the middle of the street at midnight, illuminated by the soft orange glow of the street lights --ar 7:5 --style raw --v 6.0

[Bilawal Sidhu @bilawalsidhu]

Venice beach graffiti just hits different. Especially as a 3D gaussian splat. 🏝️

[Justine Moore @venturetwins]

God-tier prompt injection: using the knowledge cutoff date against ChatGPT

[Andrew Budker @abudker]

@ray4tesla Aluminum doors dent easily

[Andrew Budker @abudker]

@nicksoman Juvenile delinquency 🙋‍♂️

[Andrew Budker @abudker]

chatGPT absolutely nailed the Amazon un-leadership principles

[Andrew Budker @abudker]

@RedAlurk you rock. Have you considered doing a 1 star review of “free trip” time share scams. Would be an epic episode.

[Andrew Budker @abudker]

Hand tracking on Oculus has come such a long way in the last few years. Really proud of the team :)

[Reality Labs at Meta @RealityLabs]

Introducing ‘First Hand,’ Our Official Hand Tracking Demo Built With Presence Platform’s Interaction SDK https://t.co/cvNF4eKnsi

[Andrew Budker @abudker]

@twjpdx23 We were wondering the same thing

[Andrew Budker @abudker]

@DennysKuhnert Looking great. Nice work @DennysKuhnert!

[Andrew Budker @abudker]

@DrMaxPalmer @DennysKuhnert If you are interested in contributing directly in this space, DM me.

[Andrew Budker @abudker]

@experimatt https://t.co/Em7dznlcD8

[Andrew Budker @abudker]

Im shocked no states have been called for Kanye yet.

[Andrew Budker @abudker]

@experimatt Congratulations!

[Andrew Budker @abudker]

@ALEX37V ?