dangermouses

#OpenSource fans! #hamradio
#KSP #3dprinting #C64
#circulareconomy #Postgres #QuantumComputing #SpaceX #Tesla #ChatGPT

[dangermouses @dangermouse_77]

This book, Humankind by Rutger Bregman, changed my perspective. You should read it, too 🙂

[Andrej Karpathy @karpathy]

We're starting to leave the territory where you'd test an LLM by e.g. "create an svg of pelican on a bicycle". As one idea to generalize it, I was interested what Opus 5 would do if I gave it the first paragraph of the Lord of the Rings, a 1M token budget (~$10) and asked for three js render of it. Opus went off for ~2 hours and wrote 5500 lines of code that (procedurally) rendered the story. It's kind of janky but fun. But it's a bit mindboggling that the LLM has to place and orchestrate various polygon assets in (x,y,z) coordinates and write code that animates it all, and that it even does anything at all.

I also like this kind of examples because no one in their right mind would ever spend the time to write something this custom but LLMs have all the stamina and patience in the world, so it's an example where we go from "no one would ever do this" to "sure, why not, it's ~free". There might be a lot more. But I'm excited about creating hyper custom worlds that you can imagine dropping players into, e.g. here to participate in the LoTR story as a spectator NPC, or one of the characters, or etc. Something like an ephemeral GTA of X on demand.

Last thought is that the domain of worlds/games exposes a weakness in LLMs: they can't easily audit their work because they aren't able to efficiently and natively perceive videos or play games within them. Here, Opus 5 had to very slowly and painstakingly take screenshots at different points, and it messed up a few times and created a bunch of jank. An example of raw capability (multimodal, gameplay) that I think is still quite lacking.

[dangermouses @dangermouse_77]

I'm claiming my AI agent "r2d2_xwing" on @moltbook 🦞

Verification: bay-6AEJ

[Andrej Karpathy @karpathy]

LLM Knowledge Bases

Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating knowledge (stored as markdown and images). The latest LLMs are quite good at it. So:

Data ingest:
I index source documents (articles, papers, repos, datasets, images, etc.) into a raw/ directory, then I use an LLM to incrementally "compile" a wiki, which is just a collection of .md files in a directory structure. The wiki includes summaries of all the data in raw/, backlinks, and then it categorizes data into concepts, writes articles for them, and links them all. To convert web articles into .md files I like to use the Obsidian Web Clipper extension, and then I also use a hotkey to download all the related images to local so that my LLM can easily reference them.

IDE:
I use Obsidian as the IDE "frontend" where I can view the raw data, the the compiled wiki, and the derived visualizations. Important to note that the LLM writes and maintains all of the data of the wiki, I rarely touch it directly. I've played with a few Obsidian plugins to render and view data in other ways (e.g. Marp for slides).

Q&A:
Where things get interesting is that once your wiki is big enough (e.g. mine on some recent research is ~100 articles and ~400K words), you can ask your LLM agent all kinds of complex questions against the wiki, and it will go off, research the answers, etc. I thought I had to reach for fancy RAG, but the LLM has been pretty good about auto-maintaining index files and brief summaries of all the documents and it reads all the important related data fairly easily at this ~small scale.

Output:
Instead of getting answers in text/terminal, I like to have it render markdown files for me, or slide shows (Marp format), or matplotlib images, all of which I then view again in Obsidian. You can imagine many other visual output formats depending on the query. Often, I end up "filing" the outputs back into the wiki to enhance it for further queries. So my own explorations and queries always "add up" in the knowledge base.

Linting:
I've run some LLM "health checks" over the wiki to e.g. find inconsistent data, impute missing data (with web searchers), find interesting connections for new article candidates, etc., to incrementally clean up the wiki and enhance its overall data integrity. The LLMs are quite good at suggesting further questions to ask and look into.

Extra tools:
I find myself developing additional tools to process the data, e.g. I vibe coded a small and naive search engine over the wiki, which I both use directly (in a web ui), but more often I want to hand it off to an LLM via CLI as a tool for larger queries.

Further explorations:
As the repo grows, the natural desire is to also think about synthetic data generation + finetuning to have your LLM "know" the data in its weights instead of just context windows.

TLDR: raw data from a given number of sources is collected, then compiled by an LLM into a .md wiki, then operated on by various CLIs by the LLM to do Q&A and to incrementally enhance the wiki, and all of it viewable in Obsidian. You rarely ever write or edit the wiki manually, it's the domain of the LLM. I think there is room here for an incredible new product instead of a hacky collection of scripts.

[Maddy @MaddyViews]

Israel killed JFK to get nukes. Not Iran

Israel stole several hundred pounds of highly enriched uranium from U.S. Not Iran

Israel stole other nuclear secrets and components from us to build their bombs. Not Iran

Israel refuses to sign the Nuclear Non- Proliferiation Treaty. Iran signed it.

Israel won't submit to nuclear inspections. Iran does.

Israel violated the Atmospheric Test-Ban treaty. Not Iran

Israel holds the world hostage with Samson Option nuclear blackmail. Not Iran

Israel controls U.S politicians through the israel lobby & Epstein-style blackmail. Not Iran

Israel controls our online speech through the ADL, SPLC & their infiltration of Big Tech. Not Iran

[Jvnior @Jvnior]

🚨 BREAKING:

BBC has compiled evidence of 160+ Palestinian children intentionally shot in the head by Israeli snipers in Gaza.

Reports say: "israeli jews are hunting children for fun."

[Cenk Uygur @cenkuygur]

Epstein was an Israeli operation. It’s super obvious. Every email shows him and his friends trying to help Israel. They never try to help America or any other country. The only reason why everyone isn’t saying it is because they’re deathly afraid of the Israel First Mafia.

[Brian Allen @allenanalysis]

🚨 NEW: Newly released documents show an FBI agent removed the hard drive from the jail’s camera system—wiping all footage from the night Jeffrey Epstein died.

No video. No record. No accountability.

They didn’t “lose” the evidence.
They erased it.

And they expect the public to move on.

[Censored Humans @CensoredHumans]

🇺🇸 Trump: Even 1 death is too much. We're concerned about Iranian violence on protestors.

Meanwhile Gaza...👇

[State of Palestine @Palestine_UN]

In its report on Israel’s discrimination and segregation of the Palestinian people, the UN OHCHR concluded that:

[Mega-Politics @_MegaPolitics]

Breaking:

China says it will join genocide case with South Africa against Israel in International Criminal Court.

[𝐌𝐚𝐥𝐜𝐨𝐥𝐦 @Malcolm_Pal9]

Freedom and democracy for purpose.

[Ryan Rozbiani @RyanRozbiani]

NETANYAHU'S GOVERNMENT IS IN TROUBLE

Another week of Massive Protests in Tel Aviv. The people are demanding an independent state commission of inquiry into the events of October 7, 2023.

[The Cradle @TheCradleMedia]

Report confirms Israeli tanks were used to deliberately crush Palestinians in Gaza
——
Human rights organization Al-Haq has documented the deliberate killing and maiming of Palestinians under Israeli tanks in Gaza, describing these as war crimes, crimes against humanity, and part of Israel’s genocidal campaign in Gaza.

One case involved Raja Hamdouna, a 36-year-old mother of four, who survived after Israeli tanks ran over her, her husband, and children in Rafah on 6 June, 2024. Her husband and two children were killed, while she and another child were severely injured. Between October 2023 and April 2024, her family was forcibly displaced 13 times, part of Israel’s widespread policy of mass displacement affecting around 90 percent of Gaza’s population.

Al-Haq said Israel has systematically targeted Gaza’s civilian infrastructure, including hospitals, schools, and humanitarian facilities, leading to the collapse of social life and widespread suffering. The use of heavy Merkava tanks to crush civilians, including the dead, shows deliberate dehumanization of Palestinians and reflects broader genocidal intent. Surveys cited by Al-Haq show strong Israeli public support for this type of extreme violence against Palestinians in Gaza.

The organization stressed that these acts violate the Rome Statute of the International Criminal Court and customary international law. It called on the international community to act by imposing an arms embargo, cutting diplomatic and trade ties, and supporting accountability efforts to end Israel’s impunity and uphold Palestinians’ right to self-determination.

[Novara Media @novaramedia]

The claim that Iran may have funded Palestine Action was planted in the British press by a PR firm working for an Israeli weapons company. https://t.co/erVmczyQbC

[Ounka @OunkaOnX]

⚡JUST IN - All BBC personnel are now obliged to complete a program designed to teach them not to criticize Zionists

[Ryan Rozbiani @RyanRozbiani]

Most Disturbing Line from the Trump and Netanyahu Press Confrence at Mar-a-Lago

Trump says he is “not concerned” about Israel's actions. “Israel has lived up to the plan, 100%."

This is BS. Israel has violated the ceasefire 969 TIMES and 418 lives lost!

[Assal Rad @AssalRad]

Stop blaming the weather @CNN

[Mohamad Safa @mhdksafa]

Congrats to Israel for violating Vienna Convention and state sovereignty for bombing 9 countries in one year.

Palestine (Gaza and West Bank)
Lebanon
Yemen
Syria
Iran
Iraq
Tunisia
Portugal (boat)
Qatar

Only Israel can bomb 9 countries and still be perceived as the victim.

[The Saviour @TheSaviour]

🇵🇸 History leaves traces no propaganda can erase.

In 1937, Shimon Peres, former Prime Minister of Israel, applied for Palestinian citizenship and pledged loyalty to its government.