๐จ Microsoft just quietly dropped a tool that turns ANY document into LLM-ready data in seconds.
It's called MarkItDown, a lightweight Python library that converts PDFs, Word, Excel, PowerPoint, images, audio, and YouTube URLs into clean Markdown your LLM can actually use.
No custom parsers. No brittle pipelines. No preprocessing hell.
Built by the AutoGen team and battle-tested across 87K GitHub stars.
The numbers don't lie:
โ pip install markitdown and you're converting files in under 60 seconds
โ 10+ file formats supported out of the box
โ Native MCP server for direct Claude Desktop integration
And it works everywhere:
โ Command line: markitdown file.pdf > doc .md
โ Python API: 3 lines of code
โ Docker
โ Azure Document Intelligence for enterprise OCR
100% Opensource. MIT license.
This is the document preprocessing tool your RAG pipeline has been waiting for LLM-ready output without the LLM-ready headache.
Link in the first comment ๐
Flood Warning Extended โ Kelani River ๐จ
The flood warning is now extended for another 48 hours.
Residents in affected areas are urged to stay alert and take safety measures.
A number of people are talking about implications of AI to schools. I spoke about some of my thoughts to a school board earlier, some highlights:
1. You will never be able to detect the use of AI in homework. Full stop. All "detectors" of AI imo don't really work, can be defeated in various ways, and are in principle doomed to fail. You have to assume that any work done outside classroom has used AI.
2. Therefore, the majority of grading has to shift to in-class work (instead of at-home assignments), in settings where teachers can physically monitor students. The students remain motivated to learn how to solve problems without AI because they know they will be evaluated without it in class later.
3. We want students to be able to use AI, it is here to stay and it is extremely powerful, but we also don't want students to be naked in the world without it. Using the calculator as an example of a historically disruptive technology, school teaches you how to do all the basic math & arithmetic so that you can in principle do it by hand, even if calculators are pervasive and greatly speed up work in practical settings. In addition, you understand what it's doing for you, so should it give you a wrong answer (e.g. you mistyped "prompt"), you should be able to notice it, gut check it, verify it in some other way, etc. The verification ability is especially important in the case of AI, which is presently a lot more fallible in a great variety of ways compared to calculators.
4. A lot of the evaluation settings remain at teacher's discretion and involve a creative design space of no tools, cheatsheets, open book, provided AI responses, direct internet/AI access, etc.
TLDR the goal is that the students are proficient in the use of AI, but can also exist without it, and imo the only way to get there is to flip classes around and move the majority of testing to in class settings.
Introducing Global PIQA, a new multilingual benchmark for 100+ languages. This benchmark is the outcome of this yearโs MRL shared task, in collaboration with 300+ researchers from 65 countries. This dataset evaluates physical commonsense reasoning in culturally relevant contexts.
Parents should take this analysis seriously. I believe there is increasing evidence that we are giving way too many vaccines to very young children. This is spreading in India too and we are seeing a rapid increase in autism in India.
Any large organization, be it a large company or government, is subject to the "head does not know what the tail is doing" problem.
Whatever schemes or projects that governments envision at the central or state level, by the time they reach a remote village, they get diluted, often so much that a lot of the allocated money is simply wasted.
There is no way to fix it than extensive decentralisation and that is true at the large corporate level and even more true at the government level.
We have to strengthen the city, district and village level governance and we have to ensure that smart people are attracted to serve at each of those levels and want to stay there (i.e, all the prestige is not in going to the state capital or Delhi). Today our system ensures that smart people don't want to stay and serve in any "small" role like in a district (with millions of people!).
The most important work I do is at the rural level in one district and in Zoho, what I do in the R&D team I head. That is reality and that keeps me grounded. The rest are only ideas that I share (like this post!) and ideas are cheap.
What a wild week in AI ๐คฏ
โข OpenAI GPT 4.5
โข Claude 3.7 Sonnet
โข Alibaba Wan 2.1 AI video
โข Grok 3 & Perplexity Voice
โข Google Gemini Code Assist
โข Amazon AI assistant Alexa+
โข ElevenLabs Speech-to-Text
โข Hume AI new LLM built for TTS
Hereโs everything you need to know:
Dr Kengatharaiyer Sarveswaran (University of Jaffna) has received @GoogleAI Research Scholar Program for 2024 for his work on developing a Sri Lankan Tamil Corpus.
ChatGPT has changed the world.
It does lack in some areas, but my favorite use case is leveraging it to teach me things twice as fast.
Here are the 10 best prompts to learn anything faster: