The Doom of Mathematicians
...is not purely an AI doing in hours what a mathematician has spent his life trying to accomplish.
That's a symptom.
Even if AI disappeared tomorrow they now know that there is "something out there" that could make all their hard work look trivial.
I wrote about something similar in an alien contact story:
“First Contact 101 — Meetings between us and primitive peoples. If we fully show you who we are it almost always destroys the lesser party. You come to understand that everything you cherish is trivial, childish and frankly pathetic. That your sciences and technologies are infantile and the basics of your fledgling economies, like intellectual property, are worthless."
This succinctly points to the misinformed idea of software engineering: people assume that the only way to understand code is to look at it with naked eyes. Reading as a way to understand systems never really worked. But deterministic contextual tools did work.
In this entertaining talk, @dhh equates software engineering with writing code. He also assumes that understanding systems is hard. It's understandable that he makes that mistake. Most do it. The good news is that understanding systems is much more accessible than he believes.
LLMs are useful mechanisms.
They are also deceitful in that they look useful for what they are not: producing definite answers directly. Used like this then becomes harmful.
These diagrams are so appealing. But they are opaque. If the question is about the existing system, ask the LLM to produce tools that produce the diagrams.
This.
The underlying assumption behind the machine god is that we have already reached the peak of human ability and therefore we have to delegate more to AI.
But when it comes to engineering software systems, that assumption is wrong.
"Software engineering has changed radically. It is now mainly about reading code. But reading code does not scale. We need to delegate to AI."
I am glad you recognize code reading as a problem. But, the broader problem statement is not correct and neither is the conclusion.
1/