DNA Story

[DNA Story @DNAStory]

@tommy_bennett There are many more typos and wrong citations my code picked up (11 problematic cases before I stopped my automatic checking). I don’t have time to check them manually because I have nothing to do with the case. But those on the case will have to.

[DNA Story @DNAStory]

@IanCutress Yes. As a concept, it is an obvious future direction, but proven to be very hard. They claim to have it in production and will release chips this year with specific compute and energy efficiency numbers that can be verified this year. If true, a new scaling law follows.

[DNA Story @DNAStory]

@fangshimin Even more complexity due to how universities fill out survey form differently. If one was to know how much universities spend on Research, they would have to look at their audited financial reports. The survey data could be more than 50% off like the case of JHU

[DNA Story @DNAStory]

@fangshimin Maybe one way to account it would include it, but if you do so, then you would add Lincoln Lab to MIT and SLAC to Stanford. If you remove all national labs, they are basically the same.

[DNA Story @DNAStory]

@fangshimin NSF survey data should not be used for rankings because they do not reflect how institutions actually spend on research. For example, the Johns Hopkins figure includes the Applied Physics Laboratory, a $2.5 billion defense research operation located on a separate campus.

[DNA Story @DNAStory]

@Klotzkette @ryanmckeen Way more than that. There are 1005 US cases in the Damien Charlotin collection.

[DNA Story @DNAStory]

@ladymissazira it is much harder to review AI generated docs, because they seem polished and legit, it is easy to miss errors. Also, past experience in spotting typical associate errors is not useful.

[DNA Story @DNAStory]

@ladymissazira Tried a legal memo with it, then asked ChatGPT to find hallucination in it. Sure enough, it found "one clear statutory error" in addition to some minor citation errors. But we cant trust ChatGPT either so here comes the painful manual review.

[DNA Story @DNAStory]

@gordon_cassie Very true. Starts with the excitement of Claude Code handling an entire test project, to fixing errors all the time and the compacting wait. Same for legal work: a memo can look polished, but if the case analysis is wrong, correcting it is painful. Still very useful but not AGI

[DNA Story @DNAStory]

@CuriousLuke93x @MaxJunestrand I am running my own local AI. No network connection. It works great. Few simple wrappers to make it a bit easier. Not critical. Most work can be done by bare metal local inference and local search.

[DNA Story @DNAStory]

@marcrizz_ @TaherHassonjee They do want to use AI because it makes some tasks less painful. But you are right on the economic incentives.

[DNA Story @DNAStory]

@garrytan Surprisingly good at genomics. M3 128G. Start with max token 1M.

[DNA Story @DNAStory]

@th_s4m0ht The most needed is a hallucination insurance policy from legal tech companies. Malpractice insurance will probably explicitly exclude AI uses. Law firms should never adopt any tech that does not have the warranty.

[DNA Story @DNAStory]

@matt_ambrogi @harvey In view of the number of cases where Attorneys are facing sanctions, it seems to me that there is only one most important bench mark over all others, % of documents containing AI hallucination. To emphasize this, other benchmarks should count very little.

[DNA Story @DNAStory]

@GavinSBaker TSMC’s US expansion hinges on the Arizona experiment. Its success has been built on Taiwan’s culture and ecosystem—scaling in the US will require a new model adapted to a different environment.

[DNA Story @DNAStory]

@mitchpresnick Is it good old capitalism?

[DNA Story @DNAStory]

@dan_biderman Legal tech’s fundamental problem is AI’s fundamental problem. Task-specific patches help at the margins, but hallucination and unreliability can’t be fixed downstream. It needs breakthroughs at the foundation model level.

[DNA Story @DNAStory]

@MarioNawfal Careful reposting. UCLA didn’t revoke his degree, he’s now at Columbia for his Master’s, and AI use was allowed on that project per his LinkedIn. Colleges need to catch up, there are ways to permit AI and still ensure real learning and rigor.

[DNA Story @DNAStory]

@stokebuilder By legal community, I assume lawyers and judges. They love open source. Few legal tech companies may not like it, but who cares. Open source may be a necessity for the legal field.