We’re not aware of any law firm going to this extreme.
For example Latham is buying GPUs but is also firm-wide on Harvey and we announced a deeper partnership today.
We think that’s the right strategy and what matters more than build vs buy is how heavily a firm is investing in AI.
The best way to invest is a portfolio approach of working closely with vertical vendors and the labs and cloud providers while also self-building with open source and the frontier ecosystem.
Everything is moving too fast and law firms are too complex for a single binary approach like this post suggests.
Law firms will not rely on a single vendor nor will they build the entire stack themselves.
My view is that longer term the labs and clouds will build general intelligence infrastructure and vertical players will help customize it for each industry.
Then individual firms will leverage their unique data, human expertise and workflows to build differentiated AI to better compete against their peers and serve their clients.
Our goal is to build the trusted vertical layer and open it up through APIs so firms can build everything from custom models and context layers to agents and products with us.
And most importantly do it in a way they can trust that their data and their clients’ data is safe and only used for their benefit.
Harvey is hiring a government affairs and public policy leader. The role: engage policymakers in the US and around the world so AI strengthens the legal profession and expands access to justice. You'd build the program working directly with me.
https://t.co/ssN7bp3OsB
Pretty good for a company that’s not even four years old! Amazing what you can do with maniacal customer focus and elite talent density. @winstonweinberg@gabepereyra and the whole team are absolute beasts.
Super valid question on why we are working with multiple research partners.
Our goal is to help the entire legal industry build better models, not just ourselves. This is why we open sourced our legal agent benchmark and the more people use it the more we learn how to make it better for everyone.
Post training is still an open field of research and there isn’t a one-sized fits all solution. We have a huge amount of open research problems, product surfaces and task types that may all require different post training approaches. Each partner explored something different:
1. @baseten - novel compaction strategies for understanding large corpuses like datarooms.
2. @FireworksAI_HQ - model routing and frontier-as-advisor-tool for cost reduction.
3. @trajectorylabs - continual learning with nemotron.
4. @EngramLab - learning firm knowledge / enterprise and precedent search.
5. @appliedcompute - harness and compaction optimization on AC2
We have many more research directions we want to explore. On top of that we need to ensure these work with many different types of open source base models. Some customers want @Zai_org or @Kimi_Moonshot, some want a European model like @MistralAI and some want a US model like @nvidia or @reflection_ai.
I think the big misconception is that the goal is to train a single model and then you're done. What every company and industry needs to build an ecosystem and system for constantly improving models which requires data, research, training, etc to be shared so everyone can contribute and benefit.
Our hope is that by open sourcing our dataset and showcasing the amazing work of all these partners we will encourage more talented AI folks to focus on legal and help the industry build better AI systems overall.
Model strategy for @harvey:
We are working on the first model in our legal foundation model series, inspired by @cursor_ai's Composer. Two goals:
1. Allow us to serve frontier intelligence across our product surface areas at an affordable price and a strong security posture.
2. Create the foundations for law firms to build their own specialized models and own their own intelligence.
The model series will focus on complex client matters that span months and take dozens of associates. The agentic system will learn to control legal tech tools, sub agents and ask for help from frontier models or human partners, much like a senior associate.
We’ve open sourced benchmarks for evaluating our initial post training work that represents work done by associates and in-house lawyers. We are scaling these significantly using synthetic and human pipelines as well as building private evals for firms.
Open sourcing this data has allowed us to quickly validate the feasibility of post training open weight models for legal work. With our research partners we’ve already shown promising results post training open source models to approach frontier performance:
1. @baseten - novel compaction strategies for analyzing large data rooms.
2. @FireworksAI_HQ - matching frontier performance by using frontier as an advisor.
3. @appliedcompute - improving performance and reducing cost of large scale review tables.
4. @trajectorylabs & @nvidia - sovereign continual learning over client matters.
We plan to continue to invest heavily in working with research partners and open sourcing our data, models and research as much as possible. We believe open research in legal will be important to building trust in the frontier ecosystem.
We are also scaling our research team. Harvey Labs is our internal research group, responsible for pushing the frontier of legal intelligence and working closely with labs, research partners, and academia to bring the frontier of agent research into Harvey.
Labs is run by @nikogrupen and @ItsJulioPereyra - Niko worked on multi-agent RL at Google Brain and Julio clerked and worked in BigLaw. We believe this pairing is crucial for building frontier legal AI systems. Together they have already made significant progress in scaling our data and training efforts.
The long term goal of Harvey Labs is to contribute to the research and infrastructure required for the legal industry to create a frontier ecosystem. We believe that the best version of legal super intelligence is one where each law firm, enterprise and government owns their own specialized version.
We are hiring for Harvey Labs across the post training, agent and data stack and open to acquiring talented teams / neolabs in this space. If interested please DM me.