Pankaj Gupta

Co-founder @basetenco working on ML model performance

[Pankaj Gupta @defpan]

Driving model performance optimization: 2024 highlights https://t.co/XVVN2egpYb via @baseten

[Amir Haghighat @amiruci]

We're doing 3 launches this week, expanding Baseten's inference platform:

- Grid: gateway, intelligent router, and guardrails for coding agents (launching on Wednesday)
- Sandboxes: stateful, VM-isolated, and co-located with inference (launching on Thursday)
- Loops: serverless RL and SFT on frontier open-weight models (GA on Friday)

What excites me most is bringing training, inference, routing, and execution onto the same platform and showing what becomes possible when they're built to work together.

More to come all week.

[Baseten @baseten]

We're proud to be a launch partner for the NVIDIA Open Agent Safety Platform and a member of the Open Secure AI Alliance.

Baseten is committed to contributing to the open frontier, including open safety standards and frameworks for inference and training. Two weeks ago, we launched our safety infrastructure research effort with Base Labs.

Today, we've contributed to OpenShell and built a template to run it inside our sandboxes. Much more to come.

[Amir Haghighat @amiruci]

Our second announcement of the day: Carbon is our newest sandbox infrastructure, built with more capabilities for long-running agents.

It has microVM isolation, an IPv6 address per sandbox, and snapshots and forks as first-class features. A sandbox snapshot can go to production within milliseconds; no extra build step needed.

Carbon is in private preview; DM me if you want access.

[Tuhin Srivastava @tuhinone]

The open frontier only works if we can make autonomy safe by default. @JensenHuang has done important work here that we're proud to support.

Excited to join the Open Secure AI Alliance and to partner with @nvidia on the launch of the Agent Safety Platform.

[Base Labs @baselabs]

We believe openness to be an advantage for AI safety. Openness provides more visibility into the behavior of models and, most importantly, greater means of turning safety research into actionable and transparent controls than closed-source.

This is why Baseten and Base Labs are building a stronger safety and security standard for open models, with the launch of our safety infrastructure. Base Labs will develop and publish methods for training and monitoring open models, and Baseten will integrate that work into its deployment infrastructure, live at runtime, and offer this work as a managed service. This will be a standard that is transparent and built into how our models are trained and deployed.

We invite the open-source community to contribute, and are proud to partner with @huggingface and @GoodfireAI to bring this vision to fruition.

Together, we are building an ecosystem of open models that are safe and accessible to all.

[Baseten @baseten]

https://t.co/JZXABlmahG

[Baseten @baseten]

Notion's AI Meeting Notes run on Baseten, and Baseten's knowledge base runs on Notion. Our teams have been working together closely to push the frontier on both fronts.

For AI Meeting Notes, our voice engineers built the fastest, highest-quality, yet lowest-cost solution on the market for speaker-attributed transcripts. We're proud to partner with the @NotionHQ team.

[Brian Li @BrianLi23]

https://t.co/ZyhZUElPGk

[Baseten @baseten]

"A really strong open-weight ecosystem will lead to an even stronger closed-weight ecosystem. It's necessary for both primitives to exist."

Thank you @FoxBusiness for having @tuhinone on to discuss the importance of a healthy frontier ecosystem. Companies deserve to run AI models on their own terms, and we're dedicated to building the inference and training to support them.

[Jensen Huang @JensenHuang]

For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.

AI will transform every industry, power every company, and be built by every country.

Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.

The world needs both frontier closed models and frontier open models.

https://t.co/AUKzoQ5Ikb

[Baseten @baseten]

Today, we're introducing GLM-5.2 Fast: our GLM-5.2 Model API designed for the most demanding real-time use cases.

The Fast tier delivers 2-3x higher TPS than the standard GLM-5.2 MAPI.

[Tuhin Srivastava @tuhinone]

We just launched a new tier of Fast Model APIs, starting with GLM-5.2 Fast.

Our customers run some of the most demanding, real-time workloads. Model APIs are the fastest way to get running with frontier-level models, and our Fast tier has even tighter guardrails around guaranteeing the best performance.

[Pankaj Gupta @defpan]

@waterloo_intern absolutely insane work. This speed unlocks a whole category of products in AI Video Generation!

[ali @waterloo_intern]

https://t.co/qe2HpEQZPd

[Baseten @baseten]

NYC team repping at Nasdaq tower this week! 💚

We're growing fast, and we're hiring across the board. If you're excited about helping companies own their intelligence, reach out!

[Philip Kiely @philipkiely]

https://t.co/LlNSUlxWLa

[Apoorv Agrawal @apoorv03]

https://t.co/BLarYGPx7Z

[Tuhin Srivastava @tuhinone]

https://t.co/aVf5uLG7j5

[Bland @usebland]

Today, we’re announcing that we’ve closed our Series C and raised $100M to continue automating the world’s most complex phone calls.

We grabbed some guy named Paul to talk about it because nobody else in the office wanted to. 🧵

[Yikai Zhu @YikaiZhu98]

https://t.co/rNXhTtf79D