Software Engineer - Networking (Agent Infra)

Job description preview

From Baseten’s original posting

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE Every agent on Baseten Sandboxes runs in its own microVM. Agents call models, reach tools and APIs, expose services, and more and more often talk to each other. Networking built into today's cloud providers was not designed for very large numbers of isolated machines that suspend, resume, and exchange data constantly. The Agent Infra team builds its own networking stack for sandboxes, designed from the start for that scale. It runs in user space, with VPP (FD.io http://FD.io) as its main data plane technology, and is built from virtualized network functions (VNF/NFV):…