Staff Software Engineer, LLM Inference Platform
CV for this role
Rewrite your CV for what Zenlayer asks for
This job is free to read. A CV tailored to it comes with Weekly and Monthly.
Pay comparison
Pay posted by Zenlayer
Market pay for software developers in United States
Per year, across all employers in this occupation. This figure is not from Zenlayer.
Source: Text of the Zenlayer job posting; US Bureau of Labor Statistics, Occupational Employment and Wage Statistics, May 2025.
Job description preview
From Zenlayer’s original posting
About Zenlayer Zenlayer is the first massively distributed edge cloud provider, operating 290+ Points of Presence across 70+ countries. With accolades including PTC “Best Networking Innovation”, “Outstanding Cloud, Data Center, or Interconnection Company”, and Inc. 5000, we enable businesses to deploy and run applications at the edge, thus reducing network latency to the end user. Zenlayer focuses on improving connections worldwide, all while nurturing a unique company culture that values service, growth, and trust. As a “Zenplayer”, you’ll be joining a community of success-driven team players that share the dream of powering a better-connected world. About the Role: As the technical lead for inference performance, you will own end-to-end responsibility for the platform's Token Performance. For models ranging from hundreds of billions to trillions of parameters (including MoE), you will continuously reduce cost per million tokens and increase per-GPU Goodput while meeting TTFT/TPOT SLOs, and prove the gain from every optimization with reproducible data. What You Will Work On 1. End-to-End Performance Attribution and Benchmarking • Establish a unified Token Performance metrics…
Open full posting on Zenlayer’s siteSimilar roles on Seoulstart
Staff Software Engineer, EnterpriseReplit · Foster City, CA · 1 day ago
- Artificial Intelligence Software Engineer SMECACI International Inc · Remote (United States) · today
Senior Software Engineer, Metric PlatformRoblox · San Mateo, CA, United States · today
Principal Software Engineer, Metrics PlatformRoblox · San Mateo, CA, United States · today