Staff Engineer, Distributed Storage and HPC & AI Infrastructure
New roles land in Following.
Job description preview
From Together AI’s original posting
About the Role In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. You’ll manage and scale high-performance parallel filesystems and object stores, evaluate and integrate cutting-edge technologies such as Vast, Weka, Ceph, and Lustre, and solve the complex engineering challenges of operating at extreme throughput, low-latency data paths, and massive cluster-scale storage operations. You will also build Kubernetes-native storage operators and self-service platforms that provide automated provisioning, strict multi-tenancy, performance isolation, and quota enforcement at cluster scale. Day-to-day, you’ll optimize end-to-end data paths for 10-50 GB/s per node, design multi-tier caching architectures, implement intelligent prefetching and model-weight distribution, and tune parallel filesystems for AI workloads. Responsibilities • Architect and implement the technical strategy and storage roadmap for Together AI, driving high-performance architectural decisions as we scale our GPU fleet. • Engineer and scale multi-petabyte AI/ML storage systems by integrating Vast, Weka, and Ceph…
Open full posting on Together AI’s siteSimilar roles on Seoulstart
Senior Staff Machine Learning Engineer (Coupang AI Foundations)Coupang · Seattle, USA · 1 day ago
Senior Software Engineer (Ruby/Rails), MVRCheckr · San Francisco, California, United States · today
Staff Product Mobile Engineer, Business MoneyGusto · Denver, CO - Hybrid; New York, NY - Hybrid; San Francisco, CA - Hybrid · today