[Remote] Backend Engineer, Multi-cloud Inference Platform

Note: The job is a remote job and is open to candidates in USA. Modular is a company focused on building innovative AI infrastructure solutions. They are seeking a Backend Engineer for their Cloud Inference team to develop a multi-cloud, multi-tenant platform for inference services, ensuring operational excellence and scalability. Responsibilities • Build the multi-cloud, multi-tenant platform powering Modular’s inference services • Build fault-tolerant, low toil services able to make use of resources in a variety of hardware platforms Clouds (Tier 1 Cloud Providers & neoclouds) • Push the envelope for operational excellence with request-to-kernel observability, multi-cloud deployments, cold-start optimizations, and more • Build helm charts, kubernetes operators, and more to make a create simple, effective, maintainable deployments Skills • 5+ years of experience working in backend engineering • Experience with service oriented architecture and distributed systems • Experience with Cloud Providers (AWS, GCP, Azure, neoclouds) • Experience with kubernetes and operating your own services • A passion for building and operating high performance, low toil, observable systems • Experience in machine learning technologies and use cases • Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture • Strongly identifies with our core company cultural values • Practical experience implementing & maintaining security in multi-tenancy environments • Experience working on high scale ML inference infrastructure (traditional AI or genAI) • Familiarity with golang Benefits • Premier insurance plans • Up to 5% 401k matching • Flexible paid time off • Stock options • Team Building Events • Regular team onsites and local meetups in Los Altos, CA as well as different cities • Traveling 2-4 times a year is expected for all roles Company Overview • Modular is an AI infrastructure company that develops a unified software stack for deployment, serving, and programming GPUs. It was founded in 2022, and is headquartered in Palo Alto, California, USA, with a workforce of 51-200 employees. Its website is https://www.modular.com. Apply To This Job