# Technical Product Manager, Infrastructure - Company: [Vastai]() - Location: Los Angeles - Team: Product - Employment type: Full Time - Salary: $170K – $240K - Posted: July 20, 2026 ## Job description ## **About Us** Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity. We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out-sized, and leadership is earned by shipping excellence. ## **About the Role** Vast.ai is seeking a Technical Product Manager to drive the backend our GPU cloud marketplace runs on. This is the software behind every live GPU rental (over 700k transactions a month): the daemon on every host's machines, the orchestration that powers each instance, and the infrastructure and test systems that let us ship it all at high velocity. **The Scale:** With over 20k GPUs, our AI cloud platform powers thousands of bleeding-edge training runs and critical production workloads for 120k+ developers all over the planet. This is a product with real scale, real data, and real users from day one. The work you ship moves tangible revenue in weeks, not quarters. **The Challenge:** We don't own the GPUs. Thousands of independent hosts price and operate them, and no two machines are alike. Your job is to make that heterogeneous, decentralized supply behave like the top-tier cloud our customers expect: fast, secure, and reliable. ## **What You'll Own** You'll drive the infrastructure, security, and reliability roadmap: sequencing competing priorities, turning non-functional requirements into specs engineering can build, and seeing them through until they ship. You'll own the metrics that prove it worked: platform uptime, fleet reliability, cost-to-serve. Initial focus areas: * **Scalability & performance.** Keep the core systems fast and ahead of demand as the marketplace grows, from database performance to end-to-end latency. * **Security, trust & compliance.** Harden the platform against attacks and abuse, and build the compliance roadmap enterprise customers need. * **Observability & infra tooling.** Give every engineer a clear view of platform health, and every host a clear view of their fleet. Own the metrics, tracing, and tooling behind it. ## **Ideal Experience** * 3+ years as a backend engineer AND 3+ years in product management * Hands-on experience with several of: security, scalability, reliability at scale, infrastructure tooling, distributed systems, observability, abuse/fraud prevention, compliance * Industry experience in one or more of the following areas: software infrastructure, developer tooling (APIs, SDKs, CLIs), AI/ML, cloud computing, GPUs, or two-sided marketplaces * Experience at a fast-paced startup or rapid-growth team ## **You Are** * **AI-native.** You work with AI agents every day, and you want to build the compute layer the AI era runs on. * **Deeply technical.** You came up as an engineer, and you reason about scalability, security, and efficiency as product concerns, not afterthoughts. * **Persuasive across the stack.** You can make a technical tradeoff legible to c-suite and a thankless migration compelling to the team doing it. * **Biased toward action.** You'd rather ship the fix today than present the plan next week. ## **Tech Stack** Python, C++, SQL/PostgreSQL, Redis, Linux, Docker, AWS, Terraform, REST APIs, LLMs/AI agents ## **Interview Process** * Initial screening (virtual) * Deep dive on the role and your experience (virtual) * Live product and technical assessment (virtual) * In person panel interview + product and technical assessment (on-site) ## **Annual Salary Range** $170,000–$240,000 base depending on experience, plus equity. We're profitable, venture-backed, and growing, so the equity is a stake in a real company with a real valuation, not a lottery ticket. ## **Benefits** * Comprehensive health, dental, vision, and life insurance * 401(k) with company match * Meaningful early-stage equity * Onsite meals, snacks, and close collaboration with founders/tech leaders * Ambitious, fast-paced startup culture where initiative is rewarded * Ample AI agent budget **LOCATION:** On-site at our office in Los Angeles (Westwood). ## Apply [Apply on Vastai]() Canonical job page: