San Francisco, CA
AI cloud platform for open-source models
Together AI builds a full-stack AI cloud platform enabling developers to train, fine-tune, and deploy open-source generative AI models at scale. It serves AI engineers, researchers, and enterprises like Salesforce and Zoom with GPU clusters and inference engines. The platform combines cutting-edge systems research with infrastructure to lower AI costs and accelerate innovation.
Provides advanced, customer-facing technical support for enterprise Kubernetes GPU clusters, HPC infrastructure, networking, and distributed storage. The role requires SRE or DevOps experience, AI/GPU infrastructure knowledge, strong troubleshooting skills, and weekend-shift availability.
Provides technical support and customer-facing SRE coverage for AI inference, fine-tuning, GPU clusters, and Kubernetes endpoints. The role requires 6+ years in technical infrastructure or support, strong debugging and observability skills, and weekend shift coverage.
Provides internal IT support across identity, devices, SaaS platforms, asset management, onboarding, and automation. The role requires hands-on experience with Okta, Google Workspace, macOS MDM, scripting, AWS provisioning, and endpoint support.
Research Engineer turning efficient foundation model training research into robust high-performance production systems at Together AI. Optimize large-scale training infrastructure, profile bottlenecks, integrate new models, and productionize novel methods in close partnership with scientists.
Build and own customer-facing visibility features for Together AI's Cloud platform, including events, audit logs, timelines, notifications, and analytics dashboards. Requires 2-5 years building large-scale distributed backend systems and enthusiasm for event-driven architectures and data pipelines.
Full-stack engineer building and shipping improvements to Together AI's core developer product surfaces (Playground, Model Garden, Fine-Tuning, etc.). Own features end-to-end from data models/APIs to intuitive UIs, instrument for value, and raise frontend/fullstack quality on a small high-ownership team. Requires 4+ years shipping production products, strong React/TypeScript, and full-stack fluency.
Own and run the end-to-end qualification process for new GPU compute capacity at Together AI. Coordinate cross-functional engineering validation of providers across hardware, networking, storage, power/cooling; perform first-pass data analysis and deliver go/no-go recommendations to leadership.
Build and own software state machines and control planes that automate the full lifecycle of GPU infrastructure from bare metal provisioning to running AI inference clusters. Requires strong software engineering experience with orchestration, reconciliation loops, and event-driven systems.
Strategic Account Executive owning full sales cycle for high-priority AI-native and enterprise accounts at Together AI. Responsibilities include pipeline generation, closing complex deals, running POCs with technical teams, and expanding customers on their AI inference and post-training platform. Requires 7+ years B2B tech sales experience with technical fluency in ML/infrastructure.
Staff Platform Engineer owning service infrastructure strategy for Together AI's Product Foundations (API, UI, Billing, IAM). Lead Kubernetes, AWS, Terraform, networking, and reusable primitives to improve reliability, consistency, and scalability across teams.
Commercial Counsel supporting infrastructure procurement (GPU/cloud capacity, data centers) and GTM enterprise deals at an AI infrastructure company. Requires JD, 5+ years in-house tech transactions experience, knowledge of data privacy, export controls, and regulatory regimes.
Senior Software Engineer building scalable observability platforms (metrics, logs, traces) with Prometheus, Grafana, OpenTelemetry and related tools for Together AI's GPU cloud infrastructure. Requires strong distributed systems and infrastructure-as-code experience.
Analytical backbone for Together AI's Infrastructure Strategy team. Conduct research, benchmarking, capacity planning, vendor/site evaluation, build dashboards, and drive data-backed decisions for scaling GPU compute infrastructure. Requires 3+ years in consulting, strategy or ops with strong quantitative skills.
Senior Network Engineer responsible for designing, implementing, and maintaining high-performance compute network infrastructure for AI systems. Requires 8+ years experience with large-scale data center networks, deep expertise in routing/switching protocols, automation, and multi-vendor hardware.
Research Engineer building platforms to customize open-source LLMs via fine-tuning, RL, and evaluation. Focus on integrating post-training with inference engines (vLLM, SGLang, TensorRT-LLM), optimizing for RL workloads, and ensuring production reliability. Requires 2+ years ML production experience and strong Python/Go skills.
Senior Product Engineer owning end-to-end frontend for Together AI's Commerce team, focusing on enterprise spend controls, usage-based pricing, metering dashboards, payments, and billing UIs. Requires 4+ years React/TypeScript experience building production UIs, strong API consumption and observability skills.
Build and architect an AI-native GTM tech stack, centralizing data in CRM/data warehouse, automating revenue workflows, designing Salesforce CPQ and CLM integrations, and maintaining data integrity to drive measurable outcomes. Requires 3+ years in GTM/RevOps with strong Salesforce and systems thinking experience.
Lead end-to-end hyperscaler partnership deals including complex commercial negotiations, revshare structures, model licensing, and marketplace private offers. Requires 10+ years in strategic partnerships with hyperscaler experience.
Own day-to-day product work for AI infrastructure (GPU clusters, storage, observability). Drive experiments, find and resolve problems with high agency, and grow into full ownership of a product area. Requires strong data skills and technical foundation.
Build and operate backend services and infrastructure for model customization and evaluation at Together AI. Requires 3+ years building production infrastructure, strong Python/Go skills, and deep experience with Kubernetes, Linux, and cloud platforms.
Research intern on the Model Shaping team working on post-training methods, efficient neural network training, and foundation model evaluation. Requires strong ML fundamentals and PyTorch/JAX experience.
Intern developing and optimizing GPU-accelerated kernels for ML/AI applications. Requires strong GPU programming background (CUDA/Triton) and knowledge of performance optimization.
Research intern on the Agents team building and aligning frontier AI systems for complex agentic and scientific tasks. Focus on post-training methods, evaluation frameworks, self-learning, and scalable agent infrastructure.
Coordinate break/fix activities, ticket management, vendor dispatches, and operational reporting across multiple data centers to maintain uptime and fast issue resolution. Requires data center operations experience and hardware knowledge.
Design and operate multi-petabyte distributed storage systems for large-scale AI training and inference, integrating parallel filesystems and building Kubernetes-native storage platforms.
Lead full-cycle recruiting for AI researchers, research engineers, and ML systems talent at a frontier AI infrastructure startup. Partner with research leadership to build hiring strategies and source from academia and industry.
Own global data center strategy and site selection for an AI infrastructure company. Lead site diligence, negotiate large colo/power contracts, and align infrastructure investments with product demand.
Staff ML Engineer to own the model serving stack for real-time voice inference (STT, TTS, speech-to-speech) on H100/H200 GPUs. Drive latency/throughput optimization using TRT-LLM and SGLang for models like Whisper and Parakeet.
Builds and maintains AI infrastructure using Ansible, Terraform, and Kubernetes, ensuring scalability, reliability, and high availability. Handles on-call incident response, monitoring, debugging, and infrastructure growth planning. Requires 5+ years experience and CS bachelor's.
Designs whitespace environments for large-scale AI GPU clusters, including rack layouts, power, cooling, and cabling. Reviews contractor designs, ensures compliance with standards, and owns capacity planning. Requires 7+ years in data center infrastructure.
Serves as primary technical owner for strategic enterprise AI infrastructure customers, managing compute, networking, storage, and facilities for large-scale GPU deployments. Requires 5+ years customer-facing experience with deep GPU/HPC expertise and observability tools.
Lead design, fit-out, and commissioning of data center sites focused on power, cooling, and IT infrastructure for high-density GPU workloads. Build and manage a 20-person operations team, oversee multi-site portfolio, and establish processes from scratch.
Leads development and scaling of global GPU infrastructure for AI, owning product roadmaps for observability, storage, networking, and security. Requires 5+ years in AI/ML infrastructure, cloud platforms, and cross-functional leadership in a fast-paced startup.
Leads establishment and scaling of global tax function, developing strategy, ensuring compliance across jurisdictions, and optimizing tax for AI infrastructure, data centers, and international expansion. Requires 10+ years tax experience, CPA preferred, and tech/AI sector knowledge.
Senior ML Engineer optimizes inference for voice AI models (STT, TTS, speech-to-speech) using engines like TensorRT-LLM and SGLang on GPUs. Requires 5+ years ML engineering with serving/inference expertise, Python/PyTorch proficiency, and production ML experience.
Manages data center construction projects from contract negotiation to commissioning, overseeing vendors, budgets, timelines, and ensuring delivery for high-density AI compute environments. Requires 7+ years in technical program management with data center experience and a bachelor's degree.
Lead Product Designer shapes AI development tools, leads complex UX initiatives, evolves design systems, and establishes design standards. Requires 7+ years experience with developer tools, user research, and cross-functional collaboration.
Research Engineer building production ML systems at the intersection of efficient inference, RL/post-training, and serving engines. Translates algorithms into scalable infrastructure improving latency, throughput, and model quality. Requires 3+ years ML systems experience and advanced degree.
Develops efficient inference engines and RL/post-training pipelines for production-scale LLMs, optimizing algorithms, systems, and performance across the stack. Requires 3+ years in ML systems/RL/inference and advanced degree.
Leads product marketing function to develop messaging, execute GTM strategies, and drive product adoption in AI cloud platform. Requires 10+ years PMM experience, 5+ years leadership, and enterprise software background.
Optimizes and builds production inference systems for large language models at scale using PyTorch and high-performance tooling. Requires 3+ years experience in production code, OS concepts, and AI inference systems.
Solutions Architect advises customers on Generative AI applications using OSS models, runs POCs, collaborates with sales, and provides technical expertise in AI/ML/GPU technologies. Requires 5+ years customer-facing experience and proficiency in Python/JavaScript.
Develops and optimizes GPU-accelerated kernels and algorithms for ML/AI applications, co-designing with modeling, hardware, and software teams. Requires strong GPU programming expertise in CUDA/Triton and knowledge of ML models.
Build and maintain highly available AI cloud infrastructure virtualizing ML hardware like GB200 GPUs and BlueField DPUs, enabling self-serve Kubernetes/Slurm clusters for internal and external customers. Requires 5+ years experience with distributed systems, backend development (Golang preferred), and cloud providers.
Build highly available global AI cloud platform virtualizing ML hardware for self-serve services like Kubernetes clusters. Requires 5+ years in distributed systems, Golang expertise, cloud providers, and strong systems knowledge.
Owns systems and tooling to optimize developer workflows, CI/CD pipelines, and local environments for faster software delivery. Requires 5+ years in DevOps/SRE, proficiency in Python/Go/JS, and CI/CD expertise.
Build and optimize the core inference platform powering frontier AI models at global scale, focusing on low-latency routing, auto-scaling, and GPU resource management. Requires 5+ years in large-scale distributed systems and expert programming skills.