Skip to content
BasetenBaseten

Solution Architect

Partners with Sales to translate customer needs into AI technical solutions, leads demos, technical scoping, benchmarking, and POC execution for ML inference deployments across modalities like LLMs and VoiceAI.

About the job

Responsibilities

  • Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).
  • Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.
  • Own benchmarking and repeatable deployments, including:
    • Handling standard deployment patterns and configurations across many modalities – LLMs, embeddings, image and video generation, VoiceAI, etc.
    • Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.
    • Driving consistent “playbook” style deployments for common models and use cases.
    • Become a power user of different runtimes such as vllm, sglang, and TRT-LMM and all the common configurations and tradeoffs between them.
  • Drive POC and project execution, including:
    • Scoping POCs and keeping stakeholders aligned on timeline, deliverables, and next steps.
    • Acting as the “ringleader” or project manager for POCs.
    • Pulling in Forward Deployed Engineering (FDE) support when deeper or more complex technical work is needed.

Requirements

  • AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.
  • Strong customer-facing communication skills, including the ability to run structured discovery and clarify ambiguous requirements.
  • Technical depth to scope solutions, without needing to write production code.
  • Ability to script and prototype as needed, including comfort “vibe coding” to move quickly in technical workflows.

Nice to Have

  • Experience running or supporting benchmarks for ML inference deployments.
  • Familiarity with infrastructure tradeoffs relevant to inference performance and cost (for example GPU selection and latency versus throughput tuning).
  • Experience serving as a cross-functional technical lead for customer POCs, including coordination across Sales and Engineering.

Benefits

  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents.
  • Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!).
  • Paid parental leave.
  • Company-facilitated 401(k).
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Skills

AI/ML, LLMs, Embeddings, vLLM, Sglang, Trt-Llm, Gpu (H100, B200), Inference Optimization, Benchmarking, Ml Deployment

Ashby

Ashby

United States

Integrations Consultant - Americas
$165k+/yrRemoteSolutions Architecture

Leads complex HCM integration implementations for strategic customers, advising on technical design, troubleshooting, change management, and best practices. Requires extensive Workday integration experience, strong consulting and communication skills, and the ability to manage multiple cross-functional projects.

OpenAI

OpenAI

New York, NY

Forward Deployed Engineer , Legal
$162k+/yrHybrid5+ YOESolutions Architecture

Build and deploy full-stack AI systems for legal teams, owning customer engagements from workflow discovery and prototyping through production adoption. The role requires 5+ years of engineering or technical deployment experience, production coding skills, and experience with LLM-powered systems in regulated or high-stakes environments.

OpenAI

OpenAI

New York, NY

Forward Deployed Engineer , Legal
$162k+/yrHybrid5+ YOESolutions Architecture

Build and deploy full-stack AI systems for legal teams, owning engagements from workflow discovery and prototyping through production adoption. The role requires 5+ years of customer-facing engineering or deployment experience, production Python or JavaScript skills, and experience with LLM-powered systems.

Roboflow

Roboflow

New York, NY
Solutions Architect
$170k+/yrRemoteSolutions Architecture

Design and demonstrate scalable edge-based computer vision solutions while partnering with sales and customers throughout the presales process. Requires solutions architecture or technical sales experience, strong computer vision and machine learning knowledge, and proficiency in Python or JavaScript.

Bilt Rewards

Bilt Rewards

New York, NY

Technical Account Manager
$160k+/yrOn-site5+ YOESolutions Architecture

Own technical relationships, integrations, launches, and ongoing support for enterprise and retail partners. The role requires 5+ years in technical account management or a related function, API and troubleshooting expertise, and strong cross-functional communication.