Own reliability and quality for an AI copilot in a trading platform. Design evaluation systems, benchmarks, quality gates, model improvement loops, and AI monitoring for correctness, safety, and performance in market analysis and trading workflows. Requires 8+ years production software experience and strong ML eval expertise.
200k – 350k
Remote8+ YOEML Engineering
About the role
Responsibilities
Own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors.
Design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows (including order placement).
Develop and maintain benchmarks: curated “golden sets,” scenario suites, stress/adversarial cases, and continuously refreshed market/regime-based test corpora.
Build automated quality gates and regression workflows that block releases when key metrics degrade.
Partner with engineering and product to define safe tool/action contracts (deterministic previews, confirmations, auditability) and ensure predictable assistant behavior.
Own model improvement loops tied to evals: data collection/labeling strategies, error taxonomy, prompt/tooling changes, and when appropriate, fine-tuning or preference optimization to measurably improve benchmark performance.
Design and operate monitoring + incident response for AI: telemetry, alerting, RCA, and “fix-forward” processes.
Develop a deep understanding of trading concepts (margin, shorting, portfolio margin, risk, execution) and how to express them accurately and understandably to users.
Requirements
At least 8 years of experience shipping production software; strong proficiency with any programming language.
Strong knowledge of computer science fundamentals, testing methodology, and systems design.
Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems (LLMs/agents/search/retrieval/ranking/recommenders).
Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation, and deploying changes with measurable impact on benchmarks.
Ability to define metrics, build measurement pipelines, and drive engineering/product decisions from data.
Comfort working across the stack: debugging model/tooling failures, instrumenting services, and partnering with frontend/product on UX patterns that improve safety and trust.
High degree of self-motivation and willingness to jump into unfamiliar areas to solve problems.
Nice-to-Haves
Experience with fine-tuning, preference optimization, distillation, or prompt/compiler-style techniques for improving tool-use reliability.
Experience creating domain-specific benchmarks and adversarial suites (e.g., “known-bad” scenarios) for high-stakes applications.
Deep experience with trading across asset classes, margin types, etc.
Experience with Rust and performance-sensitive services.
Experience designing incident response and SLOs for ML/AI systems.
Compensation
Base Salary Range: $200,000 - $350,000 (does not include bonuses or equity).
Competitive compensation packages, company equity, 401k matching, gender neutral parental leave, and full medical, dental and vision insurance.
Build and own the core AI platform powering an AI-native trading copilot. Develop high-performance Rust backend for streaming, tool execution, and safe trading actions; design robust APIs with observability and security. Requires 8+ years systems programming experience.
200k – 350k
Remote8+ YOEML Engineering
Staff Software Engineer, Agents
DecagonSan Francisco, CA
Build and own end-to-end AI agents for enterprise customers, integrating latest text/voice models and iterating based on real-world usage. Requires 8+ years of software engineering experience with Python and TypeScript.
200k – 400k
On-site8+ YOEML Engineering
Member of Technical Staff - Research Fellow
Nuance LabsSeattle, WA
3-month research fellowship for early-career researchers working on frontier Multimodal LLMs, generative modeling, and real-time audiovisual AI. Own a research problem in pretraining, post-training, RL, evaluation, or multimodal modeling. Strong PyTorch and first-author tier-1 paper required.
200k – 250k
On-siteML Engineering
Member of Technical Staff — Model Optimization and Inference
Nuance LabsSeattle, WA
Early-career engineer optimizing inference for real-time multimodal AI avatars. Focus on KV cache strategies, serving frameworks, quantization, and latency reduction for LLMs and diffusion models.
200k – 300k
On-siteEntry levelML Engineering
Staff Applied ML Scientist
SentiLinkAustin, TX +5
Build and maintain fraud detection models and financial risk products through full ML lifecycle, including production code. Requires 6+ years experience (or 8+ with Masters), PhD preferred, strong end-to-end DS/ML skills, and domain interest in fraud/identity.