# Software Engineer, Artificial Intelligence/LLM (Multiple Seniority Levels)

**Company:** [Beacon AI](https://hotfix.jobs/companies/beacon-ai)
**Location:** San Carlos, CA
**Role:** ML Engineering
**Salary:** $130k – $225k/yr
**Skills:** Python, TypeScript, LangChain, RAG, Aws Bedrock, OpenAI, Anthropic, Opensearch, Pgvector, Pinecone, Embeddings, Vector Search, Prompt Engineering, Function Calling, Evaluation Metrics
**Posted:** 2026-05-05

> Builds and owns end-to-end LLM-powered features including RAG, tool-calling, APIs, retrieval systems, evals, and monitoring for aviation AI platform. Requires production LLM experience, strong coding in Python/TypeScript, quality focus, and cost/latency optimization.

## Job Description

## Responsibilities

**Build user-facing LLM features**
- Design and implement retrieval-augmented generation and tool-calling flows using frameworks like **LangChain** or equivalent primitives.
- Deliver robust JSON and schema-bound outputs with validation, retries, and fallbacks.
- Add function calling to integrate with internal tools, search, routing, and data services.

**Own the service layer**
- Ship APIs and workers in **Python** or **TypeScript** with clear contracts, streaming, and backoff.
- Add caching, request shaping, prompt templates, and context packing to control latency and cost.
- Integrate with **AWS Bedrock**, **OpenAI**, **Anthropic**, or self-hosted endpoints.

**Retrieval and data prep**
- Collaborate on chunking, embeddings, and indexing for documents, time series, and multimedia.
- Choose and tune vector backends such as **OpenSearch**, **pgvector**, or **Pinecone**.
- Keep knowledge bases fresh with data syncs from **S3**, **Aurora**, **DynamoDB**.

**Evaluation and quality**
- Create offline evals and golden sets for prompts, retrievers, and tools.
- Stand up online metrics for task success, hallucination rate, retrieval precision/recall, p95 latency, and cost.
- Run A/B tests and prompt/version rollouts with guardrails and canaries.

**Safety, privacy, and compliance**
- Implement content and policy checks, PII detection and redaction, access controls, and auditing.
- Design human-in-the-loop paths for sensitive actions.

**Operate what you build**
- Add tracing, logs, and dashboards for model calls, token usage, errors, and saturation.

## Requirements
- Shipped LLM apps and improved them with data.
- Strong builder: production code, tests, and docs; keep things simple and observable.
- RAG and tools depth: embeddings, chunking, vector search tradeoffs, function calling.
- Quality mindset: evals, success metrics, iterate on evidence.
- Cost and latency aware: track p95, hit SLAs, reduce cost.
- Clear communicator: explain tradeoffs, align partners.

## Nice to Have
- Experience with **Bedrock**, **OpenSearch Serverless**, **pgvector**, **Pinecone**, **Weaviate**.
- Prompt versioning, guardrails, provider routing.
- Multimodal work with time series or video.
- GPU inference, **Triton**, **TensorRT-LLM**.
- Aviation or safety-critical domain.
- DevOps basics: CI/CD, IaC, secure secrets.

## Similar roles

- [Senior Applied AI Engineer](https://hotfix.jobs/jobs/ab8a1230-ed55-42ca-9f6c-fcab0585ad96) - Arcade - San Francisco, CA - $130k – $265k/yr
- [Sr. Software Engineer, AI](https://hotfix.jobs/jobs/1b390816-b8a0-4b12-b56a-6e485a7b1a38) - NinjaTrader - Chicago, IL - $125k – $175k/yr
- [Senior ML Infrastructure Engineer](https://hotfix.jobs/jobs/3ab17770-9bbf-44f3-abf4-1e8bbf1a2a5e) - Applied Intuition - Sunnyvale, CA - $125k – $220k/yr
- [AI/Machine Learning Specialist](https://hotfix.jobs/jobs/237b941d-9938-491c-b644-fed5d0eb1c40) - Black Canyon Consulting - Bethesda, MD - $135k – $205k/yr
- [Software Engineering Lead, Machine Learning](https://hotfix.jobs/jobs/97f6bab1-54ba-4f3e-a0c4-9d5e90a4c570) - Ema - California - $135k – $300k/yr

**Apply:** https://hotfix.jobs/jobs/60dc27f2-5276-427a-8223-b90025704633
**Canonical:** https://hotfix.jobs/jobs/60dc27f2-5276-427a-8223-b90025704633