# Software Architect

**Company:** [Machinify](https://hotfix.jobs/companies/machinify)
**Location:** Remote
**Role:** Backend Engineering
**Salary:** $230k – $280k/yr
**Experience:** 10+ years
**Skills:** Python, Scala, Java, LLMs, RAG, API Design, Distributed Systems, Prompt Engineering, Workflow Orchestration, Observability, Spark, Flink, Kafka, Airflow, Ray
**Posted:** 2026-04-17

> Designs and implements intelligent document processing and agentic evaluation frameworks for healthcare AI platform, owning architecture from APIs to production code. Requires 10+ years experience with Python/Scala, LLM integration, and scalable systems.

## Job Description

## What You'll Do

- Own the architecture of Machinify's intelligent document processing platform and agentic evaluation framework — from API design to implementation
- Design abstractions and interfaces that enable agentic workflows to reason over medical records, claims data, and unstructured healthcare documents
- Define the boundaries between orchestration, retrieval, LLM interaction, and domain logic — creating a framework that is principled yet pragmatic. Ensure the system scales.
- Write performant production code — this is a hands-on role where you lead through implementation, not solely through design documents.
- Make foundational technology decisions around **prompt architecture**, **multi-modal LLM integration**, **RAG patterns**, and **workflow orchestration**
- Drive reliability and observability into AI systems that must operate at healthcare-grade standards
- Collaborate closely with Data Science, Data Engineering, and Product teams to translate complex domain requirements into clean system design
- Reduce technical debt and establish architectural patterns that scale with the platform
- Mentor engineers on system design, API design, and building production-grade AI systems

## What We're Looking For

- **10+ years** of software engineering experience with a proven track record of owning system architecture at scale
- Experience with **Python** & **Scala/Java** — deep experience designing Python-based frameworks and writing idiomatic, well-structured APIs in Python and Scala/Java.
- Demonstrated ability to design effective abstractions: knowing when to generalize, when to keep things concrete, and where to draw boundaries in complex systems
- Experience architecting agentic or multi-step reasoning systems that integrate **LLMs** into production workflows — framework-agnostic design thinking is valued over familiarity with any specific tool
- Strong background in designing large-scale systems that process unstructured data such as documents, medical records, and images
- Deep understanding of **API design** principles and building platforms that other engineers build upon
- Proven ability to productionize **AI/ML systems** with a focus on reliability, observability, and maintainability
- Strong experience with designing with system performance and scaling trade-offs in mind
- Strong **CS fundamentals** — data structures, distributed systems, asynchronous programming
- Bachelor's or Master's degree in Computer Science, or equivalent experience

## Nice to Have

- Experience with **Spark**, **Flink**, **Kafka**, **Airflow**, or **Ray**
- Knowledge of **Prometheus**, **Grafana**, and observability tooling
- Background in healthcare, fintech, or other regulated industries
- Cross-functional collaboration experience with data scientists and ML engineers

## What We Offer

- Competitive salary, **401(k)** with company match
- **Unlimited PTO**
- Additional health and wellness benefits and perks

## Similar roles

- [Staff Software Engineer](https://hotfix.jobs/jobs/a77b152b-1449-47f3-ae51-4bdc7baa3fcf) - Tines - Remote - $230k – $250k/yr
- [Senior Member of Technical Staff](https://hotfix.jobs/jobs/14c428b1-f836-4085-98f3-0cf788f59d52) - Anterior - New York, NY - $230k – $300k/yr
- [Staff Software Engineer](https://hotfix.jobs/jobs/71353045-738d-4930-9200-b3c2d308dc08) - Maybern - New York, NY - $230k – $270k/yr
- [Staff Backend Software Engineer](https://hotfix.jobs/jobs/7374dc0a-c841-455d-a936-83b730367934) - Semgrep - San Francisco, CA - $230k – $288k/yr
- [Software Engineer, Monetization Infrastructure (SF/Seattle)](https://hotfix.jobs/jobs/148d2eb1-2038-4d9d-981b-bdc836861333) - OpenAI - San Francisco, CA - $230k – $385k/yr

**Apply:** https://hotfix.jobs/jobs/8b901b0f-55af-4428-9aad-768257c998bd
**Canonical:** https://hotfix.jobs/jobs/8b901b0f-55af-4428-9aad-768257c998bd