Skip to content

Staff Software Engineer | GenAI & Agentic Workflows

Leads design and development of large-scale AI systems for document processing and agentic workflows in healthcare payment integrity. Requires 6+ years experience with Java/Python, productionizing LLMs/RAG, and distributed systems.

180k – 250kUnited StatesML EngineeringRemote6+ YOE

About the role

What You’ll Do

  • Lead development of document processing pipelines capable of annually handling hundreds of millions of documents, including medical records, claims, and benefits data.
  • Design and implement agentic workflows that review and validate millions of healthcare claims per year, ensuring accuracy and payment integrity.
  • Evolve our agentic ecosystem by driving innovation in prompt development lifecycle, optimal utilization of various flavors of multi-modal (text + vision) LLMs, context extraction, RAG, workflow orchestration frameworks, observability and logging, and explainability of LLM outputs.
  • Collaborate across teams (Data Science, Data Engineering, and Product) to deliver robust, end-to-end AI-powered systems that automate complex workflows.
  • Address critical infrastructure needs by tracking and reducing tech debt while strengthening system reliability and scalability.
  • Mentor and guide engineers on best practices in designing production-grade AI systems, helping set technical direction for the team.

What You’ll Bring

  • 6+ years of software engineering experience, including at least 2 years building agentic systems or AI-driven workflows in an enterprise setting.
  • Strong programming expertise in Java and Python, with additional experience in Scala a significant plus.
  • Experience designing and scaling large-scale, distributed systems and pipelines, ideally processing unstructured data such as documents or healthcare records.
  • Proven ability to productionize AI/ML techniques (e.g., LLM prompt engineering, RAG, workflow automation, and agents) with a focus on reliability, observability, and explainability.
  • Knowledge of monitoring and observability tools (Prometheus, Grafana or similar) and passion for tracking metrics.
  • Strong CS fundamentals, including data structures, asynchronous programming, and system design.
  • Demonstrated success in reducing manual processes through automation, ideally in healthcare, fintech, or other regulated domains.
  • Collaborative mindset with experience working closely with data scientists and cross-functional teams to translate requirements into technical designs and production systems.
  • A passion for pushing the boundaries of AI to deliver better-than-human-level accuracy and efficiency at scale.

Technical Requirements

  • Bachelor’s or Master’s degree in Computer Science or a related field (or equivalent practical experience).
  • Track record of building and shipping enterprise-grade AI/ML systems in production.
  • Strong testing and code quality discipline, with experience contributing to and improving enterprise-grade systems.
  • Experience with big-data tools and distributed systems frameworks (e.g., Spark, Flink, Kafka, Airflow, Ray) is a strong plus.

What We Offer

  • Work from anywhere in the US! Machinify is digital-first.
  • Top Medical/Dental/Vision offerings
  • FSA/HSA
  • Tuition reimbursement
  • Competitive salary, 401(k) with company match
  • Unlimited PTO
  • Additional health and wellness benefits and perks
  • Flexible and trusting environment where you’ll feel empowered to do your best work

The salary for this position is based on an array of factors unique to each candidate: Such as years and depth of experience, set skills, certifications, etc. We are hiring for different levels and the base salary can range from $180k-$250k+ based on your assessed level. Compensation also includes meaningful equity, healthcare, unlimited PTO, and more.

Skills

JavaPythonScalaLLMsRAGSparkFlinkKafkaAirflowRayPrometheusGrafanaKubernetes

Similar roles

ML Engineering jobs

Member of Technical Staff - X Search

Develops and operates large-scale search engine infrastructure, including retrieval algorithms, indexing, and ML ranking models integrated with Grok AI. Requires experience with search systems, vector databases, and production ML in Python, Go, or Rust.

180k – 440kPalo Alto, CAML EngineeringOn-siteGoRust

Member of Technical Staff - Post-Training and RL

Develops advanced post-training and reinforcement learning techniques like RLHF/DPO and reward modeling to enhance AI model reasoning, truthfulness, and real-world capabilities at xAI. Seeks passionate AI enthusiasts obsessed with truth-seeking models; prior experience preferred but not required.

180k – 600kPalo Alto, CAML EngineeringOn-siteDpoJAX

Member of Technical Staff - Multimodal Understanding

Develops large-scale distributed systems and pipelines for multimodal AI pre-training, post-training, and inference across image, video, audio, and text. Requires expert Python proficiency, experience with JAX/PyTorch/XLA, and scaling multimodal ML systems.

180k – 440kPalo Alto, CAML EngineeringOn-siteRlJAX

Staff Data Scientist | Modeling

Staff Data Scientist advances ML models for healthcare claims auditing, curating data, developing precise models, and optimizing business impact for health plans. Requires expertise in SQL, Python/R, and building ML models from scratch.

180k – 260kUnited StatesML EngineeringRemoteRSQL

Staff Data Scientist | Fraud / Billing

Leads development and deployment of ML and GenAI systems to detect billing errors, audits, and fraud in healthcare payments. Requires 5+ years data science experience, team management, and a degree in CS or related field.

180k – 230kUnited StatesML EngineeringRemote5+ YOESQLPython