Senior Software Engineer, Platform

Senior Software Engineer on the Platform team builds and optimizes core APIs and pipelines for document parsing using LLMs, integrates cutting-edge models, reduces latency/costs, and collaborates with ML engineers. Requires 5+ years experience with 2+ years in production LLMs and Python expertise.

About the job

Responsibilities

Integrating and optimizing LLM calls for structured extraction, form filling, and document understanding tasks
Experimenting with new techniques and output structures to improve LLM accuracy and reduce latency
Making improvements to API design and pre-processing algorithms (chunking, structured extraction, etc.) based on customer feedback
Building and improving document processing pipelines that handle everything from PDFs to spreadsheets at scale
Driving backend latency and costs down without sacrificing quality
Building internal tooling and evals to better understand/analyze failure cases
Working directly with the founders and customers to shape the product direction and engineering strategy

Requirements

5+ years of experience building, hardening and scaling real world applications
2+ years of experience integrating LLMs into production systems
Exceptional with Python (or deep understanding of another language)
Build your own tools as needed (e.g., Streamlit app to test hypotheses or create datasets)
Quantitative approach to building products; ability to debug, experiment, and iterate fast
High bar for quality; hands-on with full development lifecycle