Senior Software Engineer, Platform

Responsibilities

• Integrating and optimizing LLM calls for structured extraction, form filling, and document understanding tasks
• Experimenting with new techniques and output structures to improve LLM accuracy and reduce latency
• Making improvements to API design and pre-processing algorithms (chunking, structured extraction, etc.) based on customer feedback
• Building and improving document processing pipelines that handle everything from PDFs to spreadsheets at scale
• Driving backend latency and costs down without sacrificing quality
• Building internal tooling and evals to better understand/analyze failure cases
• Working directly with the founders and customers to shape the product direction and engineering strategy

Requirements

• 5+ years of experience building, hardening and scaling real world applications
• 2+ years of experience integrating LLMs into production systems
• Exceptional with Python (or deep understanding of another language)
• Build your own tools as needed (e.g., Streamlit app to test hypotheses or create datasets)
• Quantitative approach to building products; ability to debug, experiment, and iterate fast
• High bar for quality; hands-on with full development lifecycle

Nice-to-Haves

• Prior experience founding a company or building products at early stages
• Experience with prompt engineering, fine-tuning, or building AI agents
• Experience delivering AI-powered products at internet scale
• Keep up with latest developments in ML/AI