Designs and leads unified data architecture integrating vendor datasets for quantitative research, simulation, and alpha generation across asset classes. Requires 7+ years experience in data engineering, Python proficiency, and financial data modeling expertise.
175k – 200k/yr
On-site7+ YOEData Engineering
About the role
Responsibilities
Architect and implement a unified data platform that integrates hundreds of vendor datasets, providing consistent, accessible, and high-quality data to simulators and researchers.
Design efficient storage and retrieval systems to support both large-scale historical backtesting and high-frequency research workflows.
Develop intuitive researcher interfaces and APIs that allow users to easily discover variables, explore metadata, and assemble data into standardized stocks × values matrices for rapid hypothesis testing.
Collaborate closely with quantitative researchers and simulation teams to understand their workflows, ensuring the data platform meets real-world analytical and performance needs.
Establish best practices for data modeling, normalization, versioning, and quality control across asset classes and data vendors.
Work with infrastructure and DevOps teams to optimize data pipelines, caching, and distributed storage for scalability and reliability.
Prototype and deploy internal data applications that enhance research productivity and data transparency.
Mentor and guide data engineers to maintain robust, maintainable, and well-documented data systems.
Requirements
7+ years of experience in data architecture, quantitative research infrastructure, or large-scale data engineering in a financial or research-driven environment.
Proven experience designing and implementing scalable data storage solutions (e.g., columnar databases, time-series systems, object stores, or data lakes).
Strong proficiency in Python and familiarity with modern data stack technologies (e.g., Parquet, Arrow, Spark, SQL/NoSQL, distributed file systems).
Deep understanding of time-series and financial data modeling, including handling multiple vendors, instruments, and frequencies.
Experience building data interfaces, APIs, or tools that serve researchers, data scientists, or quantitative analysts.
Ability to translate research needs into efficient data schemas and access patterns.
Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, Mathematics, or a related quantitative field.
Strong collaboration, communication, and documentation skills.
Nice-to-Haves
Familiarity with cloud-based architectures (e.g., AWS, GCP, Azure) and modern data governance practices.
Compensation & Benefits
Base salary range: $175,000 - $200,000 depending on candidate’s background.
Bonus based on individual and company performance.
PPO health, dental, and vision insurance premiums fully covered.
Lead the development and maintenance of scalable data pipelines, warehouse, and transformation layer using modern data stack. Collaborate with data scientists and analysts to ensure clean, reliable data for insights in a high-growth startup.
174k – 230k/yr
Remote4+ YOEData Engineering
Engineering Manager II, Big Data Storage
PinterestPalo Alto, CA
Staff-level engineer leading design and development of Pinterest’s exabyte-scale data lake storage platform using Iceberg and related big data technologies to support ML/AI workloads.
177k – 365k/yr
Hybrid8+ YOEData Engineering
Senior Software Engineer, Data Centralization & Storage
AttentiveUnited States
Senior Software Engineer focused on architecting and scaling high-throughput data platforms for analytics, AI/ML, and centralized storage using Java, Spark, Flink, Kafka, and modern data lake technologies.
178k – 206k/yr
Remote5+ YOEData Engineering
Sr. Software Engineer
6senseSan Francisco, CA
Design and build scalable big data systems and ETL pipelines using Spark, Kafka, Hive and related technologies. Requires strong data modeling, SQL, and experience with AI coding assistants.
179k – 263k/yr
Remote5+ YOEData Engineering
Data Operations Lead
HappyRobotSan Francisco, CA
Lead data operations for AI audio models at HappyRobot. Translate research needs into data specs, manage end-to-end acquisition/annotation with internal and vendor teams, optimize tooling/workflows, and scale labeling operations to deliver high-quality datasets on time.