Senior Software Engineer, Data Platform
Build and operate petabyte-scale data infrastructure powering Discord’s insights and products. The role requires 5+ years of software engineering experience, strong programming skills, and experience with large-scale pipelines, streaming, orchestration, or data warehousing.
About the job
Responsibilities
- Build and maintain data infrastructure processing petabytes of data across millions of users.
- Write clean, well-tested code for data ingestion, transformation, and serving systems.
- Own projects end-to-end, from design through deployment and production support.
- Collaborate with data scientists, engineers, and product teams to deliver solutions that power Discord's insights.
- Apply 80/20 thinking to challenge requirements, reduce unnecessary complexity, and deliver optimal solutions at the right time.
- Mentor teammates through code reviews, RFCs, and shared technical knowledge.
Requirements
- 5+ years of software engineering experience with strong programming skills in Python, Java, Rust, Go, or similar.
- Hands-on experience building or operating data infrastructure such as pipelines, streaming systems, orchestration, or data warehousing at scale.
- Proven track record of delivering complex, multi-phase projects autonomously, including handling edge cases, failure modes, and scale.
- Strong collaboration and communication skills, including with cross-functional partners.
- Ability to write clear technical documents, drive alignment, and communicate technical decisions.
- Growth mindset and a demonstrated ability to learn from failures and improve shipped work.
Nice to Have
- Passion for Discord and gaming.
- Familiarity with data governance, privacy compliance, or cost optimization in large-scale data environments.
Compensation
- US base salary range: $196,000–$245,000, plus equity and benefits.
- Compensation details reflect base salary only and exclude equity and benefits.
- Relocation assistance may be available.
Skills
Python, Java, Rust, Go, BigQuery, Kafka, Spark, Apache Flink, Apache Airflow, Dagster, Data Pipelines, Streaming Systems, Data Warehousing, Data Governance, Privacy Compliance
Similar jobs
Data Engineering jobs
Harvey
San Francisco, CABuild and lead the central data platform, covering ingestion, warehousing, orchestration, streaming, self-service frameworks, and trust layers. The role requires 5+ years of production data infrastructure experience, strong Python and SQL skills, and expertise with Snowflake and modern data tooling.
Datadog
Boston, MABuild and operate large-scale revenue data pipelines powering billing and cost attribution, while improving reliability, latency, and correctness. The role requires strong Spark and Airflow experience, cross-functional problem-solving, and operational ownership of mission-critical production systems.
Decagon
San Francisco, CASenior Data Infrastructure Engineer responsible for building and operating reliable, low-latency streaming and batch data systems that support AI products. Requires 5+ years of production data infrastructure experience and expertise with technologies such as Kafka, Flink, ClickHouse, and Terraform.
Coinbase
United States
Build and operate low-latency systems that capture, normalize, and distribute real-time market data for institutional trading. The role requires backend engineering experience, Java or C++, market data infrastructure knowledge, and exchange connectivity expertise.
Plaid
New York, NY
Build and own large-scale data models, batch and real-time pipelines, and data infrastructure that provide reliable datasets and insights across Plaid. The role requires 4+ years of data engineering experience, strong SQL and Python skills, and expertise with modern warehouses, lakes, and orchestration tools.