Skip to content
CloudflareCloudflareUnited States

Distributed Systems Engineer

Build and operate a scalable logging and audit log platform at Cloudflare, developing high-performance data connectors, integrations, and pipelines for secure, low-latency delivery to customer destinations. Requires 3+ years in distributed systems and data pipelines, strong Go (preferred) and observability skills.

Salary not listed
Hybrid3+ YOEData Engineering

About the role

Responsibilities

  • Design, build, and operate a robust logging platform, ensuring reliable logging, and secure data transfer to a wide array of customer destinations and third-party integrations.
  • Develop and maintain high-performance data connectors and integrations for our log-shipping products, focusing on usability, scalability and data integrity.
  • Create and manage systems for handling comprehensive audit logs, ensuring they are delivered securely and adhere to strict compliance and performance standards.
  • Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, identifying and removing bottlenecks in data processing and routing.
  • Work closely with Product and other engineering teams to define requirements for a new logging platform and integrations.
  • Maintain the operational health of our log delivery platform through comprehensive monitoring and participation in an on-call rotation (with flexibility for out-of-hours technical issue resolution).
  • Collaborate on the architectural evolution of our data egress platform, researching and implementing new technologies to improve efficiency and reliability.

Key Qualifications

  • 3+ years of experience working in software development covering distributed systems and data pipelines.
  • Strong programming skills (Go is preferable), with a deep understanding of software development best practices for building resilient, high-throughput systems.
  • Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
  • Strong knowledge of SQL, including experience with query optimisation.
  • A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
  • Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale.
  • Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.
  • Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus.
  • Experience with various logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (e.g., S3, R2, GCS) is a plus.
  • Experience with Infrastructure as Code tools like SALT or Terraform is a plus.
  • Experience with Linux container technologies, such as Docker and Kubernetes, is a plus.

Skills

GoDistributed SystemsData PipelinesPrometheusGrafanaSQLKafkaFlinkSplunkDatadogTerraformDockerKubernetes

Similar roles

Data Engineering jobs
OnePay

Data Analytics

OnePayUnited States

Senior Analytics Engineer owning OnePay's dbt models, Databricks BI, data quality, and semantic layers on a fast-moving fintech team. Requires 5+ years production analytics engineering, expert SQL/dbt, Databricks experience, and daily AI coding tool usage.

130k – 170k
Remote5+ YOEData Engineering
Hilbert

Forward Deployed Data Engineer (Integration)

HilbertSan Francisco, CA

Forward Deployed Data Engineer building hybrid data pipelines and semantic layers for Hilbert's AI Growth Engine. Implements warehouse-native or managed ClickHouse integrations, partners with AI agents for accelerated onboarding, and ensures reasoning consistency across customer environments.

Salary not listed
HybridData Engineering
The Voleon Group

Software Engineer, Data Infrastructure

The Voleon GroupNew York, NY +1

Software Engineer building scalable data infrastructure, cataloging, versioning, and lineage tools to support ML research and production workflows at an AI-driven hedge fund. Requires 3+ years experience, strong software design skills, and expertise in a modern language like Python or Java.

235k – 300k
Remote3+ YOEData Engineering
Hinge Health

Client Delivery Specialist

Hinge HealthSan Francisco, CA

Manage end-to-end file-based data integrations, ingestion, transformation, and maintenance for eligibility, marketing, and reporting. Own data integrity, resolve issues, automate workflows with AI, and partner cross-functionally with Customer Success, Engineering, and Revenue Operations teams.

80k – 120k
HybridData Engineering
xAI

Software Engineer

xAIPalo Alto, CA

Build and operate realtime and batch data pipelines processing billions of events daily at xAI. Design distributed data platforms, own data correctness, create shared datasets for product and business teams, and partner on data acquisition using tools like Spark, Kafka, Flink, and SQL.

125k – 400k
On-site3+ YOEData Engineering