# Staff Software Engineer, Alerting Platform

**Company:** [CommandLink](https://hotfix.jobs/companies/commandlink)
**Location:** Remote
**Role:** Backend Engineering
**Experience:** 7+ years
**Skills:** Go, Python, Kafka, Opensearch, OpenTelemetry, Syslog, Netflow, Sflow, Snmp, Icmp, Flink, Protocol Buffers, Temporal, Kubernetes, Memgraph
**Posted:** 2026-08-11

> Leads architecture and reliability for a high-scale alerting platform, spanning detection, correlation, event delivery, and downstream notifications. The role requires deep Kafka, Go or Python, telemetry and network-protocol expertise, plus experience with idempotent, cloud-native production systems.

## Job Description

## Responsibilities

- Set the architecture for evaluating rule-based thresholds, ML anomaly scores, and correlation logic to produce high-fidelity alerts.
- Own the reliability of the alerting pipeline end to end, including OpenSearch alert evaluation, Kafka delivery, callbacks, downstream notification, idempotency, and sustained-load behavior.
- Correlate security tooling, monitoring telemetry, syslog, OpenTelemetry, and L2–L4 network protocols into network and system topologies and dependency maps.
- Make topology context usable for LLM-based investigation, troubleshooting, correctness, and remediation workflows.
- Establish the technical foundation for generating alert definitions from normalized data models using LLMs.
- Provide architectural guidance across Command|Alert teams and workstreams.
- Balance new correlation and detection capabilities with long-term scalability and reliability.
- Mentor engineers and represent the technical direction to external stakeholders.

## Requirements

- Production experience designing, building, or operating high-reliability alerting or notification systems at scale.
- Experience running rule-based and ML-based detection logic against real traffic.
- Strong Kafka experience, including producing and consuming event streams for downstream delivery.
- Command of security tooling output, monitoring telemetry, syslog, OpenTelemetry, NetFlow or sFlow, SNMP, ICMP, and firewall logs.
- Experience building systems with reliable webhooks, idempotency, and delivery guarantees under load.
- Recognized mastery of Go and/or Python.
- Experience with container orchestration and multi-cloud environments.
- Ability to make organization-level architecture and technology decisions.

## Nice to Have

- Temporal or comparable workflow orchestration experience.
- Experience using LLMs with structured system or network data.
- Familiarity with Flink, Protocol Buffers, Argo, or Spacelift.
- Familiarity with Memgraph or another graph store.
- Experience with osquery, Steampipe, or similar endpoint and cloud inventory tooling.
- Experience in multi-tenant, cloud-native environments with secrets management and TLS at scale.

## Benefits

- Room to grow at a high-growth company.
- Innovative environment with meaningful impact.
- Flexible time off.
- Fun events.
- Employee referral bonuses.

## Similar jobs

- [Sr. Staff Engineer - Payments & Commerce Platform](https://hotfix.jobs/jobs/153f52a7-9c89-4b7b-b5f1-fd9fa8b0f5d8) - GoHighLevel - Remote
- [Staff Software Engineer - Financial Integrity](https://hotfix.jobs/jobs/628b08cc-4a96-4422-8259-827b91dafd1e) - Rippling - Bengaluru, India
- [Staff Backend Engineer](https://hotfix.jobs/jobs/127bb501-4fd5-435d-92d9-d47c9bf13f75) - GitLab - Remote - $153k – $259k/yr
- [Staff Software Engineer, Security Platform](https://hotfix.jobs/jobs/4781c25d-fac1-4310-82f6-3708762dc1df) - Coinbase - Remote - ₹9.4M – ₹9.4M/yr
- [Staff Engineer](https://hotfix.jobs/jobs/266a6958-bad8-43f5-a0de-de4c0c7c2e8e) - Reltio - Bengaluru, India

**Apply:** https://hotfix.jobs/jobs/1d73047d-17aa-473b-ba83-61f918f97a34
**Canonical:** https://hotfix.jobs/jobs/1d73047d-17aa-473b-ba83-61f918f97a34