Skip to content
DatabricksDatabricksUnited States

Staff Security Detection Engineer

Designs and implements scalable ML-driven intrusion detection solutions, optimizes log pipelines, and enhances threat detection on Databricks platform. Requires 10+ years experience in security detection engineering and expertise in cloud security, Python, and Spark.

143k – 273k
Remote10+ YOESecurity Engineering

About the role

Key Responsibilities

  • Design and implement advanced detection strategies by analyzing new log sources, schemas, and raw data.
  • Collaborate with product and data engineering teams to build efficient log ingestion pipelines and support large-scale data analytics.
  • Engineer and deploy detection solutions on Databricks using Spark, Python, and other technologies with clean code, testing, and documentation.
  • Develop rule-based and ML-based intrusion detection models integrated with Databricks platform for high accuracy and low false positives.
  • Partner with Incident Response teams for threat hunting, providing logging, alerts, and playbooks.
  • Influence long-term technology strategies and roadmaps for detection engineering.
  • Represent Databricks at security and engineering conferences.

What We Look For

  • 10+ years of relevant experience or advanced degree + 7 years in security detection engineering.
  • 6+ years of software engineering, with 4+ years in security-related engineering, especially detection.
  • Expertise in securing/operating at least one major cloud (AWS, Azure, GCP).
  • Strong proficiency in network security, cloud security, application/log analysis, endpoint security.
  • Proven experience in Python, Git/GitHub, CI/CD (Terraform a plus).
  • Familiarity with PySpark, SQL, data analysis tools, machine learning.
  • Passion for learning attack techniques and defense strategies.
  • Excellent communication and leadership skills.

Skills

PythonPysparkSparkMachine LearningSQLAWSAzureGCPGitTerraform

Similar roles

Security Engineering jobs
Okta

Staff Product Security Engineer

OktaBellevue, WA +4

Staff-level product security engineer leading security reviews, threat modeling, penetration testing, and LLM/AI security assessments for Okta's identity platform. Requires deep manual security expertise and strong communication skills.

141k – 248k
Hybrid7+ YOESecurity Engineering
NinjaTrader

Staff Cloud Security Engineer

NinjaTraderChicago, IL

Senior individual contributor owning cloud security architecture and guardrails for GCP workloads at a fintech trading platform. Leads threat modeling, edge defenses with Cloudflare/Armor, policy-as-code, incident response, and compliance controls while mentoring engineers.

145k – 195k
Hybrid8+ YOESecurity Engineering
Shield AI

Staff Engineer, Systems Safety (R4823)

Shield AISan Diego, CA

Leads safety requirements derivation, hazard analysis, and verification for safety-critical airborne software systems, ensuring compliance with DO-178C and related standards. Collaborates across engineering teams to integrate safety into architecture, code, and testing for airworthiness certification.

140k – 210k
On-site5+ YOESecurity Engineering
LiveKit

Staff Security Engineer

LiveKitUnited States

Staff Security Engineer owns security across applications, infrastructure, and workflows at LiveKit. Requires 6+ years software engineering experience, hands-on security expertise in cloud/container environments, threat modeling, and incident response.

150k – 250k
Remote6+ YOESecurity Engineering
Okta

Staff Security Engineer

OktaSan Francisco, CA

Staff Security Engineer embedded in TDI to build centralized security posture analytics, automate issue tracking and remediation, and drive AI-powered risk management across AWS, SaaS apps, and enterprise systems.

134k – 185k
On-site10+ YOESecurity Engineering