Posted in

Staff Software Engineer – Platform – Data Pipeline

Staff Software Engineer – Platform – Data Pipeline

CompanyObsidian Security
LocationPalo Alto, CA, USA
Salary$189000 – $252000
TypeFull-Time
Degrees
Experience LevelSenior

Requirements

  • 5+ years of experience in data platform engineering, with a focus on data pipeline optimization.
  • Proven expertise in ElasticSearch, Databricks, ScyllaDB, and Kubernetes.
  • Experience with AWS cost optimization.
  • Solid understanding of distributed systems, databases, and performance tuning.
  • Strong analytical skills and a data-driven approach to problem-solving.
  • Excellent collaboration and communication skills.

Responsibilities

  • Analyze and enhance data pipeline stability, scalability, and cost efficiency.
  • Perform performance tuning of ElasticSearch, Databricks, ScyllaDB, and Kubernetes.
  • Collaborate with engineering and product leaders to align optimization efforts with business goals, ensuring no adverse impact on user experience.

Preferred Qualifications

    No preferred qualifications provided.