Posted in

Staff Software Engineer – Distributed Data Systems

Staff Software Engineer – Distributed Data Systems

CompanyDatabricks
LocationSan Francisco, CA, USA
Salary$192000 – $260000
TypeFull-Time
DegreesBachelor’s
Experience LevelSenior, Expert or higher

Requirements

  • BS in Computer Science, related technical field or equivalent practical experience.
  • 8+ years of production level experience in either Java, Scala or C++.
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop).

Responsibilities

  • Building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.
  • Developing the de facto open source standard framework for big data (Apache Spark™).
  • Delivering reliable and high performance services and client libraries for storing and accessing large amounts of data on cloud storage backends.
  • Creating a storage management system that combines the scale and cost-efficiency of data lakes with the performance and reliability of a data warehouse.
  • Building the next generation query optimizer and execution engine that is fast, tuning free, scalable, and robust.

Preferred Qualifications

  • Optional: MS or PhD in databases, distributed systems.