Software Engineer – Batch Data
| Company | Tecton |
|---|---|
| Location | San Francisco, CA, USA |
| Salary | $197000 – $237000 |
| Type | Full-Time |
| Degrees | Bachelor’s, Master’s, PhD |
| Experience Level | Senior, Expert or higher |
Requirements
- Experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems (e.g. AWS EMR, Databricks, GCP Dataproc)
- Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs
- Knowledge of data formats such as Parquet, Avro, Arrow, Iceberg, or Delta Lake and object storage (e.g. S3, GCS)
- Expertise with cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations
- Experience with internals of distributed systems, SQL/NoSQL databases, data lakes, or data warehouses
- Strong communication skills and ability to write detailed technical specifications
- Excitement about coaching and mentorship of junior engineers
- BSc, MS, or PhD in Computer Science or related fields
- 8+ years of experience in building product software systems
Responsibilities
- Own and lead significant technical domains starting from the problem definition and technical requirements to implementation and maintenance
- Lead projects of strategic importance to Tecton spanning cross-functional teams including product management and other engineering teams
- Drive efforts to improve engineering practices, tooling, and processes along with mentorship for junior engineers
- Develop a deep understanding of the fundamental problems our customers face in building ML systems
- Be a generalist as needed. We’re a small, but growing engineering team and each engineer needs to be versatile
Preferred Qualifications
-
No preferred qualifications provided.