Posted in

Senior Software Engineer – Databricks x DBT

Senior Software Engineer – Databricks x DBT

CompanyWarner Bros.
LocationNew York, NY, USA
Salary$99400 – $184600
TypeFull-Time
Degrees
Experience LevelSenior

Requirements

  • Strong experience in python, MLOps and data pipeline development
  • Strong DBT (Data Build Tool) experience in building and architecting data pipelines and analytics workflows
  • Expert in Databricks Platform (SQL, Compute, Clusters, ML, Workflows)
  • Expert in Python language (Asynchronous, non-blocking, functional style of programming and experience implementing with Python)
  • Expert SQL & NoSQL experience and query performance tuning
  • Strong experience of streaming data, ML Ops and analytics workflows at scale
  • Strong in (Python)PySpark, Notebooks and Data Science Libraries (Scipy, Numpy, Pandas, Scikit-learn)
  • Experience of Looker (or other BI tools) for data visualization
  • Experience in Experimentation and A/B testing
  • Strong Observability (O11y), alerting and monitoring solutions with Grafana, Prometheus and PagerDuty
  • Very strong Computer Science fundamentals in object-oriented design, architectural and design patterns, data structures & algorithms
  • Very strong expertise in cloud computing and hands on experience in delivering large scale distributed systems on cloud platforms like AWS and Hashicorp Terraform
  • Ability to apply strong analytical skills in delivering simple solutions for complex problems
  • Background in Data Science & Data Engineering (including math and statistics functions)
  • Very strong communication skills both written and verbal
  • Ability to troubleshoot a production issue by reviewing source code, logs, operational metrics, stack trace, etc to pinpoint a specific problem and then resolve it
  • Ability to identify root causes and identify learnings to improve both development processes and system design
  • Experience working with data science teams to create models to improve the current experimentation platform.

Responsibilities

  • Drive best practices and set standards for the team
  • Influence team strategy and contribute significantly to team planning
  • Collaborate with other engineers and team members to enhance productivity
  • Share knowledge and help tie-break key technical decisions

Preferred Qualifications

    No preferred qualifications provided.