Skip to content

Senior Software Engineer – Databricks x DBT
Company | Warner Bros. |
---|
Location | New York, NY, USA |
---|
Salary | $99400 – $184600 |
---|
Type | Full-Time |
---|
Degrees | |
---|
Experience Level | Senior |
---|
Requirements
- Strong experience in python, MLOps and data pipeline development
- Strong DBT (Data Build Tool) experience in building and architecting data pipelines and analytics workflows
- Expert in Databricks Platform (SQL, Compute, Clusters, ML, Workflows)
- Expert in Python language (Asynchronous, non-blocking, functional style of programming and experience implementing with Python)
- Expert SQL & NoSQL experience and query performance tuning
- Strong experience of streaming data, ML Ops and analytics workflows at scale
- Strong in (Python)PySpark, Notebooks and Data Science Libraries (Scipy, Numpy, Pandas, Scikit-learn)
- Experience of Looker (or other BI tools) for data visualization
- Experience in Experimentation and A/B testing
- Strong Observability (O11y), alerting and monitoring solutions with Grafana, Prometheus and PagerDuty
- Very strong Computer Science fundamentals in object-oriented design, architectural and design patterns, data structures & algorithms
- Very strong expertise in cloud computing and hands on experience in delivering large scale distributed systems on cloud platforms like AWS and Hashicorp Terraform
- Ability to apply strong analytical skills in delivering simple solutions for complex problems
- Background in Data Science & Data Engineering (including math and statistics functions)
- Very strong communication skills both written and verbal
- Ability to troubleshoot a production issue by reviewing source code, logs, operational metrics, stack trace, etc to pinpoint a specific problem and then resolve it
- Ability to identify root causes and identify learnings to improve both development processes and system design
- Experience working with data science teams to create models to improve the current experimentation platform.
Responsibilities
- Drive best practices and set standards for the team
- Influence team strategy and contribute significantly to team planning
- Collaborate with other engineers and team members to enhance productivity
- Share knowledge and help tie-break key technical decisions
Preferred Qualifications
No preferred qualifications provided.