Skip to content

Senior Data Engineer
Company | Discord |
---|
Location | San Francisco, CA, USA |
---|
Salary | $196000 – $220500 |
---|
Type | Full-Time |
---|
Degrees | |
---|
Experience Level | Senior |
---|
Requirements
- 4+ years of experience building data pipelines in production environments with high volumes of consumer data
- 4+ years of experience in designing, developing, and maintaining robust data models from structured and unstructured sources
- 4+ years of experience writing accurate and effective code in SQL and Python
- Experience implementing and monitoring audits for data quality with massive data sets (e.g. billions of rows)
- Experience proactively identifying opportunities to improve ETL & dashboard performance and cost
- Experience leveraging excellent communication and stakeholder management skills to thrive in ambiguous environments where problems are not well-defined and evolve quickly
- Experience collaborating directly with data science, machine learning, and product engineering teams
- A desire to work with amazing, passionate people who care deeply about solving challenging problems to improve Discord
- A collaborative attitude and a healthy dose of natural curiosity!
Responsibilities
- Create and maintain data pipelines and foundational datasets to support analytics, modeling, experimentation, and product/business needs
- Design and build database architectures with massive and complex data, balancing ergonomic benefits with computational load and cost
- Collaborate closely with data science, machine learning, and engineering teams to improve the coverage, accuracy, and reliability of instrumentation
- Develop audits for data quality at scale, implementing alerting and anomaly detection as necessary
- Create scalable dashboards and reports to support business objectives and enable data-driven decision making
- Partner with data scientists, engineers, and product teams to accomplish all of the above!
Preferred Qualifications
- Passion for Discord or online communities
- Experience owning and proactively improving the data models for a functional area leveraging deep knowledge of performant scalable patterns
- Experience with modern data storage and processing technologies (i.e. BigQuery SQL, Airflow, and DBT or similar)
- Experience with data visualization and dashboarding technologies (i.e. Looker, Tableau, or similar)
- Experience with designing data architecture to power a variety of use cases, including experimentation