Posted in

Senior Data Engineer

Senior Data Engineer

CompanyDiscord
LocationSan Francisco, CA, USA
Salary$196000 – $220500
TypeFull-Time
Degrees
Experience LevelSenior

Requirements

  • 4+ years of experience building data pipelines in production environments with high volumes of consumer data
  • 4+ years of experience in designing, developing, and maintaining robust data models from structured and unstructured sources
  • 4+ years of experience writing accurate and effective code in SQL and Python
  • Experience implementing and monitoring audits for data quality with massive data sets (e.g. billions of rows)
  • Experience proactively identifying opportunities to improve ETL & dashboard performance and cost
  • Experience leveraging excellent communication and stakeholder management skills to thrive in ambiguous environments where problems are not well-defined and evolve quickly
  • Experience collaborating directly with data science, machine learning, and product engineering teams
  • A desire to work with amazing, passionate people who care deeply about solving challenging problems to improve Discord
  • A collaborative attitude and a healthy dose of natural curiosity!

Responsibilities

  • Create and maintain data pipelines and foundational datasets to support analytics, modeling, experimentation, and product/business needs
  • Design and build database architectures with massive and complex data, balancing ergonomic benefits with computational load and cost
  • Collaborate closely with data science, machine learning, and engineering teams to improve the coverage, accuracy, and reliability of instrumentation
  • Develop audits for data quality at scale, implementing alerting and anomaly detection as necessary
  • Create scalable dashboards and reports to support business objectives and enable data-driven decision making
  • Partner with data scientists, engineers, and product teams to accomplish all of the above!

Preferred Qualifications

  • Passion for Discord or online communities
  • Experience owning and proactively improving the data models for a functional area leveraging deep knowledge of performant scalable patterns
  • Experience with modern data storage and processing technologies (i.e. BigQuery SQL, Airflow, and DBT or similar)
  • Experience with data visualization and dashboarding technologies (i.e. Looker, Tableau, or similar)
  • Experience with designing data architecture to power a variety of use cases, including experimentation