Posted in

Senior Data Engineer

Senior Data Engineer

CompanyGeneral Motors
LocationAustin, TX, USA, Roswell, GA, USA, Warren, MI, USA
Salary$134000 – $205000
TypeFull-Time
DegreesBachelor’s, Master’s
Experience LevelSenior

Requirements

  • Bachelor’s Degree in Computer Science, Software Engineering, or a related field.
  • 5+ years software engineering experience, with a focus on data engineering and proficiency in Java.
  • Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure – preferred, AWS, GCP).
  • Experience in building distributed data processing micro-services and high-quality, scalable data products.
  • Strong background in data modelling, metadata management and data quality.
  • Knowledge in both relational and non-relational DB and experience in Schema design.
  • Good understanding and experience with CI/CD practices.
  • Strong problem-solving and analytical skills.

Responsibilities

  • Develop a scalable data platform to support continuing increases in data volume and complexity.
  • Develop data pipelines to ingest, process, and curate large volumes of data using Apache Flink or similar technologies.
  • Support the infrastructure required for optimal ingestion, transformation, and delivery of data.
  • Collaborate with data scientists and analysts to support the needs of advanced ML development.
  • Design and implement rigorous data validation, governance, and quality checks to uphold data integrity.
  • Mentor & Support junior engineers by providing guidance, coaching and educational opportunities.

Preferred Qualifications

  • Master’s degree in Computer Science, Software Engineering, or a related field.
  • Data pipeline and workflow management tools: Luigi, Airflow, etc.
  • Azure cloud services