Senior Data Engineer
Company | General Motors |
---|---|
Location | Austin, TX, USA, Roswell, GA, USA, Warren, MI, USA |
Salary | $134000 – $205000 |
Type | Full-Time |
Degrees | Bachelor’s, Master’s |
Experience Level | Senior |
Requirements
- Bachelor’s Degree in Computer Science, Software Engineering, or a related field.
- 5+ years software engineering experience, with a focus on data engineering and proficiency in Java.
- Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure – preferred, AWS, GCP).
- Experience in building distributed data processing micro-services and high-quality, scalable data products.
- Strong background in data modelling, metadata management and data quality.
- Knowledge in both relational and non-relational DB and experience in Schema design.
- Good understanding and experience with CI/CD practices.
- Strong problem-solving and analytical skills.
Responsibilities
- Develop a scalable data platform to support continuing increases in data volume and complexity.
- Develop data pipelines to ingest, process, and curate large volumes of data using Apache Flink or similar technologies.
- Support the infrastructure required for optimal ingestion, transformation, and delivery of data.
- Collaborate with data scientists and analysts to support the needs of advanced ML development.
- Design and implement rigorous data validation, governance, and quality checks to uphold data integrity.
- Mentor & Support junior engineers by providing guidance, coaching and educational opportunities.
Preferred Qualifications
- Master’s degree in Computer Science, Software Engineering, or a related field.
- Data pipeline and workflow management tools: Luigi, Airflow, etc.
- Azure cloud services