Principal Data Engineer
| Company | Vistra |
|---|---|
| Location | Irving, TX, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | |
| Experience Level | Expert or higher |
Requirements
- 9-11 years of experience in data engineering, including experience in designing and building data pipelines
- Strong proficiency in data engineering technologies, such as ETL frameworks, big data processing, and SQL and NoSQL databases
- Deep understanding of database systems, data modeling, and data warehousing
- Experience with cloud-based data storage and processing technologies, such as AWS, Azure, or Google Cloud
Responsibilities
- Lead the design and development of scalable and reliable data pipelines, including data ingestion, processing, storage, and retrieval
- Develop data models and schemas that support efficient data storage, retrieval, and analytics, employing optimization techniques to enhance query performance and scalability
- Leverage big data technologies and frameworks (e.g., Hadoop, Spark, Hive) to process and analyze large volumes of data, enabling advanced analytics and machine learning initiatives
- Manage and optimize data infrastructure, including cloud-based platforms, containerization technologies, and distributed computing environments
- Work closely with other teams, including Data Science, Analytics, and Product, to understand their data needs and requirements
- Develop and implement best practices for data modeling, storage, and retrieval
- Ensure the security and privacy of our data and compliance with relevant regulations
- Develop and maintain documentation for all data processes and systems
- Evaluate new technologies and tools for data processing, storage, and retrieval and recommend solutions to improve the efficiency and scalability of our data infrastructure
- Propose and lead continuous improvement opportunities
- Mentor team members to develop their technical and leadership skills
Preferred Qualifications
- Understanding of data privacy and data governance policies
- Strong problem-solving and analytical skills
- Ability to work collaboratively in a team environment
- Strong communication and interpersonal skills
- Ability to lead and manage projects
- Experience in leading a team of data engineers and managing complex projects
- Strong problem-solving skills and ability to work in a fast-paced environment
- Excellent communication skills and ability to work collaboratively with cross-functional teams
- Experience with agile software development methodologies