Data Engineer III

Data Engineer III

Requirements

• Bachelor’s degree, or its foreign equivalent, in Computer Science, Computer Engineering, Data Engineering or other closely related technical field
• At least five (5) years of experience as a Data Engineer III, or in a related IT role
• 3 years of experience creating, loading, and transforming data store leveraging ETL/ELT on cloud native platform, including Microsoft Azure, with cloud data warehousing technology, including Azure Data Lake Store
• 3 years of experience creating applications and features in relational databases, including Microsoft SQL Server, schema design, stored procedure development and performance and optimization techniques
• 3 years of experience translating business requirements, communicating technical and business concepts, and participating in code reviews
• 3 years of experience designing and implementing complex data acquisition, data curation and data analysis projects including analyzing, defining data models, establishing, and documenting best practices, standards, and governance
• 3 years of experience with enterprise scheduling or directed acyclic graph (DAG) based tools

Responsibilities

• Guide the team’s engineering process, setting data standards, mentoring other data engineers, and driving innovation
• Participate on the North America Surface Transportation Domain Analytics team to build accessible and scalable domains
• Integrate existing analytics solutions into a new cloud environment
• Make data broadly available through a service-oriented architecture
• Analyze and translate high-level customer requirements into detailed designs
• Partner with various engineering teams to create and manage long-term data and information architecture/execution roadmap
• Lead development of scalable data pipelines, establish data management frameworks, and maintain CI/CD pipelines
• Increase code quality through code reviews and writing unit, integration, and acceptance tests
• Collaborate with team to define testing strategy and drive quality throughout the engineering lifecycle through unit and integration tests
• Proactively identify performance and availability issues, troubleshoot, provide effective options, and resolve issues in production spanning multiple product areas
• Develop and maintain technical documentation for the product or service
• Write code using secure programming patterns and by finding, fixing, and enhancing security in existing applications
• Estimate for software projects including dependencies, work, time, resources, and skill needs
• Maintain knowledge of emerging technologies
• Mentor and coach other engineers by participating in design and code reviews and share best practices
• Adopt and establish best practices
• Collaborate with leadership to successfully deliver high quality software

Preferred Qualifications

No preferred qualifications provided.