Senior Data Engineer

Senior Data Engineer

Requirements

• Minimum 8 years of relevant experience in an appropriate technology domain.
• Bachelor’s degree in Computer Science, Engineering, Information Systems or Technology, or related field.
• Advanced knowledge of the practical application of engineering science and technology, including data management principles, techniques, procedures, and equipment to the design and implementation of products.
• Strong proficiency in languages like Python or R.
• Experience in implementing machine learning models utilizing modules such as PyTorch, Scikit-learn, Panda, NumPy, TensorFlow.
• Prior experience with database and model design and segmentation techniques.
• Advanced understanding of SQL, Hands on coding of one or more bigdata programming language (SCALA, Python, etc.).
• Advanced knowledge and understanding of diverse data platforms, operating systems, cloud solutions, current and emerging technologies.
• Advanced knowledge of data governance practices.
• Subject Matter Expertise (SME) on three or more platforms in appropriate technology domain.
• Ability to obtain, analyze and synthesize information from multiple sources.
• Ability to provide guidance and solution design principles to all engineers.
• Ability to utilize industry standard project management, work management, and reporting software.
• Analytical mindset, focused on results with critical thinking, research and problem-solving, and decision-making skills.
• Proficiency in organization and time management skills with proven track record of meeting various deadlines.
• Proficiency in written and verbal presentation skills alongside strong data interpretation and visualization skills.
• Proficiency in the use of broader MS Office suite (Outlook, Teams, Word, PowerPoint, Excel, Project, Visio, SQL Server Management Studio, SSIS, SSRS, Visual Studio, Power BI).
• Knowledge of architecture and development of modern data echo system; streaming, batch, data modeling, and storage, analytical solutions.
• Ability to drive technology updates and implementations across data platforms.
• Ability to provide end-to-end solutions for LOBs.

Responsibilities

• Practical application of engineering science and technology, including applying principles, techniques, procedures, and equipment to the design and implementation of data warehouse and advanced analytical applications.
• Responsible for enhancing and maintaining TC’s data warehouse and analytical platforms.
• Proficiency in advanced analytical capabilities (machine learning, predictive modeling, artificial intelligence).
• Proficiency in various algorithms, models, and frameworks.
• Leverage debugging and testing processes and protocols to finalize code.
• Perform new feature exploration of each solution to determine feature-fit for strategic and tactical program activities.
• Design and develop machine learning algorithms and deep learning applications and systems.
• Train, retrain, and monitor machine learning systems and models as needed.
• Address planned and unplanned production issues, coordination, maintenance, communication and business support.
• Document and implement change control and best practices with regards to system maintenance, configuration, development, testing, and data integrity.
• Perform operations tasks such as monitoring application performance.
• Collaborate with other members of the engineering team to design new features.
• Identify areas for process and efficiency improvement.
• Perpetual improvement of data engineering practices to automate for manual processes.
• Partner with PMO team to run the Agile processes.
• Lead the craftsmanship, availability, resilience, and scalability of your solutions.
• Bring a passion to stay on top of tech trends, experiment with and learn new technologies, participate in internal & external technology communities, and mentor other members of the engineering community.
• Encourage innovation, implementation of cutting-edge technologies, inclusion, outside-of-the-box thinking, teamwork, self-organization, and diversity.

Preferred Qualifications

No preferred qualifications provided.