Senior AWS Data Engineer – Python/Terraform

Senior AWS Data Engineer – Python/Terraform

Requirements

• Ideally three (3) to five (5) years of large-scale data engineering, with at least one implementation in AWS, ideally using Redshift, Glue, S3, DMS, Step Functions and Lambdas.
• Experience in modern development lifecycle including Agile methodology, CI/CD, automated deployments, etc.
• Hands on knowledge of orchestration techniques that manage complex dependencies between inputs and processing steps.
• Hands on experience in Data Analytics, ETL, Database Queries.
• Hands on experience with AWS services is strongly preferred (Glue, Redshift, Lambda functions, S3, EC2, etc…).
• Expert in Python or another object-oriented language.
• Must have strong database skills (Oracle, SQL Server, ETL & ELT).
• Works without supervision and provides technical guidance when required on developing appropriate plans or performing necessary actions based on recommendations and requirements.
• Works without supervision and provides technical guidance when required on ensuring that IT applications meet required specifications by designing, executing and reporting on tests of systems and services.
• Works without supervision and provides technical guidance when required on managing information throughout its lifecycle by designing and executing appropriate architectures, policies and practices.

Responsibilities

• Research and recommend innovative technologies and approaches for private and public cloud infrastructure management, upgrades, or improvements, while adhering to technical or budgetary constraints.
• Develop existing applications and contribute to development of new applications by analyzing and identifying areas for modification and improvement. Develop new routine applications to meet customer requirements.
• Create and maintain technical and/or user documentation to a high standard, and back up files to ensure instant recovery if problems occur.
• Develop own capabilities by participating in assessment and development planning activities as well as formal and informal training and coaching; gain or maintain external professional accreditation, where relevant, to improve performance and fulfill personal potential. Maintain an understanding of relevant technology, external regulation, and industry best practices through ongoing education, attending conferences, and reading specialist media.
• Proactively plan capacity monitoring and scaling of platforms and applications.
• Obtain and evaluate information on factors such as costs, performance, and security to determine solution patterns and services.
• Participate in software system programming, validation, deployment, and documentation.
• Provide technical leadership, including mentoring others, gaining consensus across teams & individuals, substantiating technical decisions, validating team recommendations, integrating efforts into a comprehensive strategy, and delivering results on time.
• Writes and/or reviews system specifications, including output requirements, flow charts and technical diagrams.
• May occasionally work a non-standard schedule including nights and/or weekends and/or have on-call responsibilities.

Preferred Qualifications

• AWS Certifications preferred but not required.
• Financial Services industry knowledge is a plus.