Senior Lead Data Engineer

Senior Lead Data Engineer

Requirements

• Technical background in computer science, software engineering, database systems, distributed systems
• Familiarity with statistics, data science, and machine learning
• A compelling track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing value
• Proven ability to design scalable architecture tailored to client requirements, ensuring alignment with budgetary constraints, project timelines, and financial objectives through effective trade-off analysis
• Expertise in applying best practices for various data architectures (e.g., event-driven, batch, real-time data integrations) focusing on efficient solutions that meet project needs without unnecessary complexity
• Direct experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scale
• Ability to context-switch, to provide support to dispersed teams which may need an ‘expert hacker’ to unblock an especially challenging technical obstacle, and to work through problems as they are still being defined
• Demonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver value
• An ‘engineering’ mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact
• Comfort with working with distributed teams on code-based deliverables, using version control systems and code reviews
• Ability to conduct data analysis, investigation, and lineage studies to document and enhance data quality and access
• Fluency with distributed and cloud environments and a deep understanding of how to balance computational considerations with theoretical properties
• Use of agile and DevSecOps practices for project management and software delivery
• Demonstrated expertise building backend services with some of the following common languages and tools: Pandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter and other Python data tools, Spark (Scala and PySpark), HDFS, Kafka and other high volume data tools, SQL and NoSQL database technologies, such as MySQL, Postgres, Cassandra, MongoDB and ElasticSearch
• Interest/background across sectors (e.g, Financial Services; Health and Life Sciences; Consumer, Retail, Energy, or Transportation)
• A minimum of 6+ years of experience as a data engineer

Responsibilities

• Understanding the overall problem being solved and what flows into it
• Building tools, platforms, and pipelines to enable teams to clearly and cleanly analyze data, build models, and drive decisions
• Lead and mentor a team of engineers, fostering a culture of collaboration, innovation, and continuous improvement
• Determining and fulfilling functional and non-functional requirements while ensuring alignment with budgetary and financial objectives
• Scaling up from ‘laptop-scale’ to ‘cluster scale’ problems, in terms of both infrastructure and problem structure and technique
• Delivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplines
• Codifying best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases
• Engage with stakeholders across various levels to ensure project alignment and manage expectations effectively
• Collaborating with clients to understand, advise, and recommend on strategic sourcing (internal versus external)
• Joining colleagues in an Oliver Wyman office or client site at least 50% of the time to collaborate and learn

Preferred Qualifications

• An undergraduate or advanced degree from a top academic program
• Willingness to be agnostic to a variety of programming languages (e.g. Python, Java, C#, GoLang) and technical stack based on client requirements
• A genuine passion for technology and solving problems
• A pragmatic approach to solutioning and delivery
• Excellent communication skills, both verbal and written
• A clear commitment to creating impactful solutions that solve our clients’ problems
• The ability to work fluidly and respectfully with our incredibly talented team
• Willingness to travel