Posted in

Data Engineer

Data Engineer

CompanyGemini
LocationSeattle, WA, USA, Remote in USA, New York, NY, USA
Salary$104000 – $145000
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • 4+ years experience in data engineering with data warehouse technologies
  • 4+ years experience in custom ETL design, implementation and maintenance
  • 4+ years experience with schema design and dimensional data modeling
  • Advanced skills with Python and SQL are a must
  • Experience with one or more MPP databases (Redshift, Bigquery, Snowflake, etc)
  • Experience with one or more ETL tools (Informatica, Pentaho, SSIS, Alooma, etc)
  • Strong computer science fundamentals including data structures and algorithms
  • Strong software engineering skills in any server side language, preferable Python
  • Experienced in working collaboratively across different teams and departments
  • Strong technical and business communication

Responsibilities

  • Design, automate, build, and launch scalable, efficient and reliable data pipelines into production using Python
  • Design, build and enhance dimensional models for Data Warehouse and BI solutions
  • Research new tools and technologies to improve existing processes
  • Work closely with data analysts to understand data integration and modeling requirements
  • Develop new systems and tools to enable the teams to consume and understand data more intuitively
  • Perform root cause analysis and resolve production and data issues
  • Create test plans, test scripts and perform data validation
  • Tune SQL queries, reports and ETL pipelines
  • Build and maintain data dictionary and process documentation
  • Take ownership and can work autonomously

Preferred Qualifications

  • Kafka, HDFS, Hive, Cloud computing experience is a plus
  • Experience with Continuous integration and deployment
  • Knowledge and experience of financial markets, banking or exchanges