Data Engineer
Company | Gemini |
---|---|
Location | Seattle, WA, USA, Remote in USA, New York, NY, USA |
Salary | $104000 – $145000 |
Type | Full-Time |
Degrees | Bachelor’s |
Experience Level | Mid Level, Senior |
Requirements
- 4+ years experience in data engineering with data warehouse technologies
- 4+ years experience in custom ETL design, implementation and maintenance
- 4+ years experience with schema design and dimensional data modeling
- Advanced skills with Python and SQL are a must
- Experience with one or more MPP databases (Redshift, Bigquery, Snowflake, etc)
- Experience with one or more ETL tools (Informatica, Pentaho, SSIS, Alooma, etc)
- Strong computer science fundamentals including data structures and algorithms
- Strong software engineering skills in any server side language, preferable Python
- Experienced in working collaboratively across different teams and departments
- Strong technical and business communication
Responsibilities
- Design, automate, build, and launch scalable, efficient and reliable data pipelines into production using Python
- Design, build and enhance dimensional models for Data Warehouse and BI solutions
- Research new tools and technologies to improve existing processes
- Work closely with data analysts to understand data integration and modeling requirements
- Develop new systems and tools to enable the teams to consume and understand data more intuitively
- Perform root cause analysis and resolve production and data issues
- Create test plans, test scripts and perform data validation
- Tune SQL queries, reports and ETL pipelines
- Build and maintain data dictionary and process documentation
- Take ownership and can work autonomously
Preferred Qualifications
- Kafka, HDFS, Hive, Cloud computing experience is a plus
- Experience with Continuous integration and deployment
- Knowledge and experience of financial markets, banking or exchanges