Senior Data Engineer

Company	Omnidian
Location	Seattle, WA, USA, Chicago, IL, USA, Pittsburgh, PA, USA, Albany, NY, USA, Denver, CO, USA
Salary	$120125 – $197625
Type	Full-Time
Degrees
Experience Level	Mid Level, Senior

4+ years experience building and optimizing data sets, ‘big data’ data pipelines, and architectures.
Experience successfully delivering large scale data engineering projects
Proficiency with distributed systems like Spark, Kafka and data lakes
Experience working with IoT data
Experience with cloud platforms like AWS or Azure
Understanding of data modeling principles
Proficiency with object oriented programming languages such as Python or Kotlin
Comfortable with SQL
Proven ability to perform root cause analysis on processes and data to identify improvement opportunities.
Demonstrated experience with data transformation, workload management, and metadata.

Build and maintain data warehouse pipelines via Databricks bronze, silver and gold medallion structures
Build and maintain data acquisition pipelines which acquire IoT data from aggregator portals, land and transform the data, and make the data available to consumer services
Use your knowledge of different programming languages to code and update data systems
Write or contribute to technical specification documents as appropriate
Create and maintain related data documentation as outlined in Data Governance standards
Act as an ambassador for data governance standards when working cross functionally
Participate in code reviews and change management processes
Identify, align stakeholders on and implement improvements to our processes, code and/or architecture.