Senior Data Engineer
| Company | EquipmentShare |
|---|---|
| Location | Chicago, IL, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | |
| Experience Level | Senior, Expert or higher |
Requirements
- 7+ years of relevant data platform development experience building production-grade solutions.
- Proficient with SQL and a high-order object-oriented language (e.g., Python).
- Experience with designing and building distributed data architecture.
- Experience building and managing production-grade data pipelines using tools such as Airflow, dbt, DataHub, MLFlow.
- Experience building and managing production-grade data platforms using distributed systems such as Kafka, Spark, Flink and/or others.
- Familiarity with event data streaming at scale.
- Proven track record learning new technologies and applying that learning quickly.
- Experience building observability and monitoring into data products.
- Motivated to identify opportunities for automation to reduce manual toil.
Responsibilities
- Collaborate with Product Managers, Designers, Engineers, Data Scientists and Data Analysts to take ideas from concept to production at scale.
- Design, build and maintain our data platform to enable automation and self-service for data scientists, machine learning engineers and analysts.
- Design, build and maintain data product framework to support EquipmentShare application data science and analytics features.
- Design, build and maintain CI/CD pipelines and automated data and machine learning deployment processes.
- Develop data monitoring, observability, and alerting capabilities using tools such as Prometheus, Grafana, or OpenTelemetry.
- Document architecture, processes and procedures for knowledge sharing and cross-team collaboration.
- Work on transforming event streams in real-time using technologies like Flink or Kafka Streams. Implement robust data quality and validation frameworks for streaming systems.
- Mentor peers to help them build their skills.
Preferred Qualifications
- Hands-on developer who enjoys solving complex problems and building impactful solutions.
- Takes the initiative to own outcomes from start to finish.
- Passionate about developing their craft and building quality, robust and scalable solutions.
- Sees learning opportunities when things don’t go to plan.
- Thrives in ambiguous, fast-paced environments and challenges assumptions.