Posted in

Data Engineer III+ – Analytics – MS Data Fabric – Focus

Data Engineer III+ – Analytics – MS Data Fabric – Focus

CompanyExpeditors
LocationVan Buren Charter Township, MI, USA
Salary$Not Provided – $Not Provided
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • Bachelor’s degree in an IT-related field or equivalent experience.
  • 3-5 years of experience in data transformation, data modeling, and analytics engineering.
  • Strong experience with SQL and query optimization across multiple databases.
  • Proficiency in Python for data processing and automation.
  • Experience with Airflow or other workflow orchestration tools.
  • Experience with Azure cloud-based data solutions.
  • Hands-on experience with ETL/ELT frameworks and workflow automation tools.
  • Strong understanding of data modeling and schema design for analytics and reporting.
  • Hands-on experience migrating on-prem data pipelines to the cloud, including strategy, execution, and optimization.
  • Experience with Power BI performance optimization and integrating Power BI with Azure.
  • Demonstrated ability to collaborate with cross-functional teams and stakeholders.

Responsibilities

  • Design and develop data models to support BI and analytics, focusing on performance and scalability.
  • Build and maintain data pipelines that transform raw data into clean, usable data sets.
  • Perform data transformations using SQL and scripting languages (e.g., Python).
  • Collaborate with data engineers to ensure data availability and integrity.
  • Validate data outputs for accuracy and consistency through rigorous testing.
  • Implement data quality checks and maintain data documentation.
  • Work with stakeholders to define metrics, KPIs, and reporting needs.
  • Support the migration of on-prem solutions to the cloud.
  • Support BI tools (e.g., Power BI) by building efficient data models that enhance performance.
  • Participate in code reviews and contribute to team best practices such as documenting data models and processes, and enforcing data governance and security.
  • Monitor pipeline performance and address data inconsistencies and bottlenecks.
  • Collaborate with the team to optimize database performance and storage solutions.

Preferred Qualifications

  • Experience with Azure Fabric, Azure Synapse, or Databricks.
  • Familiarity with infrastructure-as-code (Terraform, ARM templates).
  • Experience with data transformation tools such as dbt.
  • Understanding of data governance and compliance (GDPR, CCPA, etc.).
  • Experience working in Agile environments with CI/CD processes.
  • Certifications in Azure Data Engineering or other relevant cloud technologies.
  • Understanding of data visualization best practices.