Posted in

Data Engineer

Data Engineer

CompanyAccenture
LocationNew York, NY, USA
Salary$51.06 – $61.06
TypeFull-Time
DegreesBachelor’s, Associate’s
Experience LevelMid Level, Senior

Requirements

  • Minimum of 4 years of work experience with one or more of the following: Databricks Data Engineering, DLT, Azure Data Factory, SQL, PySpark, Synapse Dedicated SQL Pool, Azure DevOps, Python

Responsibilities

  • Create new data pipelines leveraging existing data ingestion frameworks, tools
  • Orchestrate data pipelines using the Azure Data Factory service.
  • Develop/Enhance data transformations based on the requirements to parse, transform and load data into Enterprise Data Lake, Delta Lake, Enterprise DWH (Synapse Analytics)
  • Perform Unit Testing, coordinate integration testing and UAT Create HLD/DD/runbooks for the data pipelines
  • Configure compute, DQ Rules, Maintenance Performance tuning/optimization

Preferred Qualifications

  • Azure Function Apps
  • Azure Logic Apps
  • Precisely & COSMOS DB
  • Advanced proficiency in PySpark.
  • Advanced proficiency in Microsoft Azure Databricks, Azure DevOps, Databricks Delta Live Tables and Azure Data Factory.
  • Bachelor’s or Associate’s degree