Skip to contentAzure Data Engineer – Mission Padlock
| Company | Accenture |
|---|
| Location | New York, NY, USA |
|---|
| Salary | $61.73 – $71.63 |
|---|
| Type | Full-Time |
|---|
| Degrees | Bachelor’s, Associate’s |
|---|
| Experience Level | Mid Level |
|---|
Requirements
- Minimum of 3 years of Data Engineering with Python
Responsibilities
- Create data driven generic framework components using Databricks, PySpark and the other data engineering tools
- Create new data pipelines leveraging existing data ingestion frameworks, tools
- Orchestrate data pipelines using the Azure Data Factory service.
- Develop/Enhance data transformations based on the requirements to parse, transform and load data into Enterprise Data Lake, Delta Lake
- Perform UnitTesting, coordinate integration testing and UAT
- Create HLD/DD/runbooks for the data pipelines
- Analyze source data, define DQ Rules to monitor and improve Data Quality
- Performance tuning/optimization
Preferred Qualifications
- Databricks Platform
- Databricks SQL
- Microsoft Azure Cloud Services
- Python on Azure
- Bachelor’s or Associate’s degree
