Skip to content
Databricks Engineer
| Company | Synechron |
|---|
| Location | Mississauga, ON, Canada |
|---|
| Salary | $120000 – $125000 |
|---|
| Type | Full-Time |
|---|
| Degrees | |
|---|
| Experience Level | Junior, Mid Level |
|---|
Requirements
- Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
- Proficiency in Azure Cloud Services.
- Solid Understanding of Spark and PySpark for big data processing.
- Experience in relational databases.
- Knowledge on Databricks Asset Bundles and GitLab.
Responsibilities
- Build and maintain scalable ETL/ELT pipelines using Databricks.
- Leverage PySpark/Spark and SQL to transform and process large datasets.
- Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
- Work Closely with multiple teams to prepare data for dashboard and BI Tools.
- Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.
- Optimize Databricks workloads for cost efficiency and performance.
- Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
- Implement and manage data security, access controls and governance standards using Unity Catalog.
- Ensure compliance with organizational and regulatory data policies.
- Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
- Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.
Preferred Qualifications
- Familiarity with Databricks Runtimes and advanced configurations.
- Knowledge of streaming frameworks like Spark Streaming.
- Experience in developing real-time data solutions.
- Detail-oriented, ability to turn deliverables around quickly with a high degree of accuracy.
- Strong analytical skills, ability to interpret business requirements and produce functional and technical design documents.
- Good time management skills – Ability to prioritize and multi-task, handling multiple efforts at once.
- Strong desire to understand and learn domain.
- Experience in a financial services/banking industry.
- Ability to work in a fast-paced environment; to be flexible and learn quickly.
- Ability to multi-task with attention to detail/ prioritize tasks.
