Skip to content
Senior Data Engineer
| Company | SecurityScorecard |
|---|
| Location | Canada |
|---|
| Salary | $120000 – $145000 |
|---|
| Type | Full-Time |
|---|
| Degrees | |
|---|
| Experience Level | Senior, Expert or higher |
|---|
Requirements
- 8+ years of experience in the Data Engineering space.
- Strong proficiency with working in agile environments (ideally Scrum), collaborating with cross-functional teams (engineering, design, product).
- Strong proficiency in functional programming with Scala (with cats), Spark, Airflow, Hive, Redis for building batch data processing pipelines, and with Kafka for real-time data pipelines and event-driven architectures.
- Expertise with analytical databases (ClickHouse preferred), relational databases (PostgreSQL) and large-scale data systems with ETL processes (Apache Spark); experience with NoSQL distributed databases (Cassandra/ScyllaDB).
- Expertise with Jenkins for CI/CD, Terraform, and using Docker for containerization. Experience with AWS services (EC2, S3, Lambda, RDS, SQS/SNS etc.) for cloud-based application deployment and management.
- Experience with a variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, parquet).
- Strong focus on ensuring code quality and reliability through unit and integration tests, and continuous improvement of the codebase.
- Proficiency with version control tools, particularly Git, for collaborative development and code management.
- Excellent written and verbal communication skills, with the ability to articulate technical challenges and solutions clearly.
Responsibilities
- Design complex backend systems that are scalable, reliable, and maintainable.
- Own end-to-end projects across teams, understanding and contributing to all aspects (infrastructure, application tiers, and data tiers).
- Write clean, maintainable code that adheres to best practices in readability, design patterns, reusability, and testing. Review code, ensure quality and maintainability.
- Define and uphold engineering best practices and coding standards through setting technical direction, documentation, and maintaining standards across projects.
- Continuously monitor performance metrics and recommend improvements or refactors.
- Mentor senior and mid-level engineers. Share knowledge through documentation, talks, and pairing.
Preferred Qualifications
No preferred qualifications provided.
