Scala/Python Big Data Development Manager
| Company | Citigroup |
|---|---|
| Location | Mississauga, ON, Canada |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | |
| Experience Level | Senior |
Requirements
- 6+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems.
- Experience as Applications Development Manager
- Any experience with python development is nice to have.
- Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines.
- Experience as senior level in an Applications Development role
- Stakeholder and people management experience
- Demonstrated leadership skills
- Proven project management skills
- Basic knowledge of industry practices and standards
- Consistently demonstrates clear and concise written and verbal communication
- Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN. AIRFLOW, DataOps, Data Management
- Programming and Scripting: Advanced knowledge of Scala and a good understanding of Python for data engineering tasks.
- Data Modeling and ETL Processes: Solid understanding of data modeling principles and ETL processes in big data environments.
- Analytical and Problem-Solving Skills: Strong ability to analyze and solve performance issues in Spark jobs and distributed systems.
- Version Control and CI/CD: Familiarity with Git, Jenkins, and other CI/CD tools for automating the deployment of big data applications.
Responsibilities
- Manage one or more Applications Development teams in an effort to accomplish established goals as well as conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions)
- Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
- Experience managing a data focused product, ML platform
- Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
- Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
- Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
- Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
- Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
- Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
- Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm’s reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency, as well as effectively supervise the activity of others and create accountability with those who fail to maintain these standards.
Preferred Qualifications
- Real-Time Data Streaming: Experience with streaming platforms such as Apache Kafka or Spark Streaming.
- Python Data Engineering Experience is Plus
- Financial Services Context: Familiarity with financial data processing, ensuring scalability, security, and compliance requirements.
- Leadership in Data Engineering: Proven ability to work collaboratively with teams to develop robust data pipelines and architectures.