Staff IT Data Engineer – IT Software Developer
| Company | Qualcomm |
|---|---|
| Location | San Diego, CA, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | |
| Experience Level | Senior |
Requirements
- 5+ Years of prior experience in Data Engineering and Databases
- 5+ years of Python programming experience
- Experience with ETL framework like Airflow, Dagster
- Experience with Apache Spark (PySpark), Apache Beam, relevant Big Data processing Frameworks
- Experience with system integration and real-time data pipelines using Kafka, Red Panda
- 4+ years of experience developing with GCP (BigQuery, PubSub, DataProc)
- Experience in advanced SQL using MPP databases like Clickhouse and administration is a plus.
- Experience creating data catalog for Data Lakes
- Proven track record of coding in a multi-developer environment – code collaboration, reviews, etc.
Responsibilities
- Develop, code and maintain systems to support the Analytics Infrastructure & Data Lake.
- Partner/Contribute on analytics requests and do statistical data analysis as needed.
- Development and operations of data pipeline and associated processes.
- Research and develop efficient, scalable, resilient, self-healing and reusable data engineering solutions.
- Design data recovery, reconciliation, and data life-cycle management processes.
- Collaborate with global team on projects and operations
- Participate in performance tuning efforts at code and infrastructure level.
- Building data quality as a process within the pipelines.
Preferred Qualifications
- Exposure to other programming languages like Rust, C++ are a plus.