Skip to content
Staff Data Engineer – Data Analytics & Workflows
| Company | AiDash |
|---|
| Location | Palo Alto, CA, USA |
|---|
| Salary | $190000 – $230000 |
|---|
| Type | Full-Time |
|---|
| Degrees | Bachelor’s |
|---|
| Experience Level | Senior, Expert or higher |
|---|
Requirements
- 8+ years of experience in data engineering, with hands-on experience designing and building data pipelines and architectures
- 4+ years experience in building data pipes, datalakes and datawarehouse
- Proficient in programming languages such as Python, Java, or Scala, and experience with data processing frameworks like Apache Spark or Hadoop
- Familiarity with data warehousing solutions like Snowflake, Redshift, or BigQuery
- Strong knowledge of ETL/ELT concepts, frameworks or tools (e.g., Apache Airflow, Talend, DBT, or similar)
- Deep understanding of data modeling techniques, and data warehouse design
- Knowledge of Data Security and Governance (nice to have)
- BS/BA in a technical field such as Computer Science
Responsibilities
- Design and build scalable data pipelines: Architect and implement data workflows for high-volume, high-complexity datasets, ensuring data is reliable, accurate, and accessible for analytics and machine learning applications
- Data architecture: Take ownership of designing and maintaining data architecture and storage solutions
- Performance tuning and optimization: Continuously optimize data workflows for performance, scalability, and cost-efficiency, including working with big data tools and cloud platforms
- Cross-functional Collaboration: Support data science, machine learning and business operations functions
- Infrastructure reliability and pipeline monitoring: Monitor and maintain pipelines and infrastructure to uphold internal SLAs
Preferred Qualifications
- Experience with machine learning workflows and integrating data engineering systems with ML model training and inferencing
- Knowledge of satellite-generated data and geo-spatial technologies
