Data Engineer
| Company | Brevian |
|---|---|
| Location | Sunnyvale, CA, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | Bachelor’s |
| Experience Level | Mid Level, Senior |
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 4+ years of experience in working with Data systems and Data pipeline, preferably for enterprise-level applications.
- Solid experience with big data systems, including Kafka, Apache Airflow, and building data pipelines.
- Familiarity with data modeling, ETL processes, and data warehousing.
- Understanding in cloud technologies like AWS (Amazon Web Services) related technologies such as Terraform, ECS, S3, RDS, and Opensearch.
- Experience with software development lifecycle (SDLC) practices, including coding standards, code reviews, source control management, build processes, and testing.
Responsibilities
- Design, develop, and maintain scalable, high-availability Data systems.
- Work closely with the development team to integrate cloud services and solutions, specifically within the AWS ecosystem.
- Implement and manage big data systems, including but not limited to Kafka, EMR, and data pipelines, to support data-driven decision-making.
- Ensure the security and integrity of application data in compliance with industry standards.
- Collaborate with cross-functional teams to identify and resolve performance bottlenecks.
- Provide technical mentorship to junior team members.
Preferred Qualifications
- Knowledge of Large Language Models (LLMs) is a significant plus.
- Strong analytical skills and the ability to tackle issues with innovative solutions.
- Security background and experience developing secure applications for enterprises is a plus.
- Ability to work in a fast-paced and dynamic environment and have a growth mindset.