Big Data Cloud Engineer
Company | Interpublic Group |
---|---|
Location | Jacksonville, AR, USA, Omaha, NE, USA, New York, NY, USA |
Salary | $100000 – $140000 |
Type | Full-Time |
Degrees | Bachelor’s |
Experience Level | Mid Level, Senior |
Requirements
- 4+ years of experience in deploying and managing Big Data workloads in Public Cloud environments using Databricks, Snowflake, and Amazon EMR.
- At least 3 years of experience in building and maintaining Public Cloud resources using Ansible and Terraform.
- 3+ years of hands-on scripting expertise in Spark, Perl, Python, or Bash Shell.
- 2+ years of experience in software and code management utilizing Git.
- A strong motivation to learn new technologies, coupled with a solid engineering mindset.
- A quick learner with excellent problem-solving skills, code-writing abilities, and a knack for building automation.
- A collaborative team player, eager to work closely with others to accomplish projects.
- Exceptional verbal and written communication skills.
- Bachelor’s degree in a related field or equivalent experience.
Responsibilities
- Build, manage, maintain, and optimize Big Data deployments in Public Cloud environments using Databricks, Snowflake, and Amazon EMR.
- Deploy and maintain Big Data solutions and Public Cloud resources using Infrastructure as Code tools (e.g., Terraform) on Amazon AWS, Microsoft Azure, and Google GCP.
- Provide data engineering support and services, including Databricks workflows, delta sharing, and notebooks.
- Automate repetitive tasks through hands-on programming with Perl, Bash, and/or Python.
- Optimize query performance and tuning for jobs running on Spark, Impala, and Hive.
- Deliver operational and on-call support, ensuring maximum service availability through monitoring, troubleshooting, and issue resolution.
Preferred Qualifications
- Experience in Data Engineering, Data Science, and Artificial Intelligence.
- Proficient knowledge of Linux systems.
- Expertise in administering Hadoop Infrastructure using Cloudera Data Platform.
- Hands-on experience with Database SQL