Posted in

Big Data Cloud Engineer

Big Data Cloud Engineer

CompanyInterpublic Group
LocationJacksonville, AR, USA, Omaha, NE, USA, New York, NY, USA
Salary$100000 – $140000
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • 4+ years of experience in deploying and managing Big Data workloads in Public Cloud environments using Databricks, Snowflake, and Amazon EMR.
  • At least 3 years of experience in building and maintaining Public Cloud resources using Ansible and Terraform.
  • 3+ years of hands-on scripting expertise in Spark, Perl, Python, or Bash Shell.
  • 2+ years of experience in software and code management utilizing Git.
  • A strong motivation to learn new technologies, coupled with a solid engineering mindset.
  • A quick learner with excellent problem-solving skills, code-writing abilities, and a knack for building automation.
  • A collaborative team player, eager to work closely with others to accomplish projects.
  • Exceptional verbal and written communication skills.
  • Bachelor’s degree in a related field or equivalent experience.

Responsibilities

  • Build, manage, maintain, and optimize Big Data deployments in Public Cloud environments using Databricks, Snowflake, and Amazon EMR.
  • Deploy and maintain Big Data solutions and Public Cloud resources using Infrastructure as Code tools (e.g., Terraform) on Amazon AWS, Microsoft Azure, and Google GCP.
  • Provide data engineering support and services, including Databricks workflows, delta sharing, and notebooks.
  • Automate repetitive tasks through hands-on programming with Perl, Bash, and/or Python.
  • Optimize query performance and tuning for jobs running on Spark, Impala, and Hive.
  • Deliver operational and on-call support, ensuring maximum service availability through monitoring, troubleshooting, and issue resolution.

Preferred Qualifications

  • Experience in Data Engineering, Data Science, and Artificial Intelligence.
  • Proficient knowledge of Linux systems.
  • Expertise in administering Hadoop Infrastructure using Cloudera Data Platform.
  • Hands-on experience with Database SQL