Posted in

Staff – Data Engineer

Staff – Data Engineer

CompanyWalmart
LocationBentonville, AR, USA
Salary$110000 – $220000
TypeFull-Time
DegreesBachelor’s, Master’s
Experience LevelSenior, Expert or higher

Requirements

  • Bachelors/masters degree in computer science or a related field
  • 8+ years experience in development of big data technologies/data pipelines
  • Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential
  • Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.)
  • Expertise in building idempotent workflows using orchestrators like Airflow
  • Expertise in writing SQL to analyze, optimize, profile data preferably in Big Query or SPARK SQL
  • Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets
  • Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development / data solution work
  • Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process
  • Ability to move at a rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this initiative
  • Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.

Responsibilities

  • Design, Build and Enhance high performance reusable framework for data pipeline
  • Develop and deploy cutting edge solutions at scale, impacting millions of customers worldwide to drive value from data at Walmart Scale
  • Support People Data applications ensuring Data Quality and Governance standards
  • Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the technical community
  • Provide guidance and mentorship to junior data engineers
  • Ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.

Preferred Qualifications

  • Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud
  • Master’s degree in Computer Science or related field and 4 years’ experience in software engineering or related field
  • Background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.