Posted in

Senior Data Engineer

Senior Data Engineer

CompanyRxSense
LocationPrinceton, NJ, USA
Salary$150000 – $170000
TypeFull-Time
DegreesBachelor’s
Experience LevelSenior, Expert or higher

Requirements

  • Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms.
  • Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS.
  • 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS.
  • Experience in business intelligence, data warehousing initiatives.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake.
  • Strong SQL and Python skills with experience in query optimization and performance.
  • Strong analytical, problem-solving, and communication skill.
  • Bachelor’s in mathematics, Computer Science or related technical field.

Responsibilities

  • Analyze and interpret complex data Ability to identify data anomalies and resolve data issues.
  • Understand specific business processes and domain concepts and relate them to data subject domains.
  • Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve efficiency and reduce processing time.
  • Integrate and manage data from various sources, ensuring data quality, reliability, and performance.
  • Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake.
  • Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance.
  • Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences.
  • Develop and implement data models within Snowflake to support business intelligence and analytics requirements.
  • Collaborate with Data Leads, Product Managers and QA Engineers to validate requirements, participate in user requirement sessions.
  • Perform tests and validate data flows and prepare ETL processes according to business requirements.
  • Perform ETL tuning and SQL tuning.
  • Ability to document data flows representing business logic in ETL routines.
  • Design and implement data conversion strategy from legacy to new platforms.
  • Perform design validation, reconciliation, and error handling in data load processes.
  • Design and prepare technical specifications and guidelines including ER diagrams and related documents.

Preferred Qualifications

  • Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus.
  • Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required.
  • Experience with Matillion ELT tool and Snowflake Database is preferred.
  • Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).