Skip to content

Senior Data Engineer
Company | RxSense |
---|
Location | Princeton, NJ, USA |
---|
Salary | $150000 – $170000 |
---|
Type | Full-Time |
---|
Degrees | Bachelor’s |
---|
Experience Level | Senior, Expert or higher |
---|
Requirements
- Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms.
- Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS.
- 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS.
- Experience in business intelligence, data warehousing initiatives.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake.
- Strong SQL and Python skills with experience in query optimization and performance.
- Strong analytical, problem-solving, and communication skill.
- Bachelor’s in mathematics, Computer Science or related technical field.
Responsibilities
- Analyze and interpret complex data Ability to identify data anomalies and resolve data issues.
- Understand specific business processes and domain concepts and relate them to data subject domains.
- Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve efficiency and reduce processing time.
- Integrate and manage data from various sources, ensuring data quality, reliability, and performance.
- Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake.
- Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance.
- Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences.
- Develop and implement data models within Snowflake to support business intelligence and analytics requirements.
- Collaborate with Data Leads, Product Managers and QA Engineers to validate requirements, participate in user requirement sessions.
- Perform tests and validate data flows and prepare ETL processes according to business requirements.
- Perform ETL tuning and SQL tuning.
- Ability to document data flows representing business logic in ETL routines.
- Design and implement data conversion strategy from legacy to new platforms.
- Perform design validation, reconciliation, and error handling in data load processes.
- Design and prepare technical specifications and guidelines including ER diagrams and related documents.
Preferred Qualifications
- Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus.
- Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required.
- Experience with Matillion ELT tool and Snowflake Database is preferred.
- Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).