Skip to content

Data Engineer Scala
Company | ICF |
---|
Location | Reston, VA, USA |
---|
Salary | $73722 – $125327 |
---|
Type | Full-Time |
---|
Degrees | Bachelor’s |
---|
Experience Level | Mid Level |
---|
Requirements
- Bachelor’s degree (preferred in Computer Science, IT or a related field)
- 3+ years’ experience in software or data development
- 3+ years of high-volume experience developing ETL pipelines and data validation with Scala, Spark, the Spark Engine, and the Spark Dataset API
- 2 or more years working in a data engineering role
- 1+ years of high-volume experience working with SQL
- Candidate must be able to obtain and maintain a Public Trust
- Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S.
- Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years
Responsibilities
- Document and communication requirements for data engineers
- Write Scala code to support the work on the Analytics and Reporting Team
- Utilize and write Python Scripts for ETL and Data Analysis
- Perform Data Validation and utilize SQL for data queries
- Improve Data Quality Checks
- Update and enhance Data Documentation
- Analyze large amounts of data to find inconsistencies using Zeppelin notebooks (Scala/Python)
- Communicating with external partners around requirements
- Consistently scripting and analyzing data
- Consistent JIRA and Confluence use
- Must attend Scrum Ceremonies and Test Meetings
- Working in an Agile environment
Preferred Qualifications
- 5 years’ experience with a bachelor’s degree
- Technical knowledge or working experience with Python
- Prior experience working with Medicare and/or Medicaid data, especially claims data and familiarity with claims codes (HCPCS/CPT/ICD-10-CM/ICD-10-PCS)
- Advanced SQL querying skills and database management knowledge
- Git/Github experience
- Experience working in an agile environment
- Experience working on a project using the Scaled Agile Framework
- Experience using Confluence and Jira
- Experience with software development team building modern software products
- Flexible and willing to accept a change in priorities as necessary