Data Engineer

Data Engineer

Requirements

• 8 years’ experience as a data engineer or in a similar role
• Demonstrated experience employing data models, data mining, and segmentation techniques
• Demonstrated experience developing, deploying and/or maintaining enterprise level data solutions
• Experience with SQL database design
• Python, SQL, NoSQL, Cypher, POSTGRES
• Can write in modern coding languages; Python & JavaScript required; Experience with Flask and React preferred
• Can read and understand other coding languages; HTML/CSS, R, Java, C, C++, C#
• Create respective process documentation using a web-based version control
• Experience with Gitlab and Jira
• Provide written and verbal communication and respective business process
• Work independently and on teams and have excellent time management and work prioritization skills
• Execute complex projects within government defined timelines across a geographically dispersed workforce and user base

Responsibilities

• Build and maintain data systems and construct datasets that are easy to analyze and support customer requirements
• Implement methods to improve data reliability and quality
• Combine raw information from different sources to create consistent and machine-readable formats
• Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling
• Develop and deploy Application Programming Interfaces (API) to expose IDST maintained data to the enterprise
• Acquire and assemble large, complex datasets that align with USSOCOM enterprise
• Building, testing, and maintaining data infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using modern data
• Develop analytics tools and transformative algorithms for data to provide actionable insights into customer processes, operational efficiency, and other key business performance metrics
• Create new data validation methods for analytics and data scientist team members that assist them in building and optimizing products to fulfill customer objectives
• Work with IDST stakeholders including USSOCOM leadership, customers, and design teams to assist with data-related technical issues and support their data infrastructure needs
• Analyze procedures for USSOCOM data separation, access, and security across users and the enterprise data architecture
• Work with IDST data and analytics experts to strive for greater functionality in our data systems and capability integration
• Create and maintain optimal data pipeline architecture and support associated process improvements for automating manual processes, data delivery, and infrastructure re-design for scalability

Preferred Qualifications

• SQL Alchemy, Flask, Swagger, JavaScript, Spark, Hadoop, Kafka, Hive, R, storm, MATLAB, Neo4J, MongoDB
• Data engineering certification is a plus