Software Engineer – Senior

Active TS/SCI with Polygraph security clearance.
Bachelor’s degree and 12+ years of experience. Additional experience may be substituted in lieu of a degree.
Demonstrated professional experience in Computer Science, Computer Engineering, Systems Engineering, or closely related discipline.
Demonstrated professional experience with AWS cloud services, including long-term storage options, and cloud-based database services.
Demonstrated experience working with Databricks.
Demonstrated experience understanding SQL database structures and mapping them between different SQL databases.
Demonstrated professional experience working with Apache NiFi.
Demonstrated professional experience working with large data and high performance compute clusters such as Hadoop or similar.
Demonstrated experience with API development techniques.
Demonstrated experience developing and deploying ETL processes for large data sets.
Demonstrated experience creating operating system level scripts to perform ETL operations on SQL databases.
Demonstrated professional experience with version control systems, preferably Git.
Demonstrated experience testing the development of software solutions for the extraction, transformation, and loading of data using the most efficient languages for the task such as NiFi, Python, and SQL.
Demonstrated experience implementing multiprocessing data-flows to parallelize ingest operations.

Engage regularly with data scientists, analysts, and managers.
Load large datasets into the client’s on-premises and cloud environments, and develop and maintain ingestion algorithms and schemas for large datasets.
Analyze new large-volume datasets to optimize the data ingest processes, support the creation of Apache NiFi schemas for new data loads, and develop software tools that efficiently preprocess, modify, aggregate, load, index, and archive large data collections into clusters in near real-time.
Ensure proper access controls are implemented, generate metrics to track data ingest statistics to maintain data integrity and provenance, and document the data-flows according to standards set by the client.

Demonstrated experience with the client’s data environment.
Demonstrated experience exhibiting strong coordination and collaboration skills.
Demonstrated experience working with full-stack developers to deploy applications that leverage large data sets.
Demonstrated experience communicating technical concepts to non-technical audiences.