Data Engineer

Core4ce has an opportunity with a mission critical IC Sponsor for a Data Engineer position. This Sponsor organization plays a significant role in the highly optimized mission-ready data conditioning and delivery systems in support of mission analytics. A Full-Scope polygraph is required, no exceptions.

Responsibilities

1. Design and develop complex new software products or make significant enhancements to existing software.
2. Hands-on development with significant experience in building modular, reusable services and features.
3. Expertise in modern service-oriented architecture.
4. Familiarity with working on an Agile team environment with little to no supervision.
5. Embody a passion for continuous improvement and innovation.

Requirements

1. Experienced with Apache NiFi and IC equivalent.
2. General understanding and ability to work with Zookeeper.
3. Able to deploy and maintain NiFi clusters.
4. 5+ years experience with a variety of scripting languages including Bash, Python, and Groovy.
5. Experienced using EC2 instances in AWS.
6. 2-5 years of experience working with Ansible, developing playbooks and roles for software driven deployment of NiFi clusters and Zookeeper clusters.
7. Understanding of Git and GitLab.
8. 2-5 years’ experience using REST APIs to call RESTful services.
9. Familiar with Linux – particularly the new Rocky variant.
10. Working level familiarity with Elasticsearch and Kibana. Able to develop dashboard visualizations in Kibana from data in Elasticsearch.

All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status.