Data Lake Services Developer 04-SO0110-8

Position:  Data Lake Services Developer 04-SO0110-8

PLEASE NOTE: This position requires an ACTIVE Top Secret/SCI Clearance with Polygraph. To be considered for this position, you MUST have an ACTIVE Clearance Level of Top Secret/SCI with Polygraph

Summary

The successful candidate will leverage their development skills and experience to support the successful ingestion, cleansing, transformation, loading, and display of significant amounts of data, while maintaining and improving the Sponsor’s data lake services, Hadoop environment, and Hadoop services.

Duties, Tasks & Responsibilities

• Designing and implementing large-scale ingest systems in a Big Data environment
• Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
• Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
• Developing custom solutions/code to ingest and exploit new and existing data sources
• Working with Sponsor development teams to improve system and application performance
• Providing support to maintain, optimize, troubleshoot, and configure data lake services, the Hadoop environment, and Hadoop services as needed
• Organizing and maintaining documentation so others are able to understand and use it
• Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient method

• Strong programming/development skills and experience in Java
• Experience with service oriented design and architectures
• Strong ability to manage competing priorities and communication to multiple stakeholders

• Hands-on experience with Hadoop and Hadoop services, particularly with large Hadoop clusters
• Experience with Nifi flows and deployments