Data Intelligence - Engineer, Data Ld

Job Description:

PURPOSE:
This is a Big Data Administrator Lead position and not a developer position.

The Lead Data Engineer is responsible for orchestrating, deploying, maintaining, and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using Hadoop or equivalent with emphasis on high availability, reliability, automation, and performance.

Responsibilities:

1. Advanced (expert preferred) level experience in administrating and engineering relational databases (e.g., MySQL, PostgreSQL), Big Data systems (e.g., Cloudera Data Platform Private Cloud and Public Cloud), Apache Solr as SME, ETL (e.g., Ab Initio), BI (e.g., MicroStrategy), automation tools (e.g., Ansible, Terraform, Bit Bucket) and experience working cloud solutions (specifically data products on AWS) are necessary.
2. At least 10 years of experience with all tasks involved in administration of big data and Meta Data Hub such as Cloudera.
3. Experience with Ab Initio, EMR, S3, Dynamo DB, Mongo DB, PostgreSQL, RDS, DB2 is a Plus.
4. DevOps (CI/CD Pipeline) experience is a Plus.
5. Experience with advanced knowledge of UNIX and SQL.
6. Experience managing metadata hub-MDH, Operational Console, and troubleshooting environmental issues which affect these components.
7. Prefer prior experience with migration from on-premise to AWS Cloud.
8. Represents team in all architectural and design discussions. Knowledgeable in the end-to-end process and able to act as an SME providing credible feedback and input in all impacted areas.
9. Track and monitor projects and tasks as the lead.

Essential Functions:

1. Represents team in all architectural and design discussions. Knowledgeable in the end-to-end process and able to act as an SME providing credible feedback and input in all impacted areas.
2. Project tracking and task monitoring. The lead position ensures an overall successful implementation especially where team members are working on multiple efforts at the same time. Lead the team to design, configure, implement, monitor, and manage all aspects of Data Integration Framework.
3. Develop and maintain infrastructure systems (e.g., data warehouses, data lakes) including data access APIs.
4. Develop and implement techniques to prevent system problems, troubleshoot incidents to recover services, and support root cause analysis.
5. Manage customer and stakeholder needs, generate and develop requirements, and perform functional analysis.
6. Acts as a mentor for junior and senior team members.
7. Installs, tunes, upgrades, troubleshoots, and maintains all computer systems relevant to the supported applications.
8. Expands engineering job knowledge and leading technologies by reviewing professional publications, establishing personal networks, and participating in professional societies.

Education Level: Bachelor's Degree in Information Technology, Computer Science, or related field.

Experience: At least 8 years of relevant engineering experience. In lieu of a Master's degree, an additional 4 years of relevant work experience is required.

Knowledge, Skills And Abilities (KSAs):

1. Knowledge of programming languages and web-based technologies. Expert.
2. Experience with Cloudera CDP on-prem and public cloud; Solr SME. Expert.
3. Ability to collaborate to solve technical problems across teams. Expert.
4. Excellent communication skills both written and verbal. Expert.

The incumbent is required to immediately disclose any debarment, exclusion, or other event that makes them ineligible to perform work directly or indirectly on Federal health care programs. Must be able to effectively work in a fast-paced environment with frequently changing priorities, deadlines, and workloads. Must be able to meet established deadlines and handle multiple customer service demands from internal and external customers.