Data Engineer

Job Description:

The Data Engineer will analyze, design, develop, performance tuning, test their code as well as others code and support initiatives to build an enterprise integration framework while providing inputs for improving standards for data mapping, integration, and data traceability across the NAPA business functions.

Qualifications:

• Five or more years’ experience in software engineering.
• Five or more years’ experience in large scale RDBMS environments or Google BigQuery
• Two or more years of Exadata experience OR Google BigQuery
• Four or more years’ experience with Informatica PowerCenter or IICS
• One or more years experience in Erwin
• Experience in code automation (e.g. pattern based integration)
• Experience in advanced SQL and PL/SQL techniques
• Experience in building re-usable Utility packages
• Experience with testing the code
• Focus on continuous improvement
• Experience in Unix shell and Python scripting
• Integration design & data modeling skills in Data lake and Data Warehousing environments
• Experience with Streaming technologies is a plus( STRIIM, Kafka, etc)
• Experience with other Informatica tools is plus – e.g., Metadata manager, Analyst, DVO, Data Quality
• Exposure to both on-prem and cloud Integration solutions
• Familiarity with non-relational DB technologies is a plus
• Experience with automated testing
• Experience with both batch and real-time patterns for integration s
• Ability to build and analyze complex integration workflows from heterogeneous data sources
• Experienced in large Enterprise Data Warehouse & Integration projects.
• Strong background in full lifecycle development using multiple platforms or languages.
• Ability to interact at a technical and non-technical level with Infrastructure, Network, Development, BA and QA teams.
• Development experience in high transaction/high availability systems.
• Experience with analyzing and recommending solutions for Production issues short-term and long term.

RESPONSIBILITIES:

• The ETL Engineer performs design, development and implementation of integration processes for both the Enterprise Data lake, Data Warehouse and Applications
• Analyzes requirements and existing resources to create efficient database and integration designs that meet company IT standards.
• Works with project and business analyst leads to develop and clarify in-depth technical requirements.
• Participates in all phases of the integration development lifecycle, including unit testing, quality assurance(QA) and ongoing support.
• Helps with Production support as needed.