Advanced Data Engineer (Azure) Company Hidden Retail Cincinnati, OH Developer 1 Opening Posted [...]

Agility Partners is seeking a qualified Advanced Data Engineer to fill an open position with a leading grocer in the Cincinnati area.

Key Responsibilities:

• SQL, Python, Spark, Databricks
• Working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation
• DevOps process and Terraform scripting
• Leadership skills: must be able to put together and deliver presentations.
• Solid communication while working with PMO. Must be able to translate what the product is asking for and communicate effectively with the team.

Benefits and Perks

Work within a collaborative team environment where ideas and creativity are welcomed! Family and work-life balance are important to this organization and valued for the employees.

• Working for an organization that focuses on company culture, inclusion, and diversity
• 50% medical coverage for you and your entire family, short/long term disability, and life insurance options
• 401(k)
• Life Insurance
• Disability coverage

The Ideal Candidate

Qualifications:

• Experience in Data modeling and advanced SQL techniques
• Experience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data services
• Expert in SQL, Python, Spark, Databricks
• Experience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation
• Experience with DevOps process and understanding of Terraform scripting
• Understanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design
• Experience designing and implementing ingestion processes for unstructured and structured data sets
• Experience designing and developing data cleansing routines utilizing standard data operations
• Knowledge of data, master data, and metadata related standards and processes
• Experience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries
• Experience using Azure DevOps/Github actions CI/CD pipelines to deploy code
• Microsoft Azure certifications are a plus
• Minimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms.