Senior Azure Data Engineer

• Hands on with Python, Databricks pipeline, deployment and testing.
• Continue to improve ETL Processes for scalability, quality and performance
• Independently identify and resolve complex technical problems around data pipelines and failures.
• Work with Data Engineers and other stakeholders for deployment, and writing automated test scripts and procedures
• Work on Data quality and data validations.
• Involved in writing automated scripts and testing Databricks notebooks written in python.
• End to End testing and deployment of pipelines.
• Lead quality initiatives around data quality and validation.
• Define testing methodology

Qualifications

• BS / MS S/W Engineering
• Quality assurance and automated testing experience
• Hands on with Python, Databricks pipeline, deployment and testing.
• ETL and Data quality. MS Azure, Python, ETL Processing
• DataWarehouse, Datamodeling background is a plus