Azure Data Engineer Only W2

Job Title: Azure Data Engineer

Location: NYC - 3 days Onsite

Duration: 6 months

Additional Details:

• Data Engineering
• Hands-on position
• Hit the ground running
• Experience in Financial or Banking Industry
• Engineer to build out data plans on Azure Cloud
• Agile Team
• Understand the business requirements
• Cross Functional stakeholder view
• Work with compliance and security team
• Capturing Marsh side of the business
• Collecting revenue data for brokers
• Build a very flexible data capture system
• BAU functionality
• 15 people aligned within the team

What are the applications to be supported? Azure, Python

Soft Skill requirements (team fit/personality requirements):

• Trustworthy
• Team player (Cross Functional)

We are seeking a highly skilled and motivated individual for a Data Engineer position with expertise in Python ETL and Azure experience. The candidate will contribute to our team and help drive our data engineering initiatives.

Job Requirements:

• Python ETL: Strong proficiency in Python programming language and experience in Extract, Transform, Load (ETL) processes. Ability to design and develop efficient ETL workflows.
• Azure Experience: Hands-on experience working with Microsoft Azure cloud platform, familiar with Azure services and tools, and a good understanding of Azure architecture and best practices.
• Azure Data Factory, DataBricks, Azure Storage, and Azure VM: Practical experience with Azure Data Factory, DataBricks, Azure Storage, and Azure Virtual Machines. Ability to design and implement data pipelines using Azure Data Factory.
• Data Governance, Data Quality, and Controls: Strong understanding of data governance principles, data quality management, and data controls. Ability to implement data governance frameworks and ensure compliance with data regulations.
• Implementing alerts and notifications for batch jobs: Experience in setting up alerts and notifications for batch jobs. Ability to configure monitoring and alerting mechanisms.

Additional Notes:

• Underlying work is helping migrate current pipeline from the server into Azure Data Factory.
• Location: 1166 Avenue of the Americas (NYC)
• ETL and Azure Data Factory pipelines
• Goal is to use AI techniques to solve problems.
• Python is very important for this role.
• A lot of pipelines on the team are generated through AI as code.
• Reporting into Martin, but a very flat team structure.

Azure Data Engineer Only W2