Azure Data Engineer - Hybrid in Palo Alto,CA

One of our clients in Palo Alto is looking for an Azure Data Engineer with the following skills and experience:

NOTE: This is a DIRECT HIRE position. Candidates will be working 3 days onsite in Palo Alto, CA.

Position: Azure Data Engineer

Must-Haves:

• Expertise in Azure Cloud platform services.
• Proficient in SQL with a focus on Azure SQL.
• Heavy experience with RESTful API development.
• Familiarity with Azure Data Factory (ADF).
• Experience working with Prophecy and Purview for data pipeline design and data governance.

Responsibilities:

• Design and develop end-to-end data pipelines across various data sources and systems, ensuring data quality and integrity.
• Develop data models, structures, and ETL jobs for efficient data acquisition and transformation.
• Work closely with cloud service providers to align solutions with platform offerings.
• Manage and maintain cloud-based data and analytics platforms, including performing quick proof of concepts for data solutions.
• Implement Unified Data governance and Data Quality Management solutions for enterprise data governance.
• Interact with business stakeholders to understand requirements and translate them into technology solutions.

Qualifications:

• Bachelor's degree in computer science, computer engineering, or related field with 10+ years of experience.
• Strong expertise in Azure SQL, including complex SQL queries and performance tuning.
• Experience with Azure API Management Service and RESTful API development.
• Proficiency in real-time data processing using Azure Event Hubs, Service Bus, and Stream Analytics.
• Knowledge of data transformation languages like .Net/C#, Python, Java, R, or Scala, preferably with Databricks/Spark.
• Experience with NoSQL Databases and Azure CosmosDB.
• Familiarity with Azure Purview for data cataloging and metadata management.
• Experience with Azure Data Lake Storage Gen2 and Azure BLOB storage.
• Understanding of different data formats such as Parquet, Avro, CSV, ORC, etc.
• Experience in creating, scheduling, and monitoring Azure Data Factory (ADF) pipelines.
• Previous experience in a fast-paced, agile environment.
• Ability to work with on-shore/off-shore teams.

Interested candidates may submit their resumes online or call at 310-906-4780 for further information regarding the position.