Azure Databricks - Data Engineer

Job Role: Azure Databricks - Data Engineer

Job location: Richardson (TX) or Raleigh, NC

Job Type: Full Time

Job description:

Client is seeking an Azure Databricks - Data Engineer . In this role, you will provide technical guidance to teams; anchor Proof of Concept developments and support opportunity identification and pursuit processes and evangelize Infosys brand. You will collaborate with some of the best talent in the industry to create and implement innovative high-quality solutions. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.

Required Qualifications:

1. Candidate must be located within commuting distance of Richardson (TX) or Raleigh, NC or be willing to relocate to the area.
2. Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
3. At least 7 years of experience in Information Technology.
4. At least 3 years of hands-on experience in using Azure Data Factory (ADF) to orchestrate data ingestion from various sources into Azure Synapse and Azure Data Lake Storage (ADLS).
5. At least 2 years of hands-on experience with Azure, Databricks, and Hadoop distributed frameworks while handling large amounts of big data using Spark and Hadoop Ecosystems.
6. At least 2 years of experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Azure Synapse Analytics.
7. Hands-on experience in end-to-end implementation of data warehouse and data marts.
8. Experience in writing SQL queries to analyze Type-2 dimension data.
9. Understanding of implementing Medallion Architecture using Azure Services.
10. All applicants authorized to work in the United States are encouraged to apply.

Preferred Qualifications:

1. Experience in software engineering and data engineering roles, with a focus on Azure and Databricks.
2. Strong understanding of databases and big data software technologies, specifically Azure and Databricks.
3. Exposure to Unity Catalogue.
4. Experience with Agile methodologies, particularly Scrum.
5. Experience in coordinating with offshore data engineering teams.
6. Experience with scripting languages like Python, Java, etc.
7. Strong problem-solving skills related to data, data structures, and algorithms.