Lead Data Engineer

Role: Lead Data Engineer

Location: Fremont, CA (Hybrid 3 days a week from office)

Duration: 12+ Months

Must have Skills:

1. Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is required and preferred over other cloud platforms.
2. 10+ years of proven experience with SQL, schema design, and dimensional data modelling.
3. Solid knowledge of data warehouse best practices, development standards, and methodologies.
4. Experience with ETL/ELT tools like ADF, Informatica, Talend, etc., and data warehousing technologies like Azure Synapse, Azure SQL, Amazon Redshift, Snowflake, Google Big Query, etc.
5. Strong experience with big data tools (Databricks, Spark, etc.) and programming skills in PySpark and Spark SQL.
6. Be an independent self-learner with a “let’s get this done” approach and ability to work in a fast-paced and dynamic environment.
7. Excellent communication and teamwork abilities.

Nice-to-Have Skills:

1. Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Cosmo DB knowledge.
2. SAP ECC/S/4 and Hana knowledge.
3. Intermediate knowledge on Power BI.
4. Azure DevOps and CI/CD deployments, Cloud migration methodologies and processes.