Lead Data Engineer

Quirch Foods is a leading food distribution company with a focus on delivering quality products to our customers across the United States. We are committed to leveraging cutting-edge technologies to optimize our operations and data management strategies. As we continue to grow, we are seeking an experienced Azure Lead Data Engineer to lead our data engineering initiatives and support the company’s analytics and data infrastructure.

Position Overview :
As the Lead Data Engineer at Quirch Foods, you will play a critical role in leading the design, development, and implementation of scalable data solutions in Microsoft Azure. You will be responsible for managing and optimizing our Azure Data Lake and Databricks environments to ensure that our data platform is secure, efficient, and capable of supporting advanced analytics and business intelligence needs.

Key Responsibilities :

• Lead the architecture, design, and development of scalable data solutions in Azure, including Azure Data Lake, Databricks, and other Azure data services.
• Design and implement robust ETL pipelines for processing structured and unstructured data using Azure Data Factory and Databricks.
• Oversee the management and optimization of Azure Data Lake to support data ingestion, transformation, and storage.
• Collaborate with data scientists, analysts, and business teams to ensure data solutions align with business requirements.
• Implement best practices for data governance, security, and compliance, particularly with Azure security features (e.g., encryption, IAM).
• Build and maintain high-performance, reliable data models and data pipelines that enable business intelligence and analytics tools.
• Provide technical leadership and mentorship to junior data engineers, ensuring the team follows best practices for data architecture and engineering.
• Monitor, troubleshoot, and optimize data workflows, ensuring high availability and performance of the data infrastructure.
• Stay up-to-date with the latest trends and advancements in data engineering, cloud technologies, and Azure services.

Qualifications :

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
• 7+ years of experience in data engineering, with at least 3 years of experience in Azure Data Lake and Databricks.
• Strong hands-on experience with Azure data services including Azure Data Lake, Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Data Factory.
• Expertise in designing and building scalable data architectures and pipelines in a cloud environment.
• Proficient in SQL, Python, Spark, and Databricks notebooks for data processing and transformation.
• Experience with ETL frameworks and tools for batch and real-time data processing.
• Solid understanding of data security, governance, and compliance standards.
• Excellent problem-solving and analytical skills with attention to detail.
• Strong communication and collaboration skills to work effectively with cross-functional teams.
• Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect) are a plus.

Job Type : Full-time

Benefits :

• 401(k)
• Dental insurance
• Health insurance
• Life insurance
• Paid time off
• Vision insurance

Schedule :

• 8 hour shift
• Monday to Friday

Experience :

• Azure Data Bricks: 3 years (Required)
• Azure Data Lake: 3 years (Required)

Ability to Commute :

• Coral Gables, FL 33134 (Required)

Work Location : In person