Lead Data Engineer

LEAD DATA ENGINEER

HOUSTON, TEXAS - 4 DAYS IN OFFICE

$170,000 - $200,000 BASE + BONUS + BENEFITS

Company Overview:

This automotive/retail company is seeking a Lead Data Engineer to implement, architect, and manage scalable data infrastructure. In this role, you will work with cross-functional teams and support machine learning and advanced analytics projects. You will also work in a collaborative team environment.

Role Responsibilities:

• Design and implement scalable data pipelines for diverse data using Apache Spark, Hadoop, and Kafka.
• Utilize cloud environments (AWS, Azure) and services for efficient data handling and processing.
• Develop and optimize data models and storage solutions to support operational and analytical applications.
• Automate data workflows using ETL tools to ensure timely availability of data for analytics.
• Collaborate closely with data scientists, providing necessary infrastructure and tools for complex analytical models.

Skills:

• 10+ years of data engineering experience
• Designs and operates large-scale data pipelines
• Develops ETL workflows
• Platform services experience with Databricks, AWS native, or Dataiku
• Experience with big data technologies - Spark, Hadoop, or Kafka
• Cloud environment experience - AWS or Azure
• Bonus - knowledge of ML model deployment and management practices
• Strong communication with technical and nontechnical stakeholders

BENEFITS:

$170,000 - $200,000 Base Salary + Bonus + Benefits

HOW TO APPLY Please register your interest by sending your Resume to Emma Spagnola via the Apply link on this page or at