Position: Lead Data Engineer
Company: A large healthcare company
Location: Hybrid 1-2x a week onsite in N. Scottsdale
Interview Process: 2 rounds
Duration: 2 year long contract
Work authorization: W2
Qualifications:
• 5-7 years of data engineering experience
• Capable of leading other data engineers
• 3+ years of experience with Apache Airflow and/or Composer
• 3+ years of experience with DataProc and/or Spark
• 5+ years of experience with CI/CD
• Experience producing architecture solutions using Composer and Spark
• Experience in large-scale batch processing with cloud services
• Ability to collaborate with architects to solve problems and provide data engineering solutions
• Familiarity with databases and SQL
• Familiarity with at least one OOP language, Java preferred
• Familiarity with GCP, GKE, and Cloud IAM
• Experience working with Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data Stage & Spring Batch
Overview of the role:
A large healthcare company in Phoenix is looking for a Lead Data Engineer to assist them in solutioning architecture as they transform the Rebate Processing System from its legacy platform. This person will assist their software engineers in rearchitecting, transforming, and designing data pipelines.