DevOps Engineer

Job Description

DevOps Engineer

Work location: Los Angeles, CA / Dallas, TX.

Job Summary: We are seeking a skilled DevOps Engineer to join our technology team, focusing on automating and optimizing our data engineering pipelines. The ideal candidate will have a strong background in software development, automation of CI/CD using Jenkins in data platforms like Databricks and Snowflake. You will play a crucial role in developing and enhancing CI/CD pipelines, automating tasks, and ensuring seamless data operations across our platforms.

Key Responsibilities:

• Develop and enhance CI/CD pipelines using Jenkins to automate and streamline deployment processes.
• Write and maintain scripts in Groovy to support automation and integration tasks.
• Utilize REST APIs to integrate different systems and services, and process JSON responses effectively using Python.
• Work closely with data engineering teams to understand their DevOps needs and implement solutions that enhance data workflow efficiencies.
• Deploy datahub jobs using Jenkins pipeline.
• Collaborate with development and operations teams to ensure system reliability, security, and efficiency.
• Stay updated with the latest industry trends and technologies and apply insights to improve existing systems and workflows.

Qualifications:

• Proven experience as a DevOps Engineer or similar role with a focus on data engineering platforms.
• Strong programming skills in Groovy, Python, and experience in Jenkins and CI/CD practices.
• Experience with REST APIs and data manipulation, particularly JSON.
• Familiar with Databricks and Snowflake.
• Strong problem-solving skills, attention to detail, and ability to work in a collaborative team environment.
• Excellent verbal and written communication skills.
• This role is perfect for someone passionate about automation, data flow, and continuous improvement in data operations environments.