Design, develop, and manage CI/CD pipelines to support Data Lakehouse environments on AWS, ensuring smooth deployment of data engineering applications and services.
Implement infrastructure as code (IaC) solutions using Terraform, automating the provisioning and management of AWS resources.
Collaborate with data engineering teams to optimize and deploy data pipelines using AWS Glue, S3, RDS, and other related services.
Utilize GitHub for version control and manage CI/CD workflows, ensuring seamless integration and delivery of code and infrastructure changes.
Develop and maintain GitHub Actions for automating testing, building, and deploying code, enhancing the overall CI/CD process.
Automate infrastructure provisioning and configuration using AWS services and Terraform, ensuring consistent and repeatable environments.
Monitor, troubleshoot, and optimize CI/CD processes to enhance performance, scalability, and reliability of data engineering workflows.
Work closely with data engineers to integrate Oracle GoldenGate and Informatica into data pipelines, ensuring seamless data flow and transformation.
Develop and maintain automated testing frameworks for data pipelines, ensuring the accuracy and consistency of data processing.
Collaborate with cross-functional teams to define and implement best practices for DevOps and DataOps within the organization.
Continuously improve the CI/CD processes by adopting new tools, technologies, and methodologies that enhance the efficiency and effectiveness of the engineering teams.
Document processes, configurations, and procedures, ensuring clear communication and knowledge sharing across teams.
#J-18808-Ljbffr