Senior Data Engineer

Position Summary

We are seeking a talented and experienced data engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and infrastructure. They will work closely with cross-functional teams to understand data requirements, implement solutions, and ensure data quality and reliability. The data engineer will also be involved in optimizing data processes and supporting data analytics initiatives.

About the role

• Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
• Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
• Optimize and tune data pipelines for performance and efficiency.
• Troubleshoot and debug data-related issues, and provide timely resolution.
• Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
• Document data architecture, processes, and workflows.
• Provide support and guidance to junior members of the team.

About you

• Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
• 3+ yrs of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Strong SQL skills and experience working with relational and NoSQL databases.
• Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Work Location

Mountain View, CA - Hybrid (3 days / week onsite)

What you will have at Harness

• Competitive salary
• Comprehensive healthcare benefits
• Flexible Spending Account (FSA)
• Flexible work schedule
• Employee Assistance Program (EAP)
• Flexible Time Off and Parental Leave
• Monthly, quarterly, and annual social and team building events
• Monthly internet reimbursement