Staff Software Engineer, OpenLineage - Data Observability

About the Role

We are seeking a hands-on technical leader to drive our OpenLineage integrations and data intake group. This role combines internal development responsibilities with active work in and with the OpenLineage community plus collaboration with our Data Observability product teams.

Data Observability is building tools for data teams of all sizes to visualize, monitor, and understand their critical data pipeline, jobs, and datasets. We're a fast moving organization that operates as a startup within Datadog. We build impactful features quickly with customers in a tight feedback loop while keeping an eye on reliability, scaling, and future customer needs.

As a Staff Engineer, you will drive and collaborate on projects both inside and outside the product group and in the OpenLineage community. You will contribute to and make key technical and product decisions across the teams while elevating the engineering excellence of the other team members.

At Datadog, we value our office culture - the relationships and collaboration it builds and the creativity it brings. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

Key Responsibilities

• Lead the development and implementation of OpenLineage integrations within our organization (30% of time)
• Design, architect, and expand usage of the OpenLineage event intake for easy customer onboarding to the Datadog Data Observability platform (30% of time)
• Actively participate in the OpenLineage community, contributing code, documentation, and expertise (20-30% of time)
• Manage the remediation of OpenLineage issues affecting Datadog customers
• Collaborate with cross-functional teams to ensure seamless integration of OpenLineage practices
• Represent our organization in the broader open source community, particularly in OpenLineage-related forums, events, and the Datadog blog

Qualifications

• Strong technical background in data engineering, with a focus on data lineage and governance
• Proven experience contributing to open source projects, preferably in the data space
• Excellent coding skills, with proficiency in languages commonly used in data engineering (e.g., Python, Java, Scala)
• Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to diverse audiences
• Ability to balance internal development work with external community engagement
• You have a BS/MS/PhD in a Computer Science, Engineering or related scientific field or equivalent experience

Nice to haves

• Deep understanding of OpenLineage and related data lineage concepts
• Experience in community management or developer relations is a plus

Ideal Candidate

The ideal candidate will be a passionate advocate for open source and data lineage, with a track record of meaningful contributions to relevant projects. They should be comfortable leading technical work across multiple teams, advocating for the most impactful changes for customers, and nurturing relationships with the OpenLineage community of developers.

Benefits and Growth

• Continuous career development and pathing opportunities for internal mobility
• Intradepartmental mentor and buddy program for in-house networking
• An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)
• New hire stock equity (RSUs) and employee stock purchase plan
• Free global mental health benefit through Spring Health
• Generous global benefits

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.

About Datadog:

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers' entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another.

Equal Opportunity at Datadog:

Datadog is an Affirmative Action and Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.

Your Privacy:

Any information you submit to Datadog as part of your application will be processed in accordance with Datadog's Applicant and Candidate Privacy Notice.