Director of Data Engineering

JOB DESCRIPTION
Job Summary:
As the Director, Data Engineering, you will lead a team that performs a critical function for our direct-response marketing agency: managing the ingestion of donor and transaction data from hundreds of clients into an intricate data ecosystem. You'll have the responsibility of overseeing our data infrastructure, ranging from on-premise Microsoft SQL Server to Snowflake in AWS, as well as IBM iSeries Db2.
Responsibilities:

• Own the maturation of our ETL pipelines' code development lifecycle
• Oversee the administration of data environment including the data lake, which uses API connectors to sync tens of millions of client data records per day
• Develop, implement, optimize, and support data pipelines in systems such as Knime, dbt and SSIS
• Manage and mentor a team of data engineers and a team of data coordinators
• Drive efficiency and cost-savings by standardizing and unifying technologies, centralizing error reporting, and scaling operations.
• Work closely with internal stakeholders, balancing their expectations with the capabilities of our data environments and capacity of the engineering team.
• Work in collaboration with the product development department to shape the feature and functional needs of new data systems.
• Support CRM data implementations and the data integration needs of CRM customers.
• Oversee monitoring of ETL processes to resolve immediate issues and understand root causes for permanent solutions

Qualifications:

• Extensive experience in data management and data engineering, working with various data models, RDBMSs, and ETL tools.
• Strong proficiency in SQL, with a deep understanding of query optimization, data modeling, and database design.
• Strong background in data transformation, with proficiency in Python and dbt preferred.
• Hands-on experience with data pipeline development in Knime, dbt and SSIS.
• Exceptional leadership, communication, and interpersonal skills.
• Proven ability to quickly gain context, prioritize tasks, and manage urgent needs.
• Experience managing a backlog of work, prioritizing and assigning tasks, and managing team's capacity
• Experience in managing a data-focused team and a keen ability to nurture their development.