Lead Data Engineer
Office hybrid in Seattle, WA
Job Details
Salesforce is embarking on our own Digital Transformation to deliver customer success for our customers and accelerate our growth. A key pillar of this transformation is building a strong data foundation to support all of our core marketing needs through intelligent data sets as a service.
We’re looking for an experienced and committed data engineer to build data pipelines and metrics for sales and marketing organization. In this role, you will work with business partners across Marketing functions to understand business needs, translate them to technical requirements, wrangle data from various systems, and design automated data pipelines to drive insights. You will work with internal technology groups to automate the data collection and definition process.
The right candidate will have strong data architecture, ETL/ELT, SQL and a proven track record working with enterprise metrics to build automated data pipelines. The candidate will also have strong operational skills to drive efficiency and speed, expertise building repeatable data engineering processes, strong project management skills, and a vision for how to deliver data products. Experience with marketing and sales data and metrics is a huge plus.
Responsibilities
- Actively develop, enhance and maintain data pipelines and workflows for marketing data and metrics.
- Work with marketing teams across the organization and build data metric requirements, build quick POC’s, document functional and technical requirements.
- Develop the framework in Snowflake, Big Query to automate the ETL process.
- Develop DBT ETL pipelines for data ingestion and transformation.
- Maintain, deploy and code version the ETL process.
- Use GIT CI/CD for DevOps.
- Work with the business partners, analyze the metrics and build data insights.
- Help in building POC solutions for new marketing metrics that drive effective decision making.
- Design & develop easy, repeatable and reusable automation data frameworks.
- Responsible for end-to-end data management activities, including but not limited to identify fields, data lineage and integration, performing data quality checks, analysis and presenting data.
- Run business intelligence and data warehouse plans across Marketing.
- Review and validate logical and physical design to ensure alignment with the defined solution architecture. Review solution design and ensure that the defined standards and framework are followed.
- Evaluate, determine root cause and resolve critical issues.
- Work with internal team members and external partners to support data collection and analysis and understand reporting needs.
- Collaborate with Data Science teams and support them with all the data they would need to produce their models.
- Work and collaborate with global teams.
Required Skills/Experience
- A related technical degree required with 13+ years related information systems experience in a data engineering, data modeling, automation and analytics.
- Proven understanding of data engineering concepts, database designs, associated tools, system components, internal processes and architecture along with the ability to articulate.
- Experience with multiple high priority projects by handling timelines.
- Ability to identify and work towards the betterment of operational excellence across teams.
- Well versed with Snowflake/Google Big Query/Redshift.
- DBT experience required.
- 10+ Proficiency with SQL, Bash and Python scripting.
- 7+ years of hands on experience with Airflow, CI/CD pipelines via Jenkins or similar tools, GitHub.
- Solid experience with AWS technologies like ECS, CloudWatch and Lambda.
- Experience working as a mentor to junior members in a customer-focused team.
- Experience working closely with Analytics/Data Science teams.
- Team-first mentality. Excellent interpersonal skills in order to build strong relationships that will be essential for the success in this role.
- Must be able to proactively communicate status and identify risks.
- Self-starter, highly motivated, able to shift directions quickly when priorities change, think through problems to come up with innovative solutions and deliver against tight deadlines.
- Must be results oriented and able to move forward without complete information and with minimal direction.
- Experience working with globally distributed engineering teams preferred.
- Experience with data visualization tools like Tableau is a plus.
- Experience with Marketing technology and work is a plus.
- Experience working with Web analytics platforms, metrics, and data sets (Google Analytics preferred)