Position Summary:
We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, and Google Cloud Platform (GCP). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensuring data quality and integrity.
About Team:
In the Data Engineering team, we help Walmart manage data by building pipelines and data lakes to prepare big data for analysis and unlocking actionable insights in real-time. We use cross-departmental data and machine learning to build a holistic view of true profitability, saving millions of dollars across item categories and geographies while assisting our leadership in making better decisions faster.
What you'll do:
- Collaborate with cross-functional teams to understand data requirements and design data solutions that meet business needs.
- Develop and maintain data pipelines and ETL processes using Spark and Scala.
- Design, build, and optimize data models and data architecture for efficient data processing and storage.
- Implement data integration and data transformation workflows to ensure data quality and consistency.
- Monitor and troubleshoot data pipelines to ensure data availability and reliability.
- Conduct performance tuning and optimization of data processing systems for improved efficiency and scalability.
- Work closely with data scientists and analysts to provide them with the necessary data sets and tools for analysis and reporting.
- Stay up-to-date with the latest industry trends and technologies in data engineering and apply them to enhance the data infrastructure.
What you'll bring:
- Proven working experience as a Data Engineer with a minimum of 3 years in the field.
- Strong programming skills in Scala and experience with Spark for data processing and analytics.
- Familiarity with Google Cloud Platform (GCP) services such as BigQuery, GCS, Dataproc, Pub/Sub, etc.
- Experience with data modeling, data integration, and ETL processes.
- Strong knowledge of SQL and database systems.
- Understanding of data warehousing concepts and best practices.
- Proficiency in working with large-scale data sets and distributed computing frameworks.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork abilities.
Minimum Qualifications:
Outlined below are the required minimum qualifications for this position:
- Bachelor's degree in Computer Science and 2 years' experience in software engineering or related field.
- 4 years' experience in software engineering or related field.
- Master's degree in Computer Science.
Preferred Qualifications:
Outlined below are the optional preferred qualifications for this position:
- Data engineering, database engineering, business intelligence, or business analytics.
- Master's degree in Computer Science or related field and 2 years' experience in software engineering or related field.
- Knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards and integrating digital accessibility.
Primary Location:
840 W California Ave, Sunnyvale, CA 94086-4828, United States of America.
#J-18808-Ljbffr