Data Engineer

Company:  https:/wayup.com/sitemap.xml
Location: Pleasanton
Closing Date: 02/11/2024
Salary: £100 - £125 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description

Job Description

Job Description

Job Description:

As a Data Engineer, you will be crucial in designing, building, and maintaining data pipelines and infrastructure. You will work closely with data scientists and analysts to ensure data is accessible, reliable, and optimized for analysis.

Key Responsibilities:

- Design, develop, and maintain scalable data pipelines to support analytics and reporting.

- Collaborate with data scientists and stakeholders to understand data needs and ensure high-quality data delivery.

- Write efficient SQL queries for data extraction and transformation.

- Utilize Python to build data processing scripts and automation tools.

- Implement data processing solutions using Apache Spark.

- Manage data storage solutions on cloud platforms (AWS/Azure/GCP).

- Monitor and troubleshoot data pipeline performance issues.

- Ensure data integrity and security throughout the pipeline.

Qualifications :

- Bachelor’s degree in Computer Science, Engineering, or a related field.

- 1+ years of experience in data engineering or related roles.

- Proficiency in Python for data manipulation and analysis.

- Strong SQL skills for querying and managing databases.

- Experience with Apache Spark for big data processing.

- Familiarity with at least one cloud platform (AWS/Azure/GCP).

- Understanding of data warehousing concepts and ETL processes.

- Strong problem-solving skills and attention to detail.

- Excellent communication and teamwork abilities.

#J-18808-Ljbffr
Apply Now
Share this job
https:/wayup.com/sitemap.xml
An error has occurred. This application may no longer respond until reloaded. Reload 🗙