Job Description
Job Description
Job Description:
As a Data Engineer, you will be crucial in designing, building, and maintaining data pipelines and infrastructure. You will work closely with data scientists and analysts to ensure data is accessible, reliable, and optimized for analysis.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines to support analytics and reporting.
- Collaborate with data scientists and stakeholders to understand data needs and ensure high-quality data delivery.
- Write efficient SQL queries for data extraction and transformation.
- Utilize Python to build data processing scripts and automation tools.
- Implement data processing solutions using Apache Spark.
- Manage data storage solutions on cloud platforms (AWS/Azure/GCP).
- Monitor and troubleshoot data pipeline performance issues.
- Ensure data integrity and security throughout the pipeline.
Qualifications :
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 1+ years of experience in data engineering or related roles.
- Proficiency in Python for data manipulation and analysis.
- Strong SQL skills for querying and managing databases.
- Experience with Apache Spark for big data processing.
- Familiarity with at least one cloud platform (AWS/Azure/GCP).
- Understanding of data warehousing concepts and ETL processes.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork abilities.
#J-18808-Ljbffr