Senior Data Engineer

Job Title: Junior AWS Cloud Data Engineer

Location: Torrance, CA

Experience Level: 5+ years

Role Overview

We are seeking a highly skilled and motivated AWS Cloud Data Engineer to join our dynamic team. As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS. Your expertise in S3, AWS Glue / EMR, AWS Redshift, Athena, SQL, and optionally Python/Java/Scala will be essential in ensuring the success of our data-driven projects.

Responsibilities

1. Data Pipeline Development:
   1. Design, develop, and maintain ETL processes using AWS Glue/EMR to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.
   2. Optimize data pipelines for performance, scalability, and reliability.
   3. Implement data aggregation, consolidation, and enrichment.
   4. 3+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift).
2. Workflow Automation:
   1. Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.
   2. Schedule, monitor, and manage data processing tasks efficiently.
3. Database Management:
   1. Leverage your strong SQL skills to create and optimize database queries.
   2. Strong knowledge of data storage and processing technologies, including databases (SQL and NoSQL), data lakes, and distributed computing frameworks (e.g., Hadoop, Spark).
   3. 5+ years of experience in data engineering, database design, ETL processes, and data warehousing.
4. Support Project Processes:
   1. Work closely with cross-functional teams to understand project requirements and deliverables.
   2. Provide technical support during project execution and troubleshoot issues as needed.
5. Optional Programming Skills:
   1. Familiarity with Python/Java/Scala is a plus.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
• AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.
• Strong problem-solving skills and ability to work independently.
• Excellent communication and collaboration skills.