Company:
Compunnel Inc.
Location: Denver
Closing Date: 09/11/2024
Salary: £100 - £125 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
Primary Skills: SQL, HQL, Spark, Hadoop, Hive, AWS
Description:
This role requires a working understanding of data architecture, data engineering, and data analysis. The ideal candidate is a skilled data engineer with experience creating data products supporting analytic solutions. They are able to identify and implement solutions in a highly technical environment and work as part of a technical, cross-functional team. Strong problem-solving and troubleshooting skills are a must.
This role focuses on designing, developing, and maintaining datasets within AWS with oversight and support from Lead Developers.
Day-to-day Responsibilities Include:
- Coordinating, building, and managing new data ingests
- Implementing updates, fixes, and optimizations across suite of production jobs
- Providing feedback on and enacting changes for improvements across the team including both technical and process updates
- Learning about and becoming familiar with data assets, processing jobs and pipelines, and tools
- Partnering with data analysts and data scientists to design, build, and deploy aggregation processes
Top Skills:
- Hadoop/Hive experience
- Strong SQL
- AWS Experience (EMR, Lambda, Glue, Step Functions)
- Experience working with large data sets (billions of records per day)
- Write and review code
- Python scripting (PySpark, control scripts)
- Building and managing data pipelines
- Query and data pipeline optimization
- Strong communication and collaboration skills
- Ability to learn new technologies and skills to incorporate into existing work
Education: Bachelors Degree
#J-18808-LjbffrShare this job
Compunnel Inc.
Useful Links