AWS/Python/pyspark Data Engineer

ETL Developer with IICS, AWS and PySpark (must have)

AWS/Python/PySpark Data Engineer

• Basic Python/PySpark skillset
• Basic AWS Infra knowledge

With IICS ETL development experience.

Job Description

Skill: ETL, PySpark

Experience Required

• Minimum Eight (8) years overall current and hands-on development experience.
• Basic Python/PySpark skillset.
• Basic AWS Infra knowledge.
• Good in Unix.
• Good in SQL.
• With IICS ETL development experience.

Responsibilities

• Consulting with data management teams to get a big-picture idea of the company’s data storage needs.
• Presenting the company with warehousing options based on their storage needs.
• Designing and coding the data warehousing system to desired company specifications.
• Conducting preliminary testing of the warehousing environment before data is extracted.
• Extracting company data and transferring it into the new warehousing environment.
• Testing the new storage system once all the data has been transferred.
• Troubleshooting any issues that may arise.
• Providing maintenance support.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.