Spark, Scala, Big data developer

Relevant Experience

(in Yrs)
8 - 10 years

Technical/Functional Skills

1. Experienced engineer with hands-on and strong coding skills, preferably with Java, Scala, Python.
2. AWS Cloud experience S3, EFS, ECS, EMR, etc.
3. Knowledge of Hadoop/Spark and various data formats like Parquet, AVRO, CSV, etc.
4. Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) is a plus.
5. Great attention to detail with an analytical/curious mind.
6. Organizational and communication skills.

Experience Required

8 - 10 years

Roles & Responsibilities

1. Perform large-scale data processing using Python and Apache Spark.
2. Utilize AWS services like S3, EMR, EC2 for data storage and processing.
3. Schedule, monitor, and troubleshoot data pipelines with Apache Airflow.
4. Ensure data quality, observability, and integrity across all our data infrastructure.

Generic Managerial Skills

Good communication and management skills.

Education

Bachelor's degree minimum.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.