Python + Pyspark Developer

Company:  Synechron
Location: Jersey City
Closing Date: 18/10/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description

We are looking to Hire Sr. Python Developer with Pyspark experience


Location: Jersey City, NJ || Pittsburgh, PA || Dallas, TX


Our challenge

We are seeking an experienced Python Developer with a strong background in PySpark to join our data engineering team. The ideal candidate will have a robust understanding of big data processing, experience with Apache Spark, and a proven track record in Python programming. You will be responsible for developing scalable data processing and analytics solutions in a cloud environment.



The Role

Responsibilities:

  • Design, build and maintain scalable and efficient data processing pipelines using PySpark.
  • Develop high-performance algorithms, predictive models, and proof-of-concept prototypes.
  • Work closely with data scientists and analysts to transform data into actionable insights.
  • Write reusable, testable, and efficient Python code.
  • Optimize data retrieval, develop dashboards, and reports for business stakeholders.
  • Implement data ingestion, data cleansing, deduplication, and data consolidation processes.
  • Leverage cloud-based big data services and architectures (AWS, Azure, or GCP) for processing large datasets.
  • Collaborate with cross-functional teams to define and refine data and analytics requirements.
  • Ensure systems meet business requirements and industry practices for security and privacy.
  • Stay updated with the latest innovations in big data technologies and PySpark enhancements.



Requirements:

You are:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Minimum of 8 years of experience in Python development.
  • Strong experience with Apache Spark and its components (Spark SQL, Streaming, MLlib, GraphX) using PySpark.
  • Demonstrated ability to write efficient, complex queries against large data sets.
  • Knowledge of data warehousing principles and data modeling concepts.
  • Proficient understanding of distributed computing principles.
  • Experience with at least one cloud provider (AWS, Azure, GCP), including their big data processing services.
  • Strong problem-solving skills and ability to work under tight deadlines.
  • Excellent communication and collaboration abilities.



It would be great if you also had:

  • Experience with additional big data tools like Hadoop, Kafka, or similar technologies.
  • Familiarity with machine learning frameworks and libraries.
  • Experience with data visualization tools and libraries.
  • Knowledge of containerization and orchestration technologies (Docker, Kubernetes).
  • Contributions to open-source projects or a strong GitHub portfolio showcasing relevant projects


We can offer you:

  • A highly competitive compensation and benefits package
  • A multinational organization with 55 offices in 20 countries and the possibility to work abroad
  • Laptop and a mobile phone
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & Paternity leave plans
  • A comprehensive insurance plan including: medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region)
  • Retirement savings plans
  • A higher education certification policy
  • Commuter benefits (varies by region)
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
  • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms
  • A flat and approachable organization
  • A truly diverse, fun-loving and global work culture



S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT


Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Apply Now
Share this job
Synechron
An error has occurred. This application may no longer respond until reloaded. Reload 🗙