Senior Big Data Java Engineer

Responsibilities

Global Banking Technology & Operations (GBTO) delivers day-to-day services to Global Banking & Investor Solutions (GBIS) Business Units and their clients. With IT & Operations teams working side by side under the same leadership, the goal of GBTO is to meet the evolving needs of its clients and market requirements, as well as anticipate technological advances to accelerate and support the transformation of GBIS activities. GBTO is at the very heart of this technological and operational challenge.

The Listed Derivatives Transactions Service Department is primarily engaged to provide IT solutions for the Equity Prime Services business line clients externally and internally. Working in partnership with Prime Service Front Office and Operations, we deliver innovative and robust solutions, with a desire to produce market leading solutions.

As a Sr. Big Data Java Engineer, you will work in the development of our data lake streaming platform in Azure. As a member of the Feature Team, you will work autonomously, which includes the following development tasks:

1. Architect, design and develop Kafka Stream based Java applications in Azure.
2. Architect, design and develop data pipelines for Big Data volume using Spark (Java) in Azure.
3. Write high quality code in Java.
4. Design, develop and deploy systems with scalability and resiliency in mind.
5. Review code, offer improvements to design, process and help the team improve.
6. Work with distributed systems with huge volumes of data.
7. Good working knowledge troubleshooting performance issues.
8. Support deconstruction of customer requests into detailed stories by interacting with the Product Owner.
9. Deliver working code that meets acceptance criteria as well as meets the definition of done at different levels.
10. Write code, deploy scripts, unit test, check code to source code repository, and monitor delivery pipeline activity to ensure product quality and consistency.
11. Conduct testing, deployment, and production activities of the team to ensure production stability, applying the guidelines provided by the chapter.
12. Engage in pair programming to write high quality code that’s easy to understand and support.
13. Write tests - very often before the associated code - at unit level with Junit, Mockito and in BDD style with Cucumber.
14. Attend backlog refinement and planning sessions to discuss and estimate (small, medium, large) upcoming stories.

Profile Required

Technical Skills:

1. Must have experience with Java, Kafka Streams and Spark.
2. Good working knowledge of distributed systems.
3. Must be comfortable with system design in designing Big Data systems for both batch and real-time.
4. Must have working experience with Spark jobs and troubleshooting performance issues.
5. Must have working experience in dealing with high volumes of data – batch and real-time processing.
6. Cloud experience is a must – AWS or Azure.
7. Sound knowledge of Spring Boot or another Java back-end framework, Kafka, Elastic Search, Kibana, & Kubernetes.
8. Strong experience with Cloud & Big Data technologies like Spark and Kafka.
9. Designing RESTful APIs and integrating third-party RESTful APIs.
10. Working familiarity with code revising and branding, ideally Git.

Competencies:

1. Comfortable working in agile methodologies, ideally Scrum.
2. Experience with automated testing approaches - test-driven development, unit testing, integration testing, and BDD testing.
3. Exposure to continuous integration tools.
4. Understanding of service-oriented architectures and message brokers.
5. Strong analytical skills and problem-solving ability. Able to break down complex problems into simple manageable units, develop solutions for each unit, and integrate them back into the whole.
6. Results-oriented, able to set goals and priorities that maximize the use of resources available to consistently deliver quality results.
7. Team-oriented, client-focused and open to different ideas/viewpoints. Self-aware of own behavior and work style, as well as tolerant of different needs and viewpoints.

Experience Needed:

1. 7+ years of experience working as a Java Senior Programmer.
2. 3+ years of experience working in Spark, Kafka and cloud.

Educational Requirements:

1. BS/master’s degree in computer science, Information Technology or relevant technical field.