Sr. Data Engineer

Company:  Saxon Global
Location: Chicago
Closing Date: 09/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
CAPITAL ONE
CHICAGO IL (onsite 3 days week)

REQ ID 73155-1 Sr Data Engineer
We are seeking an experienced data engineer to contribute to a high data volume application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, there's a plan to migrate the existing AWS EMR application to AWS Glue.
The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications. Exposure to various design patterns within the data engineering paradigm is crucial for success in this role.
Our development process adheres to an agile methodology, with Program Increment (PI) planning occurring every six weeks, equivalent to three sprints. If you are a skilled data engineer who thrives in an agile environment and has a solid background in designing and optimizing applications, we invite you to join our dynamic team.
Skill Set:
AWS Cloud Technologies:
  • Strong command of Apache Spark (3-5 years)
  • AWS EMR proficiency (3-5 years)
  • AWS Glue expertise (1-5 years)
PySpark Application Development:
  • Extensive experience in designing, developing, troubleshooting, and debugging PySpark applications
  • Proven track record in processing and handling large datasets
Performance Tuning:
  • Hands-on experience in performance tuning Spark applications
  • Skills to optimize Spark code for scalability, performance, and maintainability
Microservices Development:
  • Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (1-5 years)
  • Code Management:
  • Strong proficiency in using GitHub for efficient code management and sharing
Nice to have:
  • Experience in the node.js, vue.js.
  • Experience in Databricks

Required Skills : AWS EMR AWS Glue AWS Lambda AWS SNS DynamoDB Apache Spark PySpark / Python CodingNo Tenure Limit Policy
Background Check :Yes
Notes :
Selling points for candidate :No Tenure Limit Policy
Project Verification Info :"The information provided below is for Apex Systems AV use only and is not to be distributed publicly, or to any third party. Any distribution of the below information will result in corrective action from Apex Systems Vendor Management. MSA: Blanket Approval Received Client Letter: Will Provide"
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :
Master Job Title :
Branch Code :
Apply Now
Share this job
Saxon Global
An error has occurred. This application may no longer respond until reloaded. Reload 🗙