Data bricks Data Engineer

Job Title

Relevant Experience (in Yrs)

Technical/Functional Skills

Experience Required

• 10+ to 15 years of experience in Development, design, Architect implementation, and analytics solutions

Roles & Responsibilities

• 5+ Years of Experience on Data Bricks
• Hands-on development Design and Develop applications using Databricks
• Data Bricks Architecture experience is an added advantage.
• 5+ Years of Experience on AWS
• From an AWS perspective, candidates need to be very well versed with Terraform, Glue, Lambda, S3 and their usage and practical issues faced when dealing with them.
• At least 5+ Experience on AWS (Glue, S3, lambda at the minimum)
• Candidates need to have knowledge in Python core programming and Spark.
• Ability to design and demonstrate system Architecture with different environments
• Hands-on experience on Data Warehousing and SQL
• Experience on Pandas
• Strong expertise in SQL is required.
• Solid experience with git software version control and good
• Very Strong Data Bricks Architecture/Development knowledge
• Experience with DevOps & CI/CD tools – Jenkins, Cloudbees, Please Build, etc.
• Proficiency working with large data stores and data sets
• Health care knowledge is preferred.
• Agile methodology (Jira Preferable)
• Must have capability to understand the current Architecture
• Coding, testing and implementation of cloud-based Data bricks apps
• Support existing code thru enhancing, troubleshooting and maintaining per requirements
• Support on AWS migration
• Support to understand current ETL process Python or Scala
• Maintain consistent practices for source code management in GitHub
• Comply with established CI/CD practices, and participate in the creation of new CI/CD methods
• Attend daily scrum calls, and actively participate in updating/creating user stories and tasks in Jira
• Work closely with business analysts.
• Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data-centric technologies for the platform.
• Collaborating within a project team to solve complex problems.
• Lead by example coaching and mentoring those of your peers and mentoring less experienced team members. Operate as part of the extended management team.