Big Data Engineer : Dell

Company:  ShiftCode Analytics
Location: Austin
Closing Date: 09/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description

Interview : Video
Visa : All apart from H1b , cpt and TN
This is hybrid from day-1.
Description :
Requirements:

  • 5+ years' experience in data engineering work
  • Previous experience as a Big Data Engineer
  • In-depth knowledge of Hadoop, Spark, Airflow
  • Technical expertise with data models, data mining, and segmentation techniques
  • Hands-on experience with SQL database, Redis
  • Familiarity with Kubernetes and Docker tools
  • Familiarity with S3, Apache Parquet and Apache Iceberg
  • Understand how to extract data
  • Experience with Graph databases
  • Knowledge of programming languages (e.g. Python)
  • Experience with Streaming - Kafka or RMQ
  • Experience with Gitlab based CI/CD
  • Experience with Data catalog

Added advantage:
  • AI/Client Engineer
  • Client Pipelines

Responsibilities:
  • Analyze and organize raw data
  • Build data systems and pipelines
  • Interpret trends and patterns in enterprise data
  • Conduct complex data analysis and report on results
  • Prepare data for prescriptive and predictive modeling
  • Combine raw information from different sources
  • Explore ways to enhance data quality and reliability
  • Identify opportunities for data acquisition
  • Collaborate with data scientists and architects on several projects
  • Work independently with different data owners and design data flows
Apply Now
Share this job
ShiftCode Analytics
  • Similar Jobs

  • Big Data Engineer : Dell

    Austin
    View Job
  • Big Data Engineer

    Austin
    View Job
  • Big data Engineer

    Austin
    View Job
  • Data Scientist Big Data Engineer Specialist

    Austin
    View Job
  • Big data Engineer with Java

    Austin
    View Job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙