Company:
ShiftCode Analytics
Location: Austin
Closing Date: 08/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Added advantage:
Responsibilities:
Interview : Video
Visa : All apart from H1b , cpt and TN
This is hybrid from day-1.
Description :
Requirements:
- 5+ years' experience in data engineering work
- Previous experience as a Big Data Engineer
- In-depth knowledge of Hadoop, Spark, Airflow
- Technical expertise with data models, data mining, and segmentation techniques
- Hands-on experience with SQL database, Redis
- Familiarity with Kubernetes and Docker tools
- Familiarity with S3, Apache Parquet and Apache Iceberg
- Understand how to extract data
- Experience with Graph databases
- Knowledge of programming languages (e.g. Python)
- Experience with Streaming - Kafka or RMQ
- Experience with Gitlab based CI/CD
- Experience with Data catalog
Added advantage:
- AI/Client Engineer
- Client Pipelines
Responsibilities:
- Analyze and organize raw data
- Build data systems and pipelines
- Interpret trends and patterns in enterprise data
- Conduct complex data analysis and report on results
- Prepare data for prescriptive and predictive modeling
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Identify opportunities for data acquisition
- Collaborate with data scientists and architects on several projects
- Work independently with different data owners and design data flows
Share this job
ShiftCode Analytics
Useful Links