Azure Data Engineer

Company:  Tata Consultancy Services
Location: Atlanta
Closing Date: 02/11/2024
Salary: £125 - £150 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
Must Have Technical/Functional Skills

  • Azure SQL Database, Cosmos (No SQL)
  • Python, Scala
  • Strong Hands-on in T-SQL
  • Experience with Azure, REST API
  • Creating distributed data pipelines for batch and real-time applications
  • Apache Spark
  • Azure Data Factory
  • Azure Databricks
  • Jupyter Notebook
  • Azure Synapse Analytics
  • Azure Data Lake/Analytics
Roles & Responsibilities

  • Design, develop and build real-time data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, etc.)
  • Leverage the understanding of software architecture and software design patterns to write scalable, maintainable, well-designed and future-proof software
  • Manage existing pipelines and create new pipelines from a variety of sources (relational, XML, etc.)
  • Actively apply best practices within CI/CD
  • Propose and implement solutions for data pipeline stabilization and data quality checks
  • Coordinate with other teams to design optimal patterns for data ingest and egress, as well as lead and coordinate data quality initiatives and troubleshooting
  • Design and build solutions to track data quality, stabilize data pipelines, etc. to ensure reliable operations
  • Ensure best practices are followed across architecture, codebase and configuration
  • Eliminate waste
  • Deliver on time
Skills And Abilities

  • Ability to establish clear goals and responsibilities to achieve a high level of performance.
  • Ability to evaluate different options proactively and solve problems in an innovative way. Develop new solutions or combine existing methods to create new approaches.
  • Comfortable working with external product teams to establish optimal data integration patterns/solutions.
#J-18808-Ljbffr
Apply Now
Share this job
Tata Consultancy Services
  • Similar Jobs

  • Senior Data Engineer - Azure

    Atlanta
    View Job
  • Azure Data and BI Engineer

    Atlanta
    View Job
  • Azure Engineer

    Atlanta
    View Job
  • Azure Engineer

    Atlanta
    View Job
  • Azure DevOps Engineer

    Atlanta
    View Job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙