Azure DevOps Platform Administrator with Databricks Experience

Company:  USEReady
Location: New York
Closing Date: 06/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description

At USEReady,

We empower people to succeed with data. USEReady is a data and analytics firm that provides the strategies, tools, capability and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud and data ecosystem leaders like Tableau, Salesforce, Snowflake and Amazon Web Services, and has been named Tableau partner of the year multiple times.

Headquartered in NYC, the company has 600+ employees across offices in the U.S., Canada, Singapore and India and specializes in financial services. USEReady's deep analytics expertise, unique player/coach approach and focus on fast results makes the company a perfect partner for a cloud-first, digital world.

Job Title : Azure DevOps Administrator

Location : NYC

Job Type : Long term Contract

Experience

. As an Azure Databricks Administrator within this department, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security across workspaces, clusters, and jobs. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI/CD pipelines using Azure DevOps. By leveraging a deep understanding of Databricks architecture and proficiency in scripting languages, the administrator will automate tasks and enhance the efficiency of data operations. Strong communication skills and a commitment to high-quality support will enable effective collaboration with cross-functional teams, directly contributing to the department's mission of delivering robust data solutions and insights

Job Responsibilities

  • Manage and maintain Azure Databricks Platform, workspaces, clusters, and jobs
  • Oversee user administration including access controls and permissions
  • Handle library installations, runtime management, and policy enforcement
  • Implement/analyze cost control measures and monitor platform usage and performance
  • Administer Unity Catalog for data governance and security
  • Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platform
  • Manage Azure storage solutions, including Blob Storage and Data Lake Storage
  • Administer Azure Key Vault for secure storage of secrets and keys
  • Configure and manage Azure Data Factory for data integration and ETL processes
  • Implement and manage VNETs, firewalls, Azure policies and security best practices
  • Implement and manage Azure DevOps for CI/CD pipelines and version control
  • Implement best practices for automated deployment and continuous integration
  • Set up budgets and alerts to monitor and control Azure costs and spend
  • Implement monitoring solutions for platform health and performance
  • Configure alerts for proactive issue detection and resolution
  • Databricks Lakehouse Monitoring

Minimum Qualifications

  • Minimum of Bachelor's degree in Computer science, Information systems, or Engineering
  • 7+ years of related professional experience administering data platforms
  • 3+ years' experience with Azure Databricks Lakehouse Platform
  • Proficiency in scripting languages such as Python/PySpark, PowerShell, or Bash
  • Experience in automating administrative tasks and workflows
  • Knowledge of security best practices and compliance requirements
  • Experience with ETL processes, data pipelines, and big data technologies
  • Experience with backup and restore procedures for Databricks and Azure services
  • Ability to troubleshoot and resolve issues in a timely and efficient manner
  • Strong verbal and written communication skills
  • Ability to document processes, procedures, and configurations clearly
  • Commitment to providing high-quality support to internal/external users and stakeholders
  • Ability to understand and address the needs of internal and external customers
  • Team player with the ability to work collaboratively with cross-functional teams
  • Flexibility to adapt to changing requirements and priorities
  • Willingness to learn new technologies and continuously improve skills

Preferred Qualifications

  • Deep understanding of Databricks architecture, features, and best practices
  • Experience with Delta Lake and Databricks SQL for advanced data management
  • Experience in performance tuning and optimization for both Databricks and Azure environments
  • Experience supporting/administering data science and ML workloads in Databricks
  • Knowledge of disaster recovery planning and implementation
  • Experience integrating Databricks with other data platforms and tools
  • Understanding of hybrid and multi-cloud environments
  • Experience implementing data protection measures and ensuring regulatory compliance
Apply Now
Share this job
USEReady
  • Similar Jobs

  • Azure DevOps Engineer

    Weehawken
    View Job
  • AZURE DEVOPS TESTER

    New York
    View Job
  • Platform DevOps Engineer

    New York
    View Job
  • Sr. DevOps Engineer (Must have Google Cloud Platform experience)

    Jersey City
    View Job
  • Junior Platform Engineer, DevOps

    Little Ferry
    View Job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙