Sr. Lead, Cloud Engineer

JOB TITLE - Sr. Lead, Cloud Engineer, Data Platform

Job Location - Chicago IL (Onsite)

Description:

Sr. Lead Cloud/Data Platform Engineer to support data platforms including Snowflake, Databricks, and other data platforms. The individual will specialize in data platforms, handling the design, implementation, and maintenance of data storage and processing solutions to ensure efficient data flow and accessibility, collaborating with data engineers and analysts to support data-driven decision-making across the organization.

Data Platform Engineering

• Deep understanding of Snowflake’s infrastructure and services to optimize and evolve our infrastructure's reliability, availability, serviceability, performance, and cost efficiency.
• Design, develop, and unit-test various modules of database product applications primarily on Snowflake but also on Databricks and other data services.
• Contribute to initiatives aimed at scaling our processes, systems, services, and automation.
• Build data engineering and data ingestion modules for Snowflake (Relational database).
• Implement automation for administering Accounts/Databases and access roles.
• Implement Snowflake standards and methodologies for DB security – both infra and app level.
• Implement data sharing/replication for cross-cloud/cross-region for internal/external clients.
• Implement data encryption/decryption/masking policies to protect PII/PCI data.
• Propose and implement DB/Snowflake query performance optimizations to manage cost.
• Build foundational database infrastructure automation to manage traffic and scale.
• Create data structures and design data models tailored to Snowflake's architecture.
• Demonstrate knowledge of cloud managed services, particularly Azure CLI.
• Knowledge of semi-structured data and Snowflake’s approach to data sharing and security.
• Develop monitoring architecture and implement monitoring agents, dashboards, and alerts.
• Work with Cloud leadership, Product Management, and Application Teams on requirements.

Cloud DevOps Engineering, Automation, & Operations

• Develop infrastructure-as-code (IaC) automation (e.g., Terraform) to create IaC patterns and modules to provide acceleration to development end users programmatically.
• Utilize modern software DevOps and CI/CD tooling, such as GitHub, GitHub Actions, ADO, Jenkins, etc., to provision infrastructure resources and prevent configuration drift.
• Investigate and resolve complex cloud infrastructure-related issues and recommend and develop solutions to these issues, creating documentation of reengineering processes as required.
• Participate in IT Service Management (ITSM) change, incident, and general requests for cloud platform support for business as usual (BAU) operations.

Minimum Qualifications:

• 5-8+ years of technology experience.
• 3+ years cloud computing (Microsoft Azure).
• 3+ years Snowflake experience.
• Strong developing skills in Python and associated libraries.
• Terraform Infrastructure as code (IaC) automation.

Job Type: Full-time

Pay: $70.00 - $72.00 per hour

Benefits:

• 401(k)
• Dental insurance
• Health insurance

Experience:

• Snowflake: 5 years (Required)
• Databricks: 5 years (Required)
• Automation: 4 years (Required)
• DevOps: 4 years (Required)
• Infrastructure-as-code: 4 years (Required)

Work Location: In person