Data Engineer

Dice is the leading career destination for tech experts at every stage of their careers. Our client, TEKsystems c/o Allegis Group, is seeking the following. Apply via Dice today!

Description:

THIS IS A 100% ONSITE ROLE 5 DAYS A WEEK IN THE GREATER BOSTON AREA.

The customer is actively seeking an Azure Data Engineer to design, build, and manage data solutions on the Microsoft Azure cloud platform. You will oversee creating and maintaining data pipelines, data storage solutions, data processing, and data integration to enable data-driven decision-making inside the organization, as well as maintaining the infrastructure that supports data storage, processing, and retrieval. You will work with large data sets and develop data pipelines that move data from source systems to data warehouses, data lakes, and other data storage and processing systems. Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the data architecture and data-driven solutions.

Skills:

• Data Management and Storage: Microsoft Azure offers a variety of data storage options, including Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Blob Storage, and more. The Azure Data Engineer will work with these and other solutions.
• Will need experience in designing data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.
• Data Integration and ETL: To extract, transform, and load (ETL) data from various sources into data warehouses or data lakes, data engineers develop and implement data integration processes, frequently using Azure Data Factory.
• Big Data and Analytics: Will handle and analyze enormous volumes of data, Azure Data Engineers use big data technologies like Azure Databricks and Apache Spark. To support data analytics, machine learning, and other data-driven applications, they create data processing workflows and pipelines.

Additional Skills & Qualifications:

• Experience in designing and hands-on development in cloud-based analytics solutions.
• Expert-level understanding of Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Designing and building data pipelines using API ingestion and Streaming ingestion methods.
• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
• Experience in developing NO SQL solutions using Azure Cosmos DB is essential.
• Thorough understanding of Azure Cloud Infrastructure offerings.
• Strong experience in common data warehouse modeling principles including Kimball and Inmon.
• Experience in additional Modern Data Platforms technologies such as Snowflake, Matillion, BryteFlow, and Tableau are a distinct advantage.
• Knowledge of Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, and Power BI is desirable.
• Knowledge of Microsoft BI Stack (SSRS/SSAS (Tabular with DAX & OLAP with MDX) SSIS) is desirable.
• Working knowledge of Python is desirable.

Responsibilities:

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional/non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centers and Azure regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.