Senior Data Engineer

Skills

1. Cloud Platforms: Deep understanding of Azure ecosystem, including Azure Data Factory, Data Lake Storage, Blob Storage, Power Apps, and Functions.
2. Big Data Technologies: Proficiency in Databricks, Spark, PySpark, Scala, and SQL.
3. Data Engineering Fundamentals: Expertise in ETL/ELT processes, data pipelines, data modeling, schema design, and data warehousing.
4. Programming: Strong Python and SQL skills, with knowledge of other languages like Scala or R beneficial.
5. Data Warehousing and Business Intelligence: Strong ERD concepts, designs, and patterns, understanding of OLAP/OLTP systems, performance tuning, Database Server concepts, and BI tools (Power BI, Tableau).
6. Data Governance: Strong understanding of RBAC/ABAC, Data Lineage, Data leak prevention, Data security, and compliance.
7. Deep understanding and implementation knowledge of audit and monitoring in Cloud.

Experience Required

1. A minimum of seven (7) years of applying Enterprise Architecture principles, with at least five (5) years in a lead capacity.
2. Cloud and Data Engineering: Minimum of five (5) years of hands-on experience with Azure Data Factory, Databricks, API management, and managing Azure resources.
3. Demonstrated ability to automate Azure data resources using DataOps principles and tools.
4. Data Modeling and Development: Minimum of five (5) years of experience developing data models and pipelines using Python.
5. Data Platform: Minimum of five (5) years of experience working with Lakehouse platforms.
6. DevOps and Infrastructure as Code: Minimum of three (3) years of experience in CI/CD pipelines and infrastructure automation using tools such as Terraform.
7. Data Warehouse: Minimum of five (5) years of experience with data warehousing systems, OLAP/OLTP systems, and integration of BI tools.

Education

This classification requires the possession of a bachelor’s degree in an IT-related or Engineering field.

About US Tech Solutions

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit our website. We are constantly on the lookout for professionals to fulfill the staffing needs of our clients, and we currently have a job opening that may interest you.

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, or status as a protected veteran.