Sr. Data Engineer with Palantir

Role Senior Data Engineer w/ Palantir
Location Jersey City, New Jersey, US

• Project Description:

Luxoft has contract with a major Telecommunications provider to engage to establish integrated cloud technology platforms to ingest information from various Network Engineering support applications in order to better optimize management and planning for the future network. To do this Network Engineering Ops is managing data ingestion into a Snowflake Azure based deployment which allows for one cohesive platform to serve all types of users and workloads in a consistent way. Centralizing data in a unified, governed, managed data platform allows all authorized users to access accurate and timely data for analysis that is useful for highly transnational datasets. It is also useful that it can store structured and unstructured data. Additionally Network Eng. & Ops is leveraging a Palantir platform for the creation and management of cost forecasting scenarios.

• Responsibilities:

Data Ingest Data Quality Management and Support
Team to ingest data from/to Snowflake, On Prem, or Azure to Palantir and perform necessary data grooming and ongoing flow support to ensure informational requirements.
Generally following monthly sprints but needs may shift depending upon parking lot prioritizations or cross-team integration planning.
Team will also monitor data quality and resolve any issues related to data health.

• Mandatory Skills Description:

Data Engineering
Palantir Foundry
Cloud
Big Data
SnowFlake
Python
Databricks
Azure

• Nice-to-Have Skills:

Palantir AIP