Data Engineer

What You Will Be Doing :

• Developing new tools, code, and services to execute data engineering activities.
• Movement of structure and unstructured data using approved methods.
• Executing data ingestion activities for storing data in a local or enterprise level location.
• Viewing data in its source format.
• Developing code to format data that supports exploration.
• Analyzing source data formats and working with Data Scientists and partners to determine the formats and transforms that best meet mission objectives.
• Developing code and tools to provide one-time and on-going data formatting and transformations into enterprise or boutique data models.
• Implementing existing ETL code and best practices/standards.
• Developing an ETL Code Transition Plan.
• Developing and delivering documentation for each project including ETL mappings, code use guide, code location, and access instructions.
• Facilitating Code Reviews.
• Providing consulting services to support data transport, ingestion, conditioning, access, and management.

• MUST HAVE a Current and Active Top Secret SCI with Polygraph, as the customer is NOT sponsoring clearances.
• Experience with Extract, Transform, and Load (ETL) tools and processes.
• Python.
• AWS.
• SQL.
• APIs.
• Linux.
• Geospatial tools/data.

• Docker.
• Jenkins.
• Hadoop/Spark.
• Kibana.
• Kafka.
• NiFi.
• ElasticSearch.