System Engineer

Job Description
The Sponsor requires a team to support their program that automates processing of large forensic images, extract and enrich metadata, and display resulting information in meaningful ways for analysts to conduct their assessments.
Job Description
The Sponsor's organization provides technical solutions and capabilities that enable a cadre of analysts to make critical assessments, including a platform to conduct enterprise search, digital forensics, and data analytics. The Sponsor's organization is building a modern cloud-based system to replace a legacy standalone system and requires an infrastructure team that can work in a quick-paced, dynamic, agile software development environment. The Sponsor adheres to Agile Scrum development methodology best practices and has 2 week sprint cycles. The Contractor team shall work with a variety of individuals, including key stakeholders and other development teams. However, the Sponsor project manager will manage priorities. The team will be responsible for identifying, documenting, and communicating risks and mitigations across the designed system and reviewing the existing and designed system to identify gaps and minimize overlaps, analyze project needs for alternative solutions, and identify needed layers and modules and how they work together for the system. The team will play a key role in the development and selection of backend database technologies and optimization of the database population to support content, volume, ETL, and periodicity of data and will review technical implementation strategies and plans, identifies inconsistencies and opportunities for improvement and communicates those results to the PM.
Requirements
1. (Mandatory) Demonstrated experience working with an AWS cloud environment.
2. (Mandatory) Demonstrated experience understanding and implementing system security requirements.
3. (Mandatory) Demonstrated experience creating a testing environment to identify and improve bugs and efficiencies.
4. (Mandatory) Demonstrated experience programming in Python, PowerShell, and Java 8+.
5. (Mandatory) Demonstrated experience using Python and the PySpark library to read, write, and manipulate large structured and semi-structured datasets.
6. (Mandatory) Demonstrated experience using task tracking and version control technology to include JIRA and GitHub.
7. (Mandatory) Demonstrated experience using SQL and database technologies such as MySQL or SQL server.
8. (Mandatory) Demonstrated experience using and managing ElasticSearch clusters.
9. (Mandatory) Demonstrated experience tuning and optimizing ElasticSearch.
10. (Mandatory) Demonstrated experience creating and managing ElasticSearch indices.
11. (Mandatory) Demonstrated experience with Apache Spark and managing Spark clusters.
12. (Mandatory) Demonstrated experience tuning and optimizing Apache Spark.
13. (Mandatory) Demonstrated experience with the Databricks platform and Databricks API & CLI.
14. (Mandatory) Demonstrated experience understanding Hadoop Distributed File System (HDFS).
15. (Mandatory) Demonstrated experience understanding Databricks File System (DBFS).
16. (Mandatory) Demonstrated experience with infrastructure as code (IaC) technologies including AWS Cloud Formation.
17. (Mandatory) Demonstrated experience using automated build tools such as Jenkins.
18. (Mandatory) Demonstrated experience implementing machine learning models on text and multimedia data such as Spark NLP and Computer Vision models.
19. (Mandatory) Demonstrated experience with Linux operating systems and shell scripting such as Bash.
20. (Mandatory) Demonstrated experience developing machine learning models on text data and structured datasets.
21. (Desired) Bachelor's degree in Engineering, Computer Science, Mathematics, Data Science, Statistics, or related field or equivalent work experience.
22. (Desired) Demonstrated professional experience with cloud technology networks, digital forensics, or cybersecurity topics.
23. (Desired) Demonstrated experience using artificial intelligence and machine learning technologies/packages.
24. (Desired) Demonstrated experience using data pipelines and workflow technologies.
Skillset Questions
1. (Mandatory) Demonstrated experience working with an AWS cloud environment.
2. (Mandatory) Demonstrated experience understanding and implementing system security requirements.
3. (Mandatory) Demonstrated experience creating a testing environment to identify and improve bugs and efficiencies.
4. (Mandatory) Demonstrated experience programming in Python, PowerShell, and Java 8+.
5. (Mandatory) Demonstrated experience using Python and the PySpark library to read, write, and manipulate large structured and semi-structured datasets.
6. (Mandatory) Demonstrated experience using task tracking and version control technology to include JIRA and GitHub.
7. (Mandatory) Demonstrated experience using SQL and database technologies such as MySQL or SQL server.
8. (Mandatory) Demonstrated experience using and managing ElasticSearch clusters.
9. (Mandatory) Demonstrated experience tuning and optimizing ElasticSearch.
10. (Mandatory) Demonstrated experience creating and managing ElasticSearch indices.
11. (Mandatory) Demonstrated experience with Apache Spark and managing Spark clusters.
12. (Mandatory) Demonstrated experience tuning and optimizing Apache Spark.
13. (Mandatory) Demonstrated experience with the Databricks platform and Databricks API & CLI.
14. (Mandatory) Demonstrated experience understanding Hadoop Distributed File System (HDFS).
15. (Mandatory) Demonstrated experience understanding Databricks File System (DBFS).
16. (Mandatory) Demonstrated experience with infrastructure as code (IaC) technologies including AWS Cloud Formation.
17. (Mandatory) Demonstrated experience using automated build tools such as Jenkins.
18. (Mandatory) Demonstrated experience implementing machine learning models on text and multimedia data such as Spark NLP and Computer Vision models.
19. (Mandatory) Demonstrated experience with Linux operating systems and shell scripting such as Bash.
20. (Mandatory) Demonstrated experience developing machine learning models on text data and structured datasets.
21. (Desired) Bachelor's degree in Engineering, Computer Science, Mathematics, Data Science, Statistics, or related field or equivalent work experience.
22. (Desired) Demonstrated professional experience with cloud technology networks, digital forensics, or cybersecurity topics.
23. (Desired) Demonstrated experience using artificial intelligence and machine learning technologies/packages.
24. (Desired) Demonstrated experience using data pipelines and workflow technologies.