Company:
Zencon Group
Location: Washington
Closing Date: 18/10/2024
Salary: £125 - £150 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
We are seeking experienced Data Engineers to join our Advana team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, DataBricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
Responsibilities:
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as DataBricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze very large datasets, similar to those encountered in a federal agency.
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
- Utilize your experience with DoD (Department of Defense) projects to meet specific data requirements and adhere to relevant standards.
- Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
Requirements:
- Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
- Bachelor's degree in a related field.
- High level of proficiency in ETL processes and demonstrated hands-on experience with technologies such as DataBricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Strong problem-solving skills and ability to solve complex data-related issues.
- Secret clearance is required; TS/SCI clearance is preferred.
- Recent DoD or IC-related experience.
- Demonstrated experience working with very large datasets and leveraging big data technologies to process and analyze data efficiently.
- Understanding of data modeling/visualization, database design principles, and data governance practices.
- Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a huge plus.
- Previous experience with Advana is a plus.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Detail-oriented mindset with a commitment to delivering high-quality results.
- Must be in the DC Metro area and available to work onsite (Crystal City, VA and Alexandria, VA) 2-3 days per week.
Share this job
Zencon Group
Useful Links
Similar Jobs
- View Job
Advana/ DoD Data Engineer
Washington - View Job
Advana/ DoD Data Engineer
Washington - View Job
Electrical Engineer (DOD/NAVY) - Junior & Mid Level Needed
Washington - View Job
Sr. Manager, Field Engineering (Public Sector - DoD/IC)
Washington - View Job
Sr. Manager, Field Engineering (Public Sector - DoD/IC)
Washington