ETL Data Engineer - A

Company:  Tecknomic
Location: Washington
Closing Date: 10/11/2024
Salary: £125 - £150 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description

This is a full-time position with Tecknomic and the project is with the Office of the Chief Technology Officer. This is an onsite role in Washington DC. Please note, in order to apply for this position, you must be able to provide proof of Covid-19 vaccination at the initial screening stage of the interview.

This role closes on 4/23/2024.

The Enterprise Data team at OCTO requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.

The ETL data engineer will support the OCTO Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:

Responsibilities:

  1. Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
  2. Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District’s data systems.
  3. Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stakeholders or analyzing the existing code and perform enhancements or new development.
  4. Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks.
  5. Hands-on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
  6. Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
  7. Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow).
  8. Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats (CSV, XML) and Binary (Parquet, AVRO).
  9. Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
  10. Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
  11. Automates, monitors, alerts, and manages data pipelines and workflows.
  12. Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
  13. Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
  14. Develops complex programs and reports in database query language.
  15. Familiarity/experience with data visualization tools.
  16. Familiarity/experience handling and securing sensitive data based on the level of the sensitivity.

Minimum Education/Certification Requirements:

Bachelor’s degree in Information Technology or related field or equivalent experience.

What we bring:

• Health, Dental and Vision Benefits
• Life, AD&D, Short Term Disability and Long Term Disability paid 100% by the company
• Time off: Public Holidays, Vacation Days & Sick Days
• 401K

Job Type: Full-time

Pay: $1.00 - $86.00 per year

#J-18808-Ljbffr
Apply Now
Share this job
Tecknomic
  • Similar Jobs

  • ETL Data Engineer - A

    Washington
    View Job
  • ETL Data Engineer (ONSITE)

    Washington
    View Job
  • ETL Data Engineer (ONSITE)

    Washington
    View Job
  • ETL Data Engineer (ONSITE)

    Washington
    View Job
  • Technical Data Scientist/ETL Engineer

    Washington
    View Job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙