Software / Data Engineer (1399)

Company:  Zapata Technology, Inc.
Location: Monterey
Closing Date: 09/11/2024
Salary: £150 - £200 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description

Software / Data Engineer (1399) | Monterey, 93944, Monterey, CA, US

Summary: Zapata Technology is seeking an experienced Software / Data Engineer for a hybrid role in Monterey, California. The Data Engineer will lead the transformation of our data infrastructure, utilizing a custom ASP.NET application, Postgres stored procedures, and migrating existing VBA scripts to modern platforms to build and manage ETL processes. This position is required to meet the customer’s current needs but must also be prepared to transition to modern ETL tools such as Apache NiFi and Airflow in the future. The ideal candidate will have extensive experience in data engineering, database management, and designing efficient ETL workflows without relying on traditional ETL tools.

Compensation: $105-138K annually depending upon experience.

Job Qualifications:

Qualifications and skills include:

  • Design and develop modular ETL solutions that ingest and deliver data from various systems to analytics platforms, using custom ASP.NET applications and Postgres stored procedures.
  • Experience in developing and maintaining scalable data storage systems, particularly in Postgres or other relational databases.
  • Proficiency in writing efficient SQL queries and stored procedures to process and transform structured and unstructured data.
  • Experience in designing scalable data pipelines for reporting and analytics, using manual coding techniques rather than third-party ETL applications.
  • Strong ability to collaborate with cross-functional teams to create and implement custom data solutions.
  • Skilled in developing custom scripts and applications to support data transformation and management needs.
  • Experience documenting data processes, managing compliance requirements, and conducting quality assurance tasks.
  • Ability to troubleshoot and resolve data quality issues and ensure system integrity.
  • Familiarity with metadata management, ensuring compliance with data governance frameworks, including HRPP/Privacy/HIPAA/SOP.
  • CompTIA Security+ certification, demonstrating a commitment to security and compliance standards.
  • Computing Environment Certification.

Preferred Qualifications and Skills:

  • Experience with ASP.NET, C#, and related web application development frameworks.
  • Advanced knowledge of Postgres, particularly in writing complex stored procedures, query optimization, and transitioning data infrastructure to Postgres.
  • Strong familiarity with AWS cloud environments, with experience in migrating data systems to AWS.
  • Experience with low-code/no-code platforms and distributed data processing tools such as Spark, Databricks, or similar.
  • Knowledge of real-time data processing, streaming applications, and data warehousing concepts, especially in cloud-native environments.
  • Proficiency in shell scripting and automation to support cloud migrations and system integrations.
  • Experience working in Agile methodologies, particularly within cloud-based or hybrid cloud environments.

Education/Experience:

  • 4+ years of Software Development.

Working Conditions: Prolonged periods sitting at a desk and working on a computer.

Position Type/Expected Hours of Work: Full time position.

Clearance: This position requires an active Secret clearance with the ability to obtain TS/SCI.

AAP/EEO Statement:

Equal Opportunity Employer – M/F/Disabled/Veteran

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.

Zapata Technology, Inc. provides reasonable accommodation to applicants who are veterans or who have disabilities and are unable to fully use our company application system. If you need a reasonable accommodation for any part of the application and hiring process, please notify Christina Hall, EEO Coordinator at

#J-18808-Ljbffr
Apply Now
Share this job
Zapata Technology, Inc.
  • Similar Jobs

  • Software / Data Engineer (1399)

    Monterey
    View Job
  • DSP Software Engineer with Security Clearance

    Monterey
    View Job
  • Software Developer (1403)

    Monterey
    View Job
  • Software Developer (1403)

    Monterey
    View Job
  • Software Developer III

    Monterey
    View Job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙