Senior Data Engineer

Who we are:

Welcome to Archipelago, where we're redefining the landscape of commercial property insurance with our AI-powered data network. We believe in the power of accurate information to drive meaningful business decisions and offer solutions to generate that accurate information as easily and efficiently as possible. By connecting brokers, owners, and insurers, we empower our customers to navigate the complexities of the property insurance and risk management processes with confidence.

Archipelago was founded in 2018 and serves many of the world’s largest property brokers and their clients, representing over 500 of the worlds largest and most dynamic commercial property portfolios to improve their data and better represent their risks. Archipelago has achieved Series B funding from industry-leading investment partners including Scale, Canaan Partners, Ignition Partners, Prologis Ventures, Stone Point Capital, and Zigg Capital.

Join us at Archipelago and be part of a team dedicated to transforming the commercial property insurance industry. We're seeking individuals with a passion for innovation, a commitment to excellence, and a drive to further elevate and empower our customers.

If you're ready to make a meaningful impact and be part of a dynamic, forward-thinking company, we invite you to explore our job opportunities and join us on our journey to keep data accurate and workflows seamless.

NOTE: Candidates to be located or able to commute to our offices in Enschede Netherlands, New York, NY or San Francisco, CA metro areas only as we are looking to build co-located clusters of engineers that can meet in an office for collaboration and design with a hybrid schedule.

Who you are:

Archipelago is seeking a Senior Data Engineer to join our growing team. We are looking for an experienced data developer comfortable designing, developing & maintaining complex data pipelines, with a focus on flexibility and developer experience. We are adopting the Flyte platform to help us take our document processing pipeline to the next level and looking for someone to help us develop and scale this out.

This is an exciting opportunity to be part of a talented, passionate, and mission-driven group. We iterate quickly, ship every week, build for the long term, and are looking for smart, independent engineers who want to ply their trade with like-minded people.

Responsibilities :

• Develop, design, create, modify, and/or test document processing pipelines or systems to support our Machine Learning and Analytics capabilities.
• Collaborate with Data Science, Product Managers and Software Engineers to enable the Product Support team to deliver compelling user-facing features.
• Ensure quality of data through their flow, implement guardrails, health checks and alerts
• Driving the continuous improvement of our existing codebase by participating in code reviews, refactoring legacy code, and measuring code coverage and performance

Key Outcomes you are responsible for:

• Maintaining and improving accuracy and coverage metrics of the document processing pipeline.
• In collaboration with product initiative owners support Monthly Active User growth through developing and supporting customer first user experiences.
• Maintain and improve quality, performance, architecture, and security of existing functionality.
• Bring your expertise to mentor and grow not just junior engineers but the whole squad.

Key Metrics & Results to measure your success:

• Automate document processing by integrating and productizing 3rd party service Flyte to enable Labs team models to support 65% accurate automated extraction of 40 fields for documents and 500 row SOV processing in <5m.
• Evolve the automation pipeline to support casualty data types / use cases.
• Monitor, troubleshoot, and improve the flyte pipeline to have a < 5% error rate.

Qualifications:

• 5+ years of experience as a hands on data engineer with strong proficiency in Python, Pandas, etc.
• 2+ years of experience working with data workflow platforms such as Apache Airflow, Slurm or Flyte etc.
• Experience operating both internal and production data pipelines.
• Experience collaborating with platform and machine learning engineers.
• Experience with processing PDF and Excel files.
• SQL / Analytics experience with Snowflake.
• Experience working in cloud based environments, e.g. AWS, GCP, Azure.

Bonus Points:

• Experience building data pipelines for the insurance industry.
• Experience with Flyte.
• Experience with AWS compute and EKS.
• Experience with a compiled language such as Go, Java, C# etc

Benefits:

We offer benefits regardless of where you are in your career. We believe that providing our employees with the means to lead healthy balanced lives results in the best possible work performance.

• Company Equity Program
• Medical, dental, vision and life insurance
• Flexible Time Off
• Mental Health programs
• Remote office reimbursement

*All benefits are subject to change at management’s discretion.

Salary Range in CA/NY: $120,000 - $180,000

We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age (40 and over), race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.