Data Engineer

Intro description:

Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.

As a highly collaborative organization, our data engineers work cross-functionally with software engineering, data science, and product management to optimize growth and strategy of our data pipeline. In this position, you will be joining the data engineering team in an effort to take our data pipeline to the next level.

Where you come in:

1. Design and develop scalable data pipelines to collect, process, and analyze large volumes of data efficiently.
2. Collaborate with cross-functional teams including data scientists, software engineers, and product managers to understand data requirements and deliver solutions that meet business needs.
3. Develop ELT processes to transform raw data into actionable insights, leveraging tools and frameworks such as Airbyte, BigQuery, Dagster, DBT or similar technologies.
4. Participate in agile development processes, including sprint planning, daily stand-ups, and retrospective meetings, to deliver iterative improvements and drive continuous innovation.
5. Apply best practices in data modeling and schema design to ensure data integrity, consistency, and efficiency.
6. Continuously monitor and optimize data pipelines and systems for performance, availability, scalability, and cost-effectiveness.

What you'll be bringing to the team:

1. Bachelor's degree (BA or BS) or equivalent.
2. A minimum of 2 years of work experience in data engineering or similar role.
3. Advanced SQL knowledge and experience working with a variety of databases (SQL, NoSQL, Graph, Multi-model).
4. A minimum of 2 years professional experience with ETL/ELT, data modeling and Python.
5. Familiarity with cloud environments like GCP, AWS, as well as cloud solutions like Kubernetes, Docker, BigQuery, etc.
6. You have a pragmatic, data-driven mindset and are not dogmatic or overly idealistic about technology choices and trade-offs.
7. You have an aptitude for learning new things quickly and have the confidence and humility to ask clarifying questions.

Even better if you have, but not necessary:

1. Experience with one or more of the following: data processing automation, data quality, data warehousing, data governance, business intelligence, data visualization.
2. Experience working with TB scale data.