Data Engineering Lead
About
Quantum Rise is a rapidly scaling AI start-up offering consulting and product development capabilities to high-growth organizations. Our offerings range from providing strategic advice to full AI product development. We are expanding our Engineering team and are looking for a talented Data Engineering Lead to join our team.
Position Summary
As a Data Engineering Lead at Quantum Rise, you will leverage your expertise in data engineering and leadership to design, implement, and manage large-scale data systems. You will collaborate closely with consultants, data scientists, and software engineers to solve complex business problems and deliver innovative AI-driven solutions to our clients. Your role will be pivotal in driving the data strategy and infrastructure that underpin our AI products.
Key Responsibilities
- Lead the design, implementation, and management of scalable and robust data architectures that support AI and machine learning applications.
- Collaborate with cross-functional teams to understand client needs and translate them into effective data solutions.
- Ensure data quality, integrity, and security across all data systems and processes.
- Develop and maintain ETL processes to ingest, process, and store large volumes of data from various sources.
- Optimize and tune data systems for performance, reliability, and scalability.
- Utilize cloud platforms (e.g., AWS, Azure, Google Cloud) to deploy and manage data solutions
- Implement and manage data governance practices and policies.
- Mentor and develop junior data engineers, fostering a culture of continuous learning and improvement.
- Drive innovation by staying abreast of industry trends and emerging technologies in data engineering and AI.
- Contribute to Quantum Rise's thought leadership initiatives, including white papers, webinars, and industry conferences.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- 5+ years of experience in data engineering, with a proven track record of leading data projects and teams.
- Strong proficiency in data modeling, database design, and data warehousing.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with cloud platforms and services (e.g., AWS Redshift, Azure Synapse, Google BigQuery, Apache Airflow, dbt, Datadog, Grafana).
- Strong understanding of data governance, security, and compliance.
- Excellent problem-solving skills and ability to think creatively to develop innovative solutions.
- Experience with version control systems (e.g., Git) and Agile development methodologies.
- Strong communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
We urge you to apply even if you don't meet all the qualifications. Not every strong candidate will tick every box. Research indicates that individuals from underrepresented groups often face imposter syndrome and doubt their candidacy. Please don't rule yourself out prematurely-apply if you're interested. Given that our AI systems have significant social and ethical impact, we value diverse perspectives and strive for a diverse team.