Location: Remote (EST Hours)
Are you passionate about challenging the limits of data science and revolutionizing market research through synthetic data? We're looking for a highly skilled Data Engineer to join our client's innovative team. In this pivotal role, you will collaborate with data scientists to design, develop, and optimize scalable data pipelines to support cutting-edge synthetic data initiatives.
We are working with a global enterprise team of researchers who go beyond precise measurement to offer a deeper understanding of society, markets, and people. They combine advanced science, cutting-edge technology, and deep expertise to deliver meaningful, impactful results.
Key Responsibilities:
- Build and maintain scalable data pipelines using technologies such as Apache Spark, Kafka, SQL, and NoSQL databases.
- Collaborate with cross-functional teams to ensure efficient and reliable data processing and storage.
- Optimize and improve data infrastructure, ensuring performance, reliability, and data quality.
- Utilize cloud platforms (AWS, Google Cloud, Azure) to leverage cloud-based data storage and processing solutions.
- Deploy and manage data infrastructure using containerization and orchestration tools like Docker and Kubernetes.
- Work closely with data scientists on synthetic data generation, AI/ML model deployment, and similar projects.
- Implement privacy-preserving technologies and ethical considerations in data processes.
What We're Looking For:
- Proven experience in data engineering, with expertise in Apache Spark, Kafka, SQL, and NoSQL.
- Proficiency in Python, Java, or Scala, with experience in ETL frameworks and data orchestration tools.
- Hands-on experience with cloud platforms and cloud-based data storage.
- Familiarity with Docker, Kubernetes, and cloud deployment practices.
- Commitment to data quality, with an ability to identify inefficiencies and proactively implement improvements.
- Familiarity with synthetic data generation, AI/ML, and privacy-preserving technologies.
- Strong communication skills to articulate complex concepts to technical and non-technical stakeholders.
- Passion for innovation in data science, with a desire to push the limits of synthetic data solutions.
Why Join?
- Be at the forefront of synthetic data innovations, shaping the future of market research.
- Work in a collaborative environment with a talented team of data engineers, analysts, and scientists.
- Flexible working options with opportunities for personal growth and career advancement.