AI Backend Engineer

About Replit
Replit is on a mission to onboard the next billion software creators and AI has only accelerated things. It's the evolution of no code/low code: AI native coders. 30 million people have signed up to build applications, internal tools, and workflows on Replit - many of them with zero coding experience. Join the biggest change in technology since the arrival of the personal computer. Join us and help build software faster.

AI Backend Engineer, Replit, Inc., San Francisco, CA.

Responsibilities:

1. Design, develop, and maintain the backend systems that support AI features on the Replit platform.
2. Collaborate with AI researchers and engineers to integrate AI models and algorithms into our platform.
3. Optimize and scale Large Language Model serving infrastructure to ensure the platform can handle increasing user demands.
4. Implement monitoring and logging solutions to proactively identify and address performance issues.
5. Work closely with cross-functional teams, including front-end engineers, product managers, and data scientists, to deliver high-quality AI features.
6. Create and maintain technical documentation to ensure knowledge sharing and onboarding of new team members.

Requirements:

1. Bachelor’s Degree in Computer Science and/or Computer Engineering and 4 years of experience with Artificial Intelligence.
2. 2 years of experience as a Backend Engineer with a focus on AI or Machine Learning projects.
3. 2 years of experience in Python and Go.
4. 2 years of experience with AI frameworks and libraries.
5. 2 years of experience with MLOps (and LLMOps) best practices.
6. 2 years of experience with distributed computing, cloud platforms (e.g., AWS, GCP, Azure), and containerization (e.g., Docker, Kubernetes).
7. 2 years of experience demonstrating problem-solving and troubleshooting skills.

Must successfully complete competency-based interview. Telecommuting permitted. Must report to HQ 3x per week. Only incidental domestic travel is required for this position. Expected salary range is 180,960-$260,000/year.