Job DescriptionWe are seeking a skilled LLM Engineer proficient in Python programming and experienced in developing, deploying, and optimizing large language models (LLMs). The ideal candidate will have hands-on experience with FastAPI or Flask frameworks, Lang Chain implementation, and building Retrieval-Augmented Generation (RAG) pipelines. You will play a key role in integrating cutting-edge AI technologies to solve complex business problems, focusing on vector stores and retrievers while deploying scalable solutions on AWS.Key Responsibilities1. Python Development:a. Design, develop, and maintain scalable web services using FastAPI or Flask frameworks.b. Write efficient, reusable, and modular Python code to support API-driven LLM applications.2. Lang Chain & Supporting Frameworks:a. Implement Lang Chain to build custom pipelines for document indexing, retrieval, and summarization.b. Integrate Lang Chains RAG capabilities with other components like vector stores and retrievers to support real-time querying and document processing.3. RAG Pipelines:a. Architect and deploy Retrieval-Augmented Generation (RAG) systems for chatbots, knowledge systems, and other generative AI applications.b. Optimize RAG systems for speed, accuracy, and scalability across multiple use cases.4. Vector Stores & Retrievers:a. Work with vector databases like Pinecone, Chroma, FAISS, or Milvus to store and manage embeddings.b. Implement retrievers and re-rankers to improve query efficiency, ensuring high-quality and relevant outputs for users.5. AWS Cloud Deployment:a. Deploy and manage LLM-based applications on AWS, leveraging services such as Lambda, EC2, S3, EKS, and RDS.b. Ensure the scalability, availability, and reliability of deployed applications.6. Dashboards and Monitoring (Optional):a. Create monitoring dashboards using tools like Grafana or Tableau for real-time system monitoring, analytics, and performance insights.7. Experimentation with Generative AI:a. Research and integrate the latest advancements in generative AI technologies.b. Experiment with fine-tuning and adapting large language models (like GPT, BERT) for new, innovative use cases.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to .To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: .Skills and RequirementsRequired Technical SkillsPython proficiency, especially with web frameworks like FastAPI or Flask.Strong experience with Lang Chain and associated libraries.Proven expertise in building and optimizing RAG pipelines.Proficiency in using vector databases (e.g., Pinecone, FAISS).Experience with retrievers and re-rankers.Solid understanding of AWS services (Lambda, EC2, RDS, etc.).Knowledge of SQL and NoSQL databases.Familiarity with dashboarding tools such as Grafana and Tableau.Soft SkillsProblem-solving: Ability to handle complex and dynamic challenges with AI solutions.Collaboration: Experience working in multidisciplinary teams (data scientists, DevOps, etc.).Adaptability: Eagerness and passion to keep up with the latest AI advancements and incorporate them into solutions.Communication: Excellent verbal and written communication skills to convey technical information to both technical and non-technical stakeholders.This role is ideal for engineers who are passionate about pushing the boundaries of generative AI and have the technical skills to create cutting-edge, deployable solutions. nullWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to