Global IT Platform Engineer Director & Chapter Lead- Gen AI/ LLM

WHAT YOU'LL DO

To realize our goal to build a GenAI platform capability that will power use cases across BCG functions, we are seeking a passionate Gen AI Platform Chapter Lead who is dedicated to designing, developing, and optimizing GenAI-based products and solutions. You will also be committed to maintaining and developing your own expertise and knowledge to ensure that you and your Chapter members bring the latest thinking to your roles. You will bring expertise in Gen AI development, performance, and stability of custom-built products. This role is involved in all aspects of GenAI development, including documentation of all designs and development. Attendance at agile ceremonies and presenting development work incrementally is required.

This position offers an exciting opportunity to be at the forefront of Gen AI innovation, working within a dynamic and collaborative environment. If you have a passion for cutting-edge technology and a drive to make a significant impact, we invite you to apply for this role.

Among your responsibilities, you will:

1. Continuously develop Chapter expertise
   • Maintain best-in-class Gen AI Platform Chapter expertise and resources to deliver the right knowledge and skills to Squads.
   • Stay abreast of relevant developments and innovations in the Gen AI domain area, both internally and externally.
   • Maintain your own technical knowledge through learning and continuous improvement.
2. Develop Chapter members and the Chapter as a whole
   • Oversee, provide feedback, and develop Chapter members to help improve domain knowledge and better serve the Squads in which they work.
   • Discuss Chapter development progress and opportunities with the Tech Area Lead.
3. Share knowledge and expertise within and outside of the Chapter
   • Ensure the “how” of the work performed by Chapter members is aligned with established technical roadmaps and guardrails to drive strategy.
   • Share relevant insights and developments within the Gen AI space with Chapter members and related Chapters.
   • Actively share knowledge and expertise across the organization with other Chapters.
4. Identify resource needs throughout the organization
   • Engage Product Owners, Portfolio Leads, and Tech Area Leads to allocate Chapter members and ensure Squads have proper technical resourcing and functional expertise.
   • Identify expertise and resource gaps and train or hire the talent needed to address them.
5. Work in a Squad to realize its mission
   • Advance the work of the Squad based on items in the backlog and priorities set by the Product Owner.
   • Share expertise with Squad members and work cross-functionally to advance the work of the Squad.
6. Enable the organization’s new way of working
   • Model behaviors to support the organization’s transformation to a new way of working.
   • Actively create and maintain a positive culture within the Chapter based on Agile leadership behaviors.

YOU'RE GOOD AT

• Being a great hands-on engineer and mentoring other team members.
• Inspiring and motivating your team.
• Comfortable with both planning and execution.
• Influencing and being a technical thought partner with Product Owners.
• Committing to cross-functional collaboration to achieve the best results for the organization.
• Enjoying coaching and developing people to improve their performance, knowledge, and expertise.
• Being passionate, intellectually curious, and enjoying learning new skills and capabilities.
• Bringing a data-driven approach to decision-making, both in day-to-day management and in making strategic trade-offs.

YOU BRING (EXPERIENCE & QUALIFICATIONS)

• Master’s or bachelor’s degree in engineering.
• Proven experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing.
• 14+ years of relevant experience in delivering platform or complex technology solutions with a strong technical background, preferably in a global organization/enterprise.
• 2+ years’ experience experimenting and developing with LLM.
• 1+ years of experience developing with LLMs for production use cases.
• 8+ years of experience in leading enterprise-scale software engineering/platform engineering teams.
• Passionate expert in Modern Engineering, DevOps practices - strong understanding of CI/CD, AI/ML pipelines, and automation tools.

Experience & Skills (Mandatory)

• Strong knowledge and experience in Generative AI/LLM-based development.
• Strong experience working with key LLM models APIs (e.g., AWS Bedrock, Azure Open AI/OpenAI) and LLM Frameworks (e.g., LangChain, LlamaIndex).
• Experience with cloud infrastructure for AI/Generative AI/ML on AWS, Azure.
• Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios.
• Expertise in building enterprise-grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advanced retrieval patterns.
• Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.
• Proficiency in generating and working with text embeddings with an understanding of embedding spaces and their applications in semantic search and information retrieval.
• Knowledge and experience in building knowledge graphs in production.
• Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.) and expertise in implementing RAG systems that combine knowledge bases with Generative AI models.
• Knowledge of training and fine-tuning foundation models, including multimodal inputs and outputs.
• Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks.
• Experience with containerization and orchestration technologies (Kubernetes, Docker).
• Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform).

Experience & Skills (Nice to have)

• Experience with LLM guardrails.
• Experience with LLM monitoring and observability.
• Experience with security related to LLM integration.
• Experience in LLM Testing and Evaluation.
• LLM Security.

YOU'LL WORK WITH

• Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio, by setting their direction, establishing objectives and key results (with your PO), working on the staffing and development of your chapter, and ensuring that you maximize outputs and working products.
• Portfolio Leaders, Technical Area Lead, Product Owners, and other Chapter Leads with whom you shall work to manage chapter resources and ensure a positive collaboration.
• Agile Coaches and Scrum Masters, who will ensure that you adopt agile principles, mindset, and ways of working into your daily routine and who will coach you during the transformation.