Global It Platform Engineer Director & Chapter Lead- Gen Ai/ Llm Job in Boston Consulting Group

WHAT YOU'LL DO

To realize our goal to build a GenAI platform capability that will power use cases across BCG functions, we are seeing passionate Gen AI Platform Chapter Lead who is passionate about designing, developing, and optimizing GenAI based products and solutions. You will also be committed to maintaining and developing your own expertise and knowledge to ensure that you and your Chapter members bring the latest thinking to your roles. You will bring expertise in Gen AI development, Performance, and stability of custom-built products. This role is involved in all aspects of GenAI development. Work would also involve documentation of all designs and development. It would be required to attend agile ceremonies and demo/present the development work incrementally.

This position offers an exciting opportunity to be at the forefront of Gen AI innovation, working within a dynamic and collaborative environment. If you have a passion for cutting-edge technology and a drive to make a significant impact, we invite you to apply for this role.

Among your responsibilities, you will:

• Continuously develop Chapter expertise
  • Maintaining best-in-class Gen AI Platform Chapter expertise and resources in order to deliver the right knowledge and skills to Squads.
  • Staying abreast of relevant developments and innovations in Gen AI domain area, both internally and externally.
  • Maintaining your own technical knowledge through learning and continuous improvement.
• Develop Chapter members and the Chapter as a whole
  • Overseeing, providing feedback, and developing Chapter members to help improve domain knowledge and better serve the Squads in which they work.
  • Discussing Chapter development progress and opportunities with the Tech Area Lead.
• Share knowledge and expertise within and outside of the Chapter
  • Ensuring the how of the work performed by Chapter members is aligned with established technical roadmaps and guardrails to drive strategy.
  • Sharing relevant insights and developments within Gen AI space with Chapter members and related Chapters.
  • Actively sharing knowledge and expertise across the organization with other Chapters.
• Identify resource needs throughout the organization
  • Engaging Product Owners, Portfolio Leads, and Tech Area Leads to allocate Chapter members and ensure Squads have proper technical resourcing and functional expertise.
  • Identifying expertise and resource gaps and training or hiring the talent needed to address them.
• Work in a Squad to realize its mission
  • Advancing the work of the Squad based on items in the backlog and priorities set by the Product Owner.
  • Sharing expertise with Squad members and working cross-functionally to advance the work of the Squad.
• Enable the organization s new way of working
  • Modelling behaviors to support the organization s transformation to a new way of working.
  • Actively creating and maintaining a positive culture within the Chapter based on Agile leadership behaviors.

YOU'RE GOOD AT

• Being a great hands-on engineer and mentoring other team members.
• Inspiring and motivating your team.
• Comfortable with both planning and execution.
• Influencing and being a technical thought partner with Product Owners.
• Committing to cross-functional collaboration to achieve the best results for the organization.
• Enjoying coaching and developing people to improve their performance, knowledge and expertise.
• Are passionate, intellectually curious, and enjoy learning new skills and capabilities.
• Bring a data-driven approach to decision making, both in day-to-day management and in making strategic trade-offs.

YOU BRING (EXPERIENCE & QUALIFICATIONS)

• Master s or bachelor s degree in engineering
• Proven Experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing
• 14+ years of relevant experience in delivering platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise.
• 2+ years experience in experimenting and developing with LLM.
• 1+ years of experience developing with LLMs for production use case.
• 8+years of experience in leading Enterprise scale software engineering/ platform engineering teams.
• Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ ML pipelines and automation tools.

Experience & Skills (Mandatory)

• Strong knowledge and experience in Generative AI/ LLM based development.
• Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex).
• Experience with cloud infrastructure for AI/Generative AI/ML on AWS, Azure.
• Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios.
• Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data including indexing, search, and advance retrieval patterns.
• Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.
• Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information. retrieval.
• Knowledge and Experience in building knowledge graphs in production.
• Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models.
• Knowledge of training and fine-tuning Foundation Models, including multimodal inputs and outputs.
• Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks.
• Experience with containerization and orchestration technologies (Kubernetes, Docker).
• Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform).

Experience & Skills (Nice to have)

• Experience with LLM guardrails
• Experience with LLM monitoring and observability
• Experience with security related to LLM integration
• Experience in LLM Testing and Evaluation
• LLM Security

YOU'LL WORK WITH

• Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio, by setting their direction, establishing objectives and key results (with your PO), working on the staffing and development of your chapter, and ensuring that you maximize outputs and working products.
• Portfolio Leaders, Technical Area Lead, Product Owners and other Chapter Leads with whom you shall work to manager chapter resources and ensure a positive collaboration.
• Agile Coaches and Scrum Masters, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.