“Knowledge Management with Gen AI and RAG challenges” explains why Knowledge Management is a foundational piece of how enterprise will operate in the New AI era and how to implement it using Retrieval-Augmented Generation (RAG).Knowledge management is critical for maintaining a competitive edge, fostering innovation, and ensuring efficient decision-making. Integrating Gen AI with RAG techniques allows for the dynamic generation of relevant content and precise retrieval of information from extensive databases, multimodal data, internal and external information in a secure way. We will also talk about RAG key issues that include data privacy concerns, ensuring the accuracy and reliability of generated content, scalability, integration with existing systems, and addressing biases in AI outputs. This paper will delve into these challenges, providing insights into potential solutions, best practices, and strategies to navigate the complexities, ensuring successful deployment, and maximizing the benefits of Gen AI and RAG in enterprises.