Add support for more models and knowledge base

[abhijithneilabraham]

Currently LLamaindex and AzureOpenAI are being used to support LLM Apis, but this module could be extended larger than this, giving support also for open source models. We need a base class to be written for integration to such APIs.

[Govind-S-B]

Using a project like LiteLLM can reduce the hassle of producing a base class , since LiteLLM can override it and use the openai standard API while extending support to multiple backends

[abhijithneilabraham]

Thanks!