I see you try to add langchain memory and usind embedding for documents.
On my local running LLM i have not running embedding API endpoint.
What do you plan to use for embedding?
May with my other sugesstion #36 (comment) to add more API Endpoints, we can run on one Port llama.cpp with ./server --embedding API ?
I see you try to add langchain memory and usind embedding for documents.
On my local running LLM i have not running embedding API endpoint.
What do you plan to use for embedding?
May with my other sugesstion #36 (comment) to add more API Endpoints, we can run on one Port llama.cpp with
./server --embeddingAPI ?