Repository navigation

Add a script to start a OpenAI compatible api implementing MoA - #33

Open

tijszwinkels wants to merge 4 commits into

togethercomputer:mainfrom

tijszwinkels:openai-compatible-api

Commits on Jul 7, 2024
- make bot --model parameter function correctly
  tijszwinkels
  committed
  d879da7
- First hacky OpenAI compatible api
  tijszwinkels
  committed
  3d74f25
Commits on Jul 10, 2024
- Pass max-token etc. correctly
  tijszwinkels
  committed
  1592cf9
- Update Readme on usage of api.py
  tijszwinkels
  committed
  6ef8e8a