# Встреча llmaas Впрод. Пример решения для провайдера ИИ

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/1e433008-0983-4310-b056-ec706bb97ebc/raw)

роутер liteLLM и vLLM - опенсорсные.

бэкэнд на go

есть апи, биллинг и фронтэнд

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/fcccbce0-21dc-4ce7-b29f-205095801e9e/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/5fa7e68e-4718-474f-98c9-0dd986ddd2cb/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/98bd6577-a923-416d-9d51-e8293b9a8409/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/e8b6861c-1fd4-402c-ab4d-d00a3f1c5122/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/9a2fd3cd-17a5-432a-b629-204b67f43209/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/1adb68f8-b0b3-42eb-af90-3279456dec4e/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/03a91a1e-d875-47bc-bdbe-10a4ce2d00d4/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/e1e11ccc-27db-4880-ad04-1ae339cda870/raw)

### Клиентский портал:
![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/90e9dccf-eccd-49ca-9a2e-054960e32420/raw)

![](https://notes.vtorum.net/api/public/web/%D0%B2%D1%81%D1%82%D1%80%D0%B5%D1%87%D0%B0-llmaas-%D0%B2%D0%BF%D1%80%D0%BE%D0%B4-%D0%BF%D1%80%D0%B8%D0%BC%D0%B5%D1%80-%D1%80%D0%B5%D1%88%D0%B5%D0%BD%D0%B8%D1%8F-%D0%B4%D0%BB%D1%8F-%D0%BF%D1%80%D0%BE%D0%B2%D0%B0%D0%B8-%D0%B4%D0%B5%D1%80%D0%B0-%D0%B8%D0%B8-eeec79ed/assets/cefaa109-1094-4196-aa75-3ce8a128a3e8/raw)