RYDE-WORK/ktransformers
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/ktransformers.git synced 2026-03-23 02:46:35 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #123 from RodriMora/add_models_endpoints

Browse Source 
Added simple /models endpoint
This commit is contained in:
UnicornChan 2025-02-10 13:54:13 +08:00 committed by GitHub
commit f4903d549d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 11 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
ktransformers/server/api/openai/endpoints/chat.py
View File

@ -10,8 +10,16 @@ from ktransformers.server.backend.base import BackendInterfaceBase
router = APIRouter() router = APIRouter()
models = [
{"id": "0", "name": "ktranformers-model"},
]
@router.post('/chat/completions',tags=['openai']) @router.get('/models', tags=['openai'])
async def list_models():
return models
@router.post('/chat/completions', tags=['openai'])
async def chat_completion(request:Request,create:ChatCompletionCreate): async def chat_completion(request:Request,create:ChatCompletionCreate):
id = str(uuid4()) id = str(uuid4())