llama.cpp

mirror of https://github.com/RYDE-WORK/llama.cpp.git synced 2026-01-19 21:23:26 +08:00

History

Pierrick Hymbert 75cd4c7729

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495 )

* ci: bench: support sse and fix prompt processing time
server: add tokens usage in stream mode

* ci: bench: README.md EOL

* ci: bench: remove total pp and tg as it is not accurate

* ci: bench: fix case when there is no token generated

* ci: bench: change to the 95 percentile for pp and tg as it is closer to what the server exports in metrics

* ci: bench: fix finish reason rate

2024-04-06 05:40:47 +02:00

bench.yml

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495 )

2024-04-06 05:40:47 +02:00

build.yml

ci: exempt master branch workflows from getting cancelled (#6486 )

2024-04-04 18:30:53 +02:00

close-issue.yml

ci : close inactive issue, increase operations per run (#6270 )

2024-03-24 10:57:06 +02:00

code-coverage.yml

ci: exempt master branch workflows from getting cancelled (#6486 )