495f32610b
refactor: pipe the read and write process
...
this refactor simplify the process logic and fix several bugs and
performance issue.
bug fixed:
- cors headers not being sent in some situation
performance:
- perform upstream reqeust while clien is uploading content
2024-05-27 14:47:00 +08:00
45bba95f5d
Merge remote-tracking branch 'comp/master'
2024-04-09 19:07:45 +08:00
75ff8fbc2e
Refactor CORS handling and remove response's CORS headers
2024-04-09 19:07:28 +08:00
66758e0008
更新.gitlab-ci.yml文件
2024-04-08 10:29:08 +00:00
40fc2067a5
Merge remote-tracking branch 'comp/master'
2024-04-08 18:22:10 +08:00
1a56101ca8
add dockerignore
2024-04-08 18:21:55 +08:00
e373e3ac63
更新.gitlab-ci.yml文件
2024-04-08 07:48:05 +00:00
24a2e609f8
更新.gitlab-ci.yml文件
2024-04-08 05:11:47 +00:00
e442303847
更新.gitlab-ci.yml文件
2024-04-08 03:52:19 +00:00
8b95fbb5da
更新.gitlab-ci.yml文件
2024-04-08 03:40:32 +00:00
34aa4babc4
更新.gitlab-ci.yml文件
2024-04-08 03:21:24 +00:00
e6ff1f5ca4
更新.gitlab-ci.yml文件
2024-04-08 03:10:24 +00:00
6b6f245e45
Update README.md with complex configuration example
2024-04-08 11:04:29 +08:00
995eea9d67
Update README.md
2024-02-18 17:28:16 +08:00
db7f0eb316
timeout
2024-02-18 16:45:37 +08:00
990628b455
bro gooooo
2024-02-17 00:30:27 +08:00
e8b89fc41a
record all json request body
2024-02-16 22:42:48 +08:00
46ee30ced7
use path as default model name
2024-02-16 22:31:32 +08:00
f2e32340e3
fix typo
2024-02-16 17:47:40 +08:00
ca386f8302
record whisper response
2024-02-15 16:52:33 +08:00
3385f9af08
fix: replicate mistral prompt
2024-01-23 16:38:45 +08:00
8fa7fa79be
less: replicate log
2024-01-23 15:56:48 +08:00
49169452fe
fix: read config upstream type default value
2024-01-23 15:52:46 +08:00
33f341026f
fix: replicate response format
2024-01-23 15:43:48 +08:00
b1a9d6b685
add: support replicate
2024-01-23 15:20:22 +08:00
1fc17daa35
deny allow list if unknown model
2024-01-21 15:37:26 +08:00
b1ab9c3d7b
add allow & deny model list, fix cors on error
2024-01-16 17:11:25 +08:00
8672899a58
change log format
2024-01-16 16:23:27 +08:00
3a59433f66
append error
2024-01-16 12:03:23 +08:00
873548a7d0
fix: body larger than 1024*128
2024-01-16 11:32:06 +08:00
2a2d907b0d
fix: podman image build
2024-01-11 16:43:40 +08:00
2bbe98e694
fix duplicated cors headers
2024-01-04 19:03:58 +08:00
9fdbf259c0
truncate requset body if too long
2024-01-04 18:41:26 +08:00
97926087bb
async record request
2024-01-04 18:37:01 +08:00
fc5a8d55fa
fix: process error content type
2023-12-22 15:08:24 +08:00
b1e3a97aad
fix: cors and content-type on error
2023-12-22 14:24:11 +08:00
04a2e4c12d
use cors middleware
2023-12-22 13:23:41 +08:00
b8ebbed5d6
fix: recognize '/v1' prefix
2023-12-07 00:51:21 +08:00
412aefdacc
fix: record resp time
2023-11-30 10:24:00 +08:00
2c3532f12f
add hostname
2023-11-30 10:18:01 +08:00
7d93332e51
fix: record body json
2023-11-30 10:06:10 +08:00
0dbd898532
update config yaml
2023-11-29 14:40:20 +08:00
7b74818676
update config to file
2023-11-29 14:31:11 +08:00
0a2a7376f1
update dep
2023-11-28 14:36:14 +08:00
44a966e6f4
clean code
2023-11-28 14:04:42 +08:00
87244d4dc2
update docs
2023-11-28 10:42:06 +08:00
11bf18391e
update docs
2023-11-28 10:22:12 +08:00
0785d43ff1
support postgres
2023-11-28 10:19:07 +08:00
de3bea06a7
convert config to yaml file
2023-11-27 18:08:15 +08:00
3cc507a767
add docker file
2023-11-27 17:53:28 +08:00