495f32610b
refactor: pipe the read and write process
...
this refactor simplify the process logic and fix several bugs and
performance issue.
bug fixed:
- cors headers not being sent in some situation
performance:
- perform upstream reqeust while clien is uploading content
2024-05-27 14:47:00 +08:00
75ff8fbc2e
Refactor CORS handling and remove response's CORS headers
2024-04-09 19:07:28 +08:00
db7f0eb316
timeout
2024-02-18 16:45:37 +08:00
990628b455
bro gooooo
2024-02-17 00:30:27 +08:00
e8b89fc41a
record all json request body
2024-02-16 22:42:48 +08:00
46ee30ced7
use path as default model name
2024-02-16 22:31:32 +08:00
f2e32340e3
fix typo
2024-02-16 17:47:40 +08:00
ca386f8302
record whisper response
2024-02-15 16:52:33 +08:00
1fc17daa35
deny allow list if unknown model
2024-01-21 15:37:26 +08:00
b1ab9c3d7b
add allow & deny model list, fix cors on error
2024-01-16 17:11:25 +08:00
8672899a58
change log format
2024-01-16 16:23:27 +08:00
3a59433f66
append error
2024-01-16 12:03:23 +08:00
873548a7d0
fix: body larger than 1024*128
2024-01-16 11:32:06 +08:00
2bbe98e694
fix duplicated cors headers
2024-01-04 19:03:58 +08:00
fc5a8d55fa
fix: process error content type
2023-12-22 15:08:24 +08:00
04a2e4c12d
use cors middleware
2023-12-22 13:23:41 +08:00
b8ebbed5d6
fix: recognize '/v1' prefix
2023-12-07 00:51:21 +08:00
412aefdacc
fix: record resp time
2023-11-30 10:24:00 +08:00
0785d43ff1
support postgres
2023-11-28 10:19:07 +08:00
fb19d8a353
upstreams.yaml
2023-11-27 17:19:08 +08:00
4125c78f33
record response time
2023-11-17 14:53:49 +08:00
6c9eab09e2
record authorization
2023-11-16 15:42:37 +08:00
6aab4fb44b
120 timeout if only one upstream
2023-11-08 20:42:36 +08:00
b932331bdc
20s timeout for large request
2023-11-08 20:18:55 +08:00
a2c6fa32ed
default 60s timeout
2023-11-08 18:42:35 +08:00
3c4c2b5660
fix error response code
2023-11-01 17:53:57 +08:00
a3fff93f2e
hasResponse on error
2023-11-01 17:34:11 +08:00
c90a18d380
record model name
2023-11-01 17:02:30 +08:00
d9a42842b2
1m timeout for non stream request
2023-11-01 15:55:54 +08:00
5a78c61e5f
timeout for out going request
2023-11-01 15:25:59 +08:00
98a15052a2
fix: should response
2023-10-31 18:35:29 +08:00
7572ecf19b
fix: retry with 502
2023-10-31 18:34:58 +08:00
2c75c392a8
loop through upstreams
2023-10-31 18:10:01 +08:00
acc153ddca
拆分 process
2023-10-31 10:13:20 +08:00
