|
|
fd4792ec56
|
call llama.cpp directly from go
|
2023-07-11 11:59:18 -07:00 |
|
|
|
a3ec1ec2a0
|
consistent error handling for pull and generate
|
2023-07-10 21:34:15 -07:00 |
|
|
|
edba935d67
|
return error in generate response
|
2023-07-10 13:30:10 -07:00 |
|
|
|
2d49197b3b
|
increase default model size to 512
|
2023-07-10 21:24:41 +02:00 |
|
|
|
f5e2e150b8
|
allow overriding default generate options
|
2023-07-10 20:58:02 +02:00 |
|
|
|
f533f85d44
|
pr feedback
- move error check to api client pull
- simplify error check in generate
- return nil on any pull error
|
2023-07-07 17:12:02 -04:00 |
|
|
|
61dd87bd90
|
if directory cannot be resolved, do not fail
|
2023-07-07 15:27:43 -04:00 |
|
|
|
303982b56e
|
fix run generate
|
2023-07-07 11:36:29 -07:00 |
|
|
|
3f1b7177f2
|
pass model and predict options
|
2023-07-07 09:34:05 -07:00 |
|
|
|
291bb97e3d
|
client request options
|
2023-07-06 17:08:28 -07:00 |
|
|
|
b0e63bfb4c
|
simplify api client
|
2023-07-06 17:07:40 -07:00 |
|
|
|
c4b9e84945
|
progress
|
2023-07-06 17:07:40 -07:00 |
|
|
|
3d6009aae3
|
run prompts
|
2023-07-06 17:07:40 -07:00 |
|
|
|
0637632258
|
simple pull response
|
2023-07-06 16:34:44 -04:00 |
|
|
|
dd960d1d5e
|
update generate response
|
2023-07-06 16:34:44 -04:00 |
|
|
|
c9f45abef3
|
resumable downloads
|
2023-07-06 16:34:44 -04:00 |
|
|
|
7cf5905063
|
display pull progress
|
2023-07-06 16:34:44 -04:00 |
|
|
|
5079282120
|
tcp socket
|
2023-07-06 16:34:44 -04:00 |
|
|
|
68e6b4550c
|
use prompt templates
|
2023-07-06 16:34:44 -04:00 |
|
|
|
a6494f8211
|
pull models
|
2023-07-06 16:34:44 -04:00 |
|
|
|
fd962a36e5
|
client updates
|
2023-07-06 16:34:44 -04:00 |
|
|
|
6093a88c1a
|
add llama.cpp go bindings
|
2023-07-06 16:34:44 -04:00 |
|
|
|
76cb60d496
|
wip go engine
Co-authored-by: Patrick Devine <pdevine@sonic.net>
|
2023-07-06 16:34:44 -04:00 |
|
