2b9892a808
fix(windows): modelpath and list
2024-01-09 09:36:58 -08:00
2bb2bdd5d4
fix lint
2024-01-09 09:36:58 -08:00
acfc376efd
add .golangci.yaml
2024-01-09 09:36:58 -08:00
7e8f7c8358
remove ggml automatic re-pull ( #1856 )
2024-01-08 14:41:01 -05:00
0101e76dbe
Merge pull request #1797 from sublimator/nd-allow-extension-origins-still-needs-explicit-listing-2024-01-05
...
fix: allow extension origins (still needs explicit listing), fixes #1686
2024-01-05 17:20:09 -08:00
22e93efa41
add show info command and fix the modelfile
2024-01-05 12:20:05 -08:00
8baaaa39c0
Allow extension origins (still needs explicit listing), fixes #1686
2024-01-05 09:06:47 +07:00
4ad6c9b11f
fix: pull either original model or from model on create ( #1774 )
2024-01-04 01:34:38 -05:00
0b3118e0af
fix: relay request opts to loaded llm prediction ( #1761 )
2024-01-03 12:01:42 -05:00
697bea6939
Guard integration tests with a tag
...
This should help CI avoid running the integration test logic in a
container where it's not currently possible.
2023-12-22 16:33:27 -08:00
db356c8519
post-response templating ( #1427 )
2023-12-22 17:07:05 -05:00
96fb441abd
Merge pull request #1146 from dhiltgen/ext_server_cgo
...
Add cgo implementation for llama.cpp
2023-12-22 08:16:31 -08:00
63aac0edc5
fix(test): use real version string for comparison
2023-12-19 15:03:02 -08:00
51082535e1
Add automated test for multimodal
...
A simple test case that verifies llava:7b can read text in an image
2023-12-19 09:05:46 -08:00
35934b2e05
Adapted rocm support to cgo based llama.cpp
2023-12-19 09:05:46 -08:00
d4cd695759
Add cgo implementation for llama.cpp
...
Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.
2023-12-19 09:05:46 -08:00
5e7fd6906f
Update images.go
2023-12-19 09:05:46 -08:00
811b1f03c8
deprecate ggml
...
- remove ggml runner
- automatically pull gguf models when ggml detected
- tell users to update to gguf in the case automatic pull fails
Co-Authored-By: Jeffrey Morgan <jmorganca@gmail.com >
2023-12-19 09:05:46 -08:00
d99fa6ce0a
send empty messages on last chat response ( #1530 )
2023-12-18 14:23:38 -05:00
3948c6ea06
add magic header for unit tests ( #1558 )
2023-12-18 10:41:02 -08:00
86b0dd4b16
add API create/copy handlers ( #1541 )
2023-12-15 11:59:18 -08:00
0174665d0e
add API tests for list handler ( #1535 )
2023-12-14 18:18:25 -08:00
630518f0d9
Add unit test of API routes ( #1528 )
2023-12-14 16:47:40 -08:00
6ee8c80199
restore model load duration on generate response ( #1524 )
...
* restore model load duration on generate response
- set model load duration on generate and chat done response
- calculate createAt time when response created
* remove checkpoints predict opts
* Update routes.go
2023-12-14 12:15:50 -05:00
4a1abfe4fa
fix tests
2023-12-13 14:42:30 -05:00
d9e60f634b
add image support to the chat api ( #1490 )
2023-12-12 13:28:58 -08:00
0a9d348023
Fix issues with /set template and /set system ( #1486 )
2023-12-12 14:43:19 -05:00
910e9401d0
Multimodal support ( #1216 )
...
---------
Co-authored-by: Matt Apperson <mattapperson@Matts-MacBook-Pro.local >
2023-12-11 13:56:22 -08:00
7db5bcf73b
fix go-staticcheck warning
2023-12-10 11:44:27 -05:00
fa2f095bd9
fix model name returned by /api/generate being different than the model name provided
2023-12-10 11:42:15 -05:00
045b855db9
fix error on accumulating final chat response
2023-12-10 11:24:39 -05:00
32064a0646
fix empty response when receiving runner error
2023-12-10 10:53:38 -05:00
9e1406e4ed
Don't expose model information in /api/generate
2023-12-09 02:05:43 -08:00
7e9405fd07
fix: encode full previous prompt in context ( #1424 )
2023-12-08 16:53:51 -05:00
3b0b8930d4
fix: only flush template in chat when current role encountered ( #1426 )
2023-12-08 16:44:24 -05:00
e3f925fc1b
fix: restore modelfile system in prompt template ( #1425 )
2023-12-08 14:20:19 -05:00
1f05d77110
Merge pull request #1244 from jmorganca/brucemacd/no-fail-template
...
do not fail on unsupported template variables
2023-12-06 13:23:04 -08:00
c3ff36088b
Merge pull request #774 from jmorganca/mxyng/server-version
...
add version api and show server version in cli
2023-12-06 13:22:55 -08:00
47d4e22673
use missingkey in set empty interface when missing
2023-12-05 15:49:05 -08:00
5d75505ebd
return model configuration in generate
2023-12-05 14:39:02 -08:00
b9495ea162
load projectors
2023-12-05 14:36:12 -08:00
409bb9674e
Merge pull request #1308 from jmorganca/mxyng/split-from
...
split from into one or more models
2023-12-05 14:33:03 -08:00
d3479c07a1
Merge pull request #1250 from jmorganca/mxyng/create-layer
...
refactor layer creation
2023-12-05 14:32:52 -08:00
195e3d9dbd
chat api endpoint ( #1392 )
2023-12-05 14:57:33 -05:00
1ebdbd9694
server: add version handler
2023-12-05 09:36:01 -08:00
00d06619a1
Revert "chat api ( #991 )" while context variable is fixed
...
This reverts commit 7a0899d62d
2023-12-04 21:16:27 -08:00
a3737cbd33
use NewLayer for CreateBlobHandler
2023-12-04 16:59:23 -08:00
998f1785b6
add modelfamilies
2023-12-04 16:59:23 -08:00
70a93057cd
refactor layer creation
...
previous layer creation was not ideal because:
1. it required reading the input file multiple times, once to calculate
the sha256 checksum, another to write it to disk, and potentially one
more to decode the underlying gguf
2. used io.ReadSeeker which is prone to user error. if the file isn't
reset correctly or in the right place, it could end up reading an
empty file
there are also some brittleness when reading existing layers else
writing the inherited layers will error reading an already closed file
this commit aims to fix these issues by restructuring layer creation.
1. it will now write the layer to a temporary file as well as the hash
function and move it to the final location on Commit
2. layers are read once once when copied to the destination. exception
is raw model files which still requires a second read to decode the
model metadata
2023-12-04 16:59:23 -08:00
2cb0fa7d40
split from into one or more models
2023-12-04 16:59:23 -08:00
