Commit Graph

77 Commits

Author SHA1 Message Date
c895a7d13f some gocritic 2024-06-04 11:13:30 -07:00
55f6eba049 gofmt 2024-06-04 11:13:30 -07:00
955c317cab chore: update tokenizer.go (#4571)
PreTokenziers -> PreTokenizers
2024-05-22 00:25:23 -07:00
171eb040fc simplify safetensors reading 2024-05-21 11:28:22 -07:00
3591bbe56f add test 2024-05-21 11:28:22 -07:00
34d5ef29b3 fix conversion for f16 or f32 inputs 2024-05-21 11:28:22 -07:00
bbbd9f20f3 cleanup 2024-05-20 16:13:57 -07:00
547132e820 bpe pretokenizer 2024-05-20 16:13:57 -07:00
2d315ba9a9 add missing file 2024-05-20 16:13:57 -07:00
d355d2020f add fixes for llama 2024-05-20 16:13:57 -07:00
c8cf0d94ed llama3 conversion 2024-05-20 16:13:57 -07:00
4730762e5c add safetensors version 2024-05-20 16:13:57 -07:00
d88582dffd some changes for llama3 2024-05-20 16:13:57 -07:00
6694be5e50 convert/llama: use WriteSeeker 2024-05-06 15:24:01 -07:00
7ffe45734d rebase 2024-05-06 15:24:01 -07:00
9685c34509 quantize any fp16/fp32 model
- FROM /path/to/{safetensors,pytorch}
- FROM /path/to/fp{16,32}.bin
- FROM model:fp{16,32}
2024-05-06 15:24:01 -07:00
42fa9d7f0a Fix lint warnings 2024-05-03 16:44:19 -07:00
ce8ce82567 add mixtral 8x7b model conversion (#3859) 2024-04-23 20:17:04 -07:00
9f8691c6c8 Add llama2 / torch models for ollama create (#3607) 2024-04-15 11:26:42 -07:00
be517e491c no rope parameters 2024-04-05 18:05:27 -07:00
3b6a9154dd Simplify model conversion (#3422) 2024-04-01 16:14:53 -07:00
5a5efee46b Add gemma safetensors conversion (#3250)
Co-authored-by: Michael Yang <mxyng@pm.me>
2024-03-28 18:54:01 -07:00
1b272d5bcd change github.com/jmorganca/ollama to github.com/ollama/ollama (#3347) 2024-03-26 13:04:17 -07:00
9ea492f1ce convert: fix shape 2024-03-11 09:41:01 -07:00
76bdebbadf decode ggla 2024-03-08 15:46:25 -08:00
18979ad4a1 convert: fix default shape 2024-03-08 15:42:48 -08:00
2c017ca441 Convert Safetensors to an Ollama model (#2824) 2024-03-06 21:01:51 -08:00