DeepSeek Coder comprises a series of code language models trained on both 87% code and 13% natural language in English and Chinese, with each model pre-trained on 2T tokens.
Any coding LLM better than DeepSeek coder? : r/LocalLLaMA - Reddit
Feb 2, 2024 · Curious to know if there’s any coding LLM that understands language very well and also have a strong coding ability that is on par / surpasses that of Deepseek? Talking about 7b models, …
Jun 23, 2024 · did you try deepseek-coder-v2:236b-instruct-q3_K_S (102GB) to see that works ? that would show some large version of deepseek-coder-v2 is ok and your computer is ok. which might …
Feb 14, 2024 · I run this model on M1 Max 64GB at about 12t/s, the Q6 model from The Bloke runs at about 6-8t/s. I have a spare 3090 Ti, is it worth it to spin up a linux distro to expose this, would I be …
Mrademachers Deepseek v2 instruct q6 gguf (193gb) works w/ llama.cpp cli but only with disabled flash attention and no KV cache quantization. Fantastic coding model BTW! Returns working python code …