krisyotam
/
vLLM-Moet
Code
Issues
Pull Requests
Antique
Wiki
Insights
/
Code
History
Commits on
main
to
patch
10
KD
Three-tier hierarchy shipped: host 2-bit -> GPU 2-bit cache -> gate-filled FP4
kacper-daftcode committed 4 months ago
cf02998
KD
Sync the shipped patch with worktree HEAD (base-cache miss-tolerance knob)
kacper-daftcode committed 4 months ago
1b1fd28
KD
159B on one RTX 5090: host-resident 2-bit base with the GPU as an expert cache
kacper-daftcode committed 4 months ago
6da9beb
KD
Sync the shipped patch with HEAD (AFRAG default-on) + honest README claims
kacper-daftcode committed 4 months ago
68e38f6
KD
GLM-5.2-NVFP4 live on TP4 + MTP-under-PP: loader, runner fixes, first numbers
kacper-daftcode committed 4 months ago
4747bf4
KD
Delta pool auto-sizing: VLLM_MOE_W2_DELTA_GB=auto sizes the FP4 pool from free VRAM after KV allocation
kacper-daftcode committed 4 months ago
f445898
KD
Remove legacy v0.19 fork files (old patch, Dockerfile, BUILD.md, serve.sh); NOTICE -> v0.24.0 base
kacper-daftcode committed 4 months ago
3d845fe
KD
Confidence-gate driver re-integrated on v0.24 (patch now 20 files, +3.7k)
kacper-daftcode committed 4 months ago
04c52c9
KD
v0.24.0 port: rebase onto official vLLM, GLM-5.x prep, same-day A/B benchmarks
kacper-daftcode committed 4 months ago
406fe04
KA
vLLM-Moet: DeepSeek-V4-Flash on SM120 (Blackwell)
Kacper committed 4 months ago
9093a5c