Andrej Karpathyfallback to memory allocation of m,v,master_weights on host automatically in case of OOM. will run slower but won't OOMe6856bc2 years agoHistory
NameLast commit messageLast commit date
..
adamw.cuh
attention.cuh
cublas_common.h
cuda_common.h
cuda_utils.cuh
cudnn_att.cpp
cudnn_att.h
dataloader.h
encoder.cuh
fused_classifier.cuh
gelu.cuh
global_norm.cuh
layernorm.cuh
logger.h
matmul.cuh
mfu.h
outlier_detector.h
rand.h
sampler.h
schedulers.h
tokenizer.h
utils.h
zero.cuh