lael-labs/llm.c
CodeIssuesPull RequestsAntiqueWikiInsights
/
Files
ademeure-layernormbf16-3attempt_fix_zero1feature/bias_backward2feature/cublasltfeature/cudnnfeature/delete_backward_actfeature/finetune_llama31pyfeature/fix_int_overflowfeature/fp32_weight_master_copyfeature/gpt3v1feature/grad_accumfeature/grad_accum3feature/hellaswagfeature/hellaswagcfeature/hf_evalfeature/libdirfeature/load_bf16feature/lr_schedulersfeature/managed2feature/nccl-onlyfeature/openmpi_flexible_pathfeature/organize_datafeature/outliersfeature/overlap-backward-reducefeature/packed128feature/permuted_dataloaderfeature/pytorch_parityfeature/random_initfeature/recomputefeature/refactor_part2feature/restore_from_masterfeature/resumefeature/rolling_checkpointsfeature/sharded_datafeature/streamsfeature/weight_decay_2d_onlyfeature/wikitext103feature/write_checkpointsfix/illegalaccessfix/reshuffle_zero_gradgordicaleksa-fix_dataloader2lael-labsllama3masterdefaultmove/attentionmove/encoder_kernelmove/fused_classifiermove/gelumove/matmuloverfit-batch-actually
No branch matches.
View all branches
  • .github
  • dev
  • doc
  • llmc
    • cublas_common.h
    • cuda_common.h
    • cuda_utils.cuh
    • cudnn_att.cpp
    • cudnn_att.h
    • dataloader.h
    • encoder.cuh
    • logger.h
    • mfu.h
    • rand.h
    • sampler.h
    • tokenizer.h
    • utils.h
  • scripts
  • .gitignore
  • LICENSE
  • Makefile
  • profile_gpt2.cu
  • profile_gpt2cu.py
  • README.md
  • requirements.txt
  • test_gpt2.c
  • test_gpt2.cu
  • test_gpt2_fp32.cu
  • train_gpt2.c
  • train_gpt2.cu
  • train_gpt2.py
  • train_gpt2_fp32.cu
llm.c/llmc
AKAndrej Karpathyalso move the launchers49b97762 years agoHistory
NameLast commit messageLast commit date
..
cublas_common.hrefactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well2 years ago
cuda_common.hmoved device utilities into a separate file, and follow-up cleanup2 years ago
cuda_utils.cuhmoved device utilities into a separate file, and follow-up cleanup2 years ago
cudnn_att.cppmoved device utilities into a separate file, and follow-up cleanup2 years ago
cudnn_att.hmoved device utilities into a separate file, and follow-up cleanup2 years ago
dataloader.hRemove file size - not used2 years ago
encoder.cuhalso move the launchers2 years ago
logger.hmore refactor2 years ago
mfu.hadd new file llmc/mfu.h for MFU calculations for different GPUs2 years ago
rand.hAdd clarification on Box-Muller2 years ago
sampler.hrefactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well2 years ago
tokenizer.hexperiment with adding the llmc lib directory2 years ago
utils.hmore refactor2 years ago