lael-labs/llm.c
CodeIssuesPull RequestsAntiqueWikiInsights
/
Files
ademeure-layernormbf16-3attempt_fix_zero1feature/bias_backward2feature/cublasltfeature/cudnnfeature/delete_backward_actfeature/finetune_llama31pyfeature/fix_int_overflowfeature/fp32_weight_master_copyfeature/gpt3v1feature/grad_accumfeature/grad_accum3feature/hellaswagfeature/hellaswagcfeature/hf_evalfeature/libdirfeature/load_bf16feature/lr_schedulersfeature/managed2feature/nccl-onlyfeature/openmpi_flexible_pathfeature/organize_datafeature/outliersfeature/overlap-backward-reducefeature/packed128feature/permuted_dataloaderfeature/pytorch_parityfeature/random_initfeature/recomputefeature/refactor_part2feature/restore_from_masterfeature/resumefeature/rolling_checkpointsfeature/sharded_datafeature/streamsfeature/weight_decay_2d_onlyfeature/wikitext103feature/write_checkpointsfix/illegalaccessfix/reshuffle_zero_gradgordicaleksa-fix_dataloader2lael-labsllama3masterdefaultmove/attentionmove/encoder_kernelmove/fused_classifiermove/gelumove/matmuloverfit-batch-actually
No branch matches.
View all branches
  • .github
  • dev
    • cpu
    • cuda
    • data
    • eval
    • test
    • download_starter_pack.sh
    • loss_checker_ci.py
    • unistd.h
    • vislog.ipynb
  • doc
  • llmc
  • scripts
  • .gitignore
  • LICENSE
  • Makefile
  • profile_gpt2.cu
  • profile_gpt2cu.py
  • README.md
  • requirements.txt
  • test_gpt2.c
  • test_gpt2.cu
  • test_gpt2_fp32.cu
  • train_gpt2.c
  • train_gpt2.cu
  • train_gpt2.py
  • train_gpt2_fp32.cu
llm.c/dev
RWRoss WheelerAdding CI check for exceeding loss tolerance56621bb2 years agoHistory
NameLast commit messageLast commit date
..
cpuSetting up dev/CPU area with the first matmul_forward.c2 years ago
cudaDataloader test and ptx/sass file generator2 years ago
dataadd edu fineweb sh download script, change paths to my HF repo, add hellaswag to starter pack2 years ago
evalsmall fixes and readme2 years ago
testAddressed review comments2 years ago
download_starter_pack.shadd edu fineweb sh download script, change paths to my HF repo, add hellaswag to starter pack2 years ago
loss_checker_ci.pyAdding CI check for exceeding loss tolerance2 years ago
unistd.hAdd unistd.h for Windows cuDNN build2 years ago
vislog.ipynbupdate vislog to be a bit more fancy, has GPT-2/3 perf for hellaswag2 years ago