lael-labs/llm.c
CodeIssuesPull RequestsAntiqueWikiInsights
/
Files
ademeure-layernormbf16-3attempt_fix_zero1feature/bias_backward2feature/cublasltfeature/cudnnfeature/delete_backward_actfeature/finetune_llama31pyfeature/fix_int_overflowfeature/fp32_weight_master_copyfeature/gpt3v1feature/grad_accumfeature/grad_accum3feature/hellaswagfeature/hellaswagcfeature/hf_evalfeature/libdirfeature/load_bf16feature/lr_schedulersfeature/managed2feature/nccl-onlyfeature/openmpi_flexible_pathfeature/organize_datafeature/outliersfeature/overlap-backward-reducefeature/packed128feature/permuted_dataloaderfeature/pytorch_parityfeature/random_initfeature/recomputefeature/refactor_part2feature/restore_from_masterfeature/resumefeature/rolling_checkpointsfeature/sharded_datafeature/streamsfeature/weight_decay_2d_onlyfeature/wikitext103feature/write_checkpointsfix/illegalaccessfix/reshuffle_zero_gradgordicaleksa-fix_dataloader2lael-labsllama3masterdefaultmove/attentionmove/encoder_kernelmove/fused_classifiermove/gelumove/matmuloverfit-batch-actually
No branch matches.
View all branches
  • .github
    • workflows
  • dev
    • cpu
    • cuda
    • data
    • eval
    • test
    • download_starter_pack.sh
    • loss_checker_ci.py
    • unistd.h
    • vislog.ipynb
  • doc
  • llmc
  • scripts
  • .gitignore
  • LICENSE
  • Makefile
  • profile_gpt2.cu
  • profile_gpt2cu.py
  • README.md
  • requirements.txt
  • test_gpt2.c
  • test_gpt2.cu
  • test_gpt2_fp32.cu
  • train_gpt2.c
  • train_gpt2.cu
  • train_gpt2.py
  • train_gpt2_fp32.cu
  • train_llama3.py
llm.c/dev
AKAndrej Karpathyfix tokenizer omg755458d2 years agoHistory
NameLast commit messageLast commit date
..
cpuSetting up dev/CPU area with the first matmul_forward.c2 years ago
cudarevert makefile change2 years ago
datafix tokenizer omg2 years ago
evalsmall fixes and readme2 years ago
testAddressed review comments2 years ago
download_starter_pack.shadd edu fineweb sh download script, change paths to my HF repo, add hellaswag to starter pack2 years ago
loss_checker_ci.pyAdding CI check for exceeding loss tolerance2 years ago
unistd.hMove WIN32 code into unistd.h2 years ago
vislog.ipynbupdate vislog to be a bit more fancy, has GPT-2/3 perf for hellaswag2 years ago