lael-labs/llm.c · Ink

lael-labs/llm.c

Code Issues Pull Requests Antique Wiki Insights

/

Files

ademeure-layernormbf16-3 attempt_fix_zero1 feature/bias_backward2 feature/cublaslt feature/cudnn feature/delete_backward_act feature/finetune_llama31py feature/fix_int_overflow feature/fp32_weight_master_copy feature/gpt3v1 feature/grad_accum feature/grad_accum3 feature/hellaswag feature/hellaswagc feature/hf_eval feature/libdir feature/load_bf16 feature/lr_schedulers feature/managed2 feature/nccl-only feature/openmpi_flexible_path feature/organize_data feature/outliers feature/overlap-backward-reduce feature/packed128 feature/permuted_dataloader feature/pytorch_parity feature/random_init feature/recompute feature/refactor_part2 feature/restore_from_master feature/resume feature/rolling_checkpoints feature/sharded_data feature/streams feature/weight_decay_2d_only feature/wikitext103 feature/write_checkpoints fix/illegalaccess fix/reshuffle_zero_grad gordicaleksa-fix_dataloader2 lael-labs llama3 masterdefault move/attention move/encoder_kernel move/fused_classifier move/gelu move/matmul overfit-batch-actually

No branch matches.

View all branches

t

.github
dev
doc
llmc
scripts
.gitignore
LICENSE
Makefile
profile_gpt2.cu
profile_gpt2cu.py
README.md
requirements.txt
test_gpt2.c
test_gpt2.cu
test_gpt2_fp32.cu
train_gpt2.c
train_gpt2.cu
train_gpt2.py
train_gpt2_fp32.cu

llm.c/scripts/multi_node

AGAleksa GordicFix CI errorsa259eea2 years agoHistory

Name	Last commit message	Last commit date
..
run_gpt2_124M_fs.sbatch
run_gpt2_124M_mpi.sh
run_gpt2_124M_tcp.sbatch