Code

History

Commits on separate_tokenizer35+
  1. Merge branch 'master' into separate_tokenizerAndrej committed 2 years ago1443edc
  2. Single call to NCCL AllReduce and AdamW for bf16Andrej Karpathy committed 2 years ago70f7776
  3. fix printsAndrej Karpathy committed 2 years agodd60fc3
  4. fix accumulated lossAndrej Karpathy committed 2 years agobe4aeb3
  5. more defensiveAndrej Karpathy committed 2 years ago938f8f7
  6. don't hardcode the EOT token and store it in the Tokenizer fileAndrej Karpathy committed 2 years agob4c346a
  7. Add back FP16 and disable multi_gpu all reduce when there is only 1 GPUademeure committed 2 years agoc24bb88
  8. separate out our TokenizerAndrej Karpathy committed 2 years ago699c254
  9. avoid warning for cublas_compute_type in BF16 modeademeure committed 2 years ago66c4548
  10. Remove FloatN and associated code for adam & allreduceademeure committed 2 years ago1d4effd
  11. Merge pull request #286 from rosslwheeler/Makefile-windows-supportAndrej committed 2 years ago1310e2f
  12. Merge pull request #294 from karpathy/ademeure-layernormbf16-3Andrej committed 2 years ago977c688
  13. unify these twoAndrej Karpathy committed 2 years ago0e4506a
  14. gpt2_build_from_checkpointademeure committed 2 years ago8be7370
  15. Fix train_gpt2.py to write all weights as BF16 (+merge fixes)ademeure committed 2 years agoebedadf
  16. Merge remote-tracking branch 'karpathy/master' into layernormbf16ademeure committed 2 years agod23bb1f
  17. Merge pull request #281 from ChrisDryden/templateCleanupAndrej committed 2 years agoe92ec3f
  18. Merge pull request #287 from tairov/fix-zig-linkAndrej committed 2 years ago237593f
  19. Adding back PFLAGSRoss Wheeler committed 2 years agofcef97d
  20. Fix sizeof(T) -> sizeof(D) (was overallocating memory)ademeure committed 2 years ago49ffd68
  21. Fix link to zig portAydyn Tairov committed 2 years agod0b943b
  22. Merge branch 'Makefile-windows-support' of https://github.com/rosslwheeler/llm.c into Makefile-windows-supportRoss Wheeler committed 2 years ago81b689e
  23. Updating Makefile with latest changesRoss Wheeler committed 2 years agoc9ab8ee
  24. Add check with Windows OSRoss Wheeler committed 2 years ago4b80126
  25. Updating Makefile with latest changesRoss Wheeler committed 2 years agof3b1bb7
  26. Removed templates from kernels to clarify data typesChristopher Dryden committed 2 years ago109c62c
  27. Only enable kernel4 with BF16ademeure committed 2 years ago1e50f3b
  28. Use kernel6 for train_gpt2, and add all other kernels to /dev/cuda (+bugfixes)ademeure committed 2 years ago82fef03
  29. Merge branch 'ngc92-split-file' Separates out common error-checking wrapper utils, that are broadly useful across all fileAndrej Karpathy committed 2 years ago50acc12
  30. add comments pointing to the definition of the utils functionsAndrej Karpathy committed 2 years agoc20497c
  31. Merge branch 'split-file' of https://github.com/ngc92/llm.c into ngc92-split-fileAndrej Karpathy committed 2 years agob1c80e9
  32. moved checked helper functions into a separate fileErik Schultheis committed 2 years ago4a3c278
  33. Merge pull request #279 from Ricardicus/prec-ciAndrej committed 2 years ago18b41b4
  34. Merge branch 'ngc92-cleanup'Andrej Karpathy committed 2 years ago66a92c6
  35. Merge branch 'cleanup' of https://github.com/ngc92/llm.c into ngc92-cleanupAndrej Karpathy committed 2 years ago5185656