Code

History

Commits on master to dev35+
  1. fix tokenizer omgAndrej Karpathy committed 2 years ago755458d
  2. attempt to fix PRAndrej Karpathy committed 2 years ago16635d4
  3. Refactor tokenize, delegate insteadAleksa Gordic committed 2 years ago68624cc
  4. Refactor magic/version header dictAleksa Gordic committed 2 years agoe8739c8
  5. Replace fire with argparseAleksa Gordic committed 2 years agoeb1b359
  6. Add fineweb llama 3 supportAleksa Gordic committed 2 years ago5076563
  7. Use fire module, update readmeAleksa Gordic committed 2 years agof8c1ff5
  8. Add tiny shakespeareAleksa Gordic committed 2 years ago15b76bf
  9. Update header descriptionAleksa Gordic committed 2 years ago71419cb
  10. Add llama 3 tokenization and data loaderAleksa Gordic committed 2 years agod3151c4
  11. revert makefile changeAndrej Karpathy committed 2 years ago1566d6b
  12. chore(permute): use common.h utils for validation and benchmarkingmspronesti committed 2 years ago574ef9b
  13. make: generalize TARGETS definitionmspronesti committed 2 years agoa49da7d
  14. Merge pull request #712 from indianspeedster/dev-cudaAndrej committed 2 years agob4623bc
  15. fix(dev/cuda): memory leaksmspronesti committed 2 years agoc6e74ea
  16. Added compilation steps in makefile for permute.cuindianspeedster committed 2 years agoa80bce6
  17. added kernel to permute in dev/cudaindianspeedster committed 2 years ago8952c52
  18. Move WIN32 code into unistd.hRoss Wheeler committed 2 years ago9dc920a
  19. Adding CI check for exceeding loss toleranceRoss Wheeler committed 2 years ago56621bb
  20. add edu fineweb sh download script, change paths to my HF repo, add hellaswag to starter packAndrej Karpathy committed 2 years ago48fee04
  21. small cosmetic fixes to fineweb data fileAndrej Karpathy committed 2 years agoea36d04
  22. Merge pull request #629 from rosslwheeler/feature/testsAndrej committed 2 years ago2daaf6a
  23. Merge branch 'add_edu_fineweb_support' of https://github.com/eliebak/llm.c into eliebak-add_edu_fineweb_supportAndrej Karpathy committed 2 years agoff7a90b
  24. Addressed review commentsRoss Wheeler committed 2 years agod6d08be
  25. Merge branch 'karpathy:master' into feature/testsrosslwheeler committed 2 years ago267efc9
  26. resolve merge conflictsAndrej Karpathy committed 2 years agoe12d090
  27. Add unistd.h for Windows cuDNN buildRoss Wheeler committed 2 years ago2e6fd9b
  28. Merge branch 'karpathy:master' into feature/testsrosslwheeler committed 2 years ago2e32e25
  29. add outlier detector, test for it, and start tracking z score of the loss, for now only print itAndrej Karpathy committed 2 years ago569f9f1
  30. Merge branch 'streams-io' of https://github.com/ngc92/llm.c into ngc92-streams-ioAndrej Karpathy committed 2 years ago2543b62
  31. Dataloader test and ptx/sass file generatorRoss Wheeler committed 2 years ago5b95bff
  32. add shell script that downloads the .bin files of FineWeb100B directlyAndrej Karpathy committed 2 years ago2677d82
  33. update vislog to be a bit more fancy, has GPT-2/3 perf for hellaswagAndrej Karpathy committed 2 years ago0bc8753
  34. add starter pack .sh script for faster quickstartAndrej Karpathy committed 2 years agob29478e
  35. Merge pull request #611 from rosslwheeler/feature/dataloader_testAndrej committed 2 years ago4577d58