Skip to content

Pull requests: karpathy/nanoGPT

New pull request New
56 Open 165 Closed
56 Open 165 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

added fix to type comparison to enable fused AdamW
#569 opened Oct 30, 2024 by seanjudelyons Loading…
Updated README.md to include table of contents, why this project is useful, and how to contribute, and added an output for one command
#558 opened Sep 25, 2024 by arhaque09 Loading…
Adding NVIDIA hardware performance detection
#555 opened Sep 20, 2024 by fparisio Loading…
Add fire finetuning
#553 opened Sep 6, 2024 by gkielian • Draft
Add support for 0 temperature
#546 opened Aug 19, 2024 by jmccrosky Loading…
Use weights_only for loading
#540 opened Aug 2, 2024 by kit1980 Loading…
Update train.py for more efficiency
#538 opened Jul 19, 2024 by Jesseonmi Loading…
free up state_dict variable memory after loading checkpoint
#533 opened Jul 10, 2024 by adistomar Loading…
Add automatic detection of number of CPU cores
#530 opened Jun 27, 2024 by Jakobovski Loading…
2
fix val dataset size code comment
#528 opened Jun 24, 2024 by vhmth Loading…
fix(train.py): mfu estimation to respect CPU-GPU sync point
#527 opened Jun 23, 2024 by JasonLiJT Loading…
sign descent seems to do better than adamw?
#488 opened Jun 1, 2024 by nullonesix Loading…
Fix: conditional use of GradScaler based on device_type and dtype in train.py
#481 opened May 9, 2024 by BRAINIAC2677 Loading…
Refactor for easier configuration and overrides
#459 opened Mar 20, 2024 by ikeman32 Loading…
PyTorch nn.LayerNorm now takes bias arg - removed custom class
#454 opened Mar 10, 2024 by calmitchell617 Loading…
2
Early stopping
#453 opened Mar 9, 2024 by derekehyatt Loading…
2
Implement ROPE positional encodings
#450 opened Mar 8, 2024 by devinbot Loading…
1
fix: estimate_mfu dt ZeroDivisionError
#446 opened Mar 2, 2024 by HildaM Loading…
Generalize encode/decode for datasets
#415 opened Jan 5, 2024 by GMNGeoffrey Loading…
1
Fix BUG when = in CLI value, like: --start="1+1="
#412 opened Jan 4, 2024 by DIYer22 Loading…
Dockerfile using Nvidia Container Toolkit
#409 opened Dec 27, 2023 by niccolox Loading…
Azure deployment
#406 opened Dec 18, 2023 by lakaschus Loading…
Update transformer_sizing.ipynb
#402 opened Dec 10, 2023 by Cassini-chris Loading…
Fix a small bug in the attention bias calculation when flash attention is not available
#398 opened Nov 28, 2023 by tbuthfer Loading…
1
Update configurator.py
#394 opened Nov 20, 2023 by GeniusPlums Loading…
ProTip! What’s not been updated in a month: updated:<2024-10-21.