Skip to content

Pull requests: axolotl-ai-cloud/axolotl

New pull request New
66 Open 1,167 Closed
66 Open 1,167 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Bump liger to 0.4.0
#2017 opened Nov 6, 2024 by ByronHsu Loading…
Add weighted optimisation support for trl DPO trainer integration
#2016 opened Nov 5, 2024 by bursteratom Loading…
1
Update get_unpad_data patching for multipack
#2013 opened Nov 4, 2024 by chiragjn Loading…
1
7
refactor(optimizer): use optimizer_cls_and_kwargs for custom optim
#2012 opened Nov 4, 2024 by NanoCode012 • Draft
6 tasks
feat(doc): update colab example documentation Improvements or additions to documentation
#1989 opened Oct 22, 2024 by NanoCode012 Loading…
1
add soap optimizer support
#1978 opened Oct 17, 2024 by winglian Loading…
1
upgrade liger to 0.3.1 ready to merge
#1973 opened Oct 15, 2024 by winglian Loading…
7
WIP Multimodal support
#1930 opened Sep 26, 2024 by winglian Loading…
4
shampoo optim support
#1919 opened Sep 18, 2024 by winglian Loading…
2
Grokfast support ready to merge
#1917 opened Sep 17, 2024 by winglian Loading…
@NanoCode012
1
support seperate lr for embeddings, similar to loraplus
#1910 opened Sep 12, 2024 by winglian Loading…
Add Llama 3.1 Instruct Chat template, Ensure Correctness of 3, Small Refactor of Chat Template registration for shareGPT
#1903 opened Sep 7, 2024 by alpayariyak Loading…
3
phi moe support for multipack
#1870 opened Aug 26, 2024 by winglian Loading…
drop valueerror as this was from when 4bit required gptq
#1857 opened Aug 22, 2024 by winglian Loading…
1
semi-weekly 8bit lora zero3 check
#1852 opened Aug 22, 2024 by winglian Loading…
1
fix so inference can be run against quantized models without adapters
#1834 opened Aug 19, 2024 by winglian Loading…
Enable Ascend NPU support
#1758 opened Jul 16, 2024 by MengqingCao Loading…
12
add q-galore optimizer
#1752 opened Jul 14, 2024 by winglian Loading…
3
Implements SPPO Alignment Algoritm
#1735 opened Jul 11, 2024 by kaykyr Loading…
1 of 3 tasks
10
remove the bos token from dpo outputs
#1733 opened Jul 10, 2024 by winglian Loading…
1
1
Update multi-node.qmd
#1688 opened Jun 7, 2024 by shahdivax Loading…
15
update to be deprecated evaluation_strategy and c4 dataset
#1682 opened Jun 3, 2024 by winglian Loading…
jagged lr restart scheudler
#1680 opened Jun 3, 2024 by winglian Loading…
add support for SPPO
#1585 opened May 2, 2024 by winglian Loading…
WIP test out new dockerfile with more nvidia tools
#1557 opened Apr 21, 2024 by winglian Loading…
ProTip! Filter pull requests by the default branch with base:main.