Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor multi-modal #1212

Merged
merged 1 commit into from
Jun 24, 2024
Merged

Conversation

Jintao-Huang
Copy link
Collaborator

@Jintao-Huang Jintao-Huang commented Jun 24, 2024

PR type

  • Bug Fix
  • New Feature
  • Document Updates
  • More Models or Datasets Support
  1. 在所有的MLLM最佳实践中增加OCR测试, 并对所有多模态模型进行检查
  2. fix dataset中的非split问题, 抛出错误, 而不是打印error log
  3. template.py的代码优化
  4. replace_tag等函数返回List[Context], pre_tokenize的位置放置在_simplify_context_list之前
  5. fix qwen-audio bug

@Jintao-Huang Jintao-Huang merged commit 04a98d4 into modelscope:main Jun 24, 2024
2 checks passed
tastelikefeet added a commit to tastelikefeet/swift that referenced this pull request Jun 27, 2024
…n2-llava

* commit 'd8682d038d013b933c20ed4d0fda4abd3f42af56':
  Fix bugs (modelscope#1241)
  fix (modelscope#1232)
  Add new dataset (modelscope#1227)
  fix readme
  Fix qlora deploy (modelscope#1224)
  Add debug log support (modelscope#1226)
  Fix glm4v batch size (modelscope#1223)
  [TorchAcc] Add USE_TORCH_XLA=0 flag for native swift scripts (modelscope#1221)
  add in_browswer (modelscope#1220)
  support llava 1.5 (modelscope#1217)
  update multi-modal docs (modelscope#1212)
tastelikefeet added a commit to tastelikefeet/swift that referenced this pull request Jun 28, 2024
…cker

* commit 'bd420f2e9ef6d04a8b4c62c1ab27d3b8b7fb9b67':
  Support gemma2 (modelscope#1247)
  Add more datasets (modelscope#1246)
  refactor inference (modelscope#1245)
  fix bugs (modelscope#1242)
  Fix bugs (modelscope#1241)
  fix (modelscope#1232)
  Add new dataset (modelscope#1227)
  fix readme
  Fix qlora deploy (modelscope#1224)
  Add debug log support (modelscope#1226)
  Fix glm4v batch size (modelscope#1223)
  [TorchAcc] Add USE_TORCH_XLA=0 flag for native swift scripts (modelscope#1221)
  add in_browswer (modelscope#1220)
  support llava 1.5 (modelscope#1217)
  update multi-modal docs (modelscope#1212)
hjh0119 pushed a commit to hjh0119/swift that referenced this pull request Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants