Skip to content

Issues: hpcaitech/ColossalAI

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

378 Open 1,216 Closed
378 Open 1,216 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[BUG]: loading OPT 66B model - CPU runs out of memory bug Something isn't working
#5855 opened Jun 25, 2024 by PurvangL
1 task done
[FEATURE]: Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM enhancement New feature or request shardformer
#5853 opened Jun 25, 2024 by GuangyaoZhang
1
[FEATURE]: Support T5ForTokenClassification enhancement New feature or request shardformer
#5841 opened Jun 20, 2024 by GuangyaoZhang
1
Use gemini plugin and LowLevelZero to run llama2_7b. In the pulgin in gemini, set the policy to static, shard_param_frac, offload_optim_frac, and offload_param_frac to 0.0, making gemini equal to zero2, and set stage to 2 in LowLevelZero. Using bf16 for training, and comparing the two plugins, we found that the GPU memory usage of gemini is higher than that of LowLevelZero. Why is this? In principle, gemini should save more GPU memory
#5830 opened Jun 18, 2024 by JJGSBGQ
2
[FEATURE]: LoRA with sharded model enhancement New feature or request
#5826 opened Jun 17, 2024 by KaiLv69
Gradients are None after booster.backward bug Something isn't working
#5792 opened Jun 11, 2024 by ArnaudFickinger
10
[BUG]: Shardformer failure with torch 2.3 bug Something isn't working
#5757 opened May 27, 2024 by Edenzzzz
1 task done
@ver217
[BUG]: docker build cuda extension error bug Something isn't working
#5732 opened May 20, 2024 by apachemycat
1 task done
7
[BUG]: TypeError: LlamaInferenceForwards.llama_causal_lm_forward() got an unexpected keyword argument 'shard_config' bug Something isn't working
#5729 opened May 17, 2024 by hiprince
1 task done
1
[BUG]: No module named 'dropout_layer_norm' bug Something isn't working
#5726 opened May 17, 2024 by apachemycat
1 task done
1
[BUG]: TypeError: _gen_python_code() got an unexpected keyword argument 'verbose' bug Something isn't working
#5673 opened Apr 29, 2024 by Xingzhi107
2
[BUG]: GROK-1 does not support do_sample bug Something isn't working
#5672 opened Apr 28, 2024 by vsmelov
Does colossalai support rocm?
#5669 opened Apr 28, 2024 by zhaohm14
2
[PROPOSAL]: Fix potential github action smells enhancement New feature or request
#5667 opened Apr 28, 2024 by ceddy4395
1 task done
1
[BUG]: ColossalMoE Train: AssertionError: Parameters are expected to have the same dtype torch.bfloat16, but got torch.float32 bug Something isn't working
#5664 opened Apr 26, 2024 by Camille7777
1
[BUG]: re-join str type error_msgs using \n\t in general_checkpoint_io bug Something isn't working
#5615 opened Apr 21, 2024 by ericxsun
[BUG] [Shardformer]: Error in blip2 testing with half precision bug Something isn't working
#5600 opened Apr 15, 2024 by insujang
@ver217
1
[BUG]: pretraing llama2 using "gemini" plugin, can not resume from saved checkpoints bug Something isn't working
#5597 opened Apr 15, 2024 by jiejie1993
1
[BUG]: Running ColossalAI in H800 with torch 2.0 bug Something isn't working
#5594 opened Apr 13, 2024 by wxthu
29
[DOC]: What is the datasetset used to train the Colossal-Llama-2? documentation Improvements or additions to documentation
#5587 opened Apr 11, 2024 by ello0211
1
[BUG]: OOM when saving 70B model bug Something isn't working
#5585 opened Apr 11, 2024 by jiejie1993
@ver217
2
[FEATURE]: Support qwen2 model enhancement New feature or request
#5573 opened Apr 9, 2024 by wangbluo
[BUG]: AttributeError: type object 'ColoParameter' has no attribute 'from_torch_tensor' when run hybrid_parallel example bug Something isn't working
#5571 opened Apr 8, 2024 by ztorchan
3
[BUG]: ValueError: mutable default <class 'colossalai.legacy.tensor.distspec._DistSpec'> for field dist_attr is not allowed: use default_factory bug Something isn't working
#5564 opened Apr 7, 2024 by fangbrodie
1
TypeError: LlamaRotaryEmbedding.forward() got an unexpected keyword argument 'seq_len' bug Something isn't working
#5555 opened Apr 4, 2024 by alphanlp
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.