Skip to content

Issues: SJTU-IPADS/PowerInfer

New issue

Have a question about this project?Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to ourterms of serviceand privacy statement.We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

89 Open 67 Closed
89 Open 67 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Usealt+click/returnto exclude labels
or⇧+click/returnfor logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

CUDA toolkit version? question Further information is requested
#218 openedSep 6, 2024by shujiehan
1
Am i doing something wrong? question Further information is requested
#216 openedAug 28, 2024by RealMrCactus
3 tasks done
1
Có WeChat hoặc QQ hoặc mặt khác giao lưu đàn hoặc là tính toán khai một cái sao?
#215 openedAug 15, 2024by lzcchl
Some question about Fig4. question Further information is requested
#213 openedJul 23, 2024by rhmaaa
5
Ta muốn như thế nào đạt được đoán trước văn kiện đâu question Further information is requested
#211 openedJul 15, 2024by LDLINGLINGLING
3 tasks
1
Feature request: Support for PHI3 mini enhancement New feature or request
#210 openedJul 14, 2024by raymond-infinitecode
3 tasks
Xin hỏi powerinfer có không kiêm dung llama.cpp mô hình đâu question Further information is requested
#209 openedJul 5, 2024by mailonghua
the output for Q4_gguf is strange again!! bug-unconfirmed Unconfirmed bugs
#208 openedJul 4, 2024by milktea888
1
About powerinfer-2 enhancement New feature or request
#207 openedJul 2, 2024by Ther-nullptr
3 tasks done
Where is the TurboSparse-Mixtral mlp_predictor? question Further information is requested
#203 openedJun 27, 2024by MatthewCroughan
1
Xin hỏi có thể cùng vllm cộng đồng sử dụng sao question Further information is requested
#202 openedJun 26, 2024by yadandan
How to convert ProSparse-LLaMA-2-13B model to.gguf? question Further information is requested
#201 openedJun 23, 2024by Graysonicc
3 tasks done
3
windows hạ cmake biên dịch thất bại
#199 openedJun 19, 2024by codetown
How can i convert llama-3 8b and 70b in GGUF model?
#197 openedJun 17, 2024by tankv Python
Duy trì lượng hóa loại hình question Further information is requested
#196 openedJun 14, 2024by deleteeeee
1
Source for v2 (mobile inference engine) question Further information is requested
#194 openedJun 12, 2024by peeteeman
7
Need quite a long time to load the model question Further information is requested
#188 openedMay 21, 2024by meicale
Will this work with Falcon 2? question Further information is requested
#186 openedMay 14, 2024by aaronrmm
Về ở A100 hiện tạp thượng trắc đến hiệu quả dị thường nghi vấn question Further information is requested
#184 openedMay 4, 2024by bulaikexiansheng
3
Xin hỏi đại thần có duy trì LLama 3 70B kế hoạch sao? enhancement New feature or request
#183 openedMay 1, 2024by xiasw81
Ở A100-80G thượng vô pháp tìm được cuda tình huống question Further information is requested
#182 openedApr 24, 2024by bulaikexiansheng
2
Where is the definition or addition location of GGML_USE_HYBRID_THREADING? question Further information is requested
#172 openedMar 25, 2024by wfloveiu
2
two questions that i want to solve question Further information is requested
#167 openedMar 18, 2024by yeptttt
2
Will we have instruct fine-tuned model support in the future? question Further information is requested
#164 openedMar 13, 2024by ZeonfaiHo
3 tasks done
1
[Question]: High PPL on wikitext2 of ReLU-LLAMA-7B for language modeling tasks question Further information is requested
#162 openedMar 11, 2024by llCurious
3 tasks done
2
ProTip! Updated in the last three days:updated:>2024-09-06.