Offloading

LLM推理论文精读2 -- PowerNPU[ASPLOS'25]

PowerNPU:Fast On-device LLM Inference with NPUs

Oct 15, 2024

LLM推理论文精读1 -- FlexGen[ICML'23]

FlexGen

Oct 12, 2024