Search results

[BUG]: flash_decoding_unpaged_forward in the DeFTAttention does the dummy process, e.g., the attention function memory_efficient_attention_forward is commented and undefined.

bugSomething isn't workingSomething isn't working

Status: Open.

#117 In LINs-lab/DeFT;

· xinzhel opened on Apr 29, 2025

[FEAT]: Add dynamic grouping indicator for GQA/MQA

enhancementNew feature or requestNew feature or request

priority-0priority of the issuepriority of the issue

Status: Open.

#116 In LINs-lab/DeFT;

· Monstertail opened on Mar 25, 2025

[ORG]: Add pytest and CI

enhancementNew feature or requestNew feature or request

priority-0priority of the issuepriority of the issue

Status: Open.

#115 In LINs-lab/DeFT;

· Monstertail opened on Mar 5, 2025

[BUG]: Llama3.1-8B to fix

bugSomething isn't workingSomething isn't working

priority-0priority of the issuepriority of the issue

Status: Open.

#114 In LINs-lab/DeFT;

· Monstertail opened on Mar 5, 2025

[FEAT]: code structure of kernel

enhancementNew feature or requestNew feature or request

priority-0priority of the issuepriority of the issue

Status: Open.

#17 In LINs-lab/DeFT;

· Monstertail opened on Jun 30, 2024

[FEAT]: implement real speculative decoding(SD) and multi-step reasoning(MS)

enhancementNew feature or requestNew feature or request

priority-1priority of the issuepriority of the issue

Status: Open.

#12 In LINs-lab/DeFT;

· Monstertail opened on Jun 24, 2024

·  

NIPs rebuttal

[FEAT]: implement KV cache manager

enhancementNew feature or requestNew feature or request

priority-0priority of the issuepriority of the issue

Status: Open.

#11 In LINs-lab/DeFT;

· Monstertail opened on Jun 24, 2024

·  

deft kv manager with demo

[FEAT]: memory management for deft kernel tests

enhancementNew feature or requestNew feature or request

priority-0priority of the issuepriority of the issue

Status: Open.

#10 In LINs-lab/DeFT;

· Monstertail opened on Jun 24, 2024

·  

deft cuda kernel

[FEAT]: cuda kernel of deft

enhancementNew feature or requestNew feature or request

priority-0priority of the issuepriority of the issue

Status: Open.

#9 In LINs-lab/DeFT;

· Monstertail opened on Jun 24, 2024

·  

deft cuda kernel