Skip to main content

fused_qkv实现逻辑_llama_vs_ernie

fused_qkv(llama)实现逻辑图：​

image-20250906104251807

tp2->tp4,num_heads=k_v_nums:

tp2_qkv_fused-_tp4_qkv_fused.drawio

tp2->tp4,num_heads>k_v_nums:

image-20250906112745567

old_fused_qkv（ernie）实现逻辑图：​

image-20250906104313466

image-20250906104354160

tp2->tp4,num_heads=k_v_nums: 此时逻辑同上，也是均分最后一维。

tp2->tp4,num_heads>k_v_nums:

image-20250906131218483