Llama-3 8B Inference Stack

Custom kernel inference stack for Llama3.1 8B model.

In progress:

• Fused kernels
• FlashDecode
• Basic KV cache

Stack

• Triton
• CUDA
• H100/Hopper
• FP16/BF16/FP8