Flash attention

Technique that reduces memory access during attention by splitting it into blocks and keeping intermediate results in fast memory. It lowers bandwidth demand and speeds up prefill and decode, especially on long contexts. In llama.cpp it is enabled with the -fa flag.