Self-Attention Leaks: Mamba Crushes GPU Memory

Your GPU claims it can handle a million tokens — then crashes with an out-of-memory error. This is not a hardware bug.

source