I'd love to see SSMs replace transformers but adapting them to non-causal, 2D+ i...

		roger_ on Oct 28, 2024 \| parent \| context \| favorite \| on: State-space models can learn in-context by gradien... I'd love to see SSMs replace transformers but adapting them to non-causal, 2D+ inputs doesn't seem that straightforward. Is there a non-autoregressive future?