Language Modeling With State Space Models with Dan Fu - #630
Today we’re joined by Dan Fu, a PhD student at Stanford University. In our conversation with Dan, we discuss the limitations of state space models in language modeling and the search for alternative building blocks that can help increase context length without being computationally infeasible. Dan…
Sources
- T2Language Modeling With State Space Models with Dan Fu - #630Podcasts: Practical AI / TWIML / No Priors / Dwarkesh