Tag

HRM

2 posts

  1. HRM-Agent: Using the Hierarchical Reasoning Model in Reinforcement Learning

    Authors: Hoang Long Dang and David RawlinsonUPDATE: Full HRM-Agent paper now available. When the Hierarchical Reasoning Model was released, we were very excited about its combination of small size and impressive reasoning abilities. These qualities seem to be enhanced by recurrent processing, but with a surprisingly simple gradient update based on the converged recurrent forward state — turning a…

  2. Why I’m excited about the Hierarchical Reasoning Model

    Since the arrival of Chat GPT, I’ve felt that progress in AI has been largely incremental. Of course, even Chat GPT was/is mostly just a scaled up Transformer model, which was introduced by Vaswani et al in 2017. The belief that AI is advancing relatively slowly is a radical and unpopular opinion these days, and it’s been…

All posts →