Recently, as part of the “Special Year on Large Language Models and Transformers“, the Simons Institute in Berkeley hosted a workshop on “Transformers as a Computational Model”. You can see the schedule here.
I watched (almost) all videos and learned a lot about the limitations and capabilities of transformers. The videos have inspired me to work on one or more projects involving transformers.
P.S. This is my shortest post in a while.