It's a great survey of the existing platforms. Thanks for putting it together!
As the center of mass moves from fully connected networks to, say, transformers, do think the stack will evolve as well? I am wondering if there is a need to go a bit lower a la a programing language that can last for decades?
