I had a speed problem repeatedly loading large dataframes into memory for a Dash project - threads can’t share object updates and Redis gets slow with large objects. So I built brain-plasma. It lets you keep objects in memory, but separate from service memory - no need to read data into memory over and over. Fast access and arbitrary namespaces. It’s not perfect but it works well.
https://github.com/russellromney/brain-plasma
I had a speed problem repeatedly loading large dataframes into memory for a Dash project - threads can’t share object updates and Redis gets slow with large objects. So I built brain-plasma. It lets you keep objects in memory, but separate from service memory - no need to read data into memory over and over. Fast access and arbitrary namespaces. It’s not perfect but it works well.