Is there any equivalent for turning an AI LLM into a sticky platform? Right now seems like it’s pretty easy to use harnesses and tooling across models, including open weight and locally running ones.

Not with AI specifically. Having a large, private, data store (e.g. GMail, Google Drive) is the biggest advantage.