Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If you are doing LLM, of course you do. But an amazing OSS vector DB has yet to arrived. The number of vectors it could handle needs to be in the billions, at least.



Doesn't a faiss index have to fit in memory?


Faiss implements multiple different ANN algorithms, and some like IVF can use disk based indexes.


Thanks. I just googled 'faiss ivf disk' and a couple of clicks later found this page: https://github.com/facebookresearch/faiss/wiki/Indexes-that-...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: