reply on: SN release: semantic search \ stacker news ~meta

pull down to refresh

121 sats \ 5 replies \ @SimpleStacker 16 Jan freebie \ on: SN release: semantic search meta

This is great! SN search functionality was pretty poor before, so hopefully this makes old posts way more searchable!

Just curious, what language model are you using to get the semantic embeddings?

499 sats \ 4 replies \ @k00b OP 16 Jan

this sentence transformer

10 sats \ 3 replies \ @shyfire 16 Jan

deleted by author

0 sats \ 2 replies \ @k00b OP 16 Jan

We like using OpenSearch for search stuff so we store them there. I’m not sure if Postgres supports k-nn in arbitrary dimensions.

10k sats \ 1 reply \ @shyfire 16 Jan

deleted by author

0 sats \ 0 replies \ @k00b OP 16 Jan

You're right! Thanks for bringing it to my attention. I wasn't even aware of that extension.

I've been disappointed by pg's fts in the past so I didn't consider using pg for this, but we could make better use of the embeddings if they were in pg.