pg_textsearch

[tdrz]

https://github.com/timescale/pg_textsearch/

[contrebande-labs]

Hi @tdrz I'm considering continuing your work here on this. Can you comment on the state of the project, the challenges, etc? In short can you provide pointers as to what is needed to make pg_textsearch work for pglite ? Thanks!

[contrebande-labs]

Oh and also, could you please explain the choice for pg_textsearch against these 2 other BM25 implementations:

https://github.com/paradedb/paradedb/tree/main/pg_search
https://github.com/Casecommons/pg_search

Thanks!

[tdrz]

@contrebande-labs

could you please explain the choice for pg_textsearch against these 2 other BM25 implementations:

pg_textsearch is in C, until now we only have support for C extensions (and plpgsql). See here. Would be great to support Rust extensions though.

https://github.com/paradedb/paradedb/tree/main/pg_search https://github.com/Casecommons/pg_search

First one seems Ruby, second one Rust.

Can you comment on the state of the project, the challenges, etc? In short can you provide pointers as to what is needed to make pg_textsearch work for pglite ?

I did the minimal effort as described in our docs on adding Postgres extensions. Sorry, can't comment more as I didn't invest enough effort on it. I was hoping it will "just work"™.

[contrebande-labs]

Thanks for your quick reply! Will reproduce, investigate and circle back here.

[tdrz]

@contrebande-labs The tests themselves might not be correct.

I've just upgraded to pg_searchtext v0.5.1.

[tdrz]

Ideally we would use the extension's own tests, probably the basic ones are enough for us.

[contrebande-labs]

Hi. @tdrz! I'm currently having issues with my pglite setup in my app. I need to fix these before I add pg_textsearch into the mix. To be clear, I want to implement an hybrid BM25 lexical + dense semantic retriever embedding vector search in the browser with the WASM ONNXRuntime for inference. Once I have the other parts ready, I'll start integrating pg_textsearch. I'll keep you posted.

[contrebande-labs]

Hi! You seem to be on a roll. I'm facing some kind of race condition with PGlite that prevents me from moving forward. Still working on it.

[tdrz]

Moved to #913