Vector Podcast with Eric Pugh: Measuring your Search Quality with Quepid

In this new episode with Eric Pugh, co-founder and CEO at OSC (OpenSource Connections — these are the same folks behind Haystack search conference!) shows a cool demo with web sockets in Quepid and bulk upload feature for persisting ratings. He also talks about new development, involving an LLM rater called Judge Judy, which will allow you take the rating project off the ground. This is useful, when you do not have a team of raters, but curious to see what is the quality of your search engine at a bit of a more scale, than only anecdotal examples.

We have discussed lots of topics, including custom scoring, API, notebooks. I especially loved this quote from Eric: “Search reinvents itself every seven years”, and that’s why it is such an exciting field to work on.

Remember to subscribe (if you haven’t yet), because a few episodes are in editing from the Berlin Buzzwords conference — stay tuned.

At lastly, your favorite audio platforms along with pure RSS live here: https://rss.com/podcasts/vector-podcast/1539938/