Care and Repair of Search Engines
Announcing a lecture and workshop at UCLA's Information Studies department on March 1st about maintaining and improving search engines.
Posts
Filter by tag
hallucinationsocial-search-requestPerplexity-AIcomparing-resultsgenerative-searchprompt engineeringsearch-auditsmicro interactions in searchYou.comspeculative-designGoogle-BardCGTbetter-searchcompetition-in-searchchoice-in-searchgenerative-web-searchknowledge-cutoffsalternative-search-enginesevaluating-results-metasearch-quality-complaintsstanding-queriessearch-engine-optimizationrepository-of-examplesAnthropic-ClaudeCFP-RFPRAGPhinddoubtingadvertising-in-searchseo-for-social-goodOpenAI-ChatGPTpublic-interest-technologyspeculative-classroom-exercisesTavilysearch-user-interfacesgenerative-search-APIfresh-searchautocomplete-in-web-searchfalse-premiseTikTokAndievaluating-search-enginesarticulationsocial-searchdata-poisoningInflection-AI-Piacademic-searchChainForgeautomation biasMeno-Paradox+221 more
notes 2024-02-21
Work log on search evaluation tooling including Searchevals, Searchjunct, and SearchRights.org, plus community engagement on AI search benchmarking.
notes 2024-02-12
Task list for upcoming Searchevals updates, Searchwhence improvements, and preparation for a UCLA lecture on search engine evaluation.
2024-02-05
Research notes on Trieve's search-before-generate approach, ArcSearch, Perplexity AI, and testing how distractor hints affect search accuracy across multiple tools.
"Search has become ubiquitous but that does not mean that search has been solved."
Human-centered Evaluation and Auditing of Language Models Workshop
tooling to support people in making hands-on and open evaluations of search
We have a big chance to really change search for the better. Will we?
ssr: "Is anyone working on a google vs perplexity vs bard vs gpt search benchmark?"
Social media request asking if anyone is developing a comparative benchmark between major search and AI platforms.
ssr: "Anyone got any leads on good LLM prompts for RAG with citations?"
"Over the weekend, we built a demo for conversational search"
Yuveganlife Tests of Generative Web Search Tools
Link to Bruce Yu's user-driven evaluation of generative web search tools using 5 simple test questions.
on posting screenshots of the results or responses from search systems
A brief post linking to a Twitter post discussing considerations around posting screenshots of search system results or responses.
[thyroid nodule treatments]
A short post linking to a Twitter post tagged as a speculative classroom exercise about thyroid nodule treatments.
on a plagiarism–index
A short post linking to a Twitter post proposing a speculative 'plagiarism index' as a classroom exercise.
On developing informed preferences for models in generative web search
I quote-tweeted the above on Dec 10th, pasted with some edits below. The implicit social-search-request and responses was a great reminder of the work from LMSYS.org ( website | twitter | @zheng2023ju...
comparing results for [What is answer.ai (from Howard & Ries)?]
A brief index post linking to comparisons of search results across Perplexity, You.com, Bard, Bing, Tavily, and a custom generative search baseline for the 'What is answer.ai?' query.
Building a Generative Web Search Arena
I mention the need for something like this in several posts (which I will organize below). But I'm going to just start building it out myself.[^remotivated] - Dec 10th[^1]: On developing informed pref...
comparing results for [What is generative web search? site:danielsgriffin.com]
Comparison of results from Perplexity AI.Copilot, YouChat.GPT-4, and Tavily when searching 'What is generative web search? site:danielsgriffin.com', noting high dependency on indexing quality.
YouChat.GPT-4[What is generative web search? site:danielsgriffin.com]
[comparing results for [What is generative web search? site:danielsgriffin.com]](/2023/12/14/comparing-results-for-what-is-generative-web-search-site/) For other systems on this theme, see: - [Perplex...
Perplexity AI.Copilot[What is generative web search? site:danielsgriffin.com]
Documents Perplexity AI.Copilot's responses to querying 'What is generative web search? site:danielsgriffin.com' in two variations, with evaluations noting distractions from off-site sources and mixed adherence to the site: operator.