Artificial Intelligence
Maximizing Product Discovery in E-Commerce Using LLM for E-Commerce Technologies
LLM-powered product discovery replaces keyword matching with meaning: embedding models map queries and products into a shared semantic space, so "warm jacket for rainy commutes" returns the right parka instead of zero results. The stakes are measured: search abandonment costs US retailers $234 billion a year (Google Cloud), and 35% of Amazon purchases come from algorithmic recommendations (McKinsey).
What is LLM-powered product discovery?
LLM-powered product discovery is the use of large language models and embedding models to run every surface where shoppers find products — site search, recommendations, category navigation, and conversational assistants — on meaning rather than string matching. Each query and each product is represented as a vector that encodes intent, so "quiet vacuum for a small flat" retrieves compact, low-decibel machines even when no product title contains those words.
The commercial case rests on how badly the incumbent approach fails. Site search is the highest-intent surface a store owns, and it is exactly where keyword engines break: misspellings, paraphrases, and problem-shaped queries return zero or irrelevant results, and the shopper leaves — usually for a marketplace that answers the same query correctly.
Recommendations carry the other half of discovery, and the ceiling is documented. The benchmark every retailer measures against is Amazon, where algorithmic suggestion is not a sidebar widget but a primary sales channel.
Embeddings vs keyword search: what actually changes?
Keyword search matches the literal tokens of a query against indexed product text; embedding search compares dense vectors that encode what the query and the product mean. The difference is invisible on "iphone 15 case" and decisive on "gift for a coffee-obsessed dad under $50" — the long-tail, natural-language queries that carry the most purchase intent and produce the most zero-result pages.
| Criteria | Keyword (lexical) | Embedding (semantic) | Hybrid |
|---|---|---|---|
| Matches on | Literal tokens, stems, synonym lists | Meaning encoded as vectors | Both, merged and reranked |
| Long-tail natural-language queries | Zero or irrelevant results | Resolves intent to products | Resolves intent to products |
| Exact SKU, brand, model lookups | Precise | Can blur near-duplicates | Precise — lexical path wins |
| Misspellings and paraphrase | Needs hand-built dictionaries | Handled by the model | Handled by the model |
| Merchandising control | Mature: boosts, pins, rules | Immature on its own | Keeps the existing rule stack |
| Cost to add | Already installed | Embedding pipeline + vector index | Incremental on the current engine |
Baymard Institute benchmarks large e-commerce sites on each type of search query a shopper can type. Exact lookups are close to solved; the intent-shaped queries — use case, compatibility, symptom — fail on three to five times as many sites.
Source: Baymard Institute, E-Commerce Search UX benchmark (opens in a new tab)
View the data
| Item | Share of benchmarked sites with issues | Note |
|---|---|---|
| Exact SKU or model | 12% | "Nike Air Zoom Pegasus 40" — the shopper already knows the product |
| Product type | 20% | "running shoes" — the category term the catalog already uses |
| Symptom | 37% | "knee pain when running" — the problem, not the product |
| Feature | 39% | "waterproof running shoes" — an attribute that may not be a facet |
| Use case | 43% | "shoes for standing all day" — the query semantic retrieval is built for |
| Non-product question | 66% | "return policy" — answerable only from content outside the catalog |
That benchmark is the business case in one line: lexical retrieval is close to solved for the queries shoppers type when they already know the product, and weakest on the queries they type when they do not. Discovery — as opposed to re-finding — lives almost entirely in the second group, which is also where basket size grows, because a shopper who describes a situation rather than a SKU is open to being shown the right answer.
Hybrid retrieval is the deployment answer, not a compromise. Lexical retrieval keeps part numbers, brand names, and merchandising rules exact; vector retrieval catches everything phrased like a human; a reranking model orders the merged candidates. Relevance is the whole game — 88% of consumers call a good search function very important or essential, and only 12% say they get exactly what they searched for every time (opens in a new tab) (Google Cloud & The Harris Poll), and the reranker is the component that closes that gap.
How to add LLM-powered discovery to an existing store
A production rollout is a sequencing problem: enrich the data before indexing it, index before tuning, tune before testing, and hold every step against a baseline recorded up front. Scoped to one category and one surface, the sequence below fits the 90-day window we scope first production releases to.
The target architecture is smaller than most replatform proposals suggest. One query fans out to two retrievers reading the same enriched catalog, and the merged candidates pass a reranker before anything reaches the shopper. Nothing is thrown away: the lexical engine running the store today becomes one of the two paths.
The enriched catalog feeds both indexes, so semantic and lexical retrieval argue over the same facts. The reranker is the single place where relevance, stock, and merchandising rules are reconciled — and the same ranked output serves search results, recommendation slots, and a grounded assistant.
Read this diagram as a list
- Shopper query — "warm jacket for rain"
- Enriched catalog — attributes · use-case tags
- Lexical index — tokens · SKU · brand
- Vector index — embedding neighbours
- Merge and rerank — one ordered candidate set
- Discovery surfaces — search · recs · assistant
Baseline the discovery funnel (weeks 1–2)
Instrument and record four numbers before touching anything: zero-result rate, search exit rate, search-to-add-to-cart conversion, and revenue per search session. These are the figures the pilot is judged against; without them, "better search" stays an opinion.
Enrich the catalog (weeks 2–5)
Run the catalog through an LLM extraction pass: normalise attributes into one taxonomy, fill missing facet values from descriptions and supplier feeds, and tag each SKU with the use cases shoppers actually search. Generation stays grounded in the source record and passes a review queue before anything publishes.
Stand up hybrid retrieval (weeks 4–7)
Embed the enriched catalog into a vector index alongside the existing lexical engine — Elasticsearch, OpenSearch, and most commerce platforms now hold both. Route queries down both paths and merge candidates; do not switch the lexical path off.
Tune relevance on real query logs (weeks 6–9)
Replay the store's top 1,000 queries plus a sample of zero-result queries through the new stack, judge the results against a rated set built by merchandisers, and tune the reranker and merge weights. The zero-result sample is where semantic retrieval shows its largest and fastest wins.
A/B test against the baseline (weeks 9–12)
Ship the hybrid stack to a traffic split and read the four baseline metrics. Promote only what moves them; a relevance improvement that does not move add-to-cart is a tuning target, not a victory.
Extend to recommendations and conversation (week 12+)
The same embeddings power "similar products", "complete the look", and a grounded conversational assistant — each is one more retrieval surface over the enriched catalog, added incrementally, never a rebuild.
Product discovery, quantified
$234B
lost by US retailers to search abandonment every year
Source: Google Cloud & The Harris Poll
43%
of benchmarked sites mishandle use-case search queries
Source: Baymard Institute
35%
of Amazon purchases come from algorithmic recommendations
Source: McKinsey & Company