← All work

Case study · № 004 · AI design search

MOCKLY · search interfaces by intent

An AI-powered design reference platform that discovers real interface states, describes their structure, and retrieves them through natural design language.

RoleUser research · UI design · front-end
PipelineCapture · describe · index · retrieve
SearchAzure AI Search · hybrid retrieval
Livemockly.space ↗
AI searchTechnical plate showing the Mockly discovery and search pipeline

The challenge

Designers needed references from real product flows, not isolated concept shots. Keyword tags could not express layout intent, interaction patterns, or the difference between two visually similar screens serving different jobs.

The system

  • An agentic capture layer navigates products, detects state changes, and records meaningful interface states.
  • An LLM pipeline generates normalized descriptions for hierarchy, components, flow purpose, tone, and interaction patterns.
  • Azure AI Search combines vector retrieval, keywords, and semantic ranking.
  • De-duplication, resolution checks, safety screening, relevance tuning, and analytics protect catalogue quality.

Decisions that mattered

Acquisition and interpretation stay separate. The crawler captures clean evidence; later systems decide what it means.

Normalize language before scale. A growing library becomes less useful if equivalent patterns drift into incompatible labels.

Search the job, not the decoration. Queries such as “card-based checkout” should match interface purpose and structure.

Evidence boundary

The product architecture and Hashaam's design/front-end role are documented on his public case study. Source code, ingestion scale, latency, and search-quality metrics are not public, so this case focuses on product thinking and system shape rather than invented results.

Previous case← EAJNext caseFloraGenic →