Industry

E-commerce

Client

Athleta

Streamlining product reviews with generative AI

How might we make it easier for customers to leverage product reviews as validation for their purchase decisions?

The AI Review Summary offers a concise overview of a product's reviews, highlighting key benefits and potential concerns. Designed to save time and effort, it enables customers to quickly grasp a product's features without sifting through numerous reviews. By providing clear, third-party validation, this feature fosters trust and boosts conversion rates during the decision-making process.

The Challenge

Customers increasingly rely on third-party validation during their decision-making process, making it a critical aspect of modern shopping. However, the current experience requires them to sift through hundreds of reviews to find the insights they need. Shoppers want quick access to key details about a product's features, fit, and function. This generative AI review summary streamlines the process by consolidating customer feedback, enabling shoppers to make informed purchase decisions more efficiently.

Design Process

The project began with a competitive analysis, a moderated user study, and collaboration with prompt engineers to develop an algorithm that synthesizes customer reviews. The user study revealed that consumers did not perceive bias against generative AI and viewed it as an increasingly ubiquitous feature in shopping experiences. Participants expressed a strong preference for concise, content-rich summaries, particularly favoring quick, scannable attributes outlining a product's features. Collaborating with content writers, machine learning engineers, and product managers, we trained the AI to generate balanced summaries that effectively conveyed both positive and negative customer sentiments. From there, wireframes were designed and deployed for testing on particular clothing categories.

Solution & Metrics

The beta test revealed no significant impact on exit rates or conversions, though it generated ~2 million visits within the two-week testing period. While the conversion uplift fell short of expectations, stakeholders remain highly invested in testing and iterating on the feature. Next steps include refining the latest large language model, enhancing design and functionality, and driving innovation to position Athleta at the forefront of next-generation shopping experiences.