What Samsung’s experience reveals about Lupine-powered PBX Ideate

At this year’s Kameleoon’s Unite Summit in Paris, we saw how Samsung’s experience of PBX Ideate, powered by GAIN’s Lupine, was a game changer for their experimentation teams. 

The presentation explored Kameleoon’s five specialist Prompt-Based Experimentation (PBX) agents. And it how showcased how Samsung uses PBX Ideate to improve CRO by addressing an actual customer problem, why that deserved the attention of their experimentation teams, and how it all fits into their business’s priorities.

The value of PBX Ideate was about more than generating hypotheses quickly. Samsung’s experience highlighted the use of CRO recommendations that it could trust, with the ability to add business context into the analysis of the webpage, and keeping its experimentation roadmap supplied with rich ideas. 

A roadmap needs worthwhile opportunities

Samsung’s experimentation programme was running more than 150 tests a year on average. At that pace, a continuing supply of relevant hypotheses mattered. 

The team had reached a point where its ability to execute experiments was outpacing its roadmap because their build velocity had increased so much. 

This scenario provides an important context for PBX Ideate’s role. Because when a team can act on opportunities faster, deciding what deserves attention becomes increasingly important.

As Frederic De Todaro, Chief Product Officer at Kameleoon, explained, “You can't test everything, so you have to put your bets on the most promising ideas.”

An overflowing list of suggestions does not solve that problem. Teams need hypotheses they can evaluate against customer needs and commercial priorities.

Samsung turned to PBX Ideate to help replenish its ‘to test’ pipeline. The objective was not to fill a backlog with arbitrary changes, but to identify opportunities the team knew were worth meaningfully

assessing and to take those forward.

Relevant recommendations earn trust

Before making PBX Ideate part of its workflow, Samsung wanted to establish whether its recommendations made sense and if it could therefore actually trust those ideas. The team asked PBX Ideate to analyse various pages on the user journeys, then compared the output with their own understanding of the customer experience, and they were pleased that PBX Ideate arrived at the same intuitions as the team. 

This is a practical way to assess an AI ideation tool. Does it recognise challenges the team understands? Are its recommendations credible enough to investigate?

Lupine provides an evidence-based foundation for that work. It draws on more than 15 years of GAIN Conversion’s experience and learnings from over 10,000 experiments to produce methodically reasoned, test-ready ideas.

Those learnings inform the recommendations, but they do not guarantee that an individual hypothesis will succeed. That’s why the team still needs to apply its judgement, select what to pursue and test the proposed change.

Business context strengthens the analysis

Relevant ideation also needs information that a webpage alone cannot provide.

Who is the product for? How is it positioned? Which conversion challenge is the team trying to address? Samsung demonstrated how it brings that knowledge into the analysis and appreciated that PBX Ideate is not a black box. 

In the live demonstration, we saw how the Samsung team supplied a product detail page URL and described the additional context related to product positioning, the target audience, and the main conversion challenges the team were experiencing. 

This additional context changed the task from “suggest improvements to this page” to a more focused analysis of a particular product, audience and problem.

Samsung’s example concerned discount messaging. PBX Ideate identified an issue the team already recognised on the page - a live conversion concern, rather than an abstract suggestion – showing the value of adding context. 

GAIN’s experimentation learnings underpin Lupine’s approach. In this case, Samsung’s context helped focus the analysis on its business. Together, they gave the team a more relevant starting point for deciding what to test. 

Speed matters, but so does reasoning

Samsung also showed how quickly PBX Ideate could turn that starting point into hypotheses. In just a few minutes it gave the team hypotheses they could test on the page. 

For a team maintaining an active testing roadmap, this offers a useful way to explore opportunities without beginning every analysis from scratch.

But rapid output is only part of the value. PBX Ideate explains and prioritises its recommendations, helping teams consider why a proposed experiment deserves attention. 

In this demonstration, the discount-messaging hypothesis received a score of 8.2 out of 10. That was a recommendation to assess, not evidence of a completed experiment’s performance. The practical benefit for the team is a clearer basis for discussion - a specific conversion concern, a proposed change and supporting reasoning.

Samsung’s experience was that they were able to dedicate more time on other activities of their roadmap. In turn this meant that PBX ideate supported the wider CRO process, rather than becoming an activity that consumed all of the team’s attention.

Better prepared for the next stage

The output of ideation needs to be useful beyond the analysis itself. A promising hypothesis should give the team enough clarity to decide whether to take it forward.

Within Kameleoon, PBX Ideate’s recommendations can be translated into prepared prompts for the next stage. For the Samsung team who were testing the same discount-messaging hypothesis, they were able to benefit from a pre-made prompt that only needed triggering. 

The significance of PBX Ideate is the quality of the handover. The analysis produces more than inspiration because it provides a structured opportunity that can move towards being implemented without the team reconstructing the idea from scratch.

That is what Samsung’s experience brings into focus. Lupine-powered PBX Ideate helps teams identify relevant opportunities, add the context that matters, understand the reasoning and keep their experimentation roadmap moving to the build stage. 

See how Lupine powers PBX Ideate.