How avatarin built a 24/7 retail agent with GPT-Realtime
Quick Answer
avatarin developed a 24/7 multilingual retail agent using OpenAI's GPT-Realtime, enabling natural voice conversations and achieving 92% positive feedback from 30,000 users in two weeks.
Quick Take
This AI agent enhances customer service by understanding context and proactively guiding shoppers through their purchasing journey.
Key Points
- 30,000 users engaged with the AI agent in a two-week campaign.
- The agent achieved 92% positive survey responses from users.
- It combines voice, text, and visual understanding for seamless interaction.
- Conversations revealed customer insights previously hard to capture.
- avatarin aims for a unified AI experience across all customer interaction channels.
DeepSignal Analysis
What happened
avatarin has developed a 24/7 multilingual retail agent using OpenAI's GPT-Realtime, which allows for natural voice conversations. In a two-week campaign, the agent received positive feedback from 92% of approximately 30,000 users, demonstrating its effectiveness in enhancing customer service.
Key evidence
- avatarin partnered with Yamada Holdings to create a shopping agent that operates around the clock, addressing the need for expert sales support outside of store hours.
- The agent was used by around 30,000 people in a public campaign, with 92% of survey responses indicating positive experiences.
- The technology combines voice, text, and visual understanding, allowing the agent to adapt to customer needs and provide relevant recommendations.
Why it matters
This development highlights the potential of AI to transform customer service in retail by providing continuous support and personalized interactions. The high satisfaction rate suggests that consumers appreciate the ability to engage with an intelligent system that understands their context and preferences, potentially leading to improved sales and customer loyalty.
What to watch
📖 Reader Mode
~5 min readJapan’s home-appliance retailers face a persistent challenge: extending expert sales support beyond store hours while staffing remains tight. avatarin, an AI customer service company spun out of ANA Holdings, partnered with Yamada Holdings to turn experienced associates’ knowledge into a 24/7 multilingual shopping agent.
Built on OpenAI’s GPT‑Realtime, the Kurashi-Marugoto AI Agent supports natural voice conversations and guides shoppers from product discovery to purchase decisions. In a two-week public campaign on Yamada Denki’s online store, approximately 30,000 people used the agent; 92% of survey responses were positive.
“This is not an extension of the conventional chatbot. It is an attempt to expand what customer service can be with AI. We see it as the beginning of an ‘interface revolution’ in retail.”
Akira Fukabori, CEO, avatarin
From answering questions to understanding people
avatarin had worked with OpenAI well before the Yamada Denki project, using the OpenAI API for speech recognition, inquiry analysis, and employee training. Those earlier efforts helped the team understand what it takes to apply AI in practice. The shopping agent was its first major opportunity to bring those lessons directly to customers.
For Fukabori, one of the key advantages of GPT‑Realtime was the ability to bring voice, text, and visual understanding together within a single conversational experience.
“For us, the performance of a single model went beyond what we had seen from specialized speech recognition systems. It can work across speech, text, and images with low latency. That is why we chose GPT‑Realtime. Instead of asking people to adapt to the rules of a machine, the technology can adapt much more naturally to the way people communicate.”
A conventional chatbot waits for the right keyword. avatarin’s agent listens for context instead. It can respond to a shopper’s uncertainty, changing preferences, and the details that turn a generic answer into a useful recommendation.
Fukabori describes the difference with an everyday shopping problem.
“Customers do not want a chatbot. They want intelligence. ‘I need a refrigerator for a family of four, but my kitchen is small. Which one should I choose?’ Real customer service means being able to answer that question.”
Giving retail expertise a voice
avatarin designed the agent around three essential qualities:
- Keeping product information accurate without slowing the conversation.A retrieval-augmented generation system grounds the agent’s responses in product information, while GPT‑Realtime keeps the interaction responsive. This allows shoppers to have a fluid voice conversation while still receiving information based on relevant product data.
- Translating Yamada Denki’s sales expertise into conversation design.The information a sales associate needs to gather varies significantly by product category. avatarin incorporated Yamada Denki’s customer service knowledge into the agent’s conversation flows and prompting. The system is designed to adapt when customers change their requirements or move temporarily off topic, while guardrails help keep the conversation focused on the shopping experience.
- Designing an agent that asks, rather than only answers.Many traditional chatbot experiences wait for the customer to provide the next instruction. avatarin took a more proactive approach. The agent asks follow-up questions to uncover the customer’s actual needs, helping move the conversation from a simple question-and-answer exchange toward guided product discovery.
OpenAI worked with avatarin to structure complex prompts, optimize API costs for always-on voice service, and share implementation best practices. That support helped avatarin focus on translating Yamada Denki’s service model into an experience that felt accurate, responsive, and distinctly on-brand.
“I’m excited by how naturally it understands our intentions,” Fukabori says, “and by glimpses of intelligence that sometimes go beyond what people can do.”
When a conversation becomes an insight
The public campaign made the impact visible in just two weeks:
- Approximately 30,000 users
- 24/7 multilingual support by voice and text
- 92% positive survey responses
The most important discovery was not the scale alone. Every conversation revealed what shoppers cared about, why they hesitated, and what might help them decide. “With conventional online shopping, those insights were difficult to see,” Fukabori explains. “With an AI agent, they become part of the conversation.”
The service also opened new moments for retail. Customers could ask questions after stores closed and speak candidly about budgets or uncertainty without feeling sales pressure.
Each conversation ended with a short voice survey, making feedback a natural continuation of the shopping experience.
Customers described the agent as “easier to talk to than an actual sales associate” and appreciated being able to ask questions again without feeling stressed.
For avatarin, the implication reaches beyond the sale. A better conversation can also reveal how to improve service, marketing, and the next customer experience.
One Intelligence. One Brand. Every interface.
avatarin envisions a world where a single AI agent serves customers seamlessly across the web, phone, and physical stores. Instead of separate systems for each channel, the same intelligence carries the customer’s context forward. The result is continuity: one customer, one conversation, and one brand, wherever the interaction takes place.
For Yamada Holdings, whose businesses span home appliances, housing, financial services, and more, that vision could make AI a trusted companion across everyday life. The ambition is not just to connect channels, but to create AI that embodies the company’s brand and spirit of hospitality.
OpenAI’s technology is helping accelerate that vision. “AI has clearly shifted into a higher gear,” Fukabori says. “I can’t wait to see what we can build with this extraordinary intelligence.”
But avatarin does not want every company to sound the same. “We want people to experience one intelligence that embodies each company’s identity and brand across every interface. That is what we mean by ‘One Intelligence. One Brand. Every interface.’ The era of single purpose AI is over. I believe OpenAI will lead the next era of general purpose, multimodal intelligence.”
— Originally published at openai.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from OpenAI Blog
See more →Scientific computing in the age of agentic AI
AI agents are transforming scientific computing by streamlining software development, enabling researchers to focus on discovery. Projects using Codex and Claude Code report accelerated development and improved maintenance, though challenges in validating AI outputs remain. Long-term stewardship of research software is crucial to ensure reliability and reproducibility.