Octopus Energy reported higher customer satisfaction for its Arlo AI assistant than for comparable human replies in results published on 7th July 2026. The three-month UK trial covered routine enquiries representing 4% of customer emails, with sensitive and complex cases reserved for people. The findings are company-reported, not independently audited evidence of a wider improvement in customer service.
What happened
According to Octopus Energy’s trial announcement, Arlo handled around 8,000 emails a week. Customers gave its responses a satisfaction score of 76%, compared with 72% for comparable responses from human advisers — a difference of four percentage points.
The assistant answered straightforward questions about tariff renewals, payment dates and account details. This was a limited deployment within the supplier’s UK email service, rather than a test of whether AI could handle the full range of energy customer problems.
The release describes a three-month trial but does not give its exact start and end dates. The publication date therefore establishes when Octopus announced the results, not a precise testing window. The accompanying customer blog also refers to three months of testing, but the supplied text carries no publication date.
What does the satisfaction score show?
The comparison is encouraging within the work Arlo was assigned. It does not establish that the assistant would outperform staff on difficult complaints or cases involving vulnerable customers, because those enquiries were outside its remit.
Octopus does not explain how it selected the comparable human responses. Nor does the release disclose the number of satisfaction survey responses, the response rate or uncertainty around the scores. The weekly email volume is not the same as the number of customers who rated their experience.
Those omissions limit what can be concluded from the four-point difference. Readers cannot assess from the published material whether differences in the enquiries or the people responding to surveys affected the result. This is the distinction between a reported performance measure and a fully documented evaluation discussed in our coverage of the evidence gap in AI benchmarks.
The background
Arlo was built by Octopus’ technology team in partnership with Kraken and runs on the Kraken operating system, according to the release. The announcement also says Kraken had recently become independent of Octopus Energy Group, without giving a separation date.
The operational boundary is explicit. Octopus says Arlo does not handle vulnerable customers, sensitive cases or complex complaints. Those go directly to experienced customer service staff. Its role is to deal with simpler enquiries while energy specialists remain responsible for work requiring more judgement or personal support.
In its customer explanation of how Arlo works, Octopus says every AI-written email is identified as such. Customers can reach a person by replying to the message. That gives the customer an alternative to continuing an automated exchange, rather than leaving escalation solely to the assistant.
How much human oversight is involved?
The blog says human experts monitor Arlo’s messages for accuracy and usefulness, while the operations team works with its developers. It does not specify whether every message is checked, whether checks happen before or after sending, or how much staff time the process requires.
That distinction matters when assessing automation as a business investment. A system can take on customer-facing work while still requiring human checking and maintenance. The sources do not quantify that workload, a separate issue from the satisfaction score and one also examined in our reporting on AI translation and the remaining checking burden.
Octopus also presents Arlo as available outside normal working hours, including late at night and at weekends. Its blog gives one example in which the assistant answered a tariff question within a minute, listing the customer’s rates, standing charges and tariff end date. This is an illustrative company example, not a published average response time or an independently checked accuracy test.
What people are saying
Ashley Firth, Octopus Energy’s deputy chief technology officer, described the purpose of Arlo as removing repetitive work rather than replacing people. His stated aim was to leave specialists more time for conversations where their experience and empathy were needed.
The blog, written by the company’s head of operations, Inés, makes the same operational case through the types of support staff provide. It describes extended contact with vulnerable customers and referrals to the company’s social worker team. These examples explain why Octopus values staff availability; they do not measure additional support delivered because of Arlo.
The release includes two favourable customer accounts. Kelly, from Wales, said the information she received was accurate. Brenda, from Cheshire, said her query was answered quickly and gave her the information she needed. These are testimonials selected by Octopus, rather than a representative account of all trial participants.
The customer blog also acknowledges that Arlo will not be perfect from the outset. That qualification sits alongside the company’s positive assessment and its promise of continued monitoring. Neither source publishes an error rate, a breakdown of unsuccessful exchanges or the proportion of conversations passed to staff.
No independent evaluator or external customer representative is included in the supplied material. The evidence therefore supports reporting Octopus’ stated approach and measured satisfaction result, but not treating the release as an independent audit of service quality.
Murray Wilkinson, founder of Found Revenue, an AI business services provider with three UK locations, says results such as these tend to come from narrow, well-measured deployments rather than sweeping roll-outs, and advises smaller firms to agree a baseline before any trial so gains can be shown rather than assumed.
What happens next
At the time of its July 2026 announcement, Octopus said it planned to make Arlo available to more customers. The undated blog describes a wider rollout with continued monitoring. The supplied sources give no target share of emails, completion date or later performance results, so they do not establish how far that expansion subsequently progressed.
Does the trial demonstrate a financial return?
Neither source discloses development costs, running costs, savings or a return on investment. Octopus says handling simple enquiries gives specialists more time, but it does not quantify hours released or show changes in complaint backlogs. Email volume alone cannot establish a financial return.
The company’s stated intention is to support staff, not replace them. The sources provide no basis for calculating redundancies or converting the number of automated replies into an equivalent number of jobs. They also do not measure whether customers needed further contact after receiving an initial answer.
For businesses considering similar deployments, the unresolved question is whether the reported advantage holds as the service expands while retaining its exclusions and human support. Our coverage of NatWest’s voice AI test for customer spending queries examines another defined customer-service application. In Arlo’s case, wider-scale satisfaction, escalation workload and operating costs remain outside the published results.