37 days of NetSuite regression testing, done in under 6 hours
Lovehoney's NetSuite estate never stands still. For more than two and a half years, our automated end-to-end regression pack has tested every Oracle upgrade, new entity and system change before it reaches live.
The challenge
NetSuite sits at the centre of Lovehoney's technology estate. It connects to Salesforce Commerce Cloud, the warehouse and order management systems and finance, through Celigo integrations.
After go-live, the change kept coming:
- Two Oracle NetSuite upgrades a year, each able to break customisations, scripts and integrations.
- A new business entity brought onto the platform.
- Changes to the warehouse and order management systems, and to the WowTech processes.
- Tax rules that differ across US states, Canada and Europe.
- New manufacturing processes, gift vouchers and NetSuite performance improvements.
Every change needed a full end-to-end retest. Done by hand, that retesting lands on the same key people who run the business.
Our approach
- We also tested Lovehoney's NetSuite implementation. The regression pack we built then became the starting point for this service.
- Since go-live, we've run all of Lovehoney's NetSuite testing, from the fast follow releases straight after launch to every Oracle upgrade since.
- We maintain and extend the pack as the estate changes, so new entities, processes and systems are covered end to end, from storefront order to general ledger.
- A tax verification pack covers the tax periods and outcomes across US states, Canada and Europe.
- We process the transactions finance needs first. Finance still checks the outcomes, but doesn't spend days keying data.
- After every run, AI-generated dashboards give stakeholders real-time results, so go/no-go decisions rest on evidence.
Who owns it
Lovehoney owns the tests and the framework. We stay accountable for maintaining and extending them, and running them for every release.
Impact
- NetSuite upgrade 2026.2 regression tested in 5 hours 40 minutes. That's 1,645 tests, which would take an estimated 37 tester-days by hand, about £14.6k of effort every time.
- More than 547,000 automated test executions in the last 12 months.
- No live incidents caused by a NetSuite upgrade since the work began.
- Test coverage up 57% in 12 months, across storefront, NetSuite, order management and 3PL.
- Updates and new features deployed 75% faster.
- More than two and a half years of upgrades and change tested, and the service is still running.
Read the full case study
Find out how an automated regression service keeps NetSuite stable while everything around it keeps changing.
The two-page case study covers how we test every Oracle upgrade, absorb new entities and processes, and take the transaction load off finance.
547k automated tests run in the last 12 months
Under 6 hrs for a full NetSuite regression, against an estimated 37 days by hand
Zero live incidents from NetSuite upgrades since the work began
"The Spike team has demonstrated exceptional commitment towards Lovehoney's delivery, consistently maintaining their dedication even in the most challenging situations. This unwavering commitment is truly commendable and stands as a testament to their professional integrity. I would rate their performance extremely highly, as it paves the way for progressive thinking from a leadership standpoint. Their approach fosters innovation and sets a benchmark for others to follow."
How it started
We also tested Lovehoney's NetSuite implementation, connecting storefront, order management, warehouse and finance.
How long does your regression take?
Tell us about your estate and see how manual regression compares with automated end-to-end testing.
Not on NetSuite?
The platform here was NetSuite. The approach works for any ERP that has to keep up with constant change around it.