will warnock

auckland, nz

Data Strategy & AI

What I've found in my time working with New Zealand companies is that there comes a time when business data begins to matter. The crossover point into this mattering stage is two-fold. Data-related challenges and opportunities start to reveal themselves throughout your business.

If your business is anywhere near this stage, the below will be familiar and enticing to you.

Challenges Opportunities

Whether you've found yourself keen on mitigating data challenges, looking to leverage new opportunities, or a combination of both, what you're after is a data strategy. A good data strategy will allow you to derive significant value from the business data you already have and provide agility to adapt to a rapidly changing data landscape.

When I say data strategy, I'm not referring to the definition you'd find in a textbook. Rather, I mean have you asked yourself the question, how is my business data being stored and how do I retrieve that data? For many of the companies that I have worked with, the answer to the first part of this question is that their data is distributed across separate Inventory, Ecommerce, Accounting and CRM systems, all siloed by function. Given this, the task of retrieving data out of these systems is arduous and time-consuming, frequently consisting of running separate reports in each system, downloading large Excel files and then stitching these sources together with a barrage of anything-but-best-practice-formulas, lookups and highlighted cells. In many businesses, this mess of a final Excel file is referred to as the "Holy Bible" of the business due to how strongly the staff come to depend on it.1

Now a couple of years ago I'd tell you that the solution to this is simple: pipe your key data sources into a Business Intelligence/Analytics tool, build some reports, and call it a day. While this is where we want to end up, it's not how we get there. There are some challenges with storing all of your business data inside an analytics tool that are frequently not considered:

In each of these cases, there's significant time, cost and effort involved with switching analytics tools. You need to re-pipe all the data from your existing systems, clean the data, transform it and establish any relationships between tables so you can re-build your custom, charts, reports and dashboards.

Introducing the data warehouse. A central database that will serve as your one-stop shop for relevant business data. Big global enterprises have been using these for years, but with the opportunities associated with AI for business applications, any NZ company where their data matters should be utilising a data warehouse. Here are the perks:


Data Warehouse Diagram

How it works is that by instead of integrating your data directly to your analytics tool, it is synchronised to a centralised database either in the cloud (AWS, Azure, GCP) or on-premise (ok boomer). As an example, accounting data from Xero, inventory data from Cin7 and CRM data from Hubspot could all be integrated to flow into the data warehouse and be stored in their raw state. Then, with some transformations this data can all be joined together and structured into flat views like "Sales by Product", "Sales by Customer", "Aging Debtors" or "Marketing campaign opening rates". These views can then be synchronised to an analytics tool of your choosing. By centralising your data sources here, you can be confident that it is correct and consistent throughout your organisation whilst keeping ownership of it and having flexibility to use it how you wish. Some example scenarios that become possible through a data warehousing approach include:

Like most new technology advancements, speculators are likely overestimating what AI can do in the next two years, but underestimating its impact over the next decade. No one can predict the future of how this will shake out, but you can become ready for AI by adopting a data strategy for your business. Any AI application is only going to be as strong as the data you can provide to it, and if you're considerate and future thinking, then you'll be able to generate strong business value from AI in the future as it matures and evolves.




1I once discovered a miscalculation in a hefty "Bible" spreadsheet while converting it into a BI report. They were so accustomed to the quirks of its calculation that we had to reproduce the error in the new report so that it would be consistent with how they saw the world.