Nov 19, 2005

Data Warehousing for Small Business

Recently, Tom Foydel responded on my post on Data Warehousing for the Rest of Us. He brings up a couple of ideas that I would like to respond to. First:

But if I am a small or medium sized business then I probably don't have the volume of transactions that make a Data Warehouse necessary. With my volume of transactions I ought to be able to use a business analytics tool that's part of my ERP/CRM system.

Tom, you have a great point here. I honestly believe that a business has to have a reason to build a data warehouse before building one. I know that sounds overly simple and ridiculous, but you see this mentality all the time in IT. If your ERP/CRM analytics tools are adequate for your business then there is no reason for having a data warehouse. I think that principle needs to be taught to most techies in general, if you don't need it - don't build/buy it.

On the other hand, there are many small to mid-sized businesses that do have the volume of transactions that warrant a data warehouse. But, it's not just volume that counts. As soon as the business needs to start performing analytics across multiple disparate data sources a data warehouse of some kind and size is probably going to be necessary. This is the area that I am referring to when I say that the big boys have left us out. There really isn't anything out there, that I have found, that addresses this problem.

My other comment is that large business that have data warehouses have not fared very well lately. Some smart people like Peter Drucker have noted that small and medium sized business are growing today, but large businesses are mostly stuck in neutral. Are data warehouses necessary? Do they really propel growth?

Another GREAT point. Yes, it is true that even the big boys have many data warehousing woes as well. It just goes to show how immature data warehousing still is. I believe the reason businesses question the value of warehouses is because of poor alignment between the business and the warehouse. Companies may spend millions trying to get a data warehouse together only to find that it doesn't bring any of the promised value.

I personally believe that data warehouses can propel growth. They can do this at the large scale and the small scale if they are built with properly aligned business objectives. Businesses that don't have any plans to utilize the analytics to make business decisions will just end up producing a bunch of "gee-wiz" reports that don't bring any business value. Companies that allow the reporting and analytics to drive decision making will be able to utilize the power of the data warehouse to propel growth.

2 comments:

NLBarker said...

Good comments mike. One thing I believe people miss is the difference between Developers and BI/Reporting. In small companies/businesses most are left in some of the following areas:
0. The good old human parser. You manually collect the data and organize it.
1. Little to no reporting ability except what the developer will allow to show.
2. Hey crystal or similar product that can connect to developer friendly databases. This does not always lend itself to very good analysis most times.
3. A small datamart of sorts that lends itself to more comprehensive BI.

Of course from here you really bleed over to the bigger world.

I have played both sides of this fense. I believe in hind site I would in any business in the future create a small datamart that has been made BI/reporting friendly and make it automated and very managable. It really doesnt matter what tool you use it matters that you just do it. I believe what mike is really after is an attitude. My thought is "What is data good for if you dont use it?" Unfortunately many groups fall into this realm. Sometimes they dont even realize it. Anyway enough said. Thanks Mike for all the good ideas and thoughts.

jake george said...

Data Warehousing Online Training, ONLINE TRAINING – IT SUPPORT – CORPORATE TRAINING http://www.21cssindia.com/courses/data-warehousing-online-training-29.html The 21st Century Software Solutions of India offers one of the Largest conglomerations of Software Training, IT Support, Corporate Training institute in India - +919000444287 - +917386622889 - Visakhapatnam,Hyderabad Data Warehousing Online Training, Data Warehousing Training, Data Warehousing, Data Warehousing Online Training| Data Warehousing Training| Data Warehousing| "Courses at 21st Century Software Solutions
Talend Online Training -Hyperion Online Training - IBM Unica Online Training - Siteminder Online Training - SharePoint Online Training - Informatica Online Training - SalesForce Online Training - Many more… | Call Us +917386622889 - +919000444287 - contact@21cssindia.com
Visit: http://www.21cssindia.com/courses.html"