Survey: Data warehouses in no danger from Hadoop

A recent survey by Dimensional Research found that data warehousing is still considered a critical business component, in spite of its challenges of scalability and cost. Seventy-two percent of respondents said they expected to increase their investment in data warehousing, and few reported experimenting with big data and Hadoop.

The State of the Data Warehouse survey asked 319 individuals in public and private sector organizations with responsibility for data initiatives about their experiences, challenges and trends in data warehousing and data analytics.

Interest in big data is high, with 91 percent of respondents indicating they’ve considered an investment, but only 11 percent of respondents have a pilot in place, and just 5 percent have fully deployed a big data initiative. One of the big data roadblocks might be Hadoop, with an overwhelming majority of respondents expressing concerns, specifically about access to expertise.

"Hype has created confusion about what is really happening with big data initiatives," said Diane Hagglund, principal at Dimensional Research. "Although interest in big data is high, this study found that big data initiatives and Hadoop have not diminished the importance of the data warehouse -- data warehousing remains critically important and will not be replaced by Hadoop."

Almost two-thirds of survey participants have data in the cloud – either in SaaS applications like or in public infrastructure clouds like Amazon AWS.  And among the companies with data in the cloud, 79 percent said they are bringing at least some of it into a data warehouse. Only 9 percent are migrating all cloud data into the data warehouse.

Other findings include:

  • 70 percent are increasing their investment in data warehousing;
  • 96 percent say Hadoop will not replace their existing data warehouse; and
  • 32 percent have a cloud-based data warehouse today.

The full survey results are available here.

About the Author

Connect with the GCN staff on Twitter @GCNtech.


  • 2020 Government Innovation Awards
    Government Innovation Awards -

    21 Public Sector Innovation award winners

    These projects at the federal, state and local levels show just how transformative government IT can be.

  • Federal 100 Awards
    cheering federal workers

    Nominations for the 2021 Fed 100 are now being accepted

    The deadline for submissions is Dec. 31.

Stay Connected