Big Data Technologies describe a new generation of technologies and architectures, designed to economically extract value from very large volumes of a wide variety of data, by enabling high-velocity capture, discovery and/or analysis.
Well-known research company IDC, just published ten predictions about that big data technology on Jan 2012.
IDC’s 2012 Predictions:
1. Hadoop Goes Enterprise: Hadoop is traditionally positioned for social networking, online media and entertainment, and large e-commerce industries. As Hadoop matures, additional industries will accelerate production deployments
2. Many initial Hadoop projects will fail to gain broad adoption: Hadoop is still a young technology in the stage of proof-of-concept projects. In addition, Big Data projects need to tackle the not well-defined value proposition
3. New markets will emerge based on the capabilities of Big Data Technology: Data brokeraging – Trade of big data. Example: Telecoms would sell anonymous mobile location data to transportation infrastructure projects
4. Prevalence of open source software components masks the bigger revenue opportunity: Nevertheless, the commercial value proposition will be in the areas of application development tools, applications, services, and hardware
5. The number of Big Data appliances solutions will increase rapidly: Following prediction #4, additional DW, and NoSQL appliance solutions will hit the market to extract the value of big data from the hardware angle
6. M&A activity will pick up: First set of acquisitions was by large IT vendors that scaled their DW capabilities (Greenplum, Vertica, Netezza). The next set will be in the field of predictive analytics and visual discovery
7. The Market: Market will be reminded that Big Data isn’t all about batch processing but also of large amounts of weblog data that can be analyzed in real time
8. Shortage of highly skilled data scientists will persist: Opportunities for analytics as a service will expand. To compensate for the shortage, universities are beginning to introduce analytics curricula and graduate level degree programs.
9. Unified information access and analysis solutions will go mainstream: There will be a single platform to manage, access, and analyze multi-structured data. Such technology will be accompanied by capabilities of data integration, access, and analysis
10. Packaged analytic applications built on Big Data technology platforms will emerge: These applications will be customized by industry and content.