
By Jnan Dash | Article Rating: |
|
April 26, 2012 04:00 AM EDT | Reads: |
18,249 |

Big Data is a top technology trend for 2012 according to Forrester Research. The Economist said that Big Data is a new game changing asset and The Harvard Business Review termed it as a scientific revolution. Scientific Revolution? Because it is data-intensive computing to unify, theorize, experiment, and do simulation at scale.

Big Data is when the size of the data itself becomes part of the problem. But Big Data is not just “big”. There are the 3V’s of Big Data:
- Volume – Terabyte records, transactions, tables, files. A Boeing Jet engine spews out 10TB of operational data for every 30 minutes they run. Hence a 4-engine Jumbo jet can create 640TB on one Atlantic crossing. Multiply that to 25,000 flights flown each day and you get the picture.
- Velocity – batch, near-time, real-time, streams. Today’s on-line ad serving requires 40ms to respond with a decision. Financial services need near 1MS to calculate customer scoring probabilities. Stream data, such as movies, need to travel at high speed for proper rendering.
- Variety – structures, unstructured, semi-structured, and all the above in a mix. WalMart processes 1M customer transactions per hour and feeds information to a database estimated at 2.5PB (petabytes). There are old and new data sources like RFID, sensors, mobile payments, in-vehicle tracking, etc.
Because of these characteristics, traditional DBMS solutions are inadequate. Hence we have seen the growth of technologies such as Hadoop (map-reduce algorithm started at Google) mostly processing unstructured data in batch mode. New solutions are needed for realtime processing.
See my blog from last year on this subject.
Published April 26, 2012 Reads 18,249
Copyright © 2012 SYS-CON Media, Inc. — All Rights Reserved.
Syndicated stories and blog feeds, all rights reserved by the author.
More Stories By Jnan Dash
Jnan Dash is Senior Advisor at EZShield Inc., Advisor at ScaleDB and Board Member at Compassites Software Solutions. He has lived in Silicon Valley since 1979. Formerly he was the Chief Strategy Officer (Consulting) at Curl Inc., before which he spent ten years at Oracle Corporation and was the Group Vice President, Systems Architecture and Technology till 2002. He was responsible for setting Oracle's core database and application server product directions and interacted with customers worldwide in translating future needs to product plans. Before that he spent 16 years at IBM. He blogs at http://jnandash.ulitzer.com.
![]() Aug. 16, 2017 03:45 AM EDT Reads: 1,675 |
By Pat Romanski ![]() Aug. 16, 2017 03:15 AM EDT Reads: 1,482 |
By Liz McMillan ![]() Aug. 16, 2017 02:00 AM EDT Reads: 1,887 |
By Elizabeth White ![]() Aug. 16, 2017 02:00 AM EDT Reads: 1,662 |
By Liz McMillan ![]() Aug. 16, 2017 01:30 AM EDT Reads: 840 |
By Pat Romanski ![]() Aug. 16, 2017 01:15 AM EDT Reads: 1,035 |
By Elizabeth White ![]() Aug. 16, 2017 12:15 AM EDT Reads: 2,120 |
By Liz McMillan ![]() Aug. 15, 2017 11:00 PM EDT Reads: 905 |
By Pat Romanski ![]() Aug. 15, 2017 10:45 PM EDT Reads: 2,138 |
By Liz McMillan ![]() Aug. 15, 2017 10:15 PM EDT Reads: 6,369 |
By Pat Romanski ![]() Aug. 15, 2017 10:00 PM EDT Reads: 2,017 |
By Yeshim Deniz ![]() Aug. 15, 2017 09:45 PM EDT Reads: 3,509 |
By Elizabeth White ![]() Aug. 15, 2017 09:15 PM EDT Reads: 995 |
By Liz McMillan ![]() Aug. 15, 2017 08:45 PM EDT Reads: 1,490 |
By Elizabeth White ![]() Aug. 15, 2017 07:30 PM EDT Reads: 1,802 |
By Elizabeth White ![]() Aug. 15, 2017 07:30 PM EDT Reads: 1,111 |
By Liz McMillan ![]() Aug. 15, 2017 07:30 PM EDT Reads: 2,451 |
By Elizabeth White ![]() Aug. 15, 2017 07:30 PM EDT Reads: 998 |
By Pat Romanski ![]() Aug. 15, 2017 07:30 PM EDT Reads: 1,670 |
By Elizabeth White ![]() Aug. 15, 2017 07:15 PM EDT Reads: 6,614 |