So finally I’ll be writing something I came here for. Something related to IT/Technology/Computing, something which is a buzzword in the IT industry nowadays “Big Data” (although the concept came around in 2012 or so). Now, if have heard about it and knows exactly what it is – great you are up to date when it comes to technology, but if you haven’t don’t worry I’ll tell what it is. And believe me I’m going to put in the most understandable way, so if you are not from the IT background you might be able to understand what exactly it is.
It is used to describe a massive volume of data that is so large it is difficult to process it, using the traditional database and software techniques.
(Image source: blog.gartner.com)
In other words to maintain the data this huge it is really difficult for the present software and databases to do so. i.e. the data is in Petabytes (1024 Terabytes, where 1TB=1024GB) or Exabyte (1024 petabytes), which is pretty voluminous, like for example in 1TB you can store up to approximately 217 movies, considering a movie to be of 4.7GB(equivalent to a DVD). Now in a Petabyte you can store up to 1024 times 217 which will be 222,208 movies, don’t you think that is really something and it even get worse in Exabyte it’s 1024 times 222,208 which will be 227,540,992, like really that much… I doubt if there will be that much of movies made (on digging it deeper I found out that I was right it is nowhere near that number even after including the TV titles as well the number was ‘3,369,526‘. Don’t believe me… Check it here.). Whatever, I guess you are getting at what I’m trying to explain here, it indeed is HUGE. And it will continue to increase, as every day and every minute new people join in on the networks – the internet – they share, they post, they tweet, they blog, resulting in generation and transferring of more and more data every day, every minute, every second. So to avoid mishandling and wrong interpretation of such a voluminous data, we have had to find new ways to process, store, capture, curate and manage it.
I guess I’ll leave it here for now because it’s a little hard to digest… but if you feel like you want to know more don’t worry I’ll be posting the other part as well and will be tomorrow. Where I’ll tell you what are the characteristics and ways to process “BIG DATA”. So stay tuned if you like it.
I guess that’s all for now, I don’t want you to feel bored, but if you feel like you didn’t get what I meant to say or any other issue, do lemme know in the comments. I’ll be glad.