There are two sides to almost every part of cloud, and for me, one of the biggest two sided coins is data mining. It’s impossible to exist in any form online without mass amounts of data being tracked and mined in the back-end. It’s a scary thing. While there are great free services like Google and Facebook, we all know that in return for these services we pay with our privacy. Other companies pay these service providers to make me a target for their ads based. And with more and more software and services placed in the cloud, the desire for companies to leverage these services as a source of data to help drive revenue will become more invasive. But there is an upside (in my opinion) to data mining, an upside that could help mankind advance through leaps and bounds. This upside is in science. Continue reading
As more and more organizations start looking at Big Data analytics as a method to gain better business intelligence capabilities to their large databases, another question seems to come up. The question is how can you transition your current network storage, SANs, NAS etc, to support Big Data when they inherently can’t deal with terabytes or even petabytes of unstructured data. It is from this that we are seeing new methods for dealing with large volumes of data that might indeed result in a new storage platform design. Continue reading
Over the weekend I was chatting with a friend of mine who was asking about what kind of jobs I thought would be in high demand in the next few years. At some point we were talking about LINUX and the “Grep” command, particularly it’s usefulness to find a text variable in a data file. Could it be that Grep was the forefather of Big Data? In either case, I made the point that if she wanted to be in a field that would be in significant demand, Big Data is going to be (no pun intended) big. Continue reading
Do you feel like no matter how much you invest in IT security, you are losing the battle? There has been a lot of talk that security specialists are facing an uphill battle for the foreseeable future thanks to the speed of mobile device evolution and cloud development. Personally, I feel the pain of security folks. Virtualization has made things more complicated, and now with tablets and smartphones, it’s never going to return back to the network security days. But there is something that cloud is bringing to security that will make it easier for security folks, and that is Big Data. Continue reading
I wrote a few weeks back about the theme of Big Data and organizations such as EMC’s GreenPlum and Apache’s Hadoop ushering the way for the application of large data in cloud environments. It reminds me about the debate years ago on whether we would ever see a paperless society, which we realized sadly isn’t going to happen. Data just seems to compound and we cannot begin to imagine how the rates of data usage and creation will increase.
But in order to embrace big data, we need to figure out the barriers to adoption. David Asprey, a regular on the cloud expo circuit, notes that there are 2 key elements missing in the log management space right now: real scalability and security. Continue reading