Now's the perfect time to learn about a graph database and how they can help you draw insight from disparate silos of data. Get a 360 view that traditional databases just can't deliver and learn why in this short video piece w. Mike Matchett of Small…
An IT industry analyst article published by SearchITOperations.
Small World Big Data
Have you noticed yet? Those geeky big data platforms based on clusters of commodity nodes running open source parallel processing algorithms are evolving into some seriously advanced IT functionality.
The popular branded distributions of the Apache projects, including Hortonworks, Cloudera and MapR, are no longer simply made up of relatively basic big data batch query tools, such as Hadoop MapReduce, the way they were 10 years ago. We’ve seen advances in machine learning, SQL-based transaction support, in-memory acceleration, interactive query performance, streaming data handling, enterprise IT data governance, protection and security. And even container services, scheduling and management are on a new level. Big data platforms now present a compelling vision for the future of perhaps all IT data processing.
Wait — do I really mean all IT data center processing will be big data processing? Most of us are just getting used to the idea of investing in and building out functional data lakes to capture and collect tons of unstructured data for business intelligence tasks, offline machine learning, active archive and other secondary data applications. And many are having a hard time making those data lake initiatives successful. It’s a challenge to develop staff expertise, assure data provenance, manage metadata and master implied schemas, i.e., creating a single version of truth.
…big data isn’t just for backroom data science geeks. The technologies involved are going to define the next-generation IT data center platform…
Many organizations may be waiting for things in the big data market to settle out. Unfortunately, especially for those more comfortable being late adopters, big data processing technology development is accelerating. We see use cases rapidly proliferate, and general IT manageability of big data streams (easing adoption and integration) greatly increase.
The universal big data onslaught is not going to slow down, nor will it wait for slackers to catch up. And those able to harness their big data streams today aren’t just using them to look up old baseball stats. They are able to use data to improve and accelerate operations, gain greater competitiveness and achieve actual ROI. I’m not even going to point out the possibility that savvy big data processing will uncover new revenue opportunities and business models. Oops, just did!
If you think you are falling behind today on big data initiatives, I’d recommend you consider doubling down now. This area is moving way too fast to jump on board later and still expect to catch competitors. Big data is proving to be a huge game changer. There simply won’t be a later with big data.
I’ve written before that all data is eventually going to be big data. I’ll now add that all processing is eventually going to be big data processing. In my view, the focus of big data technology has moved from building out systems of insight over trailing big data sets to now offering ways to build convergent systems of action over all data.
In other words, big data isn’t just for backroom data science geeks. The technologies involved are going to define the next-generation IT data center platform…(read the complete as-published article there)
Do you think you might need to storage multiple petabytes of data? Can you afford to not look at a solution that leverages commodity hardware while giving you control of how you scale depending on the type of data you have? Resilient, autonomic, highly…
Original video (with full player and complete transcript) posted at TruthInIT.com
Browse related videos on the Small World Big Data channel at TruthInIT
An IT industry analyst article published by Enterprise Storage Forum.
The Enterprise Storage Forum survey uncovered the biggest challenges storage professionals have with their existing storage infrastructure: aging gear, lack of capacity, high operations cost, security, maintenance burden. We’ll discuss which storage technologies available or coming soon might serve to ease those pain points.
Data storage has been around as long as computing, but based on the Enterprise Storage Forum survey, we have yet to solve all the problems. Entitled Data Storage Trends 2018, the survey reveals that storage professionals face no lack of serious concerns.
One of the interesting charts that jumped out at me is about the biggest challenge in operating current storage infrastructure. In essence, this is the “select your biggest pain” question. Let’s dive in.
Top Five Data Storage Challenges
Why are these ever-present data storage challenges? Why haven’t storage vendors researched technologies and nailed down solutions to solve them? This chart illustrates the leading pain points; we’ll look at the top five:
1. Aging gear: Of course, no matter when you invest in new equipment, it starts aging immediately. And once deployed, storage, and the data stored on it tends to sit in the data center until it reaches some arbitrary vendor end-of-life (EOL) stage. With working storage the motto tends to be – “If it’s not broke, don’t fix it!”
Still, once something like storage is deployed, the capex is a sunk cost. Aging storage should probably be replaced long before full obsolescence comes along; significant attribute improvements are likely available on the market at any large storage’s “half-life.” These include better performance and agility, cheaper operating costs and upgrades, increased capacity and new features.
Here, I can’t blame storage vendors for lack of improved storage offerings. From flash engineered designs to software-defined agility, the storage landscape is full of opportunistic (and large ROI) “refresh” solutions. Proactive storage managers might think to replace their storage “ahead of time” as the scales tip in favor of new solutions, rather than sit back and wait for the traditional “five year” accounting-based storage refresh cycle.
2. Lack of Storage Capacity: Yes, data is still growing. In fact, data growth can be non-linear, which makes it hard to plan ahead. Unable to keep up with capacity demand, many organizations now rely on that elastic storage provider, cloud, hybrid cloud or even multi-cloud storage services – which can get pricey!
We may be doomed to suffer this pain point forever, but some newer storage technologies are being designed to scale-out “for a long time” with linear performance…(read the complete as-published article there)
An IT industry analyst article published by Enterprise Storage Forum.
The Enterprise Storage Survey results show that the biggest storage budget line item is cloud storage, although HDDs still hold more data. We explore why cloud is inevitably winning, and when the actual tipping point might come about.
Is on-premise storage dead? Is all storage inevitably moving to the cloud? If you work in IT these days, you are no doubt keeping a close eye on the massive changes afoot in storage infrastructure these days. Flash acceleration, hyperconvergence, cloud transformation – where is it all going and how soon will it get there?
We explored the past, present and future of enterprise storage technologies as part of our recent Storage Trends 2018 survey.
The Dominance of Cloud Storage
The short story is that cloud storage has now edged out the ubiquitous hard drive as the top budget line item in IT storage spending (see below). We are not sure if this is good news or bad news for IT, but it is clear that those cloud-heavy IT shops have to get on top of and actively manage their cloud storage spending.
Despite having cloud move into the lead for slightly more than 21% of companies, the game is not over yet for on-premise storage solutions. Flash has still not run it’s full course and HDDs are still the top budget item today for almost as many companies (21%) as cloud.
New innovations in solid-state like NVMe are providing even greater acceleration to data center workloads even as SDD prices continue to drop. As silicon price drops, total spending inherently skews towards more expensive technologies – the footprint will grow even if the relative spend doesn’t keep pace…(read the complete as-published article there)