Each of us generates data at any time of the day, and there is no difference if it does so in a professional or private capacity.
The pace is sustained and always increasing, so that 90% of the world’s data has been generated only in the last two years.
But the problem is not just quantity: if on average 2.5 quintilions of data bytes are generated every day, these are more distributed than ever, because they are generated in different places such as data centers on premise, public clouds or peripheral offices.
Every second on Google 40,000 searches are carried out, while every minute on YouTube 300 hours of video are uploaded.
This situation obbligates companies to face a situation that is not simple. As Filip Verloy, Cto Emea from Rubrik explains: • creating a link between their existing data islands can be a challenge. And creating a unified record system that acts as a single source of your data is the first crucial step to save time and devote yourself to more interesting activities.
Managing data is no longer enough
For Verloy, simple management is no longer enough. • If companies want to survive and thrive – explains • need a cloud data intelligence. The figures today are what oil represented in the last century, that is the most precious resource in the world, as the Economist has defined them. And for this reason, those who will prove themselves able to manage, govern and use them in an innovative way, will have the most favourable prospects looking to the future.
Even for cutting-edge companies, however, digging into their data can be a challenging task to undertake. It really needs to be understood whether your data is being used efficiently. Basically, data is needed to understand your data. That is, they need metadata.
In substance, metadata describe and provide information about their real data, for example where they are stored or with which applications they were created. • The adoption of a cloud data management platform that creates standard metadata allows companies to manage and analyze them on a large scale • • Verloy explains.
And that’s not all. Decisions can not only be automated with algorithms but can also establish a basic line of behavior, identify anomalies thanks to machine learning and make metadata smarter with artificial intelligence. •Fundamentally, a sophisticated and secure cloud data management platform is an essential basis, according to Verloy.
What can be the result?
For Verloy, the most obvious and immediate effects are the ability to radically improve the way the data is handled, a more efficient storage, and the certainty that the data is exactly where they should be.
Each advanced data management process must start from their analysis. What types of data there are in the company, which applications create them, which ones use them. By grouping similar data types, such as databases or file servers, you can deduplicate and store them more intelligently and conveniently on a global scale.
• This is a historically time-consuming and intensive process, conducted by analysts with specific skills • recalls Verloy -. Extensive adoption of metadata and their integration into a cloud data management system supports this process efficiently, intelligently and independently, contributing to a significant saving of storage space
The IoT factor
And another constantly growing data source is represented by IoT devices. For example, within production plants, machine sensors automatically generate huge amounts of data, often too numerous to be easily managed.
You need to find a way to automatically process excess data or to transfer it effectively to a more central point where you can perform processing. Metadata allow this data to be moved quickly and efficiently, thanks to the fact that you can immediately identify and manage them.
IoT devices are not the only ones that create data far from the center. More and more data is being created worldwide remotely and therefore it is difficult for organisations to move them intelligently, especially in cases where timeliness is needed.
As Verloy, •In Formula 1, our customer Mercedes-AMG Petronas Motorsport needs to transfer data from cars in the race to his analysis tools and send them back to a speed of 1.9 GB per second Thanks to metadata, critical data is catalogued and made immediately accessible, and then efficiently transferred wherever the team needs it.