Why unstructured data is the future of data management, According to Venture Beat Enterprises are increasingly counting on unstructured data for regulatory, analytic, and decision-making purposes. Unstructured data will power analytics, machine learning, and business intelligence.
According to the newest figures from research firm ITC, the quantity of unstructured data is about to grow from 33 zettabytes in 2018 to 175 zettabytes, or 175 billion terabytes, by 2025. There has got to be some quiet data management so organizations have the proper quiet data available at the proper time. Krishna Subramanian, president, and COO of Komprise, a knowledge management software provider, sat down with VentureBeat to debate the business benefits and challenges related to unstructured data.
Venturebeat: Does the typical enterprise IT organization skills much-unstructured data they need and the way fast it’s growing?
Krishna Subramanian: Intuitively they know tons are unstructured and it’s growing in double digits, but they don’t know exactly what proportion they need and the way fast it’s growing. we all know that 80-90% of the world’s data is unstructured.
Venturebeat: What’s the problem with this data growth — there is now endless cloud storage after all, right?
Subramanian: the large issue is that the cost – over two-thirds of the value of knowledge isn’t within the storage, but in its active management. for each piece of knowledge, companies typically keep a couple of backup copies and a replication copy for disaster recovery. If you think that your data is growing at 30%, it’s more like 90-100% once you think about all the copies of the info. It’s also knowing to consider that cloud storage isn’t necessarily cheaper. as an example, AWS itself today offers over 16 tiers of unstructured file and object storage. If you don’t put your data within the right place and control egress costs, you’ll find yourself paying quite if you were storing it on-premises because whenever you even read the info you’ll be charged. The key here is that over 80% of knowledge isn’t actually actively accessed and is cold. This cold data are often stored on cheaper storage and doesn’t require an equivalent level of backup and replication. Therefore, you would like to manage hot data that’s actively used and cold data that’s rarely used differently. As only one example, Pfizer researchers generate between 8TB and 10TB each day, and that they were running out of data center space. They were ready to use a knowledge management product to spot the cold data and eliminate it from their expensive storage, backups, and replication by moving it to lower cost-resilient storage within the cloud and taking it out of active management. the corporate aroused cutting 75% of their data storage and backup costs, all without users having to note any change. What’s hard about data growth is that tons of organizations don’t wish to delete data. You never know once you might need it. And once you do, you would like to be ready to find it easily. And users and applications shouldn’t need to change their behavior once you move data around. within the past, with archiving to tape, that wasn’t possible, but now it’s with cloud storage and with data management software.
Venturebeat: Why is it important to be strategic about how you manage it, store it — isn’t it just about making sure you can find it for the BI team?
Subramanian: Today, data may be a valuable corporate asset. You’ve needed to be strategic with it because it’s not only for your BI teams, except for the R&D and customer success teams. they have historical data to create new products or to enhance those they have already got. this is often super relevant in manufacturing, like within the semiconductor chip industry, but also in other industries that are so important to our economy, like pharmaceuticals. COVID researchers depended upon access to SARS data when developing vaccines and coverings. Data often become valuable again later, and what if you don’t know what you’ve got otherwise you can’t find it? We’ve had customers within the media and entertainment business, and within the past, once they wanted to seek out an old show, they’d need access to a tape archive. Then, they needed an asset tag to locate the tape. which will be very difficult, and it’s why archiving isn’t popular. Live archive solutions that are available today make archived data instantly accessible and transparently tier data so users can easily locate files and access them anytime.
More Q/A could be read on Venture beat