Skip to main content

Computational storage


Computational storage is an information technology (IT) architecture in which data is processed at the storage device level to reduce the amount of data that has to move between the storage plane and the compute plane. The lack of movement facilitates real-time data analysis and improves performance by reducing input/output bottlenecks.

In many respects, a computational storage device may look just like every other solid state drive (SSD). Some products have a large number of NAND flash memory devices that actually store the data, a controller that manages writing the data to the flash devices and random access memory (RAM) to provide a read/write buffer. What is unique about computational storage devices is the inclusion of one or more multi-core processors. These processors can be used to perform many functions, from indexing data as it enters the storage device to searching the contents for specific entries to providing support for sophisticated artificial intelligence (AI) programs.

Computational storage products and services are starting to appear on the market and the ability to integrate them is still in the early stages of development. However, with the growing need to store and analyze data in real-time, the market is expected to grow very quickly. As of this writing, computational storage can be implemented by using one of two key products currently being defined by the Storage Networking Industry Association (SNIA) Computational Storage Technical Working Group (TWG):

  • Computational Storage Drive (CSD): a device that provides compute services in the storage system and supports persistent data storage -- including NAND flash or other non-volatile memory.
  • Computational Storage Processor (CSP): a device that provides compute services in the storage system, but cannot store data on any form of persistent storage.



The ability to provide compute services at the device level was not truly available until the adoption rate of SSDs was in place, because traditional storage devices like hard disk drives (HDD) and tape drives are not able to process the data locally like an intelligent computation storage is capable of doing.

Why computational storage is important

Traditionally, there has always been a mismatch between storage capacity and the amount of memory that the central processing unit (CPU) uses to analyze data. This mismatch requires that all stored data be moved in phases from one location to another for analysis, which in turn prevents data analysis from being real-time. Using these products, the host platform has the ability to deliver application performance and results from the storage system without requiring all data to be exported from the storage devices into memory for analysis.

Computational Storage is important in modern architectures today due to the continued growth of the raw data being collected from sensors and actuators in the Internet of Things (IoT). Traditionally, there has always been a mismatch of storage capacity (TB of storage data) and the amount of memory (GB of DRAM) that the CPU used to analyze data. This mismatch requires that all stored data be moved from one location of large size in products like SSDs to a smaller location in memory or DRAM in phases. Due to this phased approach, the time required to complete analysis of data was no longer real-time. By providing compute services at the storage device level, the analysis of the raw data can be completed in place and the amount of data moved to memory is mitigated into a manageable and easy to process sub-set of the data.

The ability to scale storage without having to be concerned about latency is an important consideration for hyperscale computing data centers that are trying to manage all the stored data from companies using public cloud services, to the dedicated data centers for social media platforms storing images and updates, as well as data centers that are managing media and entertainment needs for data streaming. Additional use cases for computational storage include edge computing or Industrial IoT environments in which too much latency can be literally cause an accident, and the need to conserve space and power are even more important.

Comments

Post a Comment

Popular posts from this blog

Understanding the Evolution: AI, ML, Deep Learning, and Gen AI

In the ever-evolving landscape of artificial intelligence (AI) and machine learning (ML), one of the most intriguing advancements is the emergence of General AI (Gen AI). To grasp its significance, it's essential to first distinguish between these interconnected but distinct technologies. AI, ML, and Deep Learning: The Building Blocks Artificial Intelligence refers to the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. Machine Learning, a subset of AI, empowers machines to learn from data and improve over time without explicit programming. Deep Learning, a specialized subset of ML, involves neural networks with many layers (hence "deep"), capable of learning intricate patterns from vast amounts of data. Enter General AI (Gen AI): Unraveling the Next Frontier Unlike traditional AI systems that excel in specific tasks (narrow AI), General AI aims to replicate human cognitive abilities across various domains. I...
Post a Comment
Read more

Normalization of Database

Database Normalisation is a technique of organizing the data in the database. Normalization is a systematic approach of decomposing tables to eliminate data redundancy and undesirable characteristics like Insertion, Update and Deletion Anamolies. It is a multi-step process that puts data into tabular form by removing duplicated data from the relation tables. Normalization is used for mainly two purpose, Eliminating reduntant(useless) data. Ensuring data dependencies make sense i.e data is logically stored. Problem Without Normalization Without Normalization, it becomes difficult to handle and update the database, without facing data loss. Insertion, Updation and Deletion Anamolies are very frequent if Database is not Normalized. To understand these anomalies let us take an example of  Student  table. S_id S_Name S_Address Subject_opted 401 Adam Noida Bio 402 Alex Panipat Maths 403 Stuart Jammu Maths 404 Adam Noida Physics Updation Anamoly :  To upda...
Post a Comment
Read more

How to deal with a toxic working environment

Handling a toxic working environment can be challenging, but there are steps you can take to address the situation and improve your experience at work: Recognize the Signs : Identify the specific behaviors or situations that contribute to the toxicity in your workplace. This could include bullying, harassment, micromanagement, negativity, or lack of support from management. Maintain Boundaries : Set boundaries to protect your mental and emotional well-being. This may involve limiting interactions with toxic individuals, avoiding gossip or negative conversations, and prioritizing self-care outside of work. Seek Support : Reach out to trusted colleagues, friends, or family members for support and advice. Sharing your experiences with others can help you feel less isolated and provide perspective on the situation. Document Incidents : Keep a record of any incidents or behaviors that contribute to the toxic environment, including dates, times, and specific details. This documentation may b...
Post a Comment
Read more