|By Peter Velikin||
|February 17, 2012 09:28 AM EST||
The SSD caching market is on fire. This week, EMC announced VFCache, IBM announced XIV Gen3 SSD Caching, Flashsoft was acquired by Sandisk, and many storage vendors acknowledged that flash features in their long-term roadmap. Activity has certainly picked up. It is interesting to explore what is causing the rapid development of the SSD caching market.
Here are my 4 key takeaways:
1. Flash has arrived
Reliability: Flash technology (particularly in the SSD form factor) has matured enough to be used in the 24/7 enterprise environments. Through a combination of more reliable SSD and better management of data on SSD, suppliers have managed to create solutions that, while expensive, provide the bullet-proof reliability required in enterprise environments.
Real results: Businesses have experienced the benefits of higher SSD IOPS in production environments. Higher SSD performance has translated to up to 10+ times improvement in performance for applications like databases (Oracle, SQL Server, MySQL, etc.), Financial analysis, research, simulation, modeling, enterprise search, E-commerce and social networking.
Enterprise Budgets: 2012 is the first year where IT teams have dedicated budgets for deploying SSD.
2. The storage industry has accepted that storage architectures will change
EMC’s launch of VFCache and similar announcements from other storage vendors show that the industry has accepted a paradigm shift in data storage. Gone are the days when all data was stored and served from fibre-channel SAN arrays. Storage arrays will continue to be used to consolidate data for backup and sharing, but performance will be driven by a layer of flash in the server that holds a copy of primary data. Chris Mellor’s article in The Register “Inside the Mind of EMC, Is Storage Just a Launchpad” and David FLoyer's article in Wikibon “Designing Systems and Infrastructure in the Big Data IO Centric Era” provide more details on the shift in storage architectures.
3. SSD caching offers an easier path to SSD deployment
SSDs offer many advantages over HDDs, including much higher I/O performance, lower power consumption, and non-volatile memory. However, SSDs are expensive and deploying SSD often disrupts existing data protection and data management infrastructures. Deploying SSD as a cache overcomes both limitations.
Lower Cost: By caching only important data on SSD and keeping primary data on lower-cost HDD, application performance can be increased at a lower cost
Non-Disruptive Deployment: When SSD is deployed as a cache, existing primary storage remains unchanged. There is no need to pause or change existing backup and data management infrastructure.
Best of both worlds:Deploying SSD as a cache provides the low latency and high performance of server-based SSD, while preserving the ability to uniformly protect and share primary data stored in the storage array.
4. SSD cache solutions will soon pack more intelligence
SSD is not just a faster disk: data is structured, accessed, and protected in a fundamentally different way in SSDs. Unfortunately, applications today are optimized for working with HDD and do not take into account the asymmetric read/write operations and SSD wear caused by write/erase operations. One can expect that over time applications will be re-written to account for the specific properties of SSD; however, the process of rewriting applications will be slow and is likely to drag over 10-15 years. SSD Caching software is a natural application translation layer that can optimize data for SSD.
Data optimization for SSD: The table below illustrates the asymmetric nature of SSD. Read speed is 10x faster than write speed and 80x faster than erase speed. Furthermore, erase operations wear down the SSD and shorten its life. An SSD performs best if the caching software structures data in a way that maximizes read operations and minimizes write and erase operations. SSD performance is also impacted by the structure and size of data blocks stored on SSD. Intelligent SSD caching software would structure data blocks in a way that optimizes SSD performance and reliability while minimizing cost and wear.
S per GB
Mean Time to Failure
3-50K erase cycles
Performance: Existing caching algorithms were developed for HDD and do not account for the asymmetric properties of SSD (the blog “Why Standard Cache Algorithms Won’t Work For SSDs” by Prof. Qing Yang, CTO of VeloBit, discusses this in further detail). As a result, when used with SSD, –existing caching algorithms do not perform well and shorten the life of SSD. New caching algorithms, designed with SSD in mind, can increase SSD performance by 3-5x relative to existing caching solutions and can enable use of less expensive SSD.
Data pattern intelligence: Tiering and caching solutions today prioritize data based on its recency or frequency of use and, as a result, are not very effective at predicting future data use. The intelligent SSD caching software of the future will self-tune based on the data pattern to maximize performance on every application.
What do you think about the recent wave of SSD announcements and acquisitions? Where do you think the industry is going?
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, will share examples from a wide range of industries – includin...
Dec. 6, 2016 05:00 AM EST Reads: 1,638
"We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Dec. 6, 2016 04:45 AM EST Reads: 989
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
Dec. 6, 2016 04:30 AM EST Reads: 1,923
"We're a cybersecurity firm that specializes in engineering security solutions both at the software and hardware level. Security cannot be an after-the-fact afterthought, which is what it's become," stated Richard Blech, Chief Executive Officer at Secure Channels, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Dec. 6, 2016 12:45 AM EST Reads: 843
According to Forrester Research, every business will become either a digital predator or digital prey by 2020. To avoid demise, organizations must rapidly create new sources of value in their end-to-end customer experiences. True digital predators also must break down information and process silos and extend digital transformation initiatives to empower employees with the digital resources needed to win, serve, and retain customers.
Dec. 6, 2016 12:30 AM EST Reads: 1,196
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
Dec. 6, 2016 12:30 AM EST Reads: 4,583
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Dec. 6, 2016 12:00 AM EST Reads: 889
"Once customers get a year into their IoT deployments, they start to realize that they may have been shortsighted in the ways they built out their deployment and the key thing I see a lot of people looking at is - how can I take equipment data, pull it back in an IoT solution and show it in a dashboard," stated Dave McCarthy, Director of Products at Bsquare Corporation, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Dec. 5, 2016 10:30 PM EST Reads: 1,059
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and sh...
Dec. 5, 2016 08:45 PM EST Reads: 523
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
Dec. 5, 2016 07:45 PM EST Reads: 2,231
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Onalytica. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.
Dec. 5, 2016 07:45 PM EST Reads: 2,094
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
Dec. 5, 2016 07:15 PM EST Reads: 416
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effici...
Dec. 5, 2016 07:15 PM EST Reads: 5,060
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
Dec. 5, 2016 05:45 PM EST Reads: 1,620
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, discussed the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
Dec. 5, 2016 04:30 PM EST Reads: 2,074
Successful digital transformation requires new organizational competencies and capabilities. Research tells us that the biggest impediment to successful transformation is human; consequently, the biggest enabler is a properly skilled and empowered workforce. In the digital age, new individual and collective competencies are required. In his session at 19th Cloud Expo, Bob Newhouse, CEO and founder of Agilitiv, drew together recent research and lessons learned from emerging and established compa...
Dec. 5, 2016 04:15 PM EST Reads: 870
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
Dec. 5, 2016 03:45 PM EST Reads: 398
"IoT is going to be a huge industry with a lot of value for end users, for industries, for consumers, for manufacturers. How can we use cloud to effectively manage IoT applications," stated Ian Khan, Innovation & Marketing Manager at Solgeniakhela, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
Dec. 5, 2016 03:45 PM EST Reads: 4,263
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
Dec. 5, 2016 02:45 PM EST Reads: 702
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
Dec. 5, 2016 02:45 PM EST Reads: 3,301