Welcome!

Recurring Revenue Authors: Yeshim Deniz, Elizabeth White, Xenia von Wedel, Liz McMillan, Carmen Gonzalez

Related Topics: Containers Expo Blog, Microservices Expo, Open Source Cloud

Containers Expo Blog: Blog Feed Post

Using RAM in SSD Caching

Dr Dog Says “You Need More RAM In Your Cache Diet”

Dr Dog Says “You Need More RAM In Your Cache Diet”
Well, I am not really a doctor, but I play one on TV. You may remember (if you are old enough) that line from the 1986 Vicks-44 TV commercial.  Anyway, while I may not be a real doctor, I can certainly tell you about why you need more RAM in you cache diet.

“I Think My Cache Diet Is Great”
If you were happily running your IT system but needed some additional performance, chances are you turned to some kind of SSD caching solution to improve performance at a lower cost point than adding more servers or storage. You went on what I am calling a “cache diet” (no, not the “crash diet” you went on last year to lose a few lbs).  You may think your cache diet is great.  “Dog, we got some performance improvement and the applications guys are not bothering me anymore, at least for now.”  And it is true, you did see some performance improvement when you went to an SSD caching solution….but now, things are starting to slow down again and the applications guys are making noise again. You are experiencing IO bottlenecks and higher latency times for data access or you just never really got all the improvements you expected. “So what do I do now, Dr. Dog?”  Well, the problem is the SSD cache solution you implemented does not have any RAM in it and the solution from the good doctor is “you need more RAM in your cache diet.”

We Call It “Hybrid Caching”
SSD caching is a combination of an SSD device and SSD caching software.  It is being sold by many vendors and comes in many flavors.   It can be installed in many different locations in the computer system storage architecture.  This was discussed in a recently posted blog where the pros/cons of each location were discussed.  What was not talked about in that blog, however, was what types of caching algorithms actually used RAM as part of their solution.  At Velobit, we use a combination of SSD and RAM to implement our SSD caching software; a solution we refer to as “hybrid caching.”

“So What Does More RAM In My Cache Diet Actually Do?”
“Doctor” Dog shall explain: Using RAM with SSD cache hardware makes the life of the SSD better.  Even a small amount of RAM is effective in reducing IO loads on the SSD.  Obviously, if RAM is used for cache, a RAM cache hit is going to respond faster than any SSD and frees the SSD to perform other essential tasks such as garbage collection and complete pending writes.  SSDs perform poorly with mixed read/write IOs. A RAM cache helps limit mixed writes/reads, improving SSD performance and overall cache performance.

Velobit HyperCache SSD caching software uses RAM efficiently so even a small amount of RAM allocated to caching can impact performance.  Velobit uses compression algorithms based on content locality caching to reduce the amount of physical data stored in RAM.  The impact of this is to effectively increase the virtual cache size without dedicating excessive RAM resources to cache. And, while some file system caching software can use RAM to improve performance, those techniques do not use data compression to maximize the performance of the allocated RAM.

Finally, using RAM in the caching algorithm allows the Velobit SSD caching software to do selective SSD writes – it does not write data to the SSD unless the data needs to go there.  Sequential data is written directly to HDD, completely bypassing the SSD.

“I Feel Better Already”
So, if your SSD caching system seems a little, shall we say, constipated, you can probably fix that by adding a little RAM to your SSD cache diet.

Read the original blog entry...

More Stories By Peter Velikin

Peter Velikin has 12 years of experience creating new markets and commercializing products in multiple high tech industries. Prior to VeloBit, he was VP Marketing at Zmags, a SaaS-based digital content platform for e-commerce and mobile devices, where he managed all aspects of marketing, product management, and business development. Prior to that, Peter was Director of Product and Market Strategy at PTC, responsible for PTC’s publishing, content management, and services solutions. Prior to PTC, Peter was at EMC Corporation, where he held roles in product management, business development, and engineering program management.

Peter has an MS in Electrical Engineering from Boston University and an MBA from Harvard Business School.

IoT & Smart Cities Stories
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT staff augmentation services for software technology providers. By providing clients with unparalleled niche technology expertise and industry experience, Chetu has become the premiere long-term, back-end software development partner for start-ups, SMBs, and Fortune 500 companies. Chetu is headquartered in Plantation, Florida, with thirteen offices throughout the U.S. and abroad.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...