A Brief History of Desktop Storage Architecture

My VMware colleague Tristan Tod (@tristantodd) put together an excellent presentation about VDI and related storage technologies. One of my favorite parts of his presentation deck was the “A Brief History of Desktop Storage Architecture”, wich in my personal opinion is extremely valuable for VDI architects and administrators. I have added some personal comments and links but most of the work was done by Tristan. Well done Tristan!

 

Physical PCs

In the beginning…there were physical desktops and everything was on DASD (Direct access storage device).

 

Screen Shot 2013-05-19 at 5.27.17 PM

Physical PCs 2.0

Filers at team and corporate level started to arrive and user data began to land on shared storage.

 

Screen Shot 2013-05-19 at 5.27.39 PM

 

Physical PCs and Terminal Services

With terminal services came further distribution of storage for desktops in that enterprise applications began to land on shared storage and even server storage.

 

Screen Shot 2013-05-19 at 5.27.51 PM

 

Early VDI for the really unfortunate

Some early adopters of VDI were not provided with SAN access (storage administrators worried about VDI) and started hosting desktops on DASD at vSphere host level.

 

Screen Shot 2013-05-19 at 5.30.48 PM

 

Early VDI for the more fortunate

The more fortunate early adopters were able to host desktops in enterprise SAN/NAS in the same way that many vSphere customer had been hosting server workloads.

 

Screen Shot 2013-05-19 at 5.31.36 PM

VDI with basic tiered storage

Basic tiered storage involved moving seldom used, temporary, and non-essential desktop VM data off of “expensive” shared storage and onto host DASD. Many administrators continue to do this today. Refer to Save [VDI] Storage using VM Swap File Host Placement.

Screen Shot 2013-05-19 at 5.34.21 PM

VDI with advanced tiered storage

Advanced tiered-storage arrived in VMware View 4.0 and allowed storage tiering of linked clones to different storage platforms (based on capacity and performance needs). Refer to VMware View 4.5 Linked Cloning Operations Explained (Part 1) and VMware View 4.5 Linked Cloning Operations Explained (Part 2).

Screen Shot 2013-05-19 at 5.34.29 PM

VDI with advanced tiered storage and persona management

With more advanced tiered storage + persona management, further separation of storage was possible.

Screen Shot 2013-05-19 at 5.36.25 PM

VDI with local SSD or Flash

With the introduction of the stateless reference architectures for VMware View, high performance DASD (SSD or flash) could be used for host linked clones. In this way, shared storage is lightly used for access to user data, persona, and enterprise applications. Refer to Use Flash Drives (SSD) for Linked Clones, not Replicas and Offloading Virtual Desktop IOs with Atlantis ILIO: Deep Dive .

Screen Shot 2013-05-19 at 5.37.06 PM

VDI with auto-tier SAN / NAS

Some advanced storage solutions arrived that promised to be a auto-tier solution where all VDI components could land on the same storage platform but be moved to appropriate backend tier based on IO characteristics. Refer to EMC FAST Cache effectiveness with VDI. In this category I would also put a number of different technologies such as the scale-out like Nutanix with Fusion IO cards and Nexenta ZFS with ZIL and L2ARC.

Screen Shot 2013-05-19 at 5.37.56 PM

VDI with storage features in Software + advanced physical storage

Finally, advanced automatic tiering in hardware and intelligent storage features in software (such as the View Storage Accelerator) have shown great promise in providing a simplified front-end storage architecture. Refer to Understanding CBRC (Content Based Read Cache).

Screen Shot 2013-05-19 at 5.38.27 PM

We have certainly not covered all possible storage technologies for VDI but this list is amusing and demonstrate how reference architectures and deployment models have changes over the last few years. It’s all about cycles and we keep repeating them as the technology gets better and prices come down.

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5067

A Rant About Storage Vendors

I have recently been invited to present in a VMware User Group (VMUG), which I quickly answered with a big and resounding Yes! I really love to present and touch base with customers as that helps me to keep it real, instead of being a lab rat type of engineer/architect.filepicker_Gw4aY4VjRsGRCvFqStvm_keep_it_real

Mostly I look forward to present and talk about new VMware endeavors in the EUC space, things such as MDM, MAM, the new HTML5 capabilities in Horizon View or what’s coming with the next release of Horizon Mobile. All fresh and cool stuff!

When I proposed one of my fresh new sessions I was asked to present “Getting VDI Storage Right”. My immediate reaction was to say that this was an old topic that every VDI administrator and architect had already mastered and that there was no need to present on such subject. I am sure I am in right mind when I say that because at the end of the day I have been writing about storage performance and architectures for VDI for over 3 years now.

Well, I decided to respect the VMUG board request and put together a session deck on the subject. When the VMUG day comes, with a packed room, I open my session with a rant about presenting on such topic but I kept on going. Why am I writing about it then? Well, at some point during my session I had a slide with the following bullet:

 

  • Who in the room knows what the average & peak IOPS are for your VDI environment?

 

That’s when I went perplex! There was only a single hand up. I then decided to ask how many were actually currently doing VDI in some form. More than half of the room had their hands up.

It seems to me that all those hundreds of storage architecture and performance blog posts written by me and the blogger community have not been yet assimilated by organizations doing or planning to do VDI, or they are not hitting the target audience. That honestly makes me sad because I also think that to some extent this is laziness from storage administrators and VDI architects, but on the other end I also think that most storage vendors are not prepared to provide customers with proper assessment and guidance, whilst are more interested in completing the sale as quick as possible.

I work extensively with storage vendors and I can attest that many of them will say their solution is best for VDI but they have absolutely no clue about architecting such solution even thou they may have a joint architecture with VMware, Citrix or another VDI vendor.

I worked for EMC and they used to have a EUC/VDI specialist team to help customers. It appears to me this group has been thinned a little bit.  Atlantis Computing has a very good grasp on VDI as this is their bread and butter. Nutanix will say their solution scale linearly, like Atlantis, and they have recently on boarded some subject matter experts.

Other storage vendors have reached out to me in search for VDI expertise, and some of them are even using a personalized version of my VDI calculator on the field to help customers.

I honestly believed this whole storage conundrum discussion was over, but it is clearly not. With Microsoft announcing project Mohoro set to deliver Windows 8 “Desktop-as-a-Service” the whole discussion has been  reignited. How do we scale storage to accommodate for hundreds of thousands of desktops?

On the other side of the spectrum I plead you to make sure you are working with storage vendors that are indeed interested in helping you with your VDI solution and have the expertise to put you in the right track avoiding storage bottlenecks in the future.

A IDC, Goldman Sachs research from Dec, 2012 demonstrated that in the enterprise space from 95% market domination in 2005 Microsoft market share has fallen to just 20% by 2012. However, Windows is not going away anytime soon and Microsoft project Mohoro is a clear indication that the “Desktop-as-a-Service” is only warming up. I would love to know how Microsoft is architecting their own storage/compute solution for Mohoro.

 

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5064

ThinPrint: What’s New in Horizon View 5.2

After publishing What’s New in VMware Horizon View 5.2 (Beyond Marketing) I received the same question multiple times from different customers and colleagues in regards to the following excerpt from my article.

 

A new Print Redirection codebase has been introduced that supports Windows 8, and also fixes a number of outstanding issues.

 

In the following table you can see what has been introduced with the changes in Horizon View 5.2. The changes are based on the functionalities of ThinPrint Server Engine 8.6.

 

Screen Shot 2013-05-17 at 1.57.49 PM

  • SpeedCache allow print jobs to be compressed by avoiding the repetitive sending of the redundant image data.
  • Finishing support let users control the full range of features of multi-functional printers.
  • Currently there are two forms of cloud printing – virtual and mobile printing. While only part of the printing process in virtual printing is relocated to the cloud, with mobile printing the entire printing process takes place in the cloud. Read more about it here.

 

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5060

Technology Minute with Aaron Skogsberg (Cloud Edition) – EMC World’13

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5058

Technology Minute with James Ruddy (OpenStack) – EMC World’13

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5055

Technology Minute with Edward Haletky (Security Podcast) – EMC World’13

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5052

Technology Minute with Tarik Dwiek (SDS) – EMC World’13

This article was first published by Andre Leibovici (@andreleibovici) at myvirtualcloud.net.

Permanent link to this article: http://myvirtualcloud.net/?p=5050

Older posts «