09-02-2016, 19:05 #1
[EN] In The Trenches With OpenStack
Mirantis Unlocked Appliance will cost in the range of $250,000.
Can organizations build and deploy and support OpenStack for less than that? In many cases, the answer will be no.
February 9, 2016
Timothy Prickett Morgan
It is hard to believe but it is still early days for cloudy infrastructure. While a very large percentage of server capacity that can be virtualized has been over the past two decades, a lot of that capacity has not been equipped with additional tools to automate the management of that infrastructure and orchestrate the movement of workloads around server clusters. This is what makes a cloud a cloud.
There are many ways to build a public or private cloud, but for most enterprises, it is going to come down to three possibilities, or some hodge podge hybrids such as Platform9 or VMware Integrated OpenStack. Companies that are by and large Windows Server and Hyper-V shops will naturally move towards Microsoft’s Azure Stack once it is released later this year and they will probably increasingly use the Azure public cloud. Companies that have invested heavily in VMware’s ESXi and vSphere infrastructure are ever so slowly adopting its vCloud/vRealize suite of tools, which turn virtual servers into clouds. And finally, those who are mostly Linux shops will looks to OpenStack and probably the KVM hypervisor to compose their clouds.
In a sense, and oversimplifying a bit, OpenStack is an automation framework for Linux that just happens to allow Windows instances to run on KVM, just like the Azure cloud and Azure Stack are similar extensions to Windows Server that just so happen to also support Linux instances on Hyper-V. There have been a dozen releases of OpenStack since that time, on a six-month cadence of April and October launches that, interestingly enough, have also regularized the pattern for Linux operating system launches, too.
Quite a number of OpenStack distributors have come and gone. Nebula, which was founded by the NASA team that initially created the Nova cloud controller at NASA, tried to create a hardware appliance running OpenStack but ended up running out of steam with most of the employees and intellectual property being picked up by Oracle. Piston Cloud and Metacloud, two other distros, were snapped up by OpenStack, Cloudscaling was eaten by EMC, and of course Red Hat, SUSE Linux, and Canonical all have their own OpenStack platforms mashed up with their respective Linuxes.
To get a feel for what is going on out there in the clouds, The Next Platform sat down with Kamesh Pemmaraju, vice president of product marketing at Mirantis, one of the few remaining free-standing support providers for OpenStack, to talk about what is happening with the cloud tool that was initially the byproduct of a collaboration between NASA and Rackspace Hosting when the open source cloud controller project was launched in July 2010 and that is now backed by more than 500 companies.
Mirantis was founded in 1999 by Boris Renski and Alex Freedland, during the beginning of the commercial Linux revolution when distributed infrastructure was just getting rolling in enterprises and more than a decade before OpenStack was conceived. (We talked to Renski at length last summer when discussing the future of cluster controllers with various people from the Kubernetes, OpenStack, and Mesos camps.) Mirantis backed OpenStack from the get-go, and raised $20 million in Series A funding in 2013 from Intel Capital, Dell Ventures, Red Hat, SAP Ventures, Ericsson, and West Summit Capital. Most of these investors joined Insight Venture Partners in a $100 million Series B round in October 2014 that Mirantis took down, and last August Intel Capital led another $100 million Series C round that brought in August Capital and Goldman Sachs.
With such backing, Mirantis has grown to almost 800 employees and closed out 2015 with 127 commercial customers using its OpenStack support services, with close to 100 of them being added in 2015 alone. Pemmaraju reckons that there are maybe 400 customers doing OpenStack at reasonable scale in production, and that maybe in the whole world, there might be 1,500 to 2,000 OpenStack clusters. But the prospects for growth are good, based on that installed base growth and the fact that Mirantis grew its software subscription business by 4X last year. That is one reason it is paying a couple hundred engineers to work on the OpenStack code, including its own Fuel deployment tool. But the primary focus that Mirantis has is on services for OpenStack, be they training, assessment, implementation, and technical support services.
“All of these other companies have either been acquired or disappeared,” Pemmaraju tells The Next Platform. “And we know why they failed. All of the appliance companies failed because they did an appliance before the market was ready for it, and taking a completely product-oriented approach with something like OpenStack, which is still emerging, is a fool’s errand. The way we think you succeed is to provide training and services to the market and take the risk out of using an open source project that is kind of half-baked and make it work for companies.”
09-02-2016, 19:05 #2
Who Is Stacking, And How High?
Mirantis separates OpenStack adopters into three camps. The first are service providers, ranging from cloud builders to SaaS providers that are building large scale infrastructure to host their customer-facing applications. (Hyperscalers have their own cloud controllers, and these predate OpenStack are and very tightly tied to their own software and hardware, such as Google’s Borg, Microsoft’s Autopilot, or Facebook’s Kobold.) Then come the telecommunications companies and other service providers, and these companies are more focused on using OpenStack to host network functions that are being pulled off of myriad proprietary hardware appliances (load balancers, firewalls, and stranger stuff), virtualized, and hosted on cloudy infrastructure.
The third bucket has traditional enterprises like big banks, manufacturers, retailers, and so on who are building private clouds. As was the case with server virtualization when it took off on the X86 platform fifteen years ago with VMware, the first use case here among enterprises as well as for some telcos is for an automated development and test system for application developers. It took too long to provision n-tier clusters to test applications back in the early 2000s, and server virtualization fixed a lot of that; now, it takes too much effort to orchestrate the virtual capacity for many different streams of applications, and this needs to be automated with cloud software. (Luckily for humanity, we will need application developers for a while yet. Maybe.) In this case, the scale of the OpenStack platform is really determined by the size and ferocity of the teams of software developers that make use of the private cloud. Aside from the NFV use case, the other big one driving OpenStack adoption is distributed analytical software, such as Hadoop and Spark, and specifically wanting to manage and deploy multiple applications on top of a cluster.
The companies on the highest end of the scale in the OpenStack community are the names we are all familiar with, says Pemmaraju, such as eBay, PayPal, Symantec, Wal-Mart, and they tend to have multiple thousands of server nodes. “Not all of these nodes are necessarily in one datacenter or under one OpenStack control plane, but the scale is thousands of nodes when you add it all up.”
Aside from Rackspace, which probably operates the largest OpenStack cloud on the planet, the biggies include CERN, which reportedly has more than 10,000 nodes in its OpenStack infrastructure, and a number of companies in China are on the same order of magnitude. Pemmaraju knows of a few customers with 5,000 nodes in production, and adds that “these are not trivial.” Although, as we are fond of pointing out, the original design goals set out by Chris Kemp, formerly of NASA and founder of the Nebula appliance company, were for OpenStack to span 1 million servers and 60 million virtual machines in one control domain.
What those real OpenStack clouds, as opposed to the theoretical ones, are not, as Pemmaraju pointed out above, always all in one datacenter and all wired up with top of rack and end of row switches into one giant OpenStack cluster. Just like Amazon Web Services, Microsoft Azure, and Google Compute Engine, which do have over 1 million servers each in their infrastructure, spread those machines across multiple regions and datacenters, so do OpenStack shops, at least the ones that Mirantis sees.
The OpenStack infrastructure is particularly spread out among the telcos and service providers using the cloud controller as a substrate for NFV, says Pemmaraju. These companies have points of presence, or POP, centers, which have small co-location spaces and which might have a few racks of gear with maybe 50 to 100 nodes running OpenStack. The idea is to get certain network functions close to the customers that are using the network. These feed into regional centers, which might have 400 to 500 nodes of OpenStack gear running NFV software, and these in turn feed into larger network operating centers, or NOCs, that generally have no more than 1,000 nodes, but sometimes have more if a telco or service provider consolidates to fewer datacenters at the hub of its networks.
“But if you look at the aggregate, there are tons of POPs,” Pemmaraju explains. “And if you look at AT&T or Deutsche Telekom or Verizon, they have POPs in every major area they cover with fiber, cable, or telephone wire. So they may have hundreds of these POPs, depending on the country and locality. The regional offices tend to be in the dozens, and these companies tend to have fewer than ten or fifteen central offices.”
Add it all up, and these service providers are deploying thousands to tens of thousands of OpenStack nodes.
For the enterprise use cases, data analytics applications like Hadoop on generally deployed on OpenStack on bare metal iron, although Mirantis can deploy it on virtualization hypervisors if customers want to do it. As we have pointed out before, most companies have hundreds of Hadoop nodes, with only a relative handful reaching up into the 1,000 or 2,000 range.
The other enterprise use case for OpenStack is for development and test infrastructure for developers. Even the largest organizations might only need an OpenStack cluster for this purpose that has maybe 200 or 300 nodes, says Pemmaraju. The biggest organizations have hundreds to maybe a few thousand developers, so the demand for virtual infrastructure to spin up applications for testing can only get so high.
“These clusters tend to be fairly departmental,” Pemmaraju adds. “I have not seen a large enterprise like a big bank go out and build a big OpenStack cluster in one datacenter that supports all of the developers in the world for that organization. Within a large enterprise, maybe one engineering department or an R&D center with a couple hundred developers or researchers needs only a few thousand VMs. Mind you, every department will have a cluster.”
The thing is, 200 or 300 nodes is not small, not when you consider that you can get 20 cores or more in a box and as much as 512 GB or even 1 TB of memory into each node for a reasonable price, and support 25 to 50 VMs on each node. That is anywhere from 5,000 to 15,000 VMs at that scale.
Mirantis charges anywhere from $700 to $3,000 per node per year for supported versions of its eponymous OpenStack stack, which is completely open source. (The price depends on the features.) Pemmaraju reckons that about 30 percent of the users of the Mirantis stack are paying for support, with another 70 percent doing self support. (That is a very high ratio of paid to unpaid for an open source project, and second perhaps only to Red Hat Enterprise Linux, which runs somewhere around 50 percent or so. Most open source projects are lucky to convert 5 percent from free to pay.)
Up until now, the large-scale OpenStack deployers have taken a do-it-yourself approach, as did the telcos and service providers initially. But it looks like they are doing the math on what it takes to keep OpenStack up, current, and humming and many are looking for some help from a distro. “Operating a cloud is not for the faint hearted, and running anything at scale is a major challenge. It takes a lot of skills, tools, and monitoring, and it can get pretty complicated.”
To help customers speed up OpenStack deployments, Mirantis is now offering what it calls the Unlocked Appliance, which is based on Dell PowerEdge R630 servers for compute and OpenStack controllers, Dell PowerEdge R730xd storage servers for Ceph object storage, and Juniper QFX5100 and EX3300 switches. A fully configured rack with 24 compute nodes and six storage nodes, can do about 768 VMs, with an oversubscription ratio of 4 to 1 on the virtual CPUs (vCPUs) versus hyperthreads in the compute nodes. (In other words, each VM has four vCPUs. Each VM also has 8 GB of virtual memory, and 60 GB of storage.) Including hardware, software, and support, the Unlocked Appliance will cost in the range of $250,000.
They question is, can organizations build and deploy and support OpenStack for less than that? In many cases, the answer will be no, if you fully burden the costs.
09-02-2016, 20:24 #3
ZeroStack: OpenStack in a Box
“A self-service cloud that requires very little human intervention”
The closest competitor to ZeroStack is probably Platform 9.
February 5, 2016
Mahesh Neelakanta is Director of Technical Services at Florida Atlantic University, responsible for managing IT for FAU’s computer sciences department. Last year, he wanted to build a private cloud facility to support student projects. The students already had virtual desktops from VMware and a number of Windows applications running on Windows servers. But they needed more compute power, and Neelakanta felt a cloud infrastructure would support their needs efficiently, as well as give them experience of working with cloud technology.
The obvious choice for the cloud software stack was VMware, but the VMware solution was beyond Neelakanta’s budget. He looked at OpenStack, the open source cloud system that has received plentiful publicity in the last few years. But after reading up on OpenStack, he was put off by the amount of work that would have been required to set it up and get it running. “It’s a great platform, but it requires a lot of management,” Neelakanta told the Daily Cloud. “It would have taken us weeks to get it working and it was not guaranteed that we would be successful.”
Then he heard of a solution from a new startup, ZeroStack. ZeroStack has developed a hyperconverged cloud solution, essentially a single box including compute, storage, networking, and OpenStack-based software that enables a user to quickly configure and turn up a private cloud solution. The solution was in what Neelakanta describes as “late alpha/early beta” stage, but he installed it at FAU, where students are using it today. “It’s worked out really well,” he says. “I provisioned the resources, and the students can build virtual machines on top. They are building sandboxes with 20 to 30 VMs. The professors use it for database research. We now have a self-service cloud that requires very little human intervention.”
“Basically, we’ve built a private cloud in a box,” says ZeroStack co-founder and CEO Ajay Gulati. Based in Mountain View in Silicon Valley, ZeroStack took a fresh approach to the problems that have hampered enterprise adoption of OpenStack. They have built a preconfigured solution that includes all the components necessary to create a private cloud. Where OpenStack lacked important features, or where those features were difficult for customers to work with, ZeroStack added their own proprietary software, such as a self-healing “cluster” that enables the system to recover from failure of a single component by moving the workload to other components.
Gulati spent six years at VMware before leaving in 2013. He teamed up with Kirin Bondalapati, the other co-founder, who worked on virtualization technology at software startup Bromium and before that at chipmaker AMD. The company is backed by Silicon Valley venture funds Formation 8 and Foundation Capital. Their advisors include a co-founder of Nimble Storage and a co-founder of Insieme Networks (the Cisco spin-in that developed the technology at the core of Cisco’s software-defined networking solution).
Today, the ZeroStack system is in beta testing with about 15 customers including enterprises in retail, manufacturing and the pharmaceutical industries. ZeroStack Director of Marketing Nick Suh tells us the betas are going well and they expect many of them to convert to paying customers once the product goes on general release later in Q1. According to Suh, one beta tester is comparing ZeroStack to a “pure” OpenStack infrastructure the customer built himself. Because of all the work involved in standing up their “pure” OpenStack solution, they nicknamed it “The Beast.”
“They did a bake-off, and on initial deployment we were superior to the Beast hands-down, which they were expecting, but what they were not expecting was that we came out superior on performance too,” says Suh.
The ZeroStack team is growing, and busy signing up channel partners to sell the product once it’s on general availability. The notion of hyperconverged solutions—all the hardware and software you need in a single box—has already won popularity with Nutanix, a startup with a storage-focused hyperconverged solution. Nutanix reported revenue of $241 million in fiscal 2015 and has filed to go public. Says Suh: “We’re meeting a need in the marketplace. Channel partners tell us there is lots of pent-up demand among their installed base. We anticipate a high level of interest.”
“Rising Tide Lifts All Boats”
There is rapidly growing interest in private cloud solutions among enterprises, as more embrace the goal of a hybrid cloud solution, which should enable them to take advantage of the public cloud without getting locked into any one public cloud provider. According to Gulati, VMware and Microsoft private cloud solutions still lack some of the key elements that would make them compelling, easy-to-deploy, easy-to-use choices for an enterprise that doesn’t have a large team of engineers to assign to the challenge. OpenStack, despite its missed cues, is now improving rapidly. “OpenStack is getting better with every release, in terms of scalability and functionality. Even since we started (two years ago), we’ve seen lots of improvements.”
Gulati does not see the open source version of OpenStack as a competitive threat. On the contrary, he says, growing acceptance of OpenStack should help drive demand for ZeroStack. The closest competitor to ZeroStack is probably Platform 9, covered by the Daily Cloud here. The Platform 9 solution provides more options, in particular on the customer’s choice of virtualization. But fewer options makes the ZeroStack solution simpler. And for most enterprises trying to get their head around the myriad software layers involved in a cloud, simplicity is a valuable asset. ZeroStack and Platform 9 share the approach of building proprietary software to supplement OpenStack where the open source solution is not strong enough. That raises the question of how much success hardware companies, like Cisco and HP Enterprise, will have with their “pure” open source OpenStack solutions. Gulati sees all flavors of OpenStack doing well in the next few years.
11-02-2016, 09:59 #4
Platform9 adds Multi-Region & Multi-Hypervisor management
Platform9 Managed OpenStack Enterprise Edition
Thursday, February 10th, 2016
“With Amazon Web Services I can manage multiple regions of distributed infrastructure. Can I do multi-region management with Platform9?”
I get this question a lot, and I’m happy to say the answer is yes!
Today we announced our multi-region management, capabilities that enable and enhance management of distributed resources from a single pane of glass within Platform9 Managed OpenStack Enterprise Edition.
Our customers are extremely excited about this, and tell us there are three scenarios where it’s particularly useful:
- Geographically distributed infrastructure with dedicated storage and network infrastructure can be aggregated into the same private cloud. IT benefits from improved visibility into their distributed infrastructure, and can also enable self-service access to end users across sites.
- For VMware vSphere users, multiple vCenters can be easily managed within a single private cloud platform. Many large enterprise customers deploy several vCenter servers to scale their virtualized infrastructure. All of this infrastructure can be managed by a single OpenStack private cloud, increasing automation and choice while reducing infrastructure costs.
- Multiple hypervisors can be easily managed within a single private cloud platform.This reduces IT overhead and gives cloud platform users a true single pane across hypervisor platforms. It also enables an easy migration path for VMware vSphere users looking to reduce virtualization licensing costs and mitigate vendor lock-in by moving their second-tier workloads to lower-cost KVM.
I did a sneak preview and demo of multi-region management last week in Austin at Tech Field Day. (If you’re unfamiliar with Tech Field Day, you can learn more about it here. It’s a great resource for IT practitioners learning about virtualization and cloud computing).
Here’s the video of my 10-minute talk on multi-region management, which also highlights how multi-hypervisor management works. The demo shows how easy it is to see and manage distributed environments – plus you get some bonus Q&A from the Tech Field Day participants.