25-03-2015, 02:48 #1
[EN] PayPal’s Front-End Cloud Powered by OpenStackSri Shivananda, Vice President, Global Platform and Infrastructure, PayPal
Last year, PayPal served 162 million customers, across 203 markets and in 26 currencies, who transacted $228 billion in total payment volume. As we continuously deliver experiences that delight our customers and scale to meet this expanding demand in traffic, we have had to disrupt traditional approaches to infrastructure through innovation. To keep pace with innovation at this scale and growth, we’ve been reinventing our core infrastructure from the ground up. As you might imagine, that’s an enormous project. In fact, PayPal is one of the largest financial clouds in the world.
Today, I am excited to share our latest milestone: we have converted nearly 100 percent of our traffic serving web/API applications and mid-tier services at PayPal to run on our internal private cloud, based on OpenStack. Our private cloud provides us with the agility, availability, manageability, efficiency and the foundation for innovation necessary to deliver the best products and services.
Our OpenStack Journey
OpenStack has been a key choice in our journey to drive agility and operational efficiencies. We have re-architected our infrastructure and processes from a traditional manual-build-on-demand model to a multi-tenant private cloud infrastructure with end-to-end automation based on OpenStack.
The first phase of our private cloud, based on OpenStack, was rolled out in December 2011 in the midst of the online holiday shopping season. We began routing 20 percent of our workloads through our private cloud, giving us more flexibility and agility. Since, we have continued to build on top a broad base of OpenStack technologies. With our private cloud infrastructure, we’ve been able to deploy new Java applications and provision infrastructure capacity within minutes - instead of days. It is critical that we have infrastructure that is available on demand for our developers to deploy to. At the same time, it is important we have highly available infrastructure that is consistently manageable at scale.
In leveraging open source technology, it’s important that we engage with the community. We’re doing so as an active contributor to several OpenStack projects. We’re committed to open source technologies because we benefit from the collective innovation of the community (others who are just as passionate as us) and we contribute back via our findings at scale and best practices though generations of upgrades.
A big thanks to our talented cloud team that is using cutting-edge technologies to build the next generation of PayPal’s global infrastructure and payment platforms. This empowers us to redefine the payments industry through innovative services and capabilities that meet – and exceed – our customers’ ever-evolving needs and expectations.
01-04-2015, 01:32 #2
More Clarity On PayPal's Infrastructure--VMware Versus OpenStack
Last week when I wrote a post detailing PayPal‘s move to 100 percent OpenStack in its infrastructure, I caused howls of protest from VMware. The protests were understandable, partly because the situation is more complex than one would initially think but also because VMware VMW -1.17% is in a tricky position. It is certainly unpalatable having commentators shine a light on the fact that solutions like OpenStack create challenges for their existing lucrative revenue streams.
Many challenged my assumptions and instructed me in no uncertain terms that VMware remains a central part of PayPal's infrastructure spread and that the OpenStack announcement meant very little in the scheme of things. I didn’t agree with their assessment but wanted to reach back out to PayPal for further clarification.
It’s taken awhile, but PayPal spokespeople provided me with some detailed answers to my questions which should clarify things a little bit for all. Of course it won’t satisfy everyone, and I suspect my warm welcome at VMware headquarters might have just dropped a few degrees, but I believe the PayPal story indicates a broader change in enterprise IT that will impact upon other vendors too – Cisco, Citrix, Microsoft and many others face the same existential threats.
Clearly VMware is still a part of what PayPal does but, and this is the critical point, the importance of that part is reducing in relative terms. So here are the questions and answers regarding PayPal’s use of OpenStack.
Q – Does the private cloud serving 100 percent of the traffic for web/API applications and mid-tier services no longer use VMware?
A – The private cloud for Web/API application will be migrating to 100% on OpenStack.
Q – How big is the physical infrastructure running the OpenStack cloud (how many physical servers)?
A – Approximately 8,500 physical servers.
Q – Is both PayPal’s and eBay’s front end infrastructure now converted to OpenStack?
A – eBay's EBAY -0.41% and PayPal’s front-end infrastructure is running on OpenStack. While eBay has been running on OpenStack for some time and is still in the process of migrating to it.
Q – Is the OpenStack private cloud is shared infrastructure for both eBay and PayPal?
A – Our deployment across eBay and PayPal are separate instances, but use the same OpenStack code and tools. The infrastructure is deployed across multiple Availability zones and geographical locations, and is designed for multi-tenancy, i.e. environments across business units are logically isolated.
Q – Is PayPal using as much VMware virtualization software today as it did in 2011 or has there been a reduction?
A – There has been a reduction on the compute virtualization front, but VMware remains core in our network virtualization.
Q – As a practical matter, how much of PayPal data centers function as an OpenStack cloud?
A – A good portion of PayPal data centers function as an OpenStack cloud. There are certain legacy workloads running on physical servers and are in the midst of migrating to cloud.
Q – Could you provide a rough approximation of the percentage of PayPal data centers that are primarily stateless, frontend OpenStack versus stateful database and other legacy systems outside of OpenStack?
A – Approximately 65% stateless vs 35% stateful. Most of these are on OpenStack while a small percentage run on physical servers.
Q – If VMware was indeed replaced with OpenStack, why?
A – PayPal is focused on delivering agile platforms that seamlessly scale across multiple cloud environments. Our initiative with OpenStack is intended to enable agility, availability and choice to accelerate innovation. With OpenStack, PayPal has more control over customization and more choice in the vendors it uses for its hybrid cloud environment.
Q – Did PayPal create its own OpenStack cloud or did it work with an OpenStack vendor? If the latter, who’s the vendor?
A – PayPal created its own OpenStack cloud.