Building a private cloud: Get ready for a bumpy ride

IT shops have begun steering away from public clouds because of the security risks; data is outside the corporate firewall and is basically out of their control

When cloud computing became a topic of discussion a few years ago, public clouds received the bulk of the attention, mostly due to the high-profile nature of public-cloud announcements from some of the industry's biggest names, including Google and Amazon. But now that the talk has turned into implementation, some IT shops have begun steering away from public clouds because of the security risks; data is outside the corporate firewall and is basically out of their control.

Tom Bittman, vice president at Gartner, said in a blog post that based on his poll of IT managers, security and privacy are of more concern than the next three public cloud problems combined. He also wrote that 75% of those polled said that they would be pursuing a private cloud strategy by 2012, and 75% said that they would invest more in private clouds than in public clouds through 2012.

Frank Gillett, an analyst at Forrester Research, agrees that IT's emphasis is more on private clouds these days. He says that IT managers "are not interested in going outside" the firewall.

Hurdles involved

Building your own private cloud involves some challenges, including these:

* Budget. Private clouds can be expensive, so you need to do your due diligence and figure out what the upper and lower bounds for your ROI will be.

* Integrating with public clouds. Build your private cloud so that you can move to a hybrid model if public cloud services are required. This involves many factors, including security and making sure you can run your workloads in both places.

* Scaling. Private cloud computing services usually don't have the economies of scale that large public cloud providers provide.

* Reconfiguring on the fly. You may have to tear down servers and other infrastructure as it is working to move it into the private cloud. This could create huge problems.

* Legacy hardware. Leave your oldest servers behind -- you should not try to repurpose any servers that require manual configuration with a private cloud, since it would be impossible to apply automation/orchestration management to these older machines.

* Technology obsolescence. The complexity and speed of technology change will be hard for any IT organization to handle, especially the smaller ones. Once you make an investment in a private-cloud technology stack, you need to protect that investment and make sure you stay up to date with new releases of software components.

* Fear of change. Your IT team may not be familiar with private clouds, and there will be a learning curve. There may also be new operational processes and old processes that need to be reworked. Turn this into a growth opportunity for your people -- the stress of doing and learning all this may be mitigated by helping your folks keep in mind that these are important new skills in today's business environment.

Still, as Bittman's blog post points out, private clouds have their share of challenges, too; in his poll, management issues and figuring out operational processes were identified as the biggest headaches. And, of course, an on-premises private cloud need to be built internally by IT, so time frame and learning curve, as well as budget, need to be part of the equation.

Indeed, transitioning from a traditional data center -- even one with some servers virtualized -- to a private cloud architecture is no easy task, particularly given that the entire data center won't be cloud-enabled, at least not right away.

In this two-part article, we'll examine some of the issues. Part 1 looks at how cloud differs from virtualization and from a "traditional" data center. Part 2 will examine some of the management issues and look at a few shops actively building private clouds, and the lessons they've learned.

While we generally think of a private cloud as being inside a company's firewall, a private cloud can also be off-premises -- hosted by a third party, in other words -- and still remain under the control of the company's IT organization. But in this article we are talking only about on-premises private clouds.

Also, despite all the hype you might hear, no single vendor today provides all of the software required to build and manage a real private cloud -- that is, one with server virtualization, storage virtualization, network virtualization, and resource automation and orchestration. Look for vendors to increasingly create their own definitions of private cloud to fit their product sets.

Virtualization is only part of the picture

Many IT managers equate a private cloud with virtualization. What they describe is usually virtual infrastructure, meaning that "you can treat your servers, storage and networks as a single pool of resources that workloads can request on demand," explains Tony Iams, vice president and senior analyst at Ideas International, a research firm with emphasis on enterprise IT infrastructures.

But virtualization and the cloud are not the same thing; to be considered a cloud, the architecture must be set up to provide both orchestration and automation on top of the virtualization layer.

There is no single 'correct' way to transition to a private cloud environment from a traditional data center.

Orchestration is the coordinated delivery of many types of resources, such as processors, storage and networks, to provide an integrated provisioning process; resources can be delivered in minutes rather than days or weeks. In other words, a single command or request causes a number of actions to occur, possibly in a specific sequence, to coordinate the provisioning request.

The whole point of a private cloud is to allow IT managers to reduce costs and provide so-called agile provisioning rather than just making management of the infrastructure more convenient. A private cloud with virtualization underpinnings turns the technology infrastructure into a pool of resources that can be provisioned on demand with minimal manual intervention.

Without a focus on delivering IT services, it's unlikely you'll attain the full benefit of private clouds.

Comparisons to traditional data centers

In a traditional data center setup, "every time you add a server, somebody has to walk to a firewall console, set up firewall rules, attach the server to a VLAN, set up load balancing" and do many other tasks, explains Jeff Deacon, cloud computing principal at Verizon Business. But a private cloud needs minimal human intervention other than bringing in new computers or storage to keep up with demand. In a cloud environment, there is one console that lets operators set parameters to automate the entire process, rather than requiring IT personnel to log into different consoles for security, networking and server OS functions.

Another of the main differences between private clouds and traditional data centers involves IT processes. Private clouds may require a re-architecture of how data is used, and processes may have to be rewritten.

For example, today many IT organizations have to contend with sets of requirements that must be met in the provisioning process for budget; discussions with the storage, network and server groups; and tons of paperwork. This type of process is in stark contrast to the streamlined, short-duration provisioning done in clouds. Time to provision may go from weeks in the traditional data center to minutes in a cloud.

You may also have to re-architect deployment of legacy applications to take advantage of private clouds. Many legacy applications are running on mainframes and proprietary Unix platforms. Most virtualized environments, including private clouds, are geared to run on x86-based systems.

Also, in a virtualized environment, we generally don't know exactly where an application is running at any given time. Because most legacy applications are tied to a specific platform, running them in a private cloud will often require re-architecting them.

Divorcing applications from the hardware is a hallmark of clouds, including private clouds. In a traditional data center, those 10 servers over there might be running billing applications and those five over there running CRM apps. With a private cloud, however, it's not known ahead of time which servers are running which specific applications. The applications run on whichever servers have free cycles at the time the apps need to run.

Private clouds involve two groups: the IT (data center) operations folks and the business users who want to run applications. A private cloud gives business users the opportunity to quickly provision a server and run an application when they want to -- without human intervention.

The IT operations folks have to make sure that sufficient resources are available for the type of on-demand computing that business users have heard is available with public clouds, and that usually means that the wait for user-requested resources is minutes, not days. Anything short of this, and users will be unhappy.

This is what private clouds are all about: providing the on-demand elasticity of public clouds but doing it within the company's firewall.

Another difference is that some IT managers or business users may expect private clouds to act like public clouds. In a public cloud, the public cloud provider's IT operations group is responsible for the compute infrastructure, and the enterprise's business application groups manage and monitor their own applications, under agreement, on the public cloud. If the private cloud is expected to operate in a similar manner, that means the IT group may need to give up its traditional application-management role.

The steps for transition

The first thing is to broaden out beyond server virtualization. At this point, a lot of users are looking at virtualization for purposes of availability. So look at those aspects of virtual infrastructure that improve availability as the next steps toward a private cloud.

Today, people are integrating storage with virtualization and are beginning to understand the impact of broad virtualization of resources, Iams of Ideas International says. "When we get to the stage where virtualization of servers is the rule rather than the exception and most workloads are virtualized, this is the stage in which virtualization gets woven into the operational process," he says.

When you get to this stage, you have to rethink what this does to your storage processes, Iams says. "For example, how does virtualization affect backup and recovery?"

More about: Amazon, Bill, etwork, Forrester Research, Gartner, Google, Ideas International, LAN, Linux, Verizon, Verizon, Verizon Business, VMware
References show all

Comments

1

Vivek Juneja

Tue 31/08/2010 - 23:01

Private Cloud Taxonomies

Hi Bill,

I was immensely pleased by the clarity of the article, especially when we have numerous definitions and abstractions of Private Cloud all around the web. This article is definitely a pointer to the things an organisation must take care to embrace IT agility.
Having been involved in talking to a lot of our customers, we have clearly seen the trend of understanding and embracing the value that Internal Cloud can bring to the business. Also, not to mention, a vast of them also have investments in non-x86 hardware that have been till now not been covered by the flurry of tools and frameworks in Private Cloud. Hence, there is a sense of confusion in this regard. The organization cannot risk loosing the existing investments in hardware, and still needs to embrace the benefits of rapid provisioning. Non-x86 customers usually start with custom implementations of automation around existing virtualisation (Solaris Ldom, HP IVM etc.), that are then used to form a Self - Service interface. Thanks to the effort of OCCI (http://en.wikipedia.org/wiki/OCCI), these custom automations are made to expose standard WS interfaces that can then be consumed by various Cloud Management tools. Tools like Eucalyptus, OpenStack and Cloud.com are increasingly coming under the scrutiny of such bespoke implementors and are been modified to be used to run on the non-x86 platforms.
With this, we also see a rise of mixed - breed clouds, which integrate various kinds of hardware platforms and their respective Virtualization capabilities, but provide a common interface to control and manage. For instance, a common cloud fabric like this, could provide the end user to have multiple availability regions , each for the type of Hardware platform (SPARC, X86 etc.).
Other interesting developments include Hypervisor agnostic Clouds that span across multiple hypervisors, useful for organisations that have a range of Virtualization investments like Hyper-V, VMware, Xen etc.
I see a great set of possibilities opening up thanks to wonderful open projects like Eucalyptus, OpenStack, cloud.com used in conjunction with the offerings from market leaders of Virtualization like VMware, Xen and Hyper-V.

Highly recommend your article. Wonderful read.

Thanks,
Vivek Juneja
(www.vivekjuneja.in)

2

paolo belotti

Sun 19/09/2010 - 18:11

Future looks interesting

Great article Bill,
For sure security concern is a strong barrier to the adoption of Public Cloud but I think that biggest obstacle for Public Cloud implementation is still the immaturity of Internet connections (speed and reliability).
It is also true that no single vendor has the perfect solution for any kind of Private Cloud. As you mention, the economy of scales of Private Cloud are smaller and this implies different approaches. Moreover, there are difference needs from SMB, Mid Market and Enterprise Companies that cannot be match by a single Private Cloud offer. Future looks interesting.

3

Luke Vorster

Sat 30/10/2010 - 12:01

Are Grids non-virtual clouds?

Hi,

This is a most interesting, broad and deep, accessible analysis of what to expect from developing one's own cloud-based intranet/desktop/data center.

I have had trouble answering this question, which I get asked too often these days. Maybe you can shed some light, or provide me with a classifier:

If virtualising servers, network, and storage in a unified system which can be dynamically allocated (across organisational boundaries in the public case), on demand is a cloud, then what is Grid Computing?

Is it that Grid Computing does not virtualise the resources, but rather encapsulates there locations?

Post new comment

The content of this field is kept private and will not be shown publicly.
Users posting comments agree to the TechWorld comments policy.
Login or register to link comments to your user profile, or you may also post a comment without being logged in.
Related Coverage
Related Whitepapers
Latest Stories
Community Comments
Tags: cloud computing, internet
Whitepapers
All whitepapers

Twitter Feed