The Wayback Machine - https://web.archive.org/web/20120606232517/http://cloudcomputing.sys-con.com:80/node/2280168

Welcome!

Cloud Expo Authors: Elizabeth White, Pat Romanski, James Carlini, Glenn Rossman, Liz McMillan

Related Topics: Cloud Expo, SOA & WOA, Virtualization, Web 2.0, Apache

Cloud Expo: Blog Feed Post

APIs: Essential for Delivering Storage in Enterprise Cloud Infrastructures

As new storage platforms evolve, native API support is a must

It’s pretty easy to pick holes in the current legacy storage products, especially when it comes to integration within both public and private cloud deployments.  However it’s worth discussing exactly what is required when implementing cloud frameworks, as the way in which storage is deployed is radically different from the traditional model of storage operations.  In this post we will look at why traditional methods of storage management need to change and how that affects the way in which the hardware itself is used.  This leads to a discussion on APIs and how they are essential to drive cloud deployments effectively.

The Legacy View

Legacy Provisioning Process
For the last 10 years or so, the traditional view of  storage management has consisted of a number of Storage Administrators using a GUI, CLIs and/or scripts to process storage requests as they are generated by the business user.  The process is highly manual, with lots of interactions between the requestor, the storage admin delivering the work and other intermediaries to cover things like billing, change control, capacity management and workload scheduling.  This made the overall process pretty people intensive and not surprisingly elongated the delivery time.  Many end users will also have recollections of asking for their specific requirement to be told they can only have something “off the shelf” – i.e. storage to a standard LUN size and with a specific RAID protection.

This was done for obvious reasons; firstly the configuration of large arrays was predicated on pre-planning and a fixed design, usually created at hardware installation time.  Once defined and in use, it couldn’t be changed (or at least couldn’t be changed without significant impact and cost).  Second, it makes sense to reduce requirements into a smaller subset to make the provisioning process easier.  As well as being rigid in configuration, many legacy arrays assume the creation and provisioning of LUNs is an infrequent task.  Many require requests to be packaged and executed in batch and certainly can’t cope easily with concurrent requests.  Although it is possible to automate some provisioning processes using CLIs and scripts, this doesn’t address the real requirements in creating an on-demand model.

The New World

API Provisioning Process
As we scale up to ever large IT deployments and especially within service-based or “cloud” configurations, the idea of having large amounts of human intervention in the provisioning process simply doesn’t work.  Instead, we need to move to a model of “storage on demand” where an external agent – user or orchestration software – can request storage as part of a portal and see the request actioned in real-time or at least within a matter of minutes or hours.  This kind of operation can only be delivered where the hardware has been designed for the purpose.  Where previously storage administrators were involved in every provisioning request, those requests will be actioned within a provisioning framework, defined by the administrator or a storage architect.

Framework
What do we mean by framework?  Well, it’s all about setting a set of parameters around which allocations take place.  This could include:

  • LUN Size
  • Resiliency/Availability
  • Performance
  • Security credentials
  • Snapshot policy
  • Capacity on demand LUN
The architect chooses which specific hardware components are used to meet the requirements.  There are also operational limitations:
  • Maximum number of concurrent requests
  • Maximum number of provisioning requests per hour
  • Ability to suspend or reject provisioning requests by array
  • Restrict requests by array capacity
  • Restrict requests by user based on capacity guidelines
The provisioning framework also needs the ability to work asynchronously and autonomously; that is, to accept, process and acknowledge provisioning requests without the requestor having to maintain a permanent session to the array.  Once requests are completed, the requestor is alerted via a callback mechanism or by manually checking whether a request has completed.  Obviously there is a need for integration into monitoring frameworks, in order to track hardware and performance issues.

Designed for API
Of course there’s a big question around whether APIs can be retro-fitted to existing storage.  In classic IT tradition the answer is “it depends”.  Without a doubt no new storage array should be released without native API functionality.  However fitting an API to existing technology will depend on how flexible the existing configuration process is.  It’s possible to create an API wrapper and build automation into a middleware layer.  This is how products such as iWave’s Storage Automator work.  However adding these features to existing storage products could be costly and still be an imperfect solution.

The Storage Architect Take
As new storage platforms evolve, native API support is a must. The Storage Administrator will simply be required to deploy the infrastructure and plug it into a higher framework from where provisioning will be entirely automated.  Vendors offering this level of functionality will be the most attractive to service providers, looking to make the cost of acquiring and managing storage as cheap as possible. We’re about to see a paradigm shift in the way in which storage is managed and possibly an end to the storage administrator.

Read the original blog entry...

More Stories By Chris Evans

With over 23 years' experience in the IT industry, Chris M Evans has spent the majority of his career consulting to large organisations on storage issues. Starting in mainframe, his knowledge extends to Open Systems & Windows environments, looking not purely at technology but also the wider business implications of the implementation of technology. Chris runs his own consultancy with a number of like minded and colleagues. He maintains blogs at www.thestoragearchitect.com and www.thevirtualisationarchitect.com as well as writing for online publications.

Cloud Expo Breaking News
Have you ever stopped to ask the question, what is the biggest Big Data? If you haven't, it's probably because you don't imagine that it could have much to do with your day-to-day business concerns. But, in a real sense, you are already intimately involved in the ultimate Big Data. In his session at the 10th International Cloud Expo, Sandy Steier, CEO & Co-Founder of 1010data, will describe the largest possible dataset and show that, if you are involved with any data, you are automatically inv...
The SI Organization, Inc.'s (the SI) Chief Information Officer Steve DeLuca will speak at the 10th International Cloud Expo June 13 at the Javits Center in New York City. His session, "Transitioning a Full Enterprise to Cloud in Just 10 Months: Lessons Learned," will focus on the successful deployment of the SI's cloud-based infrastructure. The lessons learned from the SI's internal deployment will serve other organizations as they embark on similar transformations of their IT environments. ...
In his session at the 10th International Cloud Expo, Corey Scobie, Chief Technology Officer of SOA Software, will discuss how businesses are harnessing the power of APIs to reach new customers and markets. He will walk the audience through the growth and evolution of the API, why effective API management is important, how the game changes when companies expose business applications to the outside world. A brief history of the API How to use APIs to make money, save money, build brand "Appifi...
The company will demonstrate for the first time how to quickly onboard existing Windows applications to cloud computing providers. At the upcoming Cloud Expo New York, Racemi will demonstrate its online migration service Cloud Path that now makes migrating existing Windows servers to public clouds point-and-click easy. The company will demonstrate for the first time how to quickly onboard existing Windows applications to cloud computing providers, like Amazon EC2, GoGrid, Rackspace and Terrema...
“I think there is opportunity for this market to go far beyond analytics,” observed Margaret Dawson, Symform’s Vice President of Marketing, in this exclusive Q&A; with Cloud Expo Conference Chair Jeremy Geelan. “Again,” Dawson continued, “this goes back to how we can integrate these solutions with other related products/solutions to get a broader picture of what is happening across our business. I think an interesting intersection is Big Data and distributed compute processing.” Cloud Computing ...
Compuware Corporation on Wednesday announced that – in recognition of World IPv6 launch – the Compuware APM platform now supports IPv6 across its product brands – Gomez and dynaTrace. This support will help organizations ensure the quality and performance of their web, mobile and cloud applications as they transition to IPv6, providing unparalleled insight into application performance regardless of the network used--IPv4 or IPv6. The Internet is going through a major architectural change as it...
ServiceMesh, provider of the market-leading cloud application management platform for Global 2000 companies, will participate in three speaking sessions at Cloud Expo 2012 New York, June 11-14 at the Javits Center in New York City. Cloud Expo is a global enterprise IT event that gathers thought leaders and industry experts from around the globe to discuss the latest issues and trends in cloud computing. ServiceMesh representatives will be available at booth #218 to deliver live demonstrations of...
SOA Software, a leading provider of SOA governance, cloud and enterprise API management products, will share innovative strategies for driving business growth through the use of APIs at Cloud Expo in New York, June 11-14, the company announced on Wednesday. Enterprises are increasingly making business applications available as APIs in order to drive business growth and expose new revenue and partnership opportunities. As a result APIs are reshaping the business landscape as dramatically as the...
Compuware Corporation, the technology performance company, on Tuesday announced that Michael Kopp, a Technology Strategist for Compuware's application performance management (APM) business, will present a session titled: "How to Do Application Performance Monitoring in the Clouds: Lessons Learned" at Cloud Expo 2012 New York in New York City. Organizations face the challenge of monitoring and managing performance in clouds every other day. Not only is APM different in a cloud, but all clouds ar...
CloudStack has been the platform of choice for more than a hundred public and private production clouds. In his general session at the 10th International Cloud Expo, Shannon Williams, VP of market development for the Cloud Platforms Group at Citrix and a co-founder of Cloud.com, will provide an insider view and discuss the company's experiences in designing the right architecture for your cloud. Shannon Williams is vice president of market development for the Cloud Platforms Group at Citrix, ...