2nd International Workshop on Collaboration and Cloud Computing (CCC)

April 14, 2010 - Leave a Response

Theme: Computing Clouds with Telecom Grade “Trust” and Global Interoperability

The combination of hardware assisted virtualization and the broadband Internet have taken the Information Technology (IT) hosted managed services to a next level of evolution, where the software applications have become independent of the hardware infrastructure and can be migrated at will.  This introduces two key issues that need to be addressed to fully leverage the potential that the new servers and virtualization offer:

  1. The operation and management of virtual services have to be decoupled from the operation and management of the server, network and storage physical infrastructure that hosts them
  2. Resource provisioning must be application sensitive, dynamic to meet the transient nature of services that can migrate and must accommodate latency constraints of services that utilize them.

The second international IEEE Workshop On collaboration & Cloud Computing under the aegis of  19th IEEE

International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises (WETICE) 2010, is devoted to address the operation and management issues in the next generation cloud computing.  Seven papers discuss various aspects of bringing telecom grade “trust” and global interoperability to distributed collaborating computing clouds:

  1. Next Generation Cloud Computing Architecture: Enabling Real-time Dynamism for Shared Distributed Physical Infrastructure
  2. A Framework of Scientific Workflow Management Systems For Multi-cloud Orchestration Environment
  3. Application Development: Fly to the Clouds or Stay In-house?
  4. Using Virtualization to Prepare Your Data Center For “Real-time Assurance of Business Continuity”
  5. CloudGauge: A Dynamic Cloud and Virtualization Benchmarking Suite
  6. Enterprise Usability of Cloud Computing Environmenr: Issues and Challenges
  7. Creating Next Generation Cloud Computing Operations Support Services By Social OSS Contributions With Telecom NGN Experience

WETICE 2010 will be hosted from June 28th to June 30th, 2010, at the:

     DDE Building
     T.E.I. of Larissa
     Zip 411 10,
     Larissa, Greece

WETICE is an annual international forum for state-of-the-art research in enabling technologies for collaboration, consisting of a number of cognate workshops.  WETICE-2010 is co-sponsored by the IEEE Computer Society Technical Committee on Data Engineering.  So far 18 WETICE conferences have taken place under the co-sponsorship of IEEE CS.  What sets WETICE apart from larger conferences is that the workshops are kept small enough to promote fruitful discussions on the latest technology developments, directions, problems, and requirements.  Each workshop includes paper presentations, workgroup discussions, keynote sessions and a final joint session to summarize each groups’ findings.  The Proceedings will be published by IEEE CS Press and distributed at the conference.  WETICE 2010 includes also plenary invited presentations by experts from academia and industry and a Young researchers workshop on Services particularly tailored at PhD students.

For details on how to register, please visit http://WETICE.org

Does the New “Virtual Network” Spell Sunset to the Heterogeneous Physical Network Infrastructure as We Know in Today’s Data Centers?

March 5, 2010 - 3 Responses

 

“There is nothing more difficult to take in hand, more perilous to conduct, or more uncertain in its success, than to take the lead in the introduction of a new order of things.”                      –Niccolo Machiavelli, “The Prince”  1469-1527

In spite of Machiavelli’s warnings, human endeavor strives to introduce a new order of things time and again.  This is more so in technology than in any other human undertaking.  Current industry effort to transform the Information Technology delivery using virtualization is a case in point.  This quote from a startup company Vyatta spells out the future that the new hardware assisted virtualization in the multi-core multi-CPU servers are offering to fully transform the nature of the next generation data center.

“Vyatta is bringing innovation and affordability to the networking industry by delivering advanced routing and security in a software-based network OS that scales from the branch office to the service provider edge. Vyatta has decoupled networking software from proprietary hardware allowing users to leverage the price and performance advantages of standard x86-based hardware and components as well as Citrix XenServer and VMWare virtual or cloud environments.”

We have seen the sunset networking technologies before.  The current generation technologists probably do not know what an analog or step-by-step switch is or that ATM once stood for next generation broadband technology.  While IBM still continues to support SNA, many of the people who can spell out what SNA stands for are either retired or dead.  As the following quote from Wikipedia points out, a vestige of legacy still continues.  “While IBM is still providing support for SNA, one of the primary pieces of hardware, the 3745/3746 communications controller has been withdrawn from marketing by the IBM Corporation. However, there are an estimated 20,000 of these controllers installed and IBM continues to provide hardware maintenance service and micro code features to support users. A robust market of smaller companies continues to provide the 3745/3746, features, parts and service.”  The rest of the world moves on.

As Vyatta correctly points out the decoupling of virtual services from physical hardware infrastructure offers a new simplification of the next generation virtual data center by eliminating a host of proprietary appliances, protocols and siloed management systems.  Elimination of heterogeneous cable tangling and the interoperability issues with multiple protocols, that resulted from decades of overlay network evolution, is made possible by the “virtual network” inside the server smoothly integrating with the broadband transport network outside the server.  It offers a paradigm shift with multi-fold reduction in Total Cost of Ownership (TCO). 

However what is not appreciated is that the new infrastructure and advances in virtualization technologies offer a new distributed workflow implementation with telecom grade trust where self configuring, self monitoring and self-optimizing services collaborate to offer latency sensitive cpu-to-spindle connections on demand.  Instead, many of the efforts today are going toward consolidating existing applications, which are tied to physical infrastructures that are proprietary and burdened with layers of administrative systems,thus contaminating the simplicity of the new architecture.  Is this “old wine in a new bottle” approach (perhaps square pegs in round holes is a better metaphor) the right approach to realize the orders of magnitude improvement that the new generation of servers offer? A clear example is running a current Fibre Channel dependant application as a virtual application.  Imagine the complexity that will be ported inside the server when two Fibre channel based applications with multipathing are implemented in a virtual server.  Performance optimization in such an environment will be a nightmare.  Even Fibre Channel over Ethernet attempts seem artificial and run counter to choosing the best architecture that exploits virtualization with management simplicity and agility using dynamic provisioning.

The raw chip performance that is tenfold along with hardware assisted virtualization of CPU and memory in the new server architecture offer an unparalleled opportunity to improve the way business workflows are implemented.  They offer an opportunity to eliminate decades of layered appliance complexity with multiple protocols with their own interoperability and management overhead.  For the first time, it is possible to replace myriad point solutions that have been strung together in the guise of “open systems” with next generation integrated solutions for the cost of maintenance of today’s systems alone.   It is estimated that 80% of current IT budget goes to maintaining existing systems than creating new services to serve the business needs. 

There are two key issues that need to be addressed to fully leverage the potential that the new servers and virtualization offer to avoid putting old wine in the new bottle:

  1. The operation and management of virtual services have to be decoupled from the operation and management of the server, network and storage physical infrastructure that hosts them
  2. Resource provisioning must be dynamic and must accommodate latency constraints of services that utilize them.

Current server-centric operating systems that have evolved over few decades, where dedicated resources were assumed and the resources are statically provisioned to applications at install time, no longer fit the new model where services can be dynamically provisioned on-demand and shut-down when not in use.  New operating systems that provision distributed resources on-demand to match the latency tolerance of services that use them are required that go beyond today’s Hypervisors.  Distributed resource Fault, Configuration, Accounting, Performance and Security management has to be integrated with services and service FCAPS management with appropriate mediation to enable distributed self-managed business workflows that are latency tolerant.  Just automating existing administration processes using scripts to bridge current siloed management systems will not suffice. Leveraging hardware assisted virtualization  using next generation distributed operating system offers an opportunity to eliminate them.  Will the architectural simplicity of distributed computing clouds with hardware assisted virtualization trump the status quo of management complexity or the square pegs in round holes prevail?

The 2nd International IEEE Workshop is intended to continue the discussion of some of the innovative approaches started in the last workshop by bringing both the academic researchers and industry R&D leaders together.  Papers are invited to discuss innovative approaches that will enable next generation virtual data centers that will enable distributed collaborating computing clouds.

The last date for submission of papers is extended to:

March 14th, 2010.

Please submit your papers to workshop@kawaobjects.com

For details on how to contribute papers and how to participate in the workshop, please visit

www.wetice.org

www.workshop.kawaobjects.com

Is The Hardware Assisted Virtualization, The Next Big Thing To Commoditize IT With Stunning Return On Investment?

March 1, 2010 - Leave a Response

A friend of mine recently sent me a picture (source unknown) showing the predictions of Information Technology by RAND scientists.  On the right is a new generation server that promises 9X performance compared to servers deployed today in our data centers.  We have certainly come a long way!  The new servers offer three compelling reasons to refresh current data centers by replacing the old with the new:

  1. Energy cost reduction,
  2.  High performance using multi-core, multi-CPU processors with high bandwidth throughput and
  3. Hardware assisted virtualization enabling service agility, high availability and disaster recovery

While the energy and space savings and high performance provide impressive return on investment by themselves, what is perhaps being overlooked is the disruption that hardware assisted virtualization could potentially usher in by truly enabling the hardware infrastructure operation and management to be completely decoupled from application implementation, operation and management.  Virtualization allows the composition of logical servers with a choice of service levels for computing, network and storage resources independent of physical infrastructure composition or physical location.  Only a fraction of the potential has been so far realized – thanks largely due to the various Operating Systems and software-based hypervisors which provide multi-tenancy capabilities resulting in significant power and space savings through the consolidation of multiple applications on the same hardware.  In addition, the ability to migrate virtual applications from one physical infrastructure to another has radically transformed the way high availability and disaster recovery are implemented. 

However, the real potential of virtualization is not fully exploited for the following reasons:

  1.  Current generation Hypervisors (the operating systems that provide computing, network and storage resource management for applications that use them) have evolved from current server-centric operating systems and do not allow a clean separation of hardware Fault, Configuration, Accounting, Performance and Security (FCAPS) management from services FCAPS management to fully exploit the hardware and software decoupling.
  2. Each OS vendor, in order to claim dominance with their existing products, offer other OSs as “guest OSs” without providing same level integration services across multiple Oss.  This makes the real life implementations, very management intensive, cumbersome and error-prone to really operate in a heterogeneous environment.  
  3. Current method of using Virtual Machine Images that include application, OS and storage images does not provide on-the-fly composition and decomposition of application services. 
  4. More importantly, current server implementations of Hypervisors do not exploit the potential of sharing distributed resources across physical and geographic boundaries and provide latency based composition of logical servers to fully utilize the power of distributed resources.

True power of network-centric computing (in contrast to server-centric computing) will be unleashed only when the operating system provides latency sensitive FCAPS management of distributed server, network and storage resources.

There are two schools of thought that are emerging to shape the future course of virtualized datacenters:

  1. The Incrementalists:  Most vendors who have existing products would like the incremental approach to add additional layers to support virtualization.  They usually provide minimal support to other vendor products and offer “put the other guy’s system behind my system for management” approach.  Windows support of Linux and Linux support of Windows fall in this category.  While they pretend to support other approaches, they will tend to enhance their own approach to show differentiation.  Their main argument is that customers have embedded-base  and do not like fork-lifts.  The incrementalists offer incremental layers of management systems, bridge systems and a plethora of services to assist their customers implement their solutions.  They show how their point solutions incrementally improve the ROI
  2. The Disruptionists:  Most startups who do not have vested interest in existing solutions attempt to show how disruption can bring orders of magnitude cost savings by eliminating many of the existing point solutions.  They offer fully decoupled services architecture in which hardware becomes commoditized and all services are virtual applications.  They claim that the new multi-core multi-CPU servers, high bandwidth SAS storage, and gigabit Ethernet offer new simplification that can eliminate a host of complex server, storage and network management systems by unifying the logical resource management.  The dynamic provisioning that virtualization offers can be used to eliminate the current system administration paradigm that has evolved over last few decades from a server-centric IT.  By leveraging the decoupling of physical infrastructure from logical servers and implementing latency based dynamic provisioning of resources, new application architectures are possible that dramatically simplify the implementation of business workflows with greater agility.  They envision that the orders of magnitude productivity improvements will naturally lead to a refresh of current data centers and provide an impetus for changing application architectures.  They point to current efforts by SAP and Oracle to reengineer their applications to meet the new drive towards offering these applications as Software as a Service (SaaS).  They claim that the disruption of the vendors is a good thing without disrupting the customer businesses.  They also assert that a seamless migration is possible with the use of virtualization.

Virtualization offers a dramatic opportunity for improving the next generation data center.  How we get there will be decided by a few innovators in the next few years. 

As server technologies are radically transforming the way the next generation data center is going to be virtualized, are the network and storage vendors caught in a dilemma that faced Frame Relay vendors when SONET was introduced and ATM switch vendors faced when IP networking became a viable data networking solution with voice thrown in for free?  Will today’s specialized router appliances, network security appliances, Fibre Channel SAN solutions, point to point replication services and many of the appliances that were once essential become irrelevant in the new virtualized data center architecture where self-managed virtual applications are decoupled from the hardware on which they reside?  Will the servers, network and storage devices become commodity infrastructure just as washers and dryers are in a big Laundromat?  Will the virtual applications fly in and fly out, turned on and turned off based on workload demands and business priorities? Will the Work-flows be implemented with distributed business intelligence and the services have no loyalty to physical infrastructure?  Will the physical infra-structure be like buildings for rent where self-managed service groups move-in and move-out at will to implement distributed business workflows?

Following the inaugural workshop from last year on collaboration and cloud computing, the 2nd International IEEE Workshop under the aegis of WETICE 2010, (19th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises) is inviting papers from both incrementalists and the disruptionists to present their views of the future.  The last date for submission of papers is extended to:

March 14th, 2010.

Please submit your papers to workshop@kawaobjects.com

For details on how to contribute papers and how to participate in the workshop, please visit

www.wetice.org

www.workshop.kawaobjects.com

Can Today’s Systems Administration Paradigm, Albeit Automation, Move Us To Telecom Grade “Trust” In The Clouds?

January 12, 2010 - Leave a Response

SHORT ATTENTION SPAN SUMMARY  

Telecommunication systems have evolved over a century to develop a reputation for service reliability often referred to as “Telecom Grade Trust”.  The Internet embraced many of the concepts from Telecommunications Network to establish the same level of trust and provide data and voice convergence.  The Internet has since allowed many services to be delivered that facilitate communication, collaboration and commerce at the speed of light.  However, these services are developed and delivered from the Information Technology infrastructure that has different characteristics from the Internet and the Telecommunications infrastructure.  This explains why many of the services such as e-mail from Google, or e-mail delivered through Blackberry handheld device do not offer a similar level of Telecom-grade trust.   

In the past, the mainframe systems did provide a high degree of reliability, security and performance, but had other problems with agility, linear scaling and high cost.  This led to the current IT systems administration paradigm that evolved over the last forty years with an open-systems approach.  It is based on the assumption that the time-scales of systems administration are slow enough to tolerate human latency.  However, the evolution of communication, collaboration and commerce at the speed of light is demanding a systems administration process that allocates the right resources to the right application at the speed of light based on business priorities and changing workloads.   

The dissonance between services transcending space and time boundaries and their management requires a re-engineering of current IT infrastructure to eliminate the latency.  Just automating current processes only adds to the complexity and both the system and software vendors have to reexamine the administration paradigm to leverage the advances in multi-core, multi-CPU hardware and virtualization technologies.    

The 2nd IEEE International workshop on collaboration and cloud computing is challenging the academicians and industry researchers to develop new architectural simplification of the solutions.    

SOME THOUGHTS FOR REFLECTION:  

As a colleague of mine from AT&T Bell Labs used to say, “Software is human knowledge encapsulated in executable form as opposed to manuals where it is encapsulated in non-executable form requiring a human agent to execute.”  During the past fifty years, as more and more human knowledge from many domains is translated into executable form using workflow automation, the way we communicate, collaborate and conduct commerce has transcended space and time boundaries only limited by the speed of light.  While Information Technologies (IT) have facilitated this transformation, many have started to question their effectiveness.  Instead of repeating the same arguments about Return On Investment and Total Cost of Ownership conundrum, lack of agility or how 70% of IT investment goes into its own maintenance thus robbing resources from new solutions development, I would like to follow Arnold Kling and Nick Schulz [1] in identifying the “intangible assets” and ”the hidden liabilities” in today’s IT infrastructure.   It suggests some new directions for the systems and software evolution and the hope is that the participants of the Second International Workshop on Collaboration and Cloud Computing will discuss some new ideas.    

According to King and Schultz, the “intangible assets” are knowledge bases.  This category includes formal scientific findings and technological innovations.  Multi-CPU, multi-core Servers, virtualization technologies, mobile technologies, green technologies and software innovation fall into this category.  It also includes less formal learning from experience, such as the know-how and workflows that improve productivity (automated or otherwise).  “Hidden liabilities”, on the other hand, are institutional and cultural impediments to innovation and productivity.  These range from structure and conduct of government to the attitudes and customs of ordinary citizens.”  We can include current vendor reluctance to change status quo, short-term economic pressures from the Wall Street casino, embedded legacy processes and plain inertia that discourages change to the list.  Economics 2.0, as they call it, emphasizes the role of innovation and entrepreneurship to overcome the market failure to change from status quo and incremental innovation to a paradigm shift and order-of-magnitude improvements.   

The authors claim that “conventional economics is focused on how we can allocate resources efficiently.  In this view, the story is that markets facilitate trade and thereby foster efficiency but do little else.  With painstaking graphs and numerical examples, the professor shows that both sides of trade benefit from the exchange, whether trade takes place within a national border or across it.  These calculations explain why it is better to outsource your ironing to a laundry than to do it yourself.  Economics 1.0 explains that trade is based on comparative advantage.  Economics 2.0 says, yes, it is more efficient to send your shirts to a laundry than to iron them yourself.  But have you heard of permanent press?  Thanks to technical progress, many shirts today do not need to be ironed at all.  Perhaps in another decade, or two, they will not need to be washed.  Given the likely progress of nanotechnology, there is a good chance that the shirts manufactured in 2020, will be “permanent clean.”     

Current open systems approaches that profess choice and diversity have also introduced complexity.  Any systems administrator will immediately acknowledge the complexity of diagnosing troubles and the amount of time spent on dealing with the idiosyncrasies of different hardware and software systems.  Despite vendor claims of one-click installations, configuring new hardware and software takes trial and error, visits to many web-sites for answers to similar problems, thick volumes of reading material and multiple downloads of patches from different vendors.  Recently, I spent three weeks to install and make Windows server 20008 R2 work on a Dell PowerEdge 2970 and another four weeks to bring up Ubuntu on the same machine as a virtual guest OS  inspite of excellent support from Dell and very good design of both Windows and Ubuntu systems.  The productivity loss in the universe is directly proportional to the number of systems, even granting the new automation assistance from various sources.

The current approach to throw software and systems out and offer services for recurring revenue to assist customers and make them operational is not a scalable approach as more consumers become computer sytems dependent, and neither is asking each consumer to become a geek to use the technology.   Unless we find ways to create systems that are self-configuring, self-monitoring, and self-healing, the benefits of intangible assets in current IT industry will be outrun by the costs of hidden liabilities.    

Both POTS (Plain Old Telephone System) and PANS (pretty Amazing New Services) infrastructures have evolved to embrace many of the self-configuring, monitoring and healing attributes through Intelligent Network (IN) architecture and distributed systems management.  It is time to learn from the past and reexamine current IT infrastructure evolution.  With the advent of Virtualization, multi-CPU and multi-core servers and our current understanding of distributed computing and operating systems, it is possible to reexamine the systems administration paradigm and eliminate various steps we take today (albeit automated) and re-engineer the IT infrastructure to eliminate unnecessary human latency.    

Evolution from POTS, PANS and SANs to Intelligent Collaborating Cloud Network (ICCN)

 Figure 1 shows the evolution of current communication and computing infrastructure.  The Internet combined with virtualization technology allows the software systems to transcend physical, geographical and time boundaries to enable human communication, collaboration and commerce at the speed of light.  However, tying the new technologies to legacy evolution only slows down the growth.  What we need is a bold and new approach that leverages the new technologies to progress rapidly while wrapping the legacy to integrate smoothly with future advances.  We have done this before with COBOL programming, digital switching and wire-line to wireless transitions.

 Now imagine you are a vending machine and the supply of the soft drink you are dispensing is running out.  You would like to call the local supplier who can replenish your supply just in time.  Imagine that you are being vandalized and you would like to call for help.  Imagine now, you are a vendor providing a group of vending machines in a mall.  Wouldn’t it be economical to create a local gateway that keeps an eye on the safety and supplies of the group?  By the way, you can also remotely monitor, manage and optimize your small vending cloud.     

You can imagine similar scenarios with home computing, entertainment, education, healthcare, security monitoring, and remote control systems.  When a new device or a service is added or removed, you would like it to be added or removed transparently to the management systems that provides local Fault, Configuration, Accounting, Performance and security (FCAPS) optimization and collaborate with remote distributed entities to extend FCAPS management globally.      

On a larger scale, you can imagine local power grid systems being FCAPS managed locally and being connected with other distributed grid systems to provide global management and optimization strategies.  These scenarios are possible because of the deployment of intelligence in distributed computing elements with networking and storage, which can communicate with other elements on demand.   

 With collaborating computing clouds, it will be possible to provide same features that Wall Mart and other large organizations use to small businesses without breaking their bank accounts.  Management of Power Grids will be as easy as current telecommunications management systems that assure voice and data with “Telecom Grade Trust”   

 The above examples illustrate the more general distributed computing services network model where managed workflows are implemented using clusters of computing networks organized in various topologies that are optimal to support the overall end-to-end objectives taking into account service latency tolerance.  Four major technology advances have made this architecture efficient and effective:    

  1. Proliferation of powerful Commercially Off The Shelf (COTS) computing processors, network connectivity and storage at affordable cost embedded in a variety of edge devices to monitor and control local environments
  2. Higher bandwidth networks and ubiquitous wire-line and wireless connectivity allowing workflow implementations with desired latency tolerance
  3. Virtualization technology that no longer requires application software (used to implement services executing the components of a local or global workflow) to be tied to a particular physical infrastructure in a particular location and
  4. Distributed computing software advances that provide latency tolerance, high availability, end to end security, performance optimization and improved resource utilization

The combination of virtualization and the broadband Internet have taken the Information Technology (IT) hosted managed services to a next level of evolution, where the software applications have become independent of the hardware infrastructure and can be migrated at will.  In addition, the service creation, which once was in the purview of IT software development groups exclusively, has been democratized and anyone with the access to the network can now start developing new services on virtual servers and deploy them in the market place to meet wildly varying workload conditions.  This is very similar to the Intelligent Network deployed to deliver voice and data services in the past with service creation, delivery and assurance platforms to connect billion of users.  The following figure shows the old IN model modified to show the new trend.   

        

This new architecture fundamentally alters the way in which current IT infrastructure is deployed by virtualizing all the functions that are hardware or appliance oriented such as load balancers, firewalls, and even routing functions.  In the limiting case, it is easy to imagine that all physical computers, network elements and storage systems becoming completely commoditized just like washers and dryers where virtual services are being deployed through virtual servers with specific functionality and appropriate latency management.  This allows implementing business workflows using managed distributed computing elements with unparalleled agility.    

The distributed computing model that allows individuals to form groups, set goals and implement workflows leveraging specialization and separation of concerns has been evolving over centuries to create distributed human networks and allowed groups, organizations and even nations to scale with a purpose.  The main purpose of the distributed computing networks is to optimize the distributed resource utilization to accomplish the goal.  In its essence, distributed computing enables execution of workflows by a network of distributed agents to accomplish the overall goal of the group.  In most cases, the workflow tasks involve:    

  1. Monitoring local environments by gathering information
  2. Pre-process, filter and prepare the information to be correlated or used by other agents
  3. Make decision to provide local control and optimization based on global policies
  4. Correlate and analyze the information gathered by different agents in light of group’s objectives
  5. Make relevant decisions based on the analysis
  6. Request actions based on the decisions from different agents and
  7. Execute various actions based on the requests to control or manage local environments

While virtualiation technology commoditizes the computing hardware, by making the service execution independent of underlying hardware, by allowing movement at will, the distributed computing network implementation provides a new opportunity to the chip and system vendors to support features that allow the implementation of dynamic local FCAPS management in hardware, hypervisors and operating systems thus providing efficiency and global interoperability.  This will allow creating local services with dynamic FCAPS management and a managed network of distributed computing services.  By combining virtualization and the distributed computing network model, we can create clusters of computing networks interconnected to implement managed workflow implementations with latency tolerance to meet the business objectives.  This is equivalent to implementing distributed computing clouds, each cloud offering the services of a mini-data center where local workflows are implemented and managed through coordination and collaboration with other mini-clouds.  
 
The chip and computer vendors can play a substantial role in simplifying the implementation of these services by incorporating specific service enabling features that support local FCAPS management and interoperability with other clouds.  This has been done before in telecommunication networks and IP service networks.  For example when the routers were first introduced routing tables had to be manually entered.  Every time the router was switched off, the tables had to be reentered to start the service.  FCAPS management was added as an afterthought to reduce the tediousness of operation and management.  In telephony, dynamic provisioning altered the service economics substantially.  Similarly, if the cloud appliances (with computing, networking and storage services) are not designed with operation and management ease at the chip level, and appropriate operating systems are not designed to address FCAPS management of virtual servers, distributed computing networks cannot scale to implement distributed managed workflows that address latency issues.  Will this provide the chip vendors and hardware vendors a completely new opportunity?   Are there solutions that go beyond automating existing processes that evolved over last four decades incrementally adding enormous complexity?  Is network-centric resource management different from server-centric management we are used to today?
 
One clear lesson we can take away from POTS, PANS and SAN implementations is that when resources are distributed and shared, they need to be managed to compose them and provide servics to their consumers with appropriate end-to-end service level assurance.   Service consumers and resources require mediation to resolve contention for shared resources and resolve conflicts based on global business priorities.  Services that enable communication, collaboration and commerce at the speed of light demand dynamic services management at the speed of light.  

A successful implementation of IN required a smooth integration of hardware and software features that provide dynamic resource management.  Virtualization offers a new opportunity to provide dynamic IT resource management.  The 2nd International IEEE Workshop is intended to continue the discussion of some of the innovative approaches started in the last workshop  [2] by bringing both the academic researchers and industry R&D leaders together.  Now let us go back to the first picture you saw.  If you see a way to go from the present to the future in the picture, you are cordially invited to contribute a paper to this workshop and try to establish leadership in creating the next generation cloud computing.  You may change the game and prove the postulates of Economics 2.0.  

 Refereces Cited:
[1] Arnold Kling and Nick Schulz, “From Poverty to Prosperity: Intangible Assets, Hidden Liabilities and the Lasting Triumph Over Scarcity”, Encounter Books, New York, London, 2009   

[2]     P. Goyal, “The Virtual Business Services Fabric: an integrated abstraction of Services and Computing Infrastructure,” in Proceedings of WETICE 2009: 18th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises, 33-38 (2009).

From POTS, PANS and SANs to Clouds – Is it a new opportunity for the Telecom and IP network service providers?

December 4, 2009 - Leave a Response

POTS, PANS and Computing Clouds

In 1907 Theodore Vail, the then President of AT&T, stated that “the telephone by the nature of its technology would operate most efficiently as a monopoly providing universal service.”  Vail wrote in that year’s AT&T Annual Report that government regulation, “provided it is independent, intelligent, considerate, thorough, and just,” was an appropriate and acceptable substitute for the competitive marketplace.   

From the beginnings of AT&T to today’s remaking of at&t, much has changed but two things that remain constant are the universal service (on a global scale) and the telecom grade “trust” (providing reliable, secure and high performance connection at a reasonable cost) that are taken for granted.  This was made possible with technology and process innovations with the support for institutionalized R&D at AT&T Bell Labs.   

The Internet on the other hand evolved to connect billions of computers anywhere, anytime from the prophetic statement made by J.C.R. Licklider ”A network of such [computers], connected to one another by wide-band communication lines [which provided] the functions of present-day libraries together with anticipated advances in information storage and retrieval and [other] symbiotic functions.”  Starting with three computers connected in 1969, the network grew to 213 by 1981.  The IETF was formed in 1985.  It used the Request for Comments (RFC) process to develop and promote the standards that drove the growth of the Internet by transforming the “send and pray” network to a reliable, secure and high performance network.   Many concepts from POTS (Plain Old Telephone Service) were borrowed to create a robust Internet infrastructure including FCAPS (Fault, Configuration, Accounting, Performance and Security) management. 

Two major trends occurred that changed the communications landscape and fueled the convergence of Telecommunications, the Internet and the cable networks resulting in Pretty Amazing Network (New) Services (PANS)  predicted by Negroponte from MIT Media Lab:     

  1. Moore’s Law stated in 1965, that computers double in capabilities every 18 months
  2.  Nielsen’s observation in 1995 that the Internet bandwidth was growing at 50% annual growth rate 

Three key developments contributed to the convergence according to Jean-Jacques Laffont, and Jean Tirole discussed in their book “Competition in Telecommunications”:     

  1. Drastic cost reduction of hardware infrastructure,    
  2. Bandwidth explosion and   
  3. Network intelligence and global interoperability made possible by signaling infrastructure    

The development of intelligent network (IN) multiplied the number of PANS and improved their quality.  The Telecommunications Act of 1996 hastened the convergence of voice and data and put an end to the “acceptable substitute” that Theodore Vail proposed.  The access to high bandwidth and the managed network intelligence created the current service explosion resulting in social networks and web-based commerce at the speed of light. As the services offered started to grow, the increased consumer demand created an explosion of insatiable growth for information storage.  As one IT manager of a well-known bank expressed, a new “Moore’s law” is in effect doubling the storage every eleven months.  This created a new opportunity to restructure the Information Technology deployment to deliver correct data to right business application on-demand in a secure way providing right performance, throughput and availability.   

Storage networking and resulting NAS and SAN technologies have changed the dynamics of the enterprise IT infrastructure in a significant way to meet business application needs but were not able to meet the cost constraints dictated by the mass services market.  Wild fluctuations in the workloads make it impossible to provision for meeting peak-load requirements cost-effectively.  This created a new class of service providers such as Amazon, Google and Microsoft to abandon the expensive and management intensive SAN strategy to develop an alternative storage strategy using commercially off the shelf (COTS) hardware and distributed web-based service oriented software architectures.  The resulting divergence between IT infrastructure supporting Internet-based consumer services such as social networking, email and video streaming applications and mission critical business applications requiring high performance and low latency tolerance is currently providing a new opportunity to reexamine the economics of IT management.  

The divergence between the mass-market service infrastructure and traditional business application infrastructure took a wider turn with the introduction of server virtualization that allowed dynamic server provisioning, application migration, dialup, and dial down of virtual server instances to meet wildly fluctuating workload demands.    While virtual servers have provided consolidation, flexibility, mobility, performance management and Disaster Recovery (by instantly replicating virtual servers) taking advantage of the new multi-CPU and multi-core physical servers, they have:   

  1. Reduced visibility within a virtual server, through layers of virtualization increasing indirection between logical and physical resources,  
  2. No control of CPU to spindle resources (dial-up or dial-down resources on demand) within each virtual server at run time to address changing workloads and business priorities (without elaborate administration whether it is manual or supported by layers of automation) and,  
  3. Increased cost and latency of diagnosing and resolving shared resource conflicts between multiple virtual servers, shared storage and network resources 

A side effect of virtualization caused by the resulting virtual I/O inside the server makes expensive SAN storage management infrastructure providing backend functions unnecessary for addressing application performance and availability.  Will this spell an end to the Fibre Channel industry just as the IP networks put an end to the Asynchronous Transfer Mode (ATM) switching?  Only time will tell. 

A more critical question is whether the vendor lock-in of the cloud approach today is preferable to the multi-vendor quilt approach for end-to-end optimization as pointed out by Tim Bray  “The small problem is that we haven’t quite figured out the architectural sweet spot for cloud platforms. Is it Amazon’s EC2/S3 “Naked virtual white box” model? Is it a Platform-as-a-service flavor like Google App Engine? We just don’t know yet; stay tuned.” Virtual server sprawl and their management have become more complex than physical server farm management. 

No cloud vendor has yet addressed satisfactorily, virtual server sprawl management by providing visibility and control to assure telecom grade trust to both service development and service delivery.  The management complexity introduced by open systems approaches of “landscaping”, “bursting”, etc are labor and knowledge intensive.    Three factors raise two important questions:   

  1. The inability, today, to easily dial-in or dial-out a virtual server from one cloud to another with telecom grade trust and visibility into resource performance,  
  2. The inability to dial-up or dial-down resources used by a single virtual server at run-time based on workloads without the complexity of systems administration, and  
  3. The lack of visibility and control to resolve contention between shared resources dynamically, among many virtual servers, based on business priorities without complexity and human latency. 

The two questions are:    

  1. When management issues and the resulting complexity are accounted for, is the cloud (whether private or public) using current virtualization technology which, depends on a whole virtual application image replication and or migration, cost effective?   
  2. Are there better alternatives?    

While current state of the art has not yet assured confidence with telecom grade trust, if approached correctly, the computing clouds present the last frontier in information technology revolution that will reduce complexity, provide global interoperability and telecom grade trust to networked computing resources.  Based on POTS, PANS and SAN experience, it is easy to see that reducing waste and providing telecom grade trust for accessing computing resources globally will have profound economic consequences.    

While the R&D capabilities of the Telecom and IP service providers have been decimated by the free market forces,  investments chasing bubbles and downright fraud from companies like WorldCom directly impacting companies such as AT&T, the survivors still do possess the institutional knowledge, the infrastructure and the cash required to deliver telecom grade trust in the cloud.  Unfortunately, many of the startup companies and other cloud players today, lack this knowledge and it is a long shot that they will come up with an innovative solution other than adding incremental layers of systems administration automation and proliferate an expensive services industry to manage the various management systems.  As one observer put it, the Venture Capitalists with a short-term focus on profits and no real long-term vision are in no mood to invest in true innovation unless “John Chambers walks in with an idea or there is a new product already making revenue”.  As another Silicon Valley veteran lamented “the VCs today are more often chasing the bubbles with a herd mentality than investing prudently on long-term vision based projects and make them happen with serious commitment to the end”.  On the other hand, current server and storage players do not like to disrupt their current streams of revenues from selling more software, shelfware and services by introducing innovation that will change the status quo and will eliminate the profitable services revenue.  This offers a good opening for the network service providers to retake the initiative with network-centric distributed computing with telecom grade trust.     

What the service providers need is an alliance with visionary (or hungry) COTS server vendors and COTS storage vendors to provide hooks to create the next generation Intelligent Network (IN) that delivers even more Pretty Amazing Network Services creation, delivery and assurance.  This approach has the potential to change the paradigm and create a 10X improvement from current approaches.  They have done it twice with POTS and PANS, but can they do it a third time?  A successful implementation of IN required a smooth integration of hardware and software features that are service enabling.  The 2nd International IEEE Workshop is intended to continue the discussion of some of the innovative approaches started in the last workshop by bringing both the academic researchers and industry R&D leaders together.

2nd International IEEE Workshop

July 31, 2009 - 4 Responses

Exploring Communication, Collaboration and Commerce at the Speed of Light

Starts: Monday June 28, 2010, 08:00AM
Ends: Wednesday June 30, 2010, 05:00PM
Event Type: Workshop
Location: Technological Education Institute of Larissa, Larissa, Greece
   
Website: http://www.workshop.kawaobjects.com
   
   
Intended For: Bringing together Academia and Industry: CIO’s, Technical Architects. Researchers, Scientists, Engineers, CTOs, Product Managers etc.
Organization: www.WETICE.ORG sponsored by IEEE

The Plain Old Telephone Service (POTS) created a services infrastructure that allowed billions of users to connect anywhere, anytime to communicate with each other. The Internet provided a services infrastructure that allowed billions of computing devices to connect with each other anywhere, anytime and allowed Pretty Amazing Network Services (PANS) that enabled communication, collaboration and commerce at the speed of light combining voice, data and video. Currently, three major breakthroughs are taking the computing and communication technologies to the next level of productivity by reducing the operations costs of business workflow implementation and creating a new infrastructure to deliver distributed latency tolerant workflow implementations with unprecedented availability, reliability, performance and security at the speed of light:

  1. Multi-CPU, multi-Core servers that allow consolidation of computing power with high degree of efficiency,
  2. Virtualization technology that no longer requires application software to be tied to a particular physical infrastructure in a particular location, and
  3. Distributed computing software advances that provide latency tolerance, high availability, end to end security, performance optimization and improved resource utilization

Combining these advances, new application centric architectures are being deployed that provide High Availability and Disaster Recovery at much lower operation and management costs. In addition, the Cloud offerings from various vendors are allowing web services software infrastructure to be deployed independent of the type and location of physical infrastructure. Virtual application servers, virtual load balancers, virtual firewalls and virtual applications are radically changing the way the next generation services are developed, deployed and managed. Cloud Computing is profoundly altering the software services landscape and the next generation Virtual Data Center is becoming the Central Office for application switching to deploy fully distributed latency optimized workflow implementations. The new paradigm has the potential to create self configuring, self monitoring, self healing and self optimizing distributed software systems which will radically reduce the cost structures of next generation services deployment and eliminate today’s knowledge and labor intensive IT management complexity.

Following the inaugural workshop from last year on collaboration and cloud computing, we are pleased to announce the

2nd International IEEE Workshop On collaboration & Cloud Computing

under the aegis of WETICE 2010, 19th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises.

Papers are invited to continue the discussion of many topics that were started last year in the 1st workshop.  Queries or papers can be directed to

workshop@kawaobjects.com

Papers will be reviewed by two program committee members for acceptance.

For details on how to contribute papers and how to participate in the workshop, please visit

www.wetice.org

www.workshop.kawaobjects.com

Discussions and papers from the 1st Workshop can be reviewed at

http://www.workshop.kawaobjects.com/2009-overview.html

Last conference identified following topics for further exploration:

  • Hardware assistance to dynamically compose computing, network and storage resources to create logical resource pools (transcending physical and geographical boundaries) that meet service requirements of the resource consumers such as latency tolerance, response time, throughput, bandwidth etc.
  • An operating system that allows the composition of logical resources dynamically by matching the hardware infrastructure capabilities and the resource consumer profiles
  • A service creation infrastructure that allows composition and assembly of logical resources to create business workflows and
  • A service management fabric that also is an assembly of logical resources to assure service delivery
  • The 2nd International IEEE Workshop On Collaboration and Cloud Computing will follow-up on these topics in Larissa, Greece.

    http://en.wikipedia.org/wiki/Larissa

    Follow

    Get every new post delivered to your Inbox.