Performance monitoring in Cloud computing // IT Management Solutions

Performance monitoring in Cloud computing

Are your applications moving to an elastic cloud infrastructure? The question is no longer if, but when – whether that is a public cloud, a private cloud, or a hybrid cloud.

Classic computing capacity models clearly indicate that over-provisioning is essential to keep up with peak loads of traffic while the over-provisioned capacity is largely left under-utilized during non-peak periods. Such over-provisioning and under-utilization can be avoided by moving to an elastic cloud-computing capacity model where just-in-time provisioning and deprovisioning can be achieved by automatically scaling up and down on-demand.

(Source: )

Cloud auto-scaling decisions are often made based on infrastructure metrics such as CPU Utilization. However, in a cloud or virtualized environment, infrastructure metrics may not be reliable enough for making auto-scaling decisions. Auto-scaling decisions based on application metrics, such as request-queue depth or requests per minute, are much more useful since the application is intimately familiar with conditions such as:

  • When the existing number of compute instances cannot handle the incoming arrival rate of traffic and must elastically scale up additional instances based on a high-watermark threshold on a given application metric
  • When it’s time to scale back down based on a low-watermark threshold on the same application metric.

The basic flow for auto-scaling using AppDynamics is shown in the diagram below:Every application service can be expressed as a statistical model of traffic, queues and resources as shown in the diagram below.

  • For a given arrival rate λ, we need to maximize the service rate μ with an optimum value of n resources. Monitoring either the arrival rate λ itself for synchronous requests or q depth for asynchronous requests will help us tune the application system to see if we need additional service compute instances to meet the demands of the current arrival rate.
  • Having visibility into this data allows us not only to find bottlenecks in the code but also possibly flaws in design and architecture. AppDynamics provides visibility into these application metrics.

Let’s take an example to illustrate how this actually works in AppDynamics. ACME Corporation has a multi-tier distributed online bookstore application running on AWS EC2:

The front-end E-Commerce tier is experiencing a very heavy volume of requests resulting in the tier going into a Warning (Yellow) state.

You might also like

I did some of that.

by CalifornianNative

My ex-employer told me he will subcontract a job to me to install a composite material vacuum and temperature monitoring system. I designed and bid it, but he does not want the work. He told me I can have all the profit if I assume responsibility for providing satisfactory performance. The cost of my monthly California State Disability Insurance and liability insurance was more than he would make on the job. There is not enough profit in automation and instrumentation anymore.
Kudos to you on providing a very comprehensive skill list for the aspiring manufacturing engineer. You might want to add machine vision

Resume feedback request...

by ej20g

I'm looking for a new job. So far, this resume has gotten me nowhere. Any obvious problems? Too much crap? I'm looking for a mech engineering job, btw. Thanks
University of California, Berkeley
Bachelor of Science Degree in Mechanical Engineering
Research Engineer, ***************, February 2005-Present
Conducted ASTM performance tests on a variety of commercial food service equipment and authored reports on respective equipment
Contributed to the development of ASTM test methods for food service equipment
Introduced mathematical model used in the simulation of commercial water heating systems with unsteady flow characteristics
Prepared and performed presentations related to commercial water heating
Automotive Technician/Consultant, Independent, September 2001-December 2004
Offered consultation on performanc…

McGraw-Hill Osborne Media VCP VMware Certified Professional vSphere 4 Study Guide (Exam VCP410) with CD-ROM (Certification Press)
Book (McGraw-Hill Osborne Media)

Senate panel OKs $51 billion for Commerce, Justice, Science  —
One sticking point is the House's desire to limit funding for the National Strategy for Trusted Identities in Cyberspace, a plan designed to come up with a new system for managing identities online.

McGraw-Hill Osborne Media Effective MySQL Replication Techniques in Depth
eBooks (McGraw-Hill Osborne Media)
O'Reilly Media The Art of Capacity Planning: Scaling Web Resources
Book (O'Reilly Media)
  • ISBN13: 9780596518578
  • Condition: New
  • Notes: BRAND NEW FROM PUBLISHER! 100% Satisfaction Guarantee. Tracking provided on most orders. Buy with Confidence! Millions of books sold!
THiNKaha # IT OPERATIONS MANAGEMENT tweet Book01: Managing Your IT Infrastructure in the Age of Complexity
eBooks (THiNKaha)
Lenovo Lenovo ThinkPad Edge 688646U E431 14-Inch Touchscreen Laptop (Black)
Personal Computer (Lenovo)
  • Intel Core i5-3230M 2.6 GHz Processor (3 MB Cache)
  • 4 GB DDR3 RAM
  • 128 GB Solid-State Drive
  • 14-Inch Touchscreen Display, Intel HD Graphics 4
  • Windows 8 Professional, 5-hour battery life

Related Posts

Copyright © . All Rights Reserved