<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Application Performance Engineering Blog - Shunra Software &#187; Load testing</title>
	<atom:link href="http://www.shunra.com/shunrablog/index.php/tag/load-testing/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.shunra.com/shunrablog</link>
	<description>Supporting application performance management for IT professionals</description>
	<lastBuildDate>Wed, 08 Feb 2012 21:51:07 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.1</generator>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
		<item>
		<title>3rd Party System Scalability? – “How Slow Can They Go”</title>
		<link>http://www.shunra.com/shunrablog/index.php/2010/10/20/3rd-party-system-scalability-%e2%80%93-%e2%80%9chow-slow-can-they-go%e2%80%9d/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2010/10/20/3rd-party-system-scalability-%e2%80%93-%e2%80%9chow-slow-can-they-go%e2%80%9d/#comments</comments>
		<pubDate>Wed, 20 Oct 2010 20:14:39 +0000</pubDate>
		<dc:creator>Tim Grant</dc:creator>
				<category><![CDATA[APM Partners]]></category>
		<category><![CDATA[Events]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Tips and Tricks]]></category>
		<category><![CDATA[3rd Party Software Performance]]></category>
		<category><![CDATA[HP]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[Network]]></category>
		<category><![CDATA[Network Catcher]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra for HP Software]]></category>
		<category><![CDATA[Shunra Software for HP]]></category>
		<category><![CDATA[Web load testing]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=2200</guid>
		<description><![CDATA[“How Slow Can They Go?” ...You definitely need to identify how slow your 3rd party providers can go before it starts to affect the performance of your sites. 
... don’t try to replicate that traffic, just impair the actual traffic...]]></description>
			<content:encoded><![CDATA[<p>Is your site dependent on performance of 3<sup>rd</sup> party content providers? Don’t say no too quickly! Most sites have 3<sup>rd</sup> party content in one way or another. Let’s talk about 3<sup>rd</sup> party SLA’s and the notion of testing your site so that you know how slow your 3<sup>rd</sup> party content can get before it significantly slows your site down.</p>
<p>You have probably encountered a situation where pre-launch load tests did not correlate with the way it performed in production.  There are a lot of reasons why this can happen, but for now, I want to focus on 3<sup>rd</sup> party content providers and Content Delivery Networks (CDN).  Almost everyone running a business today has some part of their application or Web presence farmed out to a 3<sup>rd</sup> party.  Think about what happens when you go online to buy gifts for the upcoming Holidays.</p>
<p>As you browse for that perfect tie for your dad, the site is likely to be serving static content from Akamai or Limelight, adds from 3<sup>rd</sup> party providers, and a shopping cart that may not be hosted by the company you are dealing with.  When you actually purchase that Tickle-me Elmo for your niece, the site processes your credit card by interacting with a financial institution and provides shipping tracking numbers by interacting with a major shipping company behind the scenes.  All that typically happens as you wait for the page to return in a few seconds if all goes as it should, but any of those 3<sup>rd</sup> party providers have a strong likelihood to disrupt the page load and make the site look like it is not responding.</p>
<p>Increased delays from these and other 3<sup>rd</sup> party providers do happen and you should definitely test for those scenarios, but how do you do that when you really do not have control over those sites. You definitely should perform load tests on the site as a whole to ensure that each 3<sup>rd</sup> party provider will scale to your targeted peak traffic and perform within their SLA as expected. In addition, you should think about how slow your 3<sup>rd</sup> party providers can get without affecting the performance of your site.</p>
<p>“How Slow Can They Go?” Yes, a corny statement, but to the point! You definitely need to identify how slow your 3<sup>rd</sup> party providers can go before it starts to affect the performance of your sites.  The real dilemma is replicating the traffic from the 3<sup>rd</sup> party site, which in the case of financial transactions can be very difficult plus your team can waste a great deal of time trying to do this. I’m suggesting that you don’t try to replicate that traffic, instead use the actual 3<sup>rd</sup> party traffic from the 3<sup>rd</sup> party site during the test. Here’s the catch, you impair the traffic coming from the 3<sup>rd</sup> party site real time. Simply single out that traffic in your usability studies using a tool like <a href="http://www.shunra.com/ve-desktop-overview">Shunra’s VE Desktop</a> to measure performance of the site with the 3<sup>rd</sup> party adds impaired or by slowing down the response from your credit card processing partner using a <a href="http://www.shunra.com/ve-appliance">Shunra VE Network Appliance</a> on your backend systems during a maintenance window.</p>
<p>Now think about scalability load testing for a minute. I recommend that you do not implicitly trust 3<sup>rd</sup> party and Content Delivery Network (CDN) provider’s scalability estimates and guarantees. You are probably scratching your head thinking that your CDN’s and other 3<sup>rd</sup> party content providers have massive server and network infrastructures that are impossible to overload. While it is true that the major 3<sup>rd</sup> party providers have massive infrastructures, the real question to ask yourself is this, “How much of that infrastructure is your content riding on?” Let’s just say that you actually do know how much of their infrastructure is dedicated to your cause, you still have to ask yourself the question, “Do I know for sure that it will handle the peak traffic?” Adding in impairments during a load test is easy using <a href="http://www.shunra.com/ve-suite-overview">Shunra’s VE Suite</a> or <a href="http://www.shunra.com/shunra_for_hp_software">Shunra for HP Software</a> which works seamlessly with Load Runner.</p>
<p>During my career I have load tested literally hundreds of different sites, and many of those sites had CDN and 3<sup>rd</sup> party content provided by very large companies that did not hold up to the load during a stress test. Let’s face it, regardless of the size, the CDN or 3<sup>rd</sup> party provider’s service can only scale to the level of infrastructure that is available to your site.  CDN content can fail to scale due to complex caching configurations that can get screwed up with one incorrect setting.</p>
<p>In more than one situation, I had a customer tell us that they were going to inform their CDN or 3<sup>rd</sup> party providers to “be ready” for the peak traffic that our load test was going to generate. They were usually shocked when I asked, “Why?” Their answer was typically, “We need to be responsible partners and let them know anytime we are doing testing.”  Clearly, I would normally agree with that statement for many different kinds of testing, but not in the case of load testing against an established Service Level Agreement (SLA)!  Here is the bottom line, if the CDN or 3<sup>rd</sup> Party has agreed to an SLA then that system should be ready to handle that load any time (barring timeframes specified in the SLA for maintenance windows, etc.).</p>
<p>In several load testing engagements, where the client let the CDN or 3<sup>rd</sup> party know about the load test, there were “additional resources” stood up to support the load test. Surprisingly, the system scaled during those times, but failed to scale when no notice was given ahead of time. Does that sound suspicious to you? If the answer is yes, then we are on the same mental wavelength. If you encounter problems with your 3<sup>rd</sup> party provider not scaling during your load test, and they will probably insist on “supporting” you during the next load test. Be sure that you ask your 3<sup>rd</sup> party providers the following questions:</p>
<p>What did you do to support this load test Vs. the last one?</p>
<p>What did you change in your infrastructure that allowed it to scale successfully this time?</p>
<p>Did you add infrastructure or change a setting?</p>
<p>In one situation, I heard a 3<sup>rd</sup> party provider tell my client that they stood up an extra bank of machines to support the testing that was happening that evening. My question to the customer was, “Does that sound strange to you?”</p>
<p>At the end of the day, we all need to admit to ourselves that even our monstrous 3<sup>rd</sup> party CDN partners can slow your site down, so you really should test how your site performs to the end user and how the infrastructure scales when they do slow down. Try to find out how slow each 3<sup>rd</sup> party provider can get before it impacts your site and ultimately the end user’s response time and build that into your Service Level Objectives and ultimately let that drive your Service Level Agreements with 3<sup>rd</sup> party content providers.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2010/10/20/3rd-party-system-scalability-%e2%80%93-%e2%80%9chow-slow-can-they-go%e2%80%9d/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Load Testing for Special Events and Holidays</title>
		<link>http://www.shunra.com/shunrablog/index.php/2010/07/09/load-testing-for-special-events-and-holidays/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2010/07/09/load-testing-for-special-events-and-holidays/#comments</comments>
		<pubDate>Fri, 09 Jul 2010 14:46:25 +0000</pubDate>
		<dc:creator>Tim Grant</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[HP]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[Network]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra for HP Software]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=2137</guid>
		<description><![CDATA[The holidays are not typically on our minds this early in the year given that it is currently early July and over 100 degrees Fahrenheit in portions of the Eastern USA. On the other hand, if you have an ecommerce site that has changed since the Holidays last year, then perhaps you should be thinking about gauging your traffic and applying a peak load to the site. Let’s not forget that even the biggest logos have had issues during peak traffic. Many large sites including HP’s outage in 2009, Wal-Mart’s outage in 2006, in 2008 Bloomingdale’s and J. Crew went down, and many others have made the news in recent years because their sites were note ready for the traffic. "...Load testing without taking latency into account gives the site an unfair advantage during load tests, which does not exist in the real world."]]></description>
			<content:encoded><![CDATA[<p>The holidays are not typically on our minds this early in the year given that it is currently early July and over 100 degrees Fahrenheit in portions of the Eastern USA. On the other hand, if you have an ecommerce site that has changed since the Holidays last year, then perhaps you should be thinking about gauging your traffic and applying a peak load to the site. Let’s not forget that even the biggest logos have had issues during peak traffic. Many large sites including <a href="http://answers.yahoo.com/question/index?qid=20091130124458AAOK5sV">HP’s outage in 2009</a>, <a href="http://news.cnet.com/Holiday-shopping-crush-stalls-Walmart.com/2100-1038_3-6138199.html">Wal-Mart’s outage in 2006</a>, <a href="http://noturnonred.org/2008/12/01/cyber-monday/">in 2008 Bloomingdale’s and J. Crew went down</a>, and many others have made the news in recent years because their sites were note ready for the traffic. Oh, by the way, you have to do your testing early enough to take corrective action before the holidays!</p>
<p>Now that I’ve startled you out of your summer doldrums, let’s talk about how you can perform your tests most accurately. First, let’s talk about an all-too-common pitfall of not taking network latency into account when building the load test. Most teams will load test their site to ensure it will hold up to capacity, but all too often the team fails to take into account the implications that network latency will have on their load tests. As a result, testing teams will run load tests from a single location, often the same location that the Website is hosted or from within the lab itself.</p>
<p>If you just asked yourself, “What’s the problem with doing it that way?”, then you seriously need to read the next two paragraphs!</p>
<p>Unfortunately, our web sites have finite resources resulting in limited scalability. Yes, even cloud sites  occationally suffer from this affliction, here are a few examples from this year <a href="http://www.crn.com/software/225701829">http://www.crn.com/software/225701829</a>. Load testing without taking latency into account gives the site an unfair advantage during load tests, which does not exist in the real world. This is especially true when your internet traffic hits on Cyber Monday. Think about it this way, when your load test generators are on the same network or physically very close to the Website, then packet round trip time is less than 1 millisecond. Now contrast that with users across the internet with packet round trip times of 30 to 50 milliseconds (that’s if your user is in the same country as the web server) or even 100 milliseconds or higher going to different continents. That translates into network connections staying open for 30, 50, or 100 times longer with internet user traffic compared to your lab setting. This is a significant difference which results in longer HTTP sessions, longer page downloads, higher simultaneous HTTP and application server sessions. This can even impact database activity. Ultimately, means Internet user traffic consumes more site resources compared to testing without the correct network latency.</p>
<p>I’ve conducted numerous load tests in a previous role, and I have literally seen websites crumble under Internet traffic that was less than half the load tested traffic where no network emulation was used during the load testing. Now think about all the other parameters that you should be thinking about, like packet loss, jitter, and the impact that the end user’s bandwidth has on the test dynamics.</p>
<p>Now, let’s re-run your load test and add in end user network impairment (latency, packet loss, bandwidth, and jitter) into the mix using <a href="http://www.shunra.com/products_overview">Shunra</a>. Because the network latency that we just discussed now matches that of the end user, you can expect an accurate estimation of the site’s true scalability. With <a href="http://www.shunra.com/products_overview">Shunra</a>, you can replicate users coming from a variety of locations so you’ll be correctly replicating the latency of users from multiple geographies for even higher accuracy.</p>
<p>To bolster the accuracy of the network emulation, Shunra has a <a href="http://www.shunra.com/network-catcher">Network Catcher technology</a> that records network latency and other impairments, and then allows you to use those conditions in products such as <a href="http://www.shunra.com/shunra_ve_desktop_for_hp_software_overview">Shunra for HP Software</a> while testing your systems. This is important because network latency changes throughout the day depending on internet traffic.  Thus internet latency at noon is not the same as it might be at 2AM, when many sites conduct their off hours load test.  With Shunra all the network guess-work is taken out of the load test process and you are left with a more accurate load test. That’s powerful! And it’s one of the reasons that I joined the team here at Shunra.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2010/07/09/load-testing-for-special-events-and-holidays/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The Value of Leveraging Virtualization for Application Performance Testing</title>
		<link>http://www.shunra.com/shunrablog/index.php/2010/03/12/the-value-of-leveraging-virtualization-for-application-performance-testing/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2010/03/12/the-value-of-leveraging-virtualization-for-application-performance-testing/#comments</comments>
		<pubDate>Fri, 12 Mar 2010 17:56:28 +0000</pubDate>
		<dc:creator>Liam McCamley</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Tips and Tricks]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[Application Performance Management]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[HP Performance Center]]></category>
		<category><![CDATA[HP Software]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[LoadRunner]]></category>
		<category><![CDATA[Network Performance]]></category>
		<category><![CDATA[Performance Testing]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[User Experience]]></category>
		<category><![CDATA[VE Desktop for HP Software]]></category>
		<category><![CDATA[Virtualization]]></category>
		<category><![CDATA[WAN Emulation]]></category>
		<category><![CDATA[WAN Performance]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1960</guid>
		<description><![CDATA[Virtualization has emerged as one of the leading technologies in today’s market; enabling businesses to more effectively scale operations to meet demand while significantly reducing costs at the same time. Everyone seems to understand what virtualization is, but it’s actually rather difficult to define because the term is used interchangeably to describe a plethora of [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://www.shunra.com/virtualization.php" target="_blank">Virtualization</a> has emerged as one of the leading technologies in today’s market; enabling businesses to more effectively scale operations to meet demand while significantly reducing costs at the same time. Everyone seems to understand what virtualization is, but it’s actually rather difficult to define because the term is used interchangeably to describe a plethora of different things. When I first tried to define what virtualization is in my own terms, I thought of it more as a technology for achieving some end – primarily server consolidation. However, after further investigation I realized that virtualization is really more of a concept than anything else. This certainly became evident in an article I read from the<a href="http://virtualization.sys-con.com/node/554197" target="_blank"> Virtualization Journal</a> where the CTO of Citrix &amp; Founder of XenSource, Simon Crosby, was being interviewed on the topic of virtualization. He stated that &#8220;virtualization is already widely used, but primarily for the first-order benefit, namely server consolidation. The second-order benefits of agility, availability and manageability of the IT stack are now becoming better understood,&#8221; Crosby continues, &#8220;and as a consequence virtualization has moved from a tactical tool for gaining immediate savings, to become a key strategic theme for every IT department.&#8221; Essentially, virtualization has become a business enabler for many – and that’s certainly apparent considering the number of organizations gearing up for cloud computing. This is also the case when it comes to how application performance testing can be leveraged within organizations today.</p>
<p>There are many challenges organizations face when it comes to administering and maintaining a dedicated pre-production or staging environment for which accurate performance testing can be conducted. The cost to manage and maintain infrastructure, along with personnel and facilities, can be fairly sizeable and are only a subset of the overall costs to be considered. So, in many cases performance testing can be rather expensive and this is exactly why virtualization can provide significant benefits because there is cost reduction across the board. A prime example is in many performance labs there are a variety of application performance tools typically utilized for testing &#8211; one such tool is HP LoadRunner or Performance Center. These tools are a primary part of a performance lab as they provide load generation capabilities and can accurately test applications under real world load and stress scenarios. However, these solutions require a significant amount of infrastructure and resources (A Controller to execute tests, LoadRunner Generators to produce user traffic, Virtual User Generator to record scripts, etc.) and this can make it very difficult to manage the environment when it has to scale to meet higher demand. In this case, virtualization saves time, effort and cost because resources can be allocated dynamically within the environment and any number of virtual machines can be leveraged when needed to handle these resource intensive applications. This is also enabling many organizations to architect and customize elegant configurations that more closely align with their testing requirements – which can minimize unnecessary infrastructure and resources. Yet, the prevalent issue many organizations still grapple with is how to execute performance tests that accurately depict the network for which the application will be deployed across.</p>
<p>The most pervasive approach that many organizations would take is to physically deploy hardware (remote load generators) in offices that they wanted to test an application from. This process was not only time-consuming, but also expensive, inaccurate and cumbersome to manage. For this reason, HP decided to form a partnership with <a href="http://www.shunra.com">Shunra </a>to develop a seamless solution that provides this capability within the HP LoadRunner and Performance Center solutions – <a href="http://www.shunra.com/shunra_ve_desktop_for_hp_software_overview.php" target="_blank">Shunra VE Desktop for HP</a>. This solution aligns very well with the virtualization movement because it is simply a plug-in within the HP products that introduces the network into the existing test bed and can be leveraged across most virtual platforms. For <a href="http://www.shunra.com/shunra_ve_desktop_for_hp_software.php" target="_blank">LoadRunner 9.5</a> and later, there is simply a “<a href="http://www.shunra.com/wan-emulation.php" target="_blank">WAN emulation</a>” tab that can be accessed from within the Controller to introduce the latency, jitter, packet loss and bandwidth constraints directly into the test. With <a href="http://www.shunra.com/shunra_ve_desktop_for_hp_software.php">Performance Center 9.5</a> and later, this capability can easily be configured directly from the browser UI to allocate <a href="http://www.shunra.com/wan-emulation.php" target="_blank">WAN emulation</a> parameters across any number of desired load generators. A consequence of this is that organizations can leverage on-demand performance testing from a dynamic virtual environment that is agile, flexible and robust. This therefore eliminates the need to manage testing cycles across multiple time zones and remove any need for additional hardware. Additionally, all of the network metrics from each generator utilizing WAN emulation within the test will automatically be imported into the controller, which can save a significant amount of time when collating results and generating analysis reports. These reasons are precisely why numerous organizations have decided to improve their existing performance test environment with the VE Desktop for HP Software  solution. Not only does this solution address a strategic gap within the functionality of the HP solutions, it embraces virtualization as a means to more effectively administer performance testing. Overall, the V<a href="http://www.shunra.com/shunra_ve_desktop_for_hp_software.php" target="_blank">E Desktop for HP Software</a> solution was co-developed with HP to considerably enhance the accuracy and value of these application performance test suites.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2010/03/12/the-value-of-leveraging-virtualization-for-application-performance-testing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Is IPTV coming to your home sooner than expected?</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/12/22/is-iptv-coming-to-your-home-sooner-than-expected/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/12/22/is-iptv-coming-to-your-home-sooner-than-expected/#comments</comments>
		<pubDate>Tue, 22 Dec 2009 20:03:54 +0000</pubDate>
		<dc:creator>Yigal Gafni</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Apple]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[Bandwidth]]></category>
		<category><![CDATA[IPTV]]></category>
		<category><![CDATA[Jitter]]></category>
		<category><![CDATA[Latency]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[Packet Loss]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[User Experience]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1802</guid>
		<description><![CDATA[In today’s Business section of the New York Times, there is an article by Brian Stelter (December 22, 2009) about a proposal by Apple computer to offer TV subscription packages via the Internet.  The article points out that ABC and CBS are actively considering joining the Apple venture. Disney, who owns ABC, was the first [...]]]></description>
			<content:encoded><![CDATA[<p>In today’s Business section of the New York Times, there is an article by <a href="http://topics.nytimes.com/topics/reference/timestopics/people/s/brian_stelter/index.html" target="_blank">Brian Stelter</a> (December 22, 2009) about a proposal by Apple computer to offer TV subscription packages via the Internet.  The article points out that ABC and CBS are actively considering joining the Apple venture. Disney, who owns ABC, was the first major network to sell single TV episodes on ITunes four years ago. In another article on the Wall Street Journal Online website, <a href="http://samschechner.com/" target="_blank">Sam Schechner</a> claims that Apple wants to start delivering the package sometime in 2010.  Another source was quoting the projected offering at $30 a month, using the existing ITunes delivery mechanism. (<a href="http://online.wsj.com/article/SB10001424052748703344704574610491399388448.html">View article</a>)</p>
<p>While actual deployment may be month away, it is important to remember that the transport mechanism, open Internet over an IP Core will require substantial testing of the end user experience. <a href="http://www.shunra.com/voip-deployment-services.php" target="_blank">IPTV</a> is a protocol sensitive to network conditions, like latency and packet loss.  Any successful implementation will have to include significant bandwidth allocation testing, as well as load under latency, jitter and packet loss.</p>
<p><img class="aligncenter size-full wp-image-1808" title="yigal post pic2" src="http://www.shunra.com/shunrablog/wp-content/uploads/2009/12/yigal-post-pic22.bmp" alt="yigal post pic2" /></p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/12/22/is-iptv-coming-to-your-home-sooner-than-expected/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>HP tackles the challenges of load testing</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/12/17/hp-tackles-the-challenges-of-load-testing/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/12/17/hp-tackles-the-challenges-of-load-testing/#comments</comments>
		<pubDate>Thu, 17 Dec 2009 15:27:25 +0000</pubDate>
		<dc:creator>anca.popovici</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[HP]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[LoadRunner]]></category>
		<category><![CDATA[Mark Tomlinson]]></category>
		<category><![CDATA[Steve Feloney]]></category>
		<category><![CDATA[VE Desktop for HP Software]]></category>
		<category><![CDATA[Web 2.0]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1757</guid>
		<description><![CDATA[Video: Mark Tomlinson and Steve Feloney from HP address the risk of load testing Web 2.0 applications without considering WAN latency]]></description>
			<content:encoded><![CDATA[<p><!--StartFragment--></p>
<table border="0" cellspacing="0">
<tbody>
<tr id="post-1768" valign="top">
<td></td>
<td></td>
</tr>
</tbody>
</table>
<p>Are you migrating over to the Web 2.0 world or considering adding modern architecture and components? If so, take a look at this interesting video I came across, in which <a href="http://www.communities.hp.com/online/blogs/loadrunner/archive/tags/Tomlinson/default.aspx" target="_blank">Mark Tomlinson</a> and Steve Feloney from HP, our partner, tackle the challenges of load testing Web 2.0 applications. It will be well worth your time to <a href="http://www.communities.hp.com/online/blogs/loadrunner/archive/2009/12/14/video-real-stories-of-load-testing-web-2-0-part-1.aspx"><span style="text-decoration: underline;">check out Mark and Steve</span></a> as they address the top issues that make LoadRunner web testing much harder and more complex. Very helpful and it&#8217;s only 4 min long!</p>
<p>In this video, Mark and Steve talk about real challenges their customers faced when migrating to the Web 2.0 without considering the impact of WAN latency, and most importantly how to solve this! Anyone using <a href="http://www.shunra.com/shunra_ve_desktop_for_hp_software_overview.php"><span style="font-family: Times New Roman;"><span style="font-size: 12pt;">VE Desktop for HP Software</span></span></a><strong><span style="font-family: Times New Roman;"><span style="font-size: 12pt;"><a href="../../shunra_ve_desktop_for_hp_software_overview.php" target="_blank"> </a></span></span></strong> should also definitely check this out and take a light-hearted look at web load testing.</p>
<p>This video is the first in a series put together by Steve and Mark covering some top issues that make LoadRunner web testing much harder and complex. Stay tuned for the next part of &#8220;<strong>Real Stories of Load Testing Web 2.0: Impacts of WAN latency of Web 2.0 apps&#8221;</strong>.</p>
<p>&#8230;will Steve end up going to Paris? and what will Mark find on google? the plot thickens&#8230;</p>
<p><span style="font-family: Times New Roman;"><span style="font-size: 12pt;"> </span></span> <!--EndFragment--></p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/12/17/hp-tackles-the-challenges-of-load-testing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Location-aware deployment testing</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/11/06/location-aware-deployment-testing/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/11/06/location-aware-deployment-testing/#comments</comments>
		<pubDate>Fri, 06 Nov 2009 18:09:00 +0000</pubDate>
		<dc:creator>Dave Berg</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Application Development]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[Cloud Computing]]></category>
		<category><![CDATA[cloud-based application]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[HP Software]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[LoadRunner]]></category>
		<category><![CDATA[network performance measurement]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[Performance Testing]]></category>
		<category><![CDATA[pre-deployment testing]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[VE Network Catcher]]></category>
		<category><![CDATA[VE Suite]]></category>
		<category><![CDATA[WAN Emulation]]></category>
		<category><![CDATA[WAN Performance]]></category>
		<category><![CDATA[WAN Simulation]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1721</guid>
		<description><![CDATA[As a corollary to last week’s blog about hosted load testing, I thought it would be interesting to explain a little about using a cloud-based test environment to perform pre-deployment testing for a cloud-based application. That sounds like a lot of clouds!  What we are simply trying to understand is where and how to deploy [...]]]></description>
			<content:encoded><![CDATA[<p>As a corollary to last week’s <a href="../index.php/2009/10/30/hosted-load-testing-ii/">blog</a> about hosted load testing, I thought it would be interesting to explain a little about using a cloud-based test environment to perform pre-deployment testing for a cloud-based application.</p>
<p>That sounds like a lot of clouds!  What we are simply trying to understand is where and how to deploy your application in the cloud, so it will perform well for your customers.</p>
<p>If you take the case of deploying an online store into the Amazon EC2 cloud, there are many things to consider that will impact your customer’s experience.  Two of the most important are where to deploy what, and how your store will function over the Internet.  To compound the issue, where you physically deploy machines within EC2 is not clear.  Amazon goes to great lengths to avoid you knowing where their zones are.</p>
<p>Fortunately, you cannot only find solutions to these problems, but with cloud computing the process gets a lot easier.  To break the problems down into a logical flow, you’ll first need to know the demographics of your customers.  Where are they?  How will they access the store?  What needs to happen for them to have a positive experience at your store?  If you can answer these questions, you’ll likely come up with some numbers that place percentages of your users in different regions around your target market (US, EMEA, global, etc.).  Further, you’ll know the top two browsers they’ll use and with what kind of connections they’ll access the internet (e.g. Firefox with a 768/256kbps DSL, or IE8 with dial-up – yes people still use dial-up!).  Finally, you’ll have some way to quantify a “positive user experience”.  That usually involves consistency (does it work?) and speed (how fast?).</p>
<p>Using the information above and <a title="HP Loadrunner" href="http://shunra.com/shunra_ve_desktop_for_hp_software_overview.php?keyword=VED%20for%20HP%20Software" target="_blank">HP LoadRunner</a> with <a href="../../shunra_ve_desktop_for_hp_software.php">WAN emulation</a>, you can quickly build a to-scale test in your cloud-based lab and understand what would happen if you hosted your application all in one place and serviced your entire customer base.  Odds are that the test will not meet all of your performance goals the first time you run it.  Most likely, you will need to adjust some things in your store (e.g. reduce chattiness and image resolution, optimize Web 2.0 use) and then begin the discussion about where to deploy what.  Can you keep all of your database servers in one place?  If you have to split your database servers, how will that affect performance?  Will you need to deploy web servers in every zone, will you be okay with one in each region, or will you need something in-between?</p>
<p>Again, not only can answers to these questions actually be answered, but by using cloud-based testing you can arrive at valid conclusions faster than ever.  To understand the network impact of deploying machines in different zones, network performance measurement tools like <a href="../../ve-network-catcher.php">VE Network Catcher</a> can run in each of the zones to measure network performance between zones and to customer representative endpoints.  Importing that data directly into HP LoadRunner with <a title="WAN Emulation" href="http://www.shunra.com/wan-emulation.php" target="_blank">WAN emulation</a> and using the flexible cloud environment, you can rapidly form and either dismiss or validate hypotheses about how your application should best be deployed.</p>
<p>The benefit of testing in this way is that you can experiment with many different configurations in rapid succession to find the one or few that are most appropriate for your needs.  Trial and error with a live application is not advisable.  And building a test lab with physical machines to simulate the same thing is not only significantly more expensive, but a lot slower process.  As I pointed out in my previous blog, the same ROI formula that explain and fuel the explosion of Cloud Computing for hosting applications are also relevant for using Cloud Computing to test your applications with.</p>
<p>Now you know what I think.  What do you think??</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/11/06/location-aware-deployment-testing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Building Applications for a Remote Datacenter Part 2 Application Efficiency Metrics</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/11/05/building-applications-for-a-remote-datacenter-part-2-application-efficiency-metrics/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/11/05/building-applications-for-a-remote-datacenter-part-2-application-efficiency-metrics/#comments</comments>
		<pubDate>Thu, 05 Nov 2009 19:02:58 +0000</pubDate>
		<dc:creator>Amichai Lesser</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[Application Testing]]></category>
		<category><![CDATA[Bandwidth]]></category>
		<category><![CDATA[datacenter]]></category>
		<category><![CDATA[enterprise-data-driven- transactional a]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[HP Performance Center]]></category>
		<category><![CDATA[HP Software]]></category>
		<category><![CDATA[Latency]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[Network Emulation]]></category>
		<category><![CDATA[Network Emulator]]></category>
		<category><![CDATA[Network Performance]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[Performance Testing]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[transaction reponse]]></category>
		<category><![CDATA[User Experience]]></category>
		<category><![CDATA[WAN Emulation]]></category>
		<category><![CDATA[WAN Optimization]]></category>
		<category><![CDATA[WAN Performance]]></category>
		<category><![CDATA[WAN Simulation]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1698</guid>
		<description><![CDATA[In the previous post we identified the Wide Area Network and the impairments that it introduces as a key reason for why a local user (let’s say in NYC) experiences a faster application than a user that is remote to his datacenter (let’s say in Tokyo). I also presented a question to the group: “We [...]]]></description>
			<content:encoded><![CDATA[<p>In the <a href="http://www.shunra.com/shunrablog/index.php/2009/10/13/building-applications-for-a-remote-datacenter-part-1-the-network-impact/">previous post</a> we identified the Wide  Area Network and the impairments that it introduces as a key reason for why a  local user (let’s say in NYC) experiences a faster application than a user that is remote to his datacenter (let’s say in Tokyo). I also presented a question to the group: “We  identified network latency as one of the key reasons that impact application  performance to a remote datacenter; we also said that a typical WAN link will introduce 10 – 500 msec  of latency. The question is, why does network latency impact application  performance, surely a user doesn’t notice an increase of a few milliseconds in  response time, even 500 milliseconds = ½ second goes by in a flinch. So why does  network latency have such a big impact on application performance when the data center is remote?”</p>
<p>The following posts will  answer this question and more, but in order to get answers we need to first  address additional questions:</p>
<p>Consider the remote user  in Tokyo, he is accessing multiple applications that are all hosted in the remote NYC  data center.</p>
<p>Will all these  applications perform the same way once hosted in a remote data center?</p>
<p>The obvious answer is NO,  some applications will perform well even when users are remote to the data center, while others will provide  intermittent poor performance and some will always perform poorly for a remote  user.</p>
<p>The answers to the next  questions are less obvious:</p>
<ul>
<li> Why do some applications  perform well in remote data centers while others fail miserably?</li>
<li> What is it about the way applications are designed and architected in a remote data center that allows some applications to  perform better than others?</li>
<li> What are the key design  flaws that cause applications to perform poorly in a remote data center?</li>
</ul>
<p>Since there are a lot of  different applications, there are also a lot of different answers to these  questions. In the next couple of posts we will focus on <a href="http://www.shunra.com/shunrablog/index.php/2009/11/05/a-data-driven-transactional-application-a-glossary-post/">enterprise-data-driven- transactional </a>applications and their performance flaws over the network (ignoring for a  moment back-end or desktop related bottlenecks). We will further limit this  category to client server based applications, ignoring for a moment the  complexity of N-Tier applications and multi web service based applications,  these will be dealt with in future posts.</p>
<p>Over the years I was  asked to analyze performance problems for many transactional applications and  specifically analyze their performance degradation when users are remote to their data center, the  following are the key application metrics that I found are related to  performance degradation over the network:</p>
<ol>
<li> The number of application turns per  transaction (or how chatty the application is)</li>
<li> The transaction size (or how much data needs to be  downloaded from the server to the client in order to complete each  transaction)</li>
<li> The transaction efficiency factor (how much data a  transaction downloads per application turn)</li>
<li>The blocking nature of object retrieval (can the transaction retrieve multiple objects concurrently or is each object download blocking other object requests from being processed)</li>
<li>The transaction redundancy metric (or how much of the same data is being retrieved by all the requests made by this transaction). It seems like this metric should always be zero, but you will be surprised how often this is the single reason behind performance problems.</li>
<li>The transaction initialization size (how much data does  the transaction download initially Vs. sequential navigational  steps)</li>
<li> The caching ratio (how much data is cached locally as a  percentage of the overall data needed by the  application)</li>
<li> The latency scale factor (How does the backend’s  ability to scale change when network latency is added between front end clients  and the backend)</li>
</ol>
<p>Measuring and observing these metrics allows for the deep level analysis that is required to identify performance bottlenecks. This information also helps to point out to application developers and system engineers what needs to be changed in order to remediate application performance problems.</p>
<p>In the next  couple of posts I will explain each of the above factors and describe how each  of them impacts application performance, so sign up for the RSS feed  to get notification on these future posts.</p>
<p>Until then&#8230;</p>
<p>Amichai Lesser</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/11/05/building-applications-for-a-remote-datacenter-part-2-application-efficiency-metrics/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Hosted Load Testing II</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/10/30/hosted-load-testing-ii/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/10/30/hosted-load-testing-ii/#comments</comments>
		<pubDate>Fri, 30 Oct 2009 15:34:09 +0000</pubDate>
		<dc:creator>Dave Berg</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[Application Performance Testing]]></category>
		<category><![CDATA[Application Testing]]></category>
		<category><![CDATA[Cloud Computing]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[HP Performance Center]]></category>
		<category><![CDATA[HP Software]]></category>
		<category><![CDATA[Load Generator]]></category>
		<category><![CDATA[load generators]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[LoadRunner]]></category>
		<category><![CDATA[Mark Tomlinson]]></category>
		<category><![CDATA[Network Emulation]]></category>
		<category><![CDATA[Performance Test Lab]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[Skytap]]></category>
		<category><![CDATA[User Experience]]></category>
		<category><![CDATA[WAN Performance]]></category>
		<category><![CDATA[Web 2.0]]></category>
		<category><![CDATA[Web Performance]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1693</guid>
		<description><![CDATA[My friend Mark Tomlinson from HP recently wrote an informative blog about “Understanding the language of hosted load testing.”  The blog touched on two competing approaches to application performance testing that were referenced as “behind the firewall” and “outside the firewall”.  Behind the firewall testing usually means testing in a lab environment such as a [...]]]></description>
			<content:encoded><![CDATA[<p>My friend Mark Tomlinson from HP recently wrote an informative blog about “<a href="http://www.communities.hp.com/online/blogs/loadrunner/archive/2009/10/27/understanding-the-language-of-real-world-load-testing.aspx">Understanding the language of hosted load testing</a>.”  The blog touched on two competing approaches to application performance testing that were referenced as “behind the firewall” and “outside the firewall”.  Behind the firewall testing usually means testing in a lab environment such as a Performance Test Lab.  Outside the firewall testing means testing over some part of a live network.  As you can imagine, and as Mark pointed out, both approaches have their pros and cons.  Selectively borrowing from Mark and adding some of my own gives us the following:</p>
<p>Performance Test Lab testing</p>
<p>Pros: Controlled, repeatable, relatively easy to debug observed problems</p>
<p>Cons: Expensive to build and maintain, commonly implemented without real world network considerations</p>
<p>Live Network testing</p>
<p>Pros: Cheap, good for periodic sanity checks of performance</p>
<p>Cons: Puts non-revenue generating load on the production network, very difficult to debug, high volume testing is not an accurate depiction of end user performance</p>
<p>The good news is that developments in cloud-based testing and in HP LoadRunner have been able to improve the accuracy of Performance Test Lab testing while also reducing the complexity and overall cost.  By moving HP LoadRunner load generators into a cloud-based testing environment, your testing can immediately benefit from the flexibility and scalability of the cloud.</p>
<p>One specific use case is for Peak Testing.  Peak testing is simply another name for load testing.  What “peak” implies is that it is at a scale that is not common.  If you are running, or want to run a test that is not commonly run in your environment, then it is fair to assume that you’ll need to plan ahead to gather the necessary resources.  Working in a cloud environment makes gathering and configuring extra resources on demand easy.  Need an extra five load generators?  No problem; just clone your existing one and wait for them to start.  Need more RAM?  No problem; just shut the machine down, configure more RAM, and restart the machine.  Working with the latest version of HP LoadRunner with <a href="../../shunra_ve_desktop_for_hp_software.php">WAN emulation</a> makes the story even more compelling.  Need load generation from LA, London, and Tokyo?  No problem; just configure the load generators to emulate those locations and they will.  Sound easy?  It is.  Companies like <a href="http://www.skytap.com/">Skytap</a> already have thought this scenario through and have a great subscription-based model built for you to use today.</p>
<p>The real benefits of peak testing in the cloud are that you can quickly scale your lab up and down without the burden of maintaining a lab large enough to support your peak needs –saving time and money.  It is the end of costly lab build-ups, running tests during maintenance windows in the middle of the night, sending load generators to all corners of the world, and putting test traffic on your production network!</p>
<p>Of course, there are a lot of other ways Cloud Computing can be used in a QA environment; validating new versions of test products and proof of concepts are two that immediately come to mind.  In the end, the same ROI formulae that explain and fuel the explosion of Cloud Computing for hosting applications are also relevant for using Cloud Computing to test your applications with.</p>
<p>Now you know what I think.  What do you think??</p>
<p>P.S. Stay tuned for a coming blog on location-aware deployment testing in the cloud…</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/10/30/hosted-load-testing-ii/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>Analyzing and remediating latency sensitive applications part 2 Oracle Clinical</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/09/17/analyzing-and-remediating-latency-sensitive-applications-part-2-oracle-clinical/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/09/17/analyzing-and-remediating-latency-sensitive-applications-part-2-oracle-clinical/#comments</comments>
		<pubDate>Thu, 17 Sep 2009 19:04:21 +0000</pubDate>
		<dc:creator>Amichai Lesser</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Application Development]]></category>
		<category><![CDATA[Application Performance]]></category>
		<category><![CDATA[Application Performance Management]]></category>
		<category><![CDATA[Application Testing]]></category>
		<category><![CDATA[Bandwidth]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[HP Software]]></category>
		<category><![CDATA[Jitter]]></category>
		<category><![CDATA[Latency]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[LoadRunner]]></category>
		<category><![CDATA[Network Emulation]]></category>
		<category><![CDATA[Network Emulator]]></category>
		<category><![CDATA[Oracle Clinical]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[Shunra]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[Shunra University]]></category>
		<category><![CDATA[User Experience]]></category>
		<category><![CDATA[VE Desktop for HP Software]]></category>
		<category><![CDATA[WAN Emulation]]></category>
		<category><![CDATA[WAN Emulator]]></category>
		<category><![CDATA[WAN Optimization]]></category>
		<category><![CDATA[WAN Performance]]></category>
		<category><![CDATA[WAN Simulation]]></category>
		<category><![CDATA[Web Performance]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1636</guid>
		<description><![CDATA[In the previous post http://www.shunra.com/shunrablog/index.php/2009/08/14/data-center-relocation-questions-and-answers-part-1/ I presented an example of a common performance problem with applications that host executables on a remote shared drive. As common as that problem is, it is usually a legacy problem, most new applications follow a more best practices architecture usually involving a web based front end for the application. [...]]]></description>
			<content:encoded><![CDATA[<p>In the previous post <a href="http://www.shunra.com/shunrablog/index.php/2009/08/14/data-center-relocation-questions-and-answers-part-1/" target="_blank">http://www.shunra.com/shunrablog/index.php/2009/08/14/data-center-relocation-questions-and-answers-part-1/</a> I presented an example of a common performance problem with applications that host executables on a remote shared drive. As common as that problem is, it is usually a legacy problem, most new applications follow a more best practices architecture usually involving a web based front end for the application. However even web based applications can provide their share of performance challenges. The following example presents an Oracle Clinical application commonly used in pharmaceutical companies especially during the clinical trial phases (which is one of the most critical business process a Pharma could have).</p>
<p>In alignment with global trends, more and more clinical trials take place outside of the United States, while the documentation and analysis is done in the US for submission to the FDA. So it is not out of the ordinary to find an Oracle Clinical user in Eastern Europe or in China submitting data to an Oracle Clinical Server hosted in the united states.</p>
<p>Unfortunately, as commonly found with an off the shelf software package that gets customized over time, this type of application can easily morph into a performance challenged application, especially for remote users. The following analysis shows an example of an Oracle Clinical transaction that completes in 8 seconds for local users, while extending to over a minute when users in E. Europe tried to use it.</p>
<div id="attachment_1639" class="wp-caption alignnone" style="width: 522px"><a href="http://www.shunra.com/shunrablog/wp-content/uploads/2009/09/OC-TRT-small.JPG"><img class="size-full wp-image-1639 " src="http://www.shunra.com/shunrablog/wp-content/uploads/2009/09/OC-TRT-small.JPG" alt="Transaction Response Time Analysis of an Oracle Clinical Application US Vs. E. Europe Access" width="512" height="284" /></a><p class="wp-caption-text">Transaction Response Time Analysis for an Oracle Clinical Application Accessed by Local Users Vs. Remote Users in E. Europe</p></div>
<p>Obviously, that big jump in response time was a great cause for concern with my client&#8217;s management. Which is how I got the privilege to be asked to analyze the root cause of the poor performance.</p>
<p>The first thing I noticed was that one particular transaction (Connect to DB) had an extremely high jump in TRT from 8 seconds locally to over a minute when accessed remotely, so I focused on that one first.</p>
<p>Looking at the network fingerprint of the transaction you can observe the following things:</p>
<p>The transaction size (amount of data downloaded from the server required to complete the transaction) is extremely high (over 5 MB).</p>
<p>The transaction generates 34 HTTP calls. Some of those calls take disproportionally longer time than others (notice the Get jar file calls that each exceed 19 seconds marked below, click on the image for a larger view)</p>
<div id="attachment_1643" class="wp-caption alignleft" style="width: 535px"><a href="http://www.shunra.com/shunrablog/wp-content/uploads/2009/09/Connect-to-DB.JPG"><img class="size-full wp-image-1643 " src="http://www.shunra.com/shunrablog/wp-content/uploads/2009/09/Connect-to-DB.JPG" alt="Oracle Clinical Connect to DB Transaction Analysis" width="525" height="258" /></a><p class="wp-caption-text">Oracle Clinical, Transaction Analysis for &quot;Connect to DB&quot;</p></div>
<p>When inspecting those JAR files, we saw that they were very heavy in size, over 1 MB each which is pretty big for basically a collection of Java classes that are zipped into a JAR file.</p>
<p>You can also observe in the next bounce diagram that most of the JAR files are downloaded in a serial fashion, blocking other objects from downloading in the mean time. Notice the delta time displayed on the right column</p>
<div id="attachment_1645" class="wp-caption alignleft" style="width: 526px"><a href="http://www.shunra.com/shunrablog/wp-content/uploads/2009/09/Connect-to-DB-Bounce-Diagram.JPG"><img class="size-full wp-image-1645 " src="http://www.shunra.com/shunrablog/wp-content/uploads/2009/09/Connect-to-DB-Bounce-Diagram.JPG" alt="Bounce Diagram of an Oracle Clinical Transaction" width="516" height="304" /></a><p class="wp-caption-text">Bounce Diagram for an Oracle Clinical Transaction</p></div>
<p><strong>What can be done to improve the performance of this application?</strong></p>
<p>Oracle Clinical uses JAR files to package Java code that will run on the client. It is not uncommon for customized off the shelf applications to increase in code size over time until the code is very bloated.</p>
<p>There are several best practices that developers can follow to reduce the size of JAR files:</p>
<ol>
<li> Rationalize the code &#8211; as applications develop over time, multiple classes and sometimes adjacent projects might reference similar libraries and other assets. If not careful those libraries and common assets end up packaged multiple times inside the JAR file, causing it to inflate in size.</li>
<li> Minify the code &#8211; a quick Google search for &#8220;reduce the size of JAR files&#8221; will reveal several free tools that can minimize the size of JAR files, usually through eliminating white spaces, comments, shortening variable names, etc.</li>
<li> Defer loading &#8211; chances are that not all the code in the JAR file is needed for the &#8220;connect to DB&#8221; transaction, which means that users that only want to perform a small transaction are penalized by the download time of code that will never get executed by them. Deferred loading is a design pattern that simply says &#8220;only download assets or code when it is needed&#8221; I wrote more on that design pattern in this previous post <a href="//www.shunra.com/shunrablog/index.php/2009/01/29/content-loading-when-being-lazy-pays-off/&quot;">&#8220;http://www.shunra.com/shunrablog/index.php/2009/01/29/content-loading-when-being-lazy-pays-off/&#8221;</a></li>
</ol>
<p>In summary, as more and more web 2.0 technologies hit main stream, new forms of performance pitfalls may present themselves, requiring us to consider application performance for remote users even for applications that traditionally were considered &#8220;remote user friendly&#8221; such as web based applications.</p>
<p><strong>How was this Analysis Performed?</strong></p>
<p>This analysis was used by integrating a HP LoadRunner script modeling an Oracle Clinical business user with Shunra VE Analyzer. So as the scripted transactions executed across a virtual WAN (simulated by the Shunra VE) the beginning and end of each transaction were marked by the VE Transaction Manager. At the end of the test, the VE Analyzer had sufficient data to generate the attached reports, enabling us to pin point the root cause of the performance problem. You can learn more on how to set this up by going through Shunra Certified Performance Engineering training, either on site or at the next Shunra University. Learn more about Shunra training here:  <a href="http://www.shunra.com/shunra-university-overview.php">http://www.shunra.com/shunra-university-overview.php</a> and here <a href="http://www.shunra.com/training-overview.php?keyword=services">http://www.shunra.com/training-overview.php?keyword=services</a></p>
<p>Questions, comments, feel free to write me at amichai.lesser at Shunra dot com. Or comment on any of my posts.</p>
<p>BTW, we just created a new Application Performance Management Group on LinkedIn, feel free to look it up and join here  <a href="http://www.linkedin.com/groupRegistration?gid=2200667">http://www.linkedin.com/groupRegistration?gid=2200667</a></p>
<p>Best,</p>
<p>Amichai Lesser</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/09/17/analyzing-and-remediating-latency-sensitive-applications-part-2-oracle-clinical/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>Data Center Relocation Questions and Answers Part 1</title>
		<link>http://www.shunra.com/shunrablog/index.php/2009/08/14/data-center-relocation-questions-and-answers-part-1/</link>
		<comments>http://www.shunra.com/shunrablog/index.php/2009/08/14/data-center-relocation-questions-and-answers-part-1/#comments</comments>
		<pubDate>Fri, 14 Aug 2009 20:10:16 +0000</pubDate>
		<dc:creator>Amichai Lesser</dc:creator>
				<category><![CDATA[Featured Post]]></category>
		<category><![CDATA[Staff Posts]]></category>
		<category><![CDATA[Application Development]]></category>
		<category><![CDATA[Application Testing]]></category>
		<category><![CDATA[Bandwidth]]></category>
		<category><![CDATA[HP LoadRunner]]></category>
		<category><![CDATA[HP Performance Center]]></category>
		<category><![CDATA[HP Software]]></category>
		<category><![CDATA[Jitter]]></category>
		<category><![CDATA[Latency]]></category>
		<category><![CDATA[Load testing]]></category>
		<category><![CDATA[Network Emulation]]></category>
		<category><![CDATA[Network Performance]]></category>
		<category><![CDATA[Performance Testing]]></category>
		<category><![CDATA[Shunra Software]]></category>
		<category><![CDATA[WAN Emulation]]></category>

		<guid isPermaLink="false">http://www.shunra.com/shunrablog/?p=1525</guid>
		<description><![CDATA[In my line of work, I get to assist many clients with analyzing the impact of an upcoming data center relocation on the performance of business applications. Many clients don’t know exactly what application performance to expect post the data center move. The main concern is that once all the applications start to operate across [...]]]></description>
			<content:encoded><![CDATA[<p>In my line of work, I get to assist many clients with  analyzing the impact of an upcoming data center relocation on the performance of  business applications. Many clients don’t know exactly what application  performance to expect post the data center move. The main concern is that once  all the applications start to operate across a Wide Area Network (WAN)  connection to a remote data center with all the added network latency, the  future performance of applications is unpredictable at best and potentially  becomes so noticeable that it hinders the success of the data center relocation  project itself. Therefore, clients often ask me, “Should we really test all the  applications for latency? Which applications are the most vulnerable to the  added network latency? Are there best practices when it comes to designing  distributed applications that need to operate across network  latency?”</p>
<p>In the next 2 posts, I will address the first 2  questions, the third one is probably a good topic for a book, so I will attempt  to address that one over several future posts.</p>
<p><strong>Should you really test all your  applications for latency prior to a data center  relocation?</strong></p>
<p>Before jumping into a direct answer with examples of  horror stories from past data center relocations that didn’t test all  applications and the consequence of that excessive risk taking I want to first  provide a conceptual best practice answer.</p>
<p>I recently received my Six Sigma Champion certification  and one of the concepts in Six Sigma and in management for quality in general is  “Don’t mass inspect, build quality into the process instead”. This concept was  one of Deming’s teachings that revolutionized the Japanese manufacturing  industry in the 1950s. So one would think that according to that best practice,  we shouldn’t test all applications prior to a data center move, since that would  be the equivalent of mass inspection. However, that would be a miss  interpretation of that statement, an organization can shift from mass inspection  to more statistical sampling only if quality is built into the process and when  mission critical processes are in control. To complete the analogy, an  organization can settle for sample testing a subset of applications only if  application development processes have quality built into them, and specifically  with a data center move, application development processes have network aware  best practices embedded in them. I have yet to find an organization that reaches  that level of maturity prior to a data center move. Usually the causation is  reverse, first a firm relocates their data center, then IT realizes that they  need to adopt a new application development paradigm since from now on  applications will access remote servers in a remote data center and thus network  aware best practices (like using VE Desktop as part of the development life  cycle) are added.</p>
<p>So this brings us to the reasonable assumption that most  companies will have a portfolio of applications that weren’t developed with a  distributed WAN in mind and now have to adjust to operating in a remote data  center. If that is the scenario your company is facing then mass inspection is  your only way to mitigate the enormous risk associated with such a  move.</p>
<p>Now if you don’t buy into the conceptual answer,  consider the following:</p>
<ol>
<li>In an average data  center relocation project, we usually find that 20% &#8211; 40% of applications  experience performance degradation ranging from visible to severe. (visible  means that a user notices the slowdown in response time, severe means that an  application stops being usable under latency  conditions).</li>
<li>Many of the problems  we uncover end up being show stoppers for the DCR project and need to go through  remediation before the project can complete.</li>
<li>The mitigation path  varies between applications and is very dependent on the type of problem that  causes the performance degradation. Hence, a typical remediation solution may  include WAN Acceleration for some applications (mainly server-to-server copy  utilities and file services), terminal services (Citrix, remote desktop, VDI,  etc.) for other applications, code fixes for some applications and architecture  changes for the rest. Therefore engineering a solution based on a sample of  applications will results in a sub optimal solution that doesn’t address all the  performance problems that will manifest post the move.</li>
<li>When a large NY  based insurance company relocated their servers from NY to Atlanta, GA without  testing, they ended up rolling back the first phase of the relocation when  several mission critical applications became unusable due to poor  performance.</li>
</ol>
<p>In summary, unless IT has built network aware best  practices into the software development process, an organization planning a data  center relocation must test all of its applications to analyze the performance  impact that new added latency will have on application performance. More best  practices on this topic can be found in my recently updated white paper that can  be found at <a title="blocked::http://www.shunra.com/predicting-the-impact-of-data-center-moves-on-application-performance-whitepaper.php" href="../../predicting-the-impact-of-data-center-moves-on-application-performance-whitepaper.php">http://www.shunra.com/predicting-the-impact-of-data-center-moves-on-application-performance-whitepaper.php</a></p>
<p>The next post will cover the question “Which  applications are the most vulnerable to the added network latency?” small  example, any applications that are running executables from a shared network  drive, will experience severe performance problems, that and more will be  covered in the next post.</p>
<p>In the meantime, I am curious to hear your experience  with data center relocations, what approach did your IT group take? Test all,  sample test or cross your fingers and just move? Let me  know.</p>
<p>P.S. as part of my Six Sigma Certification, I developed  a dashboard and a flow chart for a data center relocation performance analysis,  it needs some work before it can be shared, but if enough readers ask for it, I  will try to clean it up and post it.</p>
<p>Till next time,</p>
<p>Amichai  Lesser</p>
]]></content:encoded>
			<wfw:commentRss>http://www.shunra.com/shunrablog/index.php/2009/08/14/data-center-relocation-questions-and-answers-part-1/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
	</channel>
</rss>

