Step 1: Create a Benchmark

Submitted by epreisz on Sun, 02/11/2007 - 07:58.

Without a benchmark, there may be no way to find out if we have improved our performance. When we make an optimization that improves performance from 10fps to 60fps it is obvious; but could you visually determine a framerate increase from 60fps to 120fps without a frame counter? Probably not.

What is a benchmark? The word benchmark was originally a surveying term. When a builder begins to layout his plans from paper to the actual site, he needs a common fixed point that won’t move. Then all of the other measurements can be relative to this point. In other words, the benchmark is a starting point for comparison.

A benchmark is the starting point for comparing what we had to what we have; and in a video game, benchmarking is quite different from that of other types of programs. Examine these guidelines for determining a benchmark:

  • Repeatable
  • Representative
  • Easy to Run

Let’s dissect these traits and compare them with our ability to set a benchmark using these characteristics.

Repeatable. Hrm… games aren’t always deterministic. That is, if you run the exact same input, you are not always guaranteed the same output. This is due to random number implementations within many of our game subsystems. AI and particles are two systems that may not behave exactly the same every time. Even the laws of physics have an element of randomness when dependent on updates across a network. So games aren’t very repeatable. Strike one.

Representative. Hrm… this one is an issue as well. The representative user of a game is a pc gamer. We can try to represent them, but that’s difficult. Writing AI that behaves like we do is very difficult. Our platform, at least on the PC will very from machine to machine. In fact, in a set of 30 similar machines, in terms of hardware, may vary greatly due to software differences. Strike two.

Easy to run. Hrm… Yea, we can do this! Many games engines are driven by a console and/or scripting language. We can create test scenes using this language to get as close as we can to a representative and repeatable test. So all hope is not lost.

Instead of suggesting that these are the required attributes of a good benchmark, we must think of them as our goals to achieving the best benchmark.
There is one more piece we are missing. What are we measuring? In video games that one is easy. FPS! Frames per second, or sometimes called Hertz, meaning number of times per second, is the de-facto measure for performance in video games. If you increase the framerate, you can add more content or runtime processing. If you decrease framerate, than you are limiting the ability to add content or runtime processing.

‹ The Optimization ProcessupStep 2: Detection ›

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Leo Hendrik Baekeland improved

Submitted by bingoov on Sun, 02/05/2012 - 12:57.

Buy viagra DTJLK SDFG
Buy cialis DTJLK SDFG
viagra DTJLK SDFG
Buy cialis DTJLK SDFG
Buy viagra DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Sun, 02/05/2012 - 12:39.

levitra Online DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
cialis Online DTJLK SDFG
cialis DTJLK SDFG
viagra Online DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Sun, 02/05/2012 - 12:21.

viagra DTJLK SDFG
Buy viagra DTJLK SDFG
Buy cialis online DTJLK SDFG
ambien DTJLK SDFG
cialis DTJLK SDFG
Buy cialis DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Sun, 02/05/2012 - 12:04.

cialis Online DTJLK SDFG
Cheap viagra DTJLK SDFG
Buy viagra DTJLK SDFG
viagra Online DTJLK SDFG
Buy viagra DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Sun, 02/05/2012 - 11:47.

levitra DTJLK SDFG
Buy levitra DTJLK SDFG
viagra DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Sun, 02/05/2012 - 11:31.

viagra Online DTJLK SDFG
viagra Online DTJLK SDFG
cialis Online DTJLK SDFG
ambien DTJLK SDFG
cialis DTJLK SDFG
cialis Online DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Sun, 02/05/2012 - 11:15.

viagra Online DTJLK SDFG
viagra Online DTJLK SDFG
Buy cialis online DTJLK SDFG
ambien DTJLK SDFG
Buy cialis DTJLK SDFG
cialis Online DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Sun, 02/05/2012 - 10:59.

Cialis online DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
viagra Online DTJLK SDFG
Cialis online DTJLK SDFG

NFL Jersey For Cheap

Submitted by kkkz198608 on Sat, 02/04/2012 - 02:41.

NFL merchandise sold to women jumped NFL Jersey China significantly over last year, according to Fanatics, the world's largest online retailer of officially licensed NFL Jerseys Wholesale products. The 2011 playoff season showed a dramatic change: an 85 percent sales increase in December over 2010 and a 125 percent increase in January from the year prior.The new site highlights the women's NFL Jersey For Cheap apparel line and also added NFL Party, a site that promotes "homegating." NFL Party features a blog Outlets In Jersey with tips and recipes.When the NFL women's clothing line was expanded in 2011, the league looked to the women who make up the NFL family for some help. Wives of players, coaches and owners donned gear for NFL Youth Jerseys advertisements, which appeared in popular magazines.

Cheap Louis Vuitton products

Submitted by chy on Fri, 02/03/2012 - 07:54.

Cheap Louis Vuitton products captures top quality and exquisite design are offered online. As a fact that our Louis Vuitton Outlet is a crediable outlet with strength. We provide various excellent products which are in discount. Such as, Louis Vuitton clothes, Louis Vuitton shoes and Louis Vuitton belts and so on. More information about our products are showed in Louis Vuitton Sale line. Our Louis Vuitton Outlet Store provides you the best service and best quality products. If you want to buy Louis Vuitton products, our Louis Vuitton outlet is your perfect choice. You can find various Louis Vuitton Handbags with fashionable design and exquisite craftsmanship. And Louis Vuitton Jeans all follow the fashion trend, which is easily match with your clothes. Welcome to our website and further your inquiry!

instant cash advance

Submitted by OtgcJz on Thu, 02/02/2012 - 18:10.

pocawv instant cash advance vJfGpX payday loans vmFnxV cash advance 5854

payday loans

Submitted by OtgcJz on Thu, 02/02/2012 - 14:25.

epwkga payday loans sjhvtF cash advance 3182 payday loans >:-OOO

instant cash advance

Submitted by mUpABA on Thu, 02/02/2012 - 14:07.

byiote instant cash advance 0721 payday loans online 4385 cash advance 8]]]

cash advance

Submitted by jWLYJT on Thu, 02/02/2012 - 11:34.

qkndxbkk cash advance >:]] payday loans JsRLdK instant cash advance vvKsCy

buy viagra

Submitted by mUpABA on Wed, 02/01/2012 - 14:34.

rkhklg buy viagra 9518 cialis without prescription 8]]] buy viagra in usa >:]] buy cialis 6490

use as an ebonite substitute

Submitted by bingoov on Tue, 01/31/2012 - 11:01.

viagra alternative DTJLK SDFG
Cheap viagra DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Tue, 01/31/2012 - 10:44.

viagra online DTJLK SDFG
ambien DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Cheap viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
-|-|-|-random-}

use as an ebonite substitute

Submitted by bingoov on Tue, 01/31/2012 - 10:24.

cialis DTJLK SDFG
Generic cialis DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
Buy cialis online DTJLK SDFG

-|-|-|-random-}

Arthur Smith received British Patent

Submitted by bingoov on Tue, 01/31/2012 - 10:07.

viagra alternative DTJLK SDFG
Cheap viagra DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Tue, 01/31/2012 - 09:47.

viagra alternative DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
Cheap viagra DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Tue, 01/31/2012 - 09:30.

viagra alternative DTJLK SDFG
Cheap viagra DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Tue, 01/31/2012 - 09:11.

Viagra Online Without Prescription DTJLK SDFG
levitra DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Order viagra DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Tue, 01/31/2012 - 08:56.

viagra online DTJLK SDFG
ambien DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Cheap viagra DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
-|-|-|-random-}

Payday Loan online

Submitted by OtgcJz on Mon, 01/30/2012 - 14:13.

uegwlrvj Payday Loan online 3198 payday loans 7968 cash advance 3489

Cheap Louis Vuitton products

Submitted by chy on Mon, 01/30/2012 - 05:43.

Cheap Louis Vuitton products captures top quality and

exquisite design are offered online. As a fact that our Louis Vuitton

Outlet is a crediable outlet with strength. We provide various excellent products which are in discount. Such

as, Louis Vuitton clothes, Louis Vuitton shoes and Louis Vuitton belts and so on. More information about our products are

showed in Louis Vuitton Sale line. Our Louis Vuitton

Outlet Store provides you the best service and best quality products. If you want to buy Louis

Vuitton products, our Louis Vuitton outlet is your perfect choice. You can find various Louis Vuitton

Handbags with fashionable design and exquisite craftsmanship. And Louis Vuitton Jeans all follow

the fashion trend, which is easily match with your clothes. Welcome to our website and further your inquiry!

Re: Min vision och tro

Submitted by sengnn163 on Sun, 01/29/2012 - 08:10.

UGG Australia is one of the famous brands in the world, It have a High status,especially uggs for cheap.UGG Men very well in uggs boots outlet. UGG Bailey Button Boots , UGG Roseberry Boots , UGG Classic Short are top sale on UK Ugg Sale,Uggs Boots which are fervently loved by the classic ugg and American youth, and you can easily get those items in our cheap ugg offering a huge discount here, up to 80%.you can get Cheap ugg gloves at the lowest of price.ugg boots outlet online can guarantee the quality and offer the softy material.when you put Ugg discount on sale,you feel comfortable.welcome to our ugg boots sale Outlet discount Store.

use as an ebonite substitute

Submitted by bingoov on Wed, 01/18/2012 - 22:36.

Viagra Online Without Prescription DTJLK SDFG
levitra DTJLK SDFG
viagra DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Order viagra DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Wed, 01/18/2012 - 22:20.

cialis DTJLK SDFG
Generic cialis DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
Buy cialis online DTJLK SDFG

-|-|-|-random-}

Leo Hendrik Baekeland improved

Submitted by bingoov on Wed, 01/18/2012 - 22:06.

viagra alternative DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
Cheap viagra DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Wed, 01/18/2012 - 21:50.

viagra online DTJLK SDFG
ambien DTJLK SDFG
viagra DTJLK SDFG
Cheap viagra DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
-|-|-|-random-}

use as an ebonite substitute

Submitted by bingoov on Wed, 01/18/2012 - 21:36.

cialis DTJLK SDFG
Generic cialis DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
viagra DTJLK SDFG
Buy cialis online DTJLK SDFG

-|-|-|-random-}

use as an ebonite substitute

Submitted by bingoov on Wed, 01/18/2012 - 21:22.

Viagra Online Without Prescription DTJLK SDFG
levitra DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Order viagra DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Wed, 01/18/2012 - 21:08.

viagra alternative DTJLK SDFG
Cheap viagra DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Wed, 01/18/2012 - 20:55.

viagra online DTJLK SDFG
ambien DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Cheap viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
-|-|-|-random-}

Arthur Smith received British Patent

Submitted by bingoov on Tue, 01/17/2012 - 08:11.

viagra online DTJLK SDFG
ambien DTJLK SDFG
viagra DTJLK SDFG
Cheap viagra DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
-|-|-|-random-}

Arthur Smith received British Patent

Submitted by bingoov on Tue, 01/17/2012 - 06:32.

Viagra Online Without Prescription DTJLK SDFG
levitra DTJLK SDFG
viagra DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Order viagra DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Tue, 01/17/2012 - 06:18.

Viagra Online Without Prescription DTJLK SDFG
levitra DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Order viagra DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Tue, 01/17/2012 - 06:05.

viagra alternative DTJLK SDFG
viagra online Without Prescription DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
Cheap viagra DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Tue, 01/17/2012 - 05:52.

cialis DTJLK SDFG
Generic cialis DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
Buy cialis online DTJLK SDFG

-|-|-|-random-}

Leo Hendrik Baekeland improved

Submitted by bingoov on Tue, 01/17/2012 - 05:39.

Viagra Online Without Prescription DTJLK SDFG
levitra DTJLK SDFG
viagra DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
Order viagra DTJLK SDFG

Arthur Smith received British Patent

Submitted by bingoov on Tue, 01/17/2012 - 05:26.

viagra online Without Prescription DTJLK SDFG
Viagra Without Prescription DTJLK SDFG
generic viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Cheap cialis DTJLK SDFG -|-|-|-random-}

use as an ebonite substitute

Submitted by bingoov on Tue, 01/17/2012 - 05:13.

viagra alternative DTJLK SDFG
Cheap viagra DTJLK SDFG
viagra DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Tue, 01/17/2012 - 04:59.

viagra alternative DTJLK SDFG
viagra DTJLK SDFG
Viagra Online Without Prescription DTJLK SDFG
Viagra online DTJLK SDFG
Cheap viagra DTJLK SDFG

use as an ebonite substitute

Submitted by bingoov on Mon, 01/16/2012 - 11:44.

viagra DTJLK SDFG
cialis DTJLK SDFG
Buy xanax online DTJLK SDFG
viagra DTJLK SDFG
Ambien without Prescription DTJLK SDFG

Leo Hendrik Baekeland improved

Submitted by bingoov on Mon, 01/16/2012 - 11:33.

viagra sale DTJLK SDFG
viagra DTJLK SDFG
viagra discount DTJLK SDFG
viagra online DTJLK SDFG
viagra discount DTJLK SDFG
Buy viagra online DTJLK SDFG

The chanel bags usually

Submitted by zeng on Mon, 01/16/2012 - 03:47.

The chanel bags usually complaint in regulating Cheap Chanel Bags the most appropriate discount chanel handbags online on this sale is which buyers mostly chanel bags revisit the ignored chanel outlet cost charity at which time to check. It’s unequivocally tough for those who live store at a stretch of some-more than 1 hour for the subsequent chanel online store. It is formidable to gucci bags have the claim.This opening stores, charity latest gucci watches products louis vuitton outlet often. It includes equipment discounted gucci shoes, over-abundance equipment and handbags and purses for sale. Then the subject might movement tiffany outlet in the minds of intensity buyers burberry outlet, if the Coach bags have been replica watches accessible in these louis vuitton outlet exchange have been 100% authentic? Yes the genuine replica watches which have been 35% to 55% discount charity to the one charity on the central website cheap rolex watches of the discount hermes bags.If we live nearby a small of hermes outlet online for discount prada outlet, and the outing is value it. How do louis vuitton outlet end up shopping the Replica Watches Online genuine coach purse charity at roughly half cost compared to the cost in normal louis vuitton outlet shops.

Louis Vuitton

Submitted by ququququ on Fri, 01/13/2012 - 06:41.

The final2011 Louis VuittonCruise SS 2011 vote, Messi and Li as the largestLouis Vuitton BagsLouis Vuitton Belt number of top 10 players, topLouis Vuitton Caps/HatsLouis Vuitton Cosmetic Case 10 choices, only at the lastLouis Vuitton Dog CarrierLouis Vuitton Jewellery moment beyond the third consecutive yearLouis Vuitton LuggageLouis Vuitton New the Golden Globe badminton Macy honorLouis Vuitton ScarvesLouis Vuitton Shirt King lindane morning harvest, the secondLouis Vuitton ShoesLouis Vuitton Slipper vote 12.7%, 12.5% of the vote, lindaneLouis Vuitton SunglassesLouis Vuitton Ties place vote, ranked first.
Jamaica ranked thirdLouis Vuitton UmbrellaLouis Vuitton Wallet track and field athletesStephen Sprouse Collectionlouis vuitton bags hot sale, "Lightning" Bolt said, although2011 Louis VuittonCruise SS 2011 in his last year of the world'sLouis Vuitton BagsLouis Vuitton Belt 100 - meter jump the Louis Vuitton Caps/HatsLouis Vuitton Cosmetic Casegun to send the defending Louis Vuitton Dog CarrierLouis Vuitton Jewellerychampion failed, but stillLouis Vuitton LuggageLouis Vuitton New won the 200-meter champion, Louis Vuitton ScarvesLouis Vuitton Shirtand add to his teammates broke theLouis Vuitton ShoesLouis Vuitton Slipper 4x100-meter meter relay world recordLouis Vuitton SunglassesLouis Vuitton Ties, Bolt reached 10.2% of the voteLouis Vuitton UmbrellaLouis Vuitton Wallet. Followed by tennis star Novak DjokovicStephen Sprouse Collectionlouis vuitton belt for sale has won three Grand Slam this year, his success rate Replica Burberry Outlet Burberry Scarfof 10.1% of the votes of the magic.
5-10 bit, the top 10Burberry ShawlBurberry Sale athletes, respectively, in Spain, Real Madrid, Ronaldo, Wang rate ofBurberry Outlet USABurberry bags the Dallas Mavericks' Dirk - Dirk Nowitzki won the NBA championship - two youngest F1 world champion Witt Seoul,Burberry HandbagsBurberry Belts scored five swimming world championship gold medals and broke the world record U.S. swimmer Rochette (microblogging), NBA's youngest MVP (most valuable player)Burberry SunglassesBurberry Wallets winner of the rose, and the final year-end total monopoly champion, in the Wimbledon tennis genius Colavito baby meteoric rise.
In China, the French Open champion Li Na to obtain a clearReplica Burberry bags advantage force, 12.3% of the highest level of the first ballot, she is the only country in theReplica　Burberry Scarf election of a candidate more than 10% of the top ten choices. Won his fourth world champion Lin Dan of 9.3% of the votes came in second singles title, which is worth mentioning that the second choice of international and domestic,Replica　Burberry Shawl
to show his achievements have gone beyond the national boundaries, they that lindane top international sports and friends, to assess the star.

Owing low price and high

Submitted by chy on Tue, 01/10/2012 - 03:57.

Owing low price and high quality products is on our Louis Vuitton Outlet store, our Louis Vuitton launched the more and more new styles products. Welcome to you come our store, our some producers is on sale. For example, our LV Outlet shoes and Louis Vuitton Handbags is discounting on sale, you buy Chanel Outlet bags is very worthes, This is a good chance, you are not miss the this opportunity. And other products are sale heating, too. Various of styles for you to choose from our store, the Chanel Jewelry as well as the Louis Vuitton Belts that all come in excellent design. Hurry up, our products is limited quantity, grasp your every minute, please!

We are a great Louis Vuitton

Submitted by chy on Tue, 01/10/2012 - 03:51.

We are a great Louis Vuitton outlet where you can get the excellent products from our Louis Vuitton outlet online store, and our store Louis Vuitton Handbags Outlet products is not often. You can find various of difference products to you that choose from our Louis Vuitton Outlet Store. We would take you best discount and content service. Our Louis Vuitton sale the Louis Vuitton Jewelry and Louis Vuitton glasses, these products owing high quality and low price. And these products get you charming and elegant body. Hurry up! Cheap Louis Vuitton discount is not often, you are not miss the chance, then just come to our website, you can definitely satisfy with them. Catch the time.

Many Cheap Christian

Submitted by dfeeer on Tue, 01/10/2012 - 01:59.

Many Cheap Christian Louboutin were skeptical about whether Katie Holmes would be an appropriate fit for the Gianmarco Lorenzi Shoes and whether or not she could really model. Choosing Gianmarco Lorenzi Pumps is somewhat of a departure from recent picks such as Gianmarco Lorenzi Boots, though she certainly holds her own — especially considering that this her first major Gianmarco Lorenzi Ankle Boots. They are both beautiful and functional Discount Louboutin Pumps– and they roll up in a neat little ball so you can fit them in http://www.salesgianmarcolorenzi.com/!

123456789…next ›last »