MS Flight Simulator (2020): the 2021 PC graphics performance benchmark review

Game reviews 126 Page 9 of 10 Published by

teaser

Game Frametime Analysis GPU and CPU

Game Frametime Analysis GPU and CPU

The charts below show you graphics anomalies like stutters and glitches in a plotted chart: frame time and pacing measurements. 

Frame time
in milliseconds
FPS
8.3 120
15 66
20 50
25 40
30 33
50 20
70 14
  • FPS mostly measures performance, the number of frames rendered per passing second.
  • Frametime AKA Frame Experience recordings mostly measure and expose anomalies - here, we look at how long it takes to render one frame. Measure that chronologically, and you can see anomalies like peaks and dips in a plotted chart, indicating something could be off. 

We have a detailed article (read here) on the methodology behind it all. Basically, the time it takes to render one frame can be monitored and tagged with a number; this is latency. One frame can take, say, 17 ms. Higher latency can indicate a slow framerate, and weird latency spikes indicate a stutter, jitter, twitches; basically, anomalies that are visible on your monitor. These measurements show anomalies like small glitches and stutters that you can sometimes (and please do read that well, sometimes) see on screen. Below I'd like to run through a couple of titles with you. Bear in mind that Average FPS often matters more than frame time measurements. 

Please understand that a lower frame time is a higher FPS, so for these charts, lower = better. Huge spikes would be stutters, thick lines would be bad frame pacing, and the graduate streamlining is framerate variation.  As you might have observed, we're experimenting a bit with our charts and methodology. Below the game at Ultra HD, with image quality settings as used throughout this review. Tested at ultra quality settings:

 Note: we are playing around a bit and are adding more data. Our processor used is the Ryzen 9 5950X (16c/32t ZEN3).

MS Flight Simulator 2020 has been a bit of an enigma when it comes to the sheer low performance. We know the GPU is hardly the problem; we also know the CPU is not the problem, we measured that 16, 32, and 64 GB system memory makes no difference. So that leaves the DX11 game engine, game complexity, and programming. The sheer scale of the sim is also a massive factor here. However, if we analyze the frametime behavior, we see weird things. The same can be stated for CPU utilization, as clearly the sim finds itself most comfortable with a handful of cores that run faster over many cores.
 

GeForce RTX 3090

Image2
 
Let's have a look; this is a 3-minute plot. We'll start with the GeForce RTX 3090 (above). For frame times, we'll be using premium cards to rule out the GPU as a bottleneck. Normally we scale the chart towards a 40ms spread; anything above 40 ms indicates slow framerates or a stutter. For this plot, we'll use 60ms as the upper plafond.
You can clearly see that there are many and serious stutters, in-game. Next to that, the moving average line should have the frametime plots in green close to it. This means that per frame, there is quite a bit of variation of frametime rendered (time to render in-between frames). You could tag that as micro stuttering, but we also need to weigh that we're condensing 180 seconds of frame times in a pilot, pushing everything closer towards each other (opposed to our usual 30 seconds plot). You are looking at a GeForce RTX 3090 here, plenty of horsepowers, plenty of VRAM. The results however are mediocre.
 
 

Image3

 

Above the same card and same plot, but now we add GPU utilization (blue). Surprisingly a lot of the time, the GPU is, however, fully utilized quite a lot.


Image4

Above, still the same RTX 3090. We now add CPU utilization in total for all sixteen cores (brown) and max tread utilization load in red. Now, if you look at that red line, it's becoming more and more clear that the sim likes single threads as fastly clocked as possible. Where it breaches the 100% marker, it even runs out of stamina. If you look at the brown line, that's your total CPU utilization overall, and yeah, that indicates the sim is not threading very well. Ideally, the red and brown lines are close to each other.


Radeon RX 6900 XT


Image5

Once we take the Radeon RX 6900 XT, we see a similar frametime and pacing behavior pattern. You can argue, though, that it is even a notch worse than the 3090. We see a lot of frame pacing and stutters.


Image6

Above in blue, we add GPU utilization. Again a similar pattern indicating that GPU load is pretty well utilized. Indicating that the graphics card is full throttle at work.

  

Image7

 

In brown, the CPU utilization in total (brown) and max tread utilization load in red.

Share this content
Twitter Facebook Reddit WhatsApp Email Print