Categories
benchmark Data Visualization and Art data visualizations Infographics Uncategorized

Benchmark Comparisons

When looking at a comparison infographic, sometimes it’s difficult to determine the standard for comparing two or more things. One solution is to apply a benchmark to the chart, but there are many ways to go about it.

Benchmark comparisons in the news

As someone who has a professional interest in the natural sciences, it saddens me to look at the news and discover that not everyone in the United States trusts scientists to do the right thing. More often than not, the media cites misinformation and alleged government propaganda as sources for such distrust. However, I do sometimes wonder what opinion people from other countries have of scientists. Recently, I read a Pew Research Center report about the scientific community’s relationship to the general public, and I was surprised that people in countries like India and the Netherlands have far more trust in their nation’s scientists than the American public has in ours.

Source: Pew Research Center.

On the other end of the spectrum, I found myself wondering why nations like Japan and South Korea are skeptical of scientists. They are among the world’s leaders in technological advances, yet the people don’t seem to trust scientists to do the right thing. When compared to median values, the United States exceeds the benchmark, if only by a slight margin, which gives me hope that the vocal minority that distrusts scientists will one day see their error and learn to trust science.

Another way of showing a benchmark is by comparing positive and negative values to determine favorable perspectives. With the United States presidential election fast approaching, the public is more divided than ever on whether or not this year’s elections will be run well. It is likely that a divide in partisan politics and factors like the current COVID-19 pandemic and ongoing police brutality protests are responsible for this immense discourse.

Source: Pew Research Center.

Based on Pew Research Center’s data, I estimate that conservative-leaning voters believe that the election will be handled well. On the other hand, liberal-leaning voters believe that this year’s election will run into a series of blunders or be subject to manipulative interference. As someone who wants to see Donald Trump and his alleged enablers voted out for the sake of the rest of the nation, I am hoping for the best but preparing for the worst.

What about comparisons related to topics I enjoy?

Even when I am not catching up on the news, I still enjoy looking at comparisons for the things I love. For example, I’ve been playing Square Enix’s Final Fantasy XIV Online (shorthand: “FFXIV”) for about a year, and have a strong interest in joining the small community of players who spend most of their time on high-end or difficult pieces of content. When a new piece of content comes out, one of the first places I go to look for information is FF Logs. Their tools analyze combat data and give players a sense of their overall performance and where they can improve. They also have statistical charts that show performance averages for each of the game’s 17 combat classes (jobs). For example, one of the most difficult “raid dungeons” currently in the game goes by the name of “Eden’s Verse: Refulgence.” (shorthand: “E8”). Raids in FFXIV typically have two modes of difficulty, normal and “savage,” with the exception of specially-themed “ultimate” raids. The community typically pays attention to statistics and ranking for savage raids. In the first few weeks of release, Eden’s Verse: Refulgence (Savage) (shorthand: E8S) proved to be a difficult challenge for most raid groups.

A box plot comparing the minimum, lower quartile, median, upper quartile, and maximum damage per second (DPS) for all 17 jobs in one of Final Fantasy XIV Online’s more difficult fights. Source: FF Logs.

Combat jobs in FFXIV are divided into three major roles: tanks, healers, and damage per second (DPS). The box plot chart above shows an aggregate ranking for job performance in E8S over the course of two weeks across all percentiles. DPS jobs typically put out far greater damage than tanks or healers, with magic-based DPS jobs having the highest damage output. The only exception to that rule is the samurai job, which is typically described as being a selfish DPS job that brings little party support to a fight as it deals heavy hits at melee range.

Viewed from a different perspective– say, comparing the maximum and minimum percentiles for E8S damage– certain trends seem to appear among the 17 jobs, and it reflects in how well the player performs in the fight. The best players in the world generally fare much better and clear the raid faster than players who barely have a grasp of their jobs or exhibit poor performance.

A chart comparing the damage per second (DPS) output for E8S, in the maximum and minimum percentiles, across all 17 jobs in Final Fantasy XIV Online (job abbreviations are used). The jobs I play the most are highlighted in color. Source: FF Logs.

Compared to others who play the same jobs as me (color-highlighted in the chart above), I would say that I am somewhere between the two extremes. However, in the case of the job I play the most, red mage, I tend to lean toward the lower end of the spectrum. I recall running a four-person dungeon once with some of my friends a few months before the COVID-19 pandemic exploded. One of them, who went in with a tank job, had a third-party tool open to analyze everyone’s damage output in real-time (which is against the developer’s terms of service, but Square Enix doesn’t crack down on third-party tools if players don’t discuss them publicly in-game), and once the program crunched the numbers, he uploaded the data to FF Logs and sent me a link to the log over Discord. As I looked it over, he laughed in voice chat and likely shook his head at how low my damage output was. Another one of my friends, a healer who did significantly better than me, pointed out that at least I knew my spellcasting priority rotation as a red mage and the random black mage who got matched with our three-player party did less damage than me. I didn’t care that my damage output was sub-par, though. I was happy just to run content with my friends.

Categories
benchmark

Benchmark Comparisons

Benchmark data is information collected from industry sources to determine how other firms achieve their high levels of performance. Benchmarks are everywhere. The link that is attached talks about benchmarks and provides a great amount of information on them.

Benchmarks can be great for:

  1. Share your success with clients, grant-makers, regulators, and your Board of Trustees
  2. Feed your performance and quality improvement system
  3. Get folks talking!
  4. Set goals and acknowledge high performance

Here is an example of data from Amazon. This is Amazon’s net revenue from 2004 to 2019. The progression of their company is being shown here.

example 1

This is another example of a benchmark. This is comparing the response time and web page response time between Amazon, Apple, BestBuy, and Newegg. You can see that the webpage response time is highest for all of them. Overall, Amazon had the highest response time and Newegg had the highest webpage response time.

example 2

Lastly, this is a benchmark comparing Brower’s. Below they are comparing Edge, Chrome, Firefox and Opera. The highest number is the best therefore, Chrome is the best browser.

example 3
Categories
benchmark

Benchmark Comparisons

One of the most common forms of benchmarking is done by utilizing a line graph. The illustrator can choose many different ways to set a benchmark on a line graph either by plotting a point, plotting multiple points, or using a color scheme to represent when the benchmark is reached. Benchmarks are often added as a line to the graph, trending with the businesses’ projections over time.

https://www.sec.gov/Archives/edgar/data/6769/000095012310046150/h72229ke425.htm

Businesses can use benchmarks to help measure the attractiveness of their company by how they are introducing themselves on certain platforms. For example, the following graph shows how certain companies’ websites are attracting customers with effective design psychology.

https://www.eyequant.com/industry-benchmarking-2020/

Companies can use this type of data to maintain the success that they have achieved in the past and to see where they are capable of improving for the future. It is important for companies to look at the benchmarks of other companies so that they may know where to look for marketing strategies that bring in and maintain customers.

Categories
benchmark data visualizations Design Diagrams

Benchmark Comparisons

Adding a benchmark to your visualization can enhance the story to a reader. A visual target allows readers to easily determine whether or not a goal has been met. Benchmarks can be in the form of a line, indicator dots, overlapping bars or combo charts. Depending on the needs of your visual, the best way to display a benchmark will vary. Here are some examples of different visualizations using benchmarks.

This take on a bullet graph uses a a benchmark line to compare how well different brands are doing relative to the brand’s previous performance. I think the use of a patterned filler to show that a company is not performing as well is unique. Especially for this data set, with only one company underperforming, this benchmark stands out.

https://www.brandwatch.com/blog/introducing-benchmark-the-visualization-for-better-insights/

This graph features a line at 0 as the benchmark with another line showing how far off from the benchmark they are. With the benchmark at 0 you can easily see whether or not you are underperforming.

https://ux.stackexchange.com/questions/28749/data-visualization-what-should-be-the-baseline-you-or-the-comparator-seri

This graph displays the benchmark comparison as a simple dashed line.

https://www.datapine.com/kpi-examples-and-templates/sales