Benchmarks

The Spreadsheets test models use cases for a spreadsheet application. The use of spreadsheets is very varied, ranging from writing simple shopping lists to processing massive data sheets. We model uses in two distinct categories: common use and power use.

Implementation

The Spreadsheets test uses a build of LibreOffice Calc (http://www.libreoffice.org) that ships with the benchmark. The application is scripted to execute tasks like document loading, saving, editing data, editing formulas and calculating.

The Spreadsheets test supports OpenCL. The benchmark application selects a preferred OpenCL device to use.

The Spreadsheets test is implemented using AutoIt3 scripts.

Part 1: overall application usage

• Stage 1
  • Code path: x86/x64
  • Test sheet: 
    • The test used is similar to the spreadsheet test in PCMark 8.
    • Compute load scaled down considerably to get consistent runtimes also on low end systems.

Part 2: calculation

• The test sheets used are available in the LibreOffice repository: https://gerrit.libreoffice.org/gitweb?p=benchmark.git;a=tree
• Stage 2 - CPU
  • Code path: x86/x64
  • Test sheets:
    • Building Design
    • Stock History
• Stage 2 - OpenCL
  • Code path: OpenCL
  • Test sheets:
    • Energy market in different countries
    • Monte Carlo Black Scholes option pricing

PCMark 10 uses several test sheets that contain data for the following scenarios:

• Comparing different forms of energy based on consumption and the impact of one form of energy on the rest of the forms.
• Computation of Envelope Thermal Transfer Value for building designs to assess the thermal performance and energy conservation design factors.
• Computing short-term fluctuations of stock values and highlighting long-term trends to guide investors.
• Calculation of theoretical call and put price using key determinants of an option’s price: stock price, strike price, volatility, time to expiration, and short-term interest rate.

Workloads

Common use scenario

The common use scenario simulates working with a spreadsheet application. The workloads perform the following tasks:

1. Start LibreOffice Calc
2. Open the source and destination workbooks
3. Stretch the application windows from an initial state
4. Copy data from the source workbook into the destination workbook to cells that trigger formula evaluation
5. Copy data from the source workbook to the destination workbook to cells that do not trigger formula evaluation 
6. Copy formulas from inside the destination workbook so that data evaluation for the data copied in task 5 is triggered 
7. Copy more data from the source workbook to the destination workbook to cells that trigger formula evaluation
8. Plug specific values to three individual cells triggering formula evaluation
9. Save the destination workbook into a new file 

The workload measures the time it takes to open the document, copy and compute, copy plain data, copy formulas, editing cells, and saving the document.

Power use scenario

The power use scenario simulates the work with more complex spreadsheets in a spreadsheet application. The workloads perform the following tasks:

1. Load sheets with advanced formulas and big data sets
2. Recalculate data

The workload measures the time it takes to load the documents and recalculate the data. 

Spreadsheet score

We use a weighted harmonic mean to calculate the Spreadsheet score from the workload scores. 

Spreadsheet score    =    K × 1 / geomean(R_1,R_2)

Where: 
K      =    scoring coefficient    =    11159
R_1    =    Overall common us    =    geomean(A_1,A_2,A_3,A_4,A_5,A_6,A_7)
R_2    =    Overall power use    =    weighted geomean(A_8*,A_9*,A_10,A_11)

*  The geometric mean weight is specified in the table below.