|
|
|
|
<!DOCTYPE html>
|
|
|
|
|
<html>
|
|
|
|
|
|
|
|
|
|
<head>
|
|
|
|
|
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
|
|
|
|
|
<title>event_serialization/16777216 - Criterion.rs</title>
|
|
|
|
|
<style type="text/css">
|
|
|
|
|
body {
|
|
|
|
|
font: 14px Helvetica Neue;
|
|
|
|
|
text-rendering: optimizelegibility;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.body {
|
|
|
|
|
width: 960px;
|
|
|
|
|
margin: auto;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
th {
|
|
|
|
|
font-weight: 200
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
th,
|
|
|
|
|
td {
|
|
|
|
|
padding-right: 3px;
|
|
|
|
|
padding-bottom: 3px;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
a:link {
|
|
|
|
|
color: #1F78B4;
|
|
|
|
|
text-decoration: none;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
th.ci-bound {
|
|
|
|
|
opacity: 0.6
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
td.ci-bound {
|
|
|
|
|
opacity: 0.5
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.stats {
|
|
|
|
|
width: 80%;
|
|
|
|
|
margin: auto;
|
|
|
|
|
display: flex;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.additional_stats {
|
|
|
|
|
flex: 0 0 60%
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.additional_plots {
|
|
|
|
|
flex: 1
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
h2 {
|
|
|
|
|
font-size: 36px;
|
|
|
|
|
font-weight: 300;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
h3 {
|
|
|
|
|
font-size: 24px;
|
|
|
|
|
font-weight: 300;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#footer {
|
|
|
|
|
height: 40px;
|
|
|
|
|
background: #888;
|
|
|
|
|
color: white;
|
|
|
|
|
font-size: larger;
|
|
|
|
|
font-weight: 300;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#footer a {
|
|
|
|
|
color: white;
|
|
|
|
|
text-decoration: underline;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#footer p {
|
|
|
|
|
text-align: center
|
|
|
|
|
}
|
|
|
|
|
</style>
|
|
|
|
|
</head>
|
|
|
|
|
|
|
|
|
|
<body>
|
|
|
|
|
<div class="body">
|
|
|
|
|
<h2>event_serialization/16777216</h2>
|
|
|
|
|
<div class="absolute">
|
|
|
|
|
<section class="plots">
|
|
|
|
|
<table width="100%">
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="pdf.svg">
|
|
|
|
|
<img src="pdf_small.svg" alt="PDF of Slope" width="450" height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="iteration_times.svg">
|
|
|
|
|
<img src="iteration_times_small.svg" alt="Iteration Times" width="450" height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="stats">
|
|
|
|
|
<div class="additional_stats">
|
|
|
|
|
<h4>Additional Statistics:</h4>
|
|
|
|
|
<table>
|
|
|
|
|
<thead>
|
|
|
|
|
<tr>
|
|
|
|
|
<th></th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Lower bound</th>
|
|
|
|
|
<th>Estimate</th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Upper bound</th>
|
|
|
|
|
</tr>
|
|
|
|
|
</thead>
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Throughput</td>
|
|
|
|
|
<td class="ci-bound">1.6911 GiB/s</td>
|
|
|
|
|
<td>1.7080 GiB/s</td>
|
|
|
|
|
<td class="ci-bound">1.7247 GiB/s</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>R²</td>
|
|
|
|
|
<td class="ci-bound">0.0003013</td>
|
|
|
|
|
<td>0.0003126</td>
|
|
|
|
|
<td class="ci-bound">0.0003006</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Mean</td>
|
|
|
|
|
<td class="ci-bound">9.0594 ms</td>
|
|
|
|
|
<td>9.1481 ms</td>
|
|
|
|
|
<td class="ci-bound">9.2394 ms</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td title="Standard Deviation">Std. Dev.</td>
|
|
|
|
|
<td class="ci-bound">394.22 us</td>
|
|
|
|
|
<td>460.13 us</td>
|
|
|
|
|
<td class="ci-bound">518.49 us</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Median</td>
|
|
|
|
|
<td class="ci-bound">8.9767 ms</td>
|
|
|
|
|
<td>9.0669 ms</td>
|
|
|
|
|
<td class="ci-bound">9.1877 ms</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td title="Median Absolute Deviation">MAD</td>
|
|
|
|
|
<td class="ci-bound">297.41 us</td>
|
|
|
|
|
<td>434.48 us</td>
|
|
|
|
|
<td class="ci-bound">562.49 us</td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
</div>
|
|
|
|
|
<div class="additional_plots">
|
|
|
|
|
<h4>Additional Plots:</h4>
|
|
|
|
|
<ul>
|
|
|
|
|
|
|
|
|
|
<li>
|
|
|
|
|
<a href="typical.svg">Typical</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="mean.svg">Mean</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="SD.svg">Std. Dev.</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="median.svg">Median</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="MAD.svg">MAD</a>
|
|
|
|
|
</li>
|
|
|
|
|
</ul>
|
|
|
|
|
</div>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="explanation">
|
|
|
|
|
<h4>Understanding this report:</h4>
|
|
|
|
|
<p>The plot on the left displays the average time per iteration for this benchmark. The shaded region
|
|
|
|
|
shows the estimated probability of an iteration taking a certain amount of time, while the line
|
|
|
|
|
shows the mean. Click on the plot for a larger view showing the outliers.</p>
|
|
|
|
|
<p>The plot on the right shows the average time per iteration for the samples. Each point
|
|
|
|
|
represents one sample.</p>
|
|
|
|
|
<p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#additional-statistics">the
|
|
|
|
|
documentation</a> for more details on the additional statistics.</p>
|
|
|
|
|
</section>
|
|
|
|
|
</div>
|
|
|
|
|
<section class="plots">
|
|
|
|
|
<h3>Change Since Previous Benchmark</h3>
|
|
|
|
|
<div class="relative">
|
|
|
|
|
<table width="100%">
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="both/pdf.svg">
|
|
|
|
|
<img src="relative_pdf_small.svg" alt="PDF Comparison" width="450"
|
|
|
|
|
height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="both/iteration_times.svg">
|
|
|
|
|
<img src="relative_iteration_times_small.svg" alt="Iteration Time Comparison" width="450"
|
|
|
|
|
height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
</div>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="stats">
|
|
|
|
|
<div class="additional_stats">
|
|
|
|
|
<h4>Additional Statistics:</h4>
|
|
|
|
|
<table>
|
|
|
|
|
<thead>
|
|
|
|
|
<tr>
|
|
|
|
|
<th></th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Lower bound</th>
|
|
|
|
|
<th>Estimate</th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Upper bound</th>
|
|
|
|
|
<th></th>
|
|
|
|
|
</tr>
|
|
|
|
|
</thead>
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Change in time</td>
|
|
|
|
|
<td class="ci-bound">+62.256%</td>
|
|
|
|
|
<td>+64.027%</td>
|
|
|
|
|
<td class="ci-bound">+65.930%</td>
|
|
|
|
|
<td>(p = 0.00 <
|
|
|
|
|
0.05)</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Change in throughput</td>
|
|
|
|
|
<td class="ci-bound">-38.369%</td>
|
|
|
|
|
<td>-39.034%</td>
|
|
|
|
|
<td class="ci-bound">-39.734%</td>
|
|
|
|
|
<td></td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
Performance has regressed.
|
|
|
|
|
</div>
|
|
|
|
|
<div class="additional_plots">
|
|
|
|
|
<h4>Additional Plots:</h4>
|
|
|
|
|
<ul>
|
|
|
|
|
|
|
|
|
|
<li>
|
|
|
|
|
<a href="change/mean.svg">Change in mean</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="change/median.svg">Change in median</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="change/t-test.svg">T-Test</a>
|
|
|
|
|
</li>
|
|
|
|
|
</ul>
|
|
|
|
|
</div>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="explanation">
|
|
|
|
|
<h4>Understanding this report:</h4>
|
|
|
|
|
<p>The plot on the left shows the probability of the function taking a certain amount of time. The red
|
|
|
|
|
curve represents the saved measurements from the last time this benchmark was run, while the blue curve
|
|
|
|
|
shows the measurements from this run. The lines represent the mean time per iteration. Click on the
|
|
|
|
|
plot for a larger view.</p>
|
|
|
|
|
<p>The plot on the right shows the iteration times for the two measurements. Again, the red dots represent
|
|
|
|
|
the previous measurement while the blue dots show the current measurement.</p>
|
|
|
|
|
<p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#change">the
|
|
|
|
|
documentation</a> for more details on the additional statistics.</p>
|
|
|
|
|
</section>
|
|
|
|
|
</div>
|
|
|
|
|
<div id="footer">
|
|
|
|
|
<p>This report was generated by
|
|
|
|
|
<a href="https://github.com/bheisler/criterion.rs">Criterion.rs</a>, a statistics-driven benchmarking
|
|
|
|
|
library in Rust.</p>
|
|
|
|
|
</div>
|
|
|
|
|
</body>
|
|
|
|
|
|
|
|
|
|
</html>
|
