|
|
|
|
<!DOCTYPE html>
|
|
|
|
|
<html>
|
|
|
|
|
|
|
|
|
|
<head>
|
|
|
|
|
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
|
|
|
|
|
<title>event_serialization/4194304 - Criterion.rs</title>
|
|
|
|
|
<style type="text/css">
|
|
|
|
|
body {
|
|
|
|
|
font: 14px Helvetica Neue;
|
|
|
|
|
text-rendering: optimizelegibility;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.body {
|
|
|
|
|
width: 960px;
|
|
|
|
|
margin: auto;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
th {
|
|
|
|
|
font-weight: 200
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
th,
|
|
|
|
|
td {
|
|
|
|
|
padding-right: 3px;
|
|
|
|
|
padding-bottom: 3px;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
a:link {
|
|
|
|
|
color: #1F78B4;
|
|
|
|
|
text-decoration: none;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
th.ci-bound {
|
|
|
|
|
opacity: 0.6
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
td.ci-bound {
|
|
|
|
|
opacity: 0.5
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.stats {
|
|
|
|
|
width: 80%;
|
|
|
|
|
margin: auto;
|
|
|
|
|
display: flex;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.additional_stats {
|
|
|
|
|
flex: 0 0 60%
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.additional_plots {
|
|
|
|
|
flex: 1
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
h2 {
|
|
|
|
|
font-size: 36px;
|
|
|
|
|
font-weight: 300;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
h3 {
|
|
|
|
|
font-size: 24px;
|
|
|
|
|
font-weight: 300;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#footer {
|
|
|
|
|
height: 40px;
|
|
|
|
|
background: #888;
|
|
|
|
|
color: white;
|
|
|
|
|
font-size: larger;
|
|
|
|
|
font-weight: 300;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#footer a {
|
|
|
|
|
color: white;
|
|
|
|
|
text-decoration: underline;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#footer p {
|
|
|
|
|
text-align: center
|
|
|
|
|
}
|
|
|
|
|
</style>
|
|
|
|
|
</head>
|
|
|
|
|
|
|
|
|
|
<body>
|
|
|
|
|
<div class="body">
|
|
|
|
|
<h2>event_serialization/4194304</h2>
|
|
|
|
|
<div class="absolute">
|
|
|
|
|
<section class="plots">
|
|
|
|
|
<table width="100%">
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="pdf.svg">
|
|
|
|
|
<img src="pdf_small.svg" alt="PDF of Slope" width="450" height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="iteration_times.svg">
|
|
|
|
|
<img src="iteration_times_small.svg" alt="Iteration Times" width="450" height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="stats">
|
|
|
|
|
<div class="additional_stats">
|
|
|
|
|
<h4>Additional Statistics:</h4>
|
|
|
|
|
<table>
|
|
|
|
|
<thead>
|
|
|
|
|
<tr>
|
|
|
|
|
<th></th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Lower bound</th>
|
|
|
|
|
<th>Estimate</th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Upper bound</th>
|
|
|
|
|
</tr>
|
|
|
|
|
</thead>
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Throughput</td>
|
|
|
|
|
<td class="ci-bound">1.5918 GiB/s</td>
|
|
|
|
|
<td>1.5954 GiB/s</td>
|
|
|
|
|
<td class="ci-bound">1.5985 GiB/s</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>R²</td>
|
|
|
|
|
<td class="ci-bound">0.0007228</td>
|
|
|
|
|
<td>0.0007467</td>
|
|
|
|
|
<td class="ci-bound">0.0007146</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Mean</td>
|
|
|
|
|
<td class="ci-bound">2.4436 ms</td>
|
|
|
|
|
<td>2.4484 ms</td>
|
|
|
|
|
<td class="ci-bound">2.4540 ms</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td title="Standard Deviation">Std. Dev.</td>
|
|
|
|
|
<td class="ci-bound">15.772 us</td>
|
|
|
|
|
<td>26.509 us</td>
|
|
|
|
|
<td class="ci-bound">36.040 us</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Median</td>
|
|
|
|
|
<td class="ci-bound">2.4374 ms</td>
|
|
|
|
|
<td>2.4415 ms</td>
|
|
|
|
|
<td class="ci-bound">2.4458 ms</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td title="Median Absolute Deviation">MAD</td>
|
|
|
|
|
<td class="ci-bound">10.390 us</td>
|
|
|
|
|
<td>13.882 us</td>
|
|
|
|
|
<td class="ci-bound">17.869 us</td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
</div>
|
|
|
|
|
<div class="additional_plots">
|
|
|
|
|
<h4>Additional Plots:</h4>
|
|
|
|
|
<ul>
|
|
|
|
|
|
|
|
|
|
<li>
|
|
|
|
|
<a href="typical.svg">Typical</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="mean.svg">Mean</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="SD.svg">Std. Dev.</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="median.svg">Median</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="MAD.svg">MAD</a>
|
|
|
|
|
</li>
|
|
|
|
|
</ul>
|
|
|
|
|
</div>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="explanation">
|
|
|
|
|
<h4>Understanding this report:</h4>
|
|
|
|
|
<p>The plot on the left displays the average time per iteration for this benchmark. The shaded region
|
|
|
|
|
shows the estimated probability of an iteration taking a certain amount of time, while the line
|
|
|
|
|
shows the mean. Click on the plot for a larger view showing the outliers.</p>
|
|
|
|
|
<p>The plot on the right shows the average time per iteration for the samples. Each point
|
|
|
|
|
represents one sample.</p>
|
|
|
|
|
<p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#additional-statistics">the
|
|
|
|
|
documentation</a> for more details on the additional statistics.</p>
|
|
|
|
|
</section>
|
|
|
|
|
</div>
|
|
|
|
|
<section class="plots">
|
|
|
|
|
<h3>Change Since Previous Benchmark</h3>
|
|
|
|
|
<div class="relative">
|
|
|
|
|
<table width="100%">
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="both/pdf.svg">
|
|
|
|
|
<img src="relative_pdf_small.svg" alt="PDF Comparison" width="450"
|
|
|
|
|
height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
<td>
|
|
|
|
|
<a href="both/iteration_times.svg">
|
|
|
|
|
<img src="relative_iteration_times_small.svg" alt="Iteration Time Comparison" width="450"
|
|
|
|
|
height="300" />
|
|
|
|
|
</a>
|
|
|
|
|
</td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
</div>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="stats">
|
|
|
|
|
<div class="additional_stats">
|
|
|
|
|
<h4>Additional Statistics:</h4>
|
|
|
|
|
<table>
|
|
|
|
|
<thead>
|
|
|
|
|
<tr>
|
|
|
|
|
<th></th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Lower bound</th>
|
|
|
|
|
<th>Estimate</th>
|
|
|
|
|
<th title="0.95 confidence level" class="ci-bound">Upper bound</th>
|
|
|
|
|
<th></th>
|
|
|
|
|
</tr>
|
|
|
|
|
</thead>
|
|
|
|
|
<tbody>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Change in time</td>
|
|
|
|
|
<td class="ci-bound">-6.3851%</td>
|
|
|
|
|
<td>-6.1903%</td>
|
|
|
|
|
<td class="ci-bound">-5.9619%</td>
|
|
|
|
|
<td>(p = 0.00 <
|
|
|
|
|
0.05)</td>
|
|
|
|
|
</tr>
|
|
|
|
|
<tr>
|
|
|
|
|
<td>Change in throughput</td>
|
|
|
|
|
<td class="ci-bound">+6.8206%</td>
|
|
|
|
|
<td>+6.5988%</td>
|
|
|
|
|
<td class="ci-bound">+6.3398%</td>
|
|
|
|
|
<td></td>
|
|
|
|
|
</tr>
|
|
|
|
|
</tbody>
|
|
|
|
|
</table>
|
|
|
|
|
Performance has improved.
|
|
|
|
|
</div>
|
|
|
|
|
<div class="additional_plots">
|
|
|
|
|
<h4>Additional Plots:</h4>
|
|
|
|
|
<ul>
|
|
|
|
|
|
|
|
|
|
<li>
|
|
|
|
|
<a href="change/mean.svg">Change in mean</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="change/median.svg">Change in median</a>
|
|
|
|
|
</li>
|
|
|
|
|
<li>
|
|
|
|
|
<a href="change/t-test.svg">T-Test</a>
|
|
|
|
|
</li>
|
|
|
|
|
</ul>
|
|
|
|
|
</div>
|
|
|
|
|
</section>
|
|
|
|
|
<section class="explanation">
|
|
|
|
|
<h4>Understanding this report:</h4>
|
|
|
|
|
<p>The plot on the left shows the probability of the function taking a certain amount of time. The red
|
|
|
|
|
curve represents the saved measurements from the last time this benchmark was run, while the blue curve
|
|
|
|
|
shows the measurements from this run. The lines represent the mean time per iteration. Click on the
|
|
|
|
|
plot for a larger view.</p>
|
|
|
|
|
<p>The plot on the right shows the iteration times for the two measurements. Again, the red dots represent
|
|
|
|
|
the previous measurement while the blue dots show the current measurement.</p>
|
|
|
|
|
<p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#change">the
|
|
|
|
|
documentation</a> for more details on the additional statistics.</p>
|
|
|
|
|
</section>
|
|
|
|
|
</div>
|
|
|
|
|
<div id="footer">
|
|
|
|
|
<p>This report was generated by
|
|
|
|
|
<a href="https://github.com/bheisler/criterion.rs">Criterion.rs</a>, a statistics-driven benchmarking
|
|
|
|
|
library in Rust.</p>
|
|
|
|
|
</div>
|
|
|
|
|
</body>
|
|
|
|
|
|
|
|
|
|
</html>
|
