<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""><div><blockquote type="cite" class=""><div class="">On May 21, 2015, at 09:09, Ian Schenck <<a href="mailto:ian.schenck@gmail.com" class="">ian.schenck@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Gelin,<br class=""><br class=""><div class="">I'm loathsome to share my data as benchmark data. </div></div></div></blockquote><div><br class=""></div><div>Ian,</div><div><br class=""></div><div>Thank you for sharing, thank you for doing a <i class="">realistic</i> test, and thank you for qualifying your results as heavily as they really should be :). I only wish that more publishers of hype-fest microbenchmarks would be as scrupulous and methodical.</div><br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class="">With that disclaimer, I've attached a graph of mean and standard deviation in our particular test.</div><div class=""><br class=""></div><div class=""><span id="cid:14d772e25fb1f7844781"><Request-Response Latency.png></span><br class=""></div><div class="">Run with:</div><div class="">ab -c 1 -n 100</div><div class="">ab -c 10 -n 1000</div><div class="">ab -c 25 -n 5000</div><div class=""><br class=""></div><div class="">I don't know if I have complete output from ab anymore.</div></div></div></blockquote></div><br class=""><div class="">One thing I always feel compelled to point out - 'ab' is a <i class="">terrible</i> benchmarking tool and the numbers it outputs are, often as not, just completely wrong. It really is "apache"-bench, meant to work for validating apache configurations, not a general HTTP testing tool. I have personally had much better success with the very simple "httperf", although there are other tools that are probably better than that.</div><div class=""><br class=""></div><div class="">-glyph</div></body></html>