jepsen.checker.perf — org.clojars.jacobmbr/jepsen 0.1.4

Supporting functions for performance analysis.

bucket-points clj

(bucket-points dt points)

Takes a time window dt and a sequence of [time, _] points, and emits a seq of [time, points-in-window] buckets, ordered by time. Time is at the midpoint of the window.

bucket-scale clj

(bucket-scale dt b)

Given a bucket size dt, and a bucket number (e.g. 0, 1, ...), returns the time at the midpoint of that bucket.

bucket-time clj

(bucket-time dt t)

Given a bucket size dt and a time t, computes the time at the midpoint of the bucket this time falls into.

buckets clj

(buckets dt)

(buckets dt tmax)

Given a bucket size dt, emits a lazy sequence of times at the midpoints of each bucket.

completions-by-f-type clj

(completions-by-f-type history)

Takes a history and returns a map of f -> type-> ops, for all completions in history.

fs->points clj

(fs->points fs)

Given a sequence of :f's, yields a map of f -> gnuplot-point-type, so we can render each function in a different style.

invokes-by-f clj

(invokes-by-f history)

Takes a history and returns a map of f -> ops, for all invocations.

invokes-by-f-type clj

(invokes-by-f-type history)

Takes a history and returns a map of f -> type -> ops, for all invocations.

invokes-by-type clj

(invokes-by-type ops)

Splits up a sequence of invocations into ok, failed, and crashed ops by looking at their corresponding completions.

latencies->quantiles clj

(latencies->quantiles dt qs points)

Takes a time window in seconds, a sequence of quantiles from 0 to 1, and a sequence of [time, latency] pairs. Groups pairs by their time window and emits a emits a map of quantiles to sequences of [time, latency-at-that-quantile] pairs, one per time window.

latency-point clj

(latency-point op)

Given an operation, returns a [time, latency] pair: times in seconds, latencies in ms.

latency-preamble clj

(latency-preamble test output-path)

Gnuplot commands for setting up a latency plot.

nemesis-events clj

(nemesis-events history opts)

Given a history, constructs a sequence of times, in seconds, marking nemesis events other than start/stop pairs.

nemesis-intervals clj

(nemesis-intervals history)

(nemesis-intervals history opts)

Given a history, constructs a sequence of [start-time, stop-time] intervals when the nemesis was active, in units of seconds.

nemesis-keys clj

(nemesis-keys nemeses)

Takes a set of nemeses and renders the keys for the legend

nemesis-lines clj

(nemesis-lines history)

(nemesis-lines history opts)

Emits a sequence of gnuplot commands rendering vertical lines where nemesis events occurred.

Takes an options map for nemesis regions and styling ex: {:name "Your Nemesis Here (TM)" :start #{:start1 :start2} :stop #{:stop1 :stop2} :line-color #"dddddd" :line-width 1}

nemesis-regions clj

(nemesis-regions history nemeses)

Wraps nemesis-regions* to work with collections of nemeses.

nemesis-regions* clj

(nemesis-regions* history)

(nemesis-regions* history opts)

Emits a sequence of gnuplot commands rendering shaded regions where the nemesis is active. We can render a maximum of 12 nemeses; this keeps nemesis size and spacing consistent.

{:name "Your Nemesis Here (TM)" :start #{:start1 :start2} :stop #{:stop1 :stop2} :fill-color "#000000" :transparency 0.05}

:name must be provided for the nemesis to be displayed in the legend.

point-graph! clj

(point-graph! test history {:keys [subdirectory nemeses] :as opts})

Writes a plot of raw latency data points.

preamble clj

(preamble output-path)

Shared gnuplot preamble

qs->colors clj

(qs->colors qs)

Given a sequence of quantiles q, yields a map of q -> gnuplot-color, so we can render each latency curve in a different color.

quantiles clj

(quantiles qs points)

Takes a sequence of quantiles from 0 to 1 and a sequence of values, and returns a map of quantiles to values at those quantiles.

quantiles-graph! clj

(quantiles-graph! test history {:keys [subdirectory nemeses]})

Writes a plot of latency quantiles, by f, over time.

rate clj

(rate history)

Map breaking down the mean rate of completions by f and type, plus totals at each level.

rate-graph! clj

(rate-graph! test history {:keys [subdirectory nemeses]})

Writes a plot of operation rate by their completion times.

rate-preamble clj

(rate-preamble test output-path)

Gnuplot commands for setting up a rate plot.

type->color clj

Takes a type of operation (e.g. :ok) and returns a gnuplot color.

types clj

What types are we rendering?