Tailslayer: Library for reducing tail latency in RAM reads

Summary

Tailslayer is a C++ library that reduces tail latency in RAM reads caused by DRAM refresh stalls. It replicates data across multiple, independent DRAM channels with uncorrelated refresh schedules, using (undocumented!) channel scrambling offsets that works on AMD, Intel, and Graviton. Once the request comes in, Tailslayer issues hedged reads across all replicas, allowing the work to be performed on whichever result responds first. The library code is available in hedged_reader.cpp and the example using the library can be found in tailslayer_example.cpp. To use it, copy include/tailslayer into your project and #include <tailslayer/hedged_reader.hpp>. The library currently works with two channels (updates to come!), but full N-way usage is available in the benchmark. You provide the value type and two functions as template parameters: Signal function: Add the loop that waits for the external signal. This determines when to read. Return the desired index to read, and the read immediately fires. Final work function: This receives the value immediately after it is read. Add the desired value processing code here. #include <tailslayer/hedged_reader.hpp> [[gnu::always_inline]] inline std::size_t my_signal() { // Wait for your event, then return the index to read return index_to_read; } template <typename T> [[gnu::always_inline]] inline void my_work(T val) { // Use the value } int main() { using T = uint8_t; tailslayer::pin_to_core(tailslayer::CORE_MAIN); tailslayer::HedgedReader<T, my_signal, my_work<T>> reader{}; reader.insert(0x43); reader.insert(0x44); reader.start_workers(); } Arguments can be passed to either function via ArgList: tailslayer::HedgedReader<T, my_signal, my_work<T>, tailslayer::ArgList<1, 2>, // args to signal function tailslayer::ArgList<2> // args to final work function > reader{}; You can also optionally pass in a different channel offset, channel bit, and number of replicas to the constructor. Note: Each insert copies the element N times where N is...