You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 01:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Mon May 04, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2024021460,2sleep20-21swapper/208:32:272
484221080,4sleep20-21swapper/209:17:302
484221080,4sleep20-21swapper/209:17:302
3512820,2sleep0201rcuc/011:57:360
3512820,2sleep0201rcuc/011:57:360
3512820,2sleep0201rcuc/011:57:360
10942760,3sleep30-21swapper/310:32:363
10942760,3sleep30-21swapper/310:32:363
11082680,3sleep30-21swapper/307:42:153
11082680,3sleep30-21swapper/307:42:153
11082680,3sleep30-21swapper/307:42:153
99922660,4sleep20-21swapper/209:32:172
99922660,4sleep20-21swapper/209:32:172
9722660,3sleep20-21swapper/210:32:352
9722660,3sleep20-21swapper/210:32:352
227782630,3chrt0-21swapper/308:37:353
227782630,3chrt0-21swapper/308:37:353
85712620,3chrt0-21swapper/009:27:290
85712620,3chrt0-21swapper/009:27:290
48272610,3sleep30-21swapper/307:51:523
68862560,3sleep20-21swapper/210:47:392
68862560,3sleep20-21swapper/210:47:392
68862560,3sleep20-21swapper/210:47:392
254772490,2chrt25474-21mailstats11:37:380
254772490,2chrt25474-21mailstats11:37:380
284152470,2sleep20-21swapper/211:47:282
284152470,2sleep20-21swapper/211:47:282
284152470,2sleep20-21swapper/211:47:282
255172470,1sleep30-21swapper/310:12:303
255172470,1sleep30-21swapper/310:12:303
138382460,2sleep20-21swapper/212:32:392
138382460,2sleep20-21swapper/212:32:392
81802450,3sleep30-21swapper/310:52:303
81802450,3sleep30-21swapper/310:52:303
141072450,2chrt0-21swapper/211:07:372
141072450,2chrt0-21swapper/211:07:372
164862430,1sleep00-21swapper/012:42:260
164862430,1sleep00-21swapper/012:42:260
164862430,1sleep00-21swapper/012:42:260
97602420,3sleep30-21swapper/310:57:293
302962390,2sleep10-21swapper/108:57:361
302962390,2sleep10-21swapper/108:57:361
157672390,3sleep20-21swapper/211:12:312
157672390,3sleep20-21swapper/211:12:312
237712380,4sleep20-21swapper/210:07:312
237712380,4sleep20-21swapper/210:07:312
237712380,4sleep20-21swapper/210:07:312
22688993627,7cyclictest11674-21fschecks_time11:02:290
22688993627,7cyclictest11674-21fschecks_time11:02:290
108632360,3sleep30-21swapper/308:07:283
108632360,3sleep30-21swapper/308:07:283
240702350,3sleep30-21swapper/308:42:293
240702350,3sleep30-21swapper/308:42:293
296332340,3sleep30-21swapper/310:22:353
296332340,3sleep30-21swapper/310:22:353
296332340,3sleep30-21swapper/310:22:353
22688993428,4cyclictest16150-21sendmail08:22:160
22688993428,4cyclictest16150-21sendmail08:22:160
22688993427,4cyclictest0-21swapper/010:37:270
22688993427,4cyclictest0-21swapper/010:37:270
22688993425,7cyclictest5544-21threads09:17:390
22688993425,7cyclictest5544-21threads09:17:390
22688993325,6cyclictest24352-21kernelversion08:42:320
22688993325,6cyclictest24352-21kernelversion08:42:320
22689993224,6cyclictest12523-21sort11:02:381
22689993224,6cyclictest12523-21sort11:02:381
22689993223,7cyclictest17217-21fschecks_count11:17:291
22689993223,7cyclictest17217-21fschecks_count11:17:291
22689993223,7cyclictest17217-21fschecks_count11:17:291
22689993223,7cyclictest16821-21threads09:47:381
22689993223,7cyclictest16821-21threads09:47:381
22689993223,7cyclictest16821-21threads09:47:381
75432310,3sleep20-21swapper/207:57:302
75432310,3sleep20-21swapper/207:57:302
22689993125,4cyclictest16139-21cron08:22:161
22689993125,4cyclictest16139-21cron08:22:161
22689993122,7cyclictest24818-21fschecks_time11:37:291
22689993122,7cyclictest24818-21fschecks_time11:37:291
22688993125,4cyclictest19620-21runrttasks11:22:320
22688993125,4cyclictest19620-21runrttasks11:22:320
22688993125,4cyclictest19620-21runrttasks11:22:320
22688993124,6cyclictest8765-21sendmail12:22:160
22688993124,6cyclictest8765-21sendmail12:22:160
22688993025,3cyclictest0-21swapper/007:57:370
22688993025,3cyclictest0-21swapper/007:57:370
22688993024,5cyclictest21325-21kernelversion11:27:300
22688993024,5cyclictest21325-21kernelversion11:27:300
22688993023,5cyclictest18095-21latency_hist08:27:190
22688993023,5cyclictest18095-21latency_hist08:27:190
22688993023,5cyclictest17448-21sh09:52:290
22688993023,5cyclictest17448-21sh09:52:290
276692290,4sleep30-21swapper/310:17:333
276692290,4sleep30-21swapper/310:17:333
22689992924,3cyclictest8288-21kworker/u9:3-xprtiod08:02:151
22689992924,3cyclictest8288-21kworker/u9:3-xprtiod08:02:151
22689992920,7cyclictest8538-21fschecks_time09:27:291
22689992920,7cyclictest8538-21fschecks_time09:27:291
22688992924,3cyclictest0-21swapper/008:12:370
22688992924,3cyclictest0-21swapper/008:12:370
22688992923,5cyclictest1438-21needreboot09:07:340
22688992923,5cyclictest1438-21needreboot09:07:340
22688992922,5cyclictest4146-21cut10:42:290
22688992922,5cyclictest4146-21cut10:42:290
22688992922,5cyclictest15406-21cut11:12:280
283532280,1sleep128414-21grep11:47:281
283532280,1sleep128414-21grep11:47:281
283532280,1sleep128414-21grep11:47:281
22688992823,4cyclictest572-21cups-browsed12:32:380
22688992823,4cyclictest572-21cups-browsed12:32:380
22688992823,3cyclictest27359-21latency_hist08:52:150
22688992823,3cyclictest27359-21latency_hist08:52:150
22688992822,5cyclictest550-21cron10:27:160
22688992822,5cyclictest550-21cron10:27:160
22688992822,5cyclictest550-21cron10:27:160
22688992822,5cyclictest10982-21cut08:07:290
22688992822,5cyclictest10982-21cut08:07:290
22688992822,4cyclictest22685-21cyclictest08:27:310
22688992822,4cyclictest22685-21cyclictest08:27:310
22688992822,3cyclictest0-21swapper/011:07:390
22688992820,6cyclictest545-21in:imuxsock07:37:370
22688992820,6cyclictest545-21in:imuxsock07:37:370
22688992820,6cyclictest545-21in:imuxsock07:37:370
111402280,3sleep30-21swapper/312:27:293
111402280,3sleep30-21swapper/312:27:293
111402280,3sleep30-21swapper/312:27:293
22689992722,4cyclictest729-21dbus-daemon12:22:161
22689992722,4cyclictest729-21dbus-daemon12:22:161
22689992722,4cyclictest545-21in:imuxsock11:37:151
22689992722,4cyclictest545-21in:imuxsock11:37:151
22689992721,5cyclictest8756-21sh12:22:271
22689992721,5cyclictest8756-21sh12:22:271
22689992721,5cyclictest6569-21ntp_offset10:47:351
22689992721,5cyclictest6569-21ntp_offset10:47:351
22689992721,5cyclictest6569-21ntp_offset10:47:351
22689992721,5cyclictest11233-21latency_hist11:02:161
22689992721,3cyclictest0-21swapper/107:22:391
22689992720,5cyclictest22685-21cyclictest10:32:351
22689992720,5cyclictest22685-21cyclictest10:32:351
22689992720,5cyclictest10879-21fschecks_count08:07:281
22689992720,5cyclictest10879-21fschecks_count08:07:281
22689992719,6cyclictest2411-21latency_hist09:12:171
22689992719,6cyclictest2411-21latency_hist09:12:171
22688992720,4cyclictest0-21swapper/009:47:380
22688992720,4cyclictest0-21swapper/009:47:380
22688992720,4cyclictest0-21swapper/009:47:380
22688992719,6cyclictest9346-21gltestperf12:22:290
22688992719,6cyclictest9346-21gltestperf12:22:290
22688992719,6cyclictest10868-21/usr/sbin/munin12:27:340
22688992719,6cyclictest10868-21/usr/sbin/munin12:27:340
22688992719,6cyclictest10868-21/usr/sbin/munin12:27:340
296432260,2sleep30-21swapper/311:48:223
296432260,2sleep30-21swapper/311:48:223
296432260,2sleep30-21swapper/311:48:223
246372260,3sleep20-21swapper/211:37:282
246372260,3sleep20-21swapper/211:37:282
22689992620,4cyclictest12988-21idleruntime08:12:301
22689992620,4cyclictest12988-21idleruntime08:12:301
22689992620,4cyclictest0-21swapper/109:42:161
22689992620,4cyclictest0-21swapper/109:42:161
22689992619,4cyclictest0-21swapper/112:02:161
22689992619,4cyclictest0-21swapper/112:02:161
22689992619,4cyclictest0-21swapper/112:02:161
22689992618,6cyclictest6251-21latency_hist09:22:171
22689992618,6cyclictest6251-21latency_hist09:22:171
22689992618,6cyclictest31096-21gltestperf10:27:301
22689992618,6cyclictest31096-21gltestperf10:27:301
22689992618,6cyclictest31096-21gltestperf10:27:301
22688992621,4cyclictest5842-21sshd07:52:330
22688992621,3cyclictest26338-21sed10:12:390
22688992621,3cyclictest26338-21sed10:12:390
22688992621,3cyclictest0-21swapper/010:12:160
22688992621,3cyclictest0-21swapper/010:12:160
22688992621,3cyclictest0-21swapper/010:12:160
22688992621,3cyclictest0-21swapper/009:42:300
22688992621,3cyclictest0-21swapper/009:42:300
22688992621,3cyclictest0-21swapper/009:42:300
22688992620,4cyclictest0-21swapper/007:22:380
22688992620,3cyclictest0-21swapper/011:02:160
22688992619,5cyclictest5708-21if_wlan012:12:300
22688992619,5cyclictest5708-21if_wlan012:12:300
22688992619,5cyclictest32005-21needreboot09:02:330
22688992619,5cyclictest32005-21needreboot09:02:330
22688992619,5cyclictest32005-21needreboot09:02:330
22688992619,5cyclictest2857-21fschecks_time09:12:290
22688992619,5cyclictest2857-21fschecks_time09:12:290
22688992619,4cyclictest0-21swapper/008:52:360
22688992618,6cyclictest2882-21sshd07:45:480
22688992618,6cyclictest2882-21sshd07:45:480
2268999252,8cyclictest99632timerwakeupswit08:02:391
2268999252,8cyclictest99632timerwakeupswit08:02:391
22689992519,5cyclictest16768-21idleruntime08:22:301
22689992519,5cyclictest16768-21idleruntime08:22:301
22689992519,4cyclictest13057-21gltestperf12:32:301
22689992519,4cyclictest13057-21gltestperf12:32:301
22689992518,5cyclictest25454-21grep10:12:301
22689992518,5cyclictest25454-21grep10:12:301
22689992515,7cyclictest4444-21kernelversion10:42:311
22689992515,7cyclictest4444-21kernelversion10:42:311
22688992520,3cyclictest0-21swapper/008:57:380
22688992520,3cyclictest0-21swapper/008:57:380
22688992519,4cyclictest0-21swapper/010:27:320
22688992519,4cyclictest0-21swapper/010:27:320
22688992519,4cyclictest0-21swapper/010:27:320
22688992519,3cyclictest0-21swapper/010:17:390
22688992519,3cyclictest0-21swapper/010:17:390
22688992519,3cyclictest0-21swapper/010:06:110
22688992519,3cyclictest0-21swapper/010:06:110
22688992518,5cyclictest22207-21cut08:37:280
22688992518,5cyclictest22207-21cut08:37:280
22688992518,4cyclictest0-21swapper/009:57:290
22688992518,4cyclictest0-21swapper/009:57:290
22688992518,4cyclictest0-21swapper/007:37:150
22688992518,4cyclictest0-21swapper/007:37:150
22689992419,4cyclictest32640-21ntp_offset07:37:341
22689992419,4cyclictest32640-21ntp_offset07:37:341
22689992419,4cyclictest32640-21ntp_offset07:37:341
22689992419,4cyclictest27770-21fschecks_count08:52:261
22689992419,3cyclictest0-21swapper/110:07:291
22689992419,3cyclictest0-21swapper/109:57:361
22689992419,3cyclictest0-21swapper/109:57:361
22689992418,4cyclictest0-21swapper/111:27:271
22689992418,4cyclictest0-21swapper/111:27:271
22689992418,4cyclictest0-21swapper/111:27:271
22689992418,3cyclictest0-21swapper/112:27:371
22689992418,3cyclictest0-21swapper/112:27:371
22689992418,3cyclictest0-21swapper/112:27:371
22689992417,5cyclictest22685-21cyclictest08:27:361
22689992417,5cyclictest22685-21cyclictest08:27:361
22689992417,5cyclictest1584-21cut07:42:281
22689992417,5cyclictest1584-21cut07:42:281
22689992416,6cyclictest14153-21fschecks_time09:42:281
22689992416,6cyclictest14153-21fschecks_time09:42:281
22689992416,6cyclictest14153-21fschecks_time09:42:281
22688992419,3cyclictest0-21swapper/012:07:260
22688992419,3cyclictest0-21swapper/012:07:260
22688992419,3cyclictest0-21swapper/012:07:260
22688992419,3cyclictest0-21swapper/012:07:260
22688992419,3cyclictest0-21swapper/008:32:290
22688992418,5cyclictest17755-21needreboot11:17:350
22688992418,5cyclictest17755-21needreboot11:17:350
22688992418,5cyclictest17755-21needreboot11:17:350
22688992418,4cyclictest0-21swapper/011:52:390
22688992418,4cyclictest0-21swapper/011:52:390
22688992418,4cyclictest0-21swapper/011:52:390
22688992418,4cyclictest0-21swapper/011:49:480
22688992418,4cyclictest0-21swapper/011:49:480
22688992418,4cyclictest0-21swapper/011:49:480
22688992416,6cyclictest0-21swapper/010:37:160
22688992416,6cyclictest0-21swapper/010:37:160
22689992319,2cyclictest0-21swapper/111:32:291
22689992319,2cyclictest0-21swapper/111:12:271
22689992319,2cyclictest0-21swapper/111:12:271
22689992318,3cyclictest0-21swapper/109:52:351
22689992318,3cyclictest0-21swapper/109:52:351
22689992318,2cyclictest0-21swapper/111:57:271
22689992318,2cyclictest0-21swapper/111:57:271
22689992318,2cyclictest0-21swapper/111:57:271
22689992317,5cyclictest30662-21kernelversion11:52:321
22689992317,4cyclictest27359-21latency_hist08:52:211
22689992317,4cyclictest27359-21latency_hist08:52:211
22689992317,4cyclictest0-21swapper/110:27:271
22689992317,4cyclictest0-21swapper/110:27:271
22689992317,3cyclictest0-21swapper/112:12:271
22689992317,3cyclictest0-21swapper/112:12:271
22689992314,7cyclictest29618-21sshd07:29:481
22689992314,7cyclictest29618-21sshd07:29:481
22689992311,10cyclictest10751-21cat09:32:301
22689992311,10cyclictest10751-21cat09:32:301
22688992318,3cyclictest0-21swapper/009:37:370
22688992318,3cyclictest0-21swapper/009:37:370
22688992318,3cyclictest0-21swapper/009:32:280
22688992318,3cyclictest0-21swapper/009:32:280
22688992318,3cyclictest0-21swapper/009:22:370
22688992318,3cyclictest0-21swapper/009:22:370
22688992318,3cyclictest0-21swapper/009:22:370
22688992316,5cyclictest27891-21sshd11:44:480
22688992316,5cyclictest27891-21sshd11:44:480
22688992316,5cyclictest27891-21sshd11:44:480
22688992316,4cyclictest0-21swapper/011:12:300
22688992316,4cyclictest0-21swapper/011:12:300
22688992316,4cyclictest0-21swapper/008:02:320
22688992316,4cyclictest0-21swapper/008:02:320
22688992315,6cyclictest4318-21ls12:07:370
22688992314,7cyclictest28163-21/usr/sbin/munin07:27:330
22688992314,7cyclictest28163-21/usr/sbin/munin07:27:330
22688992314,6cyclictest8740-21timerandwakeup10:52:370
22688992314,6cyclictest8740-21timerandwakeup10:52:370
22689992218,2cyclictest0-21swapper/109:12:381
22689992218,2cyclictest0-21swapper/109:12:381
22689992217,3cyclictest30483-21grep11:52:301
22689992217,3cyclictest0-21swapper/111:27:301
22689992217,3cyclictest0-21swapper/110:37:391
22689992217,3cyclictest0-21swapper/110:37:391
22689992217,3cyclictest0-21swapper/108:32:271
22689992216,3cyclictest0-21swapper/109:02:321
22689992216,3cyclictest0-21swapper/109:02:321
22689992216,3cyclictest0-21swapper/109:02:321
22689992215,5cyclictest23838-21latency10:07:311
22689992215,5cyclictest23838-21latency10:07:311
22689992215,5cyclictest23838-21latency10:07:311
22689992213,7cyclictest14678-21systemd-journal07:57:151
22688992217,3cyclictest0-21swapper/010:47:300
22688992217,3cyclictest0-21swapper/010:47:300
22688992217,3cyclictest0-21swapper/010:47:300
34582210,3sleep30-21swapper/312:07:273
34582210,3sleep30-21swapper/312:07:273
34582210,3sleep30-21swapper/312:07:273
34582210,3sleep30-21swapper/312:07:273
238752210,3sleep30-21swapper/310:07:323
238752210,3sleep30-21swapper/310:07:323
238752210,3sleep30-21swapper/310:07:323
2269099211,14cyclictest32085-21taskset09:02:342
2269099211,14cyclictest32085-21taskset09:02:342
2269099211,14cyclictest32085-21taskset09:02:342
22689992117,2cyclictest0-21swapper/108:37:281
22689992117,2cyclictest0-21swapper/108:37:281
22689992115,4cyclictest0-21swapper/107:47:301
22689992115,3cyclictest0-21swapper/109:22:301
22689992115,3cyclictest0-21swapper/109:22:301
22689992115,3cyclictest0-21swapper/109:22:301
22689992113,6cyclictest29911-21threads10:22:391
22689992016,2cyclictest0-21swapper/110:17:351
22689992016,2cyclictest0-21swapper/110:17:351
22689992015,3cyclictest0-21swapper/112:02:371
22689992015,3cyclictest0-21swapper/112:02:371
22689992015,3cyclictest0-21swapper/112:02:371
22689992015,3cyclictest0-21swapper/112:02:371
22689992015,3cyclictest0-21swapper/110:02:301
22689992014,3cyclictest0-21swapper/111:12:321
22689992014,3cyclictest0-21swapper/111:12:321
22688992013,4cyclictest3934-21ntp_kernel_err07:47:350
22691991910,7cyclictest13773-21chrt08:12:393
22691991910,7cyclictest13773-21chrt08:12:393
22689991914,3cyclictest0-21swapper/112:07:361
22689991914,3cyclictest0-21swapper/108:42:301
22689991914,3cyclictest0-21swapper/108:42:301
22689991914,3cyclictest0-21swapper/107:32:281
22689991914,3cyclictest0-21swapper/107:32:281
22689991912,5cyclictest7896-21grep10:52:281
22689991912,5cyclictest7896-21grep10:52:281
22689991912,5cyclictest14837-21cut12:37:281
22689991912,5cyclictest14837-21cut12:37:281
22689991912,5cyclictest14837-21cut12:37:281
2268899191,8cyclictest22477-21latency_hist11:32:290
2268899191,8cyclictest22477-21latency_hist11:32:290
195052190,3chrt0-21swapper/308:27:383
195052190,3chrt0-21swapper/308:27:383
171372190,3chrt0-21swapper/308:22:363
171372190,3chrt0-21swapper/308:22:363
2269099180,13cyclictest11478-21chrt08:07:352
2269099180,13cyclictest11478-21chrt08:07:352
2268999188,8cyclictest30264-21awk11:52:291
2269199172,10cyclictest0-21swapper/309:37:273
2269199172,10cyclictest0-21swapper/309:37:273
2269199171,12cyclictest5480-21chrt07:52:293
2269099172,11cyclictest0-21swapper/212:02:252
2269099172,11cyclictest0-21swapper/212:02:252
2269099172,11cyclictest0-21swapper/212:02:252
2269099172,11cyclictest0-21swapper/210:02:192
2269099172,11cyclictest0-21swapper/210:02:192
2269099171,11cyclictest19620-21chrt11:22:322
2269099171,11cyclictest19620-21chrt11:22:322
2269099171,11cyclictest19620-21chrt11:22:322
2269099171,10cyclictest1451-21taskset07:42:272
2269099171,10cyclictest1451-21taskset07:42:272
72302160,3sleep30-21swapper/312:17:283
72302160,3sleep30-21swapper/312:17:283
2269199164,7cyclictest0-21swapper/310:37:263
2269199164,7cyclictest0-21swapper/310:37:263
2269199163,9cyclictest0-21swapper/309:09:473
2269199163,9cyclictest0-21swapper/309:09:473
2269199163,9cyclictest0-21swapper/308:57:483
2269199163,9cyclictest0-21swapper/308:57:483
2269199162,10cyclictest0-21swapper/311:22:323
2269199162,10cyclictest0-21swapper/311:22:323
2269199162,10cyclictest0-21swapper/311:22:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional