You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 04:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jun 08, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
474213995147,3cyclictest634947-21kworker/u8:0+events_unbound22:25:010
474218994542,2cyclictest436726-21kworker/u8:3+events_unbound19:10:202
474213994437,5cyclictest593637-21latency_hist21:05:010
474215994234,6cyclictest335557-21systemd-journal22:25:001
474218994037,2cyclictest766721-21kworker/u8:2+events_unbound00:35:152
474218994036,2cyclictest510417-21kworker/u8:3+flush-259:019:50:202
474218994036,2cyclictest510417-21kworker/u8:3+flush-259:019:50:202
474213994034,4cyclictest557600-21latency_hist20:30:010
474218993934,3cyclictest672078-21kworker/u8:4+events_unbound22:35:232
474213993936,2cyclictest557620-21kworker/u8:3+flush-259:021:15:210
474213993932,3cyclictest557620-21kworker/u8:3+events_unbound21:15:020
474215993832,4cyclictest562978-21/usr/sbin/munin20:35:151
474213993835,2cyclictest719072-21kworker/u8:3+flush-259:023:45:150
474213993835,2cyclictest672078-21kworker/u8:4+flush-259:023:10:210
474213993834,2cyclictest708117-21kworker/u8:1+events_unbound23:15:150
474218993734,2cyclictest650799-21kworker/u8:3+flush-259:022:15:162
474218993734,2cyclictest619650-21kworker/u8:4+flush-259:021:40:152
474215993732,3cyclictest568116-21apt-get20:40:121
474218993633,2cyclictest510417-21kworker/u8:3+flush-259:019:55:252
474215993632,3cyclictest671729-21kworker/u8:2+flush-259:022:30:161
474213993630,4cyclictest809033-21latency_hist00:30:000
474218993532,2cyclictest557620-21kworker/u8:3+events_unbound20:55:212
474213993530,4cyclictest478446-21ntpq19:10:210
474218993431,2cyclictest542131-21kworker/u8:2+events_unbound20:35:232
474218993431,2cyclictest536904-21kworker/u8:0+events_unbound20:10:162
474218993430,3cyclictest557620-21kworker/u8:3+events_unbound21:10:212
474213993431,2cyclictest536904-21kworker/u8:0+events_unbound20:20:170
474213993431,2cyclictest431555-21kworker/u8:2+events_unbound19:15:220
474213993430,3cyclictest719072-21kworker/u8:3+events_unbound00:00:240
474218993330,2cyclictest708117-21kworker/u8:1+flush-259:023:15:172
474218993330,2cyclictest672078-21kworker/u8:4+flush-259:022:40:262
474218993330,2cyclictest479355-21kworker/u8:1+flush-259:020:05:242
474215993327,4cyclictest630433-21/usr/sbin/munin21:40:211
474213993330,2cyclictest672078-21kworker/u8:4+flush-259:022:35:220
474213993329,3cyclictest526483-21apt-get20:00:120
474218993229,2cyclictest793280-21kworker/u8:0+events_unbound00:30:212
474218993229,2cyclictest609162-21kworker/u8:1+events_unbound21:25:142
474215993226,5cyclictest776231-21ntpq23:55:211
474215993226,4cyclictest335557-21systemd-journal00:20:471
474213993229,2cyclictest494849-21kworker/u8:3+events_unbound19:30:170
474218993128,2cyclictest557620-21kworker/u8:3+flush-259:021:15:262
474218993127,3cyclictest634947-21kworker/u8:0+events_unbound22:25:232
474215993127,3cyclictest542131-21kworker/u8:2+flush-259:020:30:161
474213993128,2cyclictest729684-21kworker/u8:0+events_unbound23:25:230
474213993128,2cyclictest702939-21kworker/u8:0+flush-259:022:50:250
474223993022,6cyclictest335557-21systemd-journal19:40:003
474218993027,2cyclictest766721-21kworker/u8:2+events_unbound00:15:232
474218993027,2cyclictest672078-21kworker/u8:4+events_unbound22:55:192
474218993027,2cyclictest634947-21kworker/u8:0+flush-259:022:10:252
474218993027,2cyclictest634947-21kworker/u8:0+flush-259:022:05:202
474218993027,2cyclictest619436-21kworker/u8:2+events_unbound21:50:222
474218993025,4cyclictest793045-21latency_hist00:15:002
474215993025,3cyclictest692774-21/usr/sbin/munin22:40:161
474215993024,4cyclictest681285-21ntpq22:25:221
474215993023,5cyclictest335557-21systemd-journal22:00:371
474213993027,2cyclictest542131-21kworker/u8:2+flush-259:020:30:200
474213993026,3cyclictest766721-21kworker/u8:2+events_unbound00:35:230
474213993026,3cyclictest634947-21kworker/u8:0+flush-259:022:10:250
474213993026,2cyclictest557620-21kworker/u8:3+events_unbound20:55:170
474223992922,5cyclictest718420-21latency_hist23:05:003
474218992925,3cyclictest431555-21kworker/u8:2+flush-259:019:35:212
474215992925,3cyclictest640737-21apt-get21:50:111
474213992926,2cyclictest729684-21kworker/u8:0+events_unbound23:30:160
474213992926,2cyclictest719072-21kworker/u8:3+events_unbound23:05:220
474213992926,2cyclictest719072-21kworker/u8:3+events_unbound00:15:170
474213992926,2cyclictest619650-21kworker/u8:4+events_unbound21:30:180
474218992825,2cyclictest573243-21kworker/u8:1+events_unbound20:45:212
474218992825,2cyclictest567874-21kworker/u8:0+events_unbound20:40:242
474218992824,3cyclictest729684-21kworker/u8:0+events_unbound23:30:202
474218992823,4cyclictest484492-21latency_hist19:20:002
474215992825,2cyclictest619650-21kworker/u8:4+flush-259:021:30:171
474215992821,5cyclictest745227-21latency_hist23:30:001
474213992825,2cyclictest479355-21kworker/u8:1+flush-259:020:05:150
474213992824,2cyclictest619436-21kworker/u8:2+flush-259:021:55:260
474223992723,3cyclictest650799-21kworker/u8:3+flush-259:022:15:223
474223992721,4cyclictest335557-21systemd-journal00:20:013
474218992724,2cyclictest729684-21kworker/u8:0+flush-259:023:45:242
474218992724,2cyclictest729684-21kworker/u8:0+flush-259:023:25:142
474218992723,3cyclictest729684-21kworker/u8:0+events_unbound23:35:202
474218992723,3cyclictest526647-21kworker/u8:5+events_unbound20:00:192
474218992722,4cyclictest629279-21ntpq21:35:212
474213992724,2cyclictest719072-21kworker/u8:3+events_unbound23:50:140
474213992724,2cyclictest672078-21kworker/u8:4+flush-259:023:00:220
474213992724,2cyclictest573243-21kworker/u8:1+flush-259:020:45:230
474223992619,4cyclictest724233-21cp23:10:013
474218992624,2cyclictest536904-21kworker/u8:0+flush-259:020:20:252
474218992623,2cyclictest526647-21kworker/u8:5+events_unbound20:15:142
474218992623,2cyclictest489332-21kworker/u8:0+events_unbound19:25:232
474215992622,3cyclictest557620-21kworker/u8:3+events_unbound21:00:171
474215992620,4cyclictest510417-21kworker/u8:3+events_unbound19:50:151
474215992620,4cyclictest510417-21kworker/u8:3+events_unbound19:50:151
474213992623,2cyclictest489332-21kworker/u8:0+events_unbound19:40:220
474213992622,3cyclictest671729-21kworker/u8:2+events_unbound22:25:020
474213992619,5cyclictest686498-21ntpq22:30:210
474223992521,3cyclictest630458-21apt-get21:40:123
474223992517,5cyclictest677008-21latency_hist22:25:003
474218992522,2cyclictest766721-21kworker/u8:2+events_unbound23:50:232
474218992522,2cyclictest672078-21kworker/u8:4+events_unbound23:13:402
474218992522,2cyclictest634947-21kworker/u8:0+events_unbound22:00:192
474218992522,2cyclictest583315-21kworker/u8:2+events_unbound21:05:162
474218992522,2cyclictest542131-21kworker/u8:2+flush-259:020:25:152
474213992523,2cyclictest793280-21kworker/u8:0+flush-259:000:30:250
474213992522,2cyclictest650799-21kworker/u8:3+flush-259:022:15:190
474213992522,2cyclictest619436-21kworker/u8:2+events_unbound21:50:130
474213992522,2cyclictest557620-21kworker/u8:3+flush-259:021:20:240
474213992521,3cyclictest526647-21kworker/u8:5+flush-259:020:15:150
474223992416,5cyclictest531876-21cat20:05:013
474218992421,2cyclictest793280-21kworker/u8:0+flush-259:000:20:252
474218992421,2cyclictest766721-21kworker/u8:2+events_unbound00:25:222
474218992421,2cyclictest766721-21kworker/u8:2+events_unbound00:25:222
474218992421,2cyclictest573243-21kworker/u8:1+events_unbound20:50:162
474218992421,2cyclictest557620-21kworker/u8:3+events_unbound21:20:252
474215992420,3cyclictest766721-21kworker/u8:2+flush-259:000:25:161
474215992420,3cyclictest766721-21kworker/u8:2+flush-259:000:25:161
474215992419,4cyclictest335557-21systemd-journal23:31:381
474213992421,2cyclictest672078-21kworker/u8:4+events_unbound22:45:220
474223992319,3cyclictest619436-21kworker/u8:2+flush-259:021:55:173
474223992318,3cyclictest655564-21ntpq22:00:233
474218992320,2cyclictest672078-21kworker/u8:4+events_unbound22:55:012
474218992319,3cyclictest489332-21kworker/u8:0+flush-259:019:45:262
474218992319,3cyclictest335557-21systemd-journal19:21:302
474215992319,3cyclictest557620-21kworker/u8:3+events_unbound21:15:181
474215992318,4cyclictest719072-21kworker/u8:3+events_unbound23:05:161
474213992320,2cyclictest557620-21kworker/u8:3+events_unbound20:37:390
474223992219,2cyclictest509-21rs:main3
474223992218,3cyclictest640456-21cron21:50:003
474223992218,3cyclictest567874-21kworker/u8:0+flush-259:020:40:143
474223992214,5cyclictest567854-21latency_hist20:40:013
474218992219,2cyclictest719072-21kworker/u8:3+events_unbound23:05:242
474218992219,2cyclictest489332-21kworker/u8:0+flush-259:019:45:002
474215992218,3cyclictest756014-21kworker/u8:1+flush-259:023:50:001
474215992218,3cyclictest672078-21kworker/u8:4+flush-259:022:45:241
474215992218,3cyclictest536904-21kworker/u8:0+flush-259:020:20:191
474215992217,3cyclictest672078-21kworker/u8:4+events_unbound23:00:151
474213992219,2cyclictest766721-21kworker/u8:2+events_unbound00:05:240
474213992219,2cyclictest634947-21kworker/u8:0+flush-259:022:00:240
474213992219,2cyclictest431555-21kworker/u8:2+events_unbound19:20:160
474213992218,3cyclictest793280-21kworker/u8:0+events_unbound00:20:390
474213992218,3cyclictest719072-21kworker/u8:3+flush-259:023:40:200
474213992218,3cyclictest619650-21kworker/u8:4+events_unbound21:40:140
474213992218,3cyclictest479355-21kworker/u8:1+events_unbound19:25:190
47422399216,9cyclictest494802-21latency_hist19:30:003
474223992118,2cyclictest0-21swapper/321:34:593
474218992119,2cyclictest494849-21kworker/u8:3+flush-259:019:32:062
474218992117,3cyclictest619650-21kworker/u8:4+events_unbound21:30:232
474215992117,3cyclictest431555-21kworker/u8:2+events_unbound19:15:181
474215992116,3cyclictest573243-21kworker/u8:1+events_unbound20:45:141
474215992116,3cyclictest489332-21kworker/u8:0+events_unbound19:45:221
474213992118,2cyclictest672078-21kworker/u8:4+events_unbound22:55:260
474223992016,2cyclictest0-21swapper/319:35:003
474215992017,2cyclictest583315-21kworker/u8:2+events_unbound21:10:001
474215992016,3cyclictest766721-21kworker/u8:2+flush-259:000:35:241
474215992015,3cyclictest526647-21kworker/u8:5+flush-259:020:00:191
474215992015,3cyclictest489332-21kworker/u8:0+flush-259:019:30:001
474213992017,2cyclictest672078-21kworker/u8:4+events_unbound22:40:210
474213992016,3cyclictest719072-21kworker/u8:3+events_unbound23:38:390
474223991915,2cyclictest0-21swapper/300:10:013
474223991914,3cyclictest740264-21/usr/sbin/munin23:25:143
474218991916,2cyclictest672078-21kworker/u8:4+events_unbound22:45:242
474215991916,2cyclictest557620-21kworker/u8:3+events_unbound21:10:231
474215991916,2cyclictest479355-21kworker/u8:1+events_unbound19:45:001
474215991916,2cyclictest431555-21kworker/u8:2+events_unbound19:10:221
474215991915,3cyclictest793280-21kworker/u8:0+flush-259:000:30:161
474215991915,3cyclictest719072-21kworker/u8:3+flush-259:023:40:241
474215991915,3cyclictest672078-21kworker/u8:4+events_unbound23:10:231
474215991915,3cyclictest526647-21kworker/u8:5+events_unbound20:15:001
474215991913,4cyclictest488757-21ntpq19:20:211
474213991916,3cyclictest729876-21kworker/u8:2+events_unbound23:22:530
474213991916,2cyclictest788027-21gpgv00:10:010
474223991813,1cyclictest191rcu_preempt20:15:113
474223991811,5cyclictest335557-21systemd-journal19:25:013
474218991815,2cyclictest766721-21kworker/u8:2+flush-259:023:55:232
474218991815,1cyclictest0-21swapper/200:05:002
474218991814,3cyclictest671729-21kworker/u8:2+flush-259:023:00:432
474215991814,3cyclictest672078-21kworker/u8:4+flush-259:022:35:251
474215991814,2cyclictest479355-21kworker/u8:1+events_unbound20:10:011
474213991815,2cyclictest500695-21apt-get19:35:110
474223991713,2cyclictest0-21swapper/320:05:003
474218991714,2cyclictest671729-21kworker/u8:2+events_unbound22:33:382
474218991713,3cyclictest557620-21kworker/u8:3+events_unbound21:00:122
474218991713,3cyclictest335557-21systemd-journal21:46:502
474215991714,2cyclictest609162-21kworker/u8:1+events_unbound21:35:161
474215991714,2cyclictest573243-21kworker/u8:1+events_unbound20:50:251
474213991714,2cyclictest634947-21kworker/u8:0+events_unbound21:45:130
474213991714,2cyclictest60350irq/132-enp0s29f1:rx-022:06:520
47422399169,5cyclictest509-21rs:main3
47422399169,5cyclictest509-21rs:main3
474218991614,1cyclictest0-21swapper/221:59:592
474218991613,2cyclictest719072-21kworker/u8:3+events_unbound00:07:402
474218991612,3cyclictest634947-21kworker/u8:0+events_unbound22:24:382
474218991612,3cyclictest557863-21apt-get20:30:112
474215991612,3cyclictest729684-21kworker/u8:0+flush-259:023:35:241
474215991612,3cyclictest557620-21kworker/u8:3+events_unbound20:55:131
474213991614,2cyclictest60350irq/132-enp0s29f1:rx-021:25:140
474213991614,1cyclictest60350irq/132-enp0s29f1:rx-020:10:180
474213991614,1cyclictest60350irq/132-enp0s29f1:rx-019:55:160
474213991613,2cyclictest766721-21kworker/u8:2+events_unbound00:25:140
474213991613,2cyclictest573243-21kworker/u8:1+flush-259:020:50:190
474213991612,3cyclictest719072-21kworker/u8:3+flush-259:023:55:140
47422399159,4cyclictest719072-21kworker/u8:3+flush-259:023:35:163
47422399159,4cyclictest484189-21journal-offline19:16:303
47422399158,4cyclictest630192-21awk21:39:593
47422399158,4cyclictest614277-21latency_hist21:25:013
47422399152,3cyclictest772008-21wc23:55:003
474223991512,2cyclictest604639-21irqcore21:15:173
474223991510,3cyclictest436726-21kworker/u8:3+flush-259:019:10:153
474218991512,2cyclictest719072-21kworker/u8:3+events_unbound23:42:392
47421599159,4cyclictest640491-21true21:50:001
474215991512,2cyclictest431555-21kworker/u8:2+events_unbound19:35:131
474215991512,2cyclictest0-21swapper/100:10:371
474215991511,3cyclictest719072-21kworker/u8:3+flush-259:000:05:271
474215991510,3cyclictest650799-21kworker/u8:3+events_unbound22:05:171
474213991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:240
474213991513,1cyclictest60350irq/132-enp0s29f1:rx-019:50:160
474213991513,1cyclictest60350irq/132-enp0s29f1:rx-019:50:150
474213991511,3cyclictest567874-21kworker/u8:0+events_unbound21:07:050
47422399149,1cyclictest191rcu_preempt20:58:253
47422399147,5cyclictest335557-21systemd-journal00:14:593
47422399141,4cyclictest50-21ksoftirqd/323:20:223
47422399141,3cyclictest733975-21ntpq23:15:193
47422399141,2cyclictest728746-21ntpq23:10:223
474223991411,2cyclictest599488-21irqcore21:10:163
474223991411,2cyclictest526203-21cron20:00:003
474223991411,2cyclictest0-21swapper/320:30:013
474223991411,1cyclictest191rcu_preempt22:07:243
474223991411,1cyclictest191rcu_preempt20:10:583
474223991410,3cyclictest557620-21kworker/u8:3+flush-259:021:29:593
47421599149,3cyclictest766721-21kworker/u8:2+events_unbound00:15:211
47421599149,3cyclictest552699-21/usr/sbin/munin20:25:151
47421599148,4cyclictest335557-21systemd-journal00:05:001
474215991411,2cyclictest708117-21kworker/u8:1+flush-259:023:15:221
474215991411,2cyclictest666233-21unixbench_multi22:10:261
474215991411,2cyclictest567874-21kworker/u8:0+flush-259:021:20:161
474215991411,2cyclictest526647-21kworker/u8:5+flush-259:020:15:251
474215991411,2cyclictest510417-21kworker/u8:3+flush-259:019:55:241
47422399139,3cyclictest583315-21kworker/u8:2+flush-259:021:05:193
47422399139,1cyclictest191rcu_preempt20:51:053
47422399136,5cyclictest708093-21latency_hist22:55:003
47422399133,6cyclictest50-21ksoftirqd/300:30:223
47422399133,2cyclictest0-21swapper/320:20:163
47422399132,7cyclictest50-21ksoftirqd/323:31:373
47422399132,3cyclictest50-21ksoftirqd/323:45:213
47422399132,3cyclictest50-21ksoftirqd/321:00:123
47422399131,3cyclictest50-21ksoftirqd/320:30:113
474223991312,1cyclictest481rcuc/323:59:003
474223991310,2cyclictest819296-21cron00:40:003
47421599139,3cyclictest567874-21kworker/u8:0+flush-259:021:25:241
474213991311,1cyclictest60350irq/132-enp0s29f1:rx-020:40:520
474213991311,1cyclictest60350irq/132-enp0s29f1:rx-019:45:150
47422399124,4cyclictest0-21swapper/319:51:463
47422399124,4cyclictest0-21swapper/319:51:463
47422399123,6cyclictest50-21ksoftirqd/319:40:153
47422399122,6cyclictest50-21ksoftirqd/300:00:243
47422399121,7cyclictest50-21ksoftirqd/323:40:243
47422399121,7cyclictest50-21ksoftirqd/300:15:213
47422399121,3cyclictest50-21ksoftirqd/322:25:013
47422399121,3cyclictest50-21ksoftirqd/322:10:203
47422399121,2cyclictest0-21swapper/322:35:133
47422399120,2cyclictest702051-21ntpq22:45:213
47421599129,2cyclictest672078-21kworker/u8:4+flush-259:022:55:201
47421599128,3cyclictest719072-21kworker/u8:3+flush-259:023:50:241
47422399118,1cyclictest191rcu_preempt19:45:023
47422399112,2cyclictest50-21ksoftirqd/322:40:173
47422399110,3cyclictest0-21swapper/320:45:203
47421599119,1cyclictest0-21swapper/121:55:241
47421599108,1cyclictest702939-21kworker/u8:0+events_unbound22:50:211
47421599106,3cyclictest739548-21unixbench_multi23:20:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional