You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 07:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Aug 27, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21771995549,5cyclictest63085-21latency_hist19:50:003
21763995450,3cyclictest250986-21apt-get22:50:130
21763994944,2cyclictest141439-21kworker/u8:0+events_unbound21:10:220
21763994844,3cyclictest126220-21apt-get20:50:120
21768994541,3cyclictest214716-21kworker/u8:1+flush-259:023:05:242
21768994540,3cyclictest105507-21kworker/u8:2+flush-259:021:40:232
21765994437,2cyclictest193798-21kworker/u8:2+events_unbound22:10:011
21765994340,2cyclictest84177-21kworker/u8:2+events_unbound20:20:161
21768994137,3cyclictest42444-21kworker/u8:0+flush-259:020:25:242
21771994036,3cyclictest105507-21kworker/u8:2+flush-259:021:15:243
21765994037,2cyclictest131139-21kworker/u8:3+events_unbound21:05:161
21771993835,2cyclictest120832-21kworker/u8:0+flush-259:020:55:003
21771993830,2cyclictest214716-21kworker/u8:1+flush-259:022:30:243
21768993835,2cyclictest131139-21kworker/u8:3+flush-259:021:00:242
21765993835,2cyclictest173067-21kworker/u8:1+events_unbound21:50:141
21765993835,2cyclictest173067-21kworker/u8:1+events_unbound21:50:141
21765993835,2cyclictest152243-21kworker/u8:5+events_unbound21:20:491
21765993834,3cyclictest287550-21apt-get23:25:101
21771993732,3cyclictest323271-21kworker/u8:3+flush-259:000:05:273
21771993633,2cyclictest334258-21kworker/u8:1+flush-259:000:15:233
21771993532,2cyclictest183655-21kworker/u8:3+flush-259:023:00:103
21768993531,2cyclictest271656-21kworker/u8:0+events_unbound23:25:002
21765993532,2cyclictest183655-21kworker/u8:3+events_unbound23:45:241
21768993428,4cyclictest63629-21cp19:50:012
21765993431,2cyclictest313123-21kworker/u8:0+events_unbound00:03:271
21765993429,3cyclictest344823-21apt-get00:20:121
21763993431,2cyclictest302816-21kworker/u8:2+events_unbound23:50:170
21763993431,2cyclictest193798-21kworker/u8:2+events_unbound22:15:140
21763993430,3cyclictest105507-21kworker/u8:2+flush-259:021:30:210
21768993330,2cyclictest183444-21kworker/u8:0+flush-259:021:50:252
21768993330,2cyclictest183444-21kworker/u8:0+flush-259:021:50:242
21765993330,2cyclictest302816-21kworker/u8:2+events_unbound23:50:141
21765993330,2cyclictest214716-21kworker/u8:1+events_unbound22:20:161
21763993330,2cyclictest52796-21kworker/u8:1+flush-259:020:15:150
21763993330,2cyclictest261071-21kworker/u8:2+flush-259:023:10:200
21763993330,2cyclictest250768-21kworker/u8:0+events_unbound22:55:150
21768993229,2cyclictest120832-21kworker/u8:0+flush-259:020:50:242
21765993229,2cyclictest52796-21kworker/u8:1+events_unbound19:40:291
21765993229,2cyclictest214716-21kworker/u8:1+events_unbound22:30:171
21765993229,2cyclictest183655-21kworker/u8:3+events_unbound23:40:151
21765993229,2cyclictest105507-21kworker/u8:2+events_unbound21:15:221
21763993229,2cyclictest183655-21kworker/u8:3+events_unbound23:50:000
21771993128,2cyclictest52796-21kworker/u8:1+events_unbound19:55:243
21765993128,2cyclictest52796-21kworker/u8:1+events_unbound20:10:141
21765993128,2cyclictest42444-21kworker/u8:0+events_unbound19:30:231
21765993128,2cyclictest27143-21kworker/u8:3+flush-259:019:25:151
21765993128,2cyclictest1442-21kworker/u8:2+events_unbound19:35:141
21765993128,2cyclictest105507-21kworker/u8:2+flush-259:021:30:191
21765993127,3cyclictest131377-21apt-get20:55:121
21763993128,2cyclictest42444-21kworker/u8:0+events_unbound20:00:120
21763993128,2cyclictest271656-21kworker/u8:0+events_unbound23:25:230
21763993128,2cyclictest214716-21kworker/u8:1+events_unbound22:35:230
21768993027,2cyclictest42444-21kworker/u8:0+flush-259:019:45:202
21765993027,2cyclictest42444-21kworker/u8:0+events_unbound20:25:231
21765993027,2cyclictest282182-21kworker/u8:1+events_unbound23:35:231
21765993023,5cyclictest188605-21latency_hist21:50:011
21763993027,2cyclictest323271-21kworker/u8:3+events_unbound00:20:250
21763993027,2cyclictest302816-21kworker/u8:2+events_unbound00:10:260
21763993027,2cyclictest193798-21kworker/u8:2+events_unbound22:10:220
21763993027,2cyclictest183444-21kworker/u8:0+events_unbound22:05:150
21763993024,4cyclictest323271-21kworker/u8:3+flush-259:000:30:000
21765992926,2cyclictest52796-21kworker/u8:1+events_unbound20:05:171
21765992926,2cyclictest105507-21kworker/u8:2+flush-259:021:10:251
21765992923,4cyclictest292704-21apt-get23:30:131
21763992926,2cyclictest27143-21kworker/u8:3+flush-259:019:20:250
21771992825,2cyclictest42444-21kworker/u8:0+events_unbound20:20:263
21771992825,2cyclictest3757631-21kworker/u8:5+flush-259:019:15:153
21771992825,2cyclictest183655-21kworker/u8:3+events_unbound23:45:183
21765992825,2cyclictest105507-21kworker/u8:2+events_unbound20:35:151
21765992824,3cyclictest199217-21apt-get22:00:101
21765992824,3cyclictest105507-21kworker/u8:2+flush-259:020:45:181
21763992825,2cyclictest250768-21kworker/u8:0+events_unbound23:00:230
21763992825,2cyclictest131139-21kworker/u8:3+events_unbound21:05:240
21768992724,2cyclictest42444-21kworker/u8:0+flush-259:020:05:252
21768992724,2cyclictest193798-21kworker/u8:2+flush-259:022:17:152
21768992723,3cyclictest261071-21kworker/u8:2+flush-259:023:10:162
21765992724,2cyclictest323271-21kworker/u8:3+events_unbound00:35:141
21765992724,2cyclictest302816-21kworker/u8:2+flush-259:000:08:351
21765992724,2cyclictest214716-21kworker/u8:1+events_unbound22:35:151
21765992724,2cyclictest120832-21kworker/u8:0+events_unbound20:50:231
21763992724,2cyclictest110484-21kworker/u8:4+events_unbound20:40:210
21763992723,3cyclictest105507-21kworker/u8:2+flush-259:020:35:200
21763992721,4cyclictest307130-21ntpq23:40:210
21771992623,2cyclictest214716-21kworker/u8:1+flush-259:022:40:203
21771992623,2cyclictest110484-21kworker/u8:4+flush-259:020:50:013
21765992623,2cyclictest271656-21kworker/u8:0+events_unbound23:15:041
21765992623,2cyclictest214716-21kworker/u8:1+events_unbound22:45:131
21763992623,2cyclictest173067-21kworker/u8:1+events_unbound21:45:210
21763992623,2cyclictest152243-21kworker/u8:5+events_unbound21:20:140
21763992622,3cyclictest105507-21kworker/u8:2+events_unbound21:40:230
21763992620,5cyclictest225081-21apt-get22:25:110
21771992522,2cyclictest214716-21kworker/u8:1+events_unbound22:20:193
21765992522,2cyclictest250768-21kworker/u8:0+events_unbound22:56:101
21765992521,2cyclictest105507-21kworker/u8:2+events_unbound21:29:141
21763992522,2cyclictest282182-21kworker/u8:1+events_unbound23:36:150
21771992421,2cyclictest105507-21kworker/u8:2+flush-259:020:55:173
21768992421,2cyclictest3757631-21kworker/u8:5+events_unbound19:20:022
21765992421,2cyclictest110484-21kworker/u8:4+flush-259:020:40:241
21765992420,3cyclictest42444-21kworker/u8:0+events_unbound20:33:161
21763992422,2cyclictest183655-21kworker/u8:3+events_unbound23:20:140
21763992421,2cyclictest344300-21kworker/u8:4+events_unbound00:34:260
21763992421,2cyclictest105507-21kworker/u8:2+events_unbound21:35:130
21763992419,4cyclictest335557-21systemd-journal19:40:300
21771992321,2cyclictest131139-21kworker/u8:3+flush-259:021:05:253
21771992320,2cyclictest94279-21kworker/u8:3+flush-259:020:25:163
21771992320,2cyclictest183655-21kworker/u8:3+events_unbound23:20:163
21771992320,2cyclictest178249-21cron21:40:003
21771992318,4cyclictest292442-21latency_hist23:30:003
21765992320,2cyclictest4183518-21kworker/u8:1+events_unbound19:10:151
21765992320,2cyclictest193798-21kworker/u8:2+flush-259:022:15:151
21765992319,2cyclictest194016-21/usr/sbin/munin21:55:151
21763992320,2cyclictest42444-21kworker/u8:0+events_unbound20:24:160
21763992319,3cyclictest104851-21apt-get20:30:010
21771992219,2cyclictest323271-21kworker/u8:3+events_unbound00:00:153
21768992218,3cyclictest323271-21kworker/u8:3+flush-259:000:35:232
21768992218,3cyclictest105507-21kworker/u8:2+events_unbound21:25:152
21768992216,2cyclictest105507-21kworker/u8:2+events_unbound21:15:012
21765992219,2cyclictest52796-21kworker/u8:1+events_unbound20:16:161
21765992219,2cyclictest344300-21kworker/u8:4+events_unbound00:33:271
21765992219,2cyclictest313123-21kworker/u8:0+events_unbound23:58:161
21765992219,2cyclictest302816-21kworker/u8:2+events_unbound00:14:281
21763992220,2cyclictest183655-21kworker/u8:3+events_unbound22:31:070
21763992219,2cyclictest302816-21kworker/u8:2+events_unbound00:06:280
21763992219,2cyclictest282182-21kworker/u8:1+events_unbound23:55:190
21763992219,2cyclictest183444-21kworker/u8:0+events_unbound21:50:580
21763992219,2cyclictest183444-21kworker/u8:0+events_unbound21:50:570
21771992119,2cyclictest173067-21kworker/u8:1+events_unbound21:45:223
21771992118,2cyclictest42444-21kworker/u8:0+events_unbound20:05:283
21771992118,2cyclictest214716-21kworker/u8:1+flush-259:023:05:223
21771992118,2cyclictest183655-21kworker/u8:3+flush-259:022:45:163
21771992117,3cyclictest355254-21apt-get00:30:093
21771992117,3cyclictest105507-21kworker/u8:2+events_unbound21:00:153
21768992118,2cyclictest42444-21kworker/u8:0+events_unbound19:33:162
21768992118,2cyclictest193798-21kworker/u8:2+events_unbound21:55:142
21768992118,2cyclictest183655-21kworker/u8:3+events_unbound21:48:172
21768992118,2cyclictest1442-21kworker/u8:2+flush-259:019:35:212
21768992117,2cyclictest99676-21sh20:25:002
21765992118,2cyclictest42444-21kworker/u8:0+events_unbound19:53:151
21765992118,2cyclictest42444-21kworker/u8:0+events_unbound19:49:181
21765992116,2cyclictest173067-21kworker/u8:1+events_unbound21:38:161
21763992118,2cyclictest42444-21kworker/u8:0+events_unbound19:45:160
21763992118,2cyclictest27143-21kworker/u8:3+events_unbound19:25:140
21763992118,2cyclictest173067-21kworker/u8:1+events_unbound21:59:160
21763992118,2cyclictest105507-21kworker/u8:2+events_unbound21:17:160
21763992115,4cyclictest329031-21latency_hist00:05:010
21771992017,2cyclictest52796-21kworker/u8:1+events_unbound19:50:023
21771992017,2cyclictest27143-21kworker/u8:3+events_unbound19:34:163
21771992017,2cyclictest183655-21kworker/u8:3+flush-259:022:00:213
21771992017,2cyclictest183655-21kworker/u8:3+events_unbound22:50:243
21771992016,3cyclictest344300-21kworker/u8:4+events_unbound00:29:273
21771992016,3cyclictest27143-21kworker/u8:3+flush-259:019:20:223
21768992018,2cyclictest152243-21kworker/u8:5+events_unbound21:35:022
21768992017,2cyclictest302816-21kworker/u8:2+flush-259:000:15:002
21768992017,2cyclictest240358-21idleruntime-cro22:40:012
21768992017,2cyclictest152243-21kworker/u8:5+events_unbound21:20:252
21768992017,2cyclictest110484-21kworker/u8:4+events_unbound20:40:122
21768992014,5cyclictest224823-21latency_hist22:25:002
21765992017,2cyclictest3757631-21kworker/u8:5+events_unbound19:16:151
21763992017,2cyclictest52796-21kworker/u8:1+events_unbound20:06:150
21763992017,2cyclictest334258-21kworker/u8:1+events_unbound00:17:010
21763992017,2cyclictest183655-21kworker/u8:3+events_unbound23:15:280
21771991916,2cyclictest42444-21kworker/u8:0+flush-259:020:15:243
21771991916,2cyclictest323271-21kworker/u8:3+flush-259:000:20:263
21771991916,2cyclictest282182-21kworker/u8:1+flush-259:023:55:003
21768991917,1cyclictest323271-21kworker/u8:3+events_unbound00:25:192
21768991916,2cyclictest42444-21kworker/u8:0+flush-259:020:15:192
21768991916,2cyclictest4183518-21kworker/u8:1+events_unbound19:10:232
21768991916,2cyclictest271656-21kworker/u8:0+events_unbound23:35:152
21768991914,2cyclictest3757631-21kworker/u8:5+events_unbound19:30:002
21768991914,2cyclictest250768-21kworker/u8:0+flush-259:023:00:152
21765991916,2cyclictest183655-21kworker/u8:3+events_unbound22:53:171
21763991917,2cyclictest141439-21kworker/u8:0+events_unbound21:25:270
21771991813,4cyclictest78121-21ntpq20:00:203
21768991815,2cyclictest344300-21kworker/u8:4+events_unbound00:30:132
21768991815,2cyclictest323429-21apt-get00:00:022
21768991815,2cyclictest250768-21kworker/u8:0+events_unbound22:52:172
21768991814,3cyclictest146615-21apt-get21:10:002
21768991813,4cyclictest277218-21/usr/sbin/munin23:15:192
21765991816,2cyclictest131139-21kworker/u8:3+events_unbound21:00:271
21765991815,2cyclictest282399-21apt-get23:20:121
21765991815,2cyclictest250768-21kworker/u8:0+events_unbound23:04:171
21765991815,2cyclictest183655-21kworker/u8:3+events_unbound22:25:261
2176399186,3cyclictest16-21ksoftirqd/019:15:000
21763991815,2cyclictest42444-21kworker/u8:0+events_unbound19:32:160
21763991814,1cyclictest60350irq/132-enp0s29f1:rx-022:45:120
21771991714,2cyclictest323271-21kworker/u8:3+events_unbound00:10:213
21771991714,2cyclictest0-21swapper/322:20:003
21768991715,1cyclictest323439-21/usr/sbin/munin23:59:592
21768991714,2cyclictest334258-21kworker/u8:1+flush-259:000:15:182
21768991714,2cyclictest323271-21kworker/u8:3+flush-259:000:20:262
21768991714,2cyclictest209331-21cron22:09:592
21768991714,2cyclictest183655-21kworker/u8:3+events_unbound22:25:242
21768991714,2cyclictest105507-21kworker/u8:2+events_unbound20:35:172
21763991715,1cyclictest52796-21kworker/u8:1+events_unbound19:55:030
21763991714,2cyclictest52796-21kworker/u8:1+events_unbound20:10:380
21763991714,2cyclictest42444-21kworker/u8:0+events_unbound19:50:200
21771991614,2cyclictest110484-21kworker/u8:4+events_unbound20:40:133
21771991613,2cyclictest0-21swapper/323:45:003
21768991615,1cyclictest105507-21kworker/u8:2+events_unbound20:45:122
21765991614,2cyclictest193798-21kworker/u8:2+events_unbound22:12:181
21765991613,2cyclictest214716-21kworker/u8:1+events_unbound22:40:111
21763991614,1cyclictest60350irq/132-enp0s29f1:rx-019:15:240
21763991613,2cyclictest60350irq/132-enp0s29f1:rx-022:04:590
21763991613,2cyclictest42444-21kworker/u8:0+events_unbound20:30:150
21763991613,2cyclictest110484-21kworker/u8:4+events_unbound20:49:220
2177199159,2cyclictest183655-21kworker/u8:3+events_unbound22:40:003
21771991513,2cyclictest52796-21kworker/u8:1+events_unbound20:12:163
21771991513,2cyclictest105507-21kworker/u8:2+events_unbound21:41:163
21771991513,1cyclictest230000-21sh22:30:013
21771991512,2cyclictest183444-21kworker/u8:0+events_unbound21:50:213
21771991512,2cyclictest183444-21kworker/u8:0+events_unbound21:50:203
21771991511,3cyclictest193798-21kworker/u8:2+events_unbound21:55:223
21768991513,1cyclictest307975-21latency_hist23:45:002
21768991512,2cyclictest302816-21kworker/u8:2+events_unbound23:50:162
21768991511,3cyclictest335557-21systemd-journal22:15:002
21765991513,2cyclictest302816-21kworker/u8:2+flush-259:000:15:261
21763991513,2cyclictest214716-21kworker/u8:1+events_unbound22:40:060
21763991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:250
21763991513,1cyclictest60350irq/132-enp0s29f1:rx-021:03:060
21763991513,1cyclictest60350irq/132-enp0s29f1:rx-019:35:150
21763991512,2cyclictest214716-21kworker/u8:1+events_unbound23:05:130
21771991412,1cyclictest141439-21kworker/u8:0+events_unbound21:10:193
2177199141,12cyclictest490-21dbus-daemon20:35:013
21771991411,2cyclictest42444-21kworker/u8:0+events_unbound19:40:273
21771991411,2cyclictest271656-21kworker/u8:0+flush-259:023:17:153
21768991411,3cyclictest271656-21kworker/u8:0+events_unbound23:32:162
2176599143,1cyclictest191rcu_preempt23:15:001
21765991412,2cyclictest27143-21kworker/u8:3+events_unbound19:21:161
21765991411,2cyclictest178939-21tr21:40:151
2176399147,1cyclictest191rcu_preempt00:35:180
2176399142,2cyclictest191rcu_preempt22:20:260
21763991411,2cyclictest131139-21kworker/u8:3+events_unbound20:57:540
2177199138,4cyclictest214484-21latency_hist22:15:013
21771991310,2cyclictest271656-21kworker/u8:0+events_unbound23:12:163
21771991310,2cyclictest211-21jbd2/nvme0n1p2-819:15:013
21771991310,2cyclictest115191-21unixbench_multi20:35:253
2176899139,3cyclictest52796-21kworker/u8:1+flush-259:019:55:302
2176899139,3cyclictest42444-21kworker/u8:0+events_unbound20:30:172
21768991311,2cyclictest250768-21kworker/u8:0+events_unbound22:55:202
21768991311,1cyclictest0-21swapper/221:15:162
21768991310,2cyclictest3757631-21kworker/u8:5+events_unbound19:17:162
21768991310,2cyclictest271656-21kworker/u8:0+flush-259:023:25:192
21768991310,2cyclictest245076-21unixbench_multi22:40:232
21768991310,2cyclictest105507-21kworker/u8:2+flush-259:020:55:222
2176599139,3cyclictest42444-21kworker/u8:0+events_unbound20:04:091
21765991310,2cyclictest344300-21kworker/u8:4+events_unbound00:27:341
2177199129,2cyclictest41969-21unixbench_multi19:25:253
2177199129,2cyclictest299854-21kthreadcore23:35:173
2177199129,2cyclictest105507-21kworker/u8:2+events_unbound21:34:153
2177199129,1cyclictest0-21swapper/323:30:163
2177199128,3cyclictest509-21rs:main3
2176899129,2cyclictest74110-21cpuspeed_turbos20:00:112
2176899129,2cyclictest52796-21kworker/u8:1+flush-259:020:10:192
2176899128,3cyclictest199184-21kworker/u8:4+events_unbound22:00:122
2176899127,3cyclictest21678-21latency_hist19:10:002
2176899126,4cyclictest335557-21systemd-journal00:10:002
2176899120,2cyclictest235140-21basename22:35:002
2176599123,1cyclictest191rcu_preempt19:10:011
2177199119,1cyclictest0-21swapper/323:55:133
2177199119,1cyclictest0-21swapper/321:20:173
2176899118,2cyclictest54046-21tr19:40:242
2176899118,2cyclictest183655-21kworker/u8:3+events_unbound23:45:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional