You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 21:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Mon May 04, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1118183994943,4cyclictest252-21systemd-journal07:40:002
1118183994441,2cyclictest1377315-21kworker/u8:1+flush-259:012:10:212
1118176994337,4cyclictest1118094-21latency_hist07:10:010
1118176994135,4cyclictest1180500-21/usr/sbin/munin08:10:150
1118183994035,4cyclictest252-21systemd-journal08:05:212
1118176993934,3cyclictest1206012-21latency_hist08:35:010
1118183993835,2cyclictest1216277-21kworker/u8:3+events_unbound10:20:182
1118183993733,3cyclictest1330925-21kworker/u8:0+flush-259:011:10:002
1118176993732,3cyclictest1128438-21latency_hist07:20:010
1118186993528,5cyclictest1211704-21base6408:40:003
1118176993529,5cyclictest1460184-21ntpq12:35:210
1118186993428,4cyclictest1175094-21latency_hist08:05:013
1118183993431,2cyclictest3271704-21kworker/u8:1+flush-259:007:15:172
1118183993431,2cyclictest3271704-21kworker/u8:1+events_unbound07:10:202
1118180993431,2cyclictest1190292-21kworker/u8:1+events_unbound09:05:151
1118176993429,4cyclictest1211350-21cat08:40:000
1118180993329,2cyclictest1383283-21kworker/u8:0+flush-259:012:15:011
1118183993228,3cyclictest1112604-21kworker/u8:4+flush-259:007:45:262
1118180993128,2cyclictest1190292-21kworker/u8:1+events_unbound08:40:231
1118180993126,4cyclictest1190551-21latency_hist08:20:001
1118183993027,2cyclictest1112604-21kworker/u8:4+flush-259:007:40:242
1118176993026,3cyclictest509-21rs:main0
1118176993025,4cyclictest1351527-21kworker/u8:2+flush-259:011:10:160
1118183992925,3cyclictest1351527-21kworker/u8:2+events_unbound11:00:022
1118183992925,3cyclictest1211297-21gpgv08:40:012
1118180992926,2cyclictest1216277-21kworker/u8:3+flush-259:009:00:211
1118176992925,3cyclictest1175335-21kworker/u8:0+flush-259:008:15:160
1118183992824,3cyclictest1320621-21kworker/u8:2+events_unbound10:35:202
1118183992821,5cyclictest1397786-21ntpq11:35:212
1118176992824,3cyclictest1289977-21apt-get09:55:120
1118183992723,3cyclictest1377315-21kworker/u8:1+events_unbound11:20:152
1118180992723,3cyclictest1175335-21kworker/u8:0+flush-259:008:10:251
1118183992623,2cyclictest1377315-21kworker/u8:1+flush-259:011:55:212
1118180992623,2cyclictest1190292-21kworker/u8:1+events_unbound10:30:191
1118180992622,3cyclictest1377315-21kworker/u8:1+events_unbound11:20:211
1118180992621,4cyclictest1175335-21kworker/u8:0+events_unbound08:08:221
1118180992619,5cyclictest1413725-21ntpq11:50:231
1118176992622,3cyclictest1377315-21kworker/u8:1+flush-259:011:45:240
1118186992521,3cyclictest1216277-21kworker/u8:3+flush-259:010:10:283
1118183992522,2cyclictest1351527-21kworker/u8:2+flush-259:010:55:202
1118183992522,2cyclictest1190292-21kworker/u8:1+events_unbound09:00:112
1118183992521,3cyclictest1190292-21kworker/u8:1+events_unbound10:40:212
1118183992521,3cyclictest1190292-21kworker/u8:1+events_unbound09:45:172
1118183992521,3cyclictest1159675-21kworker/u8:2+events_unbound07:54:232
1118183992520,4cyclictest252-21systemd-journal10:50:222
1118183992520,4cyclictest252-21systemd-journal10:50:222
1118180992521,3cyclictest1320621-21kworker/u8:2+events_unbound10:37:241
1118180992521,3cyclictest1264015-21kworker/u8:0+events_unbound09:33:231
1118176992519,4cyclictest1-21systemd11:45:010
1118176992512,11cyclictest1123292-21latency_hist07:15:010
1118186992420,3cyclictest1227778-21apt-get08:55:103
1118183992421,2cyclictest1216277-21kworker/u8:3+flush-259:010:25:162
1118183992420,3cyclictest1377315-21kworker/u8:1+flush-259:011:26:222
1118183992419,3cyclictest1377817-21cp11:20:012
1118183992415,7cyclictest252-21systemd-journal07:35:002
1118180992421,2cyclictest1440463-21kworker/u8:3+flush-259:012:20:331
1118180992421,2cyclictest1341435-21kworker/u8:3+flush-259:010:50:231
1118180992421,2cyclictest1341435-21kworker/u8:3+flush-259:010:50:221
1118180992421,2cyclictest1190292-21kworker/u8:1+flush-259:010:00:251
1118180992421,2cyclictest1190292-21kworker/u8:1+flush-259:009:15:281
1118180992420,3cyclictest1330925-21kworker/u8:0+events_unbound11:05:141
111818099241,21cyclictest1-21systemd12:05:001
1118176992417,5cyclictest1319722-21ntpq10:20:220
1118186992319,3cyclictest1180486-21kworker/u8:3+flush-259:008:20:013
1118186992317,4cyclictest1138964-21apt-get07:30:113
1118183992320,2cyclictest1190292-21kworker/u8:1+flush-259:010:30:212
1118183992320,2cyclictest1112604-21kworker/u8:4+flush-259:007:20:182
1118183992318,3cyclictest252-21systemd-journal09:51:212
1118180992319,3cyclictest1264015-21kworker/u8:0+flush-259:009:35:351
1118183992219,2cyclictest3271704-21kworker/u8:1+events_unbound07:25:132
1118183992219,2cyclictest1195771-21kworker/u8:0+flush-259:008:30:222
1118183992218,3cyclictest1159675-21kworker/u8:2+events_unbound07:58:232
1118180992219,2cyclictest1216277-21kworker/u8:3+events_unbound09:40:231
1118180992219,2cyclictest1190292-21kworker/u8:1+events_unbound10:28:231
1118180992219,2cyclictest1112604-21kworker/u8:4+events_unbound07:45:231
1118180992217,4cyclictest1451031-21apt-get12:30:131
1118176992218,3cyclictest1149221-21latency_hist07:40:000
1118183992118,2cyclictest1430293-21kworker/u8:2+events_unbound12:25:172
1118183992118,2cyclictest1341435-21kworker/u8:3+events_unbound10:45:202
1118183992118,2cyclictest1206039-21kworker/u8:2+events_unbound08:51:232
1118183992118,2cyclictest1190292-21kworker/u8:1+events_unbound09:15:252
1118180992118,2cyclictest1377315-21kworker/u8:1+events_unbound11:30:161
1118180992118,2cyclictest1216277-21kworker/u8:3+events_unbound10:20:141
1118180992118,2cyclictest1206039-21kworker/u8:2+events_unbound08:35:091
1118180992118,2cyclictest1190292-21kworker/u8:1+events_unbound09:10:131
1118180992117,3cyclictest1330925-21kworker/u8:0+events_unbound10:59:241
1118180992116,3cyclictest252-21systemd-journal08:25:231
1118180992116,3cyclictest252-21systemd-journal08:25:221
1118176992115,4cyclictest1435490-21/usr/sbin/munin12:15:150
1118186992017,2cyclictest1351527-21kworker/u8:2+flush-259:011:20:013
1118183992018,2cyclictest1430293-21kworker/u8:2+events_unbound12:15:012
1118183992017,2cyclictest1377315-21kworker/u8:1+flush-259:012:05:192
1118183992017,2cyclictest1351527-21kworker/u8:2+events_unbound11:10:212
1118183992016,3cyclictest1440463-21kworker/u8:3+events_unbound12:22:232
1118180992017,2cyclictest1377315-21kworker/u8:1+flush-259:012:35:181
1118180992017,2cyclictest1341435-21kworker/u8:3+flush-259:010:45:191
1118180992017,2cyclictest1112604-21kworker/u8:4+events_unbound07:19:231
1118180992016,3cyclictest3271704-21kworker/u8:1+flush-259:007:10:241
1118180992016,3cyclictest1190292-21kworker/u8:1+events_unbound10:12:241
1118176992016,2cyclictest1190292-21kworker/u8:1+flush-259:010:30:150
1118176992014,4cyclictest252-21systemd-journal09:16:220
1118176992014,4cyclictest1190292-21kworker/u8:1+flush-259:010:00:160
1118186991914,3cyclictest252-21systemd-journal10:45:013
1118183991916,2cyclictest1377315-21kworker/u8:1+events_unbound11:50:202
1118183991916,2cyclictest1190292-21kworker/u8:1+events_unbound09:25:002
1118183991916,2cyclictest1190292-21kworker/u8:1+events_unbound08:26:232
1118183991916,2cyclictest1190292-21kworker/u8:1+events_unbound08:26:222
1118183991915,3cyclictest1190292-21kworker/u8:1+events_unbound09:41:242
1118183991914,4cyclictest1263987-21latency_hist09:30:012
1118183991913,4cyclictest1174261-21ntpq08:00:212
1118180991916,2cyclictest1351527-21kworker/u8:2+events_unbound11:00:161
1118180991915,3cyclictest1377315-21kworker/u8:1+events_unbound11:45:151
1118180991915,3cyclictest1351527-21kworker/u8:2+flush-259:011:15:191
1118180991915,3cyclictest1351527-21kworker/u8:2+events_unbound11:25:141
1118176991913,4cyclictest252-21systemd-journal07:40:220
1118176991912,5cyclictest252-21systemd-journal12:32:230
1118176991912,5cyclictest1449857-21ntpq12:25:200
1118176991911,5cyclictest1284600-21latency_hist09:50:010
1118186991814,3cyclictest1190292-21kworker/u8:1+events_unbound09:10:173
1118186991814,3cyclictest1112604-21kworker/u8:4+flush-259:007:50:013
1118186991811,5cyclictest1392650-21ntpq11:30:223
111818399183,8cyclictest1269182-21munin-run09:35:012
1118183991816,2cyclictest1377315-21kworker/u8:1+events_unbound11:30:232
1118183991816,2cyclictest1216277-21kworker/u8:3+events_unbound10:05:172
1118183991815,2cyclictest1190292-21kworker/u8:1+events_unbound09:55:152
1118183991815,2cyclictest1159675-21kworker/u8:2+events_unbound08:10:212
1118183991814,3cyclictest1377315-21kworker/u8:1+events_unbound12:38:232
1118183991814,3cyclictest1190292-21kworker/u8:1+flush-259:009:05:242
1118180991815,2cyclictest3271704-21kworker/u8:1+flush-259:007:25:111
1118180991815,2cyclictest1430293-21kworker/u8:2+events_unbound12:27:241
1118180991814,3cyclictest1190292-21kworker/u8:1+flush-259:009:45:221
1118176991815,2cyclictest1435251-21cron12:15:000
1118176991814,3cyclictest1227116-21systemd-run08:55:000
1118186991715,1cyclictest0-21swapper/307:40:003
1118186991712,3cyclictest252-21systemd-journal12:25:223
1118183991714,2cyclictest1377315-21kworker/u8:1+events_unbound11:41:242
1118183991714,2cyclictest1190292-21kworker/u8:1+flush-259:010:00:192
1118180991714,2cyclictest3271704-21kworker/u8:1+flush-259:007:30:211
1118180991714,2cyclictest301rcuc/109:25:001
1118180991714,2cyclictest1227101-21turbostat08:55:001
1118180991714,2cyclictest1216277-21kworker/u8:3+flush-259:009:25:261
1118180991713,3cyclictest1430293-21kworker/u8:2+events_unbound12:19:231
1118180991713,3cyclictest1330925-21kworker/u8:0+events_unbound11:14:231
1118176991714,2cyclictest1274967-21irqcore09:40:170
111817699171,15cyclictest1169958-21turbostat07:59:590
1118176991711,4cyclictest1346605-21/usr/sbin/munin10:50:140
1118176991711,4cyclictest1346605-21/usr/sbin/munin10:50:130
1118186991614,1cyclictest0-21swapper/308:30:013
1118186991614,1cyclictest0-21swapper/308:30:003
1118186991613,2cyclictest1377315-21kworker/u8:1+flush-259:012:24:593
1118186991611,3cyclictest1264254-21apt-get09:30:113
1118183991614,2cyclictest1264015-21kworker/u8:0+flush-259:009:35:252
1118183991613,3cyclictest1377315-21kworker/u8:1+events_unbound12:30:282
1118180991613,2cyclictest1232647-21latency_hist09:00:001
1118180991613,2cyclictest1216277-21kworker/u8:3+events_unbound09:50:161
1118180991612,3cyclictest1398946-21apt-get11:40:101
1118180991612,3cyclictest1190292-21kworker/u8:1+events_unbound10:43:241
1118176991614,1cyclictest60350irq/132-enp0s29f1:rx-011:00:250
1118176991613,2cyclictest60350irq/132-enp0s29f1:rx-011:35:230
1118176991613,2cyclictest60350irq/132-enp0s29f1:rx-011:25:140
1118176991613,2cyclictest60350irq/132-enp0s29f1:rx-010:45:160
1118176991613,2cyclictest60350irq/132-enp0s29f1:rx-010:15:450
1118176991613,2cyclictest60350irq/132-enp0s29f1:rx-009:05:190
1118176991612,3cyclictest1258874-21latency_hist09:25:000
1118176991612,2cyclictest1232650-21turbostat09:00:000
1118176991611,3cyclictest1361994-21apt-get11:05:120
111817699161,13cyclictest1-21systemd11:16:200
1118176991611,3cyclictest1-21systemd10:45:000
111818699158,5cyclictest1127581-21ntpq07:15:223
1118186991512,2cyclictest2971-21cron12:10:003
1118186991511,3cyclictest509-21rs:main3
1118186991511,3cyclictest252-21systemd-journal11:45:013
1118186991511,3cyclictest1279697-21apt-get09:45:123
1118186991510,3cyclictest1424924-21latency_hist12:05:013
1118183991512,2cyclictest1190292-21kworker/u8:1+events_unbound10:15:392
111818099151,8cyclictest1195741-21basename08:25:001
1118180991512,2cyclictest1377315-21kworker/u8:1+flush-259:011:55:261
1118176991514,1cyclictest60350irq/132-enp0s29f1:rx-009:00:390
1118176991514,1cyclictest60350irq/132-enp0s29f1:rx-008:27:330
1118176991514,1cyclictest60350irq/132-enp0s29f1:rx-008:27:330
1118176991513,1cyclictest60350irq/132-enp0s29f1:rx-012:00:240
1118176991513,1cyclictest60350irq/132-enp0s29f1:rx-011:54:240
1118176991513,1cyclictest60350irq/132-enp0s29f1:rx-008:05:160
1118176991513,1cyclictest60350irq/132-enp0s29f1:rx-007:25:410
1118176991511,3cyclictest60350irq/132-enp0s29f1:rx-008:00:120
1118176991511,3cyclictest1269181-21sh09:35:000
1118176991510,3cyclictest0-21swapper/011:25:000
111818699148,4cyclictest252-21systemd-journal09:20:003
1118186991411,2cyclictest1383913-21irqcore11:25:163
1118186991411,2cyclictest1289309-21unixbench_singl09:50:263
1118186991411,2cyclictest1208587-21kthreadcore08:35:193
1118186991410,3cyclictest509-21rs:main3
1118186991410,3cyclictest1264015-21kworker/u8:0+flush-259:009:40:013
1118183991412,2cyclictest1377315-21kworker/u8:1+events_unbound11:49:242
1118183991411,2cyclictest1190292-21kworker/u8:1+events_unbound08:55:202
1118180991412,2cyclictest1393542-21kworker/u8:3+events_unbound11:35:171
1118180991411,2cyclictest1377315-21kworker/u8:1+flush-259:012:05:111
1118180991411,2cyclictest1133079-21unixbench-2d07:20:241
1118180991410,3cyclictest1159675-21kworker/u8:2+events_unbound07:55:231
111817699148,5cyclictest1320861-21apt-get10:25:120
111817699148,4cyclictest1154806-21apt-get07:45:120
1118176991413,1cyclictest60350irq/132-enp0s29f1:rx-011:34:430
1118176991413,1cyclictest60350irq/132-enp0s29f1:rx-007:20:430
1118176991412,2cyclictest60350irq/132-enp0s29f1:rx-012:24:430
1118176991412,1cyclictest60350irq/132-enp0s29f1:rx-012:05:240
1118176991412,1cyclictest60350irq/132-enp0s29f1:rx-010:57:150
1118176991412,1cyclictest60350irq/132-enp0s29f1:rx-010:05:230
1118176991412,1cyclictest60350irq/132-enp0s29f1:rx-007:30:110
1118176991411,2cyclictest61150irq/133-enp0s29f1:tx-007:50:020
1118176991411,2cyclictest60350irq/132-enp0s29f1:rx-011:55:140
1118176991411,2cyclictest60350irq/132-enp0s29f1:rx-010:10:160
1118176991411,2cyclictest60350irq/132-enp0s29f1:rx-009:50:220
1118176991411,2cyclictest1190292-21kworker/u8:1+flush-259:009:28:040
111818699139,3cyclictest1238120-21cpuspeed_turbos09:05:143
111818699139,3cyclictest1190292-21kworker/u8:1+flush-259:009:25:013
111818699138,3cyclictest1206000-21cron08:35:003
1118186991310,2cyclictest1378727-21sed11:20:163
1118186991310,2cyclictest1132573-21needreboot07:20:193
111818399139,3cyclictest1195728-21latency_hist08:25:002
1118183991311,2cyclictest1383283-21kworker/u8:0+events_unbound12:00:222
1118183991310,2cyclictest1190292-21kworker/u8:1+events_unbound08:40:132
1118183991310,2cyclictest1175335-21kworker/u8:0+flush-259:008:15:242
111818099139,3cyclictest1216277-21kworker/u8:3+events_unbound10:05:011
111818099138,3cyclictest1148934-21cron07:39:591
1118180991310,2cyclictest1206039-21kworker/u8:2+events_unbound08:45:241
1118180991310,2cyclictest1190292-21kworker/u8:1+flush-259:010:15:131
1118176991312,1cyclictest60350irq/132-enp0s29f1:rx-008:44:440
1118176991311,1cyclictest60350irq/132-enp0s29f1:rx-010:38:480
111818699129,2cyclictest1328303-21kthreadcore10:30:173
111818699127,4cyclictest1154531-21latency_hist07:45:003
111818699127,3cyclictest252-21systemd-journal10:55:223
111818699126,4cyclictest1367407-21cat11:10:003
111818099128,3cyclictest1195771-21kworker/u8:0+events_unbound08:30:101
1118180991210,2cyclictest1148976-21kworker/u8:0+flush-259:007:40:151
1118180991210,2cyclictest1112604-21kworker/u8:4+flush-259:008:00:201
111817699127,4cyclictest1180486-21kworker/u8:3+flush-259:008:20:180
111818699118,2cyclictest0-21swapper/308:10:133
111818699111,8cyclictest1325742-21awk10:30:003
111818399118,2cyclictest1217429-21irqcore08:45:172
111818099119,1cyclictest0-21swapper/109:55:171
111817699111,3cyclictest507-21in:imuxsock09:10:230
111818699108,1cyclictest0-21swapper/310:45:233
111818699106,3cyclictest1216277-21kworker/u8:3+flush-259:009:40:163
111818699105,4cyclictest1222349-21uniq08:50:123
111818699104,4cyclictest1159923-21sshd07:50:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional