You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-05 - 17:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Dec 05, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8852822810,1chrt885281-21sshd10:10:202
773048996456,3cyclictest830848-21kworker/u8:0+events_unbound10:46:220
773052995652,3cyclictest830848-21kworker/u8:0+flush-8:009:41:201
9996812550,1chrt999682-21/usr/sbin/munin12:06:102
773052995550,4cyclictest781106-21kworker/u8:1+flush-8:008:41:221
773052995347,5cyclictest798976-21kworker/u8:3+events_unbound09:46:191
8553542520,1chrt855352-21systemctl09:40:000
773052995142,7cyclictest804012-21ntpq08:11:151
773052995142,7cyclictest792745-21kworker/u8:0+flush-8:007:56:171
773052995140,8cyclictest849587-21ntpq09:31:181
773052995045,3cyclictest830848-21kworker/u8:0+events_unbound12:26:221
773052995045,3cyclictest830848-21kworker/u8:0+events_unbound12:26:221
773048995046,3cyclictest830848-21kworker/u8:0+events_unbound12:21:220
773048994945,3cyclictest798976-21kworker/u8:3+events_unbound09:16:170
773048994937,9cyclictest869318-21ntpq09:51:150
9084132480,3chrt0-21swapper/210:31:152
773052994843,4cyclictest781106-21kworker/u8:1+flush-8:008:56:171
773052994842,4cyclictest1023155-21kworker/u8:1+flush-8:012:36:151
773052994637,7cyclictest919946-21/usr/sbin/munin10:46:171
773048994641,4cyclictest949757-21kworker/u8:2+flush-8:011:36:170
773048994542,2cyclictest949757-21kworker/u8:2+events_unbound11:26:050
773048994541,3cyclictest904289-21kworker/u8:3+events_unbound10:30:200
773048994541,3cyclictest830848-21kworker/u8:0+events_unbound12:06:270
773048994541,3cyclictest830848-21kworker/u8:0+events_unbound12:03:210
773048994541,3cyclictest830848-21kworker/u8:0+events_unbound10:51:070
773048994541,3cyclictest781106-21kworker/u8:1+events_unbound07:56:240
773048994440,3cyclictest875372-21kworker/u8:1+events_unbound10:06:060
773048994440,3cyclictest830848-21kworker/u8:0+events_unbound09:23:210
773048994436,5cyclictest829499-21ntpq09:11:110
773052994332,8cyclictest983335-21ntpq11:46:171
773048994340,2cyclictest875372-21kworker/u8:1+events_unbound10:21:170
773048994339,3cyclictest875372-21kworker/u8:1+events_unbound10:25:200
773048994339,3cyclictest830848-21kworker/u8:0+events_unbound11:06:240
773048994339,3cyclictest781106-21kworker/u8:1+events_unbound09:00:210
773048994339,3cyclictest781106-21kworker/u8:1+events_unbound08:49:220
773052994234,5cyclictest810655-21ntpq08:26:151
773052994232,8cyclictest839639-21ntpq09:21:141
773048994239,2cyclictest830848-21kworker/u8:0+events_unbound11:41:050
773048994238,3cyclictest939833-21kworker/u8:3+events_unbound11:21:160
773048994238,3cyclictest823656-21kworker/u8:2+events_unbound10:16:240
773048994238,3cyclictest823656-21kworker/u8:2+events_unbound10:16:240
773048994237,4cyclictest823656-21kworker/u8:2+events_unbound10:41:230
773052994136,3cyclictest798976-21kworker/u8:3+flush-8:009:56:231
773048994137,3cyclictest963821-21kworker/u8:1+events_unbound11:31:100
773048994137,3cyclictest798976-21kworker/u8:3+events_unbound09:31:070
773048994137,3cyclictest772905-21kworker/u8:3+events_unbound07:18:210
773060994035,4cyclictest804430-21kworker/u8:0+events_unbound08:26:112
773052994030,7cyclictest773244-21/usr/sbin/munin07:11:131
773048994036,3cyclictest830848-21kworker/u8:0+events_unbound11:50:440
773048994036,3cyclictest830848-21kworker/u8:0+events_unbound10:36:450
773048994036,3cyclictest830848-21kworker/u8:0+events_unbound09:46:400
773048994036,3cyclictest823656-21kworker/u8:2+events_unbound10:55:030
773048994036,3cyclictest662696-21kworker/u8:0+events_unbound07:24:220
773048994036,3cyclictest3638553-21kworker/u8:2+events_unbound07:31:220
773048994036,3cyclictest1023155-21kworker/u8:1+events_unbound12:36:230
773052993934,3cyclictest830848-21kworker/u8:0+flush-8:012:21:081
773052993932,5cyclictest949757-21kworker/u8:2+flush-8:012:11:181
773052993928,9cyclictest933562-21ntpq10:56:321
773052993927,9cyclictest993266-21ntpq11:56:201
773052993926,10cyclictest282-21systemd-journal10:36:201
773048993935,3cyclictest949757-21kworker/u8:2+events_unbound11:18:220
773048993935,3cyclictest830848-21kworker/u8:0+events_unbound12:19:220
773048993935,3cyclictest830848-21kworker/u8:0+events_unbound11:04:200
773048993935,3cyclictest823656-21kworker/u8:2+events_unbound10:11:250
773048993935,3cyclictest804430-21kworker/u8:0+events_unbound08:22:190
773048993935,3cyclictest798976-21kworker/u8:3+events_unbound08:16:220
773048993935,3cyclictest662696-21kworker/u8:0+events_unbound07:26:310
773048993935,3cyclictest3638553-21kworker/u8:2+events_unbound07:11:210
773060993832,4cyclictest830848-21kworker/u8:0+flush-8:010:26:082
773060993830,6cyclictest282-21systemd-journal10:45:012
773052993834,3cyclictest1023155-21kworker/u8:1+events_unbound12:31:231
773052993833,4cyclictest875372-21kworker/u8:1+flush-8:010:01:241
773052993832,4cyclictest939833-21kworker/u8:3+flush-8:011:11:231
773048993834,3cyclictest963821-21kworker/u8:1+events_unbound11:46:270
773048993834,3cyclictest939833-21kworker/u8:3+events_unbound11:11:440
773048993834,3cyclictest830848-21kworker/u8:0+events_unbound09:43:210
773048993834,3cyclictest823656-21kworker/u8:2+events_unbound08:59:210
773048993834,3cyclictest811765-21kworker/u8:2+events_unbound08:35:330
773048993834,3cyclictest781106-21kworker/u8:1+events_unbound08:25:330
773048993834,3cyclictest781106-21kworker/u8:1+events_unbound07:50:020
773048993834,3cyclictest781106-21kworker/u8:1+events_unbound07:50:010
773048993834,3cyclictest3638553-21kworker/u8:2+events_unbound07:40:020
773048993830,6cyclictest825435-21latency_hist09:10:010
773052993731,4cyclictest939833-21kworker/u8:3+events_unbound11:21:211
773052993729,6cyclictest875372-21kworker/u8:1+flush-8:010:16:171
773052993729,6cyclictest875372-21kworker/u8:1+flush-8:010:16:161
773048993733,3cyclictest781106-21kworker/u8:1+events_unbound08:50:380
773048993733,3cyclictest781106-21kworker/u8:1+events_unbound08:10:030
773048993733,3cyclictest781106-21kworker/u8:1+events_unbound07:48:500
773048993733,3cyclictest3638553-21kworker/u8:2+events_unbound07:39:200
773048993733,3cyclictest1023155-21kworker/u8:1+events_unbound12:33:220
773052993630,4cyclictest830848-21kworker/u8:0+events_unbound11:26:131
773052993630,4cyclictest662696-21kworker/u8:0+flush-8:007:26:161
773052993629,5cyclictest963821-21kworker/u8:1+flush-8:011:41:161
773052993629,5cyclictest830848-21kworker/u8:0+events_unbound09:51:141
773048993632,3cyclictest811765-21kworker/u8:2+events_unbound08:32:220
773048993632,3cyclictest798976-21kworker/u8:3+events_unbound10:00:020
773060993530,4cyclictest830848-21kworker/u8:0+flush-8:012:01:212
773052993530,3cyclictest786716-21systemd-run07:35:001
773048993532,2cyclictest781106-21kworker/u8:1+events_unbound08:06:220
773048993531,3cyclictest798976-21kworker/u8:3+events_unbound09:59:220
773048993531,3cyclictest798976-21kworker/u8:3+events_unbound09:29:530
773048993531,3cyclictest1003523-21kworker/u8:3+events_unbound12:26:470
773048993531,3cyclictest1003523-21kworker/u8:3+events_unbound12:26:460
77264623525,3sleep00-21swapper/007:07:110
773060993427,5cyclictest405-21dbus-daemon10:00:002
773048993431,2cyclictest830848-21kworker/u8:0+events_unbound11:55:290
773048993430,3cyclictest1003523-21kworker/u8:3+events_unbound12:10:150
773060993324,6cyclictest282-21systemd-journal08:10:012
773052993328,4cyclictest823656-21kworker/u8:2+events_unbound10:41:191
773052993327,5cyclictest830848-21kworker/u8:0+flush-8:010:51:171
773048993329,3cyclictest798976-21kworker/u8:3+events_unbound08:44:070
773048993329,3cyclictest781106-21kworker/u8:1+events_unbound08:03:220
773052993228,3cyclictest875372-21kworker/u8:1+events_unbound10:06:211
773052993228,2cyclictest939361-21cron11:05:001
773052993227,3cyclictest904289-21kworker/u8:3+flush-8:010:31:121
773052993227,3cyclictest793745-21cron07:55:001
773052993227,3cyclictest793745-21cron07:54:591
773052993226,5cyclictest963821-21kworker/u8:1+flush-8:011:31:111
773052993226,4cyclictest798976-21kworker/u8:3+events_unbound09:16:191
773052993225,5cyclictest823656-21kworker/u8:2+flush-8:009:11:141
773052993223,6cyclictest974270-21latency_hist11:40:011
773060993124,5cyclictest282-21systemd-journal09:05:202
773060993025,4cyclictest781106-21kworker/u8:1+flush-8:008:41:122
773052993026,3cyclictest662696-21kworker/u8:0+events_unbound07:25:011
773052993026,2cyclictest885955-21irqcore10:11:101
773052993026,2cyclictest780441-21idleruntime-cro07:20:001
773052993024,4cyclictest939833-21kworker/u8:3+events_unbound11:16:181
773052993019,8cyclictest282-21systemd-journal12:20:001
7727052303,9sleep20-21swapper/207:07:582
773060992924,4cyclictest963821-21kworker/u8:1+flush-8:011:31:172
773052992923,4cyclictest830848-21kworker/u8:0+events_unbound11:51:181
773052992923,4cyclictest806392-21latency_hist08:25:011
773052992919,7cyclictest812158-21latency_hist08:35:011
773060992823,4cyclictest939833-21kworker/u8:3+flush-8:011:16:222
773060992823,4cyclictest830848-21kworker/u8:0+flush-8:011:51:132
773052992823,3cyclictest854491-21ntpq09:36:151
773052992823,3cyclictest819002-21systemd-run08:55:011
773052992823,3cyclictest793159-21systemd-run07:50:001
773052992822,4cyclictest875372-21kworker/u8:1+events_unbound10:21:101
773052992721,5cyclictest781106-21kworker/u8:1+events_unbound08:15:021
773052992720,5cyclictest830848-21kworker/u8:0+flush-8:010:26:241
773060992621,3cyclictest924243-21unixbench_singl10:46:252
773060992620,4cyclictest914336-21unixbench_singl10:36:242
773060992617,7cyclictest850023-21unixbench_multi09:31:242
773052992622,2cyclictest0-21swapper/112:06:131
773052992621,4cyclictest798976-21kworker/u8:3+flush-8:009:26:191
773052992621,3cyclictest788263-21irqcore07:41:091
773060992520,3cyclictest925255-21fschecks_time10:51:082
773060992519,4cyclictest831859-21kthreadcore09:16:092
773060992519,4cyclictest806381-21cron08:25:012
77306099250,10cyclictest10058222kthreadcore12:11:132
773052992521,3cyclictest830848-21kworker/u8:0+flush-8:011:06:191
773060992421,2cyclictest800315-21aten2_r5power_c08:11:032
773060992420,2cyclictest895546-21fschecks_time10:21:082
773060992419,3cyclictest0-21swapper/210:16:202
773060992419,3cyclictest0-21swapper/210:16:202
773060992416,6cyclictest1029264-21apt-get12:36:002
773060992414,8cyclictest282-21systemd-journal07:50:002
773060992413,9cyclictest282-21systemd-journal08:04:202
773052992419,3cyclictest0-21swapper/108:50:011
773052992416,5cyclictest799340-21latency_hist08:05:011
773060992319,2cyclictest819534-21cpuspeed_turbos08:56:042
773060992218,3cyclictest939833-21kworker/u8:3+flush-8:011:11:162
773060992218,2cyclictest865781-21cpuspeed_turbos09:51:042
773060992216,4cyclictest1028562-21unixbench_multi12:31:252
773060992215,5cyclictest805735-21cron08:20:012
773060992213,7cyclictest782464-21tr07:26:102
77305299229,4cyclictest0-21swapper/109:04:161
773052992218,2cyclictest0-21swapper/112:01:051
7724882224,12sleep10-21swapper/107:05:061
773060992116,4cyclictest935034-21fschecks_count11:01:092
773060992116,4cyclictest855346-21apt09:40:002
773060992116,4cyclictest830034-21unixbench_singl09:11:202
773060992114,5cyclictest981752-21kthreadcore11:46:142
77306099202,13cyclictest939936-21apt-get11:06:042
77306099202,13cyclictest875479-21apt-get10:01:082
773060992015,3cyclictest934059-21unixbench_multi10:56:412
773060992013,5cyclictest282-21systemd-journal08:50:182
773060992013,5cyclictest1019193-21sed12:25:012
773052992016,3cyclictest781106-21kworker/u8:1+flush-8:008:37:251
7722812203,8sleep30-21swapper/307:05:013
77306099192,6cyclictest0-21swapper/211:37:552
773060991914,3cyclictest0-21swapper/211:21:152
773060991914,3cyclictest0-21swapper/207:11:222
773060991913,4cyclictest791945-21unixbench_singl07:41:212
773052991913,4cyclictest787318-21cron07:40:001
773060991814,3cyclictest823656-21kworker/u8:2+flush-8:009:26:172
773060991814,2cyclictest0-21swapper/211:41:202
773060991814,2cyclictest0-21swapper/209:04:592
773060991814,2cyclictest0-21swapper/207:40:002
77306099181,2cyclictest9920441kthreadcore11:56:162
773060991812,5cyclictest859403-21needreboot09:41:152
773060991812,4cyclictest861001-21fschecks_time09:46:082
9838232170,4sleep30-21swapper/311:46:243
77306099178,7cyclictest1010031-21sed12:16:112
773060991714,2cyclictest1019574-21cpuspeed_turbos12:26:082
773060991714,2cyclictest1019574-21cpuspeed_turbos12:26:072
773052991712,4cyclictest823656-21kworker/u8:2+flush-8:009:05:211
77306099162,2cyclictest0-21swapper/207:15:232
77306099162,13cyclictest0-21swapper/207:56:122
77306099162,13cyclictest0-21swapper/207:52:292
77306099162,13cyclictest0-21swapper/207:52:292
77306099162,13cyclictest0-21swapper/207:33:022
77306099162,13cyclictest0-21swapper/207:23:242
773060991612,2cyclictest0-21swapper/210:06:062
773060991612,2cyclictest0-21swapper/208:40:012
773060991611,3cyclictest0-21swapper/211:26:122
773060991611,3cyclictest0-21swapper/209:21:222
77306099157,6cyclictest812260-21sed08:35:012
77305299152,5cyclictest0-21swapper/108:09:361
9123712145,5sleep30-21swapper/310:36:133
10292672142,8sleep30-21swapper/312:36:023
9891362132,7sleep30-21swapper/311:55:003
9445762132,6sleep30-21swapper/311:10:003
9196262132,6sleep30-21swapper/310:45:013
8702022132,6sleep30-21swapper/309:55:013
8413372132,7sleep30-21swapper/309:26:123
8189952132,6sleep30-21swapper/308:55:023
8168772130,2sleep3471rcuc/308:41:163
10179032132,7sleep30-21swapper/312:21:173
10039662132,6sleep30-21swapper/312:10:013
9997622122,6sleep30-21swapper/312:06:123
9946932123,5sleep30-21swapper/312:01:053
9792242122,5sleep30-21swapper/311:45:013
9629852122,6sleep30-21swapper/311:26:153
9548102122,7sleep30-21swapper/311:21:053
9313892122,6sleep30-21swapper/310:56:293
9248772122,6sleep30-21swapper/310:51:033
9208682122,6sleep30-21swapper/310:46:143
9053252122,6sleep30-21swapper/310:31:093
8916702122,6sleep30-21swapper/310:16:123
8916702122,6sleep30-21swapper/310:16:123
8760882122,6sleep30-21swapper/310:01:153
8701232122,6sleep30-21swapper/309:54:213
8510242122,6sleep30-21swapper/309:36:063
8457872124,5sleep30-21swapper/309:31:053
8348622122,6sleep30-21swapper/309:16:203
8250592122,6sleep30-21swapper/309:05:213
8182442122,2sleep20-21swapper/208:48:422
8005282122,6sleep30-21swapper/308:11:073
7992692122,6sleep30-21swapper/308:04:213
7873722122,5sleep30-21swapper/307:40:013
7817612122,6sleep30-21swapper/307:26:093
10132292122,6sleep30-21swapper/312:16:233
9893972112,5sleep30-21swapper/311:55:203
9734902112,5sleep30-21swapper/311:36:183
9645912112,5sleep30-21swapper/311:30:203
9498002112,6sleep30-21swapper/311:16:033
9435452112,5sleep30-21swapper/311:06:163
9348272112,5sleep30-21swapper/311:01:073
9006432112,6sleep30-21swapper/310:26:113
8949262112,5sleep30-21swapper/310:20:003
8898082112,5sleep30-21swapper/310:13:073
8842562112,5sleep30-21swapper/310:06:213
8607442111,6sleep30-21swapper/309:46:063
8560042112,5sleep30-21swapper/309:41:093
8365222110,7sleep30-21swapper/309:21:103
8262352112,5sleep30-21swapper/309:11:073
8244592113,5sleep30-21swapper/309:00:353
8188102112,6sleep30-21swapper/308:53:013
8180422112,6sleep30-21swapper/308:46:063
8121012112,6sleep30-21swapper/308:34:273
8069552110,7sleep30-21swapper/308:26:043
8061082112,5sleep30-21swapper/308:21:313
7943452112,5sleep30-21swapper/307:56:053
7933842112,6sleep30-21swapper/307:50:213
7933842112,6sleep30-21swapper/307:50:213
7928452113,5sleep30-21swapper/307:46:233
7871682112,6sleep30-21swapper/307:38:213
7865122112,5sleep30-21swapper/307:32:553
7810712112,5sleep30-21swapper/307:25:003
7778942112,5sleep30-21swapper/307:15:013
7732852112,5sleep30-21swapper/307:11:033
10247272112,5sleep30-21swapper/312:31:123
10232072112,5sleep30-21swapper/312:26:223
10232072112,5sleep30-21swapper/312:26:223
8123822102,5sleep30-21swapper/308:35:033
8053662102,5sleep30-21swapper/308:15:173
7995632102,5sleep30-21swapper/308:05:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional