You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-04 - 12:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Fri Jul 04, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11888992424,0cyclictest17024-21fwupd23:19:122
11888991818,0cyclictest60250irq/125-lan19:55:102
11888991717,0cyclictest60250irq/125-lan23:45:142
11888991717,0cyclictest60250irq/125-lan23:32:272
11888991717,0cyclictest60250irq/125-lan22:40:202
11888991717,0cyclictest60250irq/125-lan21:15:232
11888991717,0cyclictest60250irq/125-lan20:27:172
11888991717,0cyclictest60250irq/125-lan19:30:022
11888991616,0cyclictest60250irq/125-lan23:42:242
11888991616,0cyclictest60250irq/125-lan22:15:232
11888991616,0cyclictest60250irq/125-lan21:25:112
11888991616,0cyclictest60250irq/125-lan20:45:212
11888991616,0cyclictest60250irq/125-lan19:47:182
11888991616,0cyclictest60250irq/125-lan00:00:002
11888991615,1cyclictest60250irq/125-lan22:30:012
11888991615,1cyclictest60250irq/125-lan22:30:002
11888991615,1cyclictest60250irq/125-lan00:20:152
11888991515,0cyclictest60250irq/125-lan22:55:202
11888991515,0cyclictest60250irq/125-lan22:51:502
11888991515,0cyclictest60250irq/125-lan22:07:242
11888991515,0cyclictest60250irq/125-lan21:21:122
11888991515,0cyclictest60250irq/125-lan21:05:162
11888991515,0cyclictest60250irq/125-lan20:35:232
11888991515,0cyclictest60250irq/125-lan20:00:182
11888991515,0cyclictest60250irq/125-lan19:25:202
11888991515,0cyclictest60250irq/125-lan00:35:222
11888991515,0cyclictest60250irq/125-lan00:32:182
11888991515,0cyclictest60250irq/125-lan00:25:152
11888991515,0cyclictest60250irq/125-lan00:05:192
11888991515,0cyclictest329-21hwrng23:39:182
11888991515,0cyclictest329-21hwrng22:13:162
11888991515,0cyclictest329-21hwrng21:11:502
11888991515,0cyclictest329-21hwrng20:52:232
11888991515,0cyclictest329-21hwrng19:15:072
11888991514,1cyclictest60250irq/125-lan22:00:132
11888991514,1cyclictest60250irq/125-lan20:55:122
11888991514,1cyclictest60250irq/125-lan20:20:162
11888991414,0cyclictest60250irq/125-lan23:52:182
11888991414,0cyclictest60250irq/125-lan23:05:132
11888991414,0cyclictest60250irq/125-lan21:55:122
11888991414,0cyclictest60250irq/125-lan21:35:212
11888991414,0cyclictest60250irq/125-lan20:30:182
11888991414,0cyclictest60250irq/125-lan20:10:222
11888991414,0cyclictest60250irq/125-lan19:40:152
11888991414,0cyclictest329-21hwrng23:28:022
11888991414,0cyclictest329-21hwrng23:00:232
11888991414,0cyclictest329-21hwrng19:38:392
11888991414,0cyclictest329-21hwrng19:20:132
11888991414,0cyclictest329-21hwrng00:10:012
11888991414,0cyclictest329-21hwrng00:00:482
11888991413,1cyclictest60250irq/125-lan21:52:182
11888991413,1cyclictest60250irq/125-lan19:50:182
11888991313,0cyclictest60250irq/125-lan22:32:182
11888991313,0cyclictest60250irq/125-lan22:22:502
11888991313,0cyclictest60250irq/125-lan21:34:182
11888991313,0cyclictest60250irq/125-lan21:00:232
11888991313,0cyclictest60250irq/125-lan20:15:422
11888991313,0cyclictest329-21hwrng19:11:012
11888991312,1cyclictest60250irq/125-lan21:46:562
11888991312,1cyclictest60250irq/125-lan21:40:182
11893991212,0cyclictest329-21hwrng19:36:363
11888991212,0cyclictest60250irq/125-lan22:45:142
11888991211,1cyclictest60250irq/125-lan00:15:152
1187899120,11cyclictest789-21turbostat00:00:000
11888991111,0cyclictest60250irq/125-lan22:35:162
11888991111,0cyclictest60250irq/125-lan20:40:002
11888991111,0cyclictest60250irq/125-lan20:05:232
118939999,0cyclictest329-21hwrng23:40:193
118939999,0cyclictest329-21hwrng23:15:453
118939999,0cyclictest329-21hwrng21:21:043
118939999,0cyclictest329-21hwrng20:30:533
118939998,1cyclictest702-21snmpd22:27:263
118939998,1cyclictest702-21snmpd22:27:253
118939998,1cyclictest702-21snmpd00:25:103
118839998,1cyclictest702-21snmpd23:07:551
118839998,1cyclictest702-21snmpd00:04:331
118939988,0cyclictest702-21snmpd23:52:313
118939988,0cyclictest702-21snmpd23:45:233
118939988,0cyclictest702-21snmpd20:25:283
118939988,0cyclictest329-21hwrng23:35:113
118939988,0cyclictest329-21hwrng22:13:163
118939988,0cyclictest329-21hwrng19:26:233
118939988,0cyclictest329-21hwrng19:11:013
118889988,0cyclictest60250irq/125-lan23:10:172
118839988,0cyclictest702-21snmpd22:21:051
118839988,0cyclictest702-21snmpd21:12:381
118839988,0cyclictest702-21snmpd00:23:071
118839988,0cyclictest329-21hwrng22:56:181
118839988,0cyclictest329-21hwrng22:03:031
118839988,0cyclictest329-21hwrng21:55:531
118839988,0cyclictest329-21hwrng21:53:501
118839988,0cyclictest329-21hwrng21:47:411
118839988,0cyclictest329-21hwrng21:24:081
118839988,0cyclictest329-21hwrng21:15:561
118839988,0cyclictest329-21hwrng21:00:351
118839988,0cyclictest329-21hwrng20:39:051
118839988,0cyclictest329-21hwrng19:42:451
118839987,1cyclictest702-21snmpd22:51:421
118839987,1cyclictest702-21snmpd21:33:581
118789988,0cyclictest702-21snmpd22:52:030
118789988,0cyclictest702-21snmpd22:23:380
118789988,0cyclictest702-21snmpd22:07:410
118789988,0cyclictest329-21hwrng23:50:340
118789988,0cyclictest329-21hwrng00:38:410
118789988,0cyclictest329-21hwrng00:07:580
118789987,1cyclictest702-21snmpd21:02:560
118789987,1cyclictest702-21snmpd20:01:420
118939977,0cyclictest702-21snmpd23:31:263
118939977,0cyclictest329-21hwrng23:10:383
118939977,0cyclictest329-21hwrng23:00:233
118939977,0cyclictest329-21hwrng22:45:023
118939977,0cyclictest329-21hwrng22:07:083
118939977,0cyclictest329-21hwrng21:36:253
118939977,0cyclictest329-21hwrng21:32:203
118939977,0cyclictest329-21hwrng21:13:533
118939977,0cyclictest329-21hwrng20:51:223
118939977,0cyclictest329-21hwrng19:55:033
118939977,0cyclictest329-21hwrng19:30:283
118939977,0cyclictest329-21hwrng19:22:163
118939977,0cyclictest329-21hwrng00:22:183
118939976,1cyclictest702-21snmpd21:43:243
118939976,1cyclictest702-21snmpd00:04:123
118889976,1cyclictest15680-21kworker/2:1+events23:20:122
118839977,0cyclictest702-21snmpd23:55:301
118839977,0cyclictest702-21snmpd22:37:031
118839977,0cyclictest702-21snmpd20:25:241
118839977,0cyclictest702-21snmpd00:29:041
118839977,0cyclictest329-21hwrng23:51:351
118839977,0cyclictest329-21hwrng23:43:241
118839977,0cyclictest329-21hwrng23:31:061
118839977,0cyclictest329-21hwrng23:25:591
118839977,0cyclictest329-21hwrng23:22:551
118839977,0cyclictest329-21hwrng22:45:021
118839977,0cyclictest329-21hwrng22:41:571
118839977,0cyclictest329-21hwrng22:30:421
118839977,0cyclictest329-21hwrng22:26:361
118839977,0cyclictest329-21hwrng22:26:361
118839977,0cyclictest329-21hwrng22:16:211
118839977,0cyclictest329-21hwrng22:07:081
118839977,0cyclictest329-21hwrng21:43:341
118839977,0cyclictest329-21hwrng21:35:241
118839977,0cyclictest329-21hwrng20:59:321
118839977,0cyclictest329-21hwrng20:40:051
118839977,0cyclictest329-21hwrng20:34:591
118839977,0cyclictest329-21hwrng20:24:451
118839977,0cyclictest329-21hwrng20:16:331
118839977,0cyclictest329-21hwrng20:05:171
118839977,0cyclictest329-21hwrng20:01:111
118839977,0cyclictest329-21hwrng19:59:081
118839977,0cyclictest329-21hwrng19:50:571
118839977,0cyclictest329-21hwrng19:45:501
118839977,0cyclictest329-21hwrng19:37:381
118839977,0cyclictest329-21hwrng19:34:341
118839977,0cyclictest329-21hwrng19:26:221
118839977,0cyclictest329-21hwrng19:23:171
118839976,1cyclictest702-21snmpd23:10:371
118839976,1cyclictest702-21snmpd19:12:171
118839976,1cyclictest702-21snmpd00:11:001
118789977,0cyclictest702-21snmpd23:34:590
118789977,0cyclictest702-21snmpd23:11:280
118789977,0cyclictest702-21snmpd23:05:520
118789977,0cyclictest702-21snmpd22:40:540
118789977,0cyclictest702-21snmpd22:25:290
118789977,0cyclictest702-21snmpd22:25:290
118789977,0cyclictest702-21snmpd00:19:360
118789977,0cyclictest329-21hwrng23:15:450
118789977,0cyclictest329-21hwrng22:16:210
118789977,0cyclictest329-21hwrng21:21:040
118789977,0cyclictest329-21hwrng20:14:290
118789977,0cyclictest329-21hwrng20:07:200
118789976,1cyclictest702-21snmpd22:38:030
118789976,1cyclictest702-21snmpd20:58:580
118789976,1cyclictest702-21snmpd20:43:070
118789976,1cyclictest702-21snmpd19:57:290
118789976,1cyclictest702-21snmpd19:40:560
118789976,1cyclictest702-21snmpd19:33:230
118939966,0cyclictest702-21snmpd22:18:203
118939966,0cyclictest702-21snmpd21:57:153
118939966,0cyclictest702-21snmpd21:52:223
118939966,0cyclictest702-21snmpd21:45:193
118939966,0cyclictest702-21snmpd19:47:303
118939966,0cyclictest329-21hwrng22:57:193
118939966,0cyclictest329-21hwrng22:50:083
118939966,0cyclictest329-21hwrng22:41:573
118939966,0cyclictest329-21hwrng21:29:143
118939966,0cyclictest329-21hwrng21:16:583
118939966,0cyclictest329-21hwrng21:08:463
118939966,0cyclictest329-21hwrng20:45:133
118939965,1cyclictest702-21snmpd23:25:523
118939965,1cyclictest702-21snmpd22:00:073
118939965,1cyclictest702-21snmpd20:17:463
118939965,1cyclictest702-21snmpd00:19:213
118839966,0cyclictest702-21snmpd21:27:471
118839966,0cyclictest329-21hwrng23:47:291
118839966,0cyclictest329-21hwrng23:37:151
118839966,0cyclictest329-21hwrng21:05:421
118839966,0cyclictest329-21hwrng20:45:131
118839966,0cyclictest329-21hwrng20:10:231
118839966,0cyclictest329-21hwrng00:30:301
118839965,1cyclictest702-21snmpd23:17:311
118789966,0cyclictest702-21snmpd20:30:310
118789966,0cyclictest702-21snmpd00:23:280
118789966,0cyclictest702-21snmpd00:10:420
118789966,0cyclictest329-21hwrng21:39:300
118789965,1cyclictest702-21snmpd23:24:160
118789965,1cyclictest702-21snmpd22:03:260
118789965,1cyclictest702-21snmpd21:56:070
118789965,1cyclictest702-21snmpd21:17:180
118789965,1cyclictest14665-21gltestperf20:35:160
118939955,0cyclictest702-21snmpd22:37:143
118939955,0cyclictest702-21snmpd00:35:223
118939955,0cyclictest329-21hwrng22:33:463
118939955,0cyclictest329-21hwrng20:21:403
118939955,0cyclictest329-21hwrng19:18:113
118939955,0cyclictest329-21hwrng00:13:053
118939954,1cyclictest702-21snmpd19:52:053
118839955,0cyclictest329-21hwrng20:54:261
118789955,0cyclictest7628-21gltestperf22:55:160
118789955,0cyclictest702-21snmpd23:29:110
118789955,0cyclictest702-21snmpd21:05:020
118789955,0cyclictest702-21snmpd19:26:340
118789955,0cyclictest702-21snmpd19:17:110
118789954,1cyclictest702-21snmpd22:45:540
118789954,1cyclictest702-21snmpd21:31:360
118789954,1cyclictest702-21snmpd19:51:180
118789954,1cyclictest702-21snmpd00:00:390
118789954,1cyclictest27526-21cpuspeed_turbos23:45:120
118789954,1cyclictest19248-21cat20:45:210
118939944,0cyclictest702-21snmpd21:00:113
118939944,0cyclictest329-21hwrng23:07:323
118939943,1cyclictest702-21snmpd20:35:443
118939943,1cyclictest4586-21ntpq20:10:203
118939943,1cyclictest32157-21ntpq23:55:163
118939941,2cyclictest25177-21cat22:20:133
118939940,1cyclictest0-21swapper/323:20:133
118839944,0cyclictest702-21snmpd00:05:061
118789944,0cyclictest702-21snmpd22:13:260
118789944,0cyclictest702-21snmpd20:29:210
118789944,0cyclictest702-21snmpd20:24:310
118789944,0cyclictest702-21snmpd19:36:330
118789944,0cyclictest329-21hwrng23:03:280
118789944,0cyclictest329-21hwrng21:51:470
118789944,0cyclictest329-21hwrng21:47:410
118789944,0cyclictest329-21hwrng20:54:260
118789944,0cyclictest329-21hwrng19:45:500
118789944,0cyclictest329-21hwrng19:21:150
118789943,1cyclictest30025-21ntpq21:10:190
118789943,1cyclictest151ktimers/019:10:120
118789942,2cyclictest9568-21memory21:40:170
118789942,2cyclictest702-21snmpd00:28:210
118789942,2cyclictest24222-21ntpq23:35:170
118789940,4cyclictest680-21ntpd00:30:140
118939932,1cyclictest702-21snmpd00:31:133
118939932,1cyclictest680-21ntpd00:08:133
118939931,2cyclictest24790-21grep19:40:183
118939931,2cyclictest23409-21wc20:55:173
118939931,2cyclictest1795-21apt20:05:123
118939931,2cyclictest16558-21awk20:40:013
118839932,1cyclictest702-21snmpd22:10:531
118839932,1cyclictest271ktimers/100:35:471
118839931,2cyclictest7987-21ld00:15:211
118839931,2cyclictest10862-21sshd23:02:541
118839930,3cyclictest271ktimers/119:15:121
118789932,1cyclictest702-21snmpd20:15:100
118789932,1cyclictest481-21wpa_supplicant22:30:010
118789932,1cyclictest25403-21/usr/sbin/munin23:40:170
118789931,2cyclictest4141-21sed21:25:210
118939920,2cyclictest32171-21/usr/sbin/munin20:00:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional