You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 13:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Fri Sep 11, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13667822960,1sleep50-21swapper/509:58:295
100667525545,7sleep40-21swapper/407:08:584
100659925419,30sleep70-21swapper/707:07:577
1007047994944,4cyclictest1589266-21kworker/u16:4+flush-8:011:39:565
100665724838,7sleep50-21swapper/507:08:435
15021292420,0sleep71502130-21ssh10:52:327
1007042993937,2cyclictest1127224-21kworker/u16:1+events_unbound09:49:564
1007042993836,2cyclictest1517066-21kworker/u16:1+flush-8:011:24:564
1007042993734,2cyclictest1429457-21kworker/u16:2+events_unbound10:29:594
1007047993532,2cyclictest1491210-21kworker/u16:5+flush-8:010:55:285
1007047993532,2cyclictest1491210-21kworker/u16:5+flush-8:010:55:285
1007042993430,3cyclictest1429457-21kworker/u16:2+flush-8:011:00:064
100654223410,8sleep60-21swapper/607:07:086
1007042993331,2cyclictest1337197-21kworker/u16:0+events_unbound11:54:074
1007042993330,2cyclictest1589215-21kworker/u16:2+events_unbound11:35:064
1007047993230,2cyclictest1337197-21kworker/u16:0+events_unbound11:34:565
1007053993126,4cyclictest1234296-21latency_hist09:04:577
1007047993129,2cyclictest1627282-21kworker/u16:5+events_unbound11:45:185
1007047993128,2cyclictest1491210-21kworker/u16:5+flush-8:010:59:585
1007042993129,2cyclictest1234679-21kworker/u16:3+events_unbound09:16:154
1007042993028,2cyclictest1562719-21kworker/u16:3+events_unbound11:29:064
1007042993028,2cyclictest1429457-21kworker/u16:2+events_unbound10:58:394
1007042993028,2cyclictest1429457-21kworker/u16:2+events_unbound10:58:394
1007042993028,2cyclictest1137370-21kworker/u16:2+events_unbound08:25:244
1007042993027,2cyclictest1127224-21kworker/u16:1+events_unbound09:59:584
1007053992924,4cyclictest1528194-21latency_hist11:04:567
1007042992927,2cyclictest1367664-21kworker/u16:3+events_unbound10:44:514
1007042992826,2cyclictest1701660-21kworker/u16:2+events_unbound12:38:294
1007042992826,2cyclictest1701660-21kworker/u16:2+events_unbound12:21:074
1007042992826,2cyclictest1627282-21kworker/u16:5+events_unbound12:06:054
1007042992826,2cyclictest1627282-21kworker/u16:5+events_unbound11:45:574
1007042992826,2cyclictest1337197-21kworker/u16:0+events_unbound12:04:074
1007042992826,2cyclictest1127224-21kworker/u16:1+events_unbound08:49:564
14028242270,1chrt1402823-21ssh10:11:457
1007047992725,2cyclictest1589266-21kworker/u16:4+events_unbound11:44:565
1007047992725,2cyclictest1281599-21kworker/u16:4+events_unbound09:35:385
1007047992725,2cyclictest1234679-21kworker/u16:3+flush-8:009:15:265
1007047992724,3cyclictest987446-21kworker/u16:0+flush-8:007:25:145
1007042992725,2cyclictest1404865-21kworker/u16:4+flush-8:010:16:064
1007042992724,2cyclictest1281599-21kworker/u16:4+events_unbound09:34:574
1007047992623,2cyclictest1281598-21kworker/u16:2+events_unbound09:25:125
1007042992624,2cyclictest1701660-21kworker/u16:2+flush-8:012:32:174
1007042992624,2cyclictest1517066-21kworker/u16:1+flush-8:011:05:384
1007042992624,2cyclictest1491210-21kworker/u16:5+events_unbound10:53:544
1007042992624,2cyclictest1429457-21kworker/u16:2+events_unbound10:45:514
1007042992624,2cyclictest1127224-21kworker/u16:1+flush-8:009:53:244
1007042992623,2cyclictest1281598-21kworker/u16:2+events_unbound10:05:064
1007053992522,2cyclictest16250irq/16-ehci_hcd:usb211:45:227
1007053992520,4cyclictest1127450-21latency_hist08:09:577
1007047992522,3cyclictest1030503-21kworker/u16:3+flush-8:007:50:225
1007042992523,2cyclictest1627282-21kworker/u16:5+events_unbound12:13:544
1007042992523,2cyclictest1589266-21kworker/u16:4+events_unbound11:32:394
1007042992523,2cyclictest1337197-21kworker/u16:0+events_unbound11:11:414
1007042992523,2cyclictest1337197-21kworker/u16:0+events_unbound10:25:064
1007042992523,2cyclictest1337197-21kworker/u16:0+events_unbound10:24:154
1007042992523,2cyclictest1281598-21kworker/u16:2+events_unbound09:44:144
1007042992523,2cyclictest1281598-21kworker/u16:2+events_unbound09:25:384
1007042992523,2cyclictest1127224-21kworker/u16:1+events_unbound09:31:104
1007042992522,2cyclictest1627282-21kworker/u16:5+flush-8:012:24:574
1007042992521,3cyclictest1614988-21kworker/u16:3+events_unbound11:55:204
1007042992422,2cyclictest1367664-21kworker/u16:3+flush-8:010:35:584
1007042992422,2cyclictest1337197-21kworker/u16:0+events_unbound10:12:464
1007042992422,2cyclictest1006807-21kworker/u16:2+events_unbound07:15:214
100705399230,21cyclictest645-21systemd-journal10:39:567
100705399230,21cyclictest1256347-21latency_hist09:14:577
1007042992321,2cyclictest1551453-21kworker/u16:2+events_unbound11:15:064
1007042992321,2cyclictest1127224-21kworker/u16:1+events_unbound09:56:034
1007042992321,2cyclictest1127224-21kworker/u16:1+events_unbound09:24:104
1007047992220,2cyclictest1367664-21kworker/u16:3+events_unbound10:25:245
1007047992220,2cyclictest1127224-21kworker/u16:1+events_unbound09:50:275
1007047992219,2cyclictest1664341-21kworker/u16:1+flush-8:012:15:135
1007047992219,2cyclictest1614988-21kworker/u16:3+flush-8:011:50:025
1007042992220,2cyclictest1664341-21kworker/u16:1+events_unbound12:16:304
1007042992220,2cyclictest1234679-21kworker/u16:3+events_unbound09:10:434
1007042992218,3cyclictest1147283-21kworker/u16:0+flush-8:008:20:164
1007042992119,2cyclictest968238-21kworker/u16:4+flush-8:007:10:224
1007042992119,2cyclictest1612278-21kworker/u16:1+events_unbound11:41:024
1007047992019,1cyclictest1337197-21kworker/u16:0+events_unbound12:00:135
1007047992018,2cyclictest987446-21kworker/u16:0+flush-8:007:30:125
1007047992018,2cyclictest1429457-21kworker/u16:2+flush-8:010:45:175
1007047992018,2cyclictest1429457-21kworker/u16:2+flush-8:010:40:395
1007047992018,2cyclictest1337197-21kworker/u16:0+events_unbound11:58:335
1007042992018,2cyclictest1137370-21kworker/u16:2+events_unbound08:55:144
1007042992018,2cyclictest1137370-21kworker/u16:2+events_unbound08:55:144
1007042992018,2cyclictest1030503-21kworker/u16:3+events_unbound07:48:344
1007047991918,1cyclictest1701660-21kworker/u16:2+events_unbound12:35:255
1007047991917,2cyclictest1491210-21kworker/u16:5+flush-8:010:50:245
1007047991917,2cyclictest1337197-21kworker/u16:0+flush-8:012:10:175
1007042991917,2cyclictest1030503-21kworker/u16:3+flush-8:007:30:264
1007053991813,4cyclictest1367628-21latency_hist09:59:577
100705399180,17cyclictest0-21swapper/710:25:187
100705399180,16cyclictest1274-21snmpd09:36:377
1007047991816,2cyclictest1337197-21kworker/u16:0+events_unbound10:38:355
1007047991816,2cyclictest1281598-21kworker/u16:2+events_unbound10:05:245
1007047991816,2cyclictest1281598-21kworker/u16:2+events_unbound10:00:545
1007047991816,2cyclictest1098249-21kworker/u16:4+events_unbound08:40:155
1007053991715,1cyclictest1088492-21awk07:49:577
1007053991712,4cyclictest645-21systemd-journal12:14:567
1007053991712,4cyclictest645-21systemd-journal08:09:577
1007047991715,2cyclictest987446-21kworker/u16:0+flush-8:007:24:575
1007047991715,2cyclictest987446-21kworker/u16:0+flush-8:007:24:575
1007047991715,2cyclictest1127224-21kworker/u16:1+events_unbound10:20:095
1007047991713,3cyclictest1627282-21kworker/u16:5+flush-8:012:24:565
1007042991715,2cyclictest1030503-21kworker/u16:3+events_unbound07:25:234
100705399168,7cyclictest5923-21gmain12:25:177
1007053991615,0cyclictest0-21swapper/711:10:017
100705399160,1cyclictest0-21swapper/708:50:207
1007047991614,2cyclictest1517066-21kworker/u16:1+flush-8:011:11:145
1007047991614,2cyclictest1337197-21kworker/u16:0+flush-8:010:30:495
1007047991613,2cyclictest1589266-21kworker/u16:4+flush-8:011:29:575
1007053991514,0cyclictest0-21swapper/711:34:267
1007053991512,2cyclictest0-21swapper/711:04:577
100705399150,2cyclictest1413776-21ssh10:15:187
100705399150,14cyclictest0-21swapper/707:50:197
100704799150,15cyclictest0-21swapper/509:24:305
1007042991512,2cyclictest1030503-21kworker/u16:3+events_unbound07:39:584
1007053991413,0cyclictest0-21swapper/712:06:247
1007053991413,0cyclictest0-21swapper/708:25:117
1007053991411,2cyclictest1426129-21ssh10:20:197
1007053991410,3cyclictest1274-21snmpd07:24:217
1007053991410,3cyclictest1274-21snmpd07:24:217
1007050991413,1cyclictest1030503-21kworker/u16:3+events_unbound07:54:576
1007050991413,1cyclictest0-21swapper/612:23:046
1007050991413,1cyclictest0-21swapper/611:52:296
1007050991413,1cyclictest0-21swapper/611:17:386
1007050991413,1cyclictest0-21swapper/610:34:086
1007050991413,1cyclictest0-21swapper/610:22:376
1007050991413,1cyclictest0-21swapper/609:49:026
1007050991413,1cyclictest0-21swapper/609:38:096
1007050991413,1cyclictest0-21swapper/609:18:176
1007050991412,2cyclictest1612278-21kworker/u16:1+flush-8:011:40:076
1007050991411,2cyclictest1387549-21cut10:05:166
100705099140,1cyclictest0-21swapper/610:27:406
100705099140,14cyclictest0-21swapper/612:30:576
100705099140,14cyclictest0-21swapper/612:07:186
100705099140,14cyclictest0-21swapper/611:13:336
100704799140,14cyclictest0-21swapper/508:15:175
1007042991412,2cyclictest1127224-21kworker/u16:1+events_unbound08:10:214
100705399139,3cyclictest6398-21gmain12:35:217
100705399139,3cyclictest1274-21snmpd10:55:037
100705399139,3cyclictest1274-21snmpd10:55:037
100705399139,3cyclictest1274-21snmpd07:28:587
1007053991311,1cyclictest1392345-21awk10:09:567
100705399130,3cyclictest1377624-21ssh10:00:527
100705399130,12cyclictest1268729-21turbostat09:19:577
100705399130,11cyclictest1274-21snmpd09:20:097
1007050991312,1cyclictest0-21swapper/612:14:436
1007050991312,1cyclictest0-21swapper/610:55:156
1007050991312,1cyclictest0-21swapper/610:55:156
1007050991312,1cyclictest0-21swapper/610:13:006
1007050991312,1cyclictest0-21swapper/607:35:486
1007050991311,2cyclictest987446-21kworker/u16:0+flush-8:007:25:226
1007050991311,2cyclictest1701660-21kworker/u16:2+events_unbound12:25:106
1007050991310,2cyclictest0-21swapper/611:20:116
100705099130,13cyclictest0-21swapper/608:42:586
100705099130,0cyclictest0-21swapper/610:40:356
100705099130,0cyclictest0-21swapper/610:18:036
1007047991312,1cyclictest0-21swapper/509:42:095
1007047991312,1cyclictest0-21swapper/509:04:575
1007047991311,2cyclictest1517066-21kworker/u16:1+events_unbound11:17:075
1007047991311,2cyclictest1127224-21kworker/u16:1+flush-8:008:29:575
100704799130,13cyclictest0-21swapper/511:05:245
100704799130,13cyclictest0-21swapper/509:31:165
100704799130,13cyclictest0-21swapper/507:46:075
100704299130,1cyclictest0-21swapper/409:03:164
100705399129,2cyclictest1274-21snmpd12:33:217
100705399129,2cyclictest1274-21snmpd10:33:217
100705399129,2cyclictest1274-21snmpd08:01:197
100705399128,3cyclictest1274-21snmpd09:05:187
100705399128,3cyclictest1274-21snmpd07:13:007
100705399125,6cyclictest6050-21gmain08:20:137
1007053991211,0cyclictest0-21swapper/712:22:107
100705399120,2cyclictest1479196-21ssh10:45:047
100705399120,2cyclictest1107178-21switchtime07:55:257
100705399120,1cyclictest1292539-21rm09:28:187
100705399120,11cyclictest1711518-21ssh12:16:107
100705399120,11cyclictest1626852-21ssh11:44:217
100705399120,11cyclictest1274-21snmpd11:22:197
100705399120,10cyclictest1274-21snmpd11:25:497
100705099128,3cyclictest1294805-21cat09:30:146
100705099126,5cyclictest1590982-21pool-gnome-shel11:30:156
1007050991211,1cyclictest0-21swapper/610:02:076
1007050991211,1cyclictest0-21swapper/609:02:226
1007050991211,1cyclictest0-21swapper/608:56:226
1007050991211,1cyclictest0-21swapper/608:56:226
100705099120,12cyclictest0-21swapper/608:36:316
100704799129,2cyclictest1337197-21kworker/u16:0+flush-8:012:05:075
1007047991211,1cyclictest0-21swapper/509:45:475
1007047991211,1cyclictest0-21swapper/509:14:055
1007047991210,2cyclictest1127224-21kworker/u16:1+events_unbound10:10:075
1007047991210,2cyclictest1127224-21kworker/u16:1+events_unbound08:50:235
1007042991211,1cyclictest0-21swapper/407:54:134
1007042991210,2cyclictest1030503-21kworker/u16:3+flush-8:008:05:584
100704299120,1cyclictest0-21swapper/409:07:504
100705399118,2cyclictest1274-21snmpd09:44:587
100705399117,3cyclictest5711-21gmain07:15:187
100705399117,3cyclictest1274-21snmpd11:53:267
100705399117,3cyclictest1274-21snmpd09:41:527
100705399115,4cyclictest1661123-21rm11:55:207
100705399110,2cyclictest1302671-21ssh09:30:247
100705399110,1cyclictest1476328-21ssh10:40:427
100705399110,10cyclictest1274-21snmpd11:15:047
100705399110,10cyclictest1274-21snmpd07:32:257
100705099117,3cyclictest1702345-21tune2fs12:15:096
1007050991110,1cyclictest0-21swapper/612:38:506
1007050991110,1cyclictest0-21swapper/609:58:586
1007050991110,1cyclictest0-21swapper/609:24:366
1007050991110,1cyclictest0-21swapper/608:49:556
1007050991110,1cyclictest0-21swapper/608:10:306
100705099110,2cyclictest1034732-21kthreadcore07:20:156
100705099110,2cyclictest1034732-21kthreadcore07:20:156
100705099110,10cyclictest1532729-21cut11:05:146
100705099110,10cyclictest1326343-21cut09:40:176
100705099110,0cyclictest0-21swapper/608:30:316
100704799119,2cyclictest987446-21kworker/u16:0+flush-8:007:15:025
1007047991110,1cyclictest0-21swapper/512:34:005
1007047991110,1cyclictest0-21swapper/510:15:165
100704299119,2cyclictest1137370-21kworker/u16:2+events_unbound08:42:584
100704299119,2cyclictest1098249-21kworker/u16:4+events_unbound08:30:154
1007042991110,1cyclictest0-21swapper/408:50:494
1007042991110,1cyclictest0-21swapper/408:38:504
1007042991110,1cyclictest0-21swapper/407:38:464
100705399107,2cyclictest1274-21snmpd12:01:537
100705399107,2cyclictest1274-21snmpd11:38:447
100705399107,2cyclictest1274-21snmpd08:33:387
100705399107,2cyclictest0-21swapper/708:19:577
100705399106,3cyclictest1274-21snmpd08:43:087
100705399106,3cyclictest1274-21snmpd07:37:557
100705399104,4cyclictest1196932-21sed08:45:127
100705399104,4cyclictest1177567-21sed08:35:137
100705399100,9cyclictest1343344-21ssh09:50:017
100705399100,9cyclictest1274-21snmpd08:55:007
100705399100,9cyclictest1274-21snmpd08:55:007
100705399100,9cyclictest1274-21snmpd07:41:227
100705099109,1cyclictest0-21swapper/611:04:246
100705099109,1cyclictest0-21swapper/609:06:566
100705099108,2cyclictest86-21ksoftirqd/611:55:126
100705099106,3cyclictest1491734-21cpuspeed_turbos10:50:096
100705099106,3cyclictest1455140-21tune2fs10:35:116
100705099106,3cyclictest1282367-21/usr/sbin/munin09:25:106
100705099106,3cyclictest1152709-21kthreadcore08:20:166
100705099106,3cyclictest1139469-21kthreadcore08:15:136
100705099106,3cyclictest1021597-21cat07:15:116
100705099100,9cyclictest1672812-21kthreadcore12:00:176
100705099100,9cyclictest1352013-21ntpq09:50:246
100705099100,9cyclictest1213908-21ntpq08:50:196
100705099100,9cyclictest0-21swapper/607:30:216
100705099100,3cyclictest1486297-21kthreadcore10:45:166
100705099100,3cyclictest1100425-21kthreadcore07:55:156
100704799108,2cyclictest1030503-21kworker/u16:3+flush-8:007:40:545
100704299107,2cyclictest1030503-21kworker/u16:3+events_unbound07:55:034
10070509996,2cyclictest1628337-21tune2fs11:45:096
10070509996,2cyclictest1116574-21sed08:00:176
10070509990,8cyclictest1607206-21kthreadcore11:35:156
10070509990,8cyclictest1583341-21kthreadcore11:25:156
10070509990,8cyclictest1247364-21grep09:10:146
10070509990,8cyclictest1012048-21kthreadcore07:10:166
10070509990,2cyclictest1123338-21kthreadcore08:05:176
10070479997,2cyclictest987446-21kworker/u16:0+flush-8:007:10:155
10070479997,2cyclictest1224250-21kworker/u16:4+events_unbound08:59:565
10070479997,2cyclictest1224250-21kworker/u16:4+events_unbound08:59:565
10070479997,2cyclictest1137370-21kworker/u16:2+flush-8:008:30:125
10070479997,1cyclictest0-21swapper/511:20:135
10070479995,3cyclictest1059651-21cpu07:35:105
10070479994,5cyclictest0-21swapper/507:58:345
10070429997,2cyclictest1030503-21kworker/u16:3+events_unbound07:23:574
10070429997,2cyclictest1030503-21kworker/u16:3+events_unbound07:23:574
10070429995,3cyclictest1109032-21tune2fs08:00:104
10070509985,2cyclictest1157161-21grep08:25:096
10070509980,3cyclictest1069375-21/usr/sbin/munin07:40:116
10070509980,2cyclictest1079213-21cat07:45:076
10070479986,2cyclictest1701660-21kworker/u16:2+flush-8:012:25:065
10070479986,2cyclictest1098249-21kworker/u16:4+flush-8:008:10:555
10070479986,2cyclictest1030503-21kworker/u16:3+flush-8:008:04:565
10070479983,4cyclictest1119168-21cut08:05:145
10070429986,1cyclictest0-21swapper/408:15:134
10070479973,3cyclictest1234866-21grep09:05:095
10070479973,3cyclictest1178188-21cut08:35:145
10070479973,3cyclictest1148107-21iptables08:20:135
10070479972,4cyclictest1199856-21kthreadcore08:45:145
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional