You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 03:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Nov 22, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208696427363,7sleep50-21swapper/503:21:135
208710625747,7sleep40-21swapper/403:23:134
2087492995651,4cyclictest2606320-21latency_hist07:38:337
208749299520,50cyclictest2097451-21latency_hist03:28:347
2087492995146,4cyclictest2616417-21latency_hist07:43:337
208708925016,30sleep70-21swapper/703:23:007
24586772490,0sleep72458678-21kthreadcore06:23:517
208687724939,7sleep60-21swapper/603:20:026
2087479994037,2cyclictest2181760-21kworker/u16:3+events_unbound04:53:484
2087480993937,2cyclictest2394231-21kworker/u16:2+flush-8:006:19:005
2087488993735,2cyclictest2333693-21kworker/u16:4+flush-8:005:49:066
2087480993735,2cyclictest2576135-21kworker/u16:1+events_unbound07:56:305
2087480993735,2cyclictest2476656-21kworker/u16:3+events_unbound06:37:075
2087480993532,2cyclictest2555675-21kworker/u16:0+events_unbound07:13:365
2087480993531,3cyclictest2697424-21kworker/u16:2+flush-8:008:26:115
2087492993432,1cyclictest0-21swapper/708:13:587
2087480993432,2cyclictest2262980-21kworker/u16:4+flush-8:004:54:015
2087479993431,2cyclictest2576135-21kworker/u16:1+flush-8:007:25:434
2087479993431,2cyclictest2181760-21kworker/u16:3+flush-8:004:23:474
2087488993331,2cyclictest2333693-21kworker/u16:4+events_unbound06:33:586
2087480993331,2cyclictest2333693-21kworker/u16:4+events_unbound05:29:125
2087480993331,2cyclictest2262979-21kworker/u16:1+flush-8:005:20:435
2087480993331,2cyclictest2202093-21kworker/u16:0+flush-8:004:39:435
208749299320,31cyclictest589235-21systemd-journal03:47:067
2087480993230,2cyclictest2394231-21kworker/u16:2+events_unbound06:28:435
2087480993229,2cyclictest2636673-21kworker/u16:4+events_unbound08:08:355
2087480993129,2cyclictest2717227-21kworker/u16:3+flush-8:008:45:515
2087480993129,2cyclictest2545544-21kworker/u16:2+events_unbound07:05:475
2087480993129,2cyclictest2171694-21kworker/u16:2+flush-8:004:14:345
2087480993129,2cyclictest2076962-21kworker/u16:1+flush-8:003:36:065
2087480993128,2cyclictest2565786-21kworker/u16:2+flush-8:007:33:585
2087492993026,2cyclictest2264534-21kthreadcore04:48:537
2087488993028,2cyclictest2394231-21kworker/u16:2+flush-8:006:28:576
2087480993028,2cyclictest2648296-21kworker/u16:0+events_unbound08:39:515
2087480993028,2cyclictest2626299-21kworker/u16:2+events_unbound08:07:205
2087480993028,2cyclictest2616239-21kworker/u16:0+events_unbound07:42:205
2087480993028,2cyclictest2576135-21kworker/u16:1+flush-8:007:32:595
2087480993028,2cyclictest2576135-21kworker/u16:1+events_unbound07:50:425
2087480993028,2cyclictest2576135-21kworker/u16:1+events_unbound07:46:205
2087480993028,2cyclictest2332738-21kworker/u16:2+events_unbound05:27:055
2087480993028,2cyclictest2111324-21kworker/u16:3+flush-8:003:42:365
2087488992927,2cyclictest2576135-21kworker/u16:1+events_unbound07:48:276
2087488992926,2cyclictest2333693-21kworker/u16:4+events_unbound05:33:366
2087480992927,2cyclictest2717227-21kworker/u16:3+events_unbound08:36:125
2087480992927,2cyclictest2636673-21kworker/u16:4+flush-8:008:00:155
2087480992927,2cyclictest2333693-21kworker/u16:4+events_unbound05:46:035
2087480992927,2cyclictest2296131-21kworker/u16:0+flush-8:005:15:315
2087479992926,3cyclictest2394231-21kworker/u16:2+flush-8:006:48:574
2087492992823,4cyclictest2293234-21latency_hist05:03:337
2087488992826,2cyclictest2648296-21kworker/u16:0+flush-8:008:23:476
2087488992826,2cyclictest2545544-21kworker/u16:2+events_unbound07:08:476
2087488992826,2cyclictest2474805-21kworker/u16:0+flush-8:006:43:486
2087480992826,2cyclictest2494943-21kworker/u16:1+events_unbound06:40:035
2087480992826,2cyclictest2476656-21kworker/u16:3+events_unbound07:09:435
2087480992826,2cyclictest2303517-21kworker/u16:2+events_unbound05:10:235
2087480992826,2cyclictest2066803-21kworker/u16:2+events_unbound03:26:355
2087479992825,3cyclictest2414462-21kworker/u16:1+flush-8:006:25:424
2087492992726,0cyclictest0-21swapper/705:08:487
2087492992726,0cyclictest0-21swapper/704:53:467
2087480992725,2cyclictest2576135-21kworker/u16:1+events_unbound07:27:405
2087480992725,2cyclictest2394231-21kworker/u16:2+events_unbound06:02:045
2087480992725,2cyclictest2262979-21kworker/u16:1+events_unbound05:39:245
2087480992725,2cyclictest2131625-21kworker/u16:0+flush-8:003:49:355
2087480992725,2cyclictest1270234-21kworker/u16:0+flush-8:003:29:465
2087492992625,0cyclictest0-21swapper/705:26:247
2087488992624,2cyclictest2353695-21kworker/u16:0+events_unbound05:53:506
2087480992624,2cyclictest2687002-21kworker/u16:6+flush-8:008:18:235
2087480992624,2cyclictest2648296-21kworker/u16:0+events_unbound08:32:215
2087480992624,2cyclictest2476656-21kworker/u16:3+flush-8:007:02:475
2087480992624,2cyclictest2476656-21kworker/u16:3+events_unbound06:56:205
2087480992624,2cyclictest2394231-21kworker/u16:2+flush-8:005:56:435
2087480992624,2cyclictest2353695-21kworker/u16:0+events_unbound06:17:405
2087480992624,2cyclictest2353695-21kworker/u16:0+events_unbound06:04:315
2087480992624,2cyclictest2332738-21kworker/u16:2+events_unbound05:37:315
2087480992624,2cyclictest2202093-21kworker/u16:0+flush-8:004:29:345
2087480992624,2cyclictest2181760-21kworker/u16:3+flush-8:004:22:065
2087480992624,2cyclictest2181760-21kworker/u16:3+events_unbound04:59:205
2087480992623,2cyclictest2141759-21kworker/u16:4+flush-8:003:53:435
2087479992624,2cyclictest2303517-21kworker/u16:2+flush-8:005:08:574
2087492992524,0cyclictest0-21swapper/707:32:557
2087488992523,2cyclictest2353695-21kworker/u16:0+flush-8:005:43:496
2087480992523,2cyclictest2474805-21kworker/u16:0+flush-8:006:47:565
2087480992523,2cyclictest2202093-21kworker/u16:0+flush-8:004:35:445
2087480992523,2cyclictest2181760-21kworker/u16:3+flush-8:004:12:435
2087480992523,2cyclictest2181760-21kworker/u16:3+events_unbound04:46:195
2087480992523,2cyclictest2171694-21kworker/u16:2+flush-8:004:05:285
2087492992423,0cyclictest0-21swapper/706:52:597
2087492992421,2cyclictest589235-21systemd-journal03:38:337
2087488992422,2cyclictest2636673-21kworker/u16:4+flush-8:007:55:106
2087488992422,2cyclictest2191965-21kworker/u16:1+flush-8:004:12:116
2087480992422,2cyclictest2476656-21kworker/u16:3+events_unbound07:20:545
2087480992422,2cyclictest2262979-21kworker/u16:1+events_unbound04:50:255
2087480992422,2cyclictest2181760-21kworker/u16:3+flush-8:004:24:125
2087479992421,2cyclictest2131625-21kworker/u16:0+flush-8:003:55:174
2087492992322,0cyclictest0-21swapper/704:23:037
2087488992321,2cyclictest2676963-21kworker/u16:1+flush-8:008:46:156
2087488992321,2cyclictest2545544-21kworker/u16:2+flush-8:007:07:036
2087488992321,2cyclictest2494943-21kworker/u16:1+flush-8:006:53:586
2087488992321,2cyclictest2474805-21kworker/u16:0+events_unbound06:38:476
2087488992321,2cyclictest2333693-21kworker/u16:4+events_unbound05:24:316
2087488992321,2cyclictest2296131-21kworker/u16:0+flush-8:005:03:566
2087488992321,2cyclictest2181760-21kworker/u16:3+events_unbound04:24:596
2087488992321,2cyclictest2076962-21kworker/u16:1+flush-8:003:53:126
2087480992321,2cyclictest2474805-21kworker/u16:0+events_unbound06:49:205
2087480992321,2cyclictest2296131-21kworker/u16:0+events_unbound05:07:025
2087479992321,2cyclictest2171694-21kworker/u16:2+events_unbound04:18:594
2087492992221,0cyclictest0-21swapper/708:18:337
2087492992221,0cyclictest0-21swapper/704:18:127
2087492992217,4cyclictest2333655-21latency_hist05:23:337
2087492992216,5cyclictest2666844-21latency_hist08:08:327
2087488992220,2cyclictest2648296-21kworker/u16:0+flush-8:008:28:596
2087488992220,2cyclictest2353695-21kworker/u16:0+flush-8:006:17:116
2087488992220,2cyclictest2333693-21kworker/u16:4+flush-8:006:03:596
2087488992220,2cyclictest2181760-21kworker/u16:3+events_unbound04:34:556
2087488992220,2cyclictest2171694-21kworker/u16:2+events_unbound04:20:436
2087488992218,3cyclictest2333693-21kworker/u16:4+flush-8:005:28:596
2087480992220,2cyclictest2648296-21kworker/u16:0+flush-8:008:20:315
2087480992220,2cyclictest2333693-21kworker/u16:4+events_unbound05:52:045
2087480992220,2cyclictest2131625-21kworker/u16:0+flush-8:003:44:085
2087492992116,4cyclictest589235-21systemd-journal07:13:067
2087492992115,5cyclictest2363925-21latency_hist05:38:337
2087488992119,2cyclictest2648296-21kworker/u16:0+events_unbound08:18:506
2087488992119,2cyclictest2636673-21kworker/u16:4+events_unbound07:59:316
2087488992119,2cyclictest2494943-21kworker/u16:1+flush-8:006:49:036
2087488992119,2cyclictest2476656-21kworker/u16:3+flush-8:006:58:496
2087488992119,2cyclictest2394231-21kworker/u16:2+events_unbound06:10:196
2087488992119,2cyclictest2303517-21kworker/u16:2+events_unbound05:10:546
2087488992119,2cyclictest2181760-21kworker/u16:3+flush-8:005:18:586
2087488992119,2cyclictest2076962-21kworker/u16:1+events_unbound03:59:286
2087488992119,2cyclictest2066803-21kworker/u16:2+flush-8:003:38:486
2087488992119,2cyclictest2066803-21kworker/u16:2+events_unbound03:27:316
2087480992119,2cyclictest2757576-21kworker/u16:0+events_unbound08:53:265
2087480992119,2cyclictest2414462-21kworker/u16:1+flush-8:006:25:315
2087480992119,2cyclictest2141759-21kworker/u16:4+events_unbound04:01:085
2087479992119,2cyclictest2394231-21kworker/u16:2+events_unbound06:29:024
2087479992119,2cyclictest2181760-21kworker/u16:3+flush-8:004:08:574
2087479992118,2cyclictest2606076-21kworker/u16:4+flush-8:007:40:154
2087479992117,3cyclictest2332738-21kworker/u16:2+flush-8:005:28:584
2087492992020,0cyclictest0-21swapper/703:40:287
2087492992019,0cyclictest0-21swapper/707:57:507
2087492992019,0cyclictest0-21swapper/706:41:547
2087492992019,0cyclictest0-21swapper/705:51:537
2087488992018,2cyclictest2648296-21kworker/u16:0+events_unbound08:10:596
2087488992018,2cyclictest2626299-21kworker/u16:2+flush-8:007:52:486
2087488992018,2cyclictest2576135-21kworker/u16:1+events_unbound07:41:546
2087488992018,2cyclictest2494943-21kworker/u16:1+events_unbound07:16:106
2087488992018,2cyclictest2262979-21kworker/u16:1+events_unbound05:39:226
2087488992018,2cyclictest2141759-21kworker/u16:4+flush-8:003:54:596
2087488992018,2cyclictest1270234-21kworker/u16:0+events_unbound03:30:046
2087488992017,2cyclictest2066803-21kworker/u16:2+events_unbound03:33:396
2087480992018,2cyclictest2353695-21kworker/u16:0+events_unbound06:09:365
23890342190,1sleep40-21swapper/405:48:544
2087492991918,0cyclictest0-21swapper/703:53:517
2087492991918,0cyclictest0-21swapper/703:28:547
2087492991917,1cyclictest0-21swapper/704:38:497
2087492991913,5cyclictest2242701-21latency_hist04:38:337
2087488991917,2cyclictest2676963-21kworker/u16:1+flush-8:008:34:176
2087488991917,2cyclictest2476656-21kworker/u16:3+flush-8:007:21:076
2087488991917,2cyclictest2333693-21kworker/u16:4+events_unbound06:00:466
2087488991917,2cyclictest2296131-21kworker/u16:0+events_unbound05:14:316
2087488991917,2cyclictest2202093-21kworker/u16:0+flush-8:004:28:566
2087488991917,2cyclictest2181760-21kworker/u16:3+events_unbound04:41:226
2087488991917,2cyclictest2111324-21kworker/u16:3+flush-8:003:43:496
2087479991917,2cyclictest2576135-21kworker/u16:1+events_unbound07:54:034
2087479991915,3cyclictest2676963-21kworker/u16:1+flush-8:008:43:474
2087479991915,3cyclictest2181760-21kworker/u16:3+flush-8:004:38:364
2087492991818,0cyclictest0-21swapper/707:47:097
2087492991817,0cyclictest0-21swapper/705:44:047
2087492991817,0cyclictest0-21swapper/704:04:107
2087492991812,5cyclictest589235-21systemd-journal05:59:067
2087488991816,2cyclictest2686765-21kworker/u16:5+events_unbound08:16:376
2087488991816,2cyclictest2676963-21kworker/u16:1+events_unbound08:40:406
2087488991816,2cyclictest2576135-21kworker/u16:1+events_unbound07:33:056
2087488991816,2cyclictest2576135-21kworker/u16:1+events_unbound07:26:386
2087488991816,2cyclictest2565786-21kworker/u16:2+flush-8:007:34:016
2087488991816,2cyclictest2414462-21kworker/u16:1+events_unbound06:24:506
2087488991816,2cyclictest2414462-21kworker/u16:1+events_unbound06:22:266
2087488991816,2cyclictest2171694-21kworker/u16:2+flush-8:004:18:296
2087488991815,2cyclictest2636673-21kworker/u16:4+flush-8:008:03:576
2087479991816,2cyclictest2333693-21kworker/u16:4+flush-8:005:48:324
2087479991816,2cyclictest2262979-21kworker/u16:1+events_unbound05:33:484
2087492991716,0cyclictest0-21swapper/707:23:057
2087492991711,5cyclictest2535700-21latency_hist07:03:337
2087488991715,2cyclictest2181760-21kworker/u16:3+events_unbound04:59:366
2087488991715,2cyclictest2181760-21kworker/u16:3+events_unbound04:49:386
2087488991715,2cyclictest2181760-21kworker/u16:3+events_unbound04:44:316
2087479991715,2cyclictest2353695-21kworker/u16:0+flush-8:006:08:504
2087479991714,2cyclictest2141759-21kworker/u16:4+events_unbound04:03:484
2087479991713,3cyclictest2616239-21kworker/u16:0+flush-8:007:44:044
2087492991615,0cyclictest0-21swapper/706:53:367
2087492991615,0cyclictest0-21swapper/705:39:147
2087492991614,1cyclictest0-21swapper/707:58:507
2087492991613,2cyclictest4175659-21snmpd04:26:457
2087492991610,5cyclictest2757890-21latency_hist08:53:327
208749299160,15cyclictest4175659-21snmpd06:47:317
208749299160,14cyclictest0-21swapper/708:08:547
2087488991614,2cyclictest2757576-21kworker/u16:0+events_unbound08:51:056
2087488991614,2cyclictest2262979-21kworker/u16:1+flush-8:004:58:216
2087488991614,2cyclictest2171694-21kworker/u16:2+flush-8:004:06:246
2087479991614,2cyclictest2666521-21kworker/u16:3+events_unbound08:13:594
2087479991614,2cyclictest2555675-21kworker/u16:0+events_unbound07:18:474
2087479991614,2cyclictest2476656-21kworker/u16:3+flush-8:006:53:484
2087479991614,1cyclictest0-21swapper/408:18:504
208749299157,7cyclictest27904-21gmain07:04:037
2087492991514,0cyclictest0-21swapper/707:48:587
2087492991514,0cyclictest0-21swapper/707:24:237
2087492991514,0cyclictest0-21swapper/706:20:547
2087492991514,0cyclictest0-21swapper/705:29:037
2087492991512,2cyclictest0-21swapper/706:33:557
2087492991510,4cyclictest2232604-21latency_hist04:33:337
2087479991513,2cyclictest2676963-21kworker/u16:1+events_unbound08:48:584
208749299148,5cyclictest2434598-21latency_hist06:13:337
208749299144,8cyclictest0-21swapper/703:58:457
2087492991414,0cyclictest0-21swapper/705:07:437
2087492991414,0cyclictest0-21swapper/703:53:277
2087492991413,0cyclictest0-21swapper/708:42:047
2087479991412,2cyclictest2576135-21kworker/u16:1+flush-8:007:28:454
2087479991412,2cyclictest2394231-21kworker/u16:2+flush-8:006:13:584
260604321310,2sleep42565786-21kworker/u16:2+events_unbound07:34:564
2087492991313,0cyclictest0-21swapper/708:44:037
2087492991313,0cyclictest0-21swapper/705:54:257
2087492991312,0cyclictest0-21swapper/704:44:307
2087492991311,1cyclictest0-21swapper/708:23:527
208747999139,3cyclictest2476656-21kworker/u16:3+flush-8:006:58:534
2087479991311,2cyclictest2636673-21kworker/u16:4+flush-8:007:58:574
2087479991311,2cyclictest2332738-21kworker/u16:2+flush-8:005:38:484
2087479991311,2cyclictest2181760-21kworker/u16:3+events_unbound04:34:044
2087479991311,2cyclictest2171694-21kworker/u16:2+flush-8:004:43:574
2087479991310,2cyclictest2413416-21needreboot05:58:544
208749299129,3cyclictest96-21ksoftirqd/706:04:027
208749299128,3cyclictest4175659-21snmpd06:14:277
2087492991212,0cyclictest0-21swapper/708:34:507
2087492991212,0cyclictest0-21swapper/706:31:047
2087492991211,0cyclictest0-21swapper/705:14:147
2087492991210,1cyclictest0-21swapper/707:14:017
2087492991210,1cyclictest0-21swapper/704:08:537
208747999128,3cyclictest2636673-21kworker/u16:4+flush-8:008:03:584
208747999120,1cyclictest0-21swapper/408:38:144
208747999120,1cyclictest0-21swapper/405:55:424
208747999120,1cyclictest0-21swapper/405:03:034
208747999120,1cyclictest0-21swapper/403:25:284
208749299111,9cyclictest2087469-21cyclictest08:29:017
2087479991110,1cyclictest0-21swapper/405:20:044
2087479991110,1cyclictest0-21swapper/405:15:114
2087479991110,1cyclictest0-21swapper/404:32:284
208747999110,0cyclictest0-21swapper/403:30:024
208747999109,1cyclictest0-21swapper/404:17:104
208747999109,1cyclictest0-21swapper/404:00:564
208747999108,2cyclictest2494943-21kworker/u16:1+events_unbound07:04:034
208747999106,3cyclictest2486370-21cat06:38:484
20874799998,1cyclictest0-21swapper/406:21:144
20874799998,1cyclictest0-21swapper/406:04:504
20874799998,1cyclictest0-21swapper/405:25:454
20874799995,3cyclictest2112609-21cat03:33:504
20874799985,2cyclictest0-21swapper/403:43:524
20874799984,3cyclictest2703089-21cut08:23:524
20874799984,3cyclictest2627644-21cat07:48:484
20874799984,3cyclictest2546248-21cat07:08:454
20874799984,3cyclictest2294131-21/usr/sbin/munin05:03:454
20874799983,4cyclictest2734389-21tr08:38:514
20874799983,4cyclictest2714609-21grep08:28:544
20874799983,4cyclictest2496752-21cut06:43:494
20874799983,4cyclictest2263414-21cat04:48:484
20874799975,1cyclictest0-21swapper/408:08:474
20874799975,1cyclictest0-21swapper/407:13:494
20874799975,1cyclictest0-21swapper/406:33:444
20874799972,4cyclictest2126301-21kthreadcore03:38:554
20874799970,2cyclictest0-21swapper/403:48:514
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional