You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 11:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Nov 28, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
78479125832,8sleep50-21swapper/503:19:135
78479125832,8sleep50-21swapper/503:19:135
78507925622,30sleep70-21swapper/703:23:087
78507925622,30sleep70-21swapper/703:23:087
78480525645,8sleep60-21swapper/603:19:226
78480525645,8sleep60-21swapper/603:19:226
78501725545,7sleep40-21swapper/403:22:174
78501725545,7sleep40-21swapper/403:22:174
785409994947,2cyclictest849614-21kworker/u16:1+flush-8:004:28:094
785409994946,2cyclictest1262832-21kworker/u16:2+flush-8:007:16:464
785409994744,2cyclictest1061298-21kworker/u16:1+flush-8:006:03:094
785412994541,3cyclictest859696-21kworker/u16:2+flush-8:004:03:096
785409994442,2cyclictest1414022-21kworker/u16:2+events_unbound08:38:094
785419994338,4cyclictest940421-21latency_hist04:38:097
785410994340,2cyclictest1172018-21kworker/u16:2+flush-8:006:38:095
785419994035,4cyclictest829553-21latency_hist03:43:097
785419994035,4cyclictest1242914-21latency_hist07:08:097
785412994037,2cyclictest1121562-21kworker/u16:0+flush-8:007:13:096
785409993938,1cyclictest754893-21kworker/u16:0+events_unbound03:28:104
785412993835,2cyclictest1383037-21kworker/u16:4+flush-8:008:18:086
785409993735,2cyclictest859696-21kworker/u16:2+events_unbound04:18:104
785409993733,3cyclictest849614-21kworker/u16:1+flush-8:004:38:304
785412993634,2cyclictest889952-21kworker/u16:4+events_unbound05:05:476
785412993634,2cyclictest1202464-21kworker/u16:1+events_unbound07:38:086
785409993634,2cyclictest1212582-21kworker/u16:3+events_unbound07:58:334
785419993530,4cyclictest1021061-21latency_hist05:18:097
785419993429,4cyclictest879948-21latency_hist04:08:107
785419993429,4cyclictest1373817-21latency_hist08:13:087
785419993429,4cyclictest1131987-21latency_hist06:13:097
785412993432,2cyclictest1026601-21kworker/u16:3+flush-8:005:25:466
785412993432,2cyclictest1026601-21kworker/u16:3+flush-8:005:25:466
785409993432,2cyclictest1131888-21kworker/u16:3+events_unbound06:13:214
785412993331,2cyclictest1414022-21kworker/u16:2+flush-8:008:41:456
785409993331,2cyclictest940096-21kworker/u16:0+events_unbound04:48:304
785409993330,2cyclictest1020959-21kworker/u16:1+flush-8:005:28:304
785412993229,3cyclictest849614-21kworker/u16:1+flush-8:003:53:356
785412993129,2cyclictest1373788-21kworker/u16:2+events_unbound08:20:466
785412993129,2cyclictest1051003-21kworker/u16:0+flush-8:005:39:466
785419993024,5cyclictest889979-21latency_hist04:13:107
785412993028,2cyclictest1403857-21kworker/u16:0+events_unbound08:27:466
785412993028,2cyclictest1403857-21kworker/u16:0+events_unbound08:27:466
785410993028,2cyclictest889952-21kworker/u16:4+flush-8:004:23:105
785410993028,2cyclictest1051110-21kworker/u16:2+flush-8:005:53:255
785412992927,2cyclictest1091868-21kworker/u16:4+flush-8:005:53:456
785409992925,3cyclictest829242-21kworker/u16:0+events_unbound03:48:284
785412992826,2cyclictest754893-21kworker/u16:0+events_unbound03:23:396
785419992726,0cyclictest0-21swapper/707:43:347
78541999270,25cyclictest589235-21systemd-journal05:13:047
785409992724,2cyclictest1061298-21kworker/u16:1+flush-8:006:03:264
785419992621,4cyclictest1000874-21latency_hist05:08:107
78541999260,24cyclictest1303331-21latency_hist07:38:097
785412992624,2cyclictest1424085-21kworker/u16:1+events_unbound08:50:226
785412992623,2cyclictest795189-21kworker/u16:1+events_unbound03:38:226
785409992624,2cyclictest849614-21kworker/u16:1+flush-8:003:58:374
785409992624,2cyclictest1061298-21kworker/u16:1+events_unbound05:53:254
11824432260,1chrt1182445-21date06:38:097
78541999250,23cyclictest589235-21systemd-journal07:43:097
78541999250,23cyclictest589235-21systemd-journal07:43:097
785412992523,2cyclictest889952-21kworker/u16:4+events_unbound05:35:596
785412992523,2cyclictest849614-21kworker/u16:1+flush-8:004:35:466
785412992523,2cyclictest849614-21kworker/u16:1+events_unbound04:25:446
785412992523,2cyclictest1172018-21kworker/u16:2+events_unbound06:47:466
785412992522,2cyclictest1212582-21kworker/u16:3+flush-8:007:43:096
785412992522,2cyclictest1212582-21kworker/u16:3+flush-8:007:43:096
785410992523,2cyclictest1172018-21kworker/u16:2+events_unbound06:43:345
785419992423,0cyclictest0-21swapper/706:23:347
785419992419,4cyclictest795379-21latency_hist03:28:107
785412992421,2cyclictest940096-21kworker/u16:0+flush-8:004:53:106
785410992422,2cyclictest1433997-21kworker/u16:3+events_unbound08:48:235
785410992422,2cyclictest1091868-21kworker/u16:4+flush-8:006:08:245
785410992421,2cyclictest1091868-21kworker/u16:4+events_unbound06:23:245
78541999230,21cyclictest1263076-21latency_hist07:18:097
785412992320,2cyclictest1202464-21kworker/u16:1+events_unbound06:48:256
785410992321,2cyclictest1272933-21kworker/u16:0+events_unbound07:23:345
785410992320,2cyclictest1121562-21kworker/u16:0+flush-8:006:53:375
785410992320,2cyclictest1121562-21kworker/u16:0+flush-8:006:53:375
785409992321,2cyclictest1262832-21kworker/u16:2+flush-8:007:23:394
785419992217,4cyclictest1333513-21latency_hist07:53:097
785419992217,4cyclictest1051331-21latency_hist05:33:097
785419992216,5cyclictest1343588-21latency_hist07:58:097
785412992220,2cyclictest849614-21kworker/u16:1+events_unbound04:38:326
785412992220,2cyclictest795189-21kworker/u16:1+events_unbound03:35:346
785412992220,2cyclictest1403857-21kworker/u16:0+flush-8:008:28:456
785412992220,2cyclictest1383037-21kworker/u16:4+events_unbound08:33:286
785412992220,2cyclictest1212582-21kworker/u16:3+events_unbound06:53:286
785412992220,2cyclictest1212582-21kworker/u16:3+events_unbound06:53:286
785412992220,2cyclictest1121562-21kworker/u16:0+events_unbound06:05:476
785412992220,2cyclictest1051110-21kworker/u16:2+events_unbound06:02:476
785412992219,2cyclictest1051003-21kworker/u16:0+flush-8:005:43:356
785409992220,2cyclictest1272933-21kworker/u16:0+events_unbound07:33:304
785409992219,2cyclictest1061298-21kworker/u16:1+flush-8:006:08:294
785409992218,3cyclictest1010797-21kworker/u16:0+events_unbound05:18:244
785409992218,3cyclictest1010797-21kworker/u16:0+events_unbound05:18:244
785412992119,2cyclictest1202464-21kworker/u16:1+events_unbound07:48:316
785412992119,2cyclictest1000572-21kworker/u16:3+events_unbound05:08:326
785409992119,2cyclictest3494458-21kworker/u16:3+flush-8:003:33:404
785409992118,3cyclictest1172018-21kworker/u16:2+flush-8:006:48:164
78541999200,19cyclictest930373-21munin-run04:33:097
78541999200,18cyclictest1394002-21latency_hist08:23:097
785412992018,2cyclictest1091868-21kworker/u16:4+flush-8:006:29:466
785412992018,2cyclictest1091868-21kworker/u16:4+events_unbound06:18:296
785412992017,2cyclictest889693-21kworker/u16:3+flush-8:004:28:266
785409992018,2cyclictest849614-21kworker/u16:1+flush-8:004:43:264
785409992018,2cyclictest1121562-21kworker/u16:0+flush-8:006:53:354
785409992018,2cyclictest1121562-21kworker/u16:0+flush-8:006:53:354
785409992018,2cyclictest1091868-21kworker/u16:4+flush-8:006:18:294
785409992018,2cyclictest1026601-21kworker/u16:3+events_unbound05:23:344
785409992018,2cyclictest1026601-21kworker/u16:3+events_unbound05:23:344
785419991918,0cyclictest0-21swapper/707:18:347
785419991918,0cyclictest0-21swapper/705:38:287
785419991914,4cyclictest1081675-21latency_hist05:48:107
785412991917,2cyclictest859696-21kworker/u16:2+flush-8:004:08:346
78541299190,5cyclictest0-21swapper/606:58:266
785410991917,2cyclictest1202464-21kworker/u16:1+flush-8:007:53:255
785410991917,2cyclictest1091868-21kworker/u16:4+events_unbound06:13:385
785409991917,2cyclictest1202464-21kworker/u16:1+flush-8:008:13:294
785409991917,2cyclictest1172018-21kworker/u16:2+events_unbound06:38:254
785409991916,2cyclictest1212582-21kworker/u16:3+flush-8:007:09:154
785409991915,3cyclictest1383037-21kworker/u16:4+flush-8:008:23:244
785409991915,3cyclictest1383037-21kworker/u16:4+flush-8:008:23:244
78541999180,16cyclictest1111831-21latency_hist06:03:097
785412991816,2cyclictest1121562-21kworker/u16:0+flush-8:007:13:356
785409991816,2cyclictest849614-21kworker/u16:1+flush-8:004:08:054
785409991816,2cyclictest1212582-21kworker/u16:3+flush-8:008:03:404
785409991816,2cyclictest1212582-21kworker/u16:3+events_unbound07:03:244
785409991815,2cyclictest889952-21kworker/u16:4+events_unbound05:03:294
785412991716,1cyclictest1061298-21kworker/u16:1+events_unbound05:48:376
785412991715,2cyclictest1202464-21kworker/u16:1+flush-8:008:08:246
785412991714,2cyclictest849614-21kworker/u16:1+flush-8:004:58:346
785409991715,2cyclictest990522-21kworker/u16:2+flush-8:005:17:264
785419991613,2cyclictest0-21swapper/708:43:097
785419991610,5cyclictest1121887-21latency_hist06:08:097
785412991614,2cyclictest1303007-21kworker/u16:4+flush-8:008:03:366
785412991614,2cyclictest1020959-21kworker/u16:1+flush-8:005:28:316
785410991614,2cyclictest3494458-21kworker/u16:3+events_unbound03:38:345
785409991614,2cyclictest1172018-21kworker/u16:2+flush-8:006:43:374
785409991613,2cyclictest1091868-21kworker/u16:4+flush-8:006:23:274
785419991512,2cyclictest4175659-21snmpd08:25:007
785419991512,2cyclictest4175659-21snmpd08:25:007
78541999150,14cyclictest4175659-21snmpd03:58:227
78541999150,13cyclictest589235-21systemd-journal04:22:447
785412991513,2cyclictest1202464-21kworker/u16:1+flush-8:007:43:356
785410991513,2cyclictest849614-21kworker/u16:1+events_unbound04:13:235
785409991513,2cyclictest795189-21kworker/u16:1+flush-8:003:38:254
785409991512,2cyclictest1373788-21kworker/u16:2+flush-8:008:18:234
785409991512,2cyclictest1202464-21kworker/u16:1+flush-8:006:58:314
78541999149,4cyclictest1202559-21latency_hist06:48:097
785419991413,0cyclictest0-21swapper/704:43:257
785419991411,2cyclictest4175659-21snmpd08:16:367
785419991410,3cyclictest4175659-21snmpd07:25:077
78541999140,1cyclictest0-21swapper/707:28:337
78541999140,12cyclictest1142458-21latency_hist06:18:097
785412991412,2cyclictest889952-21kworker/u16:4+flush-8:005:20:106
785412991412,2cyclictest889952-21kworker/u16:4+flush-8:005:20:106
785412991412,2cyclictest1202464-21kworker/u16:1+flush-8:007:08:046
785412991411,2cyclictest1262832-21kworker/u16:2+flush-8:007:23:246
785412991411,2cyclictest1091868-21kworker/u16:4+flush-8:006:08:266
785412991410,3cyclictest754893-21kworker/u16:0+flush-8:003:28:156
785410991412,2cyclictest1212582-21kworker/u16:3+flush-8:007:20:015
785409991413,1cyclictest0-21swapper/403:53:234
785409991412,2cyclictest889952-21kworker/u16:4+flush-8:005:08:354
785409991412,2cyclictest849614-21kworker/u16:1+events_unbound04:53:234
785409991411,2cyclictest1212582-21kworker/u16:3+flush-8:008:11:554
785409991411,2cyclictest1051003-21kworker/u16:0+flush-8:005:43:304
78541999139,3cyclictest4175659-21snmpd08:29:097
78541999139,3cyclictest4175659-21snmpd04:26:087
78541999138,4cyclictest589235-21systemd-journal08:40:447
78541999138,4cyclictest1244104-21cat07:08:257
78541999137,5cyclictest27174-21gnome-shell06:33:087
78541999136,6cyclictest27763-21gvfs-afc-volume08:03:287
785419991310,2cyclictest852320-21kthreadcore03:53:277
785419991310,2cyclictest4175659-21snmpd03:37:217
785412991311,2cyclictest3494458-21kworker/u16:3+flush-8:003:47:106
785410991312,1cyclictest0-21swapper/506:38:365
785410991311,2cyclictest849614-21kworker/u16:1+flush-8:004:53:245
785410991310,3cyclictest1051003-21kworker/u16:0+flush-8:005:43:395
78541099130,13cyclictest0-21swapper/504:41:005
78541099130,0cyclictest0-21swapper/504:33:355
78541999129,2cyclictest4175659-21snmpd05:50:077
78541999129,2cyclictest4175659-21snmpd04:51:577
78541999129,2cyclictest0-21swapper/708:33:097
78541999128,3cyclictest4175659-21snmpd06:39:517
78541999127,4cyclictest990773-21latency_hist05:03:107
78541999125,6cyclictest27763-21gvfs-afc-volume08:48:267
78541999125,6cyclictest0-21swapper/706:56:117
78541999125,6cyclictest0-21swapper/706:56:117
785419991210,1cyclictest0-21swapper/703:43:307
78541999120,10cyclictest0-21swapper/704:13:347
78541299129,2cyclictest3494458-21kworker/u16:3+flush-8:003:48:416
785412991211,1cyclictest0-21swapper/607:18:296
785412991211,1cyclictest0-21swapper/606:38:456
785412991210,2cyclictest1121562-21kworker/u16:0+events_unbound06:33:246
78541099128,3cyclictest1091868-21kworker/u16:4+flush-8:006:28:375
785410991211,1cyclictest0-21swapper/507:46:335
785410991211,1cyclictest0-21swapper/504:44:195
785410991211,1cyclictest0-21swapper/504:08:035
785410991210,2cyclictest849614-21kworker/u16:1+flush-8:003:58:245
785410991210,2cyclictest3494458-21kworker/u16:3+flush-8:003:33:295
78541099120,1cyclictest0-21swapper/508:30:325
78541099120,11cyclictest0-21swapper/508:18:145
78540999129,2cyclictest1061298-21kworker/u16:1+flush-8:005:52:524
785409991210,2cyclictest849614-21kworker/u16:1+events_unbound04:58:324
785409991210,2cyclictest1061298-21kworker/u16:1+events_unbound05:40:464
78541999118,2cyclictest4175659-21snmpd06:59:547
78541999118,2cyclictest4175659-21snmpd03:49:407
78541999118,2cyclictest0-21swapper/707:58:097
78541999117,3cyclictest948-21NetworkManager05:18:257
78541999117,3cyclictest948-21NetworkManager05:18:257
78541999115,5cyclictest27174-21gnome-shell06:50:087
78541999114,6cyclictest0-21swapper/704:38:277
78541999110,2cyclictest0-21swapper/706:18:367
78541999110,10cyclictest4175659-21snmpd05:24:527
78541999110,10cyclictest4175659-21snmpd05:24:527
78541999110,10cyclictest1056090-21kthreadcore05:33:307
78541299119,2cyclictest849614-21kworker/u16:1+events_unbound04:13:336
78541299119,2cyclictest1433997-21kworker/u16:3+flush-8:008:43:356
785412991110,1cyclictest0-21swapper/606:25:596
785412991110,1cyclictest0-21swapper/604:49:306
785412991110,1cyclictest0-21swapper/604:06:376
78541299110,11cyclictest0-21swapper/604:44:286
78541099119,2cyclictest1202464-21kworker/u16:1+flush-8:008:08:345
78541099118,2cyclictest800694-21irqcore03:28:275
78541099118,2cyclictest754893-21kworker/u16:0+flush-8:003:23:365
785410991110,1cyclictest0-21swapper/508:43:465
785410991110,1cyclictest0-21swapper/507:49:045
785410991110,1cyclictest0-21swapper/507:29:125
785410991110,1cyclictest0-21swapper/507:01:285
785410991110,1cyclictest0-21swapper/505:50:505
785410991110,1cyclictest0-21swapper/505:32:055
785410991110,1cyclictest0-21swapper/505:04:485
785410991110,1cyclictest0-21swapper/504:11:125
78541099110,11cyclictest0-21swapper/508:41:155
78541099110,11cyclictest0-21swapper/508:33:505
78541099110,11cyclictest0-21swapper/507:06:305
78541099110,0cyclictest0-21swapper/504:58:495
78540999119,2cyclictest889693-21kworker/u16:3+events_unbound04:28:324
78540999119,2cyclictest1424085-21kworker/u16:1+events_unbound08:48:394
78540999119,2cyclictest1212582-21kworker/u16:3+flush-8:007:47:454
78540999119,2cyclictest1202464-21kworker/u16:1+flush-8:007:38:224
78540999119,2cyclictest1202464-21kworker/u16:1+flush-8:007:38:224
78540999116,4cyclictest800468-21cat03:28:254
785409991110,1cyclictest0-21swapper/408:28:384
78540999110,11cyclictest0-21swapper/408:47:334
78540999110,11cyclictest0-21swapper/407:50:294
78540999110,0cyclictest0-21swapper/407:30:384
78541999106,3cyclictest27394-21gmain05:53:257
78541999100,9cyclictest4175659-21snmpd04:53:187
78541999100,2cyclictest1131-21lldpd03:28:297
78541299109,1cyclictest0-21swapper/607:55:036
78541299108,2cyclictest1131888-21kworker/u16:3+events_unbound06:13:236
78541299107,2cyclictest990522-21kworker/u16:2+flush-8:005:16:166
78541099109,1cyclictest0-21swapper/508:26:265
78541099109,1cyclictest0-21swapper/508:26:265
78541099109,1cyclictest0-21swapper/507:36:375
78541099109,1cyclictest0-21swapper/506:49:385
78541099109,1cyclictest0-21swapper/505:26:055
78541099109,1cyclictest0-21swapper/505:26:055
78541099109,1cyclictest0-21swapper/504:49:215
78541099100,10cyclictest0-21swapper/507:58:135
78540999108,2cyclictest889693-21kworker/u16:3+events_unbound04:20:434
78540999106,3cyclictest829242-21kworker/u16:0+flush-8:003:43:354
785409991010,0cyclictest0-21swapper/408:40:094
7854129998,1cyclictest0-21swapper/608:00:536
7854129998,1cyclictest0-21swapper/607:29:216
7854109998,1cyclictest0-21swapper/507:13:175
7854109998,1cyclictest0-21swapper/505:39:485
7854109998,1cyclictest0-21swapper/504:26:585
7854109995,3cyclictest1052506-21cat05:33:255
7854099997,2cyclictest889952-21kworker/u16:4+flush-8:004:33:404
7854099997,2cyclictest849614-21kworker/u16:1+flush-8:004:08:264
7854099997,2cyclictest1303007-21kworker/u16:4+events_unbound07:53:344
7854129980,7cyclictest907661-21cut04:18:326
7854109986,1cyclictest0-21swapper/505:13:325
7854109985,2cyclictest0-21swapper/506:18:325
7854109985,2cyclictest0-21swapper/506:03:305
7854109983,4cyclictest1377976-21cat08:13:305
7854109983,4cyclictest1303807-21cat07:38:225
7854109983,4cyclictest1303807-21cat07:38:225
7854109983,4cyclictest1104346-21cut05:58:275
7854109983,4cyclictest1002786-21cut05:08:275
7854099987,1cyclictest0-21swapper/406:28:214
7854099983,4cyclictest1266295-21cut07:18:274
7854099983,4cyclictest1179576-21cut06:33:304
7854099983,4cyclictest1055644-21cut05:33:284
7854109975,1cyclictest0-21swapper/503:48:315
7854109974,2cyclictest921461-21interrupts04:28:255
7854109973,3cyclictest1354429-21expr08:03:245
7854109973,3cyclictest1023782-21tr05:18:295
7854109973,3cyclictest1023782-21tr05:18:295
7854109972,4cyclictest830145-21grep03:43:215
7854109965,1cyclictest0-21swapper/507:08:145
7854109960,1cyclictest0-21swapper/503:55:005
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional