You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 15:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Tue Nov 25, 2025 12:45:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2960121470,4sleep62186999cyclictest12:17:116
1855721340,0sleep118555-21ls08:10:001
1605721130,3sleep12183599cyclictest10:45:131
286282820,0sleep00-21swapper/009:16:410
77202780,0sleep40-21swapper/411:55:134
80102740,1sleep50-21swapper/511:55:145
46162740,0sleep60-21swapper/609:32:266
227212740,0sleep40-21swapper/410:08:304
197392740,0sleep70-21swapper/710:26:527
171972740,1sleep61036-21runrttasks10:45:186
162562730,0sleep70-21swapper/711:56:207
306082720,0sleep30-21swapper/309:40:563
320412710,0sleep00-21swapper/009:31:400
252942710,3sleep12183599cyclictest11:24:401
291442690,0sleep00-21swapper/011:10:530
222562690,0sleep50-21swapper/507:10:115
110002690,0sleep70-21swapper/710:35:107
100152680,0sleep50-21swapper/510:25:225
163462670,0sleep30-21swapper/311:04:313
2141726240,6sleep50-21swapper/507:07:405
2135225949,6sleep60-21swapper/607:06:526
2140925747,6sleep70-21swapper/707:07:337
80762550,0sleep30-21swapper/311:26:433
294532530,0sleep50-21swapper/510:14:155
2134025330,7sleep30-21swapper/307:06:413
2144824837,7sleep00-21swapper/007:08:070
2138624636,6sleep40-21swapper/407:07:234
222562450,0sleep30-21swapper/310:13:103
2135724131,6sleep20-21swapper/207:06:572
1955424029,7sleep10-21swapper/107:05:031
246242300,0sleep70-21swapper/710:46:247
325932260,1sleep40-21swapper/410:28:504
3232250,2sleep40-21swapper/411:44:394
3232250,2sleep40-21swapper/411:44:394
16782250,2sleep30-21swapper/310:33:453
2183599240,23cyclictest0-21swapper/107:18:011
2183599222,19cyclictest0-21swapper/111:26:131
106062220,4sleep32184699cyclictest10:20:473
96582210,0sleep30-21swapper/310:06:293
55862210,0sleep30-21swapper/312:13:473
21835992118,2cyclictest0-21swapper/107:10:151
2183599210,20cyclictest0-21swapper/111:30:441
214012210,0sleep081ktimersoftd/010:36:310
133562210,1sleep20-21swapper/210:16:292
2186999208,10cyclictest0-21swapper/607:15:026
2183599200,15cyclictest0-21swapper/111:35:261
170912200,0sleep10-21swapper/109:24:511
37812190,0sleep10-21swapper/111:11:581
29672190,0sleep70-21swapper/712:36:517
28582190,1sleep6671rcuc/609:17:436
21852991914,2cyclictest21579-21perf11:10:014
2187399182,10cyclictest1-21systemd11:20:217
63712170,0sleep3401rcuc/312:18:363
269372170,3sleep22184099cyclictest10:51:312
2182799170,15cyclictest0-21swapper/012:30:130
129652170,0sleep60-21swapper/611:13:226
73612160,0sleep00-21swapper/010:10:500
268172160,1sleep00-21swapper/010:27:570
229972160,0sleep50-21swapper/512:06:525
225382160,0sleep30-21swapper/312:39:523
21873991613,2cyclictest738-21gdbus11:40:007
21827991611,1cyclictest662-21gdbus09:20:510
112212160,1sleep50-21swapper/511:08:255
21873991511,2cyclictest0-21swapper/710:31:257
2186999150,13cyclictest0-21swapper/609:28:546
2186199150,13cyclictest0-21swapper/511:35:175
2185299150,13cyclictest0-21swapper/409:13:234
2184099150,13cyclictest465-21systemd-journal11:05:392
2183599150,13cyclictest0-21swapper/109:38:131
2182799150,13cyclictest0-21swapper/009:47:240
9402140,0sleep20-21swapper/210:05:162
2186999141,12cyclictest0-21swapper/612:07:566
2186999140,2cyclictest1364-21sshd10:28:596
2186999140,12cyclictest25272-21sshd12:35:216
2186999140,12cyclictest0-21swapper/611:57:276
2186999140,12cyclictest0-21swapper/610:37:046
21852991410,2cyclictest26415-21sshd11:34:154
21852991410,2cyclictest18728-21memory09:15:164
2185299140,12cyclictest0-21swapper/411:37:354
2184699140,12cyclictest24231-21sshd09:54:283
2184699140,12cyclictest0-21swapper/311:57:363
2184699140,12cyclictest0-21swapper/310:25:163
2184099142,11cyclictest79850irq/25-eno1-rx-11:23:312
21840991411,2cyclictest0-21swapper/211:03:142
21835991411,2cyclictest660-21dbus-daemon11:18:131
21835991411,2cyclictest0-21swapper/112:04:521
2183599140,5cyclictest0-21swapper/110:56:251
2183599140,12cyclictest704-21systemd-logind10:36:411
21827991410,2cyclictest2443-21tty09:55:520
2182799140,2cyclictest0-21swapper/011:50:390
2182799140,2cyclictest0-21swapper/010:01:290
119572140,0sleep50-21swapper/510:16:165
21869991311,1cyclictest537-40kipmi010:10:156
21869991310,2cyclictest0-21swapper/612:31:356
2186999130,12cyclictest0-21swapper/612:00:176
21861991311,1cyclictest0-21swapper/511:41:035
21861991311,1cyclictest0-21swapper/511:41:035
2186199130,12cyclictest0-21swapper/512:33:535
2186199130,12cyclictest0-21swapper/510:57:395
2186199130,12cyclictest0-21swapper/509:49:065
21852991311,1cyclictest0-21swapper/409:45:224
21852991310,2cyclictest0-21swapper/410:33:054
21852991310,2cyclictest0-21swapper/409:27:224
2185299130,1cyclictest0-21swapper/410:16:584
2185299130,12cyclictest0-21swapper/412:24:474
2184699130,2cyclictest0-21swapper/310:56:273
2184699130,12cyclictest0-21swapper/311:53:183
2184699130,12cyclictest0-21swapper/309:22:543
21840991311,1cyclictest0-21swapper/212:37:592
21840991311,1cyclictest0-21swapper/212:12:272
21840991311,1cyclictest0-21swapper/210:41:272
2184099130,1cyclictest0-21swapper/210:58:232
2184099130,12cyclictest1-21systemd09:55:132
2184099130,12cyclictest0-21swapper/212:24:172
2184099130,12cyclictest0-21swapper/212:01:582
2184099130,12cyclictest0-21swapper/211:34:082
2184099130,12cyclictest0-21swapper/210:26:152
21835991311,1cyclictest0-21swapper/110:51:201
21835991311,1cyclictest0-21swapper/110:06:191
2183599130,8cyclictest0-21swapper/108:20:531
2183599130,8cyclictest0-21swapper/107:32:361
2183599130,7cyclictest0-21swapper/110:43:331
2183599130,5cyclictest0-21swapper/112:08:141
2183599130,1cyclictest10055-21sshd09:14:001
2183599130,12cyclictest0-21swapper/110:23:231
2183599130,11cyclictest0-21swapper/112:11:021
21827991311,1cyclictest0-21swapper/012:04:290
21827991311,1cyclictest0-21swapper/009:25:130
2182799130,2cyclictest0-21swapper/011:21:210
2182799130,2cyclictest0-21swapper/010:33:140
2182799130,1cyclictest0-21swapper/009:40:570
2182799130,12cyclictest0-21swapper/009:37:430
21873991210,1cyclictest0-21swapper/709:34:197
2187399120,1cyclictest0-21swapper/709:38:357
21869991210,1cyclictest0-21swapper/611:23:506
21869991210,1cyclictest0-21swapper/611:19:006
21869991210,1cyclictest0-21swapper/610:20:006
21869991210,1cyclictest0-21swapper/609:55:246
2186999120,1cyclictest0-21swapper/611:48:506
2186999120,1cyclictest0-21swapper/611:35:246
2186999120,1cyclictest0-21swapper/610:21:526
2186999120,1cyclictest0-21swapper/609:46:566
2186999120,11cyclictest0-21swapper/611:01:086
2186199129,2cyclictest0-21swapper/512:10:135
2186199129,1cyclictest0-21swapper/510:40:425
21861991210,1cyclictest19455-21kworker/5:311:29:045
21861991210,1cyclictest0-21swapper/511:31:555
21861991210,1cyclictest0-21swapper/511:21:185
21861991210,1cyclictest0-21swapper/511:00:595
21861991210,1cyclictest0-21swapper/510:05:375
21861991210,1cyclictest0-21swapper/510:01:525
2186199120,1cyclictest0-21swapper/511:52:055
2186199120,1cyclictest0-21swapper/509:32:025
2186199120,1cyclictest0-21swapper/509:20:525
2186199120,11cyclictest0-21swapper/510:31:425
2186199120,11cyclictest0-21swapper/509:12:555
21852991210,1cyclictest0-21swapper/412:03:574
2185299120,11cyclictest0-21swapper/412:12:014
2185299120,11cyclictest0-21swapper/411:51:034
2185299120,11cyclictest0-21swapper/409:51:254
2185299120,11cyclictest0-21swapper/408:35:214
2185299120,11cyclictest0-21swapper/407:45:214
2184699129,2cyclictest0-21swapper/310:40:273
21846991210,1cyclictest0-21swapper/312:32:413
21846991210,1cyclictest0-21swapper/311:36:303
21846991210,1cyclictest0-21swapper/310:15:193
21846991210,1cyclictest0-21swapper/309:05:183
2184699120,1cyclictest654-21polkitd11:18:383
2184699120,11cyclictest0-21swapper/312:07:093
21840991210,1cyclictest79850irq/25-eno1-rx-11:28:222
21840991210,1cyclictest20165-21sshd09:39:372
21840991210,1cyclictest0-21swapper/212:06:162
2184099120,1cyclictest0-21swapper/211:39:552
2184099120,11cyclictest0-21swapper/211:55:232
2184099120,11cyclictest0-21swapper/211:50:002
2184099120,11cyclictest0-21swapper/210:32:272
2184099120,11cyclictest0-21swapper/209:27:062
2184099120,11cyclictest0-21swapper/209:12:122
2183599129,2cyclictest0-21swapper/111:51:571
2183599129,2cyclictest0-21swapper/110:11:321
2183599129,2cyclictest0-21swapper/110:04:261
21835991210,1cyclictest0-21swapper/112:20:031
21835991210,1cyclictest0-21swapper/111:48:361
21835991210,1cyclictest0-21swapper/109:15:531
2183599120,8cyclictest0-21swapper/109:08:301
2183599120,8cyclictest0-21swapper/107:44:161
2183599120,1cyclictest0-21swapper/109:50:431
2183599120,1cyclictest0-21swapper/109:45:371
2183599120,11cyclictest0-21swapper/112:31:531
2183599120,11cyclictest0-21swapper/111:01:171
2183599120,11cyclictest0-21swapper/110:29:341
2183599120,11cyclictest0-21swapper/109:42:231
2182799129,2cyclictest0-21swapper/011:09:470
21827991210,1cyclictest0-21swapper/011:59:150
2182799120,1cyclictest991-21sshd10:05:150
2182799120,1cyclictest0-21swapper/011:16:120
2182799120,1cyclictest0-21swapper/011:04:570
2182799120,11cyclictest0-21swapper/012:13:300
2182799120,11cyclictest0-21swapper/011:38:400
110072120,0sleep40-21swapper/411:13:054
40502110,1sleep70-21swapper/709:56:077
2187399118,2cyclictest654-21polkitd09:47:217
2187399110,2cyclictest0-21swapper/711:11:217
2186999119,1cyclictest20035-21sshd11:52:126
2186999119,1cyclictest0-21swapper/609:24:446
2186999118,2cyclictest0-21swapper/611:41:116
2186999118,2cyclictest0-21swapper/611:41:116
2186999110,9cyclictest0-21swapper/612:10:146
2186999110,2cyclictest0-21swapper/609:50:446
2186999110,1cyclictest0-21swapper/611:05:586
2186199119,1cyclictest16729-21kworker/5:012:00:165
2186199119,1cyclictest0-21swapper/512:19:145
2186199119,1cyclictest0-21swapper/509:27:525
2185299119,1cyclictest11616-21sshd11:17:514
2185299119,1cyclictest0-21swapper/409:42:094
2185299119,1cyclictest0-21swapper/409:38:554
2185299119,1cyclictest0-21swapper/409:22:154
2185299110,10cyclictest0-21swapper/407:35:234
2184699119,1cyclictest8610-21sshd11:45:393
2184699119,1cyclictest0-21swapper/309:28:573
2184099119,1cyclictest0-21swapper/211:53:222
2184099119,1cyclictest0-21swapper/209:32:132
2184099119,1cyclictest0-21swapper/208:25:182
2184099110,1cyclictest0-21swapper/209:42:272
2184099110,10cyclictest0-21swapper/208:35:312
2183599119,1cyclictest0-21swapper/111:56:151
2183599119,1cyclictest0-21swapper/109:29:531
2183599113,5cyclictest0-21swapper/108:15:411
2183599113,5cyclictest0-21swapper/107:56:561
2183599113,5cyclictest0-21swapper/107:26:011
2183599110,0cyclictest0-21swapper/107:45:101
2182799119,1cyclictest4712-21bash11:26:110
2182799119,1cyclictest0-21swapper/011:45:240
2182799119,1cyclictest0-21swapper/010:46:000
2182799119,1cyclictest0-21swapper/009:54:550
2182799119,1cyclictest0-21swapper/007:15:220
2182799117,2cyclictest465-21systemd-journal10:44:070
261882100,2sleep20-21swapper/212:26:052
2187399105,2cyclictest662-21gdbus09:14:357
2187399103,5cyclictest0-21swapper/708:57:237
2187399100,9cyclictest0-21swapper/711:06:527
2187399100,9cyclictest0-21swapper/710:56:107
2187399100,1cyclictest23775-21bash12:16:167
2187399100,1cyclictest0-21swapper/711:48:597
2186999108,1cyclictest0-21swapper/611:32:026
2186999107,2cyclictest704-21systemd-logind10:44:236
2186999107,2cyclictest0-21swapper/611:26:166
2186999107,1cyclictest0-21swapper/609:41:256
2186999104,5cyclictest0-21swapper/607:24:576
2186999103,5cyclictest0-21swapper/607:28:486
2186999103,4cyclictest0-21swapper/612:28:386
2186999101,1cyclictest91rcu_preempt12:23:136
2186199108,1cyclictest10254-21sshd10:39:465
2186199108,1cyclictest0-21swapper/509:59:595
2186199103,6cyclictest0-21swapper/508:10:145
2186199100,8cyclictest0-21swapper/510:20:135
2186199100,8cyclictest0-21swapper/508:05:135
2185299108,1cyclictest0-21swapper/411:02:234
2185299104,5cyclictest0-21swapper/408:48:434
2185299102,2cyclictest22013-21sshd10:55:314
2185299100,2cyclictest0-21swapper/408:00:204
2184699108,1cyclictest0-21swapper/309:47:533
2184699108,1cyclictest0-21swapper/309:15:553
2184699103,5cyclictest0-21swapper/307:42:093
2184699100,1cyclictest0-21swapper/312:28:393
2184099108,1cyclictest0-21swapper/211:12:542
2184099108,1cyclictest0-21swapper/209:22:002
2184099107,2cyclictest0-21swapper/210:39:342
2184099103,5cyclictest0-21swapper/207:12:052
2183599108,1cyclictest0-21swapper/111:41:521
2183599108,1cyclictest0-21swapper/111:41:521
2183599103,4cyclictest0-21swapper/108:47:191
2183599103,4cyclictest0-21swapper/108:44:011
2183599101,8cyclictest0-21swapper/107:52:361
2183599100,5cyclictest0-21swapper/108:50:291
2183599100,5cyclictest0-21swapper/108:50:291
2183599100,1cyclictest0-21swapper/112:35:141
2182799108,1cyclictest0-21swapper/012:29:050
2182799101,5cyclictest0-21swapper/008:15:000
2182799100,5cyclictest0-21swapper/008:34:590
2182799100,2cyclictest0-21swapper/012:35:230
7684290,2sleep07805-21bash11:40:430
7684290,2sleep07805-21bash11:40:430
5231290,6sleep60-21swapper/610:01:036
345290,0sleep5581rcuc/510:47:425
218739997,1cyclictest14020-21bash11:27:377
218739997,1cyclictest0-21swapper/711:32:527
218739997,1cyclictest0-21swapper/709:50:187
218739993,5cyclictest0-21swapper/712:10:117
218739993,5cyclictest0-21swapper/709:04:187
218739993,5cyclictest0-21swapper/708:01:377
218739993,5cyclictest0-21swapper/707:42:277
218739993,5cyclictest0-21swapper/707:37:037
218739993,5cyclictest0-21swapper/707:33:577
218739993,5cyclictest0-21swapper/707:25:097
218739990,3cyclictest775-21ntpd09:40:167
218739990,2cyclictest8331-21sshd10:01:327
218739990,1cyclictest18964-21sshd12:25:097
218739990,1cyclictest0-21swapper/712:02:297
218739990,1cyclictest0-21swapper/708:20:227
218699998,0cyclictest537-40kipmi009:05:156
218699995,2cyclictest465-21systemd-journal10:51:166
218699993,5cyclictest0-21swapper/608:29:206
218699993,5cyclictest0-21swapper/608:10:176
218699990,4cyclictest26442-21sshd10:32:346
218699990,2cyclictest5019-21grepconf.sh09:13:126
218699990,2cyclictest4901-21sshd10:05:446
218699990,2cyclictest1044-21sshd09:38:026
218619997,1cyclictest537-40kipmi008:20:175
218619997,1cyclictest0-21swapper/509:40:225
218619995,2cyclictest662-21gdbus11:17:035
218619994,2cyclictest662-21gdbus11:11:465
218619993,5cyclictest0-21swapper/508:43:205
218619993,5cyclictest0-21swapper/507:30:325
218529997,1cyclictest501ktimersoftd/407:13:364
218529997,1cyclictest0-21swapper/409:31:324
218529996,1cyclictest465-21systemd-journal09:56:594
218529994,2cyclictest662-21gdbus10:50:574
218529992,5cyclictest0-21swapper/408:05:464
218529990,8cyclictest662-21gdbus12:25:284
218529990,8cyclictest0-21swapper/411:26:524
218529990,4cyclictest0-21swapper/411:20:064
218529990,2cyclictest0-21swapper/409:09:274
218469997,1cyclictest0-21swapper/311:42:173
218469997,1cyclictest0-21swapper/311:42:173
218469997,1cyclictest0-21swapper/311:24:573
218469996,2cyclictest19474-21bash11:33:093
218469994,4cyclictest0-21swapper/310:46:233
218469994,4cyclictest0-21swapper/309:36:303
218469993,5cyclictest0-21swapper/311:05:033
218469993,5cyclictest0-21swapper/309:02:513
218469993,5cyclictest0-21swapper/308:55:413
218469993,5cyclictest0-21swapper/308:25:343
218469993,5cyclictest0-21swapper/307:50:253
218469993,5cyclictest0-21swapper/307:39:063
218469990,2cyclictest22054-21sshd09:10:443
218469990,2cyclictest17911-21sshd10:35:593
218469990,2cyclictest0-21swapper/307:16:073
218409997,1cyclictest27154-21sshd11:15:192
218409997,1cyclictest0-21swapper/209:47:012
218409997,1cyclictest0-21swapper/208:10:302
218409997,1cyclictest0-21swapper/207:32:282
218409995,3cyclictest5270-21systemd-cgroups09:18:062
218409993,5cyclictest0-21swapper/211:40:522
218409993,5cyclictest0-21swapper/211:40:522
218409993,5cyclictest0-21swapper/209:53:162
218409993,5cyclictest0-21swapper/207:51:372
218409990,1cyclictest27084-21bash12:30:542
218409990,1cyclictest17896-21sshd10:21:542
218359997,1cyclictest654-21polkitd10:34:481
218359997,1cyclictest0-21swapper/112:19:061
218359997,1cyclictest0-21swapper/110:19:361
218359994,3cyclictest0-21swapper/108:31:131
218359994,3cyclictest0-21swapper/108:10:431
218359990,8cyclictest0-21swapper/109:02:201
218359990,8cyclictest0-21swapper/108:26:371
218359990,8cyclictest0-21swapper/108:00:361
218359990,5cyclictest0-21swapper/112:25:421
218359990,5cyclictest0-21swapper/107:21:191
218359990,4cyclictest0-21swapper/111:06:091
218279997,1cyclictest0-21swapper/010:24:130
218279993,5cyclictest0-21swapper/009:08:240
218279993,5cyclictest0-21swapper/007:45:590
218279992,1cyclictest10004-21sshd11:31:410
218279991,2cyclictest5357-21grepconf.sh10:53:120
218279990,2cyclictest9548-21sshd12:05:030
218279990,2cyclictest8193-21sshd10:58:280
218279990,2cyclictest6758-21bash10:15:270
218279990,2cyclictest32206-21sshd09:12:190
218279990,2cyclictest30894-21/usr/sbin/munin07:25:200
218279990,2cyclictest27052-21sed08:25:160
218279990,1cyclictest21546-21sshd12:15:560
218279990,1cyclictest12592-21sshd12:24:120
218739985,2cyclictest8629-21sshd11:50:257
218739985,2cyclictest662-21gdbus12:31:007
218739985,2cyclictest660-21dbus-daemon12:21:537
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional