You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 17:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Fri Nov 21, 2025 12:45:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111892830,2sleep60-21swapper/611:57:516
188612820,1sleep7761rcuc/710:22:557
188612820,1sleep7761rcuc/710:22:557
42952780,0sleep20-21swapper/211:52:022
303492780,0sleep10-21swapper/112:38:251
258332780,1sleep60-21swapper/611:11:516
173882760,1sleep417380-21sshd10:08:244
298572750,1sleep6671rcuc/612:10:096
92712740,0sleep40-21swapper/412:35:164
179202730,0sleep40-21swapper/411:10:354
148302730,1sleep5591ktimersoftd/508:15:195
207182700,0sleep30-21swapper/311:01:223
144772700,0sleep10-21swapper/110:26:571
84102690,0sleep60-21swapper/611:47:576
163972690,0sleep10-21swapper/110:13:031
163972690,0sleep10-21swapper/110:13:031
197732680,0sleep10-21swapper/109:16:211
1389925847,7sleep00-21swapper/007:09:040
1193225848,6sleep30-21swapper/307:05:073
18122540,0sleep70-21swapper/710:25:117
1193025443,7sleep10-21swapper/107:05:061
1382325140,7sleep40-21swapper/407:08:124
165052460,4sleep71424199cyclictest11:58:407
1397024625,16sleep60-21swapper/607:10:006
1362224433,7sleep50-21swapper/507:05:425
80622430,0sleep6681ktimersoftd/611:23:456
1390124332,7sleep20-21swapper/207:09:072
1192724130,7sleep70-21swapper/707:05:047
31162280,0sleep20-21swapper/209:28:242
1420399240,23cyclictest0-21swapper/112:14:291
88952220,1sleep50-21swapper/509:14:565
1420399210,20cyclictest0-21swapper/112:15:171
14203992017,2cyclictest1044-21sshd11:42:191
14203992017,2cyclictest1044-21sshd11:42:191
318152190,1sleep70-21swapper/711:27:147
237922190,1sleep623771-21sshd10:04:426
217762190,0sleep70-21swapper/711:20:497
152602190,0sleep00-21swapper/010:03:230
14241991914,3cyclictest25831-21sshd09:26:497
317542180,1sleep731745-21sshd10:34:257
14203991815,2cyclictest19481-21sshd12:08:351
126862180,1sleep60-21swapper/612:26:206
304732170,1sleep3401rcuc/309:51:173
170442170,1sleep217045-21/usr/sbin/munin09:35:132
1423199170,15cyclictest0-21swapper/511:52:505
90342160,0sleep20-21swapper/211:28:462
246602160,0sleep30-21swapper/311:59:563
214132160,1sleep00-21swapper/009:16:360
160222160,1sleep116024-21latency_hist11:25:001
1424199160,14cyclictest0-21swapper/710:15:367
1423199161,2cyclictest0-21swapper/509:00:205
1422099160,15cyclictest0-21swapper/410:24:164
1422099160,15cyclictest0-21swapper/410:24:164
1421099160,14cyclictest0-21swapper/211:38:062
14203991614,1cyclictest8822-21sshd12:21:031
211072150,0sleep30-21swapper/312:22:573
1424199150,2cyclictest1044-21sshd10:09:337
14220991511,2cyclictest0-21swapper/412:10:094
14220991511,2cyclictest0-21swapper/409:58:574
1421599150,13cyclictest0-21swapper/311:06:123
1421599150,13cyclictest0-21swapper/310:58:473
1421599150,13cyclictest0-21swapper/310:30:033
14210991512,1cyclictest0-21swapper/210:04:172
14203991511,2cyclictest0-21swapper/110:58:381
1420399150,13cyclictest0-21swapper/110:42:221
1419899150,13cyclictest0-21swapper/011:06:140
226992140,0sleep00-21swapper/010:32:570
1424199140,2cyclictest0-21swapper/711:18:147
1424199140,12cyclictest15859-21grep10:03:307
1424199140,12cyclictest0-21swapper/711:49:097
1424199140,12cyclictest0-21swapper/709:24:307
1423699140,1cyclictest0-21swapper/611:40:156
1423699140,1cyclictest0-21swapper/611:40:156
1423699140,1cyclictest0-21swapper/611:00:146
1423699140,12cyclictest0-21swapper/611:31:266
14231991411,1cyclictest12188-21sshd11:05:075
1423199140,12cyclictest22253-21gdbus09:25:235
14220991410,2cyclictest657-21sshd11:51:284
1422099140,2cyclictest0-21swapper/412:28:184
1422099140,12cyclictest0-21swapper/411:44:294
1422099140,12cyclictest0-21swapper/411:44:294
1422099140,12cyclictest0-21swapper/409:12:524
1421599140,1cyclictest0-21swapper/312:37:123
1421599140,12cyclictest662-21gdbus09:42:433
1421599140,12cyclictest0-21swapper/310:05:033
1421599140,12cyclictest0-21swapper/309:38:333
14210991412,1cyclictest0-21swapper/210:40:182
1421099140,13cyclictest0-21swapper/211:16:592
1421099140,12cyclictest465-21systemd-journal10:50:312
1421099140,12cyclictest465-21systemd-journal10:20:162
1421099140,12cyclictest465-21systemd-journal10:20:162
1421099140,12cyclictest31577-21sshd09:32:332
14198991410,2cyclictest465-21systemd-journal10:29:410
1419899140,13cyclictest0-21swapper/009:57:410
53622130,0sleep40-21swapper/409:33:314
216292130,0sleep70-21swapper/710:37:377
14241991311,1cyclictest0-21swapper/709:37:007
14241991310,2cyclictest0-21swapper/712:11:357
1424199130,1cyclictest0-21swapper/710:40:367
1424199130,1cyclictest0-21swapper/709:55:347
1424199130,12cyclictest0-21swapper/711:03:187
1424199130,12cyclictest0-21swapper/710:55:557
1424199130,12cyclictest0-21swapper/709:46:187
1424199130,12cyclictest0-21swapper/709:19:567
14236991311,1cyclictest0-21swapper/611:52:006
1423699130,2cyclictest0-21swapper/612:08:486
1423699130,2cyclictest0-21swapper/610:28:366
1423699130,1cyclictest0-21swapper/612:19:336
1423699130,12cyclictest645-21bash09:42:186
1423699130,11cyclictest0-21swapper/609:31:416
14231991311,1cyclictest1-21systemd10:35:255
14231991311,1cyclictest0-21swapper/512:05:285
14231991310,2cyclictest0-21swapper/509:33:435
1423199130,1cyclictest0-21swapper/511:42:055
1423199130,1cyclictest0-21swapper/511:42:055
1423199130,1cyclictest0-21swapper/511:10:135
1423199130,1cyclictest0-21swapper/509:45:165
1423199130,12cyclictest0-21swapper/512:29:155
1423199130,12cyclictest0-21swapper/510:23:515
1423199130,12cyclictest0-21swapper/510:23:505
1423199130,11cyclictest1919-21sshd10:15:305
14220991311,1cyclictest21279-21sshd09:40:254
14220991310,2cyclictest26356-21sshd09:50:374
1422099130,1cyclictest0-21swapper/412:19:024
1422099130,12cyclictest28864-21sshd12:24:084
14215991311,1cyclictest0-21swapper/312:08:503
14215991311,1cyclictest0-21swapper/309:17:523
14215991310,1cyclictest0-21swapper/309:13:183
1421599130,12cyclictest0-21swapper/311:15:043
1421599130,12cyclictest0-21swapper/310:50:283
14210991311,1cyclictest0-21swapper/210:59:472
14210991310,2cyclictest0-21swapper/211:07:112
1421099130,1cyclictest356-21sshd10:39:212
1421099130,1cyclictest0-21swapper/209:24:132
1421099130,11cyclictest0-21swapper/211:03:012
14203991311,1cyclictest6220-21bash10:20:571
14203991311,1cyclictest6220-21bash10:20:571
14203991311,1cyclictest0-21swapper/109:45:151
1420399130,1cyclictest25863-21irqstats11:55:131
1420399130,12cyclictest0-21swapper/109:54:311
14198991311,1cyclictest0-21swapper/011:35:410
1419899130,2cyclictest0-21swapper/012:08:200
1419899130,12cyclictest0-21swapper/012:30:390
1419899130,12cyclictest0-21swapper/011:34:440
1419899130,12cyclictest0-21swapper/011:23:030
1419899130,12cyclictest0-21swapper/010:42:110
1419899130,12cyclictest0-21swapper/010:05:360
23682120,0sleep50-21swapper/511:47:005
1424199123,1cyclictest660-21dbus-daemon09:54:357
14241991210,1cyclictest0-21swapper/712:35:477
1424199120,1cyclictest704-21systemd-logind12:25:347
1424199120,1cyclictest0-21swapper/712:09:427
1424199120,1cyclictest0-21swapper/710:46:387
1424199120,11cyclictest0-21swapper/711:37:267
1424199120,11cyclictest0-21swapper/708:35:117
1423699129,2cyclictest0-21swapper/609:52:316
14236991210,1cyclictest1081-21rs:main6
14236991210,1cyclictest0-21swapper/610:57:266
14236991210,1cyclictest0-21swapper/610:53:166
14236991210,1cyclictest0-21swapper/609:48:216
14236991210,1cyclictest0-21swapper/609:28:276
14236991210,1cyclictest0-21swapper/609:24:176
1423699120,1cyclictest0-21swapper/612:33:566
1423699120,1cyclictest0-21swapper/610:37:006
1423699120,11cyclictest0-21swapper/611:18:486
1423699120,11cyclictest0-21swapper/610:48:096
1423699120,11cyclictest0-21swapper/610:31:546
1423699120,11cyclictest0-21swapper/609:19:436
1423699120,10cyclictest0-21swapper/610:20:196
1423699120,10cyclictest0-21swapper/610:20:196
1423199129,2cyclictest0-21swapper/510:52:375
1423199129,1cyclictest0-21swapper/510:31:155
14231991210,1cyclictest0-21swapper/511:25:415
14231991210,1cyclictest0-21swapper/511:00:575
14231991210,1cyclictest0-21swapper/510:10:255
14231991210,1cyclictest0-21swapper/510:10:255
14231991210,1cyclictest0-21swapper/509:40:105
1423199120,1cyclictest0-21swapper/512:30:055
1423199120,1cyclictest0-21swapper/511:23:475
1423199120,1cyclictest0-21swapper/510:55:505
1423199120,1cyclictest0-21swapper/510:41:275
1423199120,1cyclictest0-21swapper/509:50:235
1423199120,11cyclictest9271-21sshd10:02:295
1423199120,11cyclictest31035-21sshd12:38:325
1423199120,11cyclictest0-21swapper/512:24:095
1423199120,11cyclictest0-21swapper/512:04:315
1423199120,11cyclictest0-21swapper/509:55:295
14220991210,1cyclictest0-21swapper/411:45:254
14220991210,1cyclictest0-21swapper/411:35:374
14220991210,1cyclictest0-21swapper/410:50:274
14220991210,1cyclictest0-21swapper/409:23:214
1422099120,1cyclictest0-21swapper/412:09:134
1422099120,1cyclictest0-21swapper/411:59:244
1422099120,11cyclictest0-21swapper/411:34:404
1422099120,11cyclictest0-21swapper/410:30:584
14215991210,1cyclictest1044-21sshd09:28:523
14215991210,1cyclictest0-21swapper/311:23:573
14215991210,1cyclictest0-21swapper/310:20:223
14215991210,1cyclictest0-21swapper/310:20:223
14215991210,1cyclictest0-21swapper/310:16:123
1421599120,1cyclictest0-21swapper/312:18:393
1421599120,11cyclictest0-21swapper/312:33:023
1421599120,11cyclictest0-21swapper/311:48:163
1421599120,11cyclictest0-21swapper/311:38:273
1421599120,11cyclictest0-21swapper/310:40:163
1421599120,11cyclictest0-21swapper/309:48:473
14210991210,1cyclictest0-21swapper/212:31:192
14210991210,1cyclictest0-21swapper/212:26:132
14210991210,1cyclictest0-21swapper/207:30:232
14210991210,1cyclictest0-21swapper/207:10:212
1421099120,1cyclictest0-21swapper/211:47:542
1421099120,11cyclictest0-21swapper/212:35:292
1421099120,11cyclictest0-21swapper/211:56:472
1421099120,11cyclictest0-21swapper/210:15:182
1421099120,11cyclictest0-21swapper/210:10:112
1421099120,11cyclictest0-21swapper/210:10:112
1421099120,11cyclictest0-21swapper/207:45:172
1421099120,10cyclictest0-21swapper/207:21:222
1420399128,2cyclictest660-21dbus-daemon11:27:081
1420399126,5cyclictest704-21systemd-logind12:31:191
14203991210,1cyclictest24735-21/usr/sbin/munin08:35:201
14203991210,1cyclictest1117-21nfsd09:21:111
14203991210,1cyclictest0-21swapper/111:46:211
14203991210,1cyclictest0-21swapper/107:55:181
1420399120,2cyclictest0-21swapper/108:50:181
1420399120,1cyclictest660-21dbus-daemon09:12:031
1420399120,1cyclictest0-21swapper/111:06:581
1420399120,1cyclictest0-21swapper/109:27:381
1420399120,11cyclictest0-21swapper/110:35:231
1419899124,4cyclictest0-21swapper/009:25:010
14198991210,1cyclictest0-21swapper/011:15:060
14198991210,1cyclictest0-21swapper/010:47:170
1419899120,1cyclictest7151-21sshd10:54:410
1419899120,1cyclictest20311-21bash09:45:120
1419899120,1cyclictest1687-21bash12:38:590
1419899120,1cyclictest0-21swapper/011:51:320
1419899120,11cyclictest0-21swapper/012:18:090
1419899120,11cyclictest0-21swapper/011:14:090
1419899120,11cyclictest0-21swapper/010:58:510
1419899120,11cyclictest0-21swapper/009:11:110
1424199119,1cyclictest0-21swapper/711:50:057
1424199118,1cyclictest7166-21bash09:33:477
1424199111,3cyclictest101rcu_sched12:30:137
1424199110,0cyclictest0-21swapper/712:20:287
1423699119,1cyclictest2044-21sshd12:39:036
1423699119,1cyclictest0-21swapper/611:08:036
1423699119,1cyclictest0-21swapper/610:09:436
1423699119,1cyclictest0-21swapper/609:35:516
1423699119,1cyclictest0-21swapper/609:11:306
1423199119,1cyclictest0-21swapper/510:28:015
1423199119,1cyclictest0-21swapper/509:16:155
1423199118,2cyclictest0-21swapper/512:19:595
1422099119,1cyclictest0-21swapper/412:00:214
1422099119,1cyclictest0-21swapper/411:22:594
1422099119,1cyclictest0-21swapper/410:35:084
1422099119,1cyclictest0-21swapper/408:50:174
1422099119,1cyclictest0-21swapper/407:35:014
1422099110,1cyclictest0-21swapper/410:16:114
1422099110,1cyclictest0-21swapper/409:45:324
1422099110,1cyclictest0-21swapper/409:00:144
1422099110,10cyclictest0-21swapper/410:58:474
1422099110,10cyclictest0-21swapper/410:27:444
1421599119,1cyclictest660-21dbus-daemon11:25:493
1421599119,1cyclictest12351-21sshd09:20:083
1421599119,1cyclictest0-21swapper/310:46:183
1421599119,1cyclictest0-21swapper/309:33:023
1421099119,1cyclictest0-21swapper/210:30:052
1421099119,1cyclictest0-21swapper/209:13:432
1421099119,1cyclictest0-21swapper/207:50:232
1421099110,2cyclictest0-21swapper/212:22:382
1421099110,1cyclictest0-21swapper/209:45:032
1420399119,1cyclictest660-21dbus-daemon09:58:261
1420399119,1cyclictest1036-21runrttasks08:31:261
1420399119,1cyclictest0-21swapper/110:49:221
1420399119,1cyclictest0-21swapper/110:02:271
1420399119,1cyclictest0-21swapper/108:14:561
1420399116,4cyclictest0-21swapper/111:15:141
1420399116,1cyclictest16099-21sshd10:51:001
1420399110,10cyclictest0-21swapper/111:02:481
1420399110,10cyclictest0-21swapper/109:39:121
1419899119,1cyclictest0-21swapper/011:03:010
1419899119,1cyclictest0-21swapper/010:20:000
1419899119,1cyclictest0-21swapper/009:31:210
1419899117,1cyclictest660-21dbus-daemon10:21:100
1419899117,1cyclictest660-21dbus-daemon10:21:100
1419899110,1cyclictest0-21swapper/009:40:050
1419899110,10cyclictest0-21swapper/012:26:290
1419899110,10cyclictest0-21swapper/011:58:320
1419899110,10cyclictest0-21swapper/011:43:360
1419899110,10cyclictest0-21swapper/011:43:360
1419899110,10cyclictest0-21swapper/010:37:050
1424199108,1cyclictest0-21swapper/711:07:287
1424199108,1cyclictest0-21swapper/709:11:457
1424199103,1cyclictest78-21ksoftirqd/710:11:407
1424199103,1cyclictest78-21ksoftirqd/710:11:407
1424199100,8cyclictest660-21dbus-daemon10:51:027
1423699108,1cyclictest0-21swapper/610:18:596
1423699107,2cyclictest0-21swapper/611:35:126
1423699107,2cyclictest0-21swapper/610:14:496
1423699107,2cyclictest0-21swapper/610:14:496
1423199108,1cyclictest0-21swapper/511:30:235
1423199108,1cyclictest0-21swapper/508:06:215
1423199107,2cyclictest0-21swapper/509:08:035
1422099107,2cyclictest0-21swapper/410:46:174
1422099100,1cyclictest0-21swapper/412:30:234
1421599108,1cyclictest0-21swapper/310:12:023
1421599108,1cyclictest0-21swapper/310:12:023
1421599108,1cyclictest0-21swapper/307:50:143
1421599107,2cyclictest0-21swapper/310:27:463
1421599104,5cyclictest660-21dbus-daemon11:55:003
1421599102,7cyclictest0-21swapper/311:11:163
1421599100,1cyclictest0-21swapper/312:13:133
1421099108,1cyclictest0-21swapper/210:46:202
1421099108,1cyclictest0-21swapper/210:26:502
1421099104,5cyclictest0-21swapper/208:13:542
1421099100,1cyclictest0-21swapper/210:05:372
1421099100,0cyclictest0-21swapper/212:12:142
1420399108,1cyclictest0-21swapper/112:26:321
1420399108,1cyclictest0-21swapper/110:31:131
1420399108,1cyclictest0-21swapper/109:32:451
1420399103,1cyclictest0-21swapper/111:10:171
1420399100,6cyclictest0-21swapper/107:35:151
1420399100,2cyclictest0-21swapper/107:45:121
1419899108,1cyclictest30755-21bash12:10:130
1419899108,1cyclictest0-21swapper/009:28:070
1419899100,9cyclictest0-21swapper/011:26:410
142419997,1cyclictest78-21ksoftirqd/711:10:507
142419997,1cyclictest78-21ksoftirqd/709:10:017
142419996,1cyclictest78-21ksoftirqd/712:18:217
142419993,5cyclictest0-21swapper/711:42:397
142419993,5cyclictest0-21swapper/711:42:397
142419993,5cyclictest0-21swapper/707:52:387
142419992,3cyclictest101rcu_sched09:40:207
142419990,5cyclictest0-21swapper/707:25:127
142419990,5cyclictest0-21swapper/707:25:127
142369997,1cyclictest32016-21sshd10:43:596
142369996,2cyclictest0-21swapper/609:00:136
142369993,5cyclictest0-21swapper/608:20:156
142369993,5cyclictest0-21swapper/608:14:006
142369993,4cyclictest0-21swapper/608:30:166
142369990,7cyclictest0-21swapper/611:25:176
142369990,5cyclictest0-21swapper/612:00:156
142319996,2cyclictest30080-21sshd10:48:275
142319996,2cyclictest1060-21in:imjournal09:36:415
142319994,4cyclictest0-21swapper/509:22:415
142319993,5cyclictest0-21swapper/508:35:495
142319990,8cyclictest0-21swapper/507:50:215
142209997,1cyclictest13750-21sshd11:15:034
142209997,1cyclictest0-21swapper/411:06:104
142209993,5cyclictest0-21swapper/408:58:524
142209993,5cyclictest0-21swapper/408:58:524
142209993,5cyclictest0-21swapper/407:50:114
142209993,5cyclictest0-21swapper/407:40:234
142209993,5cyclictest0-21swapper/407:22:484
142209992,5cyclictest0-21swapper/408:20:024
142209992,1cyclictest9417-21sshd10:11:574
142209992,1cyclictest9417-21sshd10:11:574
142209990,6cyclictest0-21swapper/408:31:504
142209990,2cyclictest24550-21ntp_states08:35:164
142209990,2cyclictest18341-21sshd09:16:074
142209990,2cyclictest0-21swapper/407:16:154
142209990,1cyclictest0-21swapper/409:25:134
142159997,1cyclictest0-21swapper/307:10:193
142159996,2cyclictest0-21swapper/309:58:033
142159993,5cyclictest0-21swapper/307:45:413
142109997,1cyclictest29374-21sshd09:51:062
142109997,1cyclictest0-21swapper/209:16:002
142109997,1cyclictest0-21swapper/208:57:532
142109997,1cyclictest0-21swapper/208:57:532
142109995,1cyclictest20643-21grep11:30:192
142109990,8cyclictest0-21swapper/212:04:222
142109990,2cyclictest0-21swapper/212:16:582
142039995,1cyclictest0-21swapper/112:01:031
142039993,5cyclictest0-21swapper/108:17:151
142039993,5cyclictest0-21swapper/107:54:531
142039993,5cyclictest0-21swapper/107:20:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional