You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 13:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Apr 25, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125489911724,52cyclictest721-21dbus-daemon11:19:045
294432990,0sleep7711rcuc/710:53:127
197142820,1sleep019708-21sshd11:16:440
12556997232,0cyclictest0-21swapper/611:19:036
12521996563,2cyclictest1844-21nfsd11:19:032
1256499640,63cyclictest1325-21kworker/7:511:19:047
59822590,0sleep60-21swapper/609:48:406
59822590,0sleep60-21swapper/609:48:406
1185925626,15sleep70-21swapper/707:05:147
288242550,0sleep60-21swapper/609:40:396
68412500,0sleep10-21swapper/112:15:321
68412500,0sleep10-21swapper/112:15:321
299452500,0sleep50-21swapper/510:56:555
199312490,0sleep40-21swapper/410:24:424
114202490,1sleep111367-21sshd11:51:371
315912480,0sleep20-21swapper/210:21:362
20642470,0sleep40-21swapper/411:28:494
20642470,0sleep40-21swapper/411:28:494
127132470,8sleep213550irq/24-ahci[00012:38:152
122352470,0sleep10-21swapper/111:12:361
239712460,0sleep40-21swapper/412:03:334
138232460,1sleep313821-21sshd09:41:403
1226524624,8sleep50-21swapper/507:08:245
223862450,1sleep022379-21sshd09:16:140
54112440,0sleep60-21swapper/610:49:596
202082440,1sleep449-21ksoftirqd/411:35:224
151082440,0sleep30-21swapper/311:12:463
12902440,0sleep6641ktimersoftd/609:31:426
50202430,0sleep70-21swapper/710:14:367
242952430,0sleep60-21swapper/609:23:496
130312430,0sleep00-21swapper/010:11:160
42782420,0sleep10-21swapper/112:35:501
272992420,1sleep11-21systemd11:32:071
176852420,0sleep20-21swapper/209:27:052
170542420,0sleep6641ktimersoftd/612:16:096
170542420,0sleep6641ktimersoftd/612:16:096
122632420,1sleep125-21ksoftirqd/109:52:431
111282420,1sleep773-21ksoftirqd/712:34:287
50282410,0sleep10-21swapper/110:25:351
50282410,0sleep10-21swapper/110:25:351
310902410,2sleep21252199cyclictest09:59:252
264042410,0sleep20-21swapper/212:18:372
264042410,0sleep20-21swapper/212:18:372
251552410,0sleep30-21swapper/309:57:103
247192410,0sleep10-21swapper/110:11:571
177482410,0sleep60-21swapper/609:14:126
1235324129,8sleep60-21swapper/607:09:376
1228124129,9sleep10-21swapper/107:08:361
1206124129,8sleep00-21swapper/007:05:310
1140824128,9sleep40-21swapper/407:05:114
306002400,0sleep60-21swapper/611:47:096
268782400,0sleep60-21swapper/612:09:206
1205324029,8sleep30-21swapper/307:05:263
252072390,0sleep00-21swapper/009:14:380
222842390,0sleep322259-21sshd11:48:353
239552380,0sleep20-21swapper/207:29:502
1213923827,8sleep20-21swapper/207:06:372
41912370,2sleep11251399cyclictest11:27:021
41912370,2sleep11251399cyclictest11:27:021
12513993736,1cyclictest19128-21kworker/1:411:19:041
198382360,0sleep60-21swapper/610:26:286
198382360,0sleep60-21swapper/610:26:286
164072360,2sleep51254899cyclictest11:10:565
1253199250,24cyclictest0-21swapper/311:19:043
303662230,19sleep213550irq/24-ahci[00010:17:512
12540992322,0cyclictest0-21swapper/411:19:044
1250599233,6cyclictest26921-21cp11:30:100
1250599223,5cyclictest14417-21bash10:44:530
1250599222,5cyclictest14453-21bash10:28:040
1250599222,5cyclictest14453-21bash10:28:040
1250599220,8cyclictest0-21swapper/009:30:040
1250599213,5cyclictest30164-21sshd09:35:100
1250599212,3cyclictest1-21systemd10:55:310
1250599211,7cyclictest0-21swapper/009:42:470
1250599211,5cyclictest27747-21bash12:29:500
1251399205,1cyclictest25-21ksoftirqd/112:06:271
12513992016,1cyclictest25-21ksoftirqd/109:19:551
12513992015,3cyclictest25-21ksoftirqd/109:27:531
1250599203,6cyclictest32524-21id11:47:160
1250599202,4cyclictest6981-21bash10:18:220
1250599202,4cyclictest614-21sshd09:59:320
1250599202,4cyclictest16840-21bash12:06:500
1250599202,3cyclictest4437-21sshd10:09:000
1250599200,2cyclictest0-21swapper/012:15:280
1250599200,2cyclictest0-21swapper/012:15:280
213242190,0sleep721317-21sshd10:06:117
12556991916,2cyclictest65-21ksoftirqd/610:19:326
12556991915,3cyclictest65-21ksoftirqd/612:30:116
12556991914,3cyclictest65-21ksoftirqd/610:22:576
1255699190,4cyclictest121rcu_preempt11:33:596
1251399195,1cyclictest25-21ksoftirqd/110:04:531
1251399192,1cyclictest25-21ksoftirqd/112:03:401
1251399190,18cyclictest15989-21kworker/1:010:41:181
1250599193,5cyclictest8414-21grep12:38:000
1250599193,3cyclictest8208-21grepconf.sh10:20:120
1250599192,7cyclictest19640-21sshd11:35:200
1250599192,7cyclictest17936-21/usr/sbin/munin12:20:040
1250599192,5cyclictest721-21dbus-daemon12:14:070
1250599192,5cyclictest721-21dbus-daemon11:23:590
1250599192,5cyclictest721-21dbus-daemon11:23:590
1250599192,5cyclictest721-21dbus-daemon11:09:400
1250599192,5cyclictest447-21sshd10:51:300
1250599192,5cyclictest24670-21grep09:53:270
1250599192,5cyclictest15573-21systemd11:01:380
1250599192,4cyclictest17996-21sshd10:33:490
1250599192,4cyclictest17996-21sshd10:33:490
1250599191,7cyclictest0-21swapper/010:00:320
1250599191,4cyclictest0-21swapper/011:54:210
226222180,0sleep7711rcuc/709:31:037
12556991816,2cyclictest65-21ksoftirqd/611:42:306
1254899187,0cyclictest0-21swapper/511:49:545
1251399185,2cyclictest25-21ksoftirqd/109:59:051
1251399185,1cyclictest25-21ksoftirqd/112:10:241
12513991817,1cyclictest25-21ksoftirqd/112:30:011
12513991816,1cyclictest25-21ksoftirqd/112:24:211
12513991816,1cyclictest25-21ksoftirqd/109:41:441
12513991816,1cyclictest25-21ksoftirqd/109:16:541
12513991814,1cyclictest25-21ksoftirqd/109:11:031
1250599183,5cyclictest11802-21sd-pam12:04:450
1250599183,4cyclictest31119-21grepconf.sh11:28:380
1250599183,4cyclictest31119-21grepconf.sh11:28:380
1250599182,6cyclictest0-21swapper/011:11:270
1250599182,5cyclictest721-21dbus-daemon11:42:280
1250599182,5cyclictest19460-21ystemctl11:55:460
1250599182,2cyclictest721-21dbus-daemon10:39:450
1250599182,2cyclictest17897-21bash09:47:280
1250599182,2cyclictest17897-21bash09:47:280
1250599181,4cyclictest4995-21systemd09:24:340
1250599180,3cyclictest0-21swapper/010:40:560
111972180,1sleep211196-21bash11:53:302
47412170,0sleep20-21swapper/212:04:192
229462170,1sleep422933-21bash11:11:194
12556991715,1cyclictest65-21ksoftirqd/610:44:506
12556991714,1cyclictest65-21ksoftirqd/610:55:136
12556991713,1cyclictest65-21ksoftirqd/612:39:476
12556991712,4cyclictest65-21ksoftirqd/612:11:206
12556991712,4cyclictest65-21ksoftirqd/610:47:186
1254899177,5cyclictest0-21swapper/511:39:125
1254899176,5cyclictest0-21swapper/512:03:285
12540991715,1cyclictest49-21ksoftirqd/411:57:354
12513991716,1cyclictest25-21ksoftirqd/110:31:051
12513991716,1cyclictest25-21ksoftirqd/110:31:051
12513991716,1cyclictest25-21ksoftirqd/110:14:521
12513991715,1cyclictest25-21ksoftirqd/111:36:241
12513991715,1cyclictest25-21ksoftirqd/110:46:291
12513991715,1cyclictest25-21ksoftirqd/110:22:401
12513991715,1cyclictest25-21ksoftirqd/109:30:401
12513991714,3cyclictest25-21ksoftirqd/110:01:321
12513991713,3cyclictest25-21ksoftirqd/111:44:161
12513991712,1cyclictest121rcu_preempt11:06:441
1251399171,1cyclictest121rcu_preempt11:23:511
1251399171,1cyclictest121rcu_preempt11:23:511
1251399170,1cyclictest131rcu_sched09:47:131
1251399170,1cyclictest131rcu_sched09:47:131
1250599172,5cyclictest28591-21bash12:29:530
112582170,0sleep70-21swapper/711:36:457
214602160,2sleep51254899cyclictest10:02:325
12556991612,3cyclictest65-21ksoftirqd/611:21:186
12556991612,3cyclictest65-21ksoftirqd/611:21:186
12556991612,3cyclictest65-21ksoftirqd/609:27:206
12556991611,3cyclictest65-21ksoftirqd/611:06:326
1255699161,3cyclictest131rcu_sched11:57:306
1255699160,1cyclictest131rcu_sched10:07:136
1254899160,1cyclictest15375-21sshd09:11:525
12540991615,1cyclictest49-21ksoftirqd/411:43:244
12540991614,1cyclictest49-21ksoftirqd/411:06:154
12540991614,1cyclictest49-21ksoftirqd/410:51:054
12540991612,3cyclictest49-21ksoftirqd/409:24:494
12540991612,1cyclictest49-21ksoftirqd/412:22:344
1251399163,1cyclictest25-21ksoftirqd/111:01:011
12513991615,1cyclictest25-21ksoftirqd/110:56:341
12513991614,1cyclictest25-21ksoftirqd/112:27:371
12513991614,1cyclictest25-21ksoftirqd/110:52:261
12513991614,1cyclictest25-21ksoftirqd/110:35:041
12513991613,1cyclictest25-21ksoftirqd/111:55:501
1250599161,2cyclictest22205-21bash09:27:210
12556991513,2cyclictest65-21ksoftirqd/612:27:506
12556991513,1cyclictest65-21ksoftirqd/611:36:126
12556991513,1cyclictest65-21ksoftirqd/611:25:096
12556991513,1cyclictest65-21ksoftirqd/611:25:096
12556991513,1cyclictest65-21ksoftirqd/611:10:316
12556991513,1cyclictest65-21ksoftirqd/611:01:256
12556991513,1cyclictest65-21ksoftirqd/610:35:186
12556991513,1cyclictest65-21ksoftirqd/609:37:216
12556991511,3cyclictest65-21ksoftirqd/610:04:356
12556991511,3cyclictest65-21ksoftirqd/609:54:526
12556991511,1cyclictest65-21ksoftirqd/610:32:286
12556991511,1cyclictest65-21ksoftirqd/610:32:286
1254899159,5cyclictest0-21swapper/511:19:505
1254899159,5cyclictest0-21swapper/511:19:505
1254899154,6cyclictest2341-21sshd12:19:065
1254899154,6cyclictest2341-21sshd12:19:065
1254899150,1cyclictest0-21swapper/512:22:385
12540991514,1cyclictest49-21ksoftirqd/412:27:594
12540991514,1cyclictest49-21ksoftirqd/409:54:424
12540991513,2cyclictest49-21ksoftirqd/412:16:294
12540991513,2cyclictest49-21ksoftirqd/412:16:294
12540991513,1cyclictest49-21ksoftirqd/411:20:084
12540991513,1cyclictest49-21ksoftirqd/411:20:084
12540991513,1cyclictest49-21ksoftirqd/410:55:094
12540991513,1cyclictest49-21ksoftirqd/410:45:024
12540991513,1cyclictest49-21ksoftirqd/410:42:284
12540991513,1cyclictest49-21ksoftirqd/410:35:064
12540991513,1cyclictest49-21ksoftirqd/410:31:164
12540991513,1cyclictest49-21ksoftirqd/410:31:164
12540991513,1cyclictest49-21ksoftirqd/409:39:174
1254099151,1cyclictest131rcu_sched10:09:074
1254099150,4cyclictest2127-21sshd09:31:454
1254099150,14cyclictest6325-21kworker/4:310:12:264
1254099150,1cyclictest131rcu_sched09:16:174
1251399154,3cyclictest25-21ksoftirqd/109:35:361
12513991511,2cyclictest121rcu_preempt11:47:031
311762140,0sleep20-21swapper/210:06:462
308192140,1sleep230823-21kworker/u16:410:58:522
267432140,0sleep7711rcuc/711:02:177
177832140,0sleep40-21swapper/409:12:024
12556991413,1cyclictest65-21ksoftirqd/612:22:076
12556991413,1cyclictest65-21ksoftirqd/612:00:116
12556991413,1cyclictest65-21ksoftirqd/609:16:496
12556991412,1cyclictest65-21ksoftirqd/611:51:426
12556991412,1cyclictest65-21ksoftirqd/610:10:576
12556991412,1cyclictest65-21ksoftirqd/609:50:136
1254899148,5cyclictest0-21swapper/512:11:045
1254899148,5cyclictest0-21swapper/512:05:125
1254899148,5cyclictest0-21swapper/511:44:525
1254899148,5cyclictest0-21swapper/511:44:145
1254899140,11cyclictest8108-21systemd-cgroups09:15:245
12540991413,1cyclictest49-21ksoftirqd/410:18:254
12540991412,1cyclictest49-21ksoftirqd/412:36:434
12540991412,1cyclictest49-21ksoftirqd/412:10:494
12540991412,1cyclictest49-21ksoftirqd/411:52:394
12540991412,1cyclictest49-21ksoftirqd/411:46:174
12540991412,1cyclictest49-21ksoftirqd/411:00:084
12540991412,1cyclictest49-21ksoftirqd/410:00:124
12540991412,1cyclictest49-21ksoftirqd/409:47:544
12540991412,1cyclictest49-21ksoftirqd/409:47:544
12540991412,1cyclictest49-21ksoftirqd/409:43:054
12540991412,1cyclictest49-21ksoftirqd/409:25:014
12540991411,1cyclictest49-21ksoftirqd/411:30:104
12540991410,3cyclictest49-21ksoftirqd/410:26:354
12540991410,3cyclictest49-21ksoftirqd/410:26:354
12540991410,3cyclictest49-21ksoftirqd/409:55:534
190772130,0sleep30-21swapper/308:15:073
128902130,2sleep31253199cyclictest09:28:423
1256499133,4cyclictest721-21dbus-daemon09:19:557
1256499132,5cyclictest2232-21bash12:11:347
12564991310,2cyclictest6938-21bash09:35:417
1254899138,5cyclictest11005-21sshd12:30:385
1254899138,5cyclictest0-21swapper/511:31:445
1254899138,3cyclictest57-21ksoftirqd/510:33:505
1254899138,3cyclictest57-21ksoftirqd/510:33:505
1254899138,1cyclictest721-21dbus-daemon12:25:265
1254899138,0cyclictest0-21swapper/511:25:525
1254899138,0cyclictest0-21swapper/511:25:525
1254899137,5cyclictest21233-21grep12:35:025
12548991310,2cyclictest15214-21sshd10:35:245
1254899130,2cyclictest1-21systemd10:53:515
1254099139,3cyclictest49-21ksoftirqd/412:30:114
12540991310,2cyclictest49-21ksoftirqd/412:06:484
1253199133,4cyclictest0-21swapper/312:02:063
1253199132,4cyclictest23553-21sshd09:31:063
12531991311,1cyclictest857-21polkitd11:06:563
1253199130,12cyclictest22511-21grep10:22:583
12521991311,1cyclictest33-21ksoftirqd/210:35:352
12521991311,0cyclictest13550irq/24-ahci[00011:14:462
1252199130,13cyclictest23264-21kworker/2:110:47:512
61152120,1sleep36108-21systemd11:40:103
1256499122,4cyclictest26455-21grepconf.sh10:32:257
1256499122,4cyclictest26455-21grepconf.sh10:32:257
1256499121,5cyclictest28851-21kill09:55:277
1256499120,12cyclictest13499-21kworker/7:110:25:517
1256499120,12cyclictest13499-21kworker/7:110:25:517
1256499120,12cyclictest11692-21kworker/7:111:47:127
1256499120,11cyclictest31154-21sshd09:18:397
1254899129,3cyclictest5333-21sshd09:22:435
1254899127,5cyclictest0-21swapper/511:56:585
12548991210,1cyclictest57-21ksoftirqd/511:09:375
12548991210,1cyclictest57-21ksoftirqd/509:30:125
1254899120,3cyclictest0-21swapper/510:07:035
1254899120,3cyclictest0-21swapper/509:29:005
1254899120,11cyclictest4264-21grep10:23:475
1254899120,11cyclictest1-21systemd09:42:005
1254899120,1cyclictest25151-21sshd09:45:595
1254899120,1cyclictest25151-21sshd09:45:595
1253199122,4cyclictest9330-21sshd09:17:233
1253199122,4cyclictest7281-21sshd10:48:123
1253199122,4cyclictest32217-21sshd10:17:593
1253199122,4cyclictest30080-21sshd11:28:343
1253199122,4cyclictest30080-21sshd11:28:343
1253199122,4cyclictest27197-21rm11:22:483
1253199122,4cyclictest27197-21rm11:22:483
1253199122,4cyclictest21913-21sshd10:26:353
1253199122,4cyclictest21913-21sshd10:26:353
1253199122,4cyclictest0-21swapper/312:23:553
12531991211,1cyclictest41-21ksoftirqd/309:38:583
12531991210,1cyclictest0-21swapper/309:47:443
12531991210,1cyclictest0-21swapper/309:47:443
1253199121,5cyclictest6068-21bash10:31:133
1253199121,5cyclictest6068-21bash10:31:133
1253199121,5cyclictest601-21sshd11:04:343
1253199121,5cyclictest17162-21sshd09:14:113
1253199120,11cyclictest21040-21kworker/3:309:24:243
1252199128,3cyclictest33-21ksoftirqd/212:34:362
1252199123,5cyclictest12427-21grep09:49:032
1252199123,5cyclictest12427-21grep09:49:032
12521991211,1cyclictest33-21ksoftirqd/210:40:372
1250599121,5cyclictest3661-21cat07:50:020
1250599121,5cyclictest31450-21ntp_states07:40:080
1250599121,5cyclictest31450-21ntp_states07:40:080
1250599121,3cyclictest9097-21cpu08:00:020
1250599121,2cyclictest4751-21sshd08:47:270
1250599121,2cyclictest26486-21expr08:30:020
1250599120,6cyclictest0-21swapper/008:10:020
1250599120,4cyclictest14247-21nfsd407:10:220
1250599120,4cyclictest0-21swapper/008:40:110
1250599120,4cyclictest0-21swapper/008:35:070
1250599120,4cyclictest0-21swapper/008:20:030
1250599120,4cyclictest0-21swapper/007:45:120
65432110,0sleep70-21swapper/711:51:197
44752110,0sleep70-21swapper/709:46:417
44752110,0sleep70-21swapper/709:46:417
1256499119,1cyclictest73-21ksoftirqd/709:41:257
1256499113,7cyclictest2046-21sshd12:15:157
1256499113,7cyclictest2046-21sshd12:15:157
1256499112,4cyclictest2243-21sshd11:54:517
1256499112,3cyclictest808-21sshd11:32:287
1256499112,3cyclictest0-21swapper/710:55:297
12564991110,1cyclictest0-21swapper/710:22:597
1256499110,11cyclictest31867-21kworker/7:512:37:037
1256499110,11cyclictest31122-21kworker/7:009:28:267
1256499110,11cyclictest11692-21kworker/7:111:41:157
1256499110,10cyclictest4673-21grepconf.sh10:36:427
1255699119,1cyclictest23204-21cut08:24:506
1254899119,1cyclictest57-21ksoftirqd/510:26:445
1254899119,1cyclictest57-21ksoftirqd/510:26:445
1254899119,1cyclictest57-21ksoftirqd/509:57:595
1254899119,1cyclictest57-21ksoftirqd/509:53:515
1254899119,1cyclictest12011-21grepconf.sh09:39:485
1254899115,2cyclictest0-21swapper/509:05:305
1254899114,3cyclictest0-21swapper/507:35:025
1254899110,4cyclictest0-21swapper/508:55:025
1254899110,2cyclictest0-21swapper/511:00:595
1254899110,11cyclictest0-21swapper/510:40:515
1253199119,1cyclictest41-21ksoftirqd/312:33:423
1253199119,1cyclictest41-21ksoftirqd/311:55:083
1253199113,7cyclictest756-21sshd12:06:383
1253199113,7cyclictest464-21systemd-journal10:43:083
1253199112,4cyclictest12670-21sshd12:25:103
1253199112,4cyclictest0-21swapper/310:56:123
12531991110,1cyclictest41-21ksoftirqd/310:38:373
1253199111,4cyclictest32630-21sshd10:14:193
1253199111,4cyclictest32229-21systemd-cgroups09:53:533
1253199111,4cyclictest23565-21sshd12:35:073
1253199111,4cyclictest2312-21sshd11:38:083
1253199110,5cyclictest29395-21grep11:30:183
1253199110,11cyclictest24952-21bash10:51:013
1253199110,11cyclictest16972-21kworker/3:412:16:483
1253199110,11cyclictest16972-21kworker/3:412:16:483
1253199110,11cyclictest12750-21kworker/3:310:08:163
1252199119,2cyclictest33-21ksoftirqd/210:26:462
1252199119,2cyclictest33-21ksoftirqd/210:26:462
1252199119,1cyclictest33-21ksoftirqd/212:14:272
1252199119,1cyclictest33-21ksoftirqd/211:05:342
1252199119,1cyclictest23914-21sshd11:43:062
1252199119,1cyclictest0-21swapper/209:17:352
1252199117,3cyclictest33-21ksoftirqd/209:14:062
1252199116,5cyclictest13550irq/24-ahci[00011:49:182
1252199110,11cyclictest11396-21kworker/2:110:03:252
1250599112,2cyclictest24863-21perl07:30:030
1250599111,4cyclictest8782-21grep08:55:050
1250599111,4cyclictest6204-21grep07:55:030
1250599111,4cyclictest17941-21expr08:15:020
1250599111,2cyclictest15419-21open_inodes09:05:100
1250599110,5cyclictest0-21swapper/009:03:400
1256499109,1cyclictest73-21ksoftirqd/710:01:167
1256499109,1cyclictest21356-21sshd12:03:247
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional