You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 09:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat May 02, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2669099119118,1cyclictest41-21ksoftirqd/321:23:553
2668599920,91cyclictest2932-21kworker/2:221:23:542
106962810,0sleep00-21swapper/022:40:020
26670998031,49cyclictest0-21swapper/021:23:540
199302790,0sleep60-21swapper/623:11:156
161962790,2sleep62670799cyclictest21:37:296
115412720,1sleep51-21systemd22:32:225
26707997113,23cyclictest0-21swapper/621:23:556
2670399710,70cyclictest24620-21kworker/u16:521:23:555
192032700,1sleep319201-21sshd00:30:503
2617825327,9sleep40-21swapper/419:05:054
278972520,1sleep527898-21grep23:41:585
128202500,0sleep40-21swapper/423:22:194
92102480,0sleep49209-21sshd23:31:324
90762480,0sleep20-21swapper/221:44:372
69972470,1sleep36996-21sshd00:35:463
181982470,0sleep40-21swapper/421:26:214
293992460,0sleep40-21swapper/421:17:404
196212460,1sleep019597-21sshd23:03:410
82602450,1sleep126930-21kworker/1:400:07:331
82602450,1sleep126930-21kworker/1:400:07:331
48982450,1sleep44897-21sshd00:37:394
2638824530,11sleep70-21swapper/719:07:567
208282450,0sleep10-21swapper/123:17:031
185622450,1sleep318541-21bash21:31:573
304162440,0sleep70-21swapper/723:51:457
295742440,0sleep20-21swapper/223:08:072
295742440,0sleep20-21swapper/223:08:072
276862440,1sleep627666-21bash21:17:346
92312430,0sleep70-21swapper/700:30:147
203822430,0sleep30-21swapper/323:49:173
174392430,0sleep20-21swapper/221:41:172
229872420,1sleep522984-21bash00:38:455
19762420,2sleep52670399cyclictest20:19:365
27382410,1sleep12742-21grepconf.sh22:14:401
27382410,1sleep12742-21grepconf.sh22:14:401
2645124128,9sleep30-21swapper/319:08:493
204972410,0sleep50-21swapper/522:36:465
41092400,0sleep04106-21sshd22:37:460
284812400,0sleep6631rcuc/621:25:036
2667999400,40cyclictest29362-21kworker/1:521:23:561
2638224029,8sleep10-21swapper/119:07:501
2628524028,8sleep00-21swapper/019:06:290
2626924028,9sleep20-21swapper/219:06:152
2620624028,8sleep50-21swapper/519:05:305
101992400,0sleep00-21swapper/021:54:050
2626423926,9sleep60-21swapper/619:06:116
307852380,0sleep40-21swapper/423:04:254
105722380,0sleep50-21swapper/523:03:065
48712350,0sleep00-21swapper/023:21:510
26713993535,0cyclictest27446-21kworker/7:121:23:557
2669699346,27cyclictest0-21swapper/421:23:554
27352310,1sleep72734-21kill21:42:187
74722290,0sleep20-21swapper/223:38:592
29142210,0sleep30-21swapper/321:49:513
26690992018,1cyclictest41-21ksoftirqd/321:41:333
26690992014,3cyclictest41-21ksoftirqd/322:12:223
26690992012,4cyclictest464-21systemd-journal00:25:023
323522190,0sleep30-21swapper/300:18:323
307682190,1sleep730769-21grepconf.sh23:25:107
2669099197,2cyclictest41-21ksoftirqd/323:10:493
26690991916,1cyclictest41-21ksoftirqd/321:54:563
26690991915,3cyclictest41-21ksoftirqd/323:59:333
26690991914,3cyclictest464-21systemd-journal23:07:183
26690991914,3cyclictest464-21systemd-journal23:07:183
2669099188,2cyclictest41-21ksoftirqd/322:23:323
2669099188,2cyclictest41-21ksoftirqd/322:23:323
2669099187,1cyclictest41-21ksoftirqd/321:45:413
26690991816,1cyclictest464-21systemd-journal00:02:223
26690991816,1cyclictest41-21ksoftirqd/323:32:553
26690991815,2cyclictest41-21ksoftirqd/300:20:003
26690991815,1cyclictest41-21ksoftirqd/322:35:093
26690991815,1cyclictest41-21ksoftirqd/322:02:213
26690991814,3cyclictest41-21ksoftirqd/323:24:133
26690991814,3cyclictest41-21ksoftirqd/300:07:373
26690991814,3cyclictest41-21ksoftirqd/300:07:373
26690991812,4cyclictest41-21ksoftirqd/322:27:193
2669099181,3cyclictest41-21ksoftirqd/322:47:523
2669099176,2cyclictest41-21ksoftirqd/323:16:233
26690991715,1cyclictest41-21ksoftirqd/322:58:513
26690991715,1cyclictest41-21ksoftirqd/322:08:293
26690991715,1cyclictest41-21ksoftirqd/321:38:093
26690991714,3cyclictest41-21ksoftirqd/300:09:383
26690991714,2cyclictest41-21ksoftirqd/323:54:223
26690991713,4cyclictest41-21ksoftirqd/321:25:333
26690991711,4cyclictest41-21ksoftirqd/323:26:543
88652160,0sleep60-21swapper/622:13:096
43562160,0sleep50-21swapper/522:28:055
26713991611,4cyclictest18546-21sshd22:26:557
2670399160,0cyclictest0-21swapper/521:11:085
2669099165,1cyclictest41-21ksoftirqd/323:41:003
2669099162,2cyclictest131rcu_sched21:14:413
26690991614,1cyclictest41-21ksoftirqd/323:36:103
26690991614,1cyclictest41-21ksoftirqd/322:39:383
26690991614,1cyclictest41-21ksoftirqd/321:11:023
2667999160,11cyclictest8373-21systemd23:08:471
2667999160,11cyclictest8373-21systemd23:08:471
2667999160,0cyclictest0-21swapper/121:11:081
241172160,0sleep10-21swapper/121:49:171
2670799150,14cyclictest857-21polkitd22:50:536
2670799150,14cyclictest18438-21systemd-cgroups23:35:486
26690991513,1cyclictest41-21ksoftirqd/323:00:243
26690991513,1cyclictest41-21ksoftirqd/322:50:293
26690991511,1cyclictest41-21ksoftirqd/322:29:523
2669099151,2cyclictest41-21ksoftirqd/322:14:563
2669099151,2cyclictest41-21ksoftirqd/322:14:563
26685991513,1cyclictest33-21ksoftirqd/200:36:522
26685991513,1cyclictest33-21ksoftirqd/200:28:302
2668599150,14cyclictest2932-21kworker/2:221:28:502
2667099150,14cyclictest721-21dbus-daemon00:06:430
2667099150,14cyclictest721-21dbus-daemon00:06:430
146812150,0sleep00-21swapper/021:41:070
61262140,1sleep76083-21systemd22:41:457
26707991413,1cyclictest65-21ksoftirqd/622:38:426
26707991412,1cyclictest65-21ksoftirqd/623:50:336
26703991412,1cyclictest57-21ksoftirqd/523:10:505
2668599148,1cyclictest33-21ksoftirqd/223:15:472
26685991412,1cyclictest33-21ksoftirqd/222:17:422
26685991412,1cyclictest33-21ksoftirqd/222:17:422
26685991412,1cyclictest33-21ksoftirqd/221:19:072
26685991411,2cyclictest33-21ksoftirqd/222:24:472
26685991411,1cyclictest33-21ksoftirqd/222:33:582
26685991410,3cyclictest33-21ksoftirqd/223:39:362
2667999140,10cyclictest32196-21sshd22:52:511
2667999140,10cyclictest2207-21httpd00:10:351
16692140,2sleep72671399cyclictest21:38:347
142782140,2sleep52670399cyclictest22:40:155
296052130,0sleep70-21swapper/719:14:367
282492130,0sleep5561ktimersoftd/521:56:585
274402130,2sleep42669699cyclictest00:29:304
26713991312,1cyclictest73-21ksoftirqd/700:35:577
2670799136,6cyclictest16394-21bash00:04:196
2670799132,5cyclictest1-21systemd00:06:566
2670799132,5cyclictest1-21systemd00:06:566
26707991311,1cyclictest65-21ksoftirqd/622:19:256
26707991311,1cyclictest65-21ksoftirqd/622:19:256
2670399130,12cyclictest13718-21kworker/5:421:43:155
2669699135,7cyclictest26664-21sshd23:47:424
2669699133,4cyclictest6030-21sshd21:40:364
26696991311,1cyclictest49-21ksoftirqd/423:52:064
26696991311,1cyclictest49-21ksoftirqd/400:07:464
26696991311,1cyclictest49-21ksoftirqd/400:07:464
26696991310,2cyclictest2976-21bash21:34:474
26685991311,1cyclictest33-21ksoftirqd/223:22:302
26685991311,1cyclictest33-21ksoftirqd/222:48:142
26685991311,1cyclictest33-21ksoftirqd/222:00:272
26685991311,1cyclictest33-21ksoftirqd/221:50:142
26685991311,1cyclictest33-21ksoftirqd/200:10:232
26685991310,3cyclictest33-21ksoftirqd/221:29:512
26685991310,1cyclictest33-21ksoftirqd/223:57:562
2668599130,13cyclictest2714-21kworker/2:123:48:362
2667999132,1cyclictest857-21polkitd22:32:401
220352130,0sleep20-21swapper/222:42:442
162502130,0sleep50-21swapper/521:54:265
321082120,0sleep40-21swapper/423:42:134
299712120,0sleep40-21swapper/422:16:114
299712120,0sleep40-21swapper/422:16:114
2671399125,4cyclictest709-21systemd-logind22:13:177
2671399122,4cyclictest24854-21sshd22:06:217
26713991210,1cyclictest73-21ksoftirqd/723:38:287
26713991210,1cyclictest73-21ksoftirqd/721:51:287
26713991210,1cyclictest73-21ksoftirqd/721:29:187
2670799127,2cyclictest1-21systemd22:24:476
2670799122,4cyclictest9718-21sshd22:47:416
2670799122,4cyclictest9408-21sshd23:33:276
2670799122,4cyclictest721-21dbus-daemon23:42:406
2670799122,4cyclictest11720-21sshd23:25:576
2670799122,4cyclictest0-21swapper/623:57:166
2670799122,4cyclictest0-21swapper/622:43:456
26707991210,1cyclictest730-21NetworkManager23:22:456
2670799121,5cyclictest7024-21cp22:01:206
2670799120,2cyclictest28648-21id21:34:266
2670799120,12cyclictest10813-21kworker/6:022:33:546
2670799120,11cyclictest4102-21systemd21:49:536
2670799120,11cyclictest25447-21kworker/6:323:02:446
2670799120,11cyclictest1-21systemd00:27:146
2670399122,4cyclictest721-21dbus-daemon23:48:555
2670399121,5cyclictest0-21swapper/522:49:235
2670399120,12cyclictest21625-21kworker/5:323:09:005
2670399120,12cyclictest21625-21kworker/5:323:09:005
2669699129,1cyclictest49-21ksoftirqd/423:16:244
2669699123,4cyclictest0-21swapper/422:49:074
2669699122,4cyclictest721-21dbus-daemon21:45:414
2669699122,4cyclictest23857-21sshd22:14:024
2669699122,4cyclictest13086-21sshd22:30:254
2669699122,4cyclictest0-21swapper/400:14:234
26696991211,1cyclictest49-21ksoftirqd/400:21:574
26696991210,1cyclictest49-21ksoftirqd/400:00:254
2669699121,5cyclictest2993-21grep23:36:484
2669699120,1cyclictest15753-21sshd00:15:364
2669099120,11cyclictest0-21swapper/320:44:543
2668599129,2cyclictest1-21systemd22:08:202
2668599128,3cyclictest33-21ksoftirqd/223:10:032
2668599128,3cyclictest33-21ksoftirqd/200:32:502
2668599122,5cyclictest721-21dbus-daemon21:38:002
2668599122,4cyclictest736-21gdbus22:22:192
2668599122,4cyclictest736-21gdbus22:22:192
26685991211,1cyclictest33-21ksoftirqd/222:51:452
26685991210,2cyclictest33-21ksoftirqd/222:59:582
26685991210,1cyclictest33-21ksoftirqd/222:59:302
2668599120,12cyclictest13220-21kworker/2:223:51:392
2668599120,11cyclictest721-21dbus-daemon21:10:292
2667999125,6cyclictest25-21ksoftirqd/100:21:261
26679991211,1cyclictest25-21ksoftirqd/123:52:371
26679991210,1cyclictest25-21ksoftirqd/123:58:231
2667999120,11cyclictest9498-21kworker/1:100:38:531
2667999120,11cyclictest3706-21grepconf.sh00:26:111
2667099122,4cyclictest27938-21systemd-cgroups22:58:200
2667099122,4cyclictest24012-21systemd-cgroups22:00:240
26670991211,1cyclictest9-21ksoftirqd/023:05:010
26670991211,1cyclictest9-21ksoftirqd/023:05:010
26670991210,1cyclictest9-21ksoftirqd/021:32:330
2667099120,6cyclictest709-21systemd-logind23:18:400
2667099120,2cyclictest23634-21sshd22:08:160
2667099120,11cyclictest23276-21kworker/0:223:34:360
239222120,2sleep62670799cyclictest22:19:416
239222120,2sleep62670799cyclictest22:19:416
201402120,0sleep60-21swapper/600:30:536
200082120,0sleep2311rcuc/223:32:102
167642120,0sleep40-21swapper/423:05:214
167642120,0sleep40-21swapper/423:05:214
167642120,0sleep10-21swapper/100:19:341
300602110,0sleep1231rcuc/121:28:591
298942110,0sleep50-21swapper/523:51:435
2671399119,1cyclictest73-21ksoftirqd/723:30:087
2671399119,1cyclictest73-21ksoftirqd/723:15:117
2671399119,1cyclictest73-21ksoftirqd/723:09:127
2671399119,1cyclictest73-21ksoftirqd/723:09:127
2671399119,1cyclictest73-21ksoftirqd/722:32:347
2671399119,1cyclictest73-21ksoftirqd/722:23:407
2671399119,1cyclictest73-21ksoftirqd/722:23:407
2671399118,2cyclictest19011-21bash22:02:037
2671399117,3cyclictest73-21ksoftirqd/700:26:587
2671399115,2cyclictest11588-21bash21:44:467
2671399114,4cyclictest10025-21sshd23:12:357
2671399113,7cyclictest15492-21systemd-cgroups00:11:467
2671399110,1cyclictest27641-21sshd00:18:167
2670799119,1cyclictest0-21swapper/619:14:556
2670799113,7cyclictest5593-21grepconf.sh23:18:066
2670799113,7cyclictest32681-21sshd21:47:536
2670799113,2cyclictest1607-21cp00:16:416
26707991110,1cyclictest65-21ksoftirqd/623:48:536
2670799111,4cyclictest3284-21bash23:06:306
2670799111,4cyclictest3284-21bash23:06:306
2670799111,4cyclictest0-21swapper/600:11:596
2670799110,11cyclictest9301-21kworker/6:300:19:376
2670799110,11cyclictest4042-21kworker/6:521:40:196
2670799110,11cyclictest27171-21kworker/6:300:35:336
2670799110,11cyclictest21961-21kworker/6:222:56:456
2670799110,10cyclictest20625-21kworker/6:621:55:126
2670399119,1cyclictest57-21ksoftirqd/500:11:125
2670399112,3cyclictest0-21swapper/523:59:185
26703991110,1cyclictest9853-21sshd21:59:425
26703991110,1cyclictest721-21dbus-daemon00:27:065
2670399111,4cyclictest859-21gdbus00:15:035
2670399111,4cyclictest0-21swapper/500:20:195
2670399110,5cyclictest29237-21systemd22:21:485
2670399110,5cyclictest29237-21systemd22:21:485
2670399110,5cyclictest1095-21sshd22:56:485
2670399110,11cyclictest8851-21kworker/5:121:39:135
2670399110,11cyclictest22660-21kworker/5:321:31:375
2670399110,11cyclictest16320-21kworker/5:200:05:525
2670399110,11cyclictest16320-21kworker/5:200:05:525
2670399110,11cyclictest10938-21kworker/5:423:17:525
2670399110,10cyclictest0-21swapper/523:33:585
2669699119,1cyclictest49-21ksoftirqd/422:38:114
2669699114,6cyclictest721-21dbus-daemon22:08:424
2669699111,4cyclictest8633-21sshd22:03:324
2669699111,4cyclictest32574-21bash22:41:234
2669699111,4cyclictest18286-21sshd21:50:414
2669699111,4cyclictest15067-21bash22:57:344
2669699111,4cyclictest12072-21grep21:33:294
2669699110,11cyclictest32298-21kworker/4:300:31:494
2669099119,1cyclictest41-21ksoftirqd/321:09:363
2668599118,2cyclictest33-21ksoftirqd/200:19:452
2668599117,2cyclictest33-21ksoftirqd/200:07:462
2668599117,2cyclictest33-21ksoftirqd/200:07:462
2668599112,6cyclictest0-21swapper/200:02:542
2668599112,4cyclictest6797-21grepconf.sh00:14:582
2668599112,3cyclictest20862-21sshd22:34:532
2668599110,5cyclictest30958-21systemd23:25:112
2668599110,2cyclictest131rcu_sched22:13:592
2667999119,1cyclictest25-21ksoftirqd/121:59:481
2667999119,1cyclictest0-21swapper/100:00:101
2667999112,4cyclictest16616-21sshd21:52:291
26679991110,1cyclictest25-21ksoftirqd/122:35:431
26679991110,1cyclictest0-21swapper/122:23:411
26679991110,1cyclictest0-21swapper/122:23:411
2667999110,11cyclictest9665-21kworker/1:222:13:221
2667999110,11cyclictest3092-21kworker/1:421:32:311
2667999110,11cyclictest22218-21kworker/1:323:10:381
2667999110,10cyclictest26905-21sshd21:58:471
2667999110,1cyclictest27851-21systemd-cgroups00:31:231
2667099113,7cyclictest19563-21sshd23:34:040
2667099112,4cyclictest0-21swapper/021:49:120
2667099111,4cyclictest7852-21cp21:18:200
2667099111,4cyclictest2548-21grepconf.sh22:18:260
2667099111,4cyclictest2548-21grepconf.sh22:18:260
2667099111,4cyclictest12662-21systemd-cgroups23:54:370
2667099110,5cyclictest25396-21sshd22:50:290
2667099110,11cyclictest28647-21kworker/0:023:50:530
2667099110,11cyclictest17941-21kworker/0:021:12:510
2667099110,10cyclictest28647-21kworker/0:023:45:290
23472110,0sleep50-21swapper/523:25:245
137962110,0sleep50-21swapper/522:51:445
2671399108,1cyclictest73-21ksoftirqd/722:18:207
2671399108,1cyclictest73-21ksoftirqd/722:18:207
2671399106,2cyclictest721-21dbus-daemon22:37:467
2671399106,1cyclictest6330-21sshd22:45:337
2671399104,3cyclictest11433-21sshd22:51:367
2671399104,3cyclictest0-21swapper/723:48:457
2671399104,2cyclictest25822-21grep21:11:217
2671399103,4cyclictest857-21polkitd21:15:337
2671399103,4cyclictest709-21systemd-logind21:33:237
2671399103,4cyclictest709-21systemd-logind00:23:177
2671399103,4cyclictest18719-21sd-pam21:56:247
2671399103,3cyclictest5056-21bash23:21:517
2671399102,3cyclictest709-21systemd-logind23:59:077
2671399100,9cyclictest22713-21kworker/7:100:03:117
2670799108,1cyclictest65-21ksoftirqd/622:07:326
2670799102,2cyclictest1-21systemd21:09:586
2670399108,1cyclictest57-21ksoftirqd/521:28:595
2670399100,4cyclictest16487-21sshd00:00:255
2670399100,4cyclictest0-21swapper/523:22:205
2670399100,10cyclictest31400-21kworker/5:323:35:095
2670399100,10cyclictest10268-21kworker/5:121:19:345
2669699107,2cyclictest22831-21grepconf.sh21:54:484
2669699104,2cyclictest27897-21grepconf.sh23:09:514
2669699103,6cyclictest1984-21sshd22:51:024
2669699103,1cyclictest857-21polkitd22:25:574
2669699103,1cyclictest0-21swapper/423:55:504
2669699101,4cyclictest10547-21sshd21:12:354
2669699100,9cyclictest26037-21kworker/4:223:27:314
2669699100,4cyclictest31612-21systemd-cgroups22:21:574
2669699100,4cyclictest31612-21systemd-cgroups22:21:574
2669099108,1cyclictest41-21ksoftirqd/320:59:363
2668599103,4cyclictest721-21dbus-daemon21:56:282
2667999109,1cyclictest1-21systemd23:01:131
2667999109,1cyclictest0-21swapper/120:19:461
2667999103,2cyclictest10004-21systemd23:46:411
2667999103,1cyclictest857-21polkitd23:19:521
2667999100,4cyclictest7465-21systemd-cgroups22:43:491
2667999100,4cyclictest0-21swapper/123:35:331
2667999100,4cyclictest0-21swapper/123:26:491
2667999100,10cyclictest9665-21kworker/1:222:07:171
2667999100,10cyclictest3369-21kworker/1:222:55:241
2667999100,10cyclictest3092-21kworker/1:421:43:161
2667099108,1cyclictest9-21ksoftirqd/022:10:150
2667099103,6cyclictest904-21sshd22:24:010
2667099103,6cyclictest904-21sshd22:24:010
2667099103,6cyclictest721-21dbus-daemon00:11:160
2667099103,1cyclictest859-21gdbus00:37:440
2667099102,7cyclictest30791-21systemd23:27:070
2667099102,2cyclictest31165-21systemd22:31:330
2667099101,4cyclictest21166-21sshd23:41:340
2667099100,9cyclictest8766-21kworker/0:000:29:480
2667099100,4cyclictest709-21systemd-logind23:12:420
2667099100,4cyclictest26163-21sshd22:46:450
2667099100,4cyclictest1320-21sshd00:14:470
2667099100,10cyclictest3754-21kworker/0:622:25:420
2667099100,10cyclictest10919-21kworker/0:421:27:110
267139997,1cyclictest73-21ksoftirqd/723:39:367
267139997,1cyclictest0-21swapper/719:49:477
267139994,1cyclictest3577-21smart_sda22:54:577
267139994,1cyclictest16319-21systemd00:08:037
267139994,1cyclictest16319-21systemd00:08:037
267139990,8cyclictest7007-21kworker/7:423:03:027
267039997,1cyclictest57-21ksoftirqd/522:09:565
267039992,6cyclictest0-21swapper/500:30:125
266909997,1cyclictest41-21ksoftirqd/321:04:363
266799998,1cyclictest0-21swapper/122:46:231
266799997,1cyclictest25-21ksoftirqd/123:33:411
266799993,6cyclictest0-21swapper/123:40:201
266799993,1cyclictest1842-21nfsd21:15:421
266799992,6cyclictest721-21dbus-daemon21:37:071
266709997,1cyclictest9-21ksoftirqd/021:56:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional