You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 10:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Apr 24, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
85382880,0sleep51-21systemd21:44:425
265582750,1sleep233-21ksoftirqd/223:29:552
195642710,2sleep32519099cyclictest21:50:483
248022570,0sleep10-21swapper/122:56:141
322602520,0sleep60-21swapper/622:28:486
217862510,0sleep20-21swapper/222:52:222
2495625038,8sleep70-21swapper/719:09:107
302792490,0sleep4758-21runrttasks21:29:114
290002490,1sleep2311rcuc/221:36:302
112352490,1sleep7721-21dbus-daemon22:53:407
110092490,0sleep50-21swapper/522:29:275
226632470,0sleep50-21swapper/522:02:125
207312460,0sleep60-21swapper/623:05:166
2488424534,8sleep20-21swapper/219:08:092
2473324533,9sleep50-21swapper/519:06:115
240022450,0sleep50-21swapper/522:48:495
232052450,0sleep40-21swapper/423:44:394
209502450,0sleep50-21swapper/500:29:255
314812440,0sleep50-21swapper/521:32:565
229342440,0sleep70-21swapper/723:29:447
229342440,0sleep70-21swapper/723:29:447
156482440,0sleep60-21swapper/623:23:426
122862440,0sleep412278-21sshd22:50:004
256192430,0sleep50-21swapper/523:39:115
142522430,0sleep50-21swapper/521:54:195
327062420,0sleep70-21swapper/722:58:367
287242420,0sleep10-21swapper/121:49:341
287242420,0sleep10-21swapper/121:49:341
249282420,0sleep60-21swapper/621:11:436
158892420,0sleep50-21swapper/523:40:235
65662410,0sleep70-21swapper/723:41:457
287482410,1sleep128737-21bash21:30:521
27012410,0sleep50-21swapper/521:23:515
237082410,2sleep12517899cyclictest23:35:141
17892410,0sleep70-21swapper/722:36:187
159512410,0sleep40-21swapper/421:35:444
121742410,2sleep22518599cyclictest22:03:292
2496124027,9sleep30-21swapper/319:09:143
324172390,0sleep10-21swapper/122:36:121
272462390,0sleep7663-21in:imjournal23:48:347
2494423927,8sleep60-21swapper/619:09:016
2478923926,9sleep00-21swapper/019:06:540
2478423928,8sleep40-21swapper/419:06:504
314542380,0sleep10-21swapper/100:35:291
2479423827,8sleep10-21swapper/119:06:551
25178992214,3cyclictest25-21ksoftirqd/122:32:261
25178992214,3cyclictest25-21ksoftirqd/122:32:261
2517899208,3cyclictest25-21ksoftirqd/121:16:441
2517899208,1cyclictest25-21ksoftirqd/100:18:541
2517899206,1cyclictest25-21ksoftirqd/123:27:001
2517899206,1cyclictest25-21ksoftirqd/123:27:001
25178992015,3cyclictest25-21ksoftirqd/122:49:121
2517899199,1cyclictest25-21ksoftirqd/123:30:381
2517899197,1cyclictest25-21ksoftirqd/121:35:141
2517899196,2cyclictest25-21ksoftirqd/100:21:451
2517899196,1cyclictest25-21ksoftirqd/121:22:371
2517899195,1cyclictest25-21ksoftirqd/121:44:451
25178991915,3cyclictest25-21ksoftirqd/122:10:111
25178991914,3cyclictest25-21ksoftirqd/100:31:571
2518599180,17cyclictest24402-21kworker/2:023:29:162
2518599180,17cyclictest24402-21kworker/2:023:29:162
2517899188,2cyclictest131rcu_sched21:56:021
2517899187,3cyclictest25-21ksoftirqd/123:45:071
2517899187,1cyclictest25-21ksoftirqd/100:01:031
2517899186,3cyclictest25-21ksoftirqd/100:10:551
2517899185,4cyclictest25-21ksoftirqd/122:09:131
2517899185,2cyclictest25-21ksoftirqd/123:02:431
25178991816,1cyclictest25-21ksoftirqd/123:20:141
25178991816,1cyclictest25-21ksoftirqd/122:50:051
25178991814,1cyclictest25-21ksoftirqd/122:20:401
25178991813,3cyclictest25-21ksoftirqd/122:16:471
25178991812,4cyclictest25-21ksoftirqd/121:52:001
197332180,0sleep60-21swapper/621:39:466
2517899175,1cyclictest131rcu_sched23:51:221
25178991715,1cyclictest25-21ksoftirqd/122:25:001
25178991715,1cyclictest25-21ksoftirqd/100:05:581
25178991714,1cyclictest25-21ksoftirqd/123:41:071
25178991713,3cyclictest25-21ksoftirqd/123:05:501
25178991713,1cyclictest25-21ksoftirqd/123:55:051
25178991711,4cyclictest25-21ksoftirqd/123:12:241
2517899171,1cyclictest25-21ksoftirqd/100:28:041
91692160,0sleep5561ktimersoftd/522:05:085
257392160,1sleep2311rcuc/223:48:292
25202991613,2cyclictest1-21systemd22:11:245
25202991611,3cyclictest57-21ksoftirqd/522:42:035
2518599160,16cyclictest0-21swapper/222:06:472
25178991614,1cyclictest25-21ksoftirqd/122:41:041
25178991613,1cyclictest25-21ksoftirqd/121:13:231
2517899161,3cyclictest25-21ksoftirqd/121:25:071
2517899161,1cyclictest25-21ksoftirqd/122:02:341
2517899161,1cyclictest131rcu_sched23:17:241
25173991615,1cyclictest9-21ksoftirqd/000:20:210
112102160,1sleep233-21ksoftirqd/223:57:022
98762150,0sleep70-21swapper/700:10:047
25212991510,1cyclictest73-21ksoftirqd/700:37:207
25207991513,1cyclictest65-21ksoftirqd/623:29:206
25207991513,1cyclictest65-21ksoftirqd/623:29:206
25202991513,2cyclictest31048-21sshd21:59:015
25195991511,1cyclictest49-21ksoftirqd/423:19:144
25173991513,1cyclictest9-21ksoftirqd/021:53:540
25173991513,1cyclictest5980-21sshd22:14:180
25173991512,1cyclictest9-21ksoftirqd/023:21:010
174232150,1sleep517426-21bash22:54:025
97182140,0sleep20-21swapper/200:21:132
304862140,1sleep3758-21runrttasks23:43:093
25212991413,1cyclictest73-21ksoftirqd/722:41:167
25212991412,1cyclictest73-21ksoftirqd/722:31:157
25212991412,1cyclictest73-21ksoftirqd/722:31:157
2520299148,3cyclictest57-21ksoftirqd/523:24:075
2520299146,6cyclictest2257-21cp00:17:055
25202991412,1cyclictest57-21ksoftirqd/523:13:405
25202991412,1cyclictest57-21ksoftirqd/521:47:125
25202991412,1cyclictest57-21ksoftirqd/521:47:125
25202991412,1cyclictest57-21ksoftirqd/500:39:115
25202991411,1cyclictest28155-21sshd23:54:175
25202991410,1cyclictest57-21ksoftirqd/500:11:315
25190991411,2cyclictest41-21ksoftirqd/323:00:063
25190991411,1cyclictest31294-21sshd21:27:193
25173991412,2cyclictest9-21ksoftirqd/000:01:520
25173991412,1cyclictest9935-21sshd23:49:280
25173991412,1cyclictest9-21ksoftirqd/022:18:080
25173991412,1cyclictest9-21ksoftirqd/021:38:160
25173991412,1cyclictest9-21ksoftirqd/021:28:320
165222140,0sleep20-21swapper/200:01:022
104502140,0sleep40-21swapper/423:47:354
52652130,0sleep00-21swapper/023:28:410
52652130,0sleep00-21swapper/023:28:410
274292130,0sleep20-21swapper/222:32:122
274292130,0sleep20-21swapper/222:32:122
2521299139,3cyclictest73-21ksoftirqd/723:37:187
25212991311,1cyclictest73-21ksoftirqd/723:20:487
25212991311,1cyclictest73-21ksoftirqd/722:14:337
25212991311,1cyclictest73-21ksoftirqd/721:37:417
25212991311,1cyclictest73-21ksoftirqd/700:17:507
25212991311,1cyclictest73-21ksoftirqd/700:04:247
2520799132,5cyclictest31575-21systemd23:32:006
2520799132,5cyclictest17345-21sshd21:48:546
2520799132,5cyclictest17345-21sshd21:48:546
2520799131,5cyclictest12513-21sshd22:44:276
25202991312,1cyclictest57-21ksoftirqd/523:01:265
25202991311,1cyclictest57-21ksoftirqd/522:18:565
25202991311,1cyclictest57-21ksoftirqd/500:21:525
2519599139,4cyclictest49-21ksoftirqd/400:36:544
25195991312,1cyclictest49-21ksoftirqd/423:12:594
25195991311,1cyclictest49-21ksoftirqd/423:08:434
25195991311,1cyclictest49-21ksoftirqd/422:15:074
25195991311,1cyclictest49-21ksoftirqd/421:34:534
25195991310,2cyclictest49-21ksoftirqd/421:54:094
2519599130,13cyclictest0-21swapper/422:06:254
2519599130,12cyclictest17902-21kworker/4:022:13:354
2519099139,1cyclictest41-21ksoftirqd/300:17:193
2519099138,1cyclictest41-21ksoftirqd/322:53:253
25190991311,1cyclictest41-21ksoftirqd/322:07:263
2519099130,1cyclictest3352-21sshd23:50:513
2518599133,4cyclictest26502-21sshd23:20:312
25185991311,1cyclictest33-21ksoftirqd/223:49:592
2517399138,3cyclictest9-21ksoftirqd/000:06:320
2517399138,1cyclictest9-21ksoftirqd/022:49:420
25173991312,1cyclictest9-21ksoftirqd/023:59:020
25173991312,1cyclictest9-21ksoftirqd/021:30:020
25173991311,2cyclictest30484-21sshd00:16:500
25173991311,1cyclictest9-21ksoftirqd/023:52:330
25173991311,1cyclictest9-21ksoftirqd/023:00:100
25173991311,1cyclictest9-21ksoftirqd/022:37:530
25173991311,1cyclictest30432-21sshd21:09:580
25173991310,2cyclictest9-21ksoftirqd/023:31:370
2517399130,12cyclictest18064-21kworker/0:123:13:130
251402130,0sleep40-21swapper/423:27:574
251402130,0sleep40-21swapper/423:27:574
242422130,0sleep70-21swapper/721:17:377
287002120,0sleep20-21swapper/221:21:322
25212991211,1cyclictest73-21ksoftirqd/723:01:457
25212991211,1cyclictest73-21ksoftirqd/721:24:027
25212991210,1cyclictest73-21ksoftirqd/722:08:087
25212991210,1cyclictest73-21ksoftirqd/721:43:567
25212991210,1cyclictest73-21ksoftirqd/700:30:567
25212991210,1cyclictest73-21ksoftirqd/700:05:107
25212991210,1cyclictest464-21systemd-journal00:22:447
25212991210,1cyclictest0-21swapper/722:28:457
2521299120,11cyclictest28344-21bash23:31:497
2521299120,11cyclictest0-21swapper/723:10:327
2520799123,8cyclictest857-21polkitd21:20:286
2520799123,6cyclictest721-21dbus-daemon21:26:526
2520799122,4cyclictest28443-21grep22:10:026
2520799122,4cyclictest26738-21sshd00:05:196
2520799122,4cyclictest23367-21sshd00:27:396
2520799122,4cyclictest20753-21sshd21:30:246
2520799122,4cyclictest19336-21sshd23:01:306
25207991211,1cyclictest65-21ksoftirqd/600:01:336
2520799121,5cyclictest3271-21bash22:53:116
2520799121,5cyclictest28847-21sshd22:30:226
2520799121,5cyclictest28847-21sshd22:30:226
2520799121,5cyclictest22398-21grepconf.sh21:58:306
2520799121,5cyclictest1-21systemd23:19:386
2520799120,11cyclictest22333-21systemctl23:51:596
2520299129,2cyclictest57-21ksoftirqd/521:35:455
2520299129,2cyclictest57-21ksoftirqd/521:17:595
2520299129,2cyclictest4737-21sshd23:24:575
2520299129,2cyclictest4737-21sshd23:24:575
25202991210,1cyclictest57-21ksoftirqd/523:56:455
25202991210,1cyclictest57-21ksoftirqd/523:16:395
25202991210,1cyclictest57-21ksoftirqd/523:06:025
25202991210,1cyclictest57-21ksoftirqd/521:29:085
25202991210,1cyclictest21956-21sshd22:20:415
2520299120,12cyclictest5718-21kworker/5:500:30:025
2519599128,1cyclictest49-21ksoftirqd/423:57:084
2519599126,3cyclictest8719-21sshd23:30:394
2519599123,5cyclictest8120-21sshd23:53:044
25195991211,1cyclictest49-21ksoftirqd/421:23:474
25195991210,1cyclictest49-21ksoftirqd/422:58:014
25195991210,1cyclictest49-21ksoftirqd/421:49:154
25195991210,1cyclictest49-21ksoftirqd/421:49:154
25195991210,1cyclictest49-21ksoftirqd/421:14:544
25195991210,1cyclictest49-21ksoftirqd/400:27:414
25195991210,1cyclictest49-21ksoftirqd/400:12:054
25195991210,1cyclictest49-21ksoftirqd/400:07:164
2519599120,11cyclictest22321-21sshd22:37:314
2519599120,11cyclictest17902-21kworker/4:022:40:384
2519099122,4cyclictest26060-21sshd21:19:373
2519099122,4cyclictest15303-21grepconf.sh22:01:463
25190991210,1cyclictest41-21ksoftirqd/323:38:103
2518599124,7cyclictest0-21swapper/222:14:062
2518599122,4cyclictest639-21systemd-cgroups00:16:592
25185991211,1cyclictest33-21ksoftirqd/223:16:082
25185991210,1cyclictest33-21ksoftirqd/222:35:332
25178991212,0cyclictest28881-21kworker/1:019:31:571
25178991211,1cyclictest28881-21kworker/1:020:46:291
25173991211,1cyclictest9-21ksoftirqd/022:44:050
25173991211,1cyclictest9-21ksoftirqd/022:33:580
25173991211,1cyclictest9-21ksoftirqd/022:33:580
25173991210,1cyclictest9-21ksoftirqd/022:28:280
25173991210,1cyclictest9-21ksoftirqd/021:16:430
25173991210,1cyclictest9-21ksoftirqd/000:12:000
2517399121,5cyclictest721-21dbus-daemon22:51:150
2517399120,2cyclictest131rcu_sched23:07:540
193792120,0sleep20-21swapper/221:56:242
191922120,0sleep60-21swapper/600:12:286
2521299119,1cyclictest73-21ksoftirqd/723:09:537
2521299119,1cyclictest73-21ksoftirqd/722:48:217
2521299119,1cyclictest73-21ksoftirqd/722:24:177
2521299119,1cyclictest73-21ksoftirqd/722:15:117
2521299119,1cyclictest73-21ksoftirqd/722:00:297
2521299119,1cyclictest73-21ksoftirqd/721:58:417
2521299118,2cyclictest73-21ksoftirqd/721:10:307
2521299116,3cyclictest17490-21grepconf.sh00:25:227
2521299114,4cyclictest1803-21sshd23:56:297
25212991110,1cyclictest73-21ksoftirqd/721:26:257
2521299110,11cyclictest0-21swapper/723:17:557
2521299110,10cyclictest21488-21gltestperf20:55:067
2520799119,1cyclictest28028-21grep22:06:126
2520799119,1cyclictest26653-21systemd23:37:196
2520799115,2cyclictest857-21polkitd22:15:086
2520799113,7cyclictest30979-21id21:53:246
2520799112,4cyclictest25162-21sshd21:40:046
2520799112,4cyclictest0-21swapper/621:15:466
25207991110,1cyclictest3456-21sshd22:21:296
25207991110,1cyclictest0-21swapper/623:57:306
2520799111,4cyclictest596-21sd-pam00:24:306
2520799111,4cyclictest19194-21systemd-cgroups22:37:206
2520799111,4cyclictest10402-21sshd22:03:236
2520799111,4cyclictest0-21swapper/623:42:296
2520799111,4cyclictest0-21swapper/600:31:116
2520799111,4cyclictest0-21swapper/600:16:406
2520799110,5cyclictest1700-21cp23:11:406
2520299119,1cyclictest57-21ksoftirqd/522:32:245
2520299119,1cyclictest57-21ksoftirqd/522:32:245
2520299119,1cyclictest57-21ksoftirqd/500:00:025
2520299119,1cyclictest32075-21sshd21:14:225
2520299119,1cyclictest15857-21sshd22:59:315
2520299119,1cyclictest11871-21sshd22:35:055
25202991110,1cyclictest57-21ksoftirqd/523:32:235
2519599119,1cyclictest736-21gdbus22:31:414
2519599119,1cyclictest736-21gdbus22:31:414
2519599119,1cyclictest721-21dbus-daemon22:03:184
2519599119,1cyclictest49-21ksoftirqd/422:28:214
25195991110,1cyclictest49-21ksoftirqd/423:36:114
25195991110,1cyclictest49-21ksoftirqd/423:03:354
25195991110,1cyclictest49-21ksoftirqd/421:44:194
2519599111,4cyclictest3966-21kworker/u16:321:54:554
2519599110,1cyclictest0-21swapper/421:19:384
2519099119,1cyclictest41-21ksoftirqd/323:13:093
2519099119,1cyclictest41-21ksoftirqd/300:20:153
2519099119,1cyclictest41-21ksoftirqd/300:10:173
2519099114,6cyclictest16972-21sshd23:23:473
2519099113,4cyclictest9693-21sshd23:49:273
2519099112,4cyclictest3115-21sshd23:28:333
2519099112,4cyclictest3115-21sshd23:28:333
2519099112,4cyclictest0-21swapper/323:58:543
2519099111,4cyclictest1-21systemd00:06:423
2519099111,4cyclictest0-21swapper/321:47:543
2519099111,4cyclictest0-21swapper/321:47:543
2519099110,5cyclictest23344-21cp23:16:383
2519099110,10cyclictest0-21swapper/300:01:013
2518599119,1cyclictest8897-21systemd-cgroups23:12:052
2518599119,1cyclictest33-21ksoftirqd/200:35:152
2518599112,4cyclictest0-21swapper/221:31:182
2518599110,11cyclictest29070-21kworker/2:022:45:102
2518599110,11cyclictest11322-21kworker/2:100:10:382
2517899119,1cyclictest25-21ksoftirqd/121:09:541
25178991111,0cyclictest28881-21kworker/1:021:02:051
25178991111,0cyclictest28881-21kworker/1:021:02:051
25178991111,0cyclictest28881-21kworker/1:020:25:411
25178991111,0cyclictest28881-21kworker/1:019:52:451
25178991110,1cyclictest28881-21kworker/1:020:07:071
25178991110,1cyclictest28881-21kworker/1:019:41:071
25178991110,1cyclictest28881-21kworker/1:019:21:531
25178991110,1cyclictest25-21ksoftirqd/119:39:531
2517399119,1cyclictest9-21ksoftirqd/022:23:450
2517399119,1cyclictest9-21ksoftirqd/022:01:360
2517399119,1cyclictest9-21ksoftirqd/021:58:180
2517399119,1cyclictest9-21ksoftirqd/021:20:070
2517399119,1cyclictest9-21ksoftirqd/000:34:230
2517399119,1cyclictest9-21ksoftirqd/000:25:350
2517399119,1cyclictest709-21systemd-logind23:37:050
2517399116,2cyclictest9-21ksoftirqd/023:18:090
25173991110,1cyclictest9-21ksoftirqd/021:48:350
25173991110,1cyclictest9-21ksoftirqd/021:48:350
17462110,0sleep40-21swapper/400:18:584
111642110,0sleep20-21swapper/200:25:052
2521299108,1cyclictest73-21ksoftirqd/723:51:557
2521299108,1cyclictest73-21ksoftirqd/721:53:317
2521299108,1cyclictest73-21ksoftirqd/721:46:377
2521299108,1cyclictest73-21ksoftirqd/721:46:377
2521299108,1cyclictest73-21ksoftirqd/721:32:317
2520799109,1cyclictest65-21ksoftirqd/623:46:226
2520799103,1cyclictest0-21swapper/622:58:216
2520799102,2cyclictest709-21systemd-logind00:35:056
2520299108,1cyclictest57-21ksoftirqd/523:46:385
2519599109,1cyclictest49-21ksoftirqd/423:21:594
2519599108,1cyclictest49-21ksoftirqd/422:45:164
2519599108,1cyclictest49-21ksoftirqd/422:20:284
2519599108,1cyclictest49-21ksoftirqd/400:33:354
2519599107,2cyclictest6091-21grepconf.sh00:21:004
2519099109,1cyclictest41-21ksoftirqd/321:43:243
2519099109,1cyclictest0-21swapper/322:29:123
2519099108,1cyclictest41-21ksoftirqd/323:31:103
2519099108,1cyclictest41-21ksoftirqd/322:59:303
2519099108,1cyclictest41-21ksoftirqd/322:40:063
2519099108,1cyclictest41-21ksoftirqd/322:35:443
2519099108,1cyclictest41-21ksoftirqd/321:33:153
2519099105,1cyclictest30228-21grep21:23:313
2519099104,4cyclictest857-21polkitd21:10:133
2519099104,3cyclictest8726-21sshd22:23:433
2519099102,4cyclictest21780-21sshd00:31:143
2519099101,4cyclictest30266-21sshd22:49:113
2518599109,1cyclictest33-21ksoftirqd/200:32:242
2518599108,1cyclictest33-21ksoftirqd/222:24:332
2518599108,1cyclictest0-21swapper/200:08:032
2518599103,6cyclictest0-21swapper/223:37:252
2518599103,4cyclictest22613-21kworker/2:222:55:092
2518599101,4cyclictest16588-21grep23:01:202
2518599100,10cyclictest25233-21kworker/2:323:05:012
2518599100,10cyclictest0-21swapper/221:15:162
2518599100,1cyclictest0-21swapper/221:11:202
2517899109,1cyclictest28881-21kworker/1:020:41:371
2517899109,1cyclictest28881-21kworker/1:020:18:551
2517899109,1cyclictest28881-21kworker/1:019:11:191
2517899108,1cyclictest25-21ksoftirqd/120:14:541
25178991010,0cyclictest28881-21kworker/1:020:33:071
25178991010,0cyclictest28881-21kworker/1:019:58:071
25178991010,0cyclictest28881-21kworker/1:019:14:571
2517399109,1cyclictest9-21ksoftirqd/022:56:040
2517399109,1cyclictest9-21ksoftirqd/022:05:290
2517399109,1cyclictest9-21ksoftirqd/021:40:370
2517399109,1cyclictest9-21ksoftirqd/000:35:190
2517399108,1cyclictest9-21ksoftirqd/023:41:140
2517399107,2cyclictest32107-21/usr/sbin/munin19:20:060
229542100,0sleep70-21swapper/720:00:097
252079992,1cyclictest2201-21sshd22:45:376
252029990,8cyclictest4901-21kworker/5:100:05:045
251959997,2cyclictest49-21ksoftirqd/400:01:324
251959993,3cyclictest0-21swapper/419:39:074
251959990,3cyclictest0-21swapper/420:29:324
251909997,1cyclictest41-21ksoftirqd/322:10:153
251909997,1cyclictest41-21ksoftirqd/300:35:443
251909997,1cyclictest41-21ksoftirqd/300:25:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional