You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 12:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Apr 16, 2026 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207319914647,79cyclictest492-21systemd-journal21:34:080
20780999334,22cyclictest686-21dbus-daemon21:34:096
321632880,2sleep02073199cyclictest22:57:590
171562810,0sleep20-21swapper/223:37:582
203472740,0sleep70-21swapper/722:57:187
65442510,0sleep60-21swapper/621:12:416
314992510,0sleep10-21swapper/100:32:351
193702500,0sleep30-21swapper/321:37:293
86352490,1sleep0686-21dbus-daemon21:47:590
2053624926,8sleep30-21swapper/319:05:073
2046524827,8sleep50-21swapper/519:04:135
30292470,0sleep40-21swapper/423:13:014
173412470,0sleep50-21swapper/521:15:125
290912460,0sleep01-21systemd22:52:140
290912460,0sleep01-21systemd22:52:140
195652460,0sleep50-21swapper/523:26:555
56402450,0sleep40-21swapper/422:08:134
216782450,0sleep50-21swapper/522:24:005
18282450,0sleep40-21swapper/421:27:124
160122450,0sleep10-21swapper/121:39:111
53802440,0sleep20-21swapper/221:58:582
32922440,0sleep665-21ksoftirqd/623:35:216
211802440,0sleep10-21swapper/123:32:361
182722440,0sleep10-21swapper/122:44:141
169912440,0sleep20-21swapper/221:44:492
263442430,0sleep00-21swapper/021:56:240
2075699430,42cyclictest25013-21kworker/3:121:34:093
140912430,0sleep60-21swapper/622:27:136
76952420,0sleep50-21swapper/500:18:135
294662420,0sleep40-21swapper/400:13:564
290522420,0sleep50-21swapper/522:15:115
238912420,0sleep50-21swapper/520:06:025
2052624230,9sleep40-21swapper/419:05:004
38612410,0sleep20-21swapper/222:32:142
28132410,0sleep40-21swapper/400:16:044
2074699410,40cyclictest32676-21kworker/2:221:34:082
91552400,0sleep40-21swapper/422:52:584
91552400,0sleep40-21swapper/422:52:584
303062400,0sleep10-21swapper/122:35:411
297912400,0sleep1241ktimersoftd/122:09:381
281052400,0sleep50-21swapper/523:21:515
2054024027,9sleep70-21swapper/719:05:117
2041324029,8sleep10-21swapper/119:03:291
277692390,0sleep20-21swapper/200:17:302
2054423928,8sleep20-21swapper/219:05:142
2046923926,9sleep00-21swapper/019:04:160
203992390,0sleep00-21swapper/023:41:480
203992390,0sleep00-21swapper/023:41:480
2039823926,9sleep60-21swapper/619:03:186
183622390,0sleep60-21swapper/623:25:046
27712380,0sleep20-21swapper/222:22:532
204822380,0sleep40-21swapper/423:23:184
19732380,0sleep40-21swapper/400:27:094
109572380,0sleep70-21swapper/723:56:057
115722370,0sleep00-21swapper/023:26:260
20765993635,1cyclictest1362-21kworker/4:421:34:084
305672350,2sleep62078099cyclictest21:49:176
2077299340,34cyclictest1037-21kworker/5:021:34:085
2077299333,24cyclictest14449-21kworker/5:223:55:555
188782330,1sleep341-21ksoftirqd/322:44:163
155692330,0sleep30-21swapper/321:26:073
83382290,0sleep30-21swapper/323:24:293
2078899279,3cyclictest73-21ksoftirqd/723:09:157
20788992712,3cyclictest73-21ksoftirqd/723:11:277
20788992612,4cyclictest73-21ksoftirqd/723:00:597
20772992617,4cyclictest57-21ksoftirqd/500:31:165
2078899255,3cyclictest73-21ksoftirqd/722:48:537
20788992510,2cyclictest73-21ksoftirqd/722:55:187
20788992510,2cyclictest73-21ksoftirqd/722:55:187
20731992516,4cyclictest9-21ksoftirqd/021:13:050
2078899249,2cyclictest73-21ksoftirqd/721:29:087
2078899239,3cyclictest73-21ksoftirqd/721:32:467
2078899239,2cyclictest73-21ksoftirqd/722:16:377
2078899238,3cyclictest73-21ksoftirqd/700:26:567
2078899238,1cyclictest73-21ksoftirqd/700:05:177
20788992313,1cyclictest73-21ksoftirqd/723:29:227
20788992310,3cyclictest73-21ksoftirqd/722:00:557
2078899229,3cyclictest73-21ksoftirqd/723:44:097
2078899229,3cyclictest73-21ksoftirqd/723:44:097
2078899227,3cyclictest73-21ksoftirqd/721:11:527
2078899226,1cyclictest73-21ksoftirqd/722:42:267
2078899226,1cyclictest73-21ksoftirqd/722:31:207
2078899225,3cyclictest73-21ksoftirqd/721:21:557
20788992213,1cyclictest73-21ksoftirqd/722:08:037
20788992212,1cyclictest73-21ksoftirqd/722:36:587
20788992211,2cyclictest73-21ksoftirqd/721:44:537
20788992210,3cyclictest73-21ksoftirqd/723:51:047
2078899221,2cyclictest121rcu_preempt00:33:337
20739992220,1cyclictest21673-21kworker/1:221:34:091
235452210,0sleep623530-21sshd21:26:346
2078899219,3cyclictest73-21ksoftirqd/723:18:417
2078899219,3cyclictest73-21ksoftirqd/721:49:357
2078899219,2cyclictest73-21ksoftirqd/700:14:297
2078899218,3cyclictest73-21ksoftirqd/700:17:287
2078899217,1cyclictest73-21ksoftirqd/721:56:017
2078899216,2cyclictest73-21ksoftirqd/700:09:527
20788992110,3cyclictest73-21ksoftirqd/723:48:477
20788992110,3cyclictest73-21ksoftirqd/723:48:477
20788992110,3cyclictest73-21ksoftirqd/721:40:157
20788992110,3cyclictest73-21ksoftirqd/700:23:367
67312200,0sleep56721-21sshd23:44:505
67312200,0sleep56721-21sshd23:44:505
44032200,0sleep30-21swapper/323:15:003
268042200,1sleep41-21systemd00:08:114
2078899209,4cyclictest73-21ksoftirqd/723:25:287
2078899206,3cyclictest73-21ksoftirqd/722:13:167
2078899206,3cyclictest73-21ksoftirqd/721:54:417
2078899205,3cyclictest73-21ksoftirqd/721:17:177
20788992014,4cyclictest73-21ksoftirqd/722:25:067
2077299202,9cyclictest57-21ksoftirqd/521:40:335
20765992018,1cyclictest49-21ksoftirqd/423:53:484
2073999207,1cyclictest25-21ksoftirqd/100:04:131
2078899197,3cyclictest73-21ksoftirqd/722:26:227
2078899197,2cyclictest73-21ksoftirqd/723:39:037
2078899197,1cyclictest73-21ksoftirqd/723:32:437
20765991917,1cyclictest49-21ksoftirqd/422:40:494
20765991917,1cyclictest49-21ksoftirqd/421:22:004
20765991915,3cyclictest49-21ksoftirqd/400:04:084
20765991914,3cyclictest49-21ksoftirqd/423:26:234
2076599191,2cyclictest49-21ksoftirqd/423:00:504
2076599190,3cyclictest49-21ksoftirqd/422:01:264
20739991917,1cyclictest25-21ksoftirqd/123:24:121
20739991915,1cyclictest25-21ksoftirqd/123:39:291
20739991912,4cyclictest25-21ksoftirqd/121:10:581
2073199198,0cyclictest0-21swapper/019:33:570
2073199191,6cyclictest0-21swapper/019:54:130
149532190,0sleep50-21swapper/522:36:345
2078899187,1cyclictest73-21ksoftirqd/721:06:057
20772991815,3cyclictest57-21ksoftirqd/522:50:055
20772991815,1cyclictest57-21ksoftirqd/523:55:385
20772991812,3cyclictest57-21ksoftirqd/523:02:545
20765991816,1cyclictest49-21ksoftirqd/423:31:014
20765991816,1cyclictest49-21ksoftirqd/423:16:034
20765991816,1cyclictest49-21ksoftirqd/422:21:334
20765991816,1cyclictest49-21ksoftirqd/422:20:474
20765991816,1cyclictest49-21ksoftirqd/421:51:274
20765991816,1cyclictest49-21ksoftirqd/421:50:294
20765991815,1cyclictest49-21ksoftirqd/423:48:574
20765991815,1cyclictest49-21ksoftirqd/423:48:574
2076599181,1cyclictest131rcu_sched21:58:444
2076599180,3cyclictest131rcu_sched00:23:534
20739991816,1cyclictest25-21ksoftirqd/122:21:031
2073999181,3cyclictest492-21systemd-journal21:30:191
2073199187,5cyclictest0-21swapper/020:02:370
20731991811,7cyclictest0-21swapper/022:42:510
2073199180,6cyclictest0-21swapper/020:58:370
2073199180,6cyclictest0-21swapper/020:58:370
181822180,1sleep418166-21proc_pri21:41:064
66572170,0sleep50-21swapper/521:27:295
20780991715,1cyclictest65-21ksoftirqd/622:41:176
20772991715,1cyclictest57-21ksoftirqd/523:48:185
20772991715,1cyclictest57-21ksoftirqd/523:48:185
20772991715,1cyclictest57-21ksoftirqd/522:54:255
20772991715,1cyclictest57-21ksoftirqd/522:54:255
20772991711,2cyclictest17634-21systemd00:05:515
20772991711,1cyclictest57-21ksoftirqd/521:52:375
2076599173,3cyclictest49-21ksoftirqd/400:31:024
20765991716,1cyclictest15-21kswork22:45:594
20765991715,1cyclictest49-21ksoftirqd/422:59:424
20765991715,1cyclictest49-21ksoftirqd/422:37:554
20765991715,1cyclictest49-21ksoftirqd/422:11:054
20765991715,1cyclictest49-21ksoftirqd/421:36:424
20765991715,1cyclictest49-21ksoftirqd/421:10:544
20765991715,1cyclictest49-21ksoftirqd/421:06:224
20765991714,1cyclictest49-21ksoftirqd/422:29:454
20765991713,3cyclictest49-21ksoftirqd/421:16:314
2073999176,2cyclictest25-21ksoftirqd/121:09:531
20739991715,1cyclictest25-21ksoftirqd/123:11:111
20739991715,1cyclictest25-21ksoftirqd/121:16:071
20739991715,1cyclictest25-21ksoftirqd/100:25:321
20739991714,3cyclictest25-21ksoftirqd/100:06:021
20739991713,1cyclictest25-21ksoftirqd/122:19:141
2073999170,2cyclictest131rcu_sched22:56:591
2073999170,1cyclictest131rcu_sched23:30:471
2073199177,9cyclictest1116-21nfsd22:26:250
20731991712,5cyclictest0-21swapper/023:24:530
20731991712,1cyclictest11426-21kworker/u16:421:38:510
20731991712,0cyclictest9-21ksoftirqd/023:34:350
20731991711,1cyclictest3332-21kworker/0:023:12:190
100382170,0sleep30-21swapper/300:10:593
64412160,0sleep50-21swapper/521:20:095
20788991614,1cyclictest73-21ksoftirqd/721:05:487
20772991614,1cyclictest57-21ksoftirqd/523:14:385
20772991614,1cyclictest57-21ksoftirqd/522:41:325
20772991614,1cyclictest57-21ksoftirqd/522:33:225
20772991612,4cyclictest57-21ksoftirqd/522:04:175
20772991612,3cyclictest57-21ksoftirqd/522:56:555
20772991612,1cyclictest57-21ksoftirqd/523:34:455
20772991611,5cyclictest57-21ksoftirqd/523:16:255
20765991615,1cyclictest49-21ksoftirqd/422:33:214
20765991614,1cyclictest49-21ksoftirqd/423:45:304
20765991614,1cyclictest49-21ksoftirqd/423:45:304
20765991613,1cyclictest49-21ksoftirqd/423:07:444
20765991612,2cyclictest49-21ksoftirqd/423:57:184
2075699168,2cyclictest1-21systemd22:13:283
2075699160,1cyclictest784-21runrttasks23:40:393
20739991615,1cyclictest25-21ksoftirqd/123:43:431
20739991615,1cyclictest25-21ksoftirqd/123:43:431
20739991615,1cyclictest25-21ksoftirqd/122:47:511
20739991615,1cyclictest25-21ksoftirqd/121:51:021
20739991614,1cyclictest25-21ksoftirqd/123:54:371
20739991614,1cyclictest25-21ksoftirqd/123:10:401
20739991614,1cyclictest25-21ksoftirqd/123:05:161
20739991614,1cyclictest25-21ksoftirqd/122:51:531
20739991614,1cyclictest25-21ksoftirqd/122:51:531
20739991614,1cyclictest25-21ksoftirqd/122:10:571
20739991614,1cyclictest25-21ksoftirqd/122:02:031
20739991614,1cyclictest25-21ksoftirqd/121:46:581
20739991614,1cyclictest25-21ksoftirqd/121:20:591
20739991614,1cyclictest25-21ksoftirqd/100:00:091
2073999160,16cyclictest3929-21kworker/1:423:17:151
20731991615,1cyclictest9-21ksoftirqd/022:34:240
20731991615,1cyclictest9-21ksoftirqd/021:51:380
20731991614,2cyclictest9-21ksoftirqd/023:55:440
20731991614,1cyclictest9-21ksoftirqd/023:07:580
20731991614,1cyclictest9-21ksoftirqd/022:04:270
20731991614,1cyclictest9-21ksoftirqd/021:24:390
20731991614,1cyclictest9-21ksoftirqd/000:16:270
20731991612,0cyclictest13304-21kworker/u16:023:16:350
2073199160,1cyclictest131rcu_sched21:10:130
298872150,0sleep60-21swapper/621:36:116
213982150,0sleep20-21swapper/221:37:362
20780991510,1cyclictest87950irq/25-em1-rx-000:26:516
20772991514,1cyclictest57-21ksoftirqd/500:23:285
20772991513,1cyclictest57-21ksoftirqd/522:17:025
20772991510,4cyclictest57-21ksoftirqd/523:40:025
2077299151,1cyclictest131rcu_sched21:50:335
2077299150,7cyclictest0-21swapper/520:02:495
2077299150,1cyclictest131rcu_sched22:08:425
20746991513,1cyclictest33-21ksoftirqd/200:29:352
2073999154,1cyclictest25-21ksoftirqd/100:16:031
20739991513,1cyclictest25-21ksoftirqd/123:50:081
20739991513,1cyclictest25-21ksoftirqd/123:50:081
20739991513,1cyclictest25-21ksoftirqd/122:36:051
20739991513,1cyclictest25-21ksoftirqd/122:28:251
20739991513,1cyclictest25-21ksoftirqd/121:56:221
20739991513,1cyclictest25-21ksoftirqd/100:29:431
20739991511,1cyclictest25-21ksoftirqd/121:43:131
2073199154,11cyclictest0-21swapper/019:14:510
20731991513,1cyclictest9-21ksoftirqd/023:03:360
20731991513,1cyclictest9-21ksoftirqd/022:36:020
20731991513,1cyclictest9-21ksoftirqd/022:15:570
20731991513,1cyclictest9-21ksoftirqd/000:01:260
20731991511,4cyclictest9-21ksoftirqd/022:15:010
20731991510,2cyclictest9-21ksoftirqd/023:36:500
20731991510,1cyclictest11697-21kworker/0:322:48:170
2073199150,2cyclictest131rcu_sched00:15:230
2073199150,15cyclictest32666-21kworker/0:322:09:130
186612150,0sleep20-21swapper/223:19:322
25412140,0sleep30-21swapper/300:17:553
24902140,0sleep30-21swapper/322:02:283
20780991413,1cyclictest65-21ksoftirqd/623:51:106
20780991413,1cyclictest65-21ksoftirqd/622:37:006
20780991412,1cyclictest65-21ksoftirqd/621:16:516
2077299148,2cyclictest57-21ksoftirqd/500:28:445
20772991413,1cyclictest57-21ksoftirqd/522:28:085
20772991413,1cyclictest57-21ksoftirqd/521:58:465
20772991413,1cyclictest57-21ksoftirqd/521:45:105
20772991413,1cyclictest57-21ksoftirqd/521:23:115
20772991412,1cyclictest57-21ksoftirqd/523:06:375
20772991410,3cyclictest57-21ksoftirqd/521:08:355
2077299140,9cyclictest0-21swapper/500:01:055
20765991411,1cyclictest49-21ksoftirqd/423:35:574
20739991412,1cyclictest25-21ksoftirqd/100:10:571
2073199142,6cyclictest0-21swapper/021:19:330
2073199142,6cyclictest0-21swapper/020:32:030
2073199142,6cyclictest0-21swapper/019:26:490
20731991413,1cyclictest9-21ksoftirqd/023:56:180
20731991413,1cyclictest9-21ksoftirqd/000:29:580
20731991413,1cyclictest9-21ksoftirqd/000:22:200
20731991413,1cyclictest9-21ksoftirqd/000:07:170
20731991412,1cyclictest9-21ksoftirqd/000:31:000
20731991412,0cyclictest8398-21kworker/u16:323:49:190
20731991412,0cyclictest8398-21kworker/u16:323:49:190
165822140,0sleep30-21swapper/322:23:423
108372140,0sleep0111rcuc/021:25:560
95642130,0sleep29199-21sshd00:09:052
231882130,1sleep232231-1kworker/2:0H22:09:152
2078899133,2cyclictest73-21ksoftirqd/720:16:077
2078099136,6cyclictest0-21swapper/622:08:176
2078099130,12cyclictest3391-21bash23:59:266
2077299139,1cyclictest57-21ksoftirqd/500:11:065
20772991311,1cyclictest57-21ksoftirqd/519:40:475
2077299130,7cyclictest0-21swapper/519:27:055
2075699133,4cyclictest1-21systemd23:26:573
2075699132,5cyclictest686-21dbus-daemon00:23:043
20756991311,1cyclictest41-21ksoftirqd/322:58:493
2075699130,13cyclictest17550-21kworker/3:023:31:353
2075699130,1cyclictest0-21swapper/322:52:113
2075699130,1cyclictest0-21swapper/322:52:113
20746991311,1cyclictest33-21ksoftirqd/222:59:052
20746991311,1cyclictest33-21ksoftirqd/222:15:152
20746991311,1cyclictest33-21ksoftirqd/221:15:062
2073199132,6cyclictest0-21swapper/020:23:010
2073199132,6cyclictest0-21swapper/020:10:530
2073199132,6cyclictest0-21swapper/020:00:010
2073199132,6cyclictest0-21swapper/019:21:150
2073199132,6cyclictest0-21swapper/019:19:170
2073199132,5cyclictest0-21swapper/019:47:410
2073199132,0cyclictest0-21swapper/020:52:410
2073199132,0cyclictest0-21swapper/019:40:530
2073199132,0cyclictest0-21swapper/019:36:590
20731991312,1cyclictest9-21ksoftirqd/022:22:210
2073199131,6cyclictest0-21swapper/021:03:010
2073199131,6cyclictest0-21swapper/020:17:410
2073199131,6cyclictest0-21swapper/019:06:330
2073199131,0cyclictest0-21swapper/020:27:530
20788991211,1cyclictest73-21ksoftirqd/720:15:487
20788991211,1cyclictest73-21ksoftirqd/720:05:487
20788991211,1cyclictest73-21ksoftirqd/719:46:047
20788991210,1cyclictest73-21ksoftirqd/720:40:477
20780991211,1cyclictest65-21ksoftirqd/621:08:356
20780991210,1cyclictest65-21ksoftirqd/622:30:586
20780991210,1cyclictest65-21ksoftirqd/622:16:506
20780991210,1cyclictest65-21ksoftirqd/621:53:366
20780991210,1cyclictest65-21ksoftirqd/600:31:196
20780991210,1cyclictest65-21ksoftirqd/600:15:346
20780991210,1cyclictest0-21swapper/623:16:516
2077299121,8cyclictest32038-21expr20:20:595
2077299120,7cyclictest0-21swapper/520:44:595
2077299120,7cyclictest0-21swapper/520:26:575
2077299120,7cyclictest0-21swapper/520:15:255
2077299120,7cyclictest0-21swapper/519:45:175
2077299120,7cyclictest0-21swapper/519:33:055
2077299120,6cyclictest0-21swapper/519:06:275
2076599120,3cyclictest0-21swapper/419:56:014
2075699129,2cyclictest25781-21id21:10:093
2075699122,4cyclictest1-21systemd00:28:103
20756991210,1cyclictest0-21swapper/321:58:553
2075699120,11cyclictest19860-21kworker/3:521:45:363
2075699120,11cyclictest13668-21bash21:22:203
2074699129,1cyclictest33-21ksoftirqd/223:49:092
2074699129,1cyclictest33-21ksoftirqd/223:49:092
2074699124,7cyclictest11617-21sshd22:04:542
2074699122,4cyclictest780-21id23:57:222
2074699122,4cyclictest29983-21bash21:30:462
20746991210,1cyclictest33-21ksoftirqd/223:09:292
20731991210,1cyclictest9-21ksoftirqd/021:41:040
2073199121,6cyclictest0-21swapper/020:47:250
2073199121,6cyclictest0-21swapper/020:37:390
2073199120,6cyclictest0-21swapper/020:08:250
2073199120,0cyclictest0-21swapper/020:42:350
2078899119,1cyclictest73-21ksoftirqd/719:45:487
20788991110,1cyclictest73-21ksoftirqd/719:40:477
2078899110,1cyclictest73-21ksoftirqd/720:00:487
2078099119,1cyclictest65-21ksoftirqd/622:57:536
2078099119,1cyclictest65-21ksoftirqd/622:52:186
2078099119,1cyclictest65-21ksoftirqd/622:52:186
2078099119,1cyclictest65-21ksoftirqd/622:48:516
2078099119,1cyclictest65-21ksoftirqd/622:11:126
2078099119,1cyclictest65-21ksoftirqd/621:23:356
2078099119,1cyclictest65-21ksoftirqd/600:01:186
2078099118,1cyclictest65-21ksoftirqd/623:41:526
2078099118,1cyclictest65-21ksoftirqd/623:41:526
2078099112,4cyclictest763-21NetworkManager23:27:036
2078099110,6cyclictest31755-21systemctl23:07:136
2078099110,6cyclictest0-21swapper/623:04:256
2077299116,5cyclictest0-21swapper/519:58:215
2077299116,5cyclictest0-21swapper/519:21:535
2077299110,6cyclictest0-21swapper/519:53:015
2077299110,6cyclictest0-21swapper/519:46:495
2077299110,0cyclictest0-21swapper/520:55:255
2077299110,0cyclictest0-21swapper/520:47:095
2077299110,0cyclictest0-21swapper/519:15:215
2075699119,1cyclictest41-21ksoftirqd/321:51:123
2075699113,7cyclictest775-21gdbus00:05:133
2075699112,4cyclictest0-21swapper/300:10:463
20756991110,1cyclictest0-21swapper/322:17:163
2075699111,7cyclictest23206-21kill21:11:453
2075699111,4cyclictest20136-21sshd23:17:423
2075699110,5cyclictest763-21NetworkManager00:31:553
2075699110,5cyclictest21163-21systemd23:47:263
2075699110,5cyclictest21163-21systemd23:47:263
2075699110,11cyclictest26656-21kworker/3:523:03:213
2075699110,11cyclictest20343-21kworker/3:123:55:253
2075699110,11cyclictest1728-21kworker/3:222:31:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional