You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 08:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Mar 29, 2026 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173022710,1sleep317304-21bash21:51:103
197622670,0sleep60-21swapper/622:37:426
243732660,1sleep41-21systemd21:29:164
42332640,0sleep70-21swapper/723:15:557
1868225228,8sleep60-21swapper/619:02:016
79292510,1sleep47931-21grep21:15:234
70732510,0sleep2311rcuc/222:42:352
241902500,0sleep60-21swapper/600:20:266
78662490,1sleep07867-21id22:51:540
308232480,0sleep00-21swapper/000:00:170
222682480,1sleep622267-21sshd22:56:326
1885024825,8sleep30-21swapper/319:04:143
179342480,0sleep40-21swapper/423:48:204
129162480,2sleep71921199cyclictest23:40:387
129162480,2sleep71921199cyclictest23:40:387
170582470,0sleep30-21swapper/323:27:453
140862470,0sleep40-21swapper/423:46:204
140862470,0sleep40-21swapper/423:46:204
66102460,0sleep70-21swapper/700:13:467
62492460,0sleep60-21swapper/623:51:266
231202450,0sleep30-21swapper/322:41:403
129832450,0sleep60-21swapper/621:30:306
111502450,0sleep40-21swapper/422:16:424
1896224432,9sleep70-21swapper/719:05:477
314362430,0sleep00-21swapper/022:44:010
179892430,0sleep60-21swapper/623:07:216
126502430,1sleep773-21ksoftirqd/722:39:117
67782420,0sleep00-21swapper/023:51:280
1889224230,9sleep50-21swapper/519:04:485
16122410,0sleep70-21swapper/723:51:117
112372410,0sleep50-21swapper/521:58:095
8392400,0sleep50-21swapper/523:45:335
8392400,0sleep50-21swapper/523:45:335
47482400,0sleep20-21swapper/223:02:532
309462400,0sleep30-21swapper/300:35:443
266062400,0sleep20-21swapper/221:34:592
217902400,1sleep721789-21sshd23:11:237
1900324028,9sleep10-21swapper/119:06:211
1891424029,8sleep00-21swapper/019:05:080
1886924028,9sleep40-21swapper/419:04:314
1867824029,8sleep20-21swapper/219:01:572
118622400,0sleep70-21swapper/721:21:107
118622400,0sleep70-21swapper/721:21:107
258962390,0sleep70-21swapper/723:31:577
155472390,0sleep60-21swapper/623:16:346
93432380,0sleep70-21swapper/721:13:337
42422380,0sleep50-21swapper/522:35:015
281752380,1sleep528162-21sshd22:25:165
22932380,0sleep70-21swapper/722:53:297
240352370,0sleep60-21swapper/623:11:306
27872340,0sleep51919599cyclictest21:41:035
257732280,1sleep3784-21runrttasks21:46:053
19187992811,1cyclictest49-21ksoftirqd/400:20:234
19187992410,1cyclictest49-21ksoftirqd/400:04:154
1918799236,3cyclictest49-21ksoftirqd/422:41:354
1918799228,4cyclictest49-21ksoftirqd/422:35:134
1918799226,1cyclictest49-21ksoftirqd/421:35:314
1918099220,6cyclictest2288-21bash22:33:003
19187992118,1cyclictest49-21ksoftirqd/421:16:364
19187992118,1cyclictest49-21ksoftirqd/421:16:364
1918099219,2cyclictest41-21ksoftirqd/322:29:543
1918799204,4cyclictest49-21ksoftirqd/423:51:294
1918799204,3cyclictest49-21ksoftirqd/423:02:544
1918799203,3cyclictest49-21ksoftirqd/422:30:074
19187992017,3cyclictest49-21ksoftirqd/423:24:264
19187992015,3cyclictest49-21ksoftirqd/421:58:494
1918799200,19cyclictest18748-21kworker/4:021:36:514
1918099208,3cyclictest41-21ksoftirqd/321:39:273
19180992015,2cyclictest41-21ksoftirqd/323:40:473
19180992015,2cyclictest41-21ksoftirqd/323:40:473
1918799195,2cyclictest131rcu_sched23:30:084
1918799195,1cyclictest49-21ksoftirqd/422:03:004
1918799195,1cyclictest49-21ksoftirqd/422:03:004
1918799193,3cyclictest49-21ksoftirqd/423:09:594
19187991917,1cyclictest49-21ksoftirqd/423:12:284
19187991917,1cyclictest49-21ksoftirqd/422:54:094
19187991916,3cyclictest49-21ksoftirqd/422:23:054
19187991915,4cyclictest49-21ksoftirqd/423:37:034
19187991915,4cyclictest49-21ksoftirqd/423:37:034
19187991913,4cyclictest49-21ksoftirqd/423:32:544
1918099199,3cyclictest41-21ksoftirqd/321:18:303
1918099199,3cyclictest41-21ksoftirqd/321:18:303
19180991912,3cyclictest41-21ksoftirqd/300:20:303
1915599199,10cyclictest13264-21sshd21:15:420
1915599191,6cyclictest0-21swapper/023:14:070
1919599188,10cyclictest0-21swapper/520:46:165
1918799188,1cyclictest49-21ksoftirqd/422:46:374
1918799187,1cyclictest49-21ksoftirqd/400:10:334
19187991816,1cyclictest49-21ksoftirqd/423:59:194
19187991816,1cyclictest49-21ksoftirqd/400:13:504
19187991815,1cyclictest49-21ksoftirqd/421:07:174
19187991813,3cyclictest49-21ksoftirqd/423:01:164
19187991813,3cyclictest49-21ksoftirqd/422:06:584
1918799181,1cyclictest49-21ksoftirqd/421:50:244
1918799180,3cyclictest49-21ksoftirqd/421:24:264
1918799180,1cyclictest131rcu_sched21:51:504
19180991817,1cyclictest41-21ksoftirqd/322:37:443
1918099181,3cyclictest0-21swapper/321:23:143
1918099181,3cyclictest0-21swapper/321:15:383
1918099181,1cyclictest19379-21sshd21:56:443
1918099180,1cyclictest41-21ksoftirqd/322:23:363
1918099180,1cyclictest27853-21systemd-cgroups22:12:043
1918099180,1cyclictest24240-21sshd22:10:053
19155991811,6cyclictest9-21ksoftirqd/021:55:450
102692180,0sleep10-21swapper/123:42:161
102692180,0sleep10-21swapper/123:42:161
300462170,0sleep60-21swapper/622:34:386
19195991713,1cyclictest1-21systemd00:31:325
19187991715,1cyclictest49-21ksoftirqd/422:39:474
19187991715,1cyclictest49-21ksoftirqd/422:11:294
19187991715,1cyclictest49-21ksoftirqd/421:42:044
19187991714,1cyclictest49-21ksoftirqd/400:34:004
19187991712,3cyclictest49-21ksoftirqd/400:23:404
19187991711,4cyclictest49-21ksoftirqd/423:16:384
1918099178,1cyclictest41-21ksoftirqd/300:22:123
1918099177,3cyclictest41-21ksoftirqd/323:57:383
1918099177,2cyclictest41-21ksoftirqd/322:04:483
1918099177,2cyclictest41-21ksoftirqd/322:04:483
1918099172,1cyclictest26544-21systemd-cgroups23:52:313
19180991713,1cyclictest41-21ksoftirqd/300:03:553
19180991712,3cyclictest41-21ksoftirqd/321:35:243
1918099171,4cyclictest0-21swapper/321:07:263
1918099171,1cyclictest691-21systemd-logind22:17:163
1918099171,1cyclictest0-21swapper/323:35:063
1918099170,3cyclictest7221-21grepconf.sh23:12:183
1918099170,16cyclictest21322-21sshd23:24:183
1918099170,1cyclictest0-21swapper/322:58:443
19155991712,5cyclictest27823-21kworker/u16:100:24:550
19155991712,0cyclictest0-21swapper/020:22:160
19155991711,5cyclictest9-21ksoftirqd/023:26:010
8752160,0sleep60-21swapper/621:16:456
8752160,0sleep60-21swapper/621:16:456
5392160,0sleep00-21swapper/021:27:520
1921199162,13cyclictest0-21swapper/722:25:217
19195991612,3cyclictest57-21ksoftirqd/500:06:195
19195991610,5cyclictest691-21systemd-logind22:18:555
19187991614,1cyclictest492-21systemd-journal00:26:514
1918099166,3cyclictest41-21ksoftirqd/300:26:333
19180991615,1cyclictest41-21ksoftirqd/323:47:133
19180991615,1cyclictest41-21ksoftirqd/323:20:283
19180991615,1cyclictest41-21ksoftirqd/321:30:003
19180991614,1cyclictest41-21ksoftirqd/300:14:343
19180991612,2cyclictest41-21ksoftirqd/321:54:103
19180991610,3cyclictest41-21ksoftirqd/322:47:503
1918099161,3cyclictest26267-21sshd00:07:243
1918099161,1cyclictest31282-21systemd-cgroups23:02:323
1918099160,1cyclictest0-21swapper/323:43:213
1918099160,1cyclictest0-21swapper/323:43:213
19162991614,1cyclictest25-21ksoftirqd/122:08:571
1915599168,5cyclictest0-21swapper/020:05:360
1915599167,0cyclictest0-21swapper/021:08:580
19155991614,1cyclictest9-21ksoftirqd/022:46:590
1921199150,15cyclictest3885-21kworker/7:122:27:507
1921199150,1cyclictest0-21swapper/700:32:357
1919599150,15cyclictest0-21swapper/523:20:055
19180991514,1cyclictest41-21ksoftirqd/323:06:443
19180991511,2cyclictest41-21ksoftirqd/322:52:303
19173991514,1cyclictest33-21ksoftirqd/223:27:582
19162991513,1cyclictest25-21ksoftirqd/123:38:041
19162991513,1cyclictest25-21ksoftirqd/123:38:041
1915599158,6cyclictest9-21ksoftirqd/021:40:400
1915599157,5cyclictest0-21swapper/022:24:530
1915599157,5cyclictest0-21swapper/000:12:070
1915599157,0cyclictest0-21swapper/019:07:580
19155991513,2cyclictest29167-21kworker/u16:522:16:590
19155991513,1cyclictest9-21ksoftirqd/023:07:170
19155991513,1cyclictest9-21ksoftirqd/023:03:040
1915599150,9cyclictest0-21swapper/023:49:210
1915599150,9cyclictest0-21swapper/020:57:540
1915599150,3cyclictest0-21swapper/020:30:080
1915599150,0cyclictest0-21swapper/020:19:300
1921199144,2cyclictest21917-21grepconf.sh22:45:217
19203991412,1cyclictest65-21ksoftirqd/622:42:366
1919599148,5cyclictest29031-21fschecks_time23:26:375
1919599148,1cyclictest0-21swapper/521:25:575
1919599145,3cyclictest5310-21bash22:55:345
19195991412,1cyclictest1-21systemd23:50:045
1919599140,10cyclictest17002-21kworker/5:222:36:495
1917399144,3cyclictest691-21systemd-logind22:57:192
19162991413,1cyclictest25-21ksoftirqd/121:53:191
19162991413,1cyclictest25-21ksoftirqd/121:10:441
19162991412,1cyclictest25-21ksoftirqd/123:14:341
19162991412,1cyclictest25-21ksoftirqd/122:02:081
19162991412,1cyclictest25-21ksoftirqd/122:02:081
19162991412,1cyclictest25-21ksoftirqd/121:20:251
19162991412,1cyclictest25-21ksoftirqd/121:20:251
19162991412,1cyclictest25-21ksoftirqd/121:12:361
19162991412,1cyclictest25-21ksoftirqd/100:06:491
19162991411,1cyclictest25-21ksoftirqd/122:19:581
1916299140,1cyclictest0-21swapper/123:22:571
1915599148,5cyclictest0-21swapper/023:40:570
1915599148,5cyclictest0-21swapper/023:40:570
1915599148,5cyclictest0-21swapper/019:51:460
1915599146,5cyclictest0-21swapper/020:50:320
1915599146,5cyclictest0-21swapper/020:34:260
1915599146,5cyclictest0-21swapper/020:10:000
1915599146,5cyclictest0-21swapper/019:46:320
1915599146,5cyclictest0-21swapper/019:45:380
1915599146,0cyclictest2087-21kworker/u16:400:04:310
1915599146,0cyclictest0-21swapper/019:23:580
1915599143,0cyclictest0-21swapper/019:33:120
1915599142,6cyclictest0-21swapper/021:16:420
1915599142,6cyclictest0-21swapper/021:16:420
19155991413,1cyclictest9-21ksoftirqd/022:31:330
19155991412,1cyclictest9-21ksoftirqd/023:30:010
19155991412,1cyclictest9-21ksoftirqd/022:29:300
19155991412,1cyclictest9-21ksoftirqd/021:41:360
19155991410,1cyclictest686-21dbus-daemon00:18:080
1915599140,14cyclictest4283-21kworker/u16:222:38:210
108682140,1sleep5686-21dbus-daemon23:06:565
609321310,1sleep773-21ksoftirqd/722:16:307
46082130,0sleep20-21swapper/221:09:282
1921199137,5cyclictest32221-21kworker/7:423:58:107
1921199135,2cyclictest28788-21grepconf.sh23:43:227
1921199135,2cyclictest28788-21grepconf.sh23:43:227
1921199135,2cyclictest27021-21grepconf.sh21:55:247
1921199134,3cyclictest24598-21sshd23:24:307
1921199134,2cyclictest885-21polkitd21:47:127
1921199134,2cyclictest686-21dbus-daemon21:33:257
1921199134,2cyclictest3623-21grep22:16:217
1921199134,2cyclictest3467-21id23:30:467
1921199134,2cyclictest28986-21bash00:18:487
1921199134,2cyclictest28374-21systemd00:03:507
1921199134,2cyclictest25433-21grep23:20:517
1921199134,2cyclictest16900-21grepconf.sh22:58:017
1921199131,2cyclictest10681-21sshd21:37:437
1920399133,4cyclictest25432-21systemd22:00:526
19203991312,1cyclictest65-21ksoftirqd/621:42:076
19203991311,1cyclictest691-21systemd-logind23:59:016
19203991311,1cyclictest65-21ksoftirqd/622:27:216
19203991311,1cyclictest65-21ksoftirqd/600:06:386
1919599138,0cyclictest0-21swapper/521:34:285
1919599135,2cyclictest13247-21grepconf.sh21:15:415
1919599134,4cyclictest28833-21rm23:15:285
19195991310,2cyclictest57-21ksoftirqd/523:37:375
19195991310,2cyclictest57-21ksoftirqd/523:37:375
1919599130,7cyclictest4111-21sshd22:44:195
1919599130,13cyclictest0-21swapper/521:03:185
1919599130,13cyclictest0-21swapper/520:59:285
1919599130,13cyclictest0-21swapper/520:52:105
1919599130,13cyclictest0-21swapper/520:47:425
1919599130,13cyclictest0-21swapper/520:06:565
1919599130,13cyclictest0-21swapper/519:57:225
1919599130,13cyclictest0-21swapper/519:47:465
1919599130,13cyclictest0-21swapper/519:42:425
1919599130,12cyclictest88050irq/26-em1-tx-023:58:075
1919599130,12cyclictest17002-21kworker/5:222:57:505
1919599130,1cyclictest0-21swapper/520:36:565
1919599130,1cyclictest0-21swapper/520:26:545
1919599130,1cyclictest0-21swapper/519:52:245
1919599130,1cyclictest0-21swapper/519:18:245
19173991312,1cyclictest33-21ksoftirqd/200:21:242
19173991311,1cyclictest33-21ksoftirqd/221:20:012
19173991311,1cyclictest33-21ksoftirqd/221:20:012
19162991312,1cyclictest25-21ksoftirqd/121:39:211
19162991311,1cyclictest25-21ksoftirqd/123:58:111
19162991311,1cyclictest25-21ksoftirqd/123:49:231
19162991311,1cyclictest25-21ksoftirqd/123:33:131
19162991311,1cyclictest25-21ksoftirqd/123:27:031
19162991311,1cyclictest25-21ksoftirqd/123:08:191
19162991311,1cyclictest25-21ksoftirqd/121:32:141
1916299130,12cyclictest0-21swapper/100:30:171
1916299130,1cyclictest0-21swapper/123:16:271
1915599139,3cyclictest9-21ksoftirqd/021:48:480
1915599138,5cyclictest0-21swapper/022:01:430
1915599138,5cyclictest0-21swapper/022:01:430
1915599138,5cyclictest0-21swapper/021:01:260
1915599138,5cyclictest0-21swapper/020:55:360
1915599138,5cyclictest0-21swapper/020:45:040
1915599138,5cyclictest0-21swapper/020:15:360
1915599138,5cyclictest0-21swapper/019:15:180
1915599138,1cyclictest1-21systemd23:35:090
1915599138,0cyclictest0-21swapper/022:56:390
1915599138,0cyclictest0-21swapper/022:14:330
1915599138,0cyclictest0-21swapper/021:24:160
1915599138,0cyclictest0-21swapper/019:59:580
1915599135,5cyclictest0-21swapper/023:17:010
19155991311,1cyclictest9-21ksoftirqd/023:42:110
19155991311,1cyclictest9-21ksoftirqd/023:42:110
19155991311,1cyclictest9-21ksoftirqd/022:09:080
19155991311,1cyclictest9-21ksoftirqd/000:35:370
19155991311,1cyclictest9-21ksoftirqd/000:26:310
19155991311,1cyclictest9-21ksoftirqd/000:08:450
19155991310,2cyclictest9-21ksoftirqd/021:56:410
19155991310,1cyclictest5649-21kworker/0:021:32:010
1915599131,6cyclictest0-21swapper/020:38:380
129652130,1sleep27454-1kworker/2:2H21:49:012
83102120,1sleep58311-21bash00:13:525
312892120,0sleep61-21systemd22:21:406
1921199125,1cyclictest5525-21systemd21:09:317
1921199124,2cyclictest9791-21grep22:48:197
1921199124,2cyclictest9551-21grepconf.sh22:01:437
1921199124,2cyclictest9551-21grepconf.sh22:01:437
1921199124,2cyclictest8154-21grep21:57:587
1921199124,2cyclictest686-21dbus-daemon22:31:347
1921199124,2cyclictest26695-21nscd23:01:387
1921199124,2cyclictest24010-21bash21:42:097
1921199124,2cyclictest23497-21bash21:29:137
1921199124,2cyclictest1792-21sshd00:28:247
1921199124,2cyclictest15972-21sshd00:21:457
1921199124,2cyclictest10537-21id00:08:237
1921199123,2cyclictest20337-21bash23:52:097
1921199122,4cyclictest15251-21sshd21:23:097
1921199122,4cyclictest11860-21sshd22:11:157
19211991210,1cyclictest73-21ksoftirqd/719:51:247
1920399129,2cyclictest18049-21sshd23:48:216
1920399128,1cyclictest65-21ksoftirqd/623:43:536
1920399128,1cyclictest65-21ksoftirqd/623:43:536
1920399126,6cyclictest0-21swapper/619:41:426
1920399125,7cyclictest87950irq/25-em1-rx-022:21:136
19203991211,1cyclictest65-21ksoftirqd/621:56:066
19203991210,1cyclictest65-21ksoftirqd/623:38:046
19203991210,1cyclictest65-21ksoftirqd/623:38:046
19203991210,1cyclictest65-21ksoftirqd/623:36:076
19203991210,1cyclictest65-21ksoftirqd/622:50:216
19203991210,1cyclictest65-21ksoftirqd/622:09:226
1920399120,8cyclictest24768-21sshd21:49:426
1919599127,5cyclictest0-21swapper/523:24:415
1919599127,5cyclictest0-21swapper/523:06:235
1919599127,5cyclictest0-21swapper/521:46:155
1919599127,5cyclictest0-21swapper/520:23:065
1919599126,5cyclictest19750-21cp00:18:155
1919599126,3cyclictest885-21polkitd00:09:535
1919599125,2cyclictest8762-21grep22:46:285
1919599121,0cyclictest1115-21nfsd22:08:055
1919599120,8cyclictest0-21swapper/522:13:345
1919599120,6cyclictest0-21swapper/520:35:305
1919599120,12cyclictest4074-21kworker/5:121:54:215
1919599120,12cyclictest0-21swapper/520:21:105
1919599120,12cyclictest0-21swapper/520:11:525
1919599120,12cyclictest0-21swapper/519:38:325
1919599120,11cyclictest4575-21kworker/5:021:49:445
1919599120,11cyclictest0-21swapper/521:19:585
1919599120,11cyclictest0-21swapper/521:19:585
1919599120,0cyclictest0-21swapper/523:54:495
1919599120,0cyclictest0-21swapper/519:30:405
1919599120,0cyclictest0-21swapper/519:14:005
19187991210,1cyclictest49-21ksoftirqd/421:01:244
1918099125,1cyclictest41-21ksoftirqd/319:32:553
1918099121,1cyclictest0-21swapper/320:46:443
1917399128,4cyclictest33-21ksoftirqd/222:06:322
1917399123,3cyclictest0-21swapper/222:14:072
19173991210,2cyclictest13550irq/24-ahci[00021:41:032
19173991210,1cyclictest33-21ksoftirqd/200:07:352
1917399120,3cyclictest0-21swapper/219:21:402
1916299129,2cyclictest25-21ksoftirqd/123:03:441
1916299129,1cyclictest25-21ksoftirqd/122:33:161
1916299128,3cyclictest25-21ksoftirqd/122:37:361
1916299122,4cyclictest1347-21sshd22:01:211
19162991210,1cyclictest25-21ksoftirqd/123:01:171
19162991210,1cyclictest25-21ksoftirqd/122:53:101
19162991210,1cyclictest25-21ksoftirqd/122:51:021
19162991210,1cyclictest25-21ksoftirqd/100:33:161
19162991210,1cyclictest25-21ksoftirqd/100:25:171
1916299120,11cyclictest21079-21grep21:47:351
1916299120,11cyclictest19181-21systemd00:05:131
1915599127,5cyclictest0-21swapper/019:37:120
1915599127,0cyclictest0-21swapper/019:28:220
1915599120,6cyclictest0-21swapper/019:17:280
58172110,0sleep60-21swapper/623:02:576
1920399119,2cyclictest65-21ksoftirqd/623:30:116
1920399119,1cyclictest65-21ksoftirqd/621:22:316
1920399119,1cyclictest65-21ksoftirqd/621:14:056
1920399119,1cyclictest65-21ksoftirqd/600:02:336
1920399118,3cyclictest65-21ksoftirqd/621:34:256
1920399118,2cyclictest2942-21sshd23:25:076
1920399118,2cyclictest23283-21bash00:35:176
1920399115,3cyclictest3828-21grepconf.sh00:22:556
1920399114,6cyclictest492-21systemd-journal22:53:276
1920399114,4cyclictest20460-21grepconf.sh21:36:306
1920399113,5cyclictest15234-21grepconf.sh22:11:266
1920399112,6cyclictest0-21swapper/600:11:446
1919599116,5cyclictest0-21swapper/521:27:145
1919599112,1cyclictest24766-21sshd00:24:095
1919599111,4cyclictest718-21avahi-daemon23:35:135
1919599111,4cyclictest0-21swapper/522:01:465
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional