You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 07:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Jul 25, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34359911389,24cyclictest65-21ksoftirqd/623:18:056
192182870,2sleep4342299cyclictest22:40:034
284502840,1sleep557-21ksoftirqd/500:29:215
340199720,71cyclictest19444-21sshd23:18:041
48012590,2sleep3341899cyclictest23:02:453
295982550,0sleep60-21swapper/622:06:176
109442550,0sleep20-21swapper/221:54:202
281422540,0sleep60-21swapper/621:33:346
215982520,0sleep221575-21sshd23:47:132
177262510,0sleep40-21swapper/423:14:234
305625027,8sleep30-21swapper/319:03:493
279732500,1sleep227976-21bash23:34:562
219822500,1sleep521956-21cp00:34:265
18302500,1sleep41791-21sshd23:49:474
150422500,1sleep615043-21grep21:18:206
301724925,9sleep20-21swapper/219:03:162
218242490,1sleep341-21ksoftirqd/323:45:303
40932480,0sleep20-21swapper/223:29:592
171612480,0sleep30-21swapper/300:08:453
98072470,0sleep40-21swapper/423:37:304
91222470,0sleep40-21swapper/422:14:084
316424724,8sleep60-21swapper/619:05:216
304724725,8sleep50-21swapper/519:03:435
26522470,2sleep1340199cyclictest23:46:161
16062470,1sleep71562-21sshd00:04:167
122712470,0sleep012252-21sshd23:50:230
92542460,0sleep20-21swapper/200:30:062
103482460,1sleep6464-21systemd-journal00:30:106
85912450,2sleep4342299cyclictest22:50:214
83602450,0sleep58361-21systemd-cgroups23:41:075
295182450,1sleep629517-21sshd21:44:316
240062450,0sleep60-21swapper/622:18:356
41972440,0sleep50-21swapper/522:08:255
317224423,17sleep40-21swapper/419:05:274
265442440,1sleep226542-21bash21:29:532
46182430,0sleep40-21swapper/423:19:044
160812430,0sleep40-21swapper/423:54:124
15972430,1sleep11586-21sshd22:35:281
319002420,8sleep685150irq/25-em1-rx-023:46:056
234172420,0sleep20-21swapper/222:22:072
93792410,0sleep10-21swapper/121:25:201
296502410,0sleep00-21swapper/022:40:390
257762410,0sleep20-21swapper/200:05:392
108742410,0sleep410868-21sshd21:28:594
33472400,0sleep60-21swapper/623:02:406
316824027,9sleep00-21swapper/019:05:230
254562400,1sleep557-21ksoftirqd/523:51:095
205662400,0sleep10-21swapper/123:03:391
3407993938,1cyclictest1184-21kworker/2:023:18:052
339899390,37cyclictest0-21swapper/023:18:050
320723928,8sleep10-21swapper/119:05:561
318602390,0sleep30-21swapper/321:55:333
294723826,8sleep70-21swapper/719:02:257
174932380,0sleep10-21swapper/123:54:171
67502370,0sleep00-21swapper/021:43:130
71642320,0sleep00-21swapper/020:06:470
3428992722,4cyclictest85250irq/26-em1-tx-023:18:055
342899250,2cyclictest3238-21sshd22:21:065
3439992313,3cyclictest73-21ksoftirqd/722:06:097
3439992312,1cyclictest73-21ksoftirqd/723:20:467
309302230,0sleep10-21swapper/100:13:071
3398992217,4cyclictest9-21ksoftirqd/000:10:590
342899210,9cyclictest31223-21sshd23:06:075
342899210,2cyclictest10522-21bash23:32:045
27492210,0sleep00-21swapper/023:31:410
186342210,0sleep30-21swapper/300:19:423
132992210,12sleep685150irq/25-em1-rx-023:41:246
343999208,3cyclictest73-21ksoftirqd/723:45:497
343999208,3cyclictest73-21ksoftirqd/723:05:487
343999208,3cyclictest73-21ksoftirqd/722:07:547
343999208,1cyclictest73-21ksoftirqd/721:30:567
343999207,3cyclictest73-21ksoftirqd/721:21:427
3439992015,1cyclictest73-21ksoftirqd/722:22:237
342899202,6cyclictest30651-21grepconf.sh00:23:595
342899200,3cyclictest15679-21sshd21:32:505
342899200,2cyclictest7642-21sshd21:37:495
342899200,1cyclictest721-21dbus-daemon21:21:055
339899200,1cyclictest464-21systemd-journal23:09:520
343999198,2cyclictest73-21ksoftirqd/722:52:017
343999197,3cyclictest73-21ksoftirqd/722:13:597
3439991913,3cyclictest73-21ksoftirqd/700:22:587
3439991911,3cyclictest73-21ksoftirqd/721:56:327
342899193,7cyclictest2898-21bash23:11:435
342899190,3cyclictest31754-21systemd21:42:485
342899190,3cyclictest23566-21grepconf.sh23:54:385
342899190,3cyclictest18294-21rm00:19:415
342899190,1cyclictest21048-21sshd22:41:535
342899190,1cyclictest12874-21id22:56:025
3398991915,3cyclictest9-21ksoftirqd/023:56:260
3398991914,4cyclictest9-21ksoftirqd/022:55:200
262312190,0sleep70-21swapper/721:55:137
343999188,2cyclictest73-21ksoftirqd/700:11:247
343999188,1cyclictest73-21ksoftirqd/723:06:427
343999188,1cyclictest73-21ksoftirqd/721:44:207
343999188,1cyclictest73-21ksoftirqd/700:17:207
343999187,4cyclictest73-21ksoftirqd/721:46:467
343999187,3cyclictest73-21ksoftirqd/722:17:167
343999186,2cyclictest73-21ksoftirqd/722:28:027
343999182,3cyclictest20242-21systemd-cgroups23:34:297
343999181,2cyclictest73-21ksoftirqd/721:32:457
343999180,1cyclictest0-21swapper/722:51:137
3435991814,1cyclictest65-21ksoftirqd/621:51:306
342899181,7cyclictest27327-21grepconf.sh00:05:445
342899180,9cyclictest2084-21sshd23:29:525
342899180,9cyclictest15009-21grep00:15:555
342899180,7cyclictest21452-21bash23:07:175
342899180,2cyclictest5650-21grepconf.sh00:09:565
342899180,2cyclictest18781-21grepconf.sh22:31:025
342899180,2cyclictest14245-21sshd21:14:405
342899180,1cyclictest21412-21sshd21:49:315
3418991817,1cyclictest22752-21kworker/u16:123:18:043
3398991816,1cyclictest9-21ksoftirqd/022:46:090
3398991813,3cyclictest9-21ksoftirqd/022:34:410
300022180,1sleep229988-21bash22:00:532
343999178,2cyclictest73-21ksoftirqd/700:34:337
343999178,1cyclictest73-21ksoftirqd/721:11:497
343999177,3cyclictest73-21ksoftirqd/723:23:557
343999177,3cyclictest73-21ksoftirqd/723:23:557
343999177,1cyclictest73-21ksoftirqd/722:43:047
343999176,3cyclictest73-21ksoftirqd/721:17:417
343999176,2cyclictest73-21ksoftirqd/723:13:147
343999172,3cyclictest73-21ksoftirqd/723:31:047
3439991715,1cyclictest73-21ksoftirqd/721:41:047
343999171,2cyclictest0-21swapper/723:47:597
343999170,3cyclictest25447-21sshd23:58:207
343999170,1cyclictest0-21swapper/723:52:537
343999170,1cyclictest0-21swapper/722:33:117
343999170,1cyclictest0-21swapper/700:26:587
342899171,6cyclictest11033-21grepconf.sh22:39:355
342899170,2cyclictest25886-21sshd21:56:565
342899170,10cyclictest16725-21sshd21:06:585
342899170,1cyclictest5215-21sshd23:44:335
342899170,1cyclictest30188-21sshd22:58:475
342899170,1cyclictest0-21swapper/522:23:045
339899175,1cyclictest9-21ksoftirqd/023:11:430
339899173,1cyclictest131rcu_sched23:00:130
3398991715,1cyclictest9-21ksoftirqd/023:26:480
3398991715,1cyclictest9-21ksoftirqd/022:13:590
3398991714,2cyclictest32086-21sshd21:31:550
3398991711,2cyclictest9-21ksoftirqd/023:23:360
3398991711,2cyclictest9-21ksoftirqd/023:23:360
121992170,0sleep1241ktimersoftd/123:48:321
66072160,0sleep06599-21sshd22:03:070
343999167,3cyclictest73-21ksoftirqd/722:37:067
343999161,3cyclictest73-21ksoftirqd/722:57:547
3435991614,1cyclictest65-21ksoftirqd/622:24:476
3435991613,2cyclictest65-21ksoftirqd/621:54:196
3435991612,3cyclictest65-21ksoftirqd/622:35:056
342899161,7cyclictest12438-21sshd21:30:565
342899161,10cyclictest11085-21grepconf.sh23:24:555
342899161,10cyclictest11085-21grepconf.sh23:24:555
342899160,7cyclictest857-21polkitd22:04:215
342899160,6cyclictest14351-21sshd22:14:265
342899160,1cyclictest19046-21sshd22:47:135
342899160,1cyclictest0-21swapper/523:57:285
342899160,1cyclictest0-21swapper/522:35:425
3398991615,1cyclictest9-21ksoftirqd/000:31:510
3398991614,2cyclictest9-21ksoftirqd/000:04:300
3398991614,1cyclictest9-21ksoftirqd/023:38:420
3398991614,1cyclictest9-21ksoftirqd/022:28:300
3398991614,1cyclictest9-21ksoftirqd/021:24:540
3398991614,1cyclictest9-21ksoftirqd/000:18:380
3398991614,1cyclictest9-21ksoftirqd/000:14:120
3398991614,1cyclictest9-21ksoftirqd/000:00:460
3398991613,2cyclictest9-21ksoftirqd/022:46:430
3398991613,2cyclictest12007-21sshd21:47:050
3398991613,1cyclictest9-21ksoftirqd/000:28:250
3398991611,3cyclictest9-21ksoftirqd/022:22:580
195762160,0sleep10-21swapper/121:31:201
66782150,1sleep36681-21bash23:30:083
343999156,2cyclictest73-21ksoftirqd/700:11:447
3439991514,1cyclictest73-21ksoftirqd/723:40:317
343999151,3cyclictest73-21ksoftirqd/721:06:427
3435991514,1cyclictest65-21ksoftirqd/623:51:016
3435991514,1cyclictest65-21ksoftirqd/623:24:106
3435991514,1cyclictest65-21ksoftirqd/623:24:106
3435991514,1cyclictest65-21ksoftirqd/623:00:166
3435991514,1cyclictest65-21ksoftirqd/622:49:106
3435991513,1cyclictest65-21ksoftirqd/623:59:386
3435991513,1cyclictest65-21ksoftirqd/623:54:276
3435991513,1cyclictest65-21ksoftirqd/623:10:546
3435991513,1cyclictest65-21ksoftirqd/622:00:516
3435991512,1cyclictest65-21ksoftirqd/621:22:186
3435991511,3cyclictest65-21ksoftirqd/600:16:496
3435991510,1cyclictest65-21ksoftirqd/600:12:166
342899151,9cyclictest25509-21sshd21:51:345
342899150,1cyclictest3974-21bash21:25:015
3398991514,1cyclictest9-21ksoftirqd/023:41:330
3398991514,1cyclictest9-21ksoftirqd/022:08:200
3398991514,1cyclictest9-21ksoftirqd/021:14:310
3398991513,1cyclictest9-21ksoftirqd/021:54:170
3398991513,1cyclictest9-21ksoftirqd/021:37:030
3398991513,1cyclictest9-21ksoftirqd/021:27:460
3398991513,1cyclictest9-21ksoftirqd/021:19:230
3398991512,1cyclictest9-21ksoftirqd/000:22:170
3398991511,3cyclictest9-21ksoftirqd/023:03:010
237902150,0sleep40-21swapper/423:03:504
213822150,0sleep30-21swapper/322:40:103
343599149,4cyclictest65-21ksoftirqd/622:51:346
343599149,2cyclictest65-21ksoftirqd/621:09:196
343599148,3cyclictest65-21ksoftirqd/600:03:526
3435991412,2cyclictest65-21ksoftirqd/623:15:346
3435991412,2cyclictest65-21ksoftirqd/622:26:366
3435991412,1cyclictest65-21ksoftirqd/623:36:186
3435991412,1cyclictest65-21ksoftirqd/623:28:056
3435991412,1cyclictest65-21ksoftirqd/622:39:236
3435991412,1cyclictest65-21ksoftirqd/622:08:046
3435991412,1cyclictest65-21ksoftirqd/621:36:406
3435991412,1cyclictest65-21ksoftirqd/621:11:366
3435991412,1cyclictest65-21ksoftirqd/600:22:406
3435991412,1cyclictest65-21ksoftirqd/600:07:506
3418991412,1cyclictest41-21ksoftirqd/321:49:083
3401991413,1cyclictest25-21ksoftirqd/123:26:531
3398991412,1cyclictest9-21ksoftirqd/022:16:420
3398991412,1cyclictest9-21ksoftirqd/021:56:420
3398991412,1cyclictest9-21ksoftirqd/021:09:290
3435991312,1cyclictest65-21ksoftirqd/622:11:466
3435991311,1cyclictest65-21ksoftirqd/622:41:416
3435991311,1cyclictest65-21ksoftirqd/621:27:486
3435991311,1cyclictest65-21ksoftirqd/600:32:146
342299138,4cyclictest49-21ksoftirqd/423:27:134
3422991311,1cyclictest49-21ksoftirqd/421:11:074
3422991311,1cyclictest14409-21sshd00:26:434
342299130,12cyclictest24598-21sshd21:11:394
341899132,5cyclictest12503-21grepconf.sh00:30:173
3418991313,0cyclictest0-21swapper/322:10:553
3418991312,1cyclictest41-21ksoftirqd/323:49:153
341899130,12cyclictest4076-21bash23:33:343
3407991312,1cyclictest33-21ksoftirqd/222:10:032
3407991311,0cyclictest13550irq/24-ahci[00022:01:442
340799131,11cyclictest721-21dbus-daemon21:36:132
340199130,3cyclictest0-21swapper/120:01:431
298492130,1sleep1231rcuc/100:31:171
217142130,0sleep30-21swapper/322:45:393
342299129,2cyclictest17471-21sshd22:21:484
342299128,3cyclictest49-21ksoftirqd/421:18:234
342299125,4cyclictest857-21polkitd23:35:254
3422991211,1cyclictest0-21swapper/420:01:424
3422991210,1cyclictest49-21ksoftirqd/422:19:024
342299120,11cyclictest721-21dbus-daemon23:58:494
341899127,1cyclictest15916-21sshd22:54:223
341899122,4cyclictest7263-21sshd22:23:033
341899122,4cyclictest21513-21systemd-cgroups23:10:593
341899122,4cyclictest19675-21systemd21:07:103
341899122,4cyclictest1833-21sshd23:37:033
341899122,4cyclictest0-21swapper/300:32:113
3418991210,1cyclictest41-21ksoftirqd/322:35:023
3418991210,1cyclictest0-21swapper/321:17:313
341899121,5cyclictest16989-21systemd22:47:073
341899121,4cyclictest795-21sshd22:30:003
341899120,2cyclictest29779-21sshd22:02:363
341899120,11cyclictest9316-21kworker/3:421:43:563
341899120,11cyclictest29940-21sshd21:28:143
341899120,11cyclictest24444-21sshd00:21:483
3407991210,1cyclictest33-21ksoftirqd/222:19:052
340799120,2cyclictest19935-21grep22:43:412
340799120,11cyclictest721-21dbus-daemon00:18:262
340199122,4cyclictest721-21dbus-daemon22:23:151
340199122,4cyclictest6837-21sshd21:57:411
340199122,4cyclictest6232-21sshd23:31:491
3401991210,1cyclictest25-21ksoftirqd/122:28:201
340199121,5cyclictest5272-21bash00:26:161
244472120,0sleep224434-21sshd22:51:152
217932120,0sleep40-21swapper/421:42:134
49382110,0sleep20-21swapper/221:17:442
343999114,3cyclictest73-21ksoftirqd/720:56:307
343999114,1cyclictest73-21ksoftirqd/719:21:297
3439991110,1cyclictest73-21ksoftirqd/720:21:467
343999110,1cyclictest0-21swapper/719:46:457
342299119,1cyclictest49-21ksoftirqd/422:33:314
342299119,1cyclictest49-21ksoftirqd/421:59:174
342299119,1cyclictest49-21ksoftirqd/421:46:344
342299119,1cyclictest49-21ksoftirqd/400:07:504
342299118,3cyclictest49-21ksoftirqd/400:35:204
3422991110,1cyclictest0-21swapper/422:07:214
342299110,1cyclictest8178-21sshd23:24:464
342299110,1cyclictest8178-21sshd23:24:464
342299110,1cyclictest32006-21bash00:02:174
342299110,1cyclictest0-21swapper/422:54:114
341899119,1cyclictest41-21ksoftirqd/300:12:143
3418991111,0cyclictest0-21swapper/321:24:193
341899111,4cyclictest721-21dbus-daemon23:56:593
341899111,4cyclictest2236-21sshd23:15:213
341899111,4cyclictest2109-21sshd22:21:023
341899111,4cyclictest19538-21sshd22:14:443
341899110,11cyclictest9316-21kworker/3:422:01:123
341899110,10cyclictest29393-21systemd21:37:133
341899110,10cyclictest18085-21sshd23:23:283
341899110,10cyclictest18085-21sshd23:23:283
340799119,2cyclictest33-21ksoftirqd/223:21:302
340799119,2cyclictest33-21ksoftirqd/223:21:302
340799119,1cyclictest33-21ksoftirqd/223:56:062
340799119,1cyclictest33-21ksoftirqd/221:11:402
340799118,2cyclictest33-21ksoftirqd/222:35:492
340799115,3cyclictest15748-21id22:59:482
3407991111,0cyclictest0-21swapper/221:39:122
3407991110,1cyclictest0-21swapper/200:21:542
340799110,10cyclictest31222-21kworker/2:022:15:092
340799110,10cyclictest21944-21kworker/2:321:43:152
340199119,1cyclictest0-21swapper/122:56:491
340199113,2cyclictest5334-21grep23:22:441
340199113,2cyclictest5334-21grep23:22:441
3401991110,1cyclictest25-21ksoftirqd/123:06:441
3401991110,1cyclictest25-21ksoftirqd/121:49:591
340199111,4cyclictest859-21gdbus00:11:191
340199111,4cyclictest30719-21sshd22:08:051
340199111,4cyclictest0-21swapper/122:46:141
340199111,4cyclictest0-21swapper/121:15:021
340199110,5cyclictest709-21systemd-logind21:38:261
340199110,5cyclictest19457-21sshd21:20:291
340199110,11cyclictest4572-21kworker/1:121:52:231
340199110,11cyclictest28496-21kworker/1:221:35:271
340199110,11cyclictest24354-21kworker/1:023:14:121
340199110,1cyclictest26769-21sshd23:36:421
339899118,3cyclictest9-21ksoftirqd/020:04:010
89672100,1sleep233-21ksoftirqd/221:10:472
343999109,1cyclictest73-21ksoftirqd/719:41:417
343999109,1cyclictest73-21ksoftirqd/719:06:417
343999104,3cyclictest73-21ksoftirqd/721:01:397
343999101,3cyclictest0-21swapper/720:06:507
343999100,3cyclictest0-21swapper/719:36:417
343999100,1cyclictest0-21swapper/720:46:467
343599108,1cyclictest65-21ksoftirqd/621:06:306
342899103,6cyclictest752-21snmpd20:56:535
342899100,2cyclictest22803-21/usr/sbin/munin20:36:415
342899100,1cyclictest16168-21timerwakeupswit20:21:485
342299109,1cyclictest49-21ksoftirqd/421:36:454
342299108,1cyclictest49-21ksoftirqd/421:32:294
342299108,1cyclictest49-21ksoftirqd/400:11:444
342299103,4cyclictest857-21polkitd22:43:234
342299101,1cyclictest13294-21sshd00:21:154
342299100,6cyclictest11301-21systemd22:57:424
341899108,1cyclictest41-21ksoftirqd/321:35:183
341899102,3cyclictest23137-21sshd21:13:193
341899101,4cyclictest30755-21sshd00:02:123
341899100,4cyclictest24146-21sshd23:54:403
340799109,1cyclictest0-21swapper/220:26:512
340799108,2cyclictest33-21ksoftirqd/223:03:462
340799105,2cyclictest27567-21sshd23:42:052
340799103,4cyclictest17761-21id21:49:182
340799103,2cyclictest26308-21grep21:22:362
340799102,5cyclictest857-21polkitd23:07:272
340799102,5cyclictest0-21swapper/222:27:182
340799102,4cyclictest0-21swapper/200:34:412
340799101,5cyclictest13564-21sshd00:01:232
340799100,4cyclictest27752-21sshd00:09:212
340199109,1cyclictest0-21swapper/100:18:011
340199107,2cyclictest709-21systemd-logind22:49:141
340199107,2cyclictest709-21systemd-logind00:35:011
340199105,3cyclictest24195-21sshd00:01:511
340199102,7cyclictest15643-21grepconf.sh22:37:591
340199102,4cyclictest7348-21bash22:12:111
340199100,4cyclictest709-21systemd-logind22:53:431
340199100,4cyclictest32418-21sshd21:08:021
340199100,10cyclictest0-21swapper/122:19:091
339899109,1cyclictest0-21swapper/019:52:230
34399998,1cyclictest73-21ksoftirqd/719:31:437
34399997,1cyclictest73-21ksoftirqd/720:21:297
34399991,3cyclictest73-21ksoftirqd/720:29:547
34399991,1cyclictest73-21ksoftirqd/720:44:267
34399991,1cyclictest73-21ksoftirqd/720:44:267
34399991,1cyclictest73-21ksoftirqd/720:33:447
34399991,1cyclictest73-21ksoftirqd/720:15:117
34399991,1cyclictest73-21ksoftirqd/720:01:337
34399991,1cyclictest73-21ksoftirqd/719:21:307
34399991,1cyclictest0-21swapper/719:28:047
34399991,1cyclictest0-21swapper/719:13:247
34399990,3cyclictest0-21swapper/720:01:307
34399990,1cyclictest0-21swapper/720:56:437
34289993,5cyclictest752-21snmpd20:04:585
34289993,5cyclictest752-21snmpd19:45:215
34289992,6cyclictest9281-21gltestperf20:11:445
34289992,6cyclictest752-21snmpd21:05:355
34289992,6cyclictest752-21snmpd19:33:095
34289992,6cyclictest752-21snmpd19:24:235
34289992,6cyclictest26766-21tr19:46:415
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional