You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 01:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat May 30, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222602940,12sleep685150irq/25-em1-rx-021:45:156
31652890,1sleep53163-21grep21:18:235
26532830,1sleep1108599cyclictest00:10:311
168432800,0sleep1231rcuc/100:37:221
317572740,2sleep7110099cyclictest21:45:487
44552510,1sleep34443-21sshd21:20:133
64725026,8sleep70-21swapper/719:05:107
202322490,1sleep720234-21sshd21:52:377
165662490,2sleep7110099cyclictest22:31:147
282752480,0sleep50-21swapper/521:47:315
111282480,0sleep70-21swapper/700:11:017
69624724,8sleep00-21swapper/019:05:430
34022470,1sleep3464-21systemd-journal22:24:533
203912470,1sleep619946-21sshd00:24:306
163512470,1sleep316348-21sshd21:37:353
267532460,0sleep326751-21sshd22:55:533
70192450,2sleep0107999cyclictest22:49:090
31412450,0sleep50-21swapper/522:04:295
259232450,0sleep30-21swapper/321:45:283
223212450,0sleep60-21swapper/622:33:296
152502450,0sleep60-21swapper/622:42:186
218892440,0sleep70-21swapper/723:30:497
15742440,0sleep20-21swapper/221:57:052
63282430,0sleep56330-21cpuspeed_turbos20:13:455
312572430,0sleep10-21swapper/123:40:361
308512430,0sleep20-21swapper/222:00:332
273812430,1sleep027379-21bash23:36:420
24842430,0sleep30-21swapper/323:07:303
13292430,0sleep20-21swapper/223:18:342
285542420,0sleep50-21swapper/500:26:535
19512420,0sleep30-21swapper/300:28:593
98932410,0sleep70-21swapper/719:23:357
86362410,0sleep30-21swapper/322:12:193
236512410,0sleep00-21swapper/022:39:000
226652410,0sleep00-21swapper/000:19:030
114872410,0sleep40-21swapper/422:43:524
83724029,8sleep20-21swapper/219:07:212
78082400,0sleep20-21swapper/222:39:582
57524028,8sleep50-21swapper/519:04:205
21732400,0sleep50-21swapper/521:31:135
198642400,0sleep70-21swapper/722:11:037
88923928,8sleep10-21swapper/119:07:521
78823927,9sleep40-21swapper/419:06:434
60023928,8sleep30-21swapper/319:04:423
313652390,1sleep631367-21bash21:36:346
237822390,0sleep40-21swapper/400:11:464
158362390,0sleep415837-21systemd-cgroups21:41:134
158362390,0sleep415837-21systemd-cgroups21:41:134
189432380,0sleep00-21swapper/021:43:170
189432380,0sleep00-21swapper/021:43:170
101432380,0sleep70-21swapper/700:35:047
53723725,8sleep60-21swapper/619:03:576
92582360,2sleep1108599cyclictest00:18:241
249412360,0sleep10-21swapper/100:06:151
202372360,0sleep30-21swapper/300:02:163
88012330,0sleep30-21swapper/300:22:033
116062300,2sleep1108599cyclictest22:34:361
250932240,0sleep30-21swapper/322:20:363
110099234,6cyclictest8219-21sshd00:33:107
110099223,6cyclictest14619-21sshd00:00:037
139912210,0sleep30-21swapper/322:43:593
110099212,8cyclictest1594-21sshd22:48:527
110099212,4cyclictest22973-21sshd23:43:497
1097992117,3cyclictest49-21ksoftirqd/423:23:454
1097992116,3cyclictest49-21ksoftirqd/423:22:584
1097992115,4cyclictest49-21ksoftirqd/422:58:384
107999217,1cyclictest121rcu_preempt21:49:440
110099204,4cyclictest11267-21grepconf.sh22:19:487
110099203,2cyclictest32532-21bash22:45:057
110099202,5cyclictest13040-21grepconf.sh23:17:227
109799207,3cyclictest49-21ksoftirqd/422:49:364
1079992015,1cyclictest9-21ksoftirqd/022:17:590
29252190,0sleep70-21swapper/700:23:357
110099194,6cyclictest15862-21sshd23:00:487
110099194,5cyclictest6571-21grep21:23:597
110099194,5cyclictest1-21systemd22:14:047
110099194,3cyclictest27349-21grepconf.sh00:23:087
110099194,3cyclictest1-21systemd23:07:197
110099193,5cyclictest7845-21systemd23:50:247
110099193,5cyclictest21426-21bash22:01:547
110099192,5cyclictest19285-21grepconf.sh21:19:127
110099192,3cyclictest4976-21bash00:16:147
1079991916,1cyclictest9-21ksoftirqd/021:48:230
1079991915,3cyclictest9-21ksoftirqd/022:04:260
52172180,0sleep60-21swapper/623:16:546
110099184,3cyclictest859-21gdbus23:33:527
110099184,3cyclictest13033-21bash21:33:447
110099183,5cyclictest8689-21grepconf.sh23:13:277
110099183,5cyclictest31637-21sshd21:16:137
110099183,5cyclictest13559-21rm21:09:007
110099183,3cyclictest1666-21sshd22:35:567
110099183,2cyclictest0-21swapper/723:53:457
110099182,6cyclictest24990-21grep00:06:157
110099182,5cyclictest3040-21grep21:29:227
110099182,5cyclictest2416-21systemd21:57:087
110099182,4cyclictest721-21dbus-daemon23:27:157
1099991814,1cyclictest65-21ksoftirqd/623:55:006
1097991816,1cyclictest49-21ksoftirqd/400:08:084
107999184,1cyclictest9-21ksoftirqd/000:37:450
1079991816,1cyclictest9-21ksoftirqd/022:03:260
1079991815,1cyclictest9-21ksoftirqd/000:05:580
72132170,0sleep30-21swapper/323:29:573
242462170,0sleep30-21swapper/322:00:103
110099173,5cyclictest17481-21grepconf.sh22:38:457
110099173,4cyclictest7813-21id22:54:467
110099173,13cyclictest6838-21systemd21:38:517
110099173,13cyclictest6838-21systemd21:38:517
110099172,6cyclictest9597-21grepconf.sh22:25:157
110099172,2cyclictest14105-21sshd23:41:297
1097991715,2cyclictest49-21ksoftirqd/422:56:444
1097991713,3cyclictest49-21ksoftirqd/423:39:454
1097991713,2cyclictest49-21ksoftirqd/422:29:214
1097991713,1cyclictest49-21ksoftirqd/423:53:424
109799170,3cyclictest131rcu_sched23:47:124
107999175,1cyclictest121rcu_preempt23:01:310
1079991716,1cyclictest9-21ksoftirqd/021:13:510
1079991715,1cyclictest9-21ksoftirqd/022:20:490
1079991714,3cyclictest9-21ksoftirqd/022:25:550
1079991713,1cyclictest9-21ksoftirqd/022:54:300
107999171,2cyclictest121rcu_preempt23:06:210
107382170,0sleep4471rcuc/421:59:234
231682160,0sleep3721-21dbus-daemon22:52:003
110099163,3cyclictest998-21systemd22:04:217
110099162,3cyclictest1-21systemd23:21:287
1099991612,3cyclictest65-21ksoftirqd/623:59:476
109799165,1cyclictest49-21ksoftirqd/421:43:494
1097991615,1cyclictest49-21ksoftirqd/421:19:414
1097991614,1cyclictest49-21ksoftirqd/400:35:094
1097991613,2cyclictest49-21ksoftirqd/421:28:494
1097991613,1cyclictest49-21ksoftirqd/400:22:374
1097991612,1cyclictest49-21ksoftirqd/423:53:324
1079991615,1cyclictest9-21ksoftirqd/022:09:570
1079991615,1cyclictest9-21ksoftirqd/000:14:420
1079991614,1cyclictest9-21ksoftirqd/023:58:590
1079991614,1cyclictest9-21ksoftirqd/023:50:220
1079991614,1cyclictest9-21ksoftirqd/023:41:190
1079991614,1cyclictest9-21ksoftirqd/023:25:350
1079991614,1cyclictest9-21ksoftirqd/023:18:100
1079991614,1cyclictest9-21ksoftirqd/022:30:180
1079991614,1cyclictest9-21ksoftirqd/021:53:450
1079991614,1cyclictest9-21ksoftirqd/021:31:430
1079991614,1cyclictest9-21ksoftirqd/021:26:340
1079991614,1cyclictest9-21ksoftirqd/021:20:220
1079991614,1cyclictest9-21ksoftirqd/000:32:290
1079991614,1cyclictest9-21ksoftirqd/000:24:560
1079991612,3cyclictest9-21ksoftirqd/023:47:460
107999160,2cyclictest131rcu_sched23:09:430
107999160,15cyclictest22925-21kworker/0:323:56:100
316802150,0sleep30-21swapper/300:36:203
266692150,0sleep60-21swapper/622:03:586
185842150,0sleep60-21swapper/623:10:136
1099991513,1cyclictest65-21ksoftirqd/622:00:466
109799158,3cyclictest49-21ksoftirqd/423:34:204
1097991513,1cyclictest49-21ksoftirqd/423:31:364
1097991513,1cyclictest49-21ksoftirqd/423:09:244
1097991513,1cyclictest49-21ksoftirqd/422:05:334
1097991513,1cyclictest49-21ksoftirqd/421:55:344
1097991513,1cyclictest49-21ksoftirqd/421:25:114
1097991513,1cyclictest49-21ksoftirqd/400:16:274
1097991512,2cyclictest49-21ksoftirqd/421:16:164
1097991512,1cyclictest49-21ksoftirqd/422:41:184
1097991511,3cyclictest49-21ksoftirqd/423:03:524
109799150,1cyclictest131rcu_sched21:33:384
109799150,0cyclictest121rcu_preempt23:17:194
1095991513,1cyclictest41-21ksoftirqd/322:37:033
1079991514,1cyclictest9-21ksoftirqd/021:34:200
1079991513,1cyclictest9-21ksoftirqd/023:31:560
1079991513,1cyclictest9-21ksoftirqd/023:18:520
1079991513,1cyclictest9-21ksoftirqd/022:45:110
1079991513,1cyclictest9-21ksoftirqd/022:33:560
1079991513,1cyclictest9-21ksoftirqd/000:08:510
60812140,0sleep60-21swapper/622:34:176
275882140,0sleep527579-21sshd23:03:235
109999148,5cyclictest65-21ksoftirqd/621:28:316
109999148,4cyclictest65-21ksoftirqd/600:23:116
109999140,2cyclictest1-21systemd22:50:296
1097991413,1cyclictest49-21ksoftirqd/423:58:544
1097991413,1cyclictest49-21ksoftirqd/422:13:574
1097991412,1cyclictest9334-21kworker/4:621:49:394
1097991412,1cyclictest49-21ksoftirqd/421:12:534
1097991412,1cyclictest49-21ksoftirqd/400:31:074
1097991410,1cyclictest49-21ksoftirqd/422:09:294
109599148,3cyclictest41-21ksoftirqd/323:08:503
1095991412,1cyclictest41-21ksoftirqd/322:03:483
1079991412,1cyclictest9-21ksoftirqd/021:08:510
1079991411,1cyclictest9-21ksoftirqd/021:08:350
57632130,0sleep119303-21kworker/1:522:30:361
1099991312,1cyclictest65-21ksoftirqd/600:09:386
1099991311,2cyclictest65-21ksoftirqd/621:56:536
1099991311,1cyclictest65-21ksoftirqd/623:27:116
1099991310,3cyclictest65-21ksoftirqd/623:45:186
109899132,5cyclictest780-21sshd22:26:385
1097991312,1cyclictest49-21ksoftirqd/422:20:344
1097991311,1cyclictest49-21ksoftirqd/422:34:294
1097991311,1cyclictest49-21ksoftirqd/422:23:434
1097991311,1cyclictest49-21ksoftirqd/400:23:364
1095991311,1cyclictest41-21ksoftirqd/323:41:263
1092991311,1cyclictest756-21sshd00:04:302
1092991310,2cyclictest736-21gdbus00:35:152
109299130,13cyclictest19084-21kworker/2:523:22:132
108599132,10cyclictest2812-21sshd21:53:321
108599130,13cyclictest15035-21kworker/1:322:44:361
107999130,0cyclictest0-21swapper/019:10:110
52782120,0sleep60-21swapper/623:31:446
228152120,0sleep50-21swapper/519:43:515
109999122,4cyclictest1-21systemd21:09:006
1099991211,1cyclictest65-21ksoftirqd/622:25:166
1099991211,1cyclictest65-21ksoftirqd/621:43:276
1099991211,1cyclictest65-21ksoftirqd/621:43:276
1099991211,1cyclictest65-21ksoftirqd/600:17:406
1099991210,1cyclictest65-21ksoftirqd/623:39:066
1099991210,1cyclictest65-21ksoftirqd/622:20:226
109899123,8cyclictest19557-21sshd21:52:355
109899122,4cyclictest721-21dbus-daemon21:24:575
109899122,4cyclictest32233-21sshd22:22:545
109899122,4cyclictest30674-21bash23:05:215
109899122,4cyclictest24007-21sshd00:35:535
109899122,4cyclictest0-21swapper/500:09:495
109899122,10cyclictest0-21swapper/522:42:145
1098991211,1cyclictest0-21swapper/522:53:075
1098991210,1cyclictest57-21ksoftirqd/523:26:465
1098991210,1cyclictest57-21ksoftirqd/521:21:135
1098991210,1cyclictest57-21ksoftirqd/521:13:165
109599129,2cyclictest11241-21sshd23:22:503
1095991210,1cyclictest41-21ksoftirqd/321:56:593
109299129,2cyclictest730-21NetworkManager23:40:142
109299128,1cyclictest33-21ksoftirqd/221:32:262
109299126,5cyclictest709-21systemd-logind22:10:092
109299122,4cyclictest8575-21sshd23:33:462
109299122,4cyclictest22849-21sshd23:04:542
109299122,4cyclictest19886-21sshd21:17:272
109299122,4cyclictest1303-21systemd-cgroups00:08:392
109299120,11cyclictest32460-21kworker/2:222:23:212
108599122,4cyclictest859-21gdbus00:21:031
108599122,4cyclictest4687-21sshd00:27:231
108599122,4cyclictest31953-21sshd21:47:441
108599122,4cyclictest13457-21systemd-cgroups23:48:511
108599122,4cyclictest11206-21systemd-cgroups21:28:041
108599121,5cyclictest2991-21sshd23:33:291
108599120,12cyclictest6860-21kworker/1:123:07:151
108599120,12cyclictest20320-21kworker/1:100:30:551
108599120,11cyclictest18056-21kworker/1:021:35:121
44692110,0sleep20-21swapper/200:27:222
287982110,1sleep341-21ksoftirqd/323:44:063
19262110,0sleep50-21swapper/500:30:545
110099112,5cyclictest0-21swapper/719:08:457
109999119,1cyclictest65-21ksoftirqd/623:50:226
109999119,1cyclictest65-21ksoftirqd/623:35:036
109999119,1cyclictest65-21ksoftirqd/622:47:356
109999119,1cyclictest65-21ksoftirqd/622:13:256
109999118,1cyclictest65-21ksoftirqd/621:29:136
109999115,3cyclictest65-21ksoftirqd/623:03:386
1099991110,1cyclictest65-21ksoftirqd/623:22:376
1099991110,1cyclictest65-21ksoftirqd/600:07:196
109999111,4cyclictest1-21systemd21:16:116
109999110,10cyclictest27060-21sshd21:19:396
109899119,1cyclictest3184-21bash22:10:035
109899117,2cyclictest27492-21sshd23:44:025
109899112,3cyclictest0-21swapper/521:39:525
109899112,3cyclictest0-21swapper/521:39:525
1098991110,1cyclictest57-21ksoftirqd/523:58:435
109899111,4cyclictest9534-21sd-pam22:36:235
109899111,4cyclictest85250irq/26-em1-tx-023:15:535
109899111,4cyclictest7817-21sshd22:14:025
109899111,4cyclictest25141-21cp22:02:075
109899111,4cyclictest23742-21sshd23:19:455
109899111,4cyclictest23522-21sd-pam23:51:205
109899111,4cyclictest1-21systemd00:14:285
109899111,4cyclictest0-21swapper/500:23:055
109899110,5cyclictest4024-21systemd22:56:275
109899110,5cyclictest29957-21systemd23:10:535
109899110,11cyclictest3976-21kworker/5:222:46:245
109899110,11cyclictest26719-21kworker/5:421:58:035
109899110,11cyclictest26006-21kworker/5:123:42:135
109899110,10cyclictest0-21swapper/500:05:375
109799119,1cyclictest49-21ksoftirqd/421:08:354
1097991110,1cyclictest20175-21kworker/4:019:10:114
109599119,1cyclictest41-21ksoftirqd/323:17:393
109599119,1cyclictest41-21ksoftirqd/321:49:483
109599119,1cyclictest41-21ksoftirqd/300:05:353
109599118,2cyclictest41-21ksoftirqd/321:27:473
109599118,2cyclictest18529-21sshd00:09:333
109599118,1cyclictest41-21ksoftirqd/323:52:033
109599115,2cyclictest31415-21grepconf.sh21:12:303
109599112,5cyclictest27141-21systemd23:03:223
109599112,4cyclictest21243-21grepconf.sh22:29:373
1095991110,1cyclictest41-21ksoftirqd/300:15:583
109599110,10cyclictest13076-21sshd00:25:583
109299119,1cyclictest721-21dbus-daemon21:09:412
109299119,1cyclictest33-21ksoftirqd/200:17:472
109299119,1cyclictest24107-21bash21:19:292
109299119,1cyclictest0-21swapper/221:47:502
109299117,1cyclictest7830-21ntp_states21:38:532
109299117,1cyclictest7830-21ntp_states21:38:532
109299113,7cyclictest709-21systemd-logind22:27:272
109299113,7cyclictest32022-21sshd00:19:372
109299113,2cyclictest26325-21sshd23:08:502
109299112,4cyclictest709-21systemd-logind22:35:162
109299112,4cyclictest26199-21sshd21:34:232
109299112,4cyclictest15757-21sshd23:52:462
109299111,4cyclictest0-21swapper/222:18:252
109299110,5cyclictest3794-21sshd23:27:592
109299110,5cyclictest10845-21sshd22:04:562
109299110,11cyclictest5164-21kworker/2:121:26:012
109299110,11cyclictest19084-21kworker/2:523:32:392
109299110,10cyclictest1-21systemd21:53:302
108599119,1cyclictest25-21ksoftirqd/123:25:121
108599119,1cyclictest25-21ksoftirqd/123:13:511
108599119,1cyclictest25-21ksoftirqd/122:09:041
108599119,1cyclictest25-21ksoftirqd/121:33:171
108599112,4cyclictest26970-21sshd22:53:591
108599111,4cyclictest669-21avahi-daemon21:20:451
108599111,4cyclictest1200-21grepconf.sh21:16:211
108599111,4cyclictest0-21swapper/122:59:331
108599110,11cyclictest5283-21kworker/1:523:18:461
108599110,11cyclictest2524-21kworker/1:023:44:021
1079991110,1cyclictest0-21swapper/019:36:310
80852100,2sleep3109599cyclictest22:39:593
110099103,6cyclictest6748-21idleruntime-cro19:18:357
110099102,5cyclictest30455-21expr20:53:517
110099102,5cyclictest23018-21processes19:43:527
110099102,5cyclictest17004-21expr19:33:517
110099102,5cyclictest12431-21diskstats20:23:467
110099102,5cyclictest1096-21/usr/sbin/munin20:58:527
109999109,1cyclictest65-21ksoftirqd/622:14:036
109999109,0cyclictest0-21swapper/600:31:036
109999108,1cyclictest65-21ksoftirqd/623:00:376
109999108,1cyclictest65-21ksoftirqd/622:55:536
109999107,2cyclictest65-21ksoftirqd/600:34:296
109999100,3cyclictest0-21swapper/621:51:216
109899109,1cyclictest57-21ksoftirqd/523:28:425
109899103,4cyclictest857-21polkitd23:35:435
109899100,6cyclictest30467-21sshd22:32:035
109899100,4cyclictest0-21swapper/523:54:115
109899100,4cyclictest0-21swapper/521:34:145
109599108,1cyclictest41-21ksoftirqd/323:57:053
109599108,1cyclictest41-21ksoftirqd/323:37:573
109599108,1cyclictest41-21ksoftirqd/323:23:583
109599108,1cyclictest41-21ksoftirqd/321:18:183
109599103,4cyclictest30632-21id21:32:533
109599102,5cyclictest26014-21grep21:41:493
109599102,5cyclictest26014-21grep21:41:493
109299109,0cyclictest13550irq/24-ahci[00023:00:372
109299108,1cyclictest33-21ksoftirqd/223:56:262
109299103,6cyclictest9705-21sshd22:54:522
109299103,6cyclictest5965-21sshd22:50:592
109299103,1cyclictest1527-21sshd00:30:522
109299102,7cyclictest859-21gdbus22:44:592
109299101,4cyclictest10258-21sshd23:46:502
108599109,1cyclictest25-21ksoftirqd/123:13:061
108599109,1cyclictest25-21ksoftirqd/121:58:151
108599108,1cyclictest25-21ksoftirqd/123:37:171
108599108,1cyclictest25-21ksoftirqd/122:52:031
108599108,1cyclictest25-21ksoftirqd/122:08:081
108599103,4cyclictest859-21gdbus23:54:301
108599103,4cyclictest26846-21sshd22:42:591
108599103,1cyclictest5636-21sshd21:08:361
108599102,3cyclictest0-21swapper/122:14:311
108599100,4cyclictest669-21avahi-daemon21:42:241
108599100,4cyclictest669-21avahi-daemon21:42:241
108599100,4cyclictest17400-21sshd22:25:431
108599100,10cyclictest6835-21kworker/1:322:18:491
107999100,10cyclictest0-21swapper/019:48:490
11009992,4cyclictest24263-21/usr/sbin/munin19:48:467
11009992,4cyclictest18097-21df20:33:457
11009992,4cyclictest12460-21latency_hist19:28:357
10989990,9cyclictest0-21swapper/519:54:005
10959997,1cyclictest41-21ksoftirqd/322:14:263
10929998,1cyclictest33-21ksoftirqd/222:29:382
10929990,4cyclictest22083-21sshd23:58:422
10859997,1cyclictest25-21ksoftirqd/121:59:441
10859990,1cyclictest0-21swapper/123:59:011
10799998,1cyclictest9-21ksoftirqd/020:53:190
10799998,1cyclictest9-21ksoftirqd/020:53:190
10799998,1cyclictest9-21ksoftirqd/019:18:350
10799997,1cyclictest9-21ksoftirqd/020:28:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional