You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 06:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Apr 21, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1906721030,0sleep10-21swapper/122:30:311
26852740,0sleep00-21swapper/000:10:160
159402710,2sleep72136799cyclictest00:25:207
324262560,0sleep30-21swapper/322:47:303
272342540,0sleep10-21swapper/123:51:511
150762530,0sleep20-21swapper/222:32:082
35672500,0sleep50-21swapper/523:34:255
236952500,0sleep60-21swapper/623:21:056
59662490,0sleep45968-21kworker/u16:423:56:024
252452480,0sleep30-21swapper/322:00:213
280682470,0sleep40-21swapper/422:02:234
196422470,0sleep00-21swapper/022:34:140
69542460,0sleep60-21swapper/600:26:396
307572460,1sleep530658-21sshd21:40:215
263142460,0sleep70-21swapper/722:00:257
168642460,0sleep721299-21cyclictest22:50:157
67922450,0sleep66791-21systemd-cgroups22:44:216
252282450,2sleep72136799cyclictest23:35:317
19682450,2sleep62135999cyclictest00:24:396
101942450,0sleep00-21swapper/021:17:020
101942450,0sleep00-21swapper/021:17:020
33072440,0sleep73288-21sshd00:01:187
321962440,0sleep60-21swapper/600:15:266
194822440,0sleep30-21swapper/300:14:513
137662440,0sleep40-21swapper/423:11:344
126052440,0sleep50-21swapper/521:28:205
294042430,0sleep1231rcuc/121:56:591
26882430,0sleep4481ktimersoftd/400:19:174
106822430,0sleep10-21swapper/100:30:271
228692420,0sleep30-21swapper/323:55:133
217592420,0sleep40-21swapper/422:28:574
105922420,0sleep010585-21sshd22:26:290
2110124118,8sleep00-21swapper/019:09:000
104272410,0sleep00-21swapper/021:59:380
293342400,1sleep329322-21sshd22:16:473
231642400,0sleep30-21swapper/321:56:373
2114324027,9sleep50-21swapper/519:09:295
2111924027,9sleep30-21swapper/319:09:113
2090824027,9sleep40-21swapper/419:06:234
2090524028,9sleep10-21swapper/119:06:201
2088924028,9sleep70-21swapper/719:06:107
300572390,0sleep50-21swapper/523:10:395
2090623928,8sleep20-21swapper/219:06:212
2086123926,9sleep60-21swapper/619:05:456
177432390,0sleep10-21swapper/100:38:121
14382390,0sleep60-21swapper/600:13:506
132992390,0sleep50-21swapper/521:19:075
132992390,0sleep50-21swapper/521:19:075
308652380,0sleep40-21swapper/421:49:414
201992380,0sleep20-21swapper/200:00:252
106602380,0sleep20-21swapper/222:39:122
88502370,0sleep20-21swapper/223:04:112
312292370,0sleep50-21swapper/500:13:415
175902370,1sleep517592-21grepconf.sh21:21:075
8092360,0sleep40-21swapper/400:10:124
146612360,0sleep00-21swapper/023:40:210
146612360,0sleep00-21swapper/023:40:210
139782340,1sleep713974-21sshd23:18:497
38992300,0sleep63900-21grep23:34:266
21359992510,1cyclictest65-21ksoftirqd/622:32:586
2135999246,3cyclictest65-21ksoftirqd/623:55:466
2135999239,1cyclictest65-21ksoftirqd/600:30:496
2135999237,1cyclictest65-21ksoftirqd/621:25:176
2134499239,1cyclictest49-21ksoftirqd/421:34:414
2135999228,1cyclictest65-21ksoftirqd/622:05:126
2134499228,3cyclictest49-21ksoftirqd/423:17:054
2134499228,3cyclictest49-21ksoftirqd/421:21:304
2134499225,3cyclictest49-21ksoftirqd/421:37:284
21344992211,3cyclictest49-21ksoftirqd/422:24:004
255012210,1sleep61844-21nfsd00:07:576
21359992110,3cyclictest65-21ksoftirqd/623:06:446
21359992110,2cyclictest65-21ksoftirqd/623:15:166
2134499215,3cyclictest49-21ksoftirqd/400:03:494
21344992114,4cyclictest49-21ksoftirqd/421:15:234
21344992114,4cyclictest49-21ksoftirqd/421:15:234
2135999209,3cyclictest65-21ksoftirqd/600:04:466
2135999209,2cyclictest65-21ksoftirqd/621:56:376
2135999208,3cyclictest65-21ksoftirqd/621:20:136
2135999208,1cyclictest65-21ksoftirqd/623:51:466
2135999207,3cyclictest65-21ksoftirqd/622:24:506
2135999206,2cyclictest65-21ksoftirqd/622:39:016
2135999205,1cyclictest65-21ksoftirqd/623:28:426
21359992013,4cyclictest65-21ksoftirqd/621:42:026
21359992010,2cyclictest65-21ksoftirqd/623:43:316
21359992010,2cyclictest65-21ksoftirqd/623:43:316
2135999201,3cyclictest13206-21bash23:49:206
2134499206,1cyclictest49-21ksoftirqd/423:36:044
2134499202,1cyclictest49-21ksoftirqd/423:51:344
21344992016,1cyclictest49-21ksoftirqd/400:32:154
21344992010,4cyclictest49-21ksoftirqd/421:55:404
2131899200,2cyclictest8573-21bash23:49:041
2131899200,2cyclictest8158-21grepconf.sh00:26:431
2131899200,1cyclictest1197-21sshd22:40:221
2135999198,3cyclictest65-21ksoftirqd/622:51:086
2135999197,1cyclictest65-21ksoftirqd/621:16:276
2135999197,1cyclictest65-21ksoftirqd/621:16:276
2135999196,1cyclictest65-21ksoftirqd/623:10:136
21359991914,3cyclictest65-21ksoftirqd/621:14:226
21359991913,4cyclictest65-21ksoftirqd/622:57:056
2134499199,1cyclictest49-21ksoftirqd/421:51:454
2134499198,1cyclictest49-21ksoftirqd/423:46:334
2134499198,1cyclictest49-21ksoftirqd/421:29:264
2134499197,2cyclictest49-21ksoftirqd/421:10:124
2134499196,3cyclictest49-21ksoftirqd/423:30:014
2134499195,3cyclictest49-21ksoftirqd/422:49:114
2134499193,1cyclictest49-21ksoftirqd/421:42:134
2131899194,5cyclictest14459-21bash21:43:111
2131899190,1cyclictest11893-21if_em123:40:141
2131899190,1cyclictest11893-21if_em123:40:141
2135999188,3cyclictest65-21ksoftirqd/623:38:156
2135999187,2cyclictest65-21ksoftirqd/622:12:596
2135999187,1cyclictest65-21ksoftirqd/622:45:186
2135999187,1cyclictest65-21ksoftirqd/600:38:356
2135999185,2cyclictest65-21ksoftirqd/622:16:556
21359991816,1cyclictest65-21ksoftirqd/621:50:566
21359991814,1cyclictest65-21ksoftirqd/621:30:366
21359991812,4cyclictest65-21ksoftirqd/623:02:276
2134499189,1cyclictest49-21ksoftirqd/422:59:174
2134499187,3cyclictest49-21ksoftirqd/400:06:554
2134499186,1cyclictest49-21ksoftirqd/423:00:334
2134499185,3cyclictest49-21ksoftirqd/422:39:364
2134499182,4cyclictest49-21ksoftirqd/422:50:014
21344991816,1cyclictest49-21ksoftirqd/422:15:434
21344991812,4cyclictest49-21ksoftirqd/423:29:174
21344991812,3cyclictest49-21ksoftirqd/422:08:414
2131899182,2cyclictest26049-21grepconf.sh23:39:161
2131899181,2cyclictest2632-21grepconf.sh23:27:071
2131899180,2cyclictest1-21systemd21:27:151
2131899180,1cyclictest721-21dbus-daemon00:01:171
2131899180,1cyclictest1-21systemd22:05:271
2135999177,1cyclictest65-21ksoftirqd/622:25:036
2135999176,3cyclictest65-21ksoftirqd/622:00:326
2135999176,1cyclictest65-21ksoftirqd/621:35:506
21359991713,3cyclictest65-21ksoftirqd/621:48:516
2135199170,0cyclictest0-21swapper/521:53:585
2134499176,3cyclictest49-21ksoftirqd/423:20:244
2134499174,1cyclictest49-21ksoftirqd/423:43:564
2134499174,1cyclictest49-21ksoftirqd/423:43:564
21344991715,1cyclictest49-21ksoftirqd/422:12:324
2134499171,2cyclictest49-21ksoftirqd/422:40:234
2132599170,16cyclictest14794-21kworker/2:323:31:382
2131899170,2cyclictest19028-21sshd21:50:471
2131899170,1cyclictest13277-21systemd-cgroups23:18:471
236542160,0sleep30-21swapper/322:57:473
2134499165,3cyclictest49-21ksoftirqd/423:09:364
21344991615,1cyclictest49-21ksoftirqd/422:30:384
21344991614,1cyclictest49-21ksoftirqd/400:35:054
21344991614,1cyclictest49-21ksoftirqd/400:25:174
21344991614,1cyclictest49-21ksoftirqd/400:20:584
2132599160,13cyclictest14794-21kworker/2:323:22:442
2131899160,8cyclictest0-21swapper/121:36:591
2131899160,2cyclictest8078-21sshd22:47:581
2131899160,2cyclictest12361-21id22:19:291
2131899160,1cyclictest6300-21chrt23:12:591
2131899160,1cyclictest0-21swapper/100:15:081
21310991614,1cyclictest9-21ksoftirqd/023:34:040
21310991614,1cyclictest1844-21nfsd23:58:570
261352150,1sleep526099-21sshd00:02:365
2135199151,3cyclictest0-21swapper/521:55:125
2135199150,0cyclictest0-21swapper/520:01:145
2133399150,2cyclictest25804-21sshd00:09:493
21325991513,1cyclictest33-21ksoftirqd/221:37:192
21325991513,1cyclictest33-21ksoftirqd/221:23:202
2132599150,15cyclictest23459-21kworker/2:322:17:522
2131899159,5cyclictest9619-21sshd22:35:241
2131899150,2cyclictest32217-21tail19:25:221
2131899150,2cyclictest25250-21bash23:24:501
2131899150,1cyclictest3337-21sshd22:51:151
2131899150,1cyclictest18251-21sshd22:01:491
21310991514,1cyclictest9-21ksoftirqd/023:26:380
21310991513,1cyclictest9-21ksoftirqd/023:15:380
21310991513,1cyclictest9-21ksoftirqd/022:40:090
21310991513,1cyclictest9-21ksoftirqd/000:22:080
21310991512,3cyclictest9-21ksoftirqd/021:21:300
21310991511,1cyclictest9-21ksoftirqd/022:35:140
9502140,0sleep70-21swapper/721:42:247
270862140,0sleep30-21swapper/323:39:193
21325991413,1cyclictest33-21ksoftirqd/223:47:542
21325991412,1cyclictest33-21ksoftirqd/222:10:522
21325991412,1cyclictest33-21ksoftirqd/221:47:212
21325991411,2cyclictest33-21ksoftirqd/223:42:282
21325991411,2cyclictest33-21ksoftirqd/223:42:282
21325991410,3cyclictest33-21ksoftirqd/223:39:542
21325991410,2cyclictest33-21ksoftirqd/221:44:582
2132599140,14cyclictest20629-21kworker/2:223:07:132
2132599140,1cyclictest131rcu_sched21:15:182
2132599140,1cyclictest131rcu_sched21:15:182
2131899144,6cyclictest1-21systemd23:58:071
2131899143,8cyclictest11632-21grepconf.sh22:57:061
2131899140,1cyclictest12165-21sshd21:31:581
2131899140,1cyclictest0-21swapper/123:02:311
21310991412,1cyclictest9-21ksoftirqd/022:55:240
21310991412,1cyclictest9-21ksoftirqd/021:25:190
204832140,0sleep50-21swapper/523:19:115
117422140,0sleep50-21swapper/500:39:445
113492140,0sleep30-21swapper/323:31:113
2136799137,3cyclictest365-21httpd23:25:447
2136799137,1cyclictest27113-21kworker/7:523:13:167
2135999130,1cyclictest121rcu_preempt20:05:006
2135199139,1cyclictest57-21ksoftirqd/500:24:285
21351991311,1cyclictest57-21ksoftirqd/523:07:265
21351991311,1cyclictest5538-21systemd22:55:025
21333991311,1cyclictest22798-21systemd-cgroups00:36:363
21333991311,1cyclictest0-21swapper/322:22:173
21333991310,2cyclictest41-21ksoftirqd/322:51:543
21325991312,1cyclictest33-21ksoftirqd/222:51:322
21325991312,1cyclictest33-21ksoftirqd/221:25:172
21325991312,1cyclictest15-21kswork23:26:432
21325991311,2cyclictest33-21ksoftirqd/222:57:372
21325991311,2cyclictest33-21ksoftirqd/221:55:072
21325991311,1cyclictest721-21dbus-daemon00:36:072
21325991311,1cyclictest33-21ksoftirqd/223:55:222
21325991311,1cyclictest33-21ksoftirqd/222:41:402
21325991311,1cyclictest33-21ksoftirqd/222:01:222
21325991311,1cyclictest33-21ksoftirqd/221:13:542
21325991311,1cyclictest33-21ksoftirqd/200:28:352
21325991310,2cyclictest33-21ksoftirqd/223:10:152
21325991310,2cyclictest33-21ksoftirqd/200:11:342
21325991310,2cyclictest33-21ksoftirqd/200:07:312
21325991310,1cyclictest33-21ksoftirqd/200:30:382
21325991310,1cyclictest33-21ksoftirqd/200:22:112
21325991310,1cyclictest33-21ksoftirqd/200:16:022
2132599130,1cyclictest121rcu_preempt23:17:422
2131899133,6cyclictest13114-21grepconf.sh00:12:391
2131899130,8cyclictest12947-21sshd22:21:141
2131099139,3cyclictest9-21ksoftirqd/022:02:190
2131099139,1cyclictest9-21ksoftirqd/021:37:050
2131099136,4cyclictest9-21ksoftirqd/023:02:570
21310991312,1cyclictest9-21ksoftirqd/023:50:490
21310991312,1cyclictest9-21ksoftirqd/022:46:520
21310991312,1cyclictest9-21ksoftirqd/000:35:130
21310991312,1cyclictest9-21ksoftirqd/000:25:280
21310991311,2cyclictest9-21ksoftirqd/023:11:080
21310991311,1cyclictest9-21ksoftirqd/023:05:310
21310991311,1cyclictest9-21ksoftirqd/022:09:490
21310991311,1cyclictest9-21ksoftirqd/000:19:190
21310991310,2cyclictest9-21ksoftirqd/021:50:010
21310991310,2cyclictest9-21ksoftirqd/021:41:340
2131099131,1cyclictest131rcu_sched00:31:210
2131099130,13cyclictest1401-21kworker/0:422:14:370
57022120,0sleep20-21swapper/222:22:392
53112120,1sleep3721-21dbus-daemon23:54:173
21367991211,1cyclictest73-21ksoftirqd/722:57:147
21367991211,1cyclictest31436-21sshd23:01:477
2136799120,11cyclictest30869-21kworker/7:121:35:137
2136799120,11cyclictest27113-21kworker/7:523:24:317
21359991210,1cyclictest65-21ksoftirqd/619:40:006
2135199129,1cyclictest57-21ksoftirqd/523:42:225
2135199129,1cyclictest57-21ksoftirqd/523:42:225
2135199128,3cyclictest57-21ksoftirqd/521:30:425
2135199128,1cyclictest5928-21sshd21:37:085
2135199122,4cyclictest1-21systemd23:58:105
21351991210,1cyclictest57-21ksoftirqd/522:47:535
21351991210,1cyclictest57-21ksoftirqd/500:25:365
21351991210,1cyclictest57-21ksoftirqd/500:15:515
21351991210,1cyclictest57-21ksoftirqd/500:07:335
2135199120,11cyclictest7539-21nfsd422:35:195
2135199120,11cyclictest3967-21bash22:40:325
2135199120,11cyclictest29151-21sshd22:18:375
21344991210,1cyclictest49-21ksoftirqd/421:10:004
2133399129,2cyclictest20777-21bash21:41:393
2133399123,5cyclictest28693-21bash23:23:123
21333991210,1cyclictest41-21ksoftirqd/323:01:103
21325991210,1cyclictest33-21ksoftirqd/223:50:202
21325991210,1cyclictest33-21ksoftirqd/222:25:042
21325991210,1cyclictest33-21ksoftirqd/222:06:152
21325991210,1cyclictest33-21ksoftirqd/221:33:112
2131899124,7cyclictest2640-21cp22:29:421
2131899123,6cyclictest13797-21grepconf.sh21:45:011
2131899121,1cyclictest721-21dbus-daemon21:17:471
2131899121,1cyclictest721-21dbus-daemon21:17:471
2131899120,2cyclictest5782-21grep22:10:101
2131899120,2cyclictest464-21systemd-journal23:30:181
2131899120,2cyclictest4470-21grep23:05:381
2131899120,2cyclictest20745-21id21:21:181
2131899120,2cyclictest20658-21sshd00:05:501
2131899120,11cyclictest19754-21grep00:21:591
2131899120,1cyclictest7336-21bash21:10:501
2131099129,2cyclictest9-21ksoftirqd/022:54:170
2131099128,3cyclictest9-21ksoftirqd/023:24:410
21310991210,1cyclictest9-21ksoftirqd/023:39:290
21310991210,1cyclictest9-21ksoftirqd/021:47:570
21310991210,1cyclictest9-21ksoftirqd/021:30:050
21310991210,1cyclictest11261-21systemd-cgroups23:47:220
2131099121,1cyclictest131rcu_sched22:15:080
2131099120,3cyclictest0-21swapper/020:55:430
2131099120,2cyclictest1-21systemd22:24:150
290092110,0sleep70-21swapper/722:20:207
2136799119,1cyclictest0-21swapper/722:05:187
2136799113,3cyclictest0-21swapper/721:47:147
2136799112,4cyclictest22040-21sshd23:46:097
2136799112,4cyclictest18649-21grep23:42:247
2136799112,4cyclictest18649-21grep23:42:247
2136799112,4cyclictest0-21swapper/722:40:537
2136799110,5cyclictest14713-21systemd21:15:247
2136799110,5cyclictest14713-21systemd21:15:247
2136799110,11cyclictest29507-21kworker/7:200:06:547
2136799110,11cyclictest18822-21kworker/7:121:25:177
2136799110,10cyclictest0-21swapper/722:48:597
2136799110,1cyclictest20794-21sshd22:19:587
2135999119,1cyclictest65-21ksoftirqd/621:10:006
2135199119,1cyclictest57-21ksoftirqd/523:52:425
2135199119,1cyclictest57-21ksoftirqd/523:28:515
2135199119,1cyclictest57-21ksoftirqd/523:02:255
2135199119,1cyclictest57-21ksoftirqd/522:53:335
2135199119,1cyclictest57-21ksoftirqd/522:01:535
2135199119,1cyclictest57-21ksoftirqd/521:13:495
2135199119,1cyclictest57-21ksoftirqd/500:32:075
2135199115,3cyclictest14289-21grep22:14:145
2135199110,5cyclictest0-21swapper/521:46:105
2135199110,11cyclictest5619-21bash22:20:495
2135199110,10cyclictest0-21swapper/523:36:585
2133399119,1cyclictest41-21ksoftirqd/300:31:213
2133399119,1cyclictest41-21ksoftirqd/300:02:303
2133399115,3cyclictest4246-21systemd-cgroups23:46:593
2133399113,5cyclictest3664-21sshd00:22:553
2133399112,5cyclictest721-21dbus-daemon21:15:303
2133399112,5cyclictest721-21dbus-daemon21:15:303
21333991110,1cyclictest41-21ksoftirqd/323:16:373
2133399110,1cyclictest0-21swapper/322:07:023
2133399110,1cyclictest0-21swapper/321:46:043
2132599119,1cyclictest33-21ksoftirqd/221:50:282
21325991110,1cyclictest33-21ksoftirqd/222:45:332
2131099119,1cyclictest9-21ksoftirqd/021:10:160
2131099119,1cyclictest9-21ksoftirqd/000:08:120
2131099119,1cyclictest9-21ksoftirqd/000:00:180
106962110,0sleep30-21swapper/321:52:133
2136799109,1cyclictest0-21swapper/722:32:567
2136799108,1cyclictest73-21ksoftirqd/722:25:277
2136799103,6cyclictest8837-21sshd23:31:027
2136799103,6cyclictest22144-21sshd21:30:397
2136799103,6cyclictest15975-21sshd22:35:467
2136799103,1cyclictest752-21snmpd00:16:237
2136799102,7cyclictest24627-21sshd00:33:067
2136799101,4cyclictest5908-21grepconf.sh21:50:077
2136799100,4cyclictest20235-21sshd23:06:327
2136799100,4cyclictest0-21swapper/721:56:087
2136799100,4cyclictest0-21swapper/721:10:117
2136799100,10cyclictest29507-21kworker/7:200:21:537
2136799100,10cyclictest18519-21kworker/7:123:55:217
2136799100,10cyclictest0-21swapper/700:13:487
2135999108,1cyclictest65-21ksoftirqd/619:45:166
2135999103,2cyclictest65-21ksoftirqd/620:50:146
2135199108,1cyclictest57-21ksoftirqd/523:20:215
2135199108,1cyclictest57-21ksoftirqd/522:26:075
2135199108,1cyclictest57-21ksoftirqd/522:05:365
2135199108,1cyclictest1721-21kworker/5:222:34:365
2135199106,1cyclictest10986-21id23:45:315
2134499109,1cyclictest49-21ksoftirqd/421:00:004
2134499109,1cyclictest49-21ksoftirqd/420:35:004
2134499109,1cyclictest49-21ksoftirqd/419:35:004
2134499108,1cyclictest49-21ksoftirqd/420:55:004
2133399109,1cyclictest41-21ksoftirqd/322:33:323
2133399109,1cyclictest41-21ksoftirqd/321:14:053
2133399108,1cyclictest41-21ksoftirqd/321:27:443
2133399107,2cyclictest713750sshd00:28:323
2133399107,1cyclictest41-21ksoftirqd/323:43:123
2133399107,1cyclictest41-21ksoftirqd/323:43:123
2133399103,5cyclictest857-21polkitd23:06:063
2133399103,4cyclictest32139-21sshd22:25:523
2133399101,5cyclictest7238-21sshd23:14:523
2133399101,5cyclictest17469-21bash22:10:443
2132599109,1cyclictest0-21swapper/220:40:192
2131899104,5cyclictest27574-21cstates19:20:111
2131899103,6cyclictest4482-21cat19:35:141
2131899100,1cyclictest0-21swapper/120:25:141
2131899100,1cyclictest0-21swapper/120:05:181
213679998,1cyclictest73-21ksoftirqd/700:35:377
213679997,1cyclictest73-21ksoftirqd/721:22:167
213679996,2cyclictest73-21ksoftirqd/720:22:197
213679990,8cyclictest20611-21sshd23:51:287
213679990,4cyclictest25714-21sshd22:11:127
213519997,1cyclictest57-21ksoftirqd/519:45:005
213449997,1cyclictest49-21ksoftirqd/420:10:004
213339997,1cyclictest41-21ksoftirqd/322:40:213
213339997,1cyclictest41-21ksoftirqd/321:30:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional