You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 21:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Aug 27, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19252930,2sleep02907699cyclictest12:24:180
198622870,0sleep773-21ksoftirqd/709:36:217
28512680,0sleep40-21swapper/409:37:144
230402590,1sleep62909199cyclictest10:45:246
268112530,0sleep40-21swapper/410:47:234
8932520,1sleep0884-21sshd11:31:160
203812520,1sleep665-21ksoftirqd/611:07:036
2877725126,8sleep40-21swapper/407:03:094
2870425139,8sleep70-21swapper/707:02:077
200882510,0sleep60-21swapper/609:16:266
2882725038,8sleep50-21swapper/507:03:505
252342500,0sleep30-21swapper/310:07:253
252342500,0sleep30-21swapper/310:07:253
44992490,0sleep40-21swapper/412:08:044
2861824925,8sleep60-21swapper/607:00:546
192592490,0sleep20-21swapper/209:40:012
119032490,0sleep40-21swapper/409:11:434
119032490,0sleep40-21swapper/409:11:434
42652480,2sleep62909199cyclictest09:40:536
2875824825,8sleep30-21swapper/307:02:523
227012480,6sleep341-21ksoftirqd/307:50:153
211722480,0sleep50-21swapper/511:39:545
135442480,1sleep773-21ksoftirqd/709:59:367
321732470,1sleep52908899cyclictest12:00:285
321732470,1sleep52908899cyclictest12:00:285
240292470,0sleep10-21swapper/111:09:061
311302460,0sleep10-21swapper/111:53:111
2872624641,2sleep00-21swapper/007:02:240
25772460,0sleep40-21swapper/410:07:584
25772460,0sleep40-21swapper/410:07:584
325682450,1sleep632569-21grep11:47:486
270542450,0sleep40-21swapper/411:05:334
23162450,1sleep62317-21df_abs08:10:286
32772440,0sleep30-21swapper/310:40:333
241752440,0sleep00-21swapper/009:51:040
160092440,0sleep10-21swapper/112:01:201
160092440,0sleep10-21swapper/112:01:201
29682430,1sleep12971-21grep10:53:201
296452430,1sleep129647-21grepconf.sh11:40:221
29452430,1sleep42942-21sshd12:22:304
269602430,0sleep3721-21dbus-daemon09:44:023
92892420,0sleep50-21swapper/511:26:165
60912420,1sleep16090-21id12:10:011
194452420,1sleep1241ktimersoftd/111:47:031
50432410,0sleep00-21swapper/010:42:300
193652410,0sleep319359-21sshd12:25:173
146102410,2sleep02907699cyclictest12:06:480
52592400,0sleep30-21swapper/312:02:343
52592400,0sleep30-21swapper/312:02:343
2889024027,9sleep10-21swapper/107:04:421
2879324022,15sleep20-21swapper/207:03:232
123822400,0sleep50-21swapper/511:59:245
284562390,0sleep00-21swapper/011:47:340
252652390,0sleep00-21swapper/009:31:100
237112370,0sleep20-21swapper/210:00:112
22442370,0sleep10-21swapper/112:24:191
142922230,1sleep614281-21bash11:26:336
2908899222,6cyclictest28336-21grep11:45:425
2908899222,19cyclictest6196-21sshd11:24:205
142602220,0sleep4481ktimersoftd/411:03:004
2908899212,3cyclictest25222-21bash10:02:015
2908899212,3cyclictest25222-21bash10:02:015
2908899211,4cyclictest1-21systemd11:14:425
29076992119,1cyclictest9-21ksoftirqd/009:56:320
66162200,0sleep00-21swapper/012:04:320
66162200,0sleep00-21swapper/012:04:320
29076992017,3cyclictest9-21ksoftirqd/010:38:560
271242200,0sleep10-21swapper/111:14:431
2908899191,2cyclictest1989-21sshd10:51:235
2908899191,2cyclictest0-21swapper/510:57:155
2908899190,4cyclictest0-21swapper/511:16:355
29076991913,3cyclictest9-21ksoftirqd/010:52:590
2908899183,8cyclictest4430-21bash11:31:275
2908899183,3cyclictest4690-21grepconf.sh12:06:145
2908899182,7cyclictest0-21swapper/510:14:245
2908899182,7cyclictest0-21swapper/510:14:245
2908899182,5cyclictest26557-21grepconf.sh09:34:565
2908899182,5cyclictest25431-21systemd-cgroups11:09:115
2908899182,5cyclictest23286-21chrt12:10:535
2908899182,5cyclictest22956-21grepconf.sh11:01:395
2908899182,3cyclictest12894-21bash09:59:345
2908899181,6cyclictest0-21swapper/510:16:555
29076991815,2cyclictest9-21ksoftirqd/011:51:420
29076991815,1cyclictest9-21ksoftirqd/009:39:480
29076991814,3cyclictest9-21ksoftirqd/012:30:240
29076991814,3cyclictest9-21ksoftirqd/012:28:580
2907699180,2cyclictest131rcu_sched10:10:010
2907699180,2cyclictest131rcu_sched10:10:010
29091991716,1cyclictest65-21ksoftirqd/610:08:226
29091991716,1cyclictest65-21ksoftirqd/610:08:226
2908899173,5cyclictest24915-21bash09:27:355
2908899173,4cyclictest736-21gdbus09:17:265
2908899172,6cyclictest16861-21grep09:38:025
2908899172,5cyclictest5396-21rm11:42:385
2908899172,5cyclictest4373-21sshd09:21:015
2908899172,5cyclictest4180-21sd-pam11:53:305
2908899172,5cyclictest32042-21sshd10:45:495
2908899172,5cyclictest30308-21sshd12:35:015
2908899172,5cyclictest11752-21sshd12:21:095
2908899172,5cyclictest0-21swapper/510:40:155
2908899172,4cyclictest20500-21systemd10:39:475
2908899171,4cyclictest0-21swapper/509:52:175
2908899170,6cyclictest0-21swapper/509:11:135
2908899170,6cyclictest0-21swapper/509:11:135
29079991710,6cyclictest5705-21sshd10:17:093
29078991715,2cyclictest33-21ksoftirqd/212:16:242
29078991714,2cyclictest33-21ksoftirqd/211:21:042
29077991715,1cyclictest25-21ksoftirqd/109:23:211
29076991716,1cyclictest9-21ksoftirqd/011:25:260
29076991712,1cyclictest9-21ksoftirqd/011:43:100
67132160,1sleep06700-21bash10:29:570
29102991613,2cyclictest15147-21sshd11:41:207
29091991615,1cyclictest65-21ksoftirqd/610:14:516
29091991615,1cyclictest65-21ksoftirqd/610:14:516
29091991614,1cyclictest65-21ksoftirqd/610:50:296
2908899162,7cyclictest5131-21sshd10:20:415
2908899162,5cyclictest2461-21bash09:48:045
2908899162,5cyclictest20540-21bash10:25:175
2908899162,4cyclictest26172-21sshd10:07:285
2908899162,4cyclictest26172-21sshd10:07:285
2908899162,2cyclictest25515-21sshd10:30:535
2908899161,4cyclictest721-21dbus-daemon12:27:245
2908899161,3cyclictest721-21dbus-daemon12:16:205
2908899161,3cyclictest3007-21grep09:44:315
29078991614,1cyclictest33-21ksoftirqd/211:04:202
29077991615,1cyclictest25-21ksoftirqd/111:55:331
29077991614,1cyclictest25-21ksoftirqd/111:03:081
29077991614,1cyclictest25-21ksoftirqd/110:18:231
29076991614,1cyclictest9-21ksoftirqd/011:37:400
29076991614,1cyclictest9-21ksoftirqd/010:23:530
29076991614,1cyclictest9-21ksoftirqd/010:15:230
29076991614,1cyclictest9-21ksoftirqd/009:12:240
29076991614,1cyclictest9-21ksoftirqd/009:12:240
29076991613,2cyclictest9-21ksoftirqd/009:42:180
29076991613,1cyclictest9-21ksoftirqd/009:48:110
267362160,0sleep233-21ksoftirqd/211:52:562
86442150,0sleep30-21swapper/309:09:503
29822150,0sleep3391rcuc/309:13:033
29822150,0sleep3391rcuc/309:13:033
29091991513,1cyclictest65-21ksoftirqd/611:00:566
29091991512,3cyclictest65-21ksoftirqd/611:30:356
29091991512,3cyclictest65-21ksoftirqd/609:47:586
29091991511,3cyclictest65-21ksoftirqd/611:37:396
29091991511,3cyclictest65-21ksoftirqd/610:33:386
2908899152,3cyclictest721-21dbus-daemon09:07:545
29078991513,1cyclictest33-21ksoftirqd/212:30:562
29078991513,1cyclictest33-21ksoftirqd/210:26:372
2907899150,14cyclictest24027-21kworker/2:210:00:492
2907899150,14cyclictest24027-21kworker/2:210:00:492
2907899150,1cyclictest131rcu_sched10:59:102
29077991514,1cyclictest25-21ksoftirqd/110:55:311
29077991514,1cyclictest25-21ksoftirqd/109:36:591
29077991513,1cyclictest25-21ksoftirqd/110:35:211
29077991513,1cyclictest25-21ksoftirqd/109:41:151
29077991513,1cyclictest25-21ksoftirqd/109:30:351
29077991512,1cyclictest25-21ksoftirqd/112:32:101
29076991514,1cyclictest9-21ksoftirqd/011:58:070
29076991514,1cyclictest9-21ksoftirqd/010:13:070
29076991514,1cyclictest9-21ksoftirqd/010:13:070
29076991513,1cyclictest9-21ksoftirqd/012:15:310
29076991513,1cyclictest9-21ksoftirqd/012:12:090
29076991513,1cyclictest9-21ksoftirqd/011:07:250
29076991513,1cyclictest9-21ksoftirqd/011:02:070
29076991513,1cyclictest9-21ksoftirqd/010:55:280
29076991512,1cyclictest9-21ksoftirqd/009:22:120
56402140,0sleep30-21swapper/310:48:023
2910299147,6cyclictest73-21ksoftirqd/709:14:557
2910299147,6cyclictest73-21ksoftirqd/709:14:557
29102991411,2cyclictest73-21ksoftirqd/712:06:427
29091991413,1cyclictest65-21ksoftirqd/611:12:426
29091991412,1cyclictest65-21ksoftirqd/612:18:256
29091991412,1cyclictest65-21ksoftirqd/609:23:426
29078991413,1cyclictest33-21ksoftirqd/212:12:502
29078991413,1cyclictest33-21ksoftirqd/211:48:472
29078991412,1cyclictest33-21ksoftirqd/211:37:422
29078991412,1cyclictest33-21ksoftirqd/211:09:372
29078991412,1cyclictest33-21ksoftirqd/210:50:492
29078991412,1cyclictest33-21ksoftirqd/209:47:052
29078991411,2cyclictest33-21ksoftirqd/209:43:032
29078991410,3cyclictest33-21ksoftirqd/210:48:382
2907899140,14cyclictest948-21kworker/2:009:28:332
2907899140,13cyclictest25262-21kworker/2:011:13:422
29077991412,1cyclictest25-21ksoftirqd/112:25:311
29077991412,1cyclictest25-21ksoftirqd/111:23:261
29077991412,1cyclictest25-21ksoftirqd/110:40:301
29077991412,1cyclictest25-21ksoftirqd/110:12:301
29077991412,1cyclictest25-21ksoftirqd/110:12:301
29077991412,1cyclictest25-21ksoftirqd/110:08:581
29077991412,1cyclictest25-21ksoftirqd/110:08:581
29077991412,1cyclictest25-21ksoftirqd/109:56:331
29077991411,2cyclictest25-21ksoftirqd/109:27:011
29077991410,3cyclictest25-21ksoftirqd/109:16:481
29077991410,1cyclictest25-21ksoftirqd/110:22:591
2907799141,1cyclictest131rcu_sched10:35:061
2907799140,14cyclictest15159-21kworker/1:310:01:391
2907799140,14cyclictest15159-21kworker/1:310:01:391
2907799140,1cyclictest131rcu_sched10:27:581
2907799140,1cyclictest131rcu_sched09:06:381
29076991413,1cyclictest9-21ksoftirqd/009:29:050
29076991412,1cyclictest9-21ksoftirqd/011:24:560
29076991412,1cyclictest9-21ksoftirqd/011:16:300
29076991412,1cyclictest9-21ksoftirqd/011:10:160
29076991412,1cyclictest9-21ksoftirqd/010:49:150
29076991412,1cyclictest9-21ksoftirqd/010:30:360
29076991412,1cyclictest9-21ksoftirqd/010:01:190
29076991412,1cyclictest9-21ksoftirqd/010:01:190
29076991412,1cyclictest9-21ksoftirqd/009:07:470
242432140,0sleep70-21swapper/710:27:157
146502140,0sleep3401ktimersoftd/310:12:143
146502140,0sleep3401ktimersoftd/310:12:143
318822130,1sleep631843-21sshd11:18:326
2910299139,1cyclictest21402-21sshd11:52:387
2910299132,5cyclictest16719-21sshd11:06:517
2910299130,12cyclictest0-21swapper/712:23:547
29091991311,1cyclictest65-21ksoftirqd/609:50:516
29091991310,1cyclictest65-21ksoftirqd/610:37:396
2908099132,5cyclictest28420-21bash11:11:044
2908099130,13cyclictest22897-21kworker/4:510:53:504
2907999138,1cyclictest0-21swapper/309:37:163
2907999138,0cyclictest0-21swapper/309:33:483
2907999130,8cyclictest0-21swapper/312:07:493
2907999130,12cyclictest31646-21kworker/3:011:33:183
2907899139,4cyclictest33-21ksoftirqd/212:08:232
2907899137,1cyclictest33-21ksoftirqd/210:38:352
29078991312,1cyclictest33-21ksoftirqd/211:29:102
29078991312,1cyclictest33-21ksoftirqd/210:42:262
29078991312,1cyclictest33-21ksoftirqd/210:19:132
29078991312,1cyclictest33-21ksoftirqd/209:12:522
29078991312,1cyclictest33-21ksoftirqd/209:12:522
29078991311,2cyclictest33-21ksoftirqd/211:31:002
29078991311,1cyclictest33-21ksoftirqd/212:00:482
29078991311,1cyclictest33-21ksoftirqd/212:00:482
29078991311,1cyclictest33-21ksoftirqd/211:41:562
29078991311,1cyclictest33-21ksoftirqd/211:15:582
29078991311,1cyclictest33-21ksoftirqd/210:21:202
29078991311,1cyclictest33-21ksoftirqd/210:07:552
29078991311,1cyclictest33-21ksoftirqd/210:07:552
29078991311,1cyclictest33-21ksoftirqd/209:22:012
29078991310,2cyclictest33-21ksoftirqd/212:20:302
2907899130,1cyclictest131rcu_sched10:14:512
2907899130,1cyclictest131rcu_sched10:14:512
2907799138,1cyclictest25-21ksoftirqd/112:14:161
29077991312,1cyclictest25-21ksoftirqd/109:12:361
29077991312,1cyclictest25-21ksoftirqd/109:12:361
29077991311,1cyclictest25-21ksoftirqd/111:30:331
29077991311,1cyclictest25-21ksoftirqd/110:45:321
29077991310,2cyclictest25-21ksoftirqd/112:18:591
2907799130,13cyclictest0-21swapper/111:36:161
29076991312,1cyclictest9-21ksoftirqd/009:17:440
223992130,0sleep20-21swapper/209:50:582
9932120,0sleep00-21swapper/008:05:330
2910299122,4cyclictest24344-21bash11:00:027
2910299122,4cyclictest2001-21sshd11:47:547
2910299122,4cyclictest0-21swapper/710:06:027
2910299122,4cyclictest0-21swapper/710:06:027
29102991210,1cyclictest73-21ksoftirqd/712:29:527
29102991210,1cyclictest73-21ksoftirqd/710:37:527
2910299121,5cyclictest23265-21systemd12:00:017
2910299121,5cyclictest11017-21cp10:03:037
2910299121,5cyclictest11017-21cp10:03:037
2910299120,11cyclictest7153-21systemd10:48:077
2910299120,11cyclictest325-21sd-pam11:22:107
2910299120,11cyclictest27899-21kworker/7:210:11:397
2910299120,11cyclictest27899-21kworker/7:210:11:397
2910299120,11cyclictest1755-21kworker/7:109:17:057
2910299120,11cyclictest1161-21kworker/7:510:32:237
2910299120,11cyclictest10477-21kworker/7:011:29:427
2910299120,11cyclictest0-21swapper/711:32:447
2909199127,2cyclictest6901-21cp09:31:586
2909199124,4cyclictest65-21ksoftirqd/609:14:276
2909199124,4cyclictest65-21ksoftirqd/609:14:276
29091991211,1cyclictest65-21ksoftirqd/609:55:356
29091991211,1cyclictest65-21ksoftirqd/609:28:136
29091991210,1cyclictest65-21ksoftirqd/610:57:336
29091991210,1cyclictest65-21ksoftirqd/610:27:296
29091991210,1cyclictest65-21ksoftirqd/610:16:566
2909199120,2cyclictest6599-21systemd11:55:286
2908099122,6cyclictest7428-21bash09:59:154
2908099122,4cyclictest5483-21sshd10:02:444
2908099122,4cyclictest5483-21sshd10:02:444
2908099120,2cyclictest11098-21grepconf.sh12:13:544
2908099120,2cyclictest10094-21systemd09:09:554
2907999129,2cyclictest2478-21systemctl11:36:553
2907999127,1cyclictest0-21swapper/310:03:553
2907999127,1cyclictest0-21swapper/310:03:553
2907999126,2cyclictest6125-21sshd09:53:463
29079991211,1cyclictest41-21ksoftirqd/312:20:273
2907999120,9cyclictest0-21swapper/310:56:153
2907999120,12cyclictest0-21swapper/310:29:363
2907999120,11cyclictest30304-21kworker/3:310:50:423
2907899122,1cyclictest131rcu_sched11:56:112
29078991210,1cyclictest33-21ksoftirqd/212:25:562
29078991210,1cyclictest33-21ksoftirqd/210:31:132
29078991210,1cyclictest33-21ksoftirqd/209:30:312
29078991210,1cyclictest33-21ksoftirqd/209:18:572
29078991210,1cyclictest33-21ksoftirqd/209:08:412
2907799128,1cyclictest25-21ksoftirqd/111:28:481
29077991211,1cyclictest25-21ksoftirqd/111:18:461
29077991211,1cyclictest25-21ksoftirqd/109:53:281
29077991210,1cyclictest25-21ksoftirqd/109:46:401
29076991210,1cyclictest9-21ksoftirqd/009:05:150
128642120,0sleep7721ktimersoftd/711:15:377
63752110,0sleep30-21swapper/311:26:063
310312110,0sleep40-21swapper/410:31:134
2910299119,1cyclictest73-21ksoftirqd/710:16:207
2910299113,5cyclictest20685-21sshd11:10:387
2910299112,3cyclictest0-21swapper/709:50:267
29102991110,1cyclictest73-21ksoftirqd/712:18:217
2910299111,4cyclictest21203-21sshd10:43:267
2910299111,4cyclictest0-21swapper/709:41:457
2910299110,11cyclictest4056-21kworker/7:311:39:567
2910299110,11cyclictest29805-21kworker/7:010:54:297
2910299110,10cyclictest0-21swapper/709:29:367
2909199119,1cyclictest65-21ksoftirqd/612:21:126
2909199119,1cyclictest65-21ksoftirqd/612:12:136
2909199119,1cyclictest65-21ksoftirqd/612:06:266
2909199119,1cyclictest65-21ksoftirqd/611:42:536
2909199119,1cyclictest65-21ksoftirqd/610:03:476
2909199119,1cyclictest65-21ksoftirqd/610:03:476
2909199119,1cyclictest65-21ksoftirqd/609:07:206
2909199117,3cyclictest65-21ksoftirqd/611:21:496
2909199117,1cyclictest65-21ksoftirqd/610:40:346
29091991110,1cyclictest65-21ksoftirqd/612:04:196
29091991110,1cyclictest65-21ksoftirqd/612:04:196
2908099119,1cyclictest0-21swapper/412:16:164
2908099118,3cyclictest49-21ksoftirqd/411:34:094
2908099113,2cyclictest17936-21bash09:48:574
2908099112,4cyclictest6924-21sshd12:00:484
2908099112,4cyclictest6924-21sshd12:00:484
2908099112,4cyclictest18599-21sshd09:54:294
2908099111,1cyclictest0-21swapper/410:36:404
2908099110,11cyclictest0-21swapper/410:28:354
2908099110,10cyclictest2764-21sshd11:18:434
2908099110,1cyclictest0-21swapper/411:57:024
2907999119,1cyclictest41-21ksoftirqd/312:30:193
2907999119,1cyclictest41-21ksoftirqd/312:16:273
2907999112,4cyclictest6156-21sshd10:33:303
2907999110,5cyclictest32023-21grepconf.sh11:11:163
2907999110,11cyclictest5295-21kworker/3:511:51:013
2907999110,11cyclictest23478-21kworker/3:012:15:133
2907999110,11cyclictest1807-21kworker/3:409:58:243
2907999110,11cyclictest1439-21kworker/3:309:21:313
2907999110,10cyclictest30620-21systemd-cgroups09:26:043
2907999110,10cyclictest25192-21grep11:18:103
2907899118,2cyclictest33-21ksoftirqd/209:05:152
156952110,0sleep70-21swapper/712:03:107
156952110,0sleep70-21swapper/712:03:107
137802110,0sleep30-21swapper/310:21:113
2910299103,1cyclictest1-21systemd09:07:217
2910299102,7cyclictest3385-21cp12:13:287
2910299101,4cyclictest721-21dbus-daemon10:21:537
2910299101,4cyclictest19726-21sshd09:30:517
2910299100,4cyclictest28642-21bash11:00:157
2910299100,10cyclictest4015-21kworker/7:509:45:287
2910299100,10cyclictest30199-21kworker/7:309:23:297
2909199108,1cyclictest65-21ksoftirqd/612:30:246
2909199108,1cyclictest65-21ksoftirqd/611:52:026
2909199108,1cyclictest65-21ksoftirqd/609:35:316
2909199100,9cyclictest30932-21kworker/6:212:25:596
2909199100,10cyclictest85150irq/25-em1-rx-010:21:116
2908899102,1cyclictest0-21swapper/508:30:305
2908899101,5cyclictest3846-21timerwakeupswit08:10:375
2908099109,1cyclictest49-21ksoftirqd/412:27:154
2908099108,1cyclictest49-21ksoftirqd/410:20:304
2908099108,1cyclictest49-21ksoftirqd/409:27:564
2908099105,1cyclictest721-21dbus-daemon11:45:274
2908099104,3cyclictest1-21systemd11:40:294
2908099104,2cyclictest1-21systemd11:28:534
2908099103,4cyclictest30964-21sshd09:31:294
2908099103,4cyclictest10429-21sd-pam12:30:154
2908099102,4cyclictest4751-21grepconf.sh11:38:574
2908099101,4cyclictest19476-21sshd10:10:384
2908099101,4cyclictest19476-21sshd10:10:384
2908099100,9cyclictest7806-21kworker/4:411:20:494
2908099100,9cyclictest15445-21kworker/4:009:22:414
2908099100,4cyclictest4497-21grepconf.sh10:56:594
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional