You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 19:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Mar 27, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77882920,2sleep4571999cyclictest11:57:504
228702750,1sleep222867-21sshd11:23:202
92812730,1sleep79279-21sshd11:20:457
188342590,0sleep5551rcuc/511:56:395
86292510,1sleep48628-21sshd11:50:294
3642510,0sleep6361-21systemd-cgroups12:01:136
151942500,2sleep11116-21nfsd09:44:281
530924926,9sleep70-21swapper/707:02:367
282442480,0sleep40-21swapper/410:27:484
136052480,0sleep60-21swapper/611:21:006
120052480,0sleep20-21swapper/209:47:582
119252470,1sleep511922-21bash10:13:565
32492460,2sleep1571199cyclictest11:50:101
310222460,0sleep50-21swapper/510:18:445
225902460,0sleep40-21swapper/410:07:064
81852450,0sleep20-21swapper/211:37:222
79942440,0sleep30-21swapper/311:31:463
302682430,0sleep50-21swapper/507:46:455
302682430,0sleep50-21swapper/507:46:455
292032430,2sleep7573199cyclictest10:46:337
257602430,0sleep00-21swapper/009:35:460
147892430,1sleep4481ktimersoftd/412:22:254
166072420,0sleep60-21swapper/611:08:036
160652420,0sleep60-21swapper/609:35:126
555924130,8sleep30-21swapper/307:06:003
30522410,0sleep50-21swapper/510:33:505
278072410,0sleep00-21swapper/012:21:250
278072410,0sleep00-21swapper/012:21:250
262682410,0sleep60-21swapper/611:36:386
9342400,0sleep40-21swapper/411:22:024
553824027,9sleep00-21swapper/007:05:410
530324029,8sleep10-21swapper/107:02:301
529024027,9sleep60-21swapper/607:02:196
35782400,1sleep43577-21awk11:01:444
308132400,0sleep20-21swapper/209:56:312
308132400,0sleep20-21swapper/209:56:312
276102400,0sleep20-21swapper/212:28:482
250762400,0sleep30-21swapper/312:30:333
132052400,0sleep70-21swapper/709:06:387
543823928,8sleep20-21swapper/207:04:232
538223926,9sleep40-21swapper/407:03:374
296123927,8sleep50-21swapper/507:01:295
199892390,0sleep20-21swapper/211:19:282
150162390,0sleep50-21swapper/512:28:035
9592380,0sleep50-21swapper/510:52:165
49422380,0sleep70-21swapper/709:34:337
48832380,0sleep70-21swapper/711:26:067
280812380,0sleep30-21swapper/310:39:003
214082380,0sleep30-21swapper/312:34:013
206572360,2sleep3571399cyclictest09:59:363
206572360,2sleep3571399cyclictest09:59:363
175582360,0sleep10-21swapper/111:54:431
162642350,0sleep70-21swapper/709:29:377
59932330,2sleep5572699cyclictest11:27:565
280852310,0sleep70-21swapper/712:19:327
280852310,0sleep70-21swapper/712:19:327
300082300,0sleep40-21swapper/410:41:024
5711992317,3cyclictest25-21ksoftirqd/109:54:081
5711992117,1cyclictest25-21ksoftirqd/110:36:271
5713992012,1cyclictest41-21ksoftirqd/309:25:273
571399201,5cyclictest8738-21bash09:12:253
5711992016,3cyclictest25-21ksoftirqd/111:35:521
84132190,0sleep30-21swapper/312:25:523
571399198,3cyclictest41-21ksoftirqd/311:08:483
5713991914,3cyclictest41-21ksoftirqd/311:58:003
571399191,3cyclictest41-21ksoftirqd/311:55:563
571399190,5cyclictest17991-21sshd11:39:523
571399190,1cyclictest41-21ksoftirqd/311:25:363
45532190,0sleep00-21swapper/012:21:490
5713991813,3cyclictest41-21ksoftirqd/311:28:433
5713991813,3cyclictest41-21ksoftirqd/309:41:543
5713991810,3cyclictest41-21ksoftirqd/312:15:403
571399180,5cyclictest15748-21sshd10:25:193
571399180,1cyclictest0-21swapper/309:20:163
571199185,1cyclictest25-21ksoftirqd/109:20:471
5711991816,1cyclictest25-21ksoftirqd/112:16:391
5711991816,1cyclictest25-21ksoftirqd/112:16:391
5711991816,1cyclictest25-21ksoftirqd/112:10:321
5711991816,1cyclictest25-21ksoftirqd/110:27:401
5711991814,3cyclictest25-21ksoftirqd/109:39:021
236362180,0sleep00-21swapper/007:36:390
96612170,1sleep59656-21bash11:54:155
5731991715,1cyclictest73-21ksoftirqd/710:56:377
5726991715,1cyclictest57-21ksoftirqd/511:12:205
5726991715,1cyclictest57-21ksoftirqd/510:28:065
5726991714,2cyclictest57-21ksoftirqd/511:23:135
571399177,1cyclictest41-21ksoftirqd/310:53:313
571399176,2cyclictest41-21ksoftirqd/312:07:203
571399176,2cyclictest41-21ksoftirqd/309:07:473
571399174,3cyclictest41-21ksoftirqd/310:05:483
5713991716,1cyclictest41-21ksoftirqd/311:43:593
5713991716,1cyclictest41-21ksoftirqd/311:43:593
5713991716,1cyclictest41-21ksoftirqd/310:36:273
5713991716,1cyclictest41-21ksoftirqd/309:53:013
5713991715,1cyclictest41-21ksoftirqd/310:12:273
5713991712,3cyclictest41-21ksoftirqd/310:46:023
571399171,5cyclictest0-21swapper/311:48:503
571399171,1cyclictest0-21swapper/310:06:483
571399171,0cyclictest0-21swapper/310:27:363
5711991715,2cyclictest25-21ksoftirqd/109:50:521
5711991715,1cyclictest492-21systemd-journal11:13:551
5711991715,1cyclictest25-21ksoftirqd/112:02:051
5711991715,1cyclictest25-21ksoftirqd/111:41:531
5711991715,1cyclictest25-21ksoftirqd/111:41:531
5711991715,1cyclictest25-21ksoftirqd/111:20:051
5711991715,1cyclictest25-21ksoftirqd/111:06:491
5711991715,1cyclictest25-21ksoftirqd/110:48:051
5711991715,1cyclictest25-21ksoftirqd/110:44:031
5711991715,1cyclictest25-21ksoftirqd/110:20:081
5711991715,1cyclictest25-21ksoftirqd/110:05:011
5711991715,1cyclictest25-21ksoftirqd/109:57:271
5711991715,1cyclictest25-21ksoftirqd/109:57:271
5711991715,1cyclictest25-21ksoftirqd/109:12:371
5711991714,1cyclictest25-21ksoftirqd/112:13:351
571199170,2cyclictest131rcu_sched12:23:531
147232170,0sleep50-21swapper/510:45:435
5726991615,1cyclictest57-21ksoftirqd/511:20:445
5726991614,1cyclictest57-21ksoftirqd/512:02:075
5726991614,1cyclictest57-21ksoftirqd/509:44:065
571399167,1cyclictest41-21ksoftirqd/311:19:513
571399167,1cyclictest41-21ksoftirqd/310:57:263
5713991615,1cyclictest41-21ksoftirqd/312:02:563
5713991615,1cyclictest41-21ksoftirqd/311:11:473
5713991615,1cyclictest41-21ksoftirqd/309:36:433
5713991615,1cyclictest41-21ksoftirqd/309:31:423
5713991611,3cyclictest41-21ksoftirqd/309:28:313
571399161,1cyclictest0-21swapper/309:46:323
5711991615,1cyclictest25-21ksoftirqd/109:31:281
5711991615,1cyclictest25-21ksoftirqd/109:25:131
5711991615,1cyclictest25-21ksoftirqd/109:07:561
5711991614,1cyclictest25-21ksoftirqd/112:28:261
5711991614,1cyclictest25-21ksoftirqd/111:39:431
5711991614,1cyclictest25-21ksoftirqd/111:26:411
5711991614,1cyclictest25-21ksoftirqd/110:40:551
5711991614,1cyclictest25-21ksoftirqd/110:22:301
5711991614,1cyclictest25-21ksoftirqd/110:12:291
5711991614,1cyclictest25-21ksoftirqd/110:07:471
5711991614,1cyclictest25-21ksoftirqd/109:30:501
5711991612,3cyclictest25-21ksoftirqd/111:23:121
886321512,1sleep557-21ksoftirqd/511:09:315
5731991512,2cyclictest73-21ksoftirqd/711:30:197
5726991513,1cyclictest57-21ksoftirqd/510:39:225
5726991513,1cyclictest57-21ksoftirqd/509:21:285
5726991511,3cyclictest57-21ksoftirqd/510:46:365
5713991514,1cyclictest41-21ksoftirqd/311:03:443
5713991513,1cyclictest41-21ksoftirqd/310:16:393
571399151,2cyclictest0-21swapper/312:17:203
571399151,2cyclictest0-21swapper/312:17:203
571399151,1cyclictest0-21swapper/310:46:393
5711991514,1cyclictest25-21ksoftirqd/111:01:371
5711991513,1cyclictest25-21ksoftirqd/111:56:461
5711991513,1cyclictest25-21ksoftirqd/110:56:351
5711991513,1cyclictest25-21ksoftirqd/110:51:421
5711991512,1cyclictest25-21ksoftirqd/112:31:441
5710991512,2cyclictest14710-21memory09:06:420
194442150,0sleep20-21swapper/209:31:402
74172140,0sleep60-21swapper/609:19:516
70342140,0sleep60-21swapper/611:13:076
5731991413,1cyclictest73-21ksoftirqd/710:07:377
5731991412,1cyclictest73-21ksoftirqd/709:57:217
5731991412,1cyclictest73-21ksoftirqd/709:57:217
573199141,1cyclictest131rcu_sched11:04:127
5726991413,1cyclictest57-21ksoftirqd/511:47:415
5726991413,1cyclictest57-21ksoftirqd/509:15:115
5726991412,2cyclictest1-21systemd11:01:205
5726991412,1cyclictest57-21ksoftirqd/509:27:275
5712991412,1cyclictest33-21ksoftirqd/212:07:102
200532140,0sleep20-21swapper/212:24:392
120712140,1sleep41-21systemd12:05:354
573199138,2cyclictest73-21ksoftirqd/710:40:437
5731991311,1cyclictest73-21ksoftirqd/711:13:147
5731991311,1cyclictest73-21ksoftirqd/710:44:167
5731991311,1cyclictest73-21ksoftirqd/710:11:587
572999132,5cyclictest691-21systemd-logind11:01:516
572999132,5cyclictest3221-21systemd10:00:296
572999132,5cyclictest3221-21systemd10:00:296
5729991311,1cyclictest1-21systemd12:33:066
572999131,3cyclictest1212-21sshd11:53:456
572699139,3cyclictest57-21ksoftirqd/512:19:005
572699139,3cyclictest57-21ksoftirqd/512:19:005
572699133,4cyclictest2002-21sshd12:12:235
5726991312,1cyclictest57-21ksoftirqd/512:10:225
5726991312,1cyclictest57-21ksoftirqd/511:41:535
5726991312,1cyclictest57-21ksoftirqd/511:41:535
5726991311,1cyclictest57-21ksoftirqd/511:31:415
5726991311,1cyclictest57-21ksoftirqd/510:05:565
5726991311,1cyclictest57-21ksoftirqd/509:50:215
5726991310,2cyclictest57-21ksoftirqd/510:23:225
5726991310,2cyclictest57-21ksoftirqd/509:57:375
5726991310,2cyclictest57-21ksoftirqd/509:57:375
5726991310,2cyclictest57-21ksoftirqd/509:54:435
5719991310,2cyclictest492-21systemd-journal09:32:524
571299130,13cyclictest13442-21kworker/2:209:43:072
5710991312,1cyclictest9-21ksoftirqd/010:33:150
49812130,0sleep40-21swapper/412:29:224
234332130,0sleep40-21swapper/410:46:144
191632130,0sleep00-21swapper/009:39:070
163422130,0sleep20-21swapper/212:16:542
163422130,0sleep20-21swapper/212:16:542
91842120,0sleep29183-21grepconf.sh09:18:022
5731991211,1cyclictest73-21ksoftirqd/712:06:407
5731991210,1cyclictest73-21ksoftirqd/711:39:197
5731991210,1cyclictest73-21ksoftirqd/709:15:057
5731991210,1cyclictest686-21dbus-daemon09:48:387
5731991210,1cyclictest0-21swapper/712:21:527
573199120,2cyclictest15477-21sshd10:30:537
573199120,11cyclictest0-21swapper/709:52:447
572999122,4cyclictest7159-21grepconf.sh10:39:426
572999122,4cyclictest686-21dbus-daemon10:54:146
572999122,4cyclictest25124-21bash10:27:376
572999122,4cyclictest17674-21sshd10:10:366
572999122,4cyclictest15088-21bash09:29:336
572999122,4cyclictest1438-21sshd11:42:346
572999122,4cyclictest1438-21sshd11:42:346
572999122,4cyclictest1-21systemd10:35:476
572999122,4cyclictest1-21systemd10:03:026
5729991211,1cyclictest65-21ksoftirqd/612:12:366
5729991210,1cyclictest65-21ksoftirqd/612:19:306
5729991210,1cyclictest65-21ksoftirqd/612:19:306
5729991210,1cyclictest65-21ksoftirqd/610:49:376
572999120,11cyclictest22187-21kworker/6:409:23:506
572699124,1cyclictest686-21dbus-daemon11:37:425
5726991210,1cyclictest57-21ksoftirqd/512:24:215
5726991210,1cyclictest57-21ksoftirqd/509:22:035
572699120,11cyclictest686-21dbus-daemon12:33:265
572699120,11cyclictest0-21swapper/510:09:585
571999122,4cyclictest8747-21bash12:33:164
571999122,4cyclictest7912-21sshd11:13:104
571999122,4cyclictest5440-21sshd12:08:554
571999122,4cyclictest32628-21bash10:22:294
571999122,4cyclictest13332-21sshd10:14:004
5719991211,1cyclictest0-21swapper/411:54:124
5719991211,1cyclictest0-21swapper/410:03:194
5719991210,1cyclictest49-21ksoftirqd/409:49:074
5719991210,1cyclictest49-21ksoftirqd/409:17:074
571999120,11cyclictest10118-21cp11:16:594
5713991210,1cyclictest41-21ksoftirqd/307:41:273
571299122,6cyclictest2863-21grep10:18:592
5712991210,1cyclictest33-21ksoftirqd/212:11:282
5712991210,1cyclictest33-21ksoftirqd/212:03:052
5712991210,1cyclictest33-21ksoftirqd/211:49:352
5712991210,1cyclictest33-21ksoftirqd/210:11:012
571299120,11cyclictest691-21systemd-logind10:23:322
571299120,11cyclictest0-21swapper/211:00:162
571199120,11cyclictest26687-21ntp_states08:36:451
571099122,4cyclictest3357-21sshd11:31:350
571099122,4cyclictest3005-21sshd11:57:330
571099122,4cyclictest22204-21sshd10:18:130
571099122,4cyclictest0-21swapper/011:03:100
5710991210,1cyclictest9-21ksoftirqd/010:07:360
5710991210,1cyclictest9-21ksoftirqd/009:47:150
571099120,11cyclictest6748-21ls09:01:270
220382120,1sleep722040-21bash09:26:167
573199119,1cyclictest73-21ksoftirqd/712:31:377
573199119,1cyclictest73-21ksoftirqd/712:12:527
573199119,1cyclictest73-21ksoftirqd/712:04:457
573199119,1cyclictest73-21ksoftirqd/711:59:407
573199119,1cyclictest73-21ksoftirqd/711:32:267
573199119,1cyclictest73-21ksoftirqd/710:19:597
573199119,1cyclictest73-21ksoftirqd/710:03:037
573199119,1cyclictest73-21ksoftirqd/709:38:507
573199110,11cyclictest0-21swapper/711:06:317
573199110,10cyclictest8841-21kworker/7:112:28:177
572999113,2cyclictest23276-21bash10:16:296
572999112,4cyclictest26822-21sshd09:11:406
572999112,4cyclictest0-21swapper/611:22:366
5729991110,1cyclictest65-21ksoftirqd/609:41:426
5729991110,1cyclictest0-21swapper/611:00:136
572999111,4cyclictest30169-21sshd12:06:386
572999111,4cyclictest13616-21sshd11:34:006
572999111,4cyclictest12266-21bash10:23:126
572999111,4cyclictest0-21swapper/610:11:516
572999110,5cyclictest8400-21sshd10:45:216
572999110,5cyclictest12435-21sshd11:26:316
572999110,11cyclictest23828-21kworker/6:309:07:466
572999110,10cyclictest30417-21kworker/6:009:47:166
572999110,10cyclictest2338-21grep12:05:016
572699118,3cyclictest57-21ksoftirqd/509:06:545
572699117,3cyclictest57-21ksoftirqd/509:31:475
572699116,0cyclictest0-21swapper/507:39:535
5726991110,1cyclictest15-21kswork09:36:485
571999119,1cyclictest49-21ksoftirqd/411:38:204
571999119,1cyclictest49-21ksoftirqd/409:07:404
571999119,1cyclictest29536-21kworker/u16:012:19:374
571999119,1cyclictest29536-21kworker/u16:012:19:374
571999112,5cyclictest4968-21sshd09:27:024
571999112,4cyclictest0-21swapper/409:37:274
5719991110,1cyclictest0-21swapper/410:54:044
571999111,4cyclictest23934-21sshd10:57:184
571999111,4cyclictest19929-21sshd12:13:254
571999111,4cyclictest13075-21sshd09:59:104
571999111,4cyclictest13075-21sshd09:59:104
571999111,4cyclictest0-21swapper/411:42:384
571999111,4cyclictest0-21swapper/411:42:384
571999111,4cyclictest0-21swapper/410:33:234
571999110,10cyclictest14463-21cat09:51:474
571399115,3cyclictest41-21ksoftirqd/307:16:273
571399114,1cyclictest41-21ksoftirqd/307:46:403
571399114,1cyclictest41-21ksoftirqd/307:46:403
571399111,1cyclictest0-21swapper/308:41:393
571399111,1cyclictest0-21swapper/308:26:413
571299118,2cyclictest33-21ksoftirqd/211:51:412
571299118,2cyclictest33-21ksoftirqd/209:36:482
571299118,1cyclictest33-21ksoftirqd/211:07:582
571299116,4cyclictest686-21dbus-daemon12:32:052
571299116,3cyclictest33-21ksoftirqd/211:33:582
571299112,2cyclictest21699-21sshd10:29:202
571299110,10cyclictest0-21swapper/210:05:442
571299110,1cyclictest2089-21sshd11:27:422
571099119,1cyclictest9-21ksoftirqd/012:13:360
571099112,4cyclictest7036-21sshd12:27:340
571099112,4cyclictest31057-21sshd09:58:190
571099112,4cyclictest31057-21sshd09:58:190
571099112,4cyclictest11507-21sshd11:48:450
5710991110,1cyclictest9-21ksoftirqd/009:52:470
571099111,4cyclictest0-21swapper/011:36:590
571099111,4cyclictest0-21swapper/010:25:090
571099111,4cyclictest0-21swapper/009:42:470
571099110,11cyclictest9600-21kworker/0:209:21:470
571099110,11cyclictest9600-21kworker/0:209:18:570
571099110,11cyclictest506-21kworker/0:210:13:140
571099110,11cyclictest3842-21kworker/0:311:42:340
571099110,11cyclictest3842-21kworker/0:311:42:340
571099110,11cyclictest23406-21kworker/0:210:46:580
571099110,11cyclictest0-21swapper/010:42:270
571099110,11cyclictest0-21swapper/009:13:500
571099110,10cyclictest19277-21systemd-cgroups10:51:330
245392110,0sleep00-21swapper/011:17:500
573199108,1cyclictest73-21ksoftirqd/711:44:417
573199108,1cyclictest73-21ksoftirqd/711:44:417
573199108,1cyclictest73-21ksoftirqd/709:42:247
573199107,1cyclictest73-21ksoftirqd/710:32:057
573199107,1cyclictest73-21ksoftirqd/709:19:577
573199104,3cyclictest14957-21systemd-cgroups11:52:397
573199102,4cyclictest1694-21sshd11:48:117
573199100,10cyclictest0-21swapper/710:53:167
572999108,1cyclictest7640-21idleruntime-cro08:06:286
572999103,6cyclictest686-21dbus-daemon12:27:536
572999103,6cyclictest5027-21sshd12:21:516
572999101,4cyclictest396-21jbd2/sda2-811:47:196
572999100,4cyclictest0-21swapper/609:51:476
572999100,1cyclictest0-21swapper/609:36:596
572699108,1cyclictest57-21ksoftirqd/511:01:495
571999108,1cyclictest49-21ksoftirqd/410:47:304
571999108,1cyclictest49-21ksoftirqd/409:42:134
571999108,1cyclictest13564-21systemd-cgroups11:30:184
571999103,6cyclictest4752-21sshd10:20:594
571999103,6cyclictest0-21swapper/409:23:554
571999101,4cyclictest27856-21systemd09:13:344
571999100,10cyclictest0-21swapper/411:07:124
571399109,1cyclictest41-21ksoftirqd/307:41:473
571399104,3cyclictest41-21ksoftirqd/307:59:213
571399104,2cyclictest41-21ksoftirqd/308:16:563
571399101,3cyclictest0-21swapper/308:56:283
571399101,2cyclictest0-21swapper/308:11:283
571299108,2cyclictest33-21ksoftirqd/211:41:402
571299108,2cyclictest33-21ksoftirqd/211:41:402
571299108,1cyclictest33-21ksoftirqd/211:59:192
571299104,5cyclictest29862-21sshd09:13:412
571299103,2cyclictest30799-21systemd10:42:512
571299102,5cyclictest31451-21grepconf.sh10:15:042
571299102,5cyclictest21566-21grep09:52:122
571299102,4cyclictest27932-21systemd10:40:542
571299101,4cyclictest18570-21bash11:04:292
571299100,6cyclictest1-21systemd10:31:392
571199108,1cyclictest25-21ksoftirqd/108:15:001
571099108,1cyclictest9-21ksoftirqd/010:05:180
571099103,6cyclictest25093-21sshd11:12:160
571099103,6cyclictest15457-21sshd10:27:030
571099103,6cyclictest14275-21sshd12:09:260
571099103,6cyclictest1030-21sshd10:57:520
571099101,4cyclictest31789-21sshd11:08:560
571099101,4cyclictest15351-21sshd12:05:470
571099100,9cyclictest13946-21kworker/0:409:28:030
571099100,4cyclictest1-21systemd11:21:320
571099100,4cyclictest0-21swapper/011:51:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional