You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 19:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu May 28, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251612540,1sleep125-21ksoftirqd/112:31:011
103392520,0sleep70-21swapper/709:31:117
75802510,1sleep6641ktimersoftd/611:06:576
204342510,1sleep020433-21grep10:30:460
132962500,0sleep00-21swapper/009:40:330
76442490,1sleep27640-21sshd10:39:132
818124725,18sleep40-21swapper/407:04:394
818124725,18sleep40-21swapper/407:04:394
35352460,0sleep10-21swapper/110:35:201
35352460,0sleep10-21swapper/110:35:201
23562460,2sleep2861599cyclictest11:04:442
69602450,1sleep46963-21kworker/u16:211:56:444
263332450,0sleep00-21swapper/011:33:500
222702450,1sleep622272-21sshd10:21:396
175252450,0sleep20-21swapper/209:11:032
146302450,1sleep125-21ksoftirqd/110:58:111
319812440,0sleep50-21swapper/510:37:005
319812440,0sleep50-21swapper/510:37:005
98482430,1sleep449-21ksoftirqd/411:14:234
825624331,9sleep30-21swapper/307:05:423
825624331,9sleep30-21swapper/307:05:423
43592430,0sleep60-21swapper/611:43:416
162462430,0sleep00-21swapper/011:33:180
822224231,8sleep50-21swapper/507:05:125
822224231,8sleep50-21swapper/507:05:125
266642420,0sleep40-21swapper/411:52:204
185552420,0sleep40-21swapper/412:23:194
280342410,0sleep60-21swapper/611:17:226
241072410,0sleep50-21swapper/510:42:055
178672410,0sleep70-21swapper/711:24:047
141672410,0sleep614164-21systemd-cgroups12:36:036
87712400,0sleep3391rcuc/311:47:383
842924028,8sleep70-21swapper/707:08:027
842924028,8sleep70-21swapper/707:08:027
840724027,9sleep00-21swapper/007:07:470
840724027,9sleep00-21swapper/007:07:470
816124029,8sleep20-21swapper/207:04:202
816124029,8sleep20-21swapper/207:04:202
65642400,0sleep1241ktimersoftd/111:36:231
282662400,0sleep10-21swapper/111:00:431
213082400,0sleep30-21swapper/309:48:293
174172400,0sleep10-21swapper/111:16:451
842823926,9sleep60-21swapper/607:08:016
842823926,9sleep60-21swapper/607:08:016
196812390,0sleep70-21swapper/712:04:487
150342390,0sleep00-21swapper/009:53:380
152382380,0sleep10-21swapper/111:27:421
821823726,8sleep10-21swapper/107:05:081
821823726,8sleep10-21swapper/107:05:081
193692370,0sleep10-21swapper/112:17:481
325362340,2sleep4861799cyclictest10:01:594
153592240,0sleep20-21swapper/210:26:482
8618992221,1cyclictest57-21ksoftirqd/511:15:455
8618992219,3cyclictest57-21ksoftirqd/510:57:565
108352220,7sleep20-21swapper/211:47:452
861899207,1cyclictest121rcu_preempt09:31:495
8618992016,3cyclictest57-21ksoftirqd/509:16:375
171402200,1sleep217138-21sshd12:38:072
861899193,2cyclictest57-21ksoftirqd/509:36:345
8618991918,1cyclictest57-21ksoftirqd/512:13:435
861899191,3cyclictest57-21ksoftirqd/510:16:025
8618991817,1cyclictest1844-21nfsd10:52:065
8618991816,1cyclictest57-21ksoftirqd/512:12:085
8618991816,1cyclictest57-21ksoftirqd/511:09:475
8618991816,1cyclictest57-21ksoftirqd/511:00:325
8618991816,1cyclictest57-21ksoftirqd/509:40:355
8618991815,1cyclictest57-21ksoftirqd/511:34:025
8618991814,1cyclictest57-21ksoftirqd/511:31:255
8618991813,4cyclictest57-21ksoftirqd/512:32:095
861899180,1cyclictest0-21swapper/511:47:105
34922180,0sleep20-21swapper/212:18:452
861899174,3cyclictest57-21ksoftirqd/512:03:405
8618991716,1cyclictest57-21ksoftirqd/511:58:515
8618991716,1cyclictest57-21ksoftirqd/511:58:515
8618991716,1cyclictest57-21ksoftirqd/511:20:135
8618991715,1cyclictest57-21ksoftirqd/512:25:335
8618991715,1cyclictest57-21ksoftirqd/511:54:395
8618991715,1cyclictest57-21ksoftirqd/511:03:565
8618991715,1cyclictest57-21ksoftirqd/510:24:495
8618991715,1cyclictest57-21ksoftirqd/509:58:585
8618991715,1cyclictest57-21ksoftirqd/509:55:055
8618991713,3cyclictest464-21systemd-journal11:40:075
8618991713,1cyclictest57-21ksoftirqd/509:49:475
8618991712,3cyclictest57-21ksoftirqd/510:20:165
8618991712,3cyclictest57-21ksoftirqd/510:03:545
861899171,1cyclictest57-21ksoftirqd/511:51:505
8614991715,1cyclictest25-21ksoftirqd/112:23:491
8614991715,1cyclictest25-21ksoftirqd/110:23:151
8614991715,1cyclictest25-21ksoftirqd/109:16:271
47362170,0sleep30-21swapper/310:33:383
282112170,0sleep00-21swapper/012:18:190
8625991614,1cyclictest73-21ksoftirqd/711:38:007
861999160,0cyclictest0-21swapper/611:38:296
861899164,3cyclictest57-21ksoftirqd/510:32:085
861899164,1cyclictest131rcu_sched11:23:535
8618991614,1cyclictest57-21ksoftirqd/512:18:495
8618991614,1cyclictest57-21ksoftirqd/510:45:215
8618991614,1cyclictest57-21ksoftirqd/509:45:585
8618991614,1cyclictest57-21ksoftirqd/509:23:575
8618991614,1cyclictest57-21ksoftirqd/509:20:335
861899161,4cyclictest721-21dbus-daemon12:33:575
861899161,3cyclictest57-21ksoftirqd/509:13:115
861899160,3cyclictest57-21ksoftirqd/510:10:275
861499168,3cyclictest25-21ksoftirqd/109:24:301
8614991615,1cyclictest25-21ksoftirqd/111:58:101
8614991615,1cyclictest25-21ksoftirqd/111:53:131
8614991614,1cyclictest25-21ksoftirqd/111:41:541
8614991614,1cyclictest25-21ksoftirqd/110:02:521
8614991614,1cyclictest25-21ksoftirqd/109:51:281
8614991614,1cyclictest25-21ksoftirqd/109:35:091
8614991614,1cyclictest25-21ksoftirqd/109:18:541
861499161,1cyclictest25-21ksoftirqd/109:33:091
861499160,1cyclictest9874-21systemd-cgroups10:28:221
861499160,1cyclictest131rcu_sched11:07:561
78352160,0sleep30-21swapper/312:09:413
8625991513,1cyclictest73-21ksoftirqd/712:02:267
8625991513,1cyclictest73-21ksoftirqd/712:02:267
8617991510,2cyclictest29318-21sshd11:22:584
8617991510,1cyclictest721-21dbus-daemon09:54:204
861499158,3cyclictest25-21ksoftirqd/110:48:491
8614991514,1cyclictest25-21ksoftirqd/112:04:301
8614991513,2cyclictest25-21ksoftirqd/109:41:061
8614991513,1cyclictest25-21ksoftirqd/111:59:451
8614991513,1cyclictest25-21ksoftirqd/111:59:451
8614991513,1cyclictest25-21ksoftirqd/111:46:241
8614991513,1cyclictest25-21ksoftirqd/111:11:111
8614991513,1cyclictest25-21ksoftirqd/110:40:481
8614991513,1cyclictest25-21ksoftirqd/110:29:281
8614991513,1cyclictest25-21ksoftirqd/109:44:041
8614991510,2cyclictest25-21ksoftirqd/110:10:241
861499150,2cyclictest131rcu_sched11:32:291
861499150,15cyclictest31318-21kworker/1:110:13:411
309402150,0sleep60-21swapper/609:48:566
297742150,0sleep20-21swapper/210:01:492
254502150,0sleep70-21swapper/709:56:017
191402150,0sleep20-21swapper/209:57:332
8625991412,1cyclictest73-21ksoftirqd/710:47:587
8625991412,1cyclictest73-21ksoftirqd/709:23:147
862599140,13cyclictest15522-21kworker/7:312:24:377
8616991412,2cyclictest41-21ksoftirqd/309:15:333
861599148,4cyclictest33-21ksoftirqd/210:44:362
861599144,6cyclictest859-21gdbus09:36:172
8614991413,1cyclictest25-21ksoftirqd/109:57:471
8614991413,1cyclictest25-21ksoftirqd/109:10:441
8614991412,1cyclictest25-21ksoftirqd/112:19:511
8614991412,1cyclictest25-21ksoftirqd/112:09:421
8614991412,1cyclictest25-21ksoftirqd/111:19:181
8614991412,1cyclictest25-21ksoftirqd/110:03:401
8614991411,1cyclictest25-21ksoftirqd/110:44:491
861499140,1cyclictest121rcu_preempt12:34:011
8611991412,1cyclictest9-21ksoftirqd/012:06:450
81062140,0sleep40-21swapper/410:09:444
71382140,0sleep20-21swapper/209:40:112
47922140,0sleep00-21swapper/009:56:430
269092140,0sleep00-21swapper/009:30:150
201992140,0sleep30-21swapper/309:13:213
107772140,0sleep60-21swapper/609:27:336
862599138,3cyclictest73-21ksoftirqd/711:03:007
862599133,1cyclictest131rcu_sched11:38:487
8625991312,1cyclictest73-21ksoftirqd/711:56:457
8625991312,1cyclictest73-21ksoftirqd/711:20:107
8625991312,1cyclictest73-21ksoftirqd/709:47:577
8625991311,1cyclictest73-21ksoftirqd/711:14:007
861999134,4cyclictest24008-21idleruntime-cro09:48:386
8619991312,1cyclictest65-21ksoftirqd/612:25:196
8616991311,1cyclictest41-21ksoftirqd/312:15:333
8616991311,1cyclictest41-21ksoftirqd/310:40:473
8615991311,1cyclictest33-21ksoftirqd/209:44:412
861599131,6cyclictest3043-21sshd11:12:142
8611991311,1cyclictest9-21ksoftirqd/011:23:490
310132130,1sleep331015-21bash11:11:583
270242130,0sleep60-21swapper/612:29:146
159992130,1sleep015962-21sshd12:12:020
123352130,1sleep665-21ksoftirqd/608:08:546
123352130,1sleep665-21ksoftirqd/608:08:546
118802130,0sleep70-21swapper/709:14:377
9582120,0sleep20-21swapper/210:07:342
8625991211,1cyclictest73-21ksoftirqd/712:13:497
8625991211,1cyclictest73-21ksoftirqd/710:17:407
8625991211,1cyclictest73-21ksoftirqd/710:03:457
8625991210,1cyclictest73-21ksoftirqd/711:49:527
8625991210,1cyclictest73-21ksoftirqd/711:44:037
8625991210,1cyclictest73-21ksoftirqd/710:54:157
8625991210,1cyclictest73-21ksoftirqd/710:22:107
8625991210,1cyclictest73-21ksoftirqd/709:43:387
8625991210,1cyclictest73-21ksoftirqd/709:27:227
862599120,11cyclictest3104-21grep12:09:247
862599120,11cyclictest13432-21kworker/7:510:32:067
861999123,4cyclictest20822-21bash11:55:396
861999122,4cyclictest880-21sshd09:17:466
861999122,4cyclictest857-21polkitd09:19:276
861999122,4cyclictest5058-21sshd12:03:576
861999122,4cyclictest2859-21sshd10:53:486
861999122,4cyclictest28065-21grep12:18:186
861999122,4cyclictest0-21swapper/609:32:096
861999120,12cyclictest8984-21kworker/6:012:02:446
861999120,12cyclictest8984-21kworker/6:012:02:446
861799129,2cyclictest16350-21sshd10:41:384
861799122,4cyclictest12646-21sshd09:53:304
861799122,4cyclictest0-21swapper/412:24:494
861799121,5cyclictest709-21systemd-logind10:35:524
861799121,5cyclictest709-21systemd-logind10:35:524
861799121,5cyclictest20618-21kill12:12:194
861799120,11cyclictest0-21swapper/412:04:524
8616991211,1cyclictest41-21ksoftirqd/312:19:073
8616991211,1cyclictest41-21ksoftirqd/311:36:323
8616991211,1cyclictest41-21ksoftirqd/310:48:243
8616991211,1cyclictest41-21ksoftirqd/309:22:513
8616991210,1cyclictest41-21ksoftirqd/311:18:553
8616991210,1cyclictest41-21ksoftirqd/310:56:343
8616991210,1cyclictest41-21ksoftirqd/309:54:553
861699120,2cyclictest7751-21bash09:42:073
861599123,6cyclictest0-21swapper/211:00:032
861599122,4cyclictest721-21dbus-daemon10:17:532
861599122,4cyclictest1-21systemd12:24:442
8615991211,1cyclictest33-21ksoftirqd/211:23:492
8615991210,1cyclictest33-21ksoftirqd/212:07:322
8615991210,1cyclictest33-21ksoftirqd/209:27:222
861599121,5cyclictest13637-21bash12:13:472
861599121,5cyclictest1018-21bash11:58:172
861599120,2cyclictest1-21systemd11:16:072
861599120,11cyclictest11821-21sshd10:52:282
861199127,3cyclictest20962-21sshd09:46:340
861199122,4cyclictest2516-21sshd11:47:170
8611991210,1cyclictest9-21ksoftirqd/012:19:530
8611991210,1cyclictest9-21ksoftirqd/011:38:560
8611991210,1cyclictest9-21ksoftirqd/011:12:590
8611991210,1cyclictest9-21ksoftirqd/010:42:230
241162120,0sleep20-21swapper/211:59:312
241162120,0sleep20-21swapper/211:59:312
202452120,1sleep020246-21bash10:23:260
862599119,1cyclictest73-21ksoftirqd/712:38:017
862599119,1cyclictest73-21ksoftirqd/712:22:117
862599119,1cyclictest73-21ksoftirqd/710:34:147
862599119,1cyclictest73-21ksoftirqd/710:34:147
862599119,1cyclictest73-21ksoftirqd/710:10:187
862599119,1cyclictest73-21ksoftirqd/709:59:047
862599119,1cyclictest73-21ksoftirqd/709:52:277
862599119,1cyclictest73-21ksoftirqd/709:36:437
862599112,5cyclictest23337-21sshd10:49:227
8625991110,1cyclictest73-21ksoftirqd/711:31:367
8625991110,1cyclictest73-21ksoftirqd/711:12:067
861999119,1cyclictest65-21ksoftirqd/611:51:186
861999114,1cyclictest669-21avahi-daemon10:41:276
861999114,1cyclictest19690-21sshd11:24:106
861999112,4cyclictest29235-21sshd10:25:436
8619991110,1cyclictest65-21ksoftirqd/611:33:186
861999111,4cyclictest857-21polkitd09:41:226
861999111,4cyclictest7710-21systemd-cgroups09:55:006
861999111,4cyclictest0-21swapper/610:28:566
861999110,5cyclictest4273-21cp11:39:556
861999110,5cyclictest25381-21sshd11:18:586
861999110,5cyclictest2210-21sshd12:11:156
861999110,5cyclictest10143-21bash10:02:336
861999110,11cyclictest17563-21kworker/6:310:10:346
861999110,11cyclictest16215-21kworker/6:410:34:276
861999110,11cyclictest16215-21kworker/6:410:34:276
861999110,10cyclictest22736-21kworker/6:209:38:106
861899119,1cyclictest57-21ksoftirqd/507:43:385
861799114,4cyclictest0-21swapper/410:51:404
861799113,4cyclictest26333-21sshd09:13:414
861799111,4cyclictest464-21systemd-journal11:09:194
861799111,4cyclictest17520-21sshd10:26:564
861799111,4cyclictest14324-21sshd12:30:244
861799111,4cyclictest10897-21id10:22:534
861799110,11cyclictest8557-21kworker/4:509:46:534
861799110,11cyclictest8557-21kworker/4:509:42:244
861799110,11cyclictest8557-21kworker/4:509:19:344
861799110,10cyclictest31529-21kworker/4:111:43:504
861799110,10cyclictest14059-21bash11:38:424
861799110,10cyclictest1-21systemd10:45:004
861799110,1cyclictest1-21systemd10:54:054
861699119,2cyclictest41-21ksoftirqd/312:33:493
861699119,1cyclictest41-21ksoftirqd/312:05:573
861699119,1cyclictest41-21ksoftirqd/310:02:193
861699119,1cyclictest41-21ksoftirqd/309:26:313
8616991110,1cyclictest41-21ksoftirqd/311:29:013
8616991110,1cyclictest41-21ksoftirqd/311:24:263
8616991110,1cyclictest41-21ksoftirqd/311:00:253
8616991110,1cyclictest41-21ksoftirqd/310:22:523
8616991110,1cyclictest41-21ksoftirqd/310:09:073
8616991110,1cyclictest41-21ksoftirqd/309:49:033
8616991110,1cyclictest0-21swapper/310:51:483
8616991110,1cyclictest0-21swapper/308:48:503
861699110,11cyclictest970-21kworker/3:211:14:073
861599119,1cyclictest33-21ksoftirqd/211:48:572
861599118,2cyclictest2742-21id11:30:372
861599118,2cyclictest17891-21bash09:50:022
8615991110,1cyclictest0-21swapper/211:42:272
861599111,4cyclictest868-21bash10:11:132
861599111,4cyclictest14239-21sshd11:20:122
861599111,4cyclictest0-21swapper/209:16:342
861599110,5cyclictest1-21systemd10:37:292
861599110,5cyclictest1-21systemd10:37:292
861599110,1cyclictest0-21swapper/209:19:372
861199119,1cyclictest9-21ksoftirqd/012:27:210
861199119,1cyclictest9-21ksoftirqd/010:48:520
861199118,2cyclictest9-21ksoftirqd/010:07:140
861199113,7cyclictest27374-21bash11:56:030
861199112,4cyclictest5601-21sshd12:35:330
861199112,4cyclictest4006-21sshd10:59:180
861199112,3cyclictest7400-21sshd11:23:350
861199111,4cyclictest30884-21bash10:14:440
861199110,1cyclictest0-21swapper/011:15:580
313872118,1sleep0101ktimersoftd/010:01:560
862599108,1cyclictest73-21ksoftirqd/710:40:477
862599108,1cyclictest73-21ksoftirqd/710:24:187
862599103,4cyclictest23093-21bash12:30:547
861999108,1cyclictest65-21ksoftirqd/611:01:506
861999107,2cyclictest65-21ksoftirqd/611:08:526
861999101,3cyclictest910-21sshd10:07:346
861999100,4cyclictest4568-21sshd09:12:236
861999100,4cyclictest21366-21/usr/sbin/munin10:43:556
861999100,4cyclictest0-21swapper/612:19:176
861999100,1cyclictest0-21swapper/610:52:196
861899109,1cyclictest57-21ksoftirqd/507:13:495
8618991010,0cyclictest0-21swapper/507:53:475
861899100,10cyclictest0-21swapper/507:45:075
861899100,10cyclictest0-21swapper/507:24:295
861799109,1cyclictest49-21ksoftirqd/410:04:014
861799108,1cyclictest49-21ksoftirqd/412:00:354
861799108,1cyclictest49-21ksoftirqd/412:00:354
861799105,1cyclictest1-21systemd11:05:184
861799103,1cyclictest721-21dbus-daemon12:34:344
861799100,4cyclictest526-21sshd09:30:374
861799100,4cyclictest1-21systemd11:36:444
861799100,10cyclictest8557-21kworker/4:509:27:334
861799100,1cyclictest0-21swapper/410:58:404
861699109,1cyclictest41-21ksoftirqd/311:03:533
861699108,1cyclictest41-21ksoftirqd/312:29:493
861699108,1cyclictest41-21ksoftirqd/312:26:483
861699108,1cyclictest41-21ksoftirqd/312:02:163
861699108,1cyclictest41-21ksoftirqd/312:02:163
861699108,1cyclictest41-21ksoftirqd/311:54:103
861699108,1cyclictest41-21ksoftirqd/311:51:253
861699108,1cyclictest41-21ksoftirqd/310:34:113
861699108,1cyclictest41-21ksoftirqd/310:34:113
861699108,1cyclictest41-21ksoftirqd/309:36:053
861699108,1cyclictest41-21ksoftirqd/309:30:303
861699104,4cyclictest709-21systemd-logind10:26:053
861699102,5cyclictest12798-21systemd10:04:283
861599107,2cyclictest18545-21sshd11:35:122
861599103,6cyclictest2568-21rm10:29:422
861599103,6cyclictest0-21swapper/210:54:262
861599100,4cyclictest6472-21sshd12:13:232
861599100,4cyclictest3918-21sshd09:28:562
861599100,4cyclictest24382-21sshd10:19:542
861499108,1cyclictest25-21ksoftirqd/109:08:381
861499108,1cyclictest25-21ksoftirqd/108:58:481
861199106,1cyclictest9-21ksoftirqd/010:24:420
861199103,6cyclictest18293-21sshd10:45:240
861199103,3cyclictest19755-21sshd11:50:030
861199102,6cyclictest0-21swapper/012:29:200
861199102,4cyclictest1-21systemd12:01:540
861199102,4cyclictest1-21systemd12:01:540
861199102,3cyclictest1247-21sshd09:25:050
861199100,7cyclictest27351-21sshd09:09:300
861199100,7cyclictest12600-21grepconf.sh10:54:160
861199100,5cyclictest0-21swapper/011:07:520
861199100,4cyclictest4327-21systemd-cgroups09:14:100
234282100,0sleep40-21swapper/408:28:534
213232100,0sleep60-21swapper/610:14:116
86259997,1cyclictest73-21ksoftirqd/711:05:207
86259997,1cyclictest73-21ksoftirqd/709:08:437
86189999,0cyclictest0-21swapper/508:37:275
86189998,1cyclictest57-21ksoftirqd/507:59:095
86189997,2cyclictest57-21ksoftirqd/508:04:475
86189997,2cyclictest0-21swapper/507:38:215
86189997,1cyclictest57-21ksoftirqd/507:28:505
86189997,0cyclictest0-21swapper/508:54:175
86189997,0cyclictest0-21swapper/508:45:375
86189990,9cyclictest0-21swapper/508:32:055
86179997,1cyclictest49-21ksoftirqd/409:12:334
86179996,2cyclictest21770-21bash11:24:174
86179992,6cyclictest18617-21sshd11:33:264
86179991,4cyclictest30506-21sshd10:31:224
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional