You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 18:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Aug 30, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
314732580,0sleep70-21swapper/710:33:337
317502510,1sleep430676-21/usr/sbin/munin09:25:224
326882500,0sleep40-21swapper/409:23:384
2589025027,8sleep30-21swapper/307:03:243
235082470,1sleep523509-21bash09:58:555
163262470,1sleep31-21systemd11:59:073
293202460,0sleep00-21swapper/009:12:440
200142460,0sleep00-21swapper/011:26:520
240202450,0sleep10-21swapper/111:21:401
143452440,0sleep60-21swapper/609:58:246
300072430,0sleep00-21swapper/011:18:270
270232430,0sleep00-21swapper/010:04:340
259952430,0sleep40-21swapper/412:15:504
197942430,0sleep00-21swapper/009:53:210
157652430,0sleep115757-21sshd11:59:051
127292430,0sleep70-21swapper/711:58:557
77732420,0sleep20-21swapper/211:53:132
65012420,0sleep70-21swapper/709:18:367
65012420,0sleep70-21swapper/709:18:367
57682420,0sleep00-21swapper/010:12:190
4792420,0sleep10-21swapper/110:08:281
25612420,0sleep70-21swapper/709:27:177
204842420,0sleep00-21swapper/010:52:400
179132420,0sleep70-21swapper/712:17:137
143582420,0sleep514310-21sshd10:25:225
131462420,0sleep30-21swapper/312:11:323
275212410,1sleep127508-21sshd11:39:591
2577724128,9sleep60-21swapper/607:01:516
2578424022,4sleep40-21swapper/407:01:574
2355324029,8sleep20-21swapper/207:00:192
65592390,0sleep10-21swapper/109:43:371
274672390,0sleep40-21swapper/412:12:214
2599023928,8sleep10-21swapper/107:04:431
2576723927,8sleep50-21swapper/507:01:425
2569323928,8sleep70-21swapper/707:00:407
225712390,0sleep60-21swapper/611:52:136
109322390,0sleep70-21swapper/712:04:157
2571323826,8sleep00-21swapper/007:00:570
164652370,0sleep50-21swapper/509:42:215
125902370,0sleep10-21swapper/110:25:181
303122360,2sleep12616599cyclictest09:25:191
206002340,0sleep4471rcuc/410:47:154
26206992217,3cyclictest65-21ksoftirqd/609:31:516
26206992215,4cyclictest65-21ksoftirqd/610:26:356
26206992117,3cyclictest65-21ksoftirqd/609:14:376
2616599211,6cyclictest1596-21cp11:13:151
2616599211,3cyclictest12369-21grepconf.sh12:20:291
2620699204,1cyclictest121rcu_preempt10:54:126
26206992014,3cyclictest65-21ksoftirqd/609:15:246
26206992014,3cyclictest65-21ksoftirqd/609:15:246
26206992010,3cyclictest65-21ksoftirqd/611:29:436
2616599201,5cyclictest23680-21sshd09:06:441
2616599201,3cyclictest15022-21bash12:33:181
174912200,0sleep70-21swapper/710:59:447
174912200,0sleep70-21swapper/710:59:447
2620699196,2cyclictest65-21ksoftirqd/610:38:336
2620699196,2cyclictest65-21ksoftirqd/609:29:126
2620699195,2cyclictest65-21ksoftirqd/611:05:066
2620699195,2cyclictest65-21ksoftirqd/610:15:196
2620699194,1cyclictest65-21ksoftirqd/611:18:226
26206991915,3cyclictest65-21ksoftirqd/610:47:176
26206991914,4cyclictest65-21ksoftirqd/609:06:476
26206991914,3cyclictest65-21ksoftirqd/610:21:476
26206991913,3cyclictest65-21ksoftirqd/612:14:026
2616599192,4cyclictest13081-21bash09:54:481
2616599191,5cyclictest13709-21grepconf.sh12:09:511
2616599191,4cyclictest15640-21systemd-cgroups11:05:011
2616599191,2cyclictest1375-21bash10:01:121
2620699188,3cyclictest65-21ksoftirqd/612:09:226
2620699186,2cyclictest65-21ksoftirqd/612:17:026
2620699186,2cyclictest65-21ksoftirqd/610:55:586
2620699186,2cyclictest65-21ksoftirqd/610:55:586
2620699186,1cyclictest65-21ksoftirqd/611:57:446
2620699186,1cyclictest65-21ksoftirqd/609:47:096
2620699185,3cyclictest65-21ksoftirqd/611:33:066
2620699184,3cyclictest65-21ksoftirqd/612:25:006
2620699183,3cyclictest65-21ksoftirqd/610:41:306
26206991817,1cyclictest65-21ksoftirqd/612:33:456
26206991815,2cyclictest65-21ksoftirqd/611:13:166
2616599183,4cyclictest24860-21sshd10:33:101
2616599182,6cyclictest5054-21bash12:03:541
2616599182,5cyclictest19441-21bash10:36:251
2616599181,7cyclictest0-21swapper/111:07:221
2616599181,5cyclictest2494-21sshd10:13:581
2616599181,5cyclictest20305-21sshd11:28:441
2616599181,4cyclictest2850-21sshd09:45:131
2616599181,3cyclictest22851-21sshd09:14:121
2616599181,1cyclictest0-21swapper/111:34:111
2616599180,5cyclictest26893-21systemd12:19:351
2616599180,5cyclictest16113-21bash09:31:341
2616599180,5cyclictest15576-21bash09:36:551
295522170,0sleep30-21swapper/310:11:503
2621499170,17cyclictest12418-21kworker/7:011:16:247
2620699178,1cyclictest65-21ksoftirqd/610:01:466
2620699175,2cyclictest65-21ksoftirqd/609:20:566
2620699173,4cyclictest65-21ksoftirqd/610:09:216
2620699173,2cyclictest65-21ksoftirqd/610:34:396
2620699172,4cyclictest65-21ksoftirqd/609:44:376
2620699172,1cyclictest65-21ksoftirqd/610:12:246
26206991715,1cyclictest65-21ksoftirqd/611:47:166
26206991715,1cyclictest65-21ksoftirqd/609:35:136
26206991715,1cyclictest464-21systemd-journal11:20:406
26206991714,2cyclictest65-21ksoftirqd/609:53:286
26206991713,3cyclictest65-21ksoftirqd/612:27:426
26206991712,1cyclictest65-21ksoftirqd/611:40:486
2618399170,16cyclictest27324-21kworker/3:310:27:123
2616599172,6cyclictest7409-21sshd12:25:361
2616599171,6cyclictest22518-21sshd10:50:561
2616599171,5cyclictest29584-21sshd11:45:251
2616599171,5cyclictest12096-21sshd09:22:281
2616599171,4cyclictest25718-21bash10:45:421
2616599171,3cyclictest5809-21id10:17:421
2616599170,5cyclictest21020-21sshd11:53:591
23602170,2sleep42619199cyclictest11:25:524
11742170,0sleep40-21swapper/411:40:184
310062160,1sleep2758-21runrttasks11:04:032
270242160,0sleep20-21swapper/211:36:152
2620699166,3cyclictest65-21ksoftirqd/611:36:066
2620699165,4cyclictest65-21ksoftirqd/612:01:186
26173991614,1cyclictest33-21ksoftirqd/210:16:262
26173991610,3cyclictest33-21ksoftirqd/211:18:312
2616599162,6cyclictest10542-21sshd09:56:241
2616599162,1cyclictest0-21swapper/110:21:401
2616599161,6cyclictest0-21swapper/111:15:171
2616599161,4cyclictest20912-21bash10:40:101
2616599161,2cyclictest18067-21rm11:42:591
2616599160,6cyclictest17916-21systemd-cgroups09:17:251
2616599160,6cyclictest17916-21systemd-cgroups09:17:251
291772150,1sleep5561ktimersoftd/510:24:265
2620699151,3cyclictest65-21ksoftirqd/611:06:516
26173991510,5cyclictest33-21ksoftirqd/211:57:182
2616599151,4cyclictest25386-21bash12:10:251
2616599151,3cyclictest0-21swapper/110:57:001
2616599151,3cyclictest0-21swapper/110:57:001
2615799153,1cyclictest23176-21bash12:04:580
142612150,0sleep50-21swapper/510:12:485
105812150,0sleep20-21swapper/210:26:552
7652140,0sleep70-21swapper/710:19:157
306632140,0sleep7758-21runrttasks11:32:527
2619999140,13cyclictest26134-21sshd10:00:465
26191991412,1cyclictest49-21ksoftirqd/411:35:004
26191991412,1cyclictest49-21ksoftirqd/410:06:454
2617399149,1cyclictest33-21ksoftirqd/211:11:102
2617399148,1cyclictest33-21ksoftirqd/210:43:192
2617399147,5cyclictest33-21ksoftirqd/209:41:032
2617399147,5cyclictest33-21ksoftirqd/209:15:252
2617399147,5cyclictest33-21ksoftirqd/209:15:252
2617399147,4cyclictest33-21ksoftirqd/209:30:082
2615799144,2cyclictest1-21systemd11:43:240
2615799143,1cyclictest27994-21grep10:36:540
6762130,0sleep50-21swapper/509:54:065
302812130,0sleep40-21swapper/411:13:024
298172130,1sleep4471rcuc/412:23:194
2621499133,4cyclictest709-21systemd-logind12:28:357
2619999133,4cyclictest2244-21sshd09:09:315
2619999133,4cyclictest0-21swapper/511:18:305
2619999131,11cyclictest857-21polkitd11:23:285
2619999130,3cyclictest0-21swapper/510:53:155
2619199138,1cyclictest49-21ksoftirqd/410:16:074
26191991312,1cyclictest49-21ksoftirqd/411:51:584
26191991311,1cyclictest49-21ksoftirqd/411:57:384
2619199130,13cyclictest0-21swapper/409:17:424
2619199130,13cyclictest0-21swapper/409:17:424
2618399135,5cyclictest857-21polkitd09:48:323
26183991312,1cyclictest41-21ksoftirqd/311:03:473
26183991311,1cyclictest464-21systemd-journal09:43:383
2618399130,13cyclictest13269-21kworker/3:011:23:373
2617399139,3cyclictest33-21ksoftirqd/212:10:372
2617399139,1cyclictest33-21ksoftirqd/209:48:042
2617399133,4cyclictest0-21swapper/209:52:392
26173991312,1cyclictest33-21ksoftirqd/212:04:002
26173991311,1cyclictest33-21ksoftirqd/212:05:102
26173991311,1cyclictest33-21ksoftirqd/211:34:532
26173991311,1cyclictest33-21ksoftirqd/211:09:172
26173991311,1cyclictest33-21ksoftirqd/210:46:372
26173991311,1cyclictest33-21ksoftirqd/210:07:362
26173991311,1cyclictest33-21ksoftirqd/209:20:302
2615799136,3cyclictest0-21swapper/012:11:320
2615799133,1cyclictest464-21systemd-journal09:56:000
26157991311,1cyclictest9-21ksoftirqd/012:08:010
26157991311,1cyclictest9-21ksoftirqd/010:45:250
248722130,1sleep724868-21bash11:50:307
137162130,0sleep585250irq/26-em1-tx-012:35:055
101952130,0sleep30-21swapper/311:08:213
311362120,0sleep00-21swapper/011:00:250
2621499122,4cyclictest23201-21sshd10:09:467
2621499122,4cyclictest17443-21sshd10:25:297
2619999122,4cyclictest5599-21sshd11:09:555
2619999122,4cyclictest30122-21sshd11:29:175
2619999122,4cyclictest2110-21sshd09:14:515
2619999122,4cyclictest0-21swapper/512:23:465
2619999122,4cyclictest0-21swapper/509:30:165
26199991210,1cyclictest0-21swapper/511:13:135
2619999121,5cyclictest14737-21sshd11:04:585
2619999120,5cyclictest721-21dbus-daemon10:55:275
2619999120,5cyclictest721-21dbus-daemon10:55:275
2619999120,12cyclictest23171-21kworker/5:210:31:045
2619199129,1cyclictest49-21ksoftirqd/412:30:554
2619199128,1cyclictest49-21ksoftirqd/412:29:394
26191991211,1cyclictest49-21ksoftirqd/411:38:594
26191991210,2cyclictest49-21ksoftirqd/409:09:574
26191991210,1cyclictest721-21dbus-daemon10:33:144
26191991210,1cyclictest49-21ksoftirqd/410:39:064
26191991210,1cyclictest49-21ksoftirqd/410:05:044
26191991210,1cyclictest49-21ksoftirqd/409:43:084
2618399122,4cyclictest857-21polkitd12:32:543
2618399122,4cyclictest721-21dbus-daemon10:37:103
2618399122,4cyclictest31490-21sshd10:58:413
2618399122,4cyclictest31490-21sshd10:58:413
2618399122,4cyclictest0-21swapper/309:16:413
2618399122,4cyclictest0-21swapper/309:16:413
2618399121,5cyclictest709-21systemd-logind10:21:593
2618399121,5cyclictest21863-21sshd10:40:143
2618399121,5cyclictest1081-21bash11:33:013
2618399120,11cyclictest7456-21bash10:32:113
2618399120,11cyclictest15131-21sshd12:06:143
2618399120,11cyclictest11198-21sshd12:27:403
2618399120,1cyclictest0-21swapper/309:33:143
2617399129,2cyclictest33-21ksoftirqd/211:41:012
2617399129,1cyclictest33-21ksoftirqd/210:55:342
2617399129,1cyclictest33-21ksoftirqd/210:55:342
26173991211,1cyclictest33-21ksoftirqd/209:55:292
26173991210,1cyclictest33-21ksoftirqd/211:27:532
26173991210,1cyclictest33-21ksoftirqd/210:24:012
26173991210,1cyclictest33-21ksoftirqd/209:36:322
26173991210,1cyclictest33-21ksoftirqd/209:13:062
26173991210,1cyclictest33-21ksoftirqd/209:05:432
2617399120,4cyclictest121rcu_preempt10:11:162
2617399120,11cyclictest8992-21kworker/2:310:40:052
2617399120,11cyclictest15-21kswork10:50:462
2616599121,5cyclictest18561-21tr07:45:251
2616599120,5cyclictest27542-21memory07:05:251
2616599120,5cyclictest27542-21memory07:05:251
2616599120,4cyclictest372-21ntp_states08:10:251
2616599120,4cyclictest25254-21latency_hist08:00:081
2616599120,4cyclictest14610-21df_inode07:40:211
2615799124,5cyclictest22870-21grep12:28:200
2615799123,5cyclictest0-21swapper/012:22:300
26157991210,1cyclictest9-21ksoftirqd/010:41:070
2615799120,11cyclictest721-21dbus-daemon11:57:010
2615799120,11cyclictest0-21swapper/010:09:400
115872120,0sleep50-21swapper/510:39:395
74722110,0sleep00-21swapper/011:31:330
38282110,0sleep70-21swapper/710:23:007
29792110,0sleep42978-21systemd-cgroups10:10:234
2621499119,1cyclictest73-21ksoftirqd/712:30:277
2621499119,1cyclictest73-21ksoftirqd/710:41:407
2621499115,1cyclictest857-21polkitd12:24:157
2621499114,6cyclictest857-21polkitd10:14:037
2621499112,4cyclictest0-21swapper/709:20:437
2621499112,3cyclictest20751-21systemd-cgroups10:36:297
26214991110,1cyclictest73-21ksoftirqd/710:47:077
2621499111,4cyclictest30011-21sshd09:34:127
2621499111,4cyclictest18284-21systemd-cgroups11:14:137
2621499110,11cyclictest31395-21kworker/7:109:48:187
2621499110,11cyclictest2925-21kworker/7:309:44:557
2621499110,11cyclictest26808-21kworker/7:209:56:587
2621499110,11cyclictest12634-21kworker/7:011:43:047
2619999119,1cyclictest57-21ksoftirqd/511:49:535
2619999119,1cyclictest57-21ksoftirqd/510:19:405
2619999119,1cyclictest14061-21sshd12:02:345
2619999115,5cyclictest721-21dbus-daemon10:42:025
2619999112,4cyclictest12565-21sshd12:29:355
2619999112,4cyclictest0-21swapper/512:12:355
2619999111,4cyclictest709-21systemd-logind11:50:385
2619999111,4cyclictest25785-21systemd-cgroups10:49:255
2619999111,4cyclictest20432-21systemd-cgroups10:05:545
2619999111,4cyclictest12435-21systemd-cgroups12:15:105
2619999111,4cyclictest11705-21sshd11:55:155
2619999111,4cyclictest11440-21sshd09:25:585
2619999111,4cyclictest0-21swapper/511:35:305
2619999110,1cyclictest23233-21sshd11:41:265
2619999110,1cyclictest20920-21sshd09:15:465
2619999110,1cyclictest20920-21sshd09:15:465
2619199119,1cyclictest49-21ksoftirqd/412:06:014
2619199119,1cyclictest49-21ksoftirqd/411:17:194
2619199119,1cyclictest49-21ksoftirqd/411:05:414
2619199119,1cyclictest49-21ksoftirqd/410:50:224
2619199119,1cyclictest49-21ksoftirqd/410:41:334
2619199119,1cyclictest49-21ksoftirqd/410:27:174
2619199119,1cyclictest49-21ksoftirqd/409:48:054
2619199119,1cyclictest49-21ksoftirqd/409:35:144
2619199114,4cyclictest30034-21bash11:04:004
26191991110,1cyclictest15-21kswork10:22:264
2619199110,11cyclictest30497-21kworker/4:209:11:534
2619199110,11cyclictest23459-21kworker/4:009:33:474
2619199110,10cyclictest3072-21sshd09:52:254
2618399119,1cyclictest41-21ksoftirqd/312:18:363
2618399119,1cyclictest41-21ksoftirqd/311:43:173
2618399119,1cyclictest41-21ksoftirqd/310:18:563
2618399113,7cyclictest17687-21bash10:54:213
2618399113,2cyclictest709-21systemd-logind09:11:253
2618399112,4cyclictest3639-21systemd09:21:593
2618399111,4cyclictest8771-21systemd-cgroups12:00:263
2618399111,4cyclictest1981-21sshd09:05:213
2618399111,4cyclictest0-21swapper/311:54:513
2618399111,4cyclictest0-21swapper/311:36:213
2618399110,5cyclictest21032-21cp11:25:123
2618399110,11cyclictest30531-21kworker/3:109:35:273
2618399110,11cyclictest10803-21kworker/3:411:16:183
2618399110,10cyclictest5987-21bash10:08:473
2617399119,2cyclictest33-21ksoftirqd/212:25:332
2617399119,1cyclictest33-21ksoftirqd/212:15:232
2617399119,1cyclictest33-21ksoftirqd/211:45:262
2617399119,1cyclictest33-21ksoftirqd/210:30:512
2617399119,1cyclictest33-21ksoftirqd/210:04:412
2617399116,5cyclictest33-21ksoftirqd/212:31:002
26173991110,1cyclictest33-21ksoftirqd/211:23:242
26173991110,1cyclictest33-21ksoftirqd/209:31:322
2617399110,11cyclictest23911-21kworker/2:512:23:062
2617399110,10cyclictest1018-21strings07:15:242
2616599110,5cyclictest6179-21perl07:25:221
2616599110,5cyclictest29383-21cat07:10:191
2616599110,5cyclictest22121-21expr08:50:201
2616599110,5cyclictest20656-21smartctl08:45:281
2616599110,5cyclictest12518-21users08:30:301
2616599110,4cyclictest26524-21iostat08:00:231
2616599110,2cyclictest28212-21perl09:00:221
2616599110,2cyclictest27190-21munin-run09:00:081
2616599110,2cyclictest1614-21timerandwakeup07:15:281
2615799119,1cyclictest9-21ksoftirqd/010:15:310
2615799119,1cyclictest721-21dbus-daemon11:13:570
2615799112,5cyclictest0-21swapper/010:27:560
2615799112,4cyclictest25070-21sshd11:45:130
2615799110,10cyclictest9268-21sshd09:09:550
2615799110,10cyclictest22005-21bash09:33:440
2615799110,1cyclictest9660-21sshd10:32:180
2615799110,1cyclictest29264-21systemd-cgroups11:52:360
14402110,0sleep30-21swapper/310:46:103
2621499109,1cyclictest73-21ksoftirqd/711:47:077
2621499108,1cyclictest73-21ksoftirqd/709:54:047
2621499108,1cyclictest73-21ksoftirqd/709:08:417
2621499103,1cyclictest3409-21sshd10:03:117
2621499101,4cyclictest32563-21sshd11:04:087
2621499100,4cyclictest859-21gdbus12:06:347
2621499100,4cyclictest4887-21systemd-cgroups11:20:357
2621499100,4cyclictest464-21systemd-journal11:36:137
2621499100,4cyclictest32673-21sshd11:25:457
2621499100,4cyclictest10393-21bash09:13:307
2621499100,4cyclictest0-21swapper/709:38:407
2621499100,10cyclictest6406-21kworker/7:012:11:357
2621499100,0cyclictest0-21swapper/708:00:257
2619999108,1cyclictest57-21ksoftirqd/511:30:255
2619999103,6cyclictest3968-21sshd09:45:175
2619999102,7cyclictest12305-21bash12:06:035
2619999100,4cyclictest26034-21sshd09:39:215
2619999100,10cyclictest0-21swapper/509:21:085
2619199108,1cyclictest49-21ksoftirqd/411:46:444
2619199108,1cyclictest49-21ksoftirqd/411:21:374
2619199108,1cyclictest49-21ksoftirqd/410:57:304
2619199108,1cyclictest49-21ksoftirqd/410:57:304
2619199106,3cyclictest29198-21cp09:57:244
2619199100,1cyclictest24187-21ntp_kernel_pll_07:55:264
2618399109,1cyclictest41-21ksoftirqd/309:51:073
2618399108,1cyclictest41-21ksoftirqd/311:11:493
2618399105,1cyclictest0-21swapper/310:00:573
2618399104,3cyclictest464-21systemd-journal09:56:073
2618399103,6cyclictest29282-21sshd09:25:153
2618399102,3cyclictest0-21swapper/312:21:203
2618399100,10cyclictest26904-21kworker/3:111:46:573
2615799108,1cyclictest9-21ksoftirqd/009:40:460
2615799108,1cyclictest9-21ksoftirqd/009:25:430
2615799108,1cyclictest9-21ksoftirqd/009:18:310
2615799108,1cyclictest9-21ksoftirqd/009:18:310
2615799107,2cyclictest30102-21bash11:20:170
2615799105,2cyclictest13364-21grep09:20:410
2615799104,5cyclictest30096-21bash11:05:430
2615799103,4cyclictest1-21systemd10:20:130
2615799102,5cyclictest24096-21systemd09:46:180
2615799101,4cyclictest17930-21bash09:35:200
2615799100,9cyclictest27621-21kworker/0:311:35:260
2615799100,1cyclictest0-21swapper/010:59:570
2615799100,1cyclictest0-21swapper/010:59:570
262149997,1cyclictest73-21ksoftirqd/711:05:187
262149993,1cyclictest1-21systemd10:54:007
262069997,1cyclictest65-21ksoftirqd/609:05:086
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional