You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 17:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Dec 29, 2025 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2555621020,0sleep7711rcuc/712:07:517
15952550,0sleep41594-21systemd-cgroups10:20:574
301752540,2sleep62905199cyclictest10:37:256
198312520,1sleep41-21systemd09:39:244
2882625127,8sleep70-21swapper/707:08:347
225382490,0sleep50-21swapper/510:56:385
283642470,2sleep32904299cyclictest09:23:303
216892450,0sleep30-21swapper/310:09:433
216892450,0sleep30-21swapper/310:09:433
84012440,1sleep48404-21kworker/u16:410:58:374
232562440,0sleep10-21swapper/110:06:281
4022420,0sleep00-21swapper/010:47:440
133382420,1sleep5492-21systemd-journal11:32:345
48962410,0sleep60-21swapper/610:08:016
2641824130,8sleep30-21swapper/307:04:293
117362410,0sleep60-21swapper/612:26:406
2877024028,8sleep00-21swapper/007:07:470
2866724029,8sleep10-21swapper/107:06:201
2866324028,8sleep60-21swapper/607:06:176
2857024029,8sleep20-21swapper/207:05:012
2641924027,9sleep40-21swapper/407:04:304
48932390,0sleep00-21swapper/011:35:010
310752390,1sleep557-21ksoftirqd/510:24:105
303662390,0sleep20-21swapper/212:14:592
2642023926,9sleep50-21swapper/507:04:315
81252380,0sleep40-21swapper/412:05:564
145022380,0sleep20-21swapper/208:34:442
306792360,0sleep60-21swapper/610:44:136
294692360,0sleep00-21swapper/011:04:090
230132360,0sleep60-21swapper/612:07:346
116072340,1sleep665-21ksoftirqd/612:03:026
271832260,0sleep00-21swapper/012:21:300
29026992114,4cyclictest25-21ksoftirqd/110:13:321
29026992114,4cyclictest25-21ksoftirqd/110:13:321
2904299208,2cyclictest41-21ksoftirqd/312:25:343
288122200,0sleep50-21swapper/509:56:555
2904299196,3cyclictest41-21ksoftirqd/309:47:293
2904299195,2cyclictest41-21ksoftirqd/311:40:243
2904299193,1cyclictest41-21ksoftirqd/311:56:063
29042991914,3cyclictest6956-21systemd12:15:583
2904299188,1cyclictest41-21ksoftirqd/309:49:273
29026991814,3cyclictest25-21ksoftirqd/111:42:381
35472170,0sleep00-21swapper/010:14:360
2905199170,16cyclictest19362-21kworker/6:111:06:476
2904299178,2cyclictest41-21ksoftirqd/310:27:323
29042991712,3cyclictest41-21ksoftirqd/310:21:093
2904299170,3cyclictest41-21ksoftirqd/310:34:413
2904299166,3cyclictest41-21ksoftirqd/311:38:393
2904299166,1cyclictest41-21ksoftirqd/312:09:043
2904299166,1cyclictest41-21ksoftirqd/309:58:553
2904299165,1cyclictest41-21ksoftirqd/309:16:523
2904299165,1cyclictest41-21ksoftirqd/309:16:523
2904299163,4cyclictest41-21ksoftirqd/311:51:373
2904299162,1cyclictest41-21ksoftirqd/310:07:543
29042991615,1cyclictest41-21ksoftirqd/310:53:063
29042991615,1cyclictest41-21ksoftirqd/309:29:233
29042991614,1cyclictest41-21ksoftirqd/312:00:483
29042991611,3cyclictest41-21ksoftirqd/310:30:023
29042991610,4cyclictest41-21ksoftirqd/309:30:093
29042991610,3cyclictest41-21ksoftirqd/311:29:473
2903499168,1cyclictest33-21ksoftirqd/211:54:202
29034991611,1cyclictest33-21ksoftirqd/211:40:522
2902699165,2cyclictest25-21ksoftirqd/109:27:271
2902699163,5cyclictest25-21ksoftirqd/111:09:261
29026991615,1cyclictest25-21ksoftirqd/110:23:491
29026991615,1cyclictest25-21ksoftirqd/109:15:291
29026991615,1cyclictest25-21ksoftirqd/109:15:291
29026991614,2cyclictest25-21ksoftirqd/110:56:121
29026991614,1cyclictest25-21ksoftirqd/112:17:341
29026991614,1cyclictest25-21ksoftirqd/111:36:221
29026991614,1cyclictest25-21ksoftirqd/111:14:361
29026991614,1cyclictest25-21ksoftirqd/109:46:431
29026991614,1cyclictest25-21ksoftirqd/109:30:281
29026991612,3cyclictest25-21ksoftirqd/109:21:021
29026991612,1cyclictest25-21ksoftirqd/110:43:081
29026991611,3cyclictest25-21ksoftirqd/109:57:401
2902699161,1cyclictest131rcu_sched10:38:361
29061991515,0cyclictest0-21swapper/709:51:417
2904299158,4cyclictest492-21systemd-journal09:40:253
2904299154,3cyclictest41-21ksoftirqd/312:37:343
2904299154,3cyclictest41-21ksoftirqd/312:37:343
2904299154,10cyclictest41-21ksoftirqd/312:22:143
2904299154,1cyclictest41-21ksoftirqd/312:31:343
2904299154,1cyclictest41-21ksoftirqd/311:49:173
2904299154,1cyclictest41-21ksoftirqd/311:49:173
29042991513,1cyclictest41-21ksoftirqd/311:19:313
29042991513,1cyclictest41-21ksoftirqd/311:04:403
29042991513,1cyclictest41-21ksoftirqd/310:44:463
29042991513,1cyclictest41-21ksoftirqd/310:14:343
29042991513,1cyclictest41-21ksoftirqd/309:59:413
29042991511,1cyclictest121rcu_preempt10:40:213
2904299151,1cyclictest41-21ksoftirqd/310:54:463
2904299150,1cyclictest131rcu_sched09:13:423
2904299150,1cyclictest121rcu_preempt11:00:343
29034991512,2cyclictest33-21ksoftirqd/210:14:022
29034991512,2cyclictest33-21ksoftirqd/210:14:022
29026991514,1cyclictest25-21ksoftirqd/111:44:381
29026991514,1cyclictest25-21ksoftirqd/111:44:381
29026991514,1cyclictest25-21ksoftirqd/111:11:561
29026991514,1cyclictest25-21ksoftirqd/110:52:131
29026991514,1cyclictest25-21ksoftirqd/110:29:261
29026991514,1cyclictest25-21ksoftirqd/109:42:081
29026991514,1cyclictest25-21ksoftirqd/109:39:171
29026991514,1cyclictest25-21ksoftirqd/109:09:381
29026991513,1cyclictest25-21ksoftirqd/112:29:371
29026991513,1cyclictest25-21ksoftirqd/112:25:551
29026991513,1cyclictest25-21ksoftirqd/112:01:381
29026991513,1cyclictest25-21ksoftirqd/111:31:371
29026991513,1cyclictest25-21ksoftirqd/111:23:571
29026991513,1cyclictest25-21ksoftirqd/110:59:461
29026991513,1cyclictest25-21ksoftirqd/110:45:021
29026991513,1cyclictest25-21ksoftirqd/110:00:431
29026991513,1cyclictest25-21ksoftirqd/109:50:331
29026991511,1cyclictest25-21ksoftirqd/110:15:191
29026991510,3cyclictest25-21ksoftirqd/110:29:391
299952140,0sleep729992-21systemd-cgroups10:40:387
2904899140,8cyclictest0-21swapper/511:17:295
29042991412,1cyclictest41-21ksoftirqd/312:12:283
29042991412,1cyclictest41-21ksoftirqd/311:24:303
29042991412,1cyclictest41-21ksoftirqd/309:34:423
2904299141,1cyclictest131rcu_sched11:09:483
2904299140,1cyclictest121rcu_preempt11:16:123
29034991412,1cyclictest33-21ksoftirqd/212:39:042
29034991412,1cyclictest33-21ksoftirqd/212:39:042
29034991412,1cyclictest33-21ksoftirqd/211:28:182
29034991411,2cyclictest33-21ksoftirqd/210:54:202
29026991413,1cyclictest20690-21kworker/1:107:31:131
29026991413,1cyclictest20690-21kworker/1:107:31:131
29026991413,1cyclictest20690-21kworker/1:107:26:011
29026991412,1cyclictest25-21ksoftirqd/112:34:461
29026991412,1cyclictest25-21ksoftirqd/112:34:461
29026991412,1cyclictest25-21ksoftirqd/112:05:591
29026991412,1cyclictest25-21ksoftirqd/111:49:451
29026991411,3cyclictest25-21ksoftirqd/112:20:221
29026991410,4cyclictest25-21ksoftirqd/112:11:371
29026991410,3cyclictest25-21ksoftirqd/111:25:301
2902699140,2cyclictest121rcu_preempt11:54:591
290102140,1sleep449-21ksoftirqd/410:54:044
254762140,0sleep00-21swapper/007:59:270
2906199135,7cyclictest691-21systemd-logind09:42:407
2906199130,12cyclictest492-21systemd-journal10:20:357
2904899137,6cyclictest57-21ksoftirqd/510:44:415
2904899133,4cyclictest15906-21sshd12:20:165
29034991312,1cyclictest33-21ksoftirqd/210:56:292
29034991311,2cyclictest33-21ksoftirqd/210:32:392
29034991311,1cyclictest33-21ksoftirqd/211:14:392
29026991312,1cyclictest20690-21kworker/1:108:50:571
29026991312,1cyclictest20690-21kworker/1:108:18:011
29026991312,1cyclictest20690-21kworker/1:107:44:551
272732130,0sleep00-21swapper/011:17:150
33172120,1sleep03316-21kill10:34:380
319942120,1sleep531986-21bash10:50:535
2906199122,4cyclictest5980-21systemd-cgroups10:24:457
2906199122,4cyclictest0-21swapper/711:23:287
29061991210,1cyclictest887-21gdbus10:05:307
2906199120,11cyclictest686-21dbus-daemon12:31:557
2905199122,4cyclictest0-21swapper/612:21:366
2905199121,4cyclictest18177-21sshd10:49:366
2905199120,6cyclictest887-21gdbus09:37:386
2905199120,2cyclictest9563-21systemd10:11:466
2905199120,2cyclictest9563-21systemd10:11:466
2905199120,12cyclictest0-21swapper/609:40:066
2904899121,5cyclictest885-21polkitd10:08:185
2904899121,5cyclictest763-21NetworkManager09:10:105
2904899120,11cyclictest686-21dbus-daemon12:32:495
29047991210,1cyclictest49-21ksoftirqd/410:08:264
2904799120,11cyclictest0-21swapper/410:48:444
29042991210,1cyclictest41-21ksoftirqd/307:39:263
2903499129,2cyclictest33-21ksoftirqd/211:12:262
2903499129,2cyclictest23239-21systemctl11:57:272
29034991211,1cyclictest33-21ksoftirqd/209:47:442
29034991210,1cyclictest33-21ksoftirqd/212:12:102
2903499120,9cyclictest0-21swapper/209:37:212
29026991211,1cyclictest20690-21kworker/1:108:23:031
29026991210,1cyclictest20690-21kworker/1:108:29:491
29020991212,0cyclictest0-21swapper/011:56:340
269992120,0sleep50-21swapper/511:10:235
144322120,1sleep714433-21bash11:36:047
2906199119,1cyclictest73-21ksoftirqd/711:47:257
2906199119,1cyclictest73-21ksoftirqd/711:47:257
2906199118,2cyclictest16356-21systemd11:39:447
2906199114,6cyclictest885-21polkitd09:14:127
2906199114,1cyclictest20177-21cstates10:29:407
2906199112,4cyclictest0-21swapper/709:55:167
29061991110,1cyclictest0-21swapper/711:08:227
2906199111,4cyclictest691-21systemd-logind09:36:587
2906199110,4cyclictest763-21NetworkManager10:17:367
2906199110,11cyclictest18069-21kworker/7:011:02:337
2906199110,10cyclictest686-21dbus-daemon12:01:487
2906199110,10cyclictest6364-21sshd12:26:057
2905199119,1cyclictest1-21systemd10:45:506
2905199114,3cyclictest885-21polkitd10:30:446
2905199113,7cyclictest5004-21sshd09:57:526
29051991110,1cyclictest0-21swapper/611:16:346
2905199111,4cyclictest32426-21sshd09:13:546
2905199110,11cyclictest30758-21kworker/6:311:37:436
2905199110,11cyclictest23280-21kworker/6:510:27:266
2905199110,11cyclictest1442-21kworker/6:211:00:076
2904899119,1cyclictest15939-21systemd10:42:375
2904899114,6cyclictest686-21dbus-daemon10:24:595
2904899114,6cyclictest29264-21kworker/u16:111:00:365
2904899112,5cyclictest686-21dbus-daemon12:25:275
2904899112,3cyclictest436-21grepconf.sh12:39:105
2904899112,3cyclictest436-21grepconf.sh12:39:105
2904899111,6cyclictest12269-21systemd09:45:055
2904899111,4cyclictest1-21systemd09:38:275
2904899110,5cyclictest686-21dbus-daemon12:05:335
2904899110,11cyclictest22579-21kworker/5:111:21:485
2904899110,11cyclictest0-21swapper/510:35:225
2904899110,10cyclictest0-21swapper/509:22:415
2904799119,1cyclictest49-21ksoftirqd/411:45:544
2904799119,1cyclictest49-21ksoftirqd/411:45:544
2904799119,1cyclictest49-21ksoftirqd/411:34:154
2904799117,2cyclictest49-21ksoftirqd/411:23:484
2904799113,4cyclictest0-21swapper/410:39:004
29047991110,1cyclictest49-21ksoftirqd/410:27:594
2904799110,11cyclictest5718-21kworker/4:012:09:514
2904799110,10cyclictest20531-21grep09:15:524
2904799110,10cyclictest20531-21grep09:15:524
2904799110,10cyclictest0-21swapper/409:30:514
2903499119,1cyclictest33-21ksoftirqd/211:36:032
2903499119,1cyclictest33-21ksoftirqd/211:31:242
2903499119,1cyclictest33-21ksoftirqd/209:43:332
2903499118,2cyclictest33-21ksoftirqd/209:24:342
2903499116,4cyclictest1-21systemd12:24:332
2903499113,2cyclictest31259-21systemd09:53:582
29034991110,1cyclictest33-21ksoftirqd/212:04:482
29034991110,1cyclictest33-21ksoftirqd/211:59:482
29034991110,1cyclictest33-21ksoftirqd/209:12:572
29034991110,1cyclictest0-21swapper/211:48:002
29034991110,1cyclictest0-21swapper/211:48:002
2903499110,10cyclictest15564-21kworker/2:010:17:312
29026991111,0cyclictest20690-21kworker/1:108:45:451
29026991110,1cyclictest20690-21kworker/1:108:07:371
2902099111,4cyclictest32252-21systemd-cgroups09:17:100
2902099111,4cyclictest32252-21systemd-cgroups09:17:100
2902099110,11cyclictest7449-21kworker/0:410:06:210
2902099110,10cyclictest29803-21kworker/0:311:28:190
2906199109,1cyclictest0-21swapper/710:48:017
2906199109,1cyclictest0-21swapper/710:04:027
2906199108,1cyclictest885-21polkitd11:18:097
2906199108,1cyclictest10714-21kworker/u16:409:22:167
2906199103,6cyclictest885-21polkitd12:34:497
2906199103,6cyclictest885-21polkitd12:34:497
2906199103,6cyclictest13009-21sshd10:35:327
2906199103,6cyclictest0-21swapper/711:10:007
2906199100,9cyclictest20494-21kworker/7:409:24:547
2906199100,4cyclictest8276-21systemd-cgroups10:11:387
2906199100,4cyclictest8276-21systemd-cgroups10:11:387
2906199100,4cyclictest7492-21sshd09:31:167
2906199100,4cyclictest0-21swapper/712:16:277
2906199100,4cyclictest0-21swapper/711:50:567
2906199100,4cyclictest0-21swapper/711:33:077
2906199100,10cyclictest3080-21kworker/7:212:20:517
2906199100,10cyclictest29148-21kworker/7:412:09:427
2906199100,10cyclictest19842-21kworker/7:311:28:597
2906199100,10cyclictest12624-21kworker/7:410:54:317
2906199100,10cyclictest12020-21kworker/7:309:44:347
2905199103,6cyclictest686-21dbus-daemon09:15:096
2905199103,6cyclictest686-21dbus-daemon09:15:096
2905199101,4cyclictest0-21swapper/609:24:146
2905199100,4cyclictest763-21NetworkManager11:54:316
2905199100,4cyclictest686-21dbus-daemon11:51:166
2905199100,4cyclictest20315-21systemd-cgroups12:17:266
2905199100,4cyclictest0-21swapper/612:13:236
2905199100,4cyclictest0-21swapper/609:32:486
2905199100,10cyclictest1442-21kworker/6:210:58:326
2905199100,10cyclictest0-21swapper/612:38:056
2905199100,10cyclictest0-21swapper/612:38:056
2905199100,10cyclictest0-21swapper/611:44:476
2905199100,10cyclictest0-21swapper/611:44:476
2905199100,10cyclictest0-21swapper/610:19:586
2905199100,10cyclictest0-21swapper/609:24:576
2905199100,1cyclictest0-21swapper/611:26:306
2904899108,1cyclictest57-21ksoftirqd/511:59:265
2904899108,1cyclictest57-21ksoftirqd/510:16:195
2904899102,7cyclictest29014-21systemd-cgroups09:33:375
2904899102,2cyclictest29072-21sshd10:30:285
2904899101,4cyclictest0-21swapper/509:41:135
2904899101,0cyclictest0-21swapper/511:07:075
2904899100,4cyclictest723-21in:imjournal09:15:095
2904899100,4cyclictest723-21in:imjournal09:15:095
2904899100,4cyclictest686-21dbus-daemon11:37:205
2904899100,1cyclictest14823-21sshd12:16:505
2904799108,1cyclictest49-21ksoftirqd/411:08:524
2904799108,1cyclictest49-21ksoftirqd/410:11:334
2904799108,1cyclictest49-21ksoftirqd/410:11:334
2904799105,2cyclictest3825-21grepconf.sh11:34:544
2904799104,2cyclictest686-21dbus-daemon09:25:534
2904799103,4cyclictest885-21polkitd09:55:224
2904799102,4cyclictest25193-21systemd-cgroups10:03:224
2904799101,5cyclictest691-21systemd-logind10:18:514
2904799100,10cyclictest0-21swapper/412:33:444
2904799100,1cyclictest0-21swapper/409:12:414
2904299109,1cyclictest41-21ksoftirqd/308:29:403
2904299109,1cyclictest41-21ksoftirqd/307:49:263
2904299109,1cyclictest41-21ksoftirqd/307:39:413
2904299109,1cyclictest41-21ksoftirqd/307:34:263
2904299109,1cyclictest41-21ksoftirqd/307:34:263
2904299108,1cyclictest41-21ksoftirqd/308:24:443
2904299108,1cyclictest41-21ksoftirqd/308:19:433
2904299108,1cyclictest41-21ksoftirqd/308:14:383
2903499109,1cyclictest33-21ksoftirqd/212:20:172
2903499109,1cyclictest33-21ksoftirqd/210:36:052
2903499108,2cyclictest33-21ksoftirqd/210:22:202
2903499108,1cyclictest33-21ksoftirqd/209:59:562
2903499107,3cyclictest33-21ksoftirqd/209:20:342
2903499107,2cyclictest33-21ksoftirqd/212:33:062
2903499107,2cyclictest33-21ksoftirqd/210:44:312
2903499107,1cyclictest33-21ksoftirqd/210:07:062
2903499106,3cyclictest33-21ksoftirqd/209:19:262
2903499106,3cyclictest33-21ksoftirqd/209:19:262
2903499105,5cyclictest33-21ksoftirqd/211:22:502
2903499102,2cyclictest15618-21kworker/2:010:42:262
2903499100,10cyclictest0-21swapper/207:54:402
2902699109,1cyclictest20690-21kworker/1:109:01:211
2902699109,1cyclictest20690-21kworker/1:108:42:171
2902699109,1cyclictest20690-21kworker/1:108:12:491
2902699109,1cyclictest20690-21kworker/1:107:58:471
2902699108,1cyclictest25-21ksoftirqd/109:09:261
2902699108,1cyclictest25-21ksoftirqd/109:09:261
29026991010,0cyclictest20690-21kworker/1:107:52:011
2902099109,1cyclictest9-21ksoftirqd/012:18:180
2902099109,1cyclictest0-21swapper/009:53:230
2902099108,1cyclictest9-21ksoftirqd/012:25:140
2902099108,1cyclictest9-21ksoftirqd/011:22:060
2902099105,4cyclictest492-21systemd-journal11:48:190
2902099105,4cyclictest492-21systemd-journal11:48:190
2902099104,3cyclictest0-21swapper/009:49:250
2902099103,1cyclictest691-21systemd-logind11:10:170
2902099102,7cyclictest885-21polkitd10:29:260
2902099101,4cyclictest5458-21sshd10:21:220
2902099101,4cyclictest0-21swapper/009:59:150
2902099100,4cyclictest686-21dbus-daemon12:34:220
2902099100,4cyclictest29725-21sshd12:35:140
2902099100,4cyclictest29725-21sshd12:35:140
2902099100,1cyclictest0-21swapper/009:10:110
290619997,1cyclictest73-21ksoftirqd/711:54:427
290619992,1cyclictest28038-21sshd10:50:287
290619990,4cyclictest0-21swapper/709:15:367
290619990,4cyclictest0-21swapper/709:15:367
290519997,1cyclictest65-21ksoftirqd/611:20:226
290519992,6cyclictest887-21gdbus09:44:586
290519992,6cyclictest686-21dbus-daemon11:40:586
290519992,3cyclictest686-21dbus-daemon11:30:026
290519992,3cyclictest686-21dbus-daemon09:49:396
290519992,3cyclictest1-21systemd12:32:566
290519991,5cyclictest686-21dbus-daemon11:10:336
290519990,9cyclictest0-21swapper/608:59:436
290519990,9cyclictest0-21swapper/608:34:396
290489994,4cyclictest686-21dbus-daemon09:50:405
290489994,1cyclictest686-21dbus-daemon11:27:475
290489993,3cyclictest0-21swapper/512:01:455
290489993,1cyclictest0-21swapper/509:59:495
290489993,1cyclictest0-21swapper/509:28:155
290489992,4cyclictest8564-21systemd12:09:325
290489990,9cyclictest0-21swapper/511:47:255
290489990,9cyclictest0-21swapper/511:47:255
290489990,9cyclictest0-21swapper/510:12:445
290489990,9cyclictest0-21swapper/510:12:445
290489990,5cyclictest763-21NetworkManager11:39:395
290489990,5cyclictest12742-21kill11:53:005
290479995,1cyclictest18993-21sh10:59:414
290479995,1cyclictest11045-21systemd-cgroups10:32:044
290479994,2cyclictest28558-21sshd11:58:024
290479992,4cyclictest885-21polkitd12:16:374
290479992,4cyclictest26910-21systemd12:21:284
290479991,5cyclictest723-21in:imjournal09:21:484
290479991,4cyclictest15949-21systemd11:43:094
290479990,9cyclictest14490-21sshd11:15:514
290479990,9cyclictest0-21swapper/412:00:564
290479990,9cyclictest0-21swapper/411:25:474
290479990,9cyclictest0-21swapper/409:46:564
290479990,8cyclictest686-21dbus-daemon09:40:274
290479990,8cyclictest32313-21kworker/4:112:24:444
290479990,8cyclictest28035-21kworker/4:411:12:524
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional