You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 18:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Dec 19, 2025 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48222820,2sleep51667999cyclictest09:34:495
67102650,0sleep10-21swapper/110:25:061
1620624926,8sleep20-21swapper/207:06:252
1637924825,8sleep50-21swapper/507:08:455
172502450,2sleep1241ktimersoftd/111:03:421
230052430,0sleep10-21swapper/111:19:281
142832420,0sleep70-21swapper/709:44:047
95512410,0sleep60-21swapper/611:52:166
228552410,0sleep50-21swapper/509:31:215
182512410,0sleep30-21swapper/309:51:533
1633624128,9sleep70-21swapper/707:08:147
1620824028,9sleep40-21swapper/407:06:274
174882390,0sleep20-21swapper/209:37:262
1641723928,8sleep30-21swapper/307:09:153
1623123925,10sleep00-21swapper/007:06:470
1614323927,9sleep60-21swapper/607:05:336
1397123926,9sleep10-21swapper/107:04:481
128752390,0sleep70-21swapper/710:05:027
173692380,0sleep40-21swapper/409:23:114
1669199218,3cyclictest65-21ksoftirqd/610:31:166
1667399206,1cyclictest49-21ksoftirqd/412:28:514
16673991914,3cyclictest49-21ksoftirqd/411:05:004
16691991812,4cyclictest65-21ksoftirqd/609:29:066
1667399189,2cyclictest49-21ksoftirqd/410:19:164
16673991813,3cyclictest49-21ksoftirqd/412:05:484
16673991812,4cyclictest49-21ksoftirqd/411:11:164
16691991712,3cyclictest65-21ksoftirqd/609:23:296
16691991711,3cyclictest65-21ksoftirqd/611:28:266
1667399179,4cyclictest49-21ksoftirqd/411:41:124
16673991714,3cyclictest49-21ksoftirqd/410:42:104
16673991714,3cyclictest49-21ksoftirqd/409:58:574
16673991713,1cyclictest49-21ksoftirqd/412:11:124
16673991712,4cyclictest49-21ksoftirqd/411:45:404
16673991712,3cyclictest49-21ksoftirqd/410:33:074
16673991711,4cyclictest49-21ksoftirqd/409:25:084
91372160,1sleep6641ktimersoftd/609:35:226
1669199163,5cyclictest65-21ksoftirqd/611:06:236
16691991615,1cyclictest65-21ksoftirqd/610:44:176
16691991613,3cyclictest65-21ksoftirqd/611:39:096
16691991612,3cyclictest65-21ksoftirqd/612:22:126
1669199161,3cyclictest121rcu_preempt11:41:116
1667399167,2cyclictest49-21ksoftirqd/410:45:234
1667399166,3cyclictest49-21ksoftirqd/412:22:334
1667399166,3cyclictest49-21ksoftirqd/410:55:574
1667399165,3cyclictest49-21ksoftirqd/411:38:174
16673991614,1cyclictest49-21ksoftirqd/411:01:084
16673991614,1cyclictest49-21ksoftirqd/410:52:244
16673991614,1cyclictest49-21ksoftirqd/410:20:064
16673991614,1cyclictest49-21ksoftirqd/409:45:074
16673991613,1cyclictest49-21ksoftirqd/411:58:284
16673991612,1cyclictest49-21ksoftirqd/409:18:564
16673991612,1cyclictest49-21ksoftirqd/409:18:564
16673991611,3cyclictest49-21ksoftirqd/412:30:584
1667399160,2cyclictest121rcu_preempt10:12:084
1667399160,2cyclictest121rcu_preempt10:12:084
116182160,1sleep341-21ksoftirqd/309:35:593
41562150,0sleep60-21swapper/609:55:486
16698991513,1cyclictest28999-21systemd11:49:397
1669199155,4cyclictest65-21ksoftirqd/611:19:036
16691991513,1cyclictest65-21ksoftirqd/612:03:516
16691991512,3cyclictest65-21ksoftirqd/609:39:516
1669199150,14cyclictest13685-21kworker/6:210:35:006
1667999150,14cyclictest0-21swapper/512:13:175
1667399154,1cyclictest49-21ksoftirqd/410:37:334
1667399153,2cyclictest49-21ksoftirqd/411:16:344
16673991514,1cyclictest8206-21kworker/4:207:11:434
16673991514,1cyclictest8206-21kworker/4:207:11:434
16673991514,1cyclictest49-21ksoftirqd/412:00:064
16673991513,1cyclictest49-21ksoftirqd/412:14:484
16673991513,1cyclictest49-21ksoftirqd/411:23:504
16673991513,1cyclictest49-21ksoftirqd/409:35:074
16673991513,1cyclictest49-21ksoftirqd/409:10:394
16673991513,1cyclictest49-21ksoftirqd/409:10:394
16673991512,1cyclictest49-21ksoftirqd/411:29:294
1666599159,2cyclictest19132-21systemd12:09:043
141462150,0sleep30-21swapper/311:24:433
1669199143,2cyclictest65-21ksoftirqd/610:56:396
16691991413,1cyclictest65-21ksoftirqd/612:19:466
16691991412,1cyclictest65-21ksoftirqd/612:37:416
16691991412,1cyclictest65-21ksoftirqd/611:56:096
16691991412,1cyclictest65-21ksoftirqd/610:23:566
16691991412,1cyclictest65-21ksoftirqd/609:14:406
16691991412,1cyclictest65-21ksoftirqd/609:14:406
16691991411,1cyclictest65-21ksoftirqd/610:50:016
1669199141,2cyclictest65-21ksoftirqd/609:50:326
1667999140,0cyclictest0-21swapper/512:30:185
1667399148,4cyclictest49-21ksoftirqd/410:25:544
1667399144,3cyclictest49-21ksoftirqd/409:42:124
16673991414,0cyclictest8206-21kworker/4:207:39:274
16673991413,1cyclictest49-21ksoftirqd/411:51:564
16673991413,1cyclictest49-21ksoftirqd/410:09:364
16673991412,1cyclictest49-21ksoftirqd/412:35:574
16673991412,1cyclictest49-21ksoftirqd/411:31:284
16673991412,1cyclictest49-21ksoftirqd/409:32:264
16673991410,3cyclictest49-21ksoftirqd/410:00:244
1667399140,2cyclictest49-21ksoftirqd/409:50:424
16641991411,2cyclictest691-21systemd-logind10:04:300
19122130,0sleep30-21swapper/310:02:423
1669199139,2cyclictest65-21ksoftirqd/610:13:026
1669199139,2cyclictest65-21ksoftirqd/610:13:026
16691991312,1cyclictest65-21ksoftirqd/612:29:596
16691991312,1cyclictest65-21ksoftirqd/611:47:396
16691991312,1cyclictest65-21ksoftirqd/610:44:516
16691991312,1cyclictest65-21ksoftirqd/609:19:266
16691991312,1cyclictest65-21ksoftirqd/609:19:266
16691991311,1cyclictest65-21ksoftirqd/612:11:076
16691991311,1cyclictest65-21ksoftirqd/610:26:106
16691991311,1cyclictest65-21ksoftirqd/610:15:026
16691991311,1cyclictest65-21ksoftirqd/610:01:496
16691991311,1cyclictest65-21ksoftirqd/609:45:086
16691991311,1cyclictest65-21ksoftirqd/609:30:016
16691991310,3cyclictest65-21ksoftirqd/611:10:196
16673991313,0cyclictest8206-21kworker/4:209:00:554
1665799138,1cyclictest28124-21systemd09:54:212
1665799136,4cyclictest33-21ksoftirqd/209:24:462
16698991211,1cyclictest73-21ksoftirqd/711:28:207
16698991210,1cyclictest73-21ksoftirqd/707:54:467
16691991210,1cyclictest65-21ksoftirqd/612:27:346
16691991210,1cyclictest65-21ksoftirqd/612:05:116
16691991210,1cyclictest65-21ksoftirqd/611:30:016
16691991210,1cyclictest65-21ksoftirqd/611:24:236
16691991210,1cyclictest65-21ksoftirqd/611:00:546
16691991210,1cyclictest65-21ksoftirqd/610:06:356
1667999128,4cyclictest0-21swapper/511:36:335
1667999125,1cyclictest0-21swapper/509:25:575
1667999124,2cyclictest9299-21bash09:57:065
1667999124,2cyclictest686-21dbus-daemon12:15:345
1667999124,2cyclictest686-21dbus-daemon11:06:215
1667999124,2cyclictest25682-21grep09:17:515
1667999124,2cyclictest25682-21grep09:17:515
1667999124,2cyclictest16762-21systemd10:34:535
1667999124,1cyclictest1061-21id11:28:565
1667999123,2cyclictest21774-21systemd09:52:465
1667999120,12cyclictest0-21swapper/510:41:135
1667999120,1cyclictest0-21swapper/512:07:535
16673991212,0cyclictest8206-21kworker/4:208:24:314
16673991212,0cyclictest8206-21kworker/4:208:24:314
16673991212,0cyclictest8206-21kworker/4:207:42:554
16673991211,1cyclictest8206-21kworker/4:207:25:254
16673991210,1cyclictest49-21ksoftirqd/409:04:554
16673991210,1cyclictest49-21ksoftirqd/408:29:464
16673991210,1cyclictest49-21ksoftirqd/407:34:474
16673991210,1cyclictest49-21ksoftirqd/407:19:464
16673991210,1cyclictest49-21ksoftirqd/407:19:464
1667399121,11cyclictest0-21swapper/407:45:004
16657991211,1cyclictest33-21ksoftirqd/210:55:042
16657991210,1cyclictest33-21ksoftirqd/212:00:162
16649991211,1cyclictest25-21ksoftirqd/112:36:221
16649991211,1cyclictest25-21ksoftirqd/111:39:561
1664199120,2cyclictest12118-21id10:33:480
49512118,1sleep125-21ksoftirqd/111:51:081
1669899119,1cyclictest73-21ksoftirqd/710:47:297
1669899118,2cyclictest24052-21bash11:40:567
1669899115,4cyclictest686-21dbus-daemon12:19:517
16698991110,1cyclictest73-21ksoftirqd/712:36:167
16698991110,1cyclictest0-21swapper/710:25:067
1667999117,0cyclictest0-21swapper/511:51:505
1667999114,2cyclictest4331-21grepconf.sh09:13:095
1667999114,2cyclictest4331-21grepconf.sh09:13:095
1667999114,2cyclictest3070-21grepconf.sh09:20:005
1667999114,2cyclictest21711-21id10:50:035
1667999114,2cyclictest18528-21systemctl11:10:525
1667999114,1cyclictest3323-21grepconf.sh11:43:515
1667999114,1cyclictest14134-21systemd-cgroups12:36:375
1667999113,2cyclictest6002-21sshd11:00:535
1667999112,8cyclictest0-21swapper/511:46:575
1667999110,5cyclictest1-21systemd12:27:095
1667999110,4cyclictest0-21swapper/508:50:225
1667399119,1cyclictest49-21ksoftirqd/408:45:034
16673991110,1cyclictest8206-21kworker/4:208:05:274
1666599119,1cyclictest885-21polkitd12:26:153
1665799119,2cyclictest33-21ksoftirqd/212:10:422
1665799119,1cyclictest33-21ksoftirqd/211:49:582
1665799119,1cyclictest0-21swapper/211:00:592
1665799119,1cyclictest0-21swapper/209:17:062
1665799119,1cyclictest0-21swapper/209:17:062
1665799112,3cyclictest14442-21systemd09:29:472
16657991110,1cyclictest33-21ksoftirqd/212:20:082
16657991110,1cyclictest33-21ksoftirqd/211:09:032
16657991110,1cyclictest33-21ksoftirqd/210:14:122
16657991110,1cyclictest33-21ksoftirqd/210:14:122
1664999119,1cyclictest25-21ksoftirqd/110:04:131
1664999119,1cyclictest25-21ksoftirqd/109:24:581
1664999118,2cyclictest19355-21systemd09:45:011
16649991110,1cyclictest25-21ksoftirqd/112:33:461
1664999110,11cyclictest0-21swapper/111:25:551
1664999110,10cyclictest28167-21/usr/sbin/munin09:39:591
1664999110,10cyclictest0-21swapper/111:54:561
1664999110,1cyclictest0-21swapper/110:06:371
1664199115,3cyclictest686-21dbus-daemon09:24:240
1664199111,4cyclictest691-21systemd-logind12:21:170
22672100,1sleep773-21ksoftirqd/710:09:597
22672100,1sleep773-21ksoftirqd/710:09:597
1669899108,1cyclictest73-21ksoftirqd/711:20:207
1669899108,1cyclictest73-21ksoftirqd/709:48:107
1669899106,3cyclictest12935-21sshd09:29:317
1669899103,4cyclictest686-21dbus-daemon10:40:277
1669899103,3cyclictest30657-21sshd10:30:227
1669899102,5cyclictest691-21systemd-logind09:32:287
1669899102,4cyclictest29387-21systemd-cgroups10:51:487
1669899100,9cyclictest21739-21kworker/7:411:05:467
1669199109,1cyclictest65-21ksoftirqd/607:34:586
1669199108,1cyclictest65-21ksoftirqd/608:49:466
1669199108,1cyclictest0-21swapper/608:30:046
1667999108,1cyclictest718-21avahi-daemon10:28:025
1667999107,3cyclictest0-21swapper/510:45:385
1667999104,2cyclictest24960-21bash11:55:325
1667999104,2cyclictest21381-21bash10:06:555
1667999104,1cyclictest784-21runrttasks08:46:335
1667999104,1cyclictest26663-21grep09:46:325
1667999104,1cyclictest1-21systemd10:13:135
1667999104,1cyclictest1-21systemd10:13:135
1667999103,2cyclictest686-21dbus-daemon11:20:375
1667999103,2cyclictest686-21dbus-daemon09:40:085
1667999103,2cyclictest18482-21bash12:01:255
1667999103,1cyclictest4361-21kill10:17:355
1667399109,1cyclictest8206-21kworker/4:208:57:074
1667399109,1cyclictest8206-21kworker/4:208:33:014
1667399109,1cyclictest8206-21kworker/4:207:20:134
1667399108,1cyclictest49-21ksoftirqd/408:50:004
16673991010,0cyclictest8206-21kworker/4:208:17:354
16673991010,0cyclictest8206-21kworker/4:208:11:534
1666599109,1cyclictest0-21swapper/310:59:233
1666599107,2cyclictest885-21polkitd12:13:363
1666599102,2cyclictest18939-21systemd11:04:083
1666599100,10cyclictest18349-21systemd12:23:163
1666599100,10cyclictest10011-21kworker/3:211:58:373
1665799109,1cyclictest33-21ksoftirqd/211:26:302
1665799109,1cyclictest33-21ksoftirqd/210:15:262
1665799100,1cyclictest0-21swapper/209:45:382
1664999108,1cyclictest25-21ksoftirqd/112:13:071
1664999108,1cyclictest25-21ksoftirqd/109:12:431
1664999108,1cyclictest25-21ksoftirqd/109:12:431
1664999103,4cyclictest4869-21systemd10:39:281
1664999102,5cyclictest691-21systemd-logind11:37:591
1664999101,5cyclictest32533-21systemd-cgroups11:14:221
1664999100,10cyclictest0-21swapper/110:59:261
1664199108,2cyclictest31980-21bash09:11:590
1664199108,2cyclictest31980-21bash09:11:590
1664199103,4cyclictest0-21swapper/011:54:460
1664199103,1cyclictest5975-21systemd-cgroups12:27:400
1664199102,7cyclictest3130-21systemd10:10:030
1664199102,7cyclictest3130-21systemd10:10:030
1664199101,5cyclictest0-21swapper/008:19:460
1664199100,10cyclictest27336-21kworker/0:212:00:070
110252100,0sleep20-21swapper/212:28:562
166989999,0cyclictest0-21swapper/711:14:557
166989997,1cyclictest73-21ksoftirqd/711:55:577
166989995,1cyclictest686-21dbus-daemon11:38:437
166989994,1cyclictest3485-21systemd-cgroups09:20:027
166989993,3cyclictest12721-21systemd09:50:307
166989993,3cyclictest1-21systemd12:05:527
166989992,4cyclictest1-21systemd09:57:197
166989991,5cyclictest13562-21perl11:10:017
166989990,9cyclictest0-21swapper/712:13:437
166989990,8cyclictest31992-21kworker/7:010:58:047
166989990,1cyclictest0-21swapper/711:30:097
166919997,1cyclictest65-21ksoftirqd/608:10:076
166919990,0cyclictest0-21swapper/607:10:096
166919990,0cyclictest0-21swapper/607:10:096
166799996,1cyclictest57-21ksoftirqd/510:29:575
166799993,3cyclictest885-21polkitd10:22:095
166799993,1cyclictest711-21nscd11:31:075
166799992,3cyclictest27759-21sshd10:58:525
166799990,9cyclictest0-21swapper/511:14:575
166799990,2cyclictest10432-21systemd12:21:165
166799990,0cyclictest0-21swapper/507:30:085
166739998,1cyclictest49-21ksoftirqd/408:40:064
166739998,1cyclictest49-21ksoftirqd/408:39:464
166659999,0cyclictest0-21swapper/309:19:263
166659999,0cyclictest0-21swapper/309:19:263
166659998,1cyclictest41-21ksoftirqd/311:54:273
166659997,1cyclictest885-21polkitd12:39:453
166659997,1cyclictest41-21ksoftirqd/312:34:333
166659997,1cyclictest41-21ksoftirqd/309:58:213
166659993,1cyclictest885-21polkitd10:20:063
166659990,9cyclictest0-21swapper/311:25:153
166659990,9cyclictest0-21swapper/308:30:053
166659990,8cyclictest6207-21systemd09:42:043
166659990,0cyclictest0-21swapper/310:47:063
166659990,0cyclictest0-21swapper/309:27:293
166579998,1cyclictest33-21ksoftirqd/210:53:132
166579998,1cyclictest33-21ksoftirqd/210:24:572
166579998,1cyclictest33-21ksoftirqd/209:42:412
166579997,1cyclictest33-21ksoftirqd/211:32:192
166579997,1cyclictest33-21ksoftirqd/210:23:492
166579997,1cyclictest33-21ksoftirqd/210:01:252
166579997,0cyclictest10413-21kworker/u16:410:38:282
166579996,3cyclictest33-21ksoftirqd/211:45:232
166579996,2cyclictest33-21ksoftirqd/212:30:462
166579995,3cyclictest33-21ksoftirqd/211:56:392
166579992,4cyclictest492-21systemd-journal11:35:062
166579990,9cyclictest0-21swapper/211:42:082
166579990,0cyclictest0-21swapper/211:12:112
166499999,0cyclictest0-21swapper/112:27:531
166499999,0cyclictest0-21swapper/110:51:051
166499999,0cyclictest0-21swapper/109:51:011
166499997,1cyclictest25-21ksoftirqd/111:21:081
166499994,3cyclictest691-21systemd-logind12:21:361
166499993,5cyclictest691-21systemd-logind10:30:591
166499993,3cyclictest686-21dbus-daemon09:35:161
166499992,4cyclictest691-21systemd-logind09:20:591
166499992,4cyclictest686-21dbus-daemon10:15:281
166499992,4cyclictest0-21swapper/109:55:071
166499992,3cyclictest7056-21sshd10:46:511
166499992,3cyclictest686-21dbus-daemon11:59:491
166499992,3cyclictest686-21dbus-daemon10:23:541
166499992,3cyclictest30319-21sshd12:18:451
166499990,8cyclictest22902-21kworker/1:010:12:031
166499990,8cyclictest22902-21kworker/1:010:12:031
166499990,8cyclictest22256-21bash09:17:001
166499990,8cyclictest22256-21bash09:17:001
166499990,8cyclictest1392-21kworker/1:010:42:481
166419999,0cyclictest0-21swapper/012:36:560
166419999,0cyclictest0-21swapper/012:30:190
166419999,0cyclictest0-21swapper/011:01:240
166419997,1cyclictest5024-21diskstats10:24:590
166419993,3cyclictest686-21dbus-daemon11:48:590
166419993,1cyclictest6919-21sshd11:22:540
166419992,6cyclictest0-21swapper/010:37:220
166419992,1cyclictest1-21systemd11:17:300
166419990,4cyclictest0-21swapper/009:32:410
8181285,1sleep09-21ksoftirqd/009:35:090
166989988,0cyclictest0-21swapper/712:30:457
166989988,0cyclictest0-21swapper/708:15:027
166989986,1cyclictest73-21ksoftirqd/709:34:527
166989986,1cyclictest73-21ksoftirqd/709:10:397
166989986,1cyclictest73-21ksoftirqd/709:10:397
166989983,4cyclictest763-21NetworkManager11:01:477
166989983,1cyclictest0-21swapper/711:51:047
166989982,4cyclictest0-21swapper/712:17:437
166989982,3cyclictest686-21dbus-daemon10:16:267
166989982,3cyclictest24980-21systemd10:36:257
166989982,3cyclictest0-21swapper/712:26:097
166989980,8cyclictest0-21swapper/708:33:577
166989980,7cyclictest6229-21kworker/7:311:59:467
166989980,7cyclictest21021-21kworker/7:309:59:567
166989980,7cyclictest20019-21kworker/7:010:20:167
166989980,0cyclictest0-21swapper/709:17:007
166989980,0cyclictest0-21swapper/709:17:007
166919988,0cyclictest0-21swapper/607:59:586
166919987,1cyclictest65-21ksoftirqd/608:29:466
166919987,1cyclictest65-21ksoftirqd/607:59:466
166919987,1cyclictest65-21ksoftirqd/607:49:466
166919987,1cyclictest65-21ksoftirqd/607:30:066
166919986,1cyclictest65-21ksoftirqd/608:15:006
166919986,1cyclictest65-21ksoftirqd/607:54:466
166919980,1cyclictest121rcu_preempt08:05:026
166799985,2cyclictest1-21systemd09:59:595
166739988,0cyclictest8206-21kworker/4:207:51:154
166739986,1cyclictest49-21ksoftirqd/407:59:594
166739986,1cyclictest49-21ksoftirqd/407:55:064
166659988,0cyclictest0-21swapper/311:16:253
166659987,1cyclictest19299-21sshd09:30:283
166659986,1cyclictest41-21ksoftirqd/311:35:203
166659986,1cyclictest41-21ksoftirqd/309:46:473
166659985,2cyclictest686-21dbus-daemon10:52:593
166659985,2cyclictest686-21dbus-daemon10:37:133
166659985,2cyclictest686-21dbus-daemon10:30:373
166659985,2cyclictest27946-21idleruntime-cro07:29:463
166659985,2cyclictest21278-21ystemctl11:40:143
166659985,2cyclictest14036-21sshd10:12:323
166659985,2cyclictest14036-21sshd10:12:323
166659985,2cyclictest1-21systemd10:43:583
166659984,2cyclictest3186-21httpd11:30:223
166659983,5cyclictest0-21swapper/311:05:233
166659983,3cyclictest896-21sshd10:16:423
166659983,0cyclictest0-21swapper/309:11:143
166659983,0cyclictest0-21swapper/309:11:143
166659981,6cyclictest13829-21sshd12:00:143
166659981,3cyclictest686-21dbus-daemon11:10:243
166659980,0cyclictest0-21swapper/310:06:063
166579988,0cyclictest0-21swapper/207:14:082
166579988,0cyclictest0-21swapper/207:14:082
166579987,1cyclictest33-21ksoftirqd/212:36:442
166579987,1cyclictest33-21ksoftirqd/210:40:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional