You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-06 - 21:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Tue Jan 06, 2026 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71721925644,8sleep40-21swapper/407:03:284
72631625319,30sleep70-21swapper/707:05:557
72618124434,7sleep50-21swapper/507:04:015
726783993836,2cyclictest759737-21kworker/u16:1+events_unbound07:53:215
726783993836,2cyclictest759737-21kworker/u16:1+events_unbound07:53:215
726786993732,4cyclictest827310-21latency_hist07:58:207
726786993732,4cyclictest827310-21latency_hist07:58:207
726783993634,2cyclictest1089246-21kworker/u16:4+events_unbound11:08:335
72634523626,7sleep60-21swapper/607:06:196
726783993533,2cyclictest1156781-21kworker/u16:0+flush-8:011:38:455
726783993432,2cyclictest1205320-21kworker/u16:1+events_unbound12:08:345
726786993327,5cyclictest650-21systemd-journal09:43:207
726783993331,2cyclictest1089246-21kworker/u16:4+events_unbound11:31:175
726786993125,5cyclictest817576-21latency_hist07:53:207
726783993129,2cyclictest828916-21kworker/u16:5+events_unbound08:22:185
726783993129,2cyclictest759737-21kworker/u16:1+events_unbound07:48:185
726775993129,2cyclictest1089246-21kworker/u16:4+flush-8:010:18:454
12465172310,0chrt0-21swapper/411:33:374
726783993028,2cyclictest1156781-21kworker/u16:0+events_unbound10:53:185
726786992923,5cyclictest1050054-21latency_hist09:53:207
726783992927,2cyclictest17840-21kworker/u16:3+events_unbound07:08:475
726783992927,2cyclictest1263539-21kworker/u16:2+events_unbound11:51:305
726775992927,2cyclictest759737-21kworker/u16:1+events_unbound07:58:164
726775992927,2cyclictest759737-21kworker/u16:1+events_unbound07:58:164
726783992826,2cyclictest933564-21kworker/u16:3+flush-8:008:53:205
726783992826,2cyclictest904974-21kworker/u16:1+events_unbound09:33:015
726783992826,2cyclictest904974-21kworker/u16:1+events_unbound09:33:015
726783992826,2cyclictest1340221-21kworker/u16:0+events_unbound12:27:305
726783992826,2cyclictest1213817-21kworker/u16:3+flush-8:012:18:485
726783992826,2cyclictest1205320-21kworker/u16:1+events_unbound12:28:305
726783992826,2cyclictest1205320-21kworker/u16:1+events_unbound11:33:325
726783992826,2cyclictest1137283-21kworker/u16:1+events_unbound11:00:185
726783992725,2cyclictest876192-21kworker/u16:3+flush-8:008:34:415
726783992725,2cyclictest828916-21kworker/u16:5+events_unbound08:02:185
726783992725,2cyclictest1205320-21kworker/u16:1+events_unbound12:13:355
726783992725,2cyclictest1029880-21kworker/u16:0+events_unbound09:49:305
726775992725,2cyclictest1205320-21kworker/u16:1+flush-8:011:18:354
726783992624,2cyclictest17840-21kworker/u16:3+events_unbound07:37:155
726775992624,2cyclictest672510-21kworker/u16:2+flush-8:007:38:324
726783992523,2cyclictest933564-21kworker/u16:3+events_unbound10:36:305
726783992523,2cyclictest856489-21kworker/u16:1+events_unbound08:29:265
726783992523,2cyclictest828916-21kworker/u16:5+events_unbound08:10:255
726783992523,2cyclictest759737-21kworker/u16:1+flush-8:007:41:475
726783992523,2cyclictest672510-21kworker/u16:2+events_unbound07:33:195
726783992523,2cyclictest1282866-21kworker/u16:0+events_unbound11:53:435
726783992523,2cyclictest1282866-21kworker/u16:0+events_unbound11:53:435
726783992523,2cyclictest1137283-21kworker/u16:1+events_unbound10:54:505
726783992422,2cyclictest933564-21kworker/u16:3+events_unbound09:37:035
726783992422,2cyclictest904974-21kworker/u16:1+events_unbound09:41:585
726783992422,2cyclictest1089246-21kworker/u16:4+flush-8:011:23:405
726783992422,2cyclictest1029880-21kworker/u16:0+events_unbound10:17:095
726775992422,2cyclictest973037-21kworker/u16:4+flush-8:009:53:464
726775992422,2cyclictest828916-21kworker/u16:5+flush-8:008:13:154
726786992316,5cyclictest933895-21latency_hist08:53:207
726783992321,2cyclictest904974-21kworker/u16:1+flush-8:009:14:175
726783992321,2cyclictest1340221-21kworker/u16:0+flush-8:012:33:485
726783992321,2cyclictest1282866-21kworker/u16:0+flush-8:012:03:445
726775992321,2cyclictest933564-21kworker/u16:3+flush-8:010:28:444
726775992321,2cyclictest904974-21kworker/u16:1+flush-8:008:43:344
726775992321,2cyclictest17840-21kworker/u16:3+flush-8:007:13:224
726783992221,1cyclictest759737-21kworker/u16:1+events_unbound07:52:185
726783992220,2cyclictest933564-21kworker/u16:3+flush-8:009:10:425
726783992220,2cyclictest933564-21kworker/u16:3+events_unbound09:59:125
726783992220,2cyclictest17840-21kworker/u16:3+events_unbound07:21:145
726783992220,2cyclictest1282866-21kworker/u16:0+events_unbound12:03:165
726783992220,2cyclictest1263539-21kworker/u16:2+events_unbound11:44:585
726783992220,2cyclictest1205320-21kworker/u16:1+events_unbound11:21:385
726783992220,2cyclictest1089246-21kworker/u16:4+flush-8:010:22:225
726775992220,2cyclictest973037-21kworker/u16:4+events_unbound09:43:344
726775992220,2cyclictest876192-21kworker/u16:3+flush-8:008:33:424
726783992119,2cyclictest904974-21kworker/u16:1+flush-8:009:18:535
726783992119,2cyclictest904974-21kworker/u16:1+events_unbound09:07:315
726783992119,2cyclictest856489-21kworker/u16:1+events_unbound08:24:415
726783992119,2cyclictest828916-21kworker/u16:5+flush-8:008:06:225
726783992119,2cyclictest759737-21kworker/u16:1+events_unbound07:24:275
726783992119,2cyclictest672510-21kworker/u16:2+flush-8:008:38:275
726783992119,2cyclictest1029880-21kworker/u16:0+events_unbound10:28:545
726775992119,2cyclictest904974-21kworker/u16:1+flush-8:008:48:454
726775992119,2cyclictest672510-21kworker/u16:2+flush-8:007:43:434
726786992019,0cyclictest0-21swapper/709:08:347
726786992014,5cyclictest856454-21latency_hist08:13:217
726786992014,5cyclictest1156583-21latency_hist10:48:207
726783992018,2cyclictest933564-21kworker/u16:3+flush-8:010:07:325
726783992018,2cyclictest933564-21kworker/u16:3+flush-8:008:53:435
726783992018,2cyclictest933564-21kworker/u16:3+events_unbound09:26:305
726783992018,2cyclictest933564-21kworker/u16:3+events_unbound09:02:435
726783992018,2cyclictest672510-21kworker/u16:2+events_unbound07:15:185
726783992018,2cyclictest1029880-21kworker/u16:0+events_unbound10:24:385
726775992018,2cyclictest672510-21kworker/u16:2+events_unbound07:23:344
726775992018,2cyclictest1137283-21kworker/u16:1+flush-8:010:58:334
726783991917,2cyclictest828916-21kworker/u16:5+events_unbound08:16:345
726783991917,2cyclictest1089246-21kworker/u16:4+flush-8:010:45:305
726783991917,2cyclictest1029880-21kworker/u16:0+flush-8:010:08:585
726783991917,2cyclictest1029880-21kworker/u16:0+events_unbound09:55:175
726775991917,2cyclictest856489-21kworker/u16:1+flush-8:008:28:384
726775991917,2cyclictest17840-21kworker/u16:3+flush-8:007:18:304
726775991917,2cyclictest1089246-21kworker/u16:4+flush-8:011:08:274
726775991917,2cyclictest1029880-21kworker/u16:0+events_unbound09:48:474
726784991815,2cyclictest672510-21kworker/u16:2+events_unbound07:58:356
726783991816,2cyclictest904974-21kworker/u16:1+flush-8:008:44:305
726775991816,2cyclictest933564-21kworker/u16:3+flush-8:009:38:434
72678699170,1cyclictest0-21swapper/707:58:237
726783991715,2cyclictest973037-21kworker/u16:4+flush-8:009:45:105
726783991715,2cyclictest1137283-21kworker/u16:1+flush-8:010:39:175
726775991715,2cyclictest973037-21kworker/u16:4+flush-8:009:13:444
726775991715,2cyclictest943287-21kworker/u16:2+events_unbound08:57:524
726775991715,2cyclictest672510-21kworker/u16:2+flush-8:008:23:414
726775991715,2cyclictest1137283-21kworker/u16:1+events_unbound10:38:334
726786991614,1cyclictest0-21swapper/708:23:467
726786991613,2cyclictest1267-21snmpd10:14:547
72678699160,14cyclictest0-21swapper/709:58:447
726783991614,2cyclictest1089246-21kworker/u16:4+events_unbound11:14:385
726775991614,2cyclictest904974-21kworker/u16:1+events_unbound09:11:194
726775991614,2cyclictest1205320-21kworker/u16:1+events_unbound12:11:174
726775991611,2cyclictest1205320-21kworker/u16:1+events_unbound12:13:494
72678699154,9cyclictest727285-21ls07:08:337
726786991511,3cyclictest1267-21snmpd12:34:037
726786991510,4cyclictest1079167-21latency_hist10:08:207
72678699150,13cyclictest1333831-21grep12:18:387
72678699150,13cyclictest1175920-21turbostat10:58:197
72678699150,13cyclictest0-21swapper/710:38:447
726783991513,2cyclictest1089246-21kworker/u16:4+events_unbound11:05:115
726783991513,2cyclictest1089246-21kworker/u16:4+events_unbound11:05:115
726775991513,2cyclictest904974-21kworker/u16:1+flush-8:009:03:424
726775991513,2cyclictest904974-21kworker/u16:1+flush-8:009:02:304
726775991513,2cyclictest672510-21kworker/u16:2+flush-8:008:13:414
726775991513,2cyclictest1213817-21kworker/u16:3+flush-8:012:33:374
726775991513,2cyclictest1205320-21kworker/u16:1+flush-8:011:23:414
72678699146,7cyclictest0-21swapper/707:19:117
726786991412,1cyclictest0-21swapper/708:13:447
726786991411,2cyclictest1267-21snmpd10:58:227
726786991411,2cyclictest1223422-21ntpq11:18:457
726786991411,2cyclictest0-21swapper/712:28:457
726784991410,3cyclictest1029880-21kworker/u16:0+flush-8:010:08:456
72678499140,14cyclictest0-21swapper/609:28:426
72678499140,14cyclictest0-21swapper/609:28:426
726775991412,2cyclictest904974-21kworker/u16:1+flush-8:008:41:314
726775991412,2cyclictest904974-21kworker/u16:1+events_unbound09:18:454
726775991412,2cyclictest1205320-21kworker/u16:1+events_unbound11:47:304
726775991412,2cyclictest1089246-21kworker/u16:4+flush-8:011:18:154
726775991412,2cyclictest1089246-21kworker/u16:4+flush-8:010:13:354
726775991411,2cyclictest933564-21kworker/u16:3+flush-8:009:23:304
72678699139,3cyclictest1267-21snmpd12:15:447
72678699139,3cyclictest1267-21snmpd12:10:177
72678699139,3cyclictest1267-21snmpd11:59:147
72678699139,3cyclictest1267-21snmpd10:27:547
72678699139,3cyclictest1267-21snmpd08:42:527
72678699139,3cyclictest1267-21snmpd08:04:347
72678699139,3cyclictest1213736-21ntpq11:13:437
72678699138,4cyclictest1341710-21cat12:23:357
72678699137,5cyclictest943563-21latency_hist08:58:207
726786991310,2cyclictest1291210-21ntpq11:53:477
726786991310,2cyclictest1291210-21ntpq11:53:477
726786991310,2cyclictest1281562-21ntp_states11:48:457
72678699130,4cyclictest787093-21kthreadcore07:33:427
72678699130,12cyclictest1267-21snmpd08:30:407
72678699130,12cyclictest1127615-21turbostat10:33:207
72678499139,3cyclictest672510-21kworker/u16:2+flush-8:008:38:516
72678499130,13cyclictest0-21swapper/609:03:486
726775991312,1cyclictest0-21swapper/410:48:484
726775991312,1cyclictest0-21swapper/409:33:364
726775991311,2cyclictest788986-21kworker/u16:0+flush-8:008:03:424
726775991311,2cyclictest672510-21kworker/u16:2+flush-8:007:58:314
726775991311,2cyclictest17840-21kworker/u16:3+flush-8:007:08:514
72677599130,13cyclictest0-21swapper/407:48:364
72678699129,2cyclictest1267-21snmpd08:22:467
72678699129,2cyclictest0-21swapper/711:33:207
72678699128,4cyclictest6184-21gvfs-afc-volume10:18:437
72678699128,3cyclictest1267-21snmpd09:47:577
72678699128,3cyclictest1267-21snmpd09:32:417
72678699128,3cyclictest1267-21snmpd09:32:417
72678699128,3cyclictest1267-21snmpd09:26:297
72678699128,3cyclictest1267-21snmpd09:22:297
72678699128,3cyclictest1267-21snmpd09:03:267
72678699128,3cyclictest1267-21snmpd07:16:217
72678699128,3cyclictest1128003-21/usr/sbin/munin10:33:467
72678699127,4cyclictest6184-21gvfs-afc-volume07:43:407
72678699127,4cyclictest1262237-21ntp_states11:38:477
72678699127,4cyclictest1235252-21cat11:28:357
72678699126,5cyclictest1059768-21latency_hist09:58:217
72678699125,6cyclictest1166273-21latency_hist10:53:197
72678699120,5cyclictest1302536-21cstates12:03:327
72678699120,4cyclictest1190237-21kthreadcore11:03:387
72678699120,4cyclictest1190237-21kthreadcore11:03:387
72678699120,3cyclictest1203488-21kthreadcore11:08:417
72678699120,11cyclictest1269349-21kthreadcore11:43:397
72678699120,10cyclictest0-21swapper/709:13:457
72678699120,10cyclictest0-21swapper/708:33:447
726784991211,1cyclictest0-21swapper/610:23:156
726784991211,1cyclictest0-21swapper/609:58:396
726784991211,1cyclictest0-21swapper/608:18:426
726784991210,2cyclictest1213817-21kworker/u16:3+flush-8:011:23:466
72678499120,1cyclictest0-21swapper/608:56:516
72678499120,1cyclictest0-21swapper/607:58:186
72678499120,1cyclictest0-21swapper/607:58:186
72678499120,11cyclictest0-21swapper/612:29:226
72678499120,11cyclictest0-21swapper/611:53:266
72678499120,11cyclictest0-21swapper/611:53:266
72678499120,11cyclictest0-21swapper/611:12:266
726775991211,1cyclictest0-21swapper/407:32:414
726775991210,2cyclictest672510-21kworker/u16:2+flush-8:007:33:364
726775991210,2cyclictest1340221-21kworker/u16:0+flush-8:012:28:414
726775991210,2cyclictest1321145-21kworker/u16:2+events_unbound12:18:304
726775991210,2cyclictest1282866-21kworker/u16:0+events_unbound11:54:164
726775991210,2cyclictest1282866-21kworker/u16:0+events_unbound11:54:164
726775991210,2cyclictest1205320-21kworker/u16:1+events_unbound11:59:254
726775991210,2cyclictest1185651-21kworker/u16:2+events_unbound11:07:184
726775991210,2cyclictest1185651-21kworker/u16:2+events_unbound11:07:184
726775991210,2cyclictest1137283-21kworker/u16:1+flush-8:010:57:164
72677599120,1cyclictest0-21swapper/410:12:134
72678699118,2cyclictest1233109-21ntpq11:23:467
72678699118,2cyclictest1011777-21/usr/sbin/munin09:33:457
72678699117,3cyclictest1267-21snmpd07:29:007
726784991110,1cyclictest0-21swapper/612:16:176
726784991110,1cyclictest0-21swapper/611:44:176
726784991110,1cyclictest0-21swapper/611:16:516
726784991110,1cyclictest0-21swapper/610:59:596
726784991110,1cyclictest0-21swapper/610:06:516
726784991110,1cyclictest0-21swapper/609:43:416
726784991110,1cyclictest0-21swapper/608:32:446
726784991110,1cyclictest0-21swapper/608:25:386
726784991110,1cyclictest0-21swapper/607:38:496
726784991110,1cyclictest0-21swapper/607:31:066
72678499110,11cyclictest0-21swapper/612:11:436
72678499110,11cyclictest0-21swapper/611:04:056
72678499110,11cyclictest0-21swapper/611:04:056
72678499110,11cyclictest0-21swapper/609:55:026
72678499110,11cyclictest0-21swapper/607:16:166
72677599119,2cyclictest933564-21kworker/u16:3+flush-8:010:03:454
72677599119,2cyclictest1213817-21kworker/u16:3+events_unbound11:28:384
72677599119,2cyclictest1156781-21kworker/u16:0+flush-8:011:38:404
72677599119,2cyclictest1089246-21kworker/u16:4+events_unbound10:43:264
72677599110,1cyclictest0-21swapper/411:50:174
72677599110,11cyclictest0-21swapper/412:26:334
72677599110,11cyclictest0-21swapper/410:24:124
72677599110,11cyclictest0-21swapper/409:59:554
72678699107,2cyclictest0-21swapper/707:38:417
72678699106,3cyclictest1267-21snmpd08:58:357
72678699106,3cyclictest1267-21snmpd08:43:557
72678699105,4cyclictest760446-21seq07:23:347
72678499109,1cyclictest0-21swapper/612:02:256
72678499109,1cyclictest0-21swapper/611:30:256
72678499109,1cyclictest0-21swapper/610:43:266
72678499109,1cyclictest0-21swapper/609:36:166
72678499109,1cyclictest0-21swapper/609:24:556
72678499109,1cyclictest0-21swapper/609:21:276
72678499109,1cyclictest0-21swapper/609:14:216
72678499109,1cyclictest0-21swapper/609:10:536
72678499109,1cyclictest0-21swapper/608:46:186
72678499109,1cyclictest0-21swapper/608:08:376
72678499107,2cyclictest672510-21kworker/u16:2+flush-8:007:43:256
72678499100,10cyclictest0-21swapper/611:21:256
72678499100,0cyclictest0-21swapper/608:05:286
72677599109,1cyclictest0-21swapper/410:36:214
72677599108,2cyclictest1205320-21kworker/u16:1+flush-8:012:03:414
7267869992,5cyclictest1083568-21grep10:08:397
7267849998,1cyclictest0-21swapper/612:33:286
7267849998,1cyclictest0-21swapper/612:06:596
7267849998,1cyclictest0-21swapper/611:39:436
7267849998,1cyclictest0-21swapper/610:55:536
7267849998,1cyclictest0-21swapper/609:51:156
7267849998,1cyclictest0-21swapper/607:51:076
7267849998,1cyclictest0-21swapper/607:34:536
7267849998,1cyclictest0-21swapper/607:27:196
7267849998,1cyclictest0-21swapper/607:19:456
7267849998,1cyclictest0-21swapper/607:09:116
7267849996,2cyclictest1112325-21kthreadcore10:23:386
7267849994,4cyclictest1157753-21cat10:48:356
7267759995,3cyclictest1002883-21interrupts09:28:344
7267759995,3cyclictest1002883-21interrupts09:28:344
7267849987,1cyclictest0-21swapper/610:39:106
7267849987,1cyclictest0-21swapper/610:14:546
7267849987,1cyclictest0-21swapper/609:39:546
7267849987,1cyclictest0-21swapper/609:00:106
7267849983,1cyclictest8646612cut08:13:416
7267849980,3cyclictest8959682cat08:33:326
7267849976,1cyclictest0-21swapper/612:25:076
7267849976,1cyclictest0-21swapper/611:48:426
7267849974,2cyclictest924898-21cstates08:48:336
7267849973,3cyclictest1128092-21cat10:33:326
7267849973,3cyclictest1118634-21expr10:28:326
7267759973,3cyclictest866959-21cat08:18:334
7267849965,1cyclictest0-21swapper/612:20:426
7267849950,4cyclictest1244257-21chrt11:33:316
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional