You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 06:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sat Jan 03, 2026 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33488852550,2sleep4631rcuc/422:08:524
298835625039,8sleep40-21swapper/419:05:524
2988856994943,5cyclictest3099092-21latency_hist20:03:347
298849224333,7sleep60-21swapper/619:07:476
2988856994236,5cyclictest650-21systemd-journal23:03:337
29884662405,30sleep70-21swapper/719:07:247
298839623827,7sleep50-21swapper/519:06:265
2988852993634,2cyclictest2915730-21kworker/u16:4+flush-8:021:43:496
2988856993529,5cyclictest3166984-21latency_hist20:38:347
2988856993230,1cyclictest3458292-21latency_hist23:08:337
2988856993226,5cyclictest3157276-21latency_hist20:33:357
2988850993129,2cyclictest3564595-21kworker/u16:2+flush-8:000:13:285
298885699300,28cyclictest902-21dbus-daemon19:13:347
2988850992826,2cyclictest3167369-21kworker/u16:0+events_unbound21:08:355
2988850992826,2cyclictest2998438-21kworker/u16:3+events_unbound19:59:265
2988850992725,2cyclictest3564595-21kworker/u16:2+events_unbound00:19:255
2988850992725,2cyclictest3292126-21kworker/u16:0+events_unbound22:25:255
2988850992725,2cyclictest3292126-21kworker/u16:0+events_unbound22:25:255
2988850992725,2cyclictest2940988-21kworker/u16:2+events_unbound19:25:455
2988856992624,1cyclictest0-21swapper/722:08:497
2988852992624,2cyclictest3613716-21kworker/u16:0+flush-8:000:33:576
2988850992624,2cyclictest3167369-21kworker/u16:0+flush-8:021:20:135
2988850992523,2cyclictest3409727-21kworker/u16:0+events_unbound22:45:295
2988850992523,2cyclictest2998438-21kworker/u16:3+events_unbound19:47:465
2988850992523,2cyclictest2915730-21kworker/u16:4+events_unbound20:04:465
2988850992422,2cyclictest3574871-21kworker/u16:0+events_unbound00:16:505
2988850992422,2cyclictest3380661-21kworker/u16:1+events_unbound22:37:455
2988850992422,2cyclictest3312700-21kworker/u16:3+events_unbound22:10:455
2988850992422,2cyclictest3312700-21kworker/u16:3+events_unbound21:56:145
2988850992422,2cyclictest3108970-21kworker/u16:1+events_unbound20:15:455
2988850992422,2cyclictest2940988-21kworker/u16:2+events_unbound19:28:585
2988850992422,2cyclictest2915730-21kworker/u16:4+events_unbound19:19:475
2988850992421,2cyclictest3466774-21kworker/u16:4+flush-8:023:48:385
2988850992421,2cyclictest3292126-21kworker/u16:0+events_unbound22:28:365
2988852992321,2cyclictest3380661-21kworker/u16:1+events_unbound23:34:536
2988852992320,2cyclictest2998438-21kworker/u16:3+flush-8:019:48:356
2988850992321,2cyclictest3439210-21kworker/u16:3+events_unbound23:15:345
2988850992321,2cyclictest3439210-21kworker/u16:3+events_unbound23:15:345
2988850992321,2cyclictest3428817-21kworker/u16:2+events_unbound22:57:455
2988850992321,2cyclictest3331647-21kworker/u16:6+events_unbound21:59:355
2988850992321,2cyclictest3311731-21kworker/u16:2+flush-8:022:04:095
2988850992321,2cyclictest3141912-21kworker/u16:2+events_unbound20:53:305
2988850992321,2cyclictest3141912-21kworker/u16:2+events_unbound20:53:305
2988850992320,2cyclictest3292126-21kworker/u16:0+flush-8:021:44:055
2988850992320,2cyclictest2915730-21kworker/u16:4+flush-8:021:48:445
2988852992220,2cyclictest3380662-21kworker/u16:3+events_unbound22:48:346
2988852992220,2cyclictest2915730-21kworker/u16:4+events_unbound21:38:346
2988850992220,2cyclictest3589882-21kworker/u16:3+events_unbound00:28:185
2988850992220,2cyclictest3564595-21kworker/u16:2+events_unbound00:06:465
2988850992220,2cyclictest3564595-21kworker/u16:2+events_unbound00:00:455
2988850992220,2cyclictest3380661-21kworker/u16:1+events_unbound23:07:265
2988850992220,2cyclictest3108970-21kworker/u16:1+flush-8:020:35:105
2988850992220,2cyclictest2940988-21kworker/u16:2+events_unbound19:09:595
2988850992220,2cyclictest2915730-21kworker/u16:4+events_unbound21:27:185
2988856992116,4cyclictest650-21systemd-journal19:33:297
298885699210,19cyclictest3215512-21basename21:03:347
2988852992119,2cyclictest3380662-21kworker/u16:3+flush-8:022:28:496
2988852992118,2cyclictest3263993-21kworker/u16:1+events_unbound21:53:416
2988850992119,2cyclictest3613716-21kworker/u16:0+events_unbound00:32:305
2988850992119,2cyclictest3380661-21kworker/u16:1+events_unbound23:10:295
2988850992119,2cyclictest3264148-21kworker/u16:2+events_unbound21:32:455
2988850992119,2cyclictest3108970-21kworker/u16:1+flush-8:020:24:455
2988850992119,2cyclictest2940988-21kworker/u16:2+events_unbound19:55:065
2988850992119,2cyclictest2940988-21kworker/u16:2+events_unbound19:36:265
2988856992014,5cyclictest3283477-21latency_hist21:38:347
2988852992018,2cyclictest3613716-21kworker/u16:0+flush-8:000:33:296
2988852992018,2cyclictest3360870-21kworker/u16:1+events_unbound22:16:376
2988852992018,2cyclictest3245052-21kworker/u16:3+events_unbound21:24:096
2988852992018,2cyclictest3141912-21kworker/u16:2+events_unbound20:44:266
2988852992018,2cyclictest2915730-21kworker/u16:4+events_unbound19:17:256
2988852992018,2cyclictest2915730-21kworker/u16:4+events_unbound19:17:256
2988850992018,2cyclictest3108970-21kworker/u16:1+events_unbound21:15:155
2988850992018,2cyclictest2915730-21kworker/u16:4+events_unbound19:16:595
2988850992018,2cyclictest2915730-21kworker/u16:4+events_unbound19:16:595
30615672190,1sleep70-21swapper/719:43:537
298885699190,17cyclictest3400026-21latency_hist22:38:347
2988852991917,2cyclictest3292126-21kworker/u16:0+flush-8:022:23:496
2988852991917,2cyclictest3292126-21kworker/u16:0+flush-8:022:23:496
2988852991917,2cyclictest3264148-21kworker/u16:2+events_unbound21:39:216
2988852991917,2cyclictest3167369-21kworker/u16:0+events_unbound21:06:456
2988852991917,2cyclictest2998438-21kworker/u16:3+flush-8:019:39:016
2988850991917,2cyclictest3409727-21kworker/u16:0+events_unbound22:49:155
2988850991917,2cyclictest3380661-21kworker/u16:1+events_unbound23:40:295
2988850991917,2cyclictest3331647-21kworker/u16:6+events_unbound22:18:155
2988850991917,2cyclictest3167369-21kworker/u16:0+flush-8:021:00:255
2988856991817,0cyclictest0-21swapper/722:43:577
2988856991812,5cyclictest3429129-21latency_hist22:53:347
2988852991816,2cyclictest3564595-21kworker/u16:2+events_unbound00:18:536
2988852991816,2cyclictest3380661-21kworker/u16:1+flush-8:000:08:596
2988852991816,2cyclictest3167369-21kworker/u16:0+events_unbound21:18:466
2988852991816,2cyclictest3167369-21kworker/u16:0+events_unbound21:13:126
2988852991816,2cyclictest2915730-21kworker/u16:4+events_unbound20:19:416
2988850991815,2cyclictest3108970-21kworker/u16:1+events_unbound20:53:385
298885699170,1cyclictest0-21swapper/720:38:567
2988852991715,2cyclictest3564595-21kworker/u16:2+flush-8:000:03:586
2988852991715,2cyclictest3506371-21kworker/u16:2+events_unbound23:31:326
2988852991715,2cyclictest3292126-21kworker/u16:0+flush-8:022:18:596
2988852991715,2cyclictest3141912-21kworker/u16:2+events_unbound20:26:246
2988852991715,2cyclictest3108970-21kworker/u16:1+events_unbound20:16:306
2988852991715,2cyclictest2940988-21kworker/u16:2+events_unbound19:21:216
2988852991715,2cyclictest2915730-21kworker/u16:4+flush-8:021:33:336
2988852991715,2cyclictest2915730-21kworker/u16:4+events_unbound19:11:176
2988850991715,2cyclictest3439210-21kworker/u16:3+events_unbound23:22:295
2988850991715,2cyclictest3331647-21kworker/u16:6+events_unbound22:42:155
2988850991715,2cyclictest3141912-21kworker/u16:2+events_unbound20:29:065
2988850991715,2cyclictest2915730-21kworker/u16:4+events_unbound21:42:175
2988856991615,0cyclictest0-21swapper/721:08:577
2988856991613,2cyclictest1267-21snmpd20:27:237
2988856991610,5cyclictest650-21systemd-journal21:18:347
2988856991610,5cyclictest3273824-21latency_hist21:33:347
2988852991614,2cyclictest3517993-21kworker/u16:3+events_unbound23:44:246
2988852991614,2cyclictest3380661-21kworker/u16:1+flush-8:023:14:026
2988852991614,2cyclictest3380661-21kworker/u16:1+flush-8:023:14:026
2988852991614,2cyclictest3380661-21kworker/u16:1+flush-8:023:05:046
2988852991614,2cyclictest3380661-21kworker/u16:1+events_unbound22:39:136
2988852991614,2cyclictest3331647-21kworker/u16:6+events_unbound21:59:126
2988852991614,2cyclictest3292126-21kworker/u16:0+events_unbound22:06:256
2988852991614,2cyclictest3089401-21kworker/u16:0+flush-8:020:03:546
2988852991614,2cyclictest2940988-21kworker/u16:2+flush-8:019:44:116
2988852991614,2cyclictest2940988-21kworker/u16:2+events_unbound19:57:566
2988850991614,2cyclictest3466774-21kworker/u16:4+events_unbound23:46:295
2988850991614,2cyclictest3380661-21kworker/u16:1+events_unbound23:36:455
2988850991614,2cyclictest3331647-21kworker/u16:6+flush-8:022:19:335
2988850991614,2cyclictest3264148-21kworker/u16:2+flush-8:021:33:565
2988850991613,2cyclictest3613716-21kworker/u16:0+events_unbound00:33:355
2988856991514,0cyclictest0-21swapper/723:38:487
2988856991514,0cyclictest0-21swapper/723:23:537
298885699150,14cyclictest902-21dbus-daemon20:23:347
2988852991513,2cyclictest3564595-21kworker/u16:2+flush-8:023:59:596
2988852991513,2cyclictest3466774-21kworker/u16:4+flush-8:023:58:336
2988852991513,2cyclictest3409727-21kworker/u16:0+events_unbound23:00:246
2988852991513,2cyclictest3380661-21kworker/u16:1+events_unbound22:34:406
2988852991513,2cyclictest3108970-21kworker/u16:1+flush-8:020:39:056
2988852991513,2cyclictest3108970-21kworker/u16:1+events_unbound20:32:256
2988852991512,2cyclictest3108970-21kworker/u16:1+flush-8:020:53:396
2988852991512,2cyclictest3108970-21kworker/u16:1+events_unbound20:48:446
2988852991512,2cyclictest3108970-21kworker/u16:1+events_unbound20:48:446
2988850991513,2cyclictest3466774-21kworker/u16:4+events_unbound23:26:375
2988850991513,2cyclictest3167369-21kworker/u16:0+events_unbound21:07:185
298885699149,4cyclictest3225201-21latency_hist21:08:347
298885699148,5cyclictest1060-21runrttasks19:23:567
2988856991411,2cyclictest3614779-21perl00:28:527
298885699141,11cyclictest0-21swapper/719:53:487
2988856991410,3cyclictest1267-21snmpd22:41:567
298885699140,1cyclictest0-21swapper/721:53:567
298885699140,13cyclictest0-21swapper/723:43:577
2988852991413,1cyclictest0-21swapper/623:19:026
2988852991412,2cyclictest3380661-21kworker/u16:1+flush-8:023:08:576
2988852991412,2cyclictest3380661-21kworker/u16:1+events_unbound00:18:286
2988852991412,2cyclictest3108970-21kworker/u16:1+events_unbound21:00:536
2988852991412,2cyclictest3108970-21kworker/u16:1+events_unbound20:38:116
2988852991412,2cyclictest3042183-21kworker/u16:0+events_unbound19:35:256
298885299140,1cyclictest0-21swapper/619:58:496
2988850991412,2cyclictest3108970-21kworker/u16:1+events_unbound20:21:155
2988850991411,2cyclictest3042183-21kworker/u16:0+flush-8:019:38:355
2988847991411,3cyclictest3089401-21kworker/u16:0+flush-8:020:03:484
298885699139,3cyclictest3005986-21kthreadcore19:13:547
298885699139,3cyclictest3005986-21kthreadcore19:13:547
298885699139,3cyclictest1267-21snmpd22:19:207
298885699139,3cyclictest1267-21snmpd22:06:287
298885699139,3cyclictest1267-21snmpd19:18:577
298885699139,3cyclictest1267-21snmpd00:24:237
298885699137,5cyclictest6184-21gvfs-afc-volume22:23:587
298885699137,5cyclictest6184-21gvfs-afc-volume22:23:587
298885699135,7cyclictest0-21swapper/723:54:147
2988856991311,1cyclictest0-21swapper/719:38:587
2988856991310,2cyclictest0-21swapper/720:53:347
298885699130,12cyclictest0-21swapper/700:33:577
2988852991311,2cyclictest3409727-21kworker/u16:0+flush-8:022:58:296
2988852991311,2cyclictest3331647-21kworker/u16:6+events_unbound22:10:086
2988852991311,2cyclictest3108970-21kworker/u16:1+flush-8:020:10:356
2988852991311,2cyclictest3108970-21kworker/u16:1+events_unbound21:15:176
2988852991311,2cyclictest2998438-21kworker/u16:3+flush-8:019:29:196
2988852991311,2cyclictest2940988-21kworker/u16:2+events_unbound19:27:526
2988852991310,2cyclictest3466774-21kworker/u16:4+flush-8:023:48:536
2988852991310,2cyclictest3380662-21kworker/u16:3+flush-8:022:49:016
2988850991311,2cyclictest3517993-21kworker/u16:3+events_unbound23:55:155
2988850991311,2cyclictest3487706-21kworker/u16:0+events_unbound23:31:445
2988850991311,2cyclictest3409727-21kworker/u16:0+events_unbound22:59:215
2988850991311,2cyclictest3108970-21kworker/u16:1+events_unbound20:40:125
2988847991310,2cyclictest3589882-21kworker/u16:3+flush-8:000:18:594
2988847991310,2cyclictest3487706-21kworker/u16:0+flush-8:023:33:594
298885699129,2cyclictest1267-21snmpd21:41:197
298885699129,2cyclictest0-21swapper/722:53:347
298885699128,3cyclictest3194436-21cut20:48:567
298885699128,3cyclictest3194436-21cut20:48:567
298885699128,3cyclictest3118886-21/usr/sbin/munin20:14:057
298885699128,3cyclictest1267-21snmpd23:34:077
298885699128,3cyclictest1267-21snmpd22:28:417
298885699128,3cyclictest1267-21snmpd21:24:547
298885699128,3cyclictest1267-21snmpd00:10:117
298885699127,4cyclictest3574974-21latency_hist00:08:347
298885699127,4cyclictest1267-21snmpd20:04:107
298885699125,6cyclictest6045-21gmain23:18:527
298885699125,5cyclictest5656-21ssh-agent23:08:457
298885699124,7cyclictest6045-21gmain21:58:497
298885699120,3cyclictest3584882-21/usr/sbin/munin00:13:587
298885699120,11cyclictest0-21swapper/720:09:007
2988852991210,2cyclictest3380661-21kworker/u16:1+events_unbound23:42:406
2988850991210,2cyclictest2915730-21kworker/u16:4+events_unbound19:49:045
298884799129,2cyclictest3439210-21kworker/u16:3+flush-8:022:59:004
2988847991211,1cyclictest0-21swapper/419:13:154
298884799120,1cyclictest0-21swapper/400:15:294
298884799120,11cyclictest0-21swapper/420:13:484
298885699118,2cyclictest1267-21snmpd23:32:107
298885699118,2cyclictest1267-21snmpd21:43:587
298885699117,3cyclictest1267-21snmpd22:13:477
298885699117,3cyclictest1267-21snmpd21:21:517
298885699116,4cyclictest6184-21gvfs-afc-volume23:13:537
298885699116,4cyclictest6184-21gvfs-afc-volume23:13:537
298885699110,2cyclictest3303247-21/usr/sbin/munin21:48:587
298885699110,2cyclictest0-21swapper/700:18:597
298885699110,10cyclictest1267-21snmpd20:45:117
298885299119,2cyclictest3589882-21kworker/u16:3+events_unbound00:25:326
298885299119,2cyclictest3466774-21kworker/u16:4+events_unbound23:25:446
298885099119,2cyclictest3141912-21kworker/u16:2+events_unbound20:47:225
298884799117,3cyclictest3517561-21cat23:38:474
298884799117,3cyclictest3466774-21kworker/u16:4+flush-8:023:53:594
298884799117,3cyclictest3380661-21kworker/u16:1+flush-8:022:34:334
298884799117,3cyclictest3284661-21cat21:38:474
2988847991110,1cyclictest0-21swapper/423:19:594
2988847991110,1cyclictest0-21swapper/423:14:094
2988847991110,1cyclictest0-21swapper/423:14:094
2988847991110,1cyclictest0-21swapper/422:51:274
2988847991110,1cyclictest0-21swapper/420:24:594
2988847991110,1cyclictest0-21swapper/419:37:044
2988847991110,1cyclictest0-21swapper/419:16:254
2988847991110,1cyclictest0-21swapper/419:16:254
2988847991110,1cyclictest0-21swapper/400:09:294
298884799110,1cyclictest0-21swapper/420:48:104
298884799110,1cyclictest0-21swapper/420:01:494
298884799110,1cyclictest0-21swapper/400:00:214
298884799110,11cyclictest0-21swapper/423:26:084
298884799110,11cyclictest0-21swapper/422:54:174
298884799110,11cyclictest0-21swapper/422:32:134
298884799110,11cyclictest0-21swapper/422:16:184
298884799110,11cyclictest0-21swapper/422:08:254
298884799110,11cyclictest0-21swapper/421:52:204
298884799110,11cyclictest0-21swapper/421:32:474
298884799110,11cyclictest0-21swapper/421:00:474
298884799110,11cyclictest0-21swapper/420:56:034
298884799110,11cyclictest0-21swapper/420:35:054
298884799110,11cyclictest0-21swapper/400:35:584
298884799110,11cyclictest0-21swapper/400:33:084
298884799110,11cyclictest0-21swapper/400:27:184
298885699107,2cyclictest3537211-21irqcore23:48:507
298885699106,3cyclictest1267-21snmpd19:48:407
298885699106,3cyclictest1267-21snmpd19:35:247
298885699101,8cyclictest0-21swapper/723:59:037
298885299108,2cyclictest3292126-21kworker/u16:0+flush-8:021:49:256
298885099108,2cyclictest3108970-21kworker/u16:1+events_unbound20:10:505
298884799109,1cyclictest0-21swapper/422:26:514
298884799109,1cyclictest0-21swapper/422:26:514
298884799109,1cyclictest0-21swapper/422:03:034
298884799109,1cyclictest0-21swapper/421:25:134
298884799109,1cyclictest0-21swapper/421:12:554
298884799109,1cyclictest0-21swapper/421:08:024
298884799109,1cyclictest0-21swapper/420:32:334
298884799109,1cyclictest0-21swapper/420:19:574
298884799109,1cyclictest0-21swapper/419:55:494
298884799109,1cyclictest0-21swapper/419:52:594
298884799109,1cyclictest0-21swapper/419:40:324
298884799109,1cyclictest0-21swapper/419:29:584
298884799109,1cyclictest0-21swapper/400:06:304
298884799107,2cyclictest3173273-21kthreadcore20:38:524
298884799106,3cyclictest3274993-21cat21:33:494
298884799105,3cyclictest3466555-21kthreadcore23:08:534
29888479998,1cyclictest0-21swapper/420:50:414
29888479998,1cyclictest0-21swapper/420:50:414
29888479996,2cyclictest3069086-21ntpq19:44:004
29888479994,4cyclictest3544484-21ntpq23:48:564
29888479987,1cyclictest0-21swapper/421:15:174
29888479986,1cyclictest0-21swapper/419:19:054
29888479985,2cyclictest0-21swapper/423:03:514
29888479985,2cyclictest0-21swapper/419:23:514
29888479984,3cyclictest3416127-21kthreadcore22:43:534
29888479984,3cyclictest3406802-21kthreadcore22:38:544
29888479984,3cyclictest3362204-21tune2fs22:18:494
29888479984,3cyclictest3112593-21cut20:08:544
29888479983,4cyclictest3533833-21grep23:43:554
29888479983,4cyclictest3503459-21cut23:28:544
29888479983,4cyclictest3294769-21kthreadcore21:43:524
29888479980,1cyclictest0-21swapper/421:53:514
29888479973,3cyclictest3246314-21grep21:18:514
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional