You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 20:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Mar 13, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1060021050,1sleep710602-21cut09:04:157
2601932950,1sleep7260194-21grep10:49:147
2865992650,1sleep7286602-21cut10:59:167
4504862640,1sleep50-21swapper/512:09:105
396208026435,8sleep40-21swapper/407:00:344
3962610995957,2cyclictest229630-21kworker/u16:1+events_unbound10:59:245
2094302570,0sleep7209432-21sed10:29:107
3962610995047,2cyclictest268317-21kworker/u16:3+events_unbound11:39:125
396210024939,7sleep60-21swapper/607:00:526
3962610994745,2cyclictest229630-21kworker/u16:1+events_unbound12:14:245
3962618994540,4cyclictest26517-21latency_hist09:13:547
3962610994442,2cyclictest99142-21kworker/u16:4+events_unbound10:24:115
3962610994442,2cyclictest253728-21kworker/u16:0+events_unbound10:54:195
3962610994341,2cyclictest229630-21kworker/u16:1+events_unbound12:00:445
3962618994237,4cyclictest4186273-21latency_hist08:58:557
3962614994240,2cyclictest268317-21kworker/u16:3+flush-8:011:48:546
3962610994239,2cyclictest388863-21kworker/u16:2+events_unbound11:54:095
3962610994239,2cyclictest388863-21kworker/u16:2+events_unbound11:54:095
3962610994139,2cyclictest229630-21kworker/u16:1+events_unbound11:09:475
3962610994139,2cyclictest229630-21kworker/u16:1+events_unbound10:36:455
3962610994138,2cyclictest268317-21kworker/u16:3+events_unbound11:04:095
3962618994035,4cyclictest436986-21latency_hist12:03:547
3962610994038,2cyclictest99142-21kworker/u16:4+events_unbound10:48:005
3962610994038,2cyclictest96601-21kworker/u16:3+events_unbound10:02:205
3962610994038,2cyclictest96601-21kworker/u16:3+events_unbound10:02:205
3962610994038,2cyclictest3962811-21kworker/u16:0+events_unbound07:14:185
3962610994038,2cyclictest145132-21kworker/u16:0+events_unbound10:05:165
39531232403,31sleep70-21swapper/706:59:007
3962610993937,2cyclictest48976-21kworker/u16:2+events_unbound09:42:045
3962610993937,2cyclictest229630-21kworker/u16:1+events_unbound12:21:365
3962610993937,2cyclictest229630-21kworker/u16:1+events_unbound11:49:275
3962610993937,2cyclictest145132-21kworker/u16:0+events_unbound10:20:155
3962610993836,2cyclictest48976-21kworker/u16:2+events_unbound09:28:335
3962610993836,2cyclictest473139-21kworker/u16:3+events_unbound12:30:125
3962610993836,2cyclictest3962811-21kworker/u16:0+events_unbound09:38:435
3962610993836,2cyclictest304453-21kworker/u16:4+events_unbound11:32:005
3962610993836,2cyclictest268317-21kworker/u16:3+events_unbound11:14:095
3962610993836,2cyclictest253728-21kworker/u16:0+events_unbound10:51:155
3962618993732,4cyclictest3995075-21latency_hist07:18:557
3962610993735,2cyclictest4119643-21kworker/u16:1+events_unbound09:17:565
3962610993735,2cyclictest4119643-21kworker/u16:1+events_unbound09:06:115
3962610993735,2cyclictest3962811-21kworker/u16:0+events_unbound07:04:185
3962610993735,2cyclictest229630-21kworker/u16:1+events_unbound12:05:525
3962610993735,2cyclictest229630-21kworker/u16:1+events_unbound12:05:525
3962610993735,2cyclictest2033-21kworker/u16:4+events_unbound09:12:045
3962610993735,2cyclictest145132-21kworker/u16:0+events_unbound10:18:005
3962610993634,2cyclictest96601-21kworker/u16:3+events_unbound09:52:165
3962610993634,2cyclictest3962811-21kworker/u16:0+events_unbound09:20:405
3962610993634,2cyclictest3962811-21kworker/u16:0+events_unbound09:20:405
3962610993634,2cyclictest304453-21kworker/u16:4+events_unbound11:20:075
3962610993634,2cyclictest229630-21kworker/u16:1+flush-8:010:41:045
3962610993634,2cyclictest229630-21kworker/u16:1+events_unbound12:25:315
3962610993634,2cyclictest229630-21kworker/u16:1+events_unbound11:38:395
3962610993634,2cyclictest145132-21kworker/u16:0+events_unbound10:09:045
3962608993633,2cyclictest145132-21kworker/u16:0+flush-8:010:23:544
3962610993533,2cyclictest48976-21kworker/u16:2+events_unbound09:48:435
3962610993533,2cyclictest48976-21kworker/u16:2+events_unbound09:29:045
3962610993533,2cyclictest304453-21kworker/u16:4+events_unbound11:47:075
3962610993432,2cyclictest96601-21kworker/u16:3+events_unbound09:56:535
3962610993432,2cyclictest147938-21kworker/u16:2+events_unbound10:31:015
396215523424,7sleep50-21swapper/507:01:395
4460852330,0sleep7446086-21grep12:04:247
4460852330,0sleep7446086-21grep12:04:247
3962614993129,2cyclictest4023448-21kworker/u16:2+events_unbound08:19:246
3962610993129,2cyclictest268317-21kworker/u16:3+events_unbound11:28:275
3962610993028,2cyclictest3962811-21kworker/u16:0+events_unbound07:38:165
3962608992926,3cyclictest48976-21kworker/u16:2+flush-8:009:34:314
3962608992925,3cyclictest4023448-21kworker/u16:2+flush-8:008:19:214
3962614992826,2cyclictest4119643-21kworker/u16:1+events_unbound09:29:086
3962614992826,2cyclictest3962811-21kworker/u16:0+events_unbound08:39:076
3962614992825,3cyclictest99142-21kworker/u16:4+flush-8:010:14:156
3962614992823,2cyclictest229630-21kworker/u16:1+events_unbound11:13:576
3962608992826,2cyclictest229630-21kworker/u16:1+flush-8:011:54:254
3962608992826,2cyclictest229630-21kworker/u16:1+flush-8:011:54:254
3962614992725,2cyclictest145132-21kworker/u16:0+events_unbound10:06:126
3962614992624,2cyclictest3964362-21kworker/u16:3+events_unbound08:44:096
3962610992624,2cyclictest3962811-21kworker/u16:0+events_unbound08:11:165
3962608992624,2cyclictest48976-21kworker/u16:2+events_unbound09:39:184
3161502260,1chrt316148-21ssh11:13:187
3962614992523,2cyclictest3964362-21kworker/u16:3+events_unbound07:48:496
3962614992523,2cyclictest388863-21kworker/u16:2+events_unbound12:23:166
3962614992523,2cyclictest145132-21kworker/u16:0+events_unbound10:09:066
3962610992523,2cyclictest3964362-21kworker/u16:3+events_unbound08:36:155
3962610992523,2cyclictest3964362-21kworker/u16:3+events_unbound07:55:045
3962610992523,2cyclictest3964362-21kworker/u16:3+events_unbound07:55:045
3962610992523,2cyclictest3962811-21kworker/u16:0+events_unbound08:18:575
3962610992523,2cyclictest3962811-21kworker/u16:0+events_unbound07:10:055
3962610992523,2cyclictest3962811-21kworker/u16:0+events_unbound07:10:055
3962610992523,2cyclictest2433275-21kworker/u16:1+events_unbound07:27:175
3962608992523,2cyclictest99142-21kworker/u16:4+flush-8:010:04:244
3962608992523,2cyclictest3995268-21kworker/u16:2+flush-8:007:19:254
3962614992422,2cyclictest2433275-21kworker/u16:1+flush-8:007:18:506
3962614992422,2cyclictest229630-21kworker/u16:1+events_unbound11:05:516
3962614992321,2cyclictest3962811-21kworker/u16:0+events_unbound09:09:166
3962614992321,2cyclictest3962811-21kworker/u16:0+events_unbound08:54:176
3962614992321,2cyclictest388863-21kworker/u16:2+events_unbound11:55:156
3962614992321,2cyclictest388863-21kworker/u16:2+events_unbound11:55:156
3962614992321,2cyclictest147938-21kworker/u16:2+events_unbound10:21:276
3962610992321,2cyclictest3964362-21kworker/u16:3+events_unbound08:58:165
3962610992321,2cyclictest3964362-21kworker/u16:3+events_unbound08:50:175
3962610992321,2cyclictest3962811-21kworker/u16:0+events_unbound08:26:055
3962608992321,2cyclictest3964362-21kworker/u16:3+events_unbound07:29:174
3962608992321,2cyclictest147938-21kworker/u16:2+flush-8:010:33:544
3962618992215,6cyclictest0-21swapper/711:24:177
3962614992220,2cyclictest3962811-21kworker/u16:0+events_unbound08:59:206
3962614992220,2cyclictest304453-21kworker/u16:4+events_unbound11:35:176
3962614992220,2cyclictest304453-21kworker/u16:4+events_unbound11:32:176
3962614992220,2cyclictest268317-21kworker/u16:3+events_unbound11:27:156
3962614992220,2cyclictest268317-21kworker/u16:3+events_unbound11:11:196
3962614992220,2cyclictest147938-21kworker/u16:2+events_unbound10:29:166
3962610992220,2cyclictest3962811-21kworker/u16:0+flush-8:008:39:275
3962610992219,2cyclictest3962811-21kworker/u16:0+flush-8:007:59:055
3962608992220,2cyclictest99142-21kworker/u16:4+events_unbound09:59:224
3962608992220,2cyclictest99142-21kworker/u16:4+events_unbound09:59:224
3962618992114,6cyclictest280327-21latency_hist10:58:547
3962618992113,7cyclictest376694-21latency_hist11:38:547
3962614992119,2cyclictest96601-21kworker/u16:3+events_unbound10:01:566
3962614992119,2cyclictest96601-21kworker/u16:3+events_unbound10:01:566
3962614992119,2cyclictest48976-21kworker/u16:2+events_unbound09:46:576
3962614992119,2cyclictest48976-21kworker/u16:2+events_unbound09:27:136
3962614992119,2cyclictest4119643-21kworker/u16:1+events_unbound09:08:296
3962614992119,2cyclictest3964362-21kworker/u16:3+flush-8:008:03:496
3962614992119,2cyclictest229630-21kworker/u16:1+events_unbound10:45:006
3962614992119,2cyclictest147938-21kworker/u16:2+events_unbound10:25:216
3962610992119,2cyclictest3962811-21kworker/u16:0+events_unbound08:48:165
3962618992014,5cyclictest650-21systemd-journal10:13:557
3962614992018,2cyclictest48976-21kworker/u16:2+events_unbound09:37:196
3962614992018,2cyclictest3964362-21kworker/u16:3+events_unbound07:24:166
3962614992018,2cyclictest229630-21kworker/u16:1+events_unbound12:24:116
3962614992018,2cyclictest229630-21kworker/u16:1+events_unbound10:41:016
3962614992018,2cyclictest2033-21kworker/u16:4+events_unbound09:17:056
3962614992017,2cyclictest4119643-21kworker/u16:1+events_unbound08:33:566
3962610992018,2cyclictest4023448-21kworker/u16:2+flush-8:007:49:205
3962610992018,2cyclictest3995268-21kworker/u16:2+events_unbound07:22:165
3962618991913,5cyclictest4014202-21latency_hist07:28:557
3962614991917,2cyclictest96601-21kworker/u16:3+events_unbound09:57:406
3962614991917,2cyclictest48976-21kworker/u16:2+events_unbound09:50:016
3962614991917,2cyclictest4119643-21kworker/u16:1+events_unbound09:41:356
3962614991917,2cyclictest4119643-21kworker/u16:1+events_unbound08:25:166
3962614991917,2cyclictest388863-21kworker/u16:2+events_unbound12:06:436
3962614991917,2cyclictest388863-21kworker/u16:2+events_unbound12:06:436
3962614991917,2cyclictest304453-21kworker/u16:4+events_unbound11:43:126
3962614991917,2cyclictest229630-21kworker/u16:1+events_unbound12:17:166
3962614991917,2cyclictest229630-21kworker/u16:1+events_unbound12:08:566
3962610991917,2cyclictest3962811-21kworker/u16:0+events_unbound08:07:175
3962618991816,1cyclictest0-21swapper/708:04:187
3962618991815,2cyclictest1267-21snmpd10:20:237
3962614991816,2cyclictest48976-21kworker/u16:2+events_unbound09:22:046
3962614991816,2cyclictest48976-21kworker/u16:2+events_unbound09:22:046
3962614991816,2cyclictest409852-21kworker/u16:5+events_unbound11:50:596
3962614991816,2cyclictest4023448-21kworker/u16:2+flush-8:007:34:206
3962614991816,2cyclictest253728-21kworker/u16:0+events_unbound10:50:116
3962614991816,2cyclictest147938-21kworker/u16:2+events_unbound10:34:096
3962610991816,2cyclictest3962811-21kworker/u16:0+events_unbound08:30:055
3962610991816,2cyclictest3962811-21kworker/u16:0+events_unbound07:43:055
396261899174,12cyclictest494118-21ntp_states12:24:217
3962614991715,2cyclictest3962811-21kworker/u16:0+events_unbound08:31:256
3962614991715,2cyclictest304453-21kworker/u16:4+events_unbound11:22:416
3962610991715,2cyclictest4023448-21kworker/u16:2+events_unbound08:18:205
3962610991715,2cyclictest3964362-21kworker/u16:3+flush-8:007:44:065
3962610991714,2cyclictest2433275-21kworker/u16:1+flush-8:007:29:055
3962608991715,2cyclictest99142-21kworker/u16:4+flush-8:010:23:594
3962608991714,2cyclictest4119643-21kworker/u16:1+events_unbound09:14:074
3962618991613,2cyclictest0-21swapper/711:18:547
3962618991612,3cyclictest1267-21snmpd09:33:347
3962618991611,4cyclictest0-21swapper/712:18:547
396261899160,14cyclictest0-21swapper/707:39:197
3962614991614,2cyclictest473139-21kworker/u16:3+events_unbound12:31:566
3962614991614,2cyclictest4023448-21kworker/u16:2+events_unbound08:12:166
3962614991614,2cyclictest4023448-21kworker/u16:2+events_unbound08:07:056
3962614991614,2cyclictest3964362-21kworker/u16:3+events_unbound08:53:286
3962614991614,2cyclictest3962811-21kworker/u16:0+events_unbound07:23:056
3962614991614,2cyclictest268317-21kworker/u16:3+events_unbound12:03:456
3962614991614,2cyclictest268317-21kworker/u16:3+events_unbound10:58:096
3962614991614,2cyclictest268316-21kworker/u16:2+events_unbound10:59:596
3962614991614,2cyclictest2433275-21kworker/u16:1+events_unbound07:12:576
3962614991614,2cyclictest2433275-21kworker/u16:1+events_unbound07:12:576
3962608991614,2cyclictest3962811-21kworker/u16:0+flush-8:009:09:114
396260899160,16cyclictest0-21swapper/409:00:184
396260899160,16cyclictest0-21swapper/408:49:024
396260899160,16cyclictest0-21swapper/408:36:444
396260899160,16cyclictest0-21swapper/408:31:374
396260899160,16cyclictest0-21swapper/408:24:274
396260899160,16cyclictest0-21swapper/408:12:104
396260899160,16cyclictest0-21swapper/408:00:544
396260899160,16cyclictest0-21swapper/407:53:444
396260899160,16cyclictest0-21swapper/407:45:334
396260899160,16cyclictest0-21swapper/407:43:304
396260899160,16cyclictest0-21swapper/407:38:234
396261899153,11cyclictest5944-21gmain10:13:037
3962618991510,4cyclictest4176748-21latency_hist08:53:547
396261899150,3cyclictest4138629-21sed08:33:547
396261899150,14cyclictest0-21swapper/709:54:147
396261899150,14cyclictest0-21swapper/709:19:187
396261899150,14cyclictest0-21swapper/709:19:187
3962608991511,3cyclictest229630-21kworker/u16:1+flush-8:012:23:544
396260899150,15cyclictest0-21swapper/408:48:004
396260899150,15cyclictest0-21swapper/408:16:164
396260899150,15cyclictest0-21swapper/407:15:514
396261899148,5cyclictest650-21systemd-journal07:08:547
396261899148,5cyclictest462087-21df_inode12:14:067
396261899148,5cyclictest297120-21kthreadcore11:04:157
396261899147,6cyclictest0-21swapper/709:44:057
396261899146,7cyclictest0-21swapper/709:59:127
396261899146,7cyclictest0-21swapper/709:59:127
396261899145,8cyclictest0-21swapper/712:30:547
396261899145,8cyclictest0-21swapper/711:39:567
396261899145,8cyclictest0-21swapper/710:03:557
396261899145,8cyclictest0-21swapper/709:14:127
396261899144,9cyclictest196383-21/usr/sbin/munin10:24:077
396261899144,8cyclictest0-21swapper/712:08:587
396261899144,8cyclictest0-21swapper/710:43:557
396261899143,10cyclictest416471-21grep11:54:127
396261899143,10cyclictest416471-21grep11:54:127
396261899143,10cyclictest353862-21perl11:29:087
396261899142,11cyclictest238637-21kthreadcore10:39:177
396261899142,10cyclictest4076206-21cut07:59:127
396261899141,5cyclictest6344-21gmain08:44:117
3962618991410,3cyclictest401796-21df_inode11:49:067
3962608991411,2cyclictest229630-21kworker/u16:1+flush-8:011:39:044
396260899140,14cyclictest0-21swapper/407:27:074
396261899139,3cyclictest1267-21snmpd09:02:307
396261899139,3cyclictest1267-21snmpd08:39:547
396261899139,3cyclictest1267-21snmpd08:11:417
396261899139,3cyclictest1267-21snmpd07:21:107
396261899136,6cyclictest0-21swapper/709:49:077
396261899136,2cyclictest0-21swapper/707:09:167
396261899136,2cyclictest0-21swapper/707:09:167
396261899135,7cyclictest0-21swapper/710:33:587
396261899134,8cyclictest0-21swapper/711:13:567
396261899134,8cyclictest0-21swapper/709:24:007
396261899133,9cyclictest0-21swapper/709:39:127
396261899133,9cyclictest0-21swapper/709:34:337
396261899130,12cyclictest396107-21grep11:44:167
3962614991311,2cyclictest4023448-21kworker/u16:2+events_unbound07:50:216
3962614991311,2cyclictest3962811-21kworker/u16:0+events_unbound07:30:176
3962608991311,2cyclictest3962811-21kworker/u16:0+events_unbound07:09:094
3962608991311,2cyclictest3962811-21kworker/u16:0+events_unbound07:09:094
396260899130,13cyclictest0-21swapper/408:06:014
396261899128,3cyclictest1267-21snmpd08:16:177
396261899124,3cyclictest6450-21gmain07:29:237
396261899120,3cyclictest902-21dbus-daemon08:23:557
396261899120,11cyclictest6264-21rtkit-daemon08:34:107
396261899120,11cyclictest0-21swapper/707:49:177
3962614991210,2cyclictest3964362-21kworker/u16:3+events_unbound07:42:036
3962614991210,2cyclictest3962811-21kworker/u16:0+events_unbound07:54:556
3962614991210,2cyclictest3962811-21kworker/u16:0+events_unbound07:54:556
396260899129,2cyclictest3962811-21kworker/u16:0+flush-8:007:54:054
396260899129,2cyclictest3962811-21kworker/u16:0+flush-8:007:54:054
3962608991211,1cyclictest0-21swapper/409:19:554
3962608991211,1cyclictest0-21swapper/409:19:554
396260899120,12cyclictest0-21swapper/410:44:444
396260899120,12cyclictest0-21swapper/409:48:374
396261899115,5cyclictest4128706-21sshd-session08:25:147
396261899110,2cyclictest0-21swapper/707:34:177
396261899110,10cyclictest1116-21lldpd07:46:167
3962614991110,1cyclictest4101434-21grep08:14:076
396260899119,2cyclictest96601-21kworker/u16:3+events_unbound09:54:154
396260899118,2cyclictest145132-21kworker/u16:0+events_unbound10:09:164
3962608991110,1cyclictest0-21swapper/410:53:254
3962608991110,1cyclictest0-21swapper/410:39:324
3962608991110,1cyclictest0-21swapper/410:37:294
3962608991110,1cyclictest0-21swapper/410:14:194
3962608991110,1cyclictest0-21swapper/409:31:264
3962608991110,1cyclictest0-21swapper/408:43:214
396260899110,11cyclictest0-21swapper/412:13:204
396260899110,11cyclictest0-21swapper/411:46:514
396260899110,11cyclictest0-21swapper/411:12:484
396260899110,11cyclictest0-21swapper/410:56:154
396260899110,11cyclictest0-21swapper/408:57:324
396260899110,0cyclictest0-21swapper/412:30:324
396261899106,3cyclictest1267-21snmpd07:54:147
396261899106,3cyclictest1267-21snmpd07:54:147
396261099108,2cyclictest4119643-21kworker/u16:1+events_unbound09:03:325
396260899109,1cyclictest0-21swapper/412:06:434
396260899109,1cyclictest0-21swapper/412:06:434
396260899109,1cyclictest0-21swapper/411:25:064
396260899109,1cyclictest0-21swapper/411:22:444
396260899100,9cyclictest0-21swapper/409:49:084
396260899100,10cyclictest0-21swapper/409:04:234
39626149998,1cyclictest0-21swapper/607:05:156
39626089998,1cyclictest0-21swapper/411:07:174
39626089998,1cyclictest0-21swapper/410:58:564
39626089998,1cyclictest0-21swapper/407:04:304
39626089987,1cyclictest0-21swapper/412:26:264
39626089987,1cyclictest0-21swapper/411:34:434
39626089982,2cyclictest0-21swapper/411:59:254
39626089976,1cyclictest0-21swapper/411:32:214
39626089975,1cyclictest1041-21lldpd11:50:384
39626089973,3cyclictest51743-21expr09:24:064
39626089951,1cyclictest681rcuog/411:14:564
39626089950,4cyclictest461503-21chrt12:13:584
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional