You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 01:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sat Sep 12, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
375255325848,7sleep40-21swapper/419:06:584
375270125621,30sleep70-21swapper/719:09:027
1640792470,0sleep7164077-21tune2fs23:40:097
375164524430,8sleep50-21swapper/519:05:235
3753047994240,2cyclictest3940748-21kworker/u16:5+flush-8:020:49:545
3753047994240,2cyclictest3940748-21kworker/u16:5+flush-8:020:49:545
1350762400,1chrt0-21swapper/623:25:186
1025522400,1chrt0-21swapper/423:15:064
375305899360,34cyclictest645-21systemd-journal22:59:547
375305899360,34cyclictest187299-21latency_hist23:49:547
3753047993129,2cyclictest3962242-21kworker/u16:1+flush-8:021:24:545
3753047993128,2cyclictest3951374-21kworker/u16:0+events_unbound21:10:095
38759782290,1chrt0-21swapper/420:10:114
3753047992927,2cyclictest3980722-21kworker/u16:2+events_unbound21:15:205
41483582280,1chrt4148356-21ssh22:13:557
3753058992823,4cyclictest40872-21latency_hist22:49:547
3753047992827,1cyclictest258943-21kworker/u16:0+events_unbound00:20:165
3753047992724,2cyclictest3962242-21kworker/u16:1+events_unbound21:29:575
3753047992724,2cyclictest3864009-21kworker/u16:4+events_unbound20:20:095
3753058992620,5cyclictest4087979-21latency_hist21:49:557
3753048992622,3cyclictest4051423-21kworker/u16:5+flush-8:021:54:556
3753047992624,2cyclictest3753264-21kworker/u16:1+flush-8:019:10:085
3753047992623,2cyclictest4109925-21kworker/u16:1+events_unbound22:29:575
3753058992519,5cyclictest3785937-21latency_hist19:24:557
3753048992522,3cyclictest3951374-21kworker/u16:0+flush-8:020:55:106
3753047992523,2cyclictest3980722-21kworker/u16:2+flush-8:021:28:335
3753047992523,2cyclictest3980722-21kworker/u16:2+flush-8:021:28:335
3753047992523,2cyclictest3951374-21kworker/u16:0+flush-8:021:35:205
3753043992523,2cyclictest3753264-21kworker/u16:1+events_unbound19:40:094
375248122514,8sleep60-21swapper/619:05:566
3753047992422,2cyclictest3980722-21kworker/u16:2+flush-8:021:50:235
3753047992422,2cyclictest3951374-21kworker/u16:0+flush-8:021:40:125
3753047992422,2cyclictest199653-21kworker/u16:3+flush-8:000:09:495
3753047992421,2cyclictest4109925-21kworker/u16:1+flush-8:022:35:105
3753047992421,2cyclictest1596-21kworker/u16:2+flush-8:023:49:595
3753047992421,2cyclictest1596-21kworker/u16:2+flush-8:023:35:045
3753058992317,5cyclictest645-21systemd-journal22:34:557
3753048992319,3cyclictest3705204-21kworker/u16:2+flush-8:019:34:556
3753047992321,2cyclictest3951374-21kworker/u16:0+events_unbound21:00:095
3753047992321,2cyclictest150604-21kworker/u16:0+flush-8:023:48:395
3753048992218,3cyclictest3951374-21kworker/u16:0+flush-8:021:10:106
3753047992220,2cyclictest258943-21kworker/u16:0+flush-8:000:25:045
3753058992119,1cyclictest99732-21ssh23:10:507
3753047992119,2cyclictest3705204-21kworker/u16:2+flush-8:019:50:205
3753047992119,2cyclictest150604-21kworker/u16:0+flush-8:023:55:205
3753047992119,2cyclictest114530-21kworker/u16:1+flush-8:023:30:005
3753043992117,3cyclictest260739-21kworker/u16:2+flush-8:000:39:544
3753047992018,2cyclictest3951374-21kworker/u16:0+flush-8:022:05:195
3753047992018,2cyclictest3951374-21kworker/u16:0+flush-8:022:05:195
3753047992018,2cyclictest3951374-21kworker/u16:0+events_unbound22:00:245
3753047992018,2cyclictest1596-21kworker/u16:2+flush-8:023:00:195
3753047992017,2cyclictest3980722-21kworker/u16:2+events_unbound22:17:055
3753058991814,3cyclictest1274-21snmpd21:40:087
3753058991814,3cyclictest1274-21snmpd00:30:557
3753047991816,2cyclictest53432-21kworker/u16:4+events_unbound22:59:495
3753047991816,2cyclictest3951374-21kworker/u16:0+events_unbound22:28:565
3753047991816,2cyclictest3815190-21kworker/u16:0+events_unbound20:00:135
3753047991816,2cyclictest3815190-21kworker/u16:0+events_unbound20:00:135
3753043991816,2cyclictest3962242-21kworker/u16:1+flush-8:021:30:564
3753058991714,2cyclictest0-21swapper/700:14:547
3753047991715,2cyclictest3951374-21kworker/u16:0+events_unbound23:10:285
3753047991715,2cyclictest3951374-21kworker/u16:0+events_unbound22:21:055
3753047991715,2cyclictest3932001-21kworker/u16:0+flush-8:020:40:165
3753047991715,2cyclictest212200-21kworker/u16:1+flush-8:000:10:195
3753047991715,2cyclictest212200-21kworker/u16:1+flush-8:000:10:195
3753043991715,2cyclictest3921360-21kworker/u16:3+flush-8:020:35:584
3753058991612,3cyclictest1274-21snmpd23:23:207
375305899160,14cyclictest0-21swapper/722:50:187
375304899160,1cyclictest0-21swapper/621:48:566
3753047991614,2cyclictest1596-21kworker/u16:2+events_unbound22:50:155
375305899150,13cyclictest1274-21snmpd21:16:207
375305899150,13cyclictest1274-21snmpd20:12:187
375305899150,13cyclictest0-21swapper/722:15:177
3753047991514,1cyclictest0-21swapper/522:46:295
3753047991513,2cyclictest3951374-21kworker/u16:0+flush-8:021:56:525
3753047991513,2cyclictest3864009-21kworker/u16:4+events_unbound20:09:545
3753047991513,2cyclictest3815190-21kworker/u16:0+flush-8:019:49:545
3753047991513,2cyclictest258943-21kworker/u16:0+events_unbound00:35:275
375305899149,4cyclictest188568-21cat23:50:077
3753058991413,0cyclictest0-21swapper/723:19:007
3753058991413,0cyclictest0-21swapper/700:38:317
3753058991413,0cyclictest0-21swapper/700:24:387
3753058991411,2cyclictest0-21swapper/719:14:557
375305899140,1cyclictest0-21swapper/720:20:207
375305899140,12cyclictest3794733-21ntp_offset19:25:207
3753048991413,1cyclictest0-21swapper/600:15:436
3753047991412,2cyclictest114530-21kworker/u16:1+events_unbound23:28:355
3753043991413,1cyclictest0-21swapper/422:27:344
3753043991413,1cyclictest0-21swapper/422:09:554
3753043991413,1cyclictest0-21swapper/421:28:174
3753043991413,1cyclictest0-21swapper/421:28:174
3753043991413,1cyclictest0-21swapper/400:02:584
3753043991412,1cyclictest0-21swapper/421:15:124
375304399140,1cyclictest0-21swapper/423:55:334
375304399140,1cyclictest0-21swapper/423:32:224
375304399140,1cyclictest0-21swapper/422:02:404
375304399140,14cyclictest0-21swapper/422:31:124
375304399140,14cyclictest0-21swapper/421:51:474
375305899139,3cyclictest1274-21snmpd21:21:387
375305899139,3cyclictest1274-21snmpd21:00:527
375305899137,5cyclictest273901-21tune2fs00:25:087
3753058991313,0cyclictest0-21swapper/723:31:497
3753058991310,2cyclictest5738-21gmain19:30:167
3753058991310,2cyclictest1274-21snmpd21:14:477
375305899130,3cyclictest4184889-21sh22:28:507
375305899130,1cyclictest0-21swapper/720:35:197
3753048991312,1cyclictest0-21swapper/622:10:516
3753048991312,1cyclictest0-21swapper/619:24:216
3753048991311,2cyclictest199653-21kworker/u16:3+flush-8:000:01:306
3753048991311,2cyclictest1596-21kworker/u16:2+events_unbound22:45:086
375304899130,1cyclictest0-21swapper/623:21:576
375304899130,1cyclictest0-21swapper/622:54:226
375304899130,1cyclictest0-21swapper/622:34:116
375304899130,13cyclictest0-21swapper/623:50:016
375304899130,13cyclictest0-21swapper/600:38:546
3753047991312,1cyclictest0-21swapper/523:23:515
3753047991312,1cyclictest0-21swapper/521:44:595
3753047991311,2cyclictest3951374-21kworker/u16:0+events_unbound20:59:555
3753047991311,2cyclictest3753264-21kworker/u16:1+flush-8:019:19:555
3753047991310,3cyclictest3753264-21kworker/u16:1+flush-8:019:34:305
375304799130,13cyclictest0-21swapper/522:42:235
3753043991312,1cyclictest0-21swapper/422:35:184
3753043991312,1cyclictest0-21swapper/421:59:024
3753043991312,1cyclictest0-21swapper/400:15:534
375304399130,1cyclictest0-21swapper/419:28:474
375304399130,13cyclictest0-21swapper/422:24:254
375304399130,13cyclictest0-21swapper/421:41:234
375304399130,13cyclictest0-21swapper/421:38:134
375304399130,13cyclictest0-21swapper/400:21:534
375304399130,12cyclictest3894366-21sort20:20:114
375305899129,2cyclictest990-21in:imjournal21:55:077
375305899129,2cyclictest1274-21snmpd21:32:567
375305899129,2cyclictest1274-21snmpd19:50:207
375305899128,3cyclictest1274-21snmpd23:37:247
375305899128,3cyclictest1274-21snmpd21:28:057
375305899128,3cyclictest1274-21snmpd21:28:057
375305899128,3cyclictest1274-21snmpd20:54:587
375305899128,3cyclictest1274-21snmpd20:47:347
375305899128,3cyclictest1274-21snmpd20:47:347
375305899128,3cyclictest1274-21snmpd20:42:287
375305899127,4cyclictest5997-21gmain20:00:197
375305899127,4cyclictest5997-21gmain20:00:197
375305899127,4cyclictest4173259-21latency_hist22:24:557
375305899120,2cyclictest223849-21sh00:04:437
375305899120,1cyclictest0-21swapper/719:55:187
375305899120,11cyclictest28192-21ssh22:43:597
375305899120,10cyclictest208655-21grep23:55:217
375305899120,10cyclictest1274-21snmpd20:31:007
375305899120,10cyclictest0-21swapper/720:25:117
375304899129,2cyclictest3814153-21ntpq19:35:196
375304899128,3cyclictest4150186-21cat22:15:096
375304899128,3cyclictest3876567-21cut20:10:126
375304899127,4cyclictest3835737-21cat19:50:086
375304899123,8cyclictest3886123-21kthreadcore20:15:116
3753048991211,1cyclictest0-21swapper/622:29:086
3753048991211,1cyclictest0-21swapper/622:06:176
3753048991211,1cyclictest0-21swapper/622:06:176
3753048991211,1cyclictest0-21swapper/620:38:566
3753048991211,1cyclictest0-21swapper/620:30:066
3753048991211,1cyclictest0-21swapper/600:31:016
375304899120,1cyclictest0-21swapper/622:43:486
375304899120,1cyclictest0-21swapper/621:27:306
375304899120,1cyclictest0-21swapper/621:27:306
3753047991210,2cyclictest3753264-21kworker/u16:1+flush-8:019:20:105
375304399128,3cyclictest3770240-21kthreadcore19:15:134
3753043991211,1cyclictest0-21swapper/423:24:014
3753043991211,1cyclictest0-21swapper/423:11:154
3753043991211,1cyclictest0-21swapper/422:58:574
3753043991211,1cyclictest0-21swapper/422:46:114
3753043991211,1cyclictest0-21swapper/422:42:334
3753043991211,1cyclictest0-21swapper/422:17:104
3753043991211,1cyclictest0-21swapper/420:28:234
3753043991211,1cyclictest0-21swapper/420:06:094
375304399120,1cyclictest0-21swapper/420:44:094
375305899117,3cyclictest935-21NetworkManager21:05:137
375305899117,3cyclictest1274-21snmpd22:09:007
375305899117,3cyclictest1274-21snmpd22:09:007
375305899117,3cyclictest1274-21snmpd20:51:197
375305899117,3cyclictest1274-21snmpd19:48:057
375305899116,4cyclictest1274-21snmpd20:07:217
375305899115,5cyclictest905-21dbus-daemon22:38:317
375305899110,9cyclictest4121358-21ssh22:00:197
375305899110,10cyclictest4061445-21ssh21:36:067
375305899110,10cyclictest1274-21snmpd23:08:477
375305899110,10cyclictest1274-21snmpd21:54:277
375304899116,4cyclictest4054038-21grep21:35:136
3753048991110,1cyclictest0-21swapper/622:38:456
3753048991110,1cyclictest0-21swapper/620:23:106
3753048991110,1cyclictest0-21swapper/620:08:216
3753048991110,1cyclictest0-21swapper/600:24:336
375304899110,3cyclictest4010453-21kthreadcore21:15:166
375304899110,3cyclictest3852380-21kthreadcore19:55:156
375304899110,1cyclictest0-21swapper/619:11:456
375304899110,11cyclictest0-21swapper/621:02:546
375304899110,11cyclictest0-21swapper/620:46:216
375304899110,11cyclictest0-21swapper/620:46:216
375304899110,10cyclictest4046114-21kthreadcore21:30:136
375304799119,2cyclictest53432-21kworker/u16:4+events_unbound23:06:285
375304799119,2cyclictest260739-21kworker/u16:2+events_unbound00:32:045
375304799118,2cyclictest3864009-21kworker/u16:4+flush-8:020:34:555
375304799118,2cyclictest1596-21kworker/u16:2+events_unbound23:14:565
375304799116,4cyclictest3816266-21cat19:40:095
3753047991110,1cyclictest0-21swapper/521:09:125
3753047991110,1cyclictest0-21swapper/520:31:505
375304799110,11cyclictest0-21swapper/520:17:015
375304799110,0cyclictest0-21swapper/520:53:365
3753043991110,1cyclictest0-21swapper/423:03:034
3753043991110,1cyclictest0-21swapper/421:48:094
3753043991110,1cyclictest0-21swapper/420:49:404
3753043991110,1cyclictest0-21swapper/420:49:404
3753043991110,1cyclictest0-21swapper/400:31:584
375304399110,11cyclictest0-21swapper/420:14:594
375305899107,2cyclictest0-21swapper/719:34:557
375305899106,3cyclictest1274-21snmpd23:26:127
375305899106,3cyclictest1274-21snmpd19:10:287
375305899106,3cyclictest1274-21snmpd00:12:137
375305899106,3cyclictest1274-21snmpd00:12:137
375305899105,4cyclictest76056-21rm23:02:247
375305899100,2cyclictest224427-21/usr/sbin/munin00:05:187
375304899109,1cyclictest0-21swapper/622:01:426
375304899109,1cyclictest0-21swapper/621:07:006
375304899109,1cyclictest0-21swapper/620:51:236
375304899107,2cyclictest3855812-21tr20:00:126
375304899107,2cyclictest3855812-21tr20:00:126
375304899105,4cyclictest78588-21tune2fs23:05:086
375304899105,4cyclictest72849-21kthreadcore23:00:146
375304899100,9cyclictest4166012-21tr22:20:146
375304899100,9cyclictest4070720-21kthreadcore21:40:136
375304899100,9cyclictest3815654-21expr19:40:066
375304899100,9cyclictest0-21swapper/621:55:166
375304899100,9cyclictest0-21swapper/619:14:556
375304899100,3cyclictest3932639-21cstates20:40:066
375304799108,2cyclictest3864009-21kworker/u16:4+flush-8:020:10:165
375304799108,2cyclictest3753264-21kworker/u16:1+flush-8:019:55:175
375304799108,2cyclictest221131-21kworker/u16:2+flush-8:000:04:525
375304399109,1cyclictest0-21swapper/423:47:404
375304399109,1cyclictest0-21swapper/423:07:094
375304399109,1cyclictest0-21swapper/421:21:314
375304399109,1cyclictest0-21swapper/421:09:224
37530589990,8cyclictest2190-21dockerd19:40:137
37530589990,1cyclictest0-21swapper/720:15:137
37530489998,1cyclictest0-21swapper/623:15:306
37530489997,2cyclictest86-21ksoftirqd/623:37:406
37530489997,2cyclictest86-21ksoftirqd/600:13:246
37530489997,2cyclictest86-21ksoftirqd/600:13:246
37530489996,2cyclictest3829446-21kthreadcore19:45:146
37530489994,4cyclictest4015921-21cat21:20:086
37530489990,9cyclictest0-21swapper/623:32:316
37530489990,8cyclictest3903083-21/usr/sbin/munin20:25:166
37530489990,8cyclictest0-21swapper/622:55:076
37530479995,3cyclictest3787121-21cat19:25:105
37530439998,1cyclictest0-21swapper/422:05:494
37530439998,1cyclictest0-21swapper/422:05:494
37530439998,1cyclictest0-21swapper/400:26:274
37530439998,1cyclictest0-21swapper/400:09:254
37530439997,1cyclictest0-21swapper/419:35:114
37530439996,2cyclictest0-21swapper/419:45:234
37530439994,4cyclictest42147-21cat22:50:084
37530439990,8cyclictest3955702-21cut20:50:124
37530489986,2cyclictest86-21ksoftirqd/623:10:556
37530489986,2cyclictest86-21ksoftirqd/600:28:046
37530489984,3cyclictest53432-21kworker/u16:4+flush-8:023:59:546
37530489980,7cyclictest0-21swapper/623:45:176
37530479984,3cyclictest4143942-21cut22:10:145
37530479983,4cyclictest3810859-21cut19:35:145
37530439986,1cyclictest0-21swapper/419:55:084
37530439985,2cyclictest0-21swapper/419:10:124
37530439984,3cyclictest3855232-21hddtemp_smartct20:00:104
37530439984,3cyclictest3855232-21hddtemp_smartct20:00:104
37530439983,4cyclictest3962122-21cut20:55:094
37530439983,4cyclictest3843957-21users19:50:214
37530489975,2cyclictest86-21ksoftirqd/623:40:346
37530489973,3cyclictest3786554-21tr19:25:076
37530489971,6cyclictest0-21swapper/600:05:206
37530479975,2cyclictest258943-21kworker/u16:0+events_unbound00:17:285
37530479975,1cyclictest0-21swapper/520:25:085
37530439976,1cyclictest641ktimers/423:44:274
37530439976,1cyclictest641ktimers/423:37:574
37530439975,1cyclictest0-21swapper/420:30:094
37530439975,1cyclictest0-21swapper/419:20:094
37530439974,2cyclictest1961372sleep423:50:174
37530439973,3cyclictest3990800-21cpuspeed21:10:074
37530439973,3cyclictest3801279-21cut19:30:144
37530439972,4cyclictest3971876-21cut21:00:084
37530479962,2cyclictest0-21swapper/523:43:155
37530439964,2cyclictest212200-21kworker/u16:1+nfsiod00:10:074
37530439964,2cyclictest212200-21kworker/u16:1+nfsiod00:10:074
37530439950,4cyclictest126765-21chrt23:25:004
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional