You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 12:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu Jun 04, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5520962960,0sleep60-21swapper/600:21:596
415206525747,7sleep40-21swapper/419:04:244
4152527995553,2cyclictest99096-21kworker/u16:2+flush-8:021:36:555
4152527995452,2cyclictest523175-21kworker/u16:0+events_unbound00:31:555
4152527995048,2cyclictest172224-21kworker/u16:0+events_unbound21:51:555
4152527994947,2cyclictest496024-21kworker/u16:0+events_unbound23:57:045
4152527994846,2cyclictest439778-21kworker/u16:1+events_unbound00:22:125
4152535994643,2cyclictest65534-21latency_hist20:41:407
4152527994644,2cyclictest222794-21kworker/u16:4+events_unbound22:21:535
415197924635,8sleep50-21swapper/519:03:135
4152527994543,2cyclictest44841-21kworker/u16:3+events_unbound21:47:085
4152527994543,2cyclictest212365-21kworker/u16:0+events_unbound23:21:555
4152527994541,3cyclictest44841-21kworker/u16:3+flush-8:020:47:065
4152527994541,3cyclictest44841-21kworker/u16:3+flush-8:020:47:065
4152527994442,2cyclictest3887171-21kworker/u16:2+flush-8:020:27:055
4152535994338,4cyclictest114192-21latency_hist21:21:407
4152527994341,2cyclictest222794-21kworker/u16:4+events_unbound22:43:375
4152527994341,2cyclictest212365-21kworker/u16:0+events_unbound23:27:535
4152535994237,4cyclictest138336-21latency_hist21:31:407
4152527994240,2cyclictest4177208-21kworker/u16:1+flush-8:019:47:055
41512572423,32sleep70-21swapper/719:02:107
4152527994139,2cyclictest413248-21kworker/u16:3+events_unbound23:36:215
4152527994139,2cyclictest283177-21kworker/u16:2+events_unbound23:37:065
4152527994038,2cyclictest477352-21kworker/u16:4+flush-8:000:27:095
4152527994038,2cyclictest44841-21kworker/u16:3+flush-8:021:13:225
4152527994037,2cyclictest44841-21kworker/u16:3+events_unbound21:16:455
4152527993937,2cyclictest44841-21kworker/u16:3+events_unbound20:36:585
4152527993937,2cyclictest3887171-21kworker/u16:2+flush-8:020:01:425
4152527993937,2cyclictest283177-21kworker/u16:2+events_unbound23:43:215
4152527993937,2cyclictest212365-21kworker/u16:0+events_unbound23:18:105
4152527993937,2cyclictest212365-21kworker/u16:0+events_unbound23:11:025
4152527993836,2cyclictest439778-21kworker/u16:1+events_unbound00:03:545
4152527993836,2cyclictest283177-21kworker/u16:2+events_unbound23:54:415
4152527993836,2cyclictest283177-21kworker/u16:2+events_unbound23:00:455
4152527993836,2cyclictest222794-21kworker/u16:4+flush-8:022:20:065
4152527993836,2cyclictest222794-21kworker/u16:4+events_unbound22:35:015
4152527993836,2cyclictest184670-21kworker/u16:1+events_unbound22:06:545
4152527993836,2cyclictest172224-21kworker/u16:0+events_unbound21:42:465
4152527993735,2cyclictest88017-21kworker/u16:1+flush-8:021:07:145
4152527993735,2cyclictest66369-21kworker/u16:4+flush-8:021:27:135
4152527993735,2cyclictest4177208-21kworker/u16:1+flush-8:020:17:015
4152527993735,2cyclictest222794-21kworker/u16:4+events_unbound22:29:425
4152527993735,2cyclictest222794-21kworker/u16:4+events_unbound22:16:175
4152527993735,2cyclictest212365-21kworker/u16:0+events_unbound23:50:175
415253599360,34cyclictest635-21systemd-journal23:26:397
4152527993634,2cyclictest99096-21kworker/u16:2+flush-8:021:23:575
4152527993634,2cyclictest66369-21kworker/u16:4+events_unbound21:32:545
4152527993634,2cyclictest523175-21kworker/u16:0+flush-8:000:21:065
4152527993634,2cyclictest331323-21kworker/u16:1+flush-8:023:05:305
4152527993634,2cyclictest331323-21kworker/u16:1+events_unbound22:56:095
4152527993634,2cyclictest222794-21kworker/u16:4+events_unbound22:40:585
4152535993530,4cyclictest210633-21latency_hist22:01:407
4152527993533,2cyclictest44841-21kworker/u16:3+flush-8:022:04:295
4152527993533,2cyclictest222794-21kworker/u16:4+flush-8:022:47:455
4152527993432,2cyclictest212365-21kworker/u16:0+flush-8:023:12:415
4152527993432,2cyclictest184670-21kworker/u16:1+flush-8:021:59:585
4152527993331,2cyclictest439778-21kworker/u16:1+events_unbound00:11:105
4152527993331,2cyclictest439778-21kworker/u16:1+events_unbound00:11:105
4152527993331,2cyclictest4103348-21kworker/u16:0+events_unbound19:16:535
4152527993330,2cyclictest4162004-21kworker/u16:3+events_unbound19:22:495
4152527993230,2cyclictest3887171-21kworker/u16:2+flush-8:019:37:005
4152527993230,2cyclictest24502-21kworker/u16:0+events_unbound20:07:025
4152523993228,3cyclictest172224-21kworker/u16:0+flush-8:021:46:404
4152535993126,4cyclictest85782-21cat20:57:067
4152527993129,2cyclictest477352-21kworker/u16:4+flush-8:000:12:375
415200923121,7sleep60-21swapper/619:03:386
4152527993028,2cyclictest44841-21kworker/u16:3+flush-8:020:57:015
4152535992924,4cyclictest270964-21latency_hist22:26:407
4152527992927,2cyclictest3887171-21kworker/u16:2+events_unbound19:09:515
4152527992826,2cyclictest44841-21kworker/u16:3+events_unbound20:53:065
4152527992826,2cyclictest4186814-21kworker/u16:0+events_unbound19:43:515
4152527992826,2cyclictest3887171-21kworker/u16:2+flush-8:020:44:225
4152527992826,2cyclictest3887171-21kworker/u16:2+events_unbound20:22:505
4152527992825,2cyclictest3887171-21kworker/u16:2+events_unbound20:13:065
5699772270,1chrt0-21swapper/600:27:126
415253599270,25cyclictest418697-21grep23:26:587
4152527992724,2cyclictest4103348-21kworker/u16:0+events_unbound19:12:585
4152532992623,3cyclictest99096-21kworker/u16:2+flush-8:021:41:406
4152527992624,2cyclictest66369-21kworker/u16:4+events_unbound21:02:505
4152535992520,4cyclictest76652-21latency_hist20:56:407
4152527992523,2cyclictest3887171-21kworker/u16:2+events_unbound19:26:495
2800062250,1chrt280004-21ntpq22:27:077
4152527992422,2cyclictest4177208-21kworker/u16:1+events_unbound20:33:185
4152535992318,4cyclictest463919-21latency_hist23:46:407
4152535992318,4cyclictest4161952-21latency_hist19:11:407
415253599220,20cyclictest364592-21sensors23:02:097
4152532992219,2cyclictest222794-21kworker/u16:4+flush-8:022:46:396
4152523992220,2cyclictest523175-21kworker/u16:0+events_unbound00:36:224
4152523992220,2cyclictest222794-21kworker/u16:4+events_unbound22:38:474
4152532992118,2cyclictest222794-21kworker/u16:4+flush-8:022:21:516
4152527992119,2cyclictest3887171-21kworker/u16:2+flush-8:019:57:255
4152523992119,2cyclictest66369-21kworker/u16:4+events_unbound21:09:464
4152523992119,2cyclictest477352-21kworker/u16:4+events_unbound23:57:414
4152523992119,2cyclictest212365-21kworker/u16:0+events_unbound23:30:334
4152535992017,2cyclictest485054-21ntpq23:52:067
4152523992018,2cyclictest3887171-21kworker/u16:2+flush-8:020:31:364
4152523992018,2cyclictest222794-21kworker/u16:4+flush-8:022:23:414
4152523992018,2cyclictest212365-21kworker/u16:0+events_unbound22:52:094
4152523992018,2cyclictest172224-21kworker/u16:0+events_unbound21:53:334
4152535991914,4cyclictest4188338-21cat19:36:527
4152535991914,4cyclictest163685-21cat21:41:547
4152523991917,2cyclictest66369-21kworker/u16:4+flush-8:021:22:014
4152523991917,2cyclictest44841-21kworker/u16:3+events_unbound21:40:454
4152523991917,2cyclictest331323-21kworker/u16:1+events_unbound23:04:374
4152523991917,2cyclictest283177-21kworker/u16:2+events_unbound23:56:134
4152523991917,2cyclictest222794-21kworker/u16:4+events_unbound22:44:494
4152523991917,2cyclictest222794-21kworker/u16:4+events_unbound22:36:254
4152523991917,2cyclictest184670-21kworker/u16:1+events_unbound22:04:264
4152535991817,0cyclictest0-21swapper/721:47:147
4152535991817,0cyclictest0-21swapper/721:06:537
4152523991816,2cyclictest523175-21kworker/u16:0+events_unbound00:22:014
4152523991816,2cyclictest477352-21kworker/u16:4+events_unbound00:20:424
4152523991816,2cyclictest44841-21kworker/u16:3+events_unbound21:27:064
4152523991816,2cyclictest439778-21kworker/u16:1+flush-8:000:07:214
4152523991816,2cyclictest439778-21kworker/u16:1+flush-8:000:07:214
4152523991816,2cyclictest439778-21kworker/u16:1+events_unbound00:13:384
4152523991816,2cyclictest439778-21kworker/u16:1+events_unbound00:04:144
4152523991816,2cyclictest3887171-21kworker/u16:2+events_unbound19:57:014
4152523991816,2cyclictest212365-21kworker/u16:0+flush-8:023:08:554
4152523991816,2cyclictest212365-21kworker/u16:0+events_unbound23:43:254
772532170,0sleep40-21swapper/420:56:494
4152535991715,1cyclictest0-21swapper/722:37:037
4152535991714,2cyclictest0-21swapper/723:16:597
4152535991713,3cyclictest313231-21kthreadcore22:42:017
4152535991713,3cyclictest1234-21snmpd19:50:437
4152535991711,5cyclictest3714-21latency_hist19:46:407
415253299170,17cyclictest0-21swapper/622:47:486
4152527991715,2cyclictest4177208-21kworker/u16:1+events_unbound19:53:435
4152523991715,2cyclictest44841-21kworker/u16:3+events_unbound22:08:264
4152523991715,2cyclictest413248-21kworker/u16:3+flush-8:023:32:254
4152523991715,2cyclictest4103348-21kworker/u16:0+events_unbound19:11:444
4152523991715,2cyclictest283177-21kworker/u16:2+events_unbound22:47:534
4152523991715,2cyclictest222794-21kworker/u16:4+events_unbound22:31:144
4152523991715,2cyclictest212365-21kworker/u16:0+flush-8:022:18:134
4152523991715,2cyclictest212365-21kworker/u16:0+events_unbound23:21:304
4152523991715,2cyclictest184670-21kworker/u16:1+events_unbound21:48:504
4152535991614,1cyclictest340286-21ntpq22:52:057
4152535991613,2cyclictest1234-21snmpd00:32:387
415253599160,15cyclictest1234-21snmpd23:57:417
415253599160,14cyclictest115278-21grep21:21:547
4152523991614,2cyclictest99096-21kworker/u16:2+flush-8:021:18:504
4152523991614,2cyclictest413248-21kworker/u16:3+events_unbound23:50:374
4152535991512,2cyclictest1234-21snmpd21:03:547
415253599150,13cyclictest572385-21latency_hist00:31:407
415253599150,13cyclictest196204-21sh21:52:177
4152532991513,2cyclictest283177-21kworker/u16:2+flush-8:023:12:116
4152523991513,2cyclictest523175-21kworker/u16:0+events_unbound00:30:374
4152523991513,2cyclictest44841-21kworker/u16:3+events_unbound21:33:024
4152523991513,2cyclictest4177208-21kworker/u16:1+events_unbound20:17:494
4152523991513,2cyclictest283177-21kworker/u16:2+events_unbound23:15:104
4152523991513,2cyclictest24502-21kworker/u16:0+events_unbound20:05:504
4152523991513,2cyclictest212365-21kworker/u16:0+flush-8:023:25:384
4152523991513,2cyclictest184670-21kworker/u16:1+events_unbound22:00:104
4152535991413,0cyclictest0-21swapper/700:05:327
4152535991411,2cyclictest0-21swapper/720:16:407
4152535991411,2cyclictest0-21swapper/700:16:537
4152532991413,1cyclictest0-21swapper/623:53:516
4152532991413,1cyclictest0-21swapper/623:46:276
4152532991413,1cyclictest0-21swapper/622:27:096
4152532991410,4cyclictest0-21swapper/622:17:516
415253299140,1cyclictest0-21swapper/623:25:106
415253299140,1cyclictest0-21swapper/621:23:466
415253299140,14cyclictest0-21swapper/621:31:586
4152523991412,2cyclictest44841-21kworker/u16:3+events_unbound21:13:314
4152523991412,2cyclictest4177208-21kworker/u16:1+flush-8:020:40:264
4152523991412,2cyclictest24502-21kworker/u16:0+flush-8:020:07:504
4152523991412,2cyclictest212365-21kworker/u16:0+flush-8:022:57:574
4152523991412,2cyclictest212365-21kworker/u16:0+events_unbound23:38:104
415253599139,3cyclictest1234-21snmpd22:09:167
415253599139,3cyclictest1234-21snmpd20:34:387
415253599139,3cyclictest1234-21snmpd19:23:037
415253599138,4cyclictest635-21systemd-journal00:16:397
415253599136,6cyclictest5975-21gmain19:11:457
4152535991312,0cyclictest0-21swapper/722:33:467
4152535991312,0cyclictest0-21swapper/722:17:137
4152535991310,2cyclictest0-21swapper/723:11:417
4152535991310,2cyclictest0-21swapper/720:17:057
4152532991312,1cyclictest0-21swapper/623:18:336
4152532991312,1cyclictest0-21swapper/622:52:516
4152532991312,1cyclictest0-21swapper/622:13:456
4152532991312,1cyclictest0-21swapper/621:49:286
4152532991312,1cyclictest0-21swapper/621:42:136
415253299130,13cyclictest0-21swapper/621:19:406
415253299130,13cyclictest0-21swapper/621:15:446
415253299130,13cyclictest0-21swapper/600:00:486
4152527991311,2cyclictest3887171-21kworker/u16:2+flush-8:019:31:565
4152523991311,2cyclictest4186814-21kworker/u16:0+events_unbound19:49:064
4152523991311,2cyclictest3887171-21kworker/u16:2+events_unbound19:06:574
4152523991310,2cyclictest24502-21kworker/u16:0+events_unbound20:11:524
415253599129,2cyclictest0-21swapper/720:46:407
415253599129,2cyclictest0-21swapper/720:46:407
415253599129,2cyclictest0-21swapper/720:46:407
415253599128,3cyclictest1234-21snmpd23:51:347
415253599128,3cyclictest1234-21snmpd20:27:507
415253599128,3cyclictest1234-21snmpd20:22:027
415253599128,3cyclictest1234-21snmpd19:55:527
4152535991210,1cyclictest0-21swapper/723:31:557
4152535991210,1cyclictest0-21swapper/722:01:557
415253599120,11cyclictest521353-21taskset00:07:097
415253599120,11cyclictest521353-21taskset00:07:097
415253599120,11cyclictest368721-21cat23:06:557
415253599120,11cyclictest23461-21sed19:57:057
4152532991211,1cyclictest0-21swapper/623:31:196
4152532991211,1cyclictest0-21swapper/622:32:216
4152532991211,1cyclictest0-21swapper/622:09:396
4152532991211,1cyclictest0-21swapper/622:01:276
4152532991211,1cyclictest0-21swapper/621:07:516
4152532991211,1cyclictest0-21swapper/620:17:526
4152532991211,1cyclictest0-21swapper/619:26:286
4152532991211,1cyclictest0-21swapper/600:13:346
4152532991210,2cyclictest331323-21kworker/u16:1+flush-8:022:57:106
415253299120,1cyclictest0-21swapper/620:35:316
415253299120,1cyclictest0-21swapper/620:06:026
415253299120,1cyclictest0-21swapper/619:53:356
415253299120,12cyclictest0-21swapper/620:55:426
415253299120,12cyclictest0-21swapper/600:20:216
415252399129,2cyclictest4177208-21kworker/u16:1+events_unbound19:36:494
4152523991211,1cyclictest0-21swapper/422:13:474
4152523991211,1cyclictest0-21swapper/419:20:404
4152523991210,2cyclictest66369-21kworker/u16:4+flush-8:021:03:344
4152523991210,2cyclictest4177208-21kworker/u16:1+events_unbound19:32:504
4152523991210,2cyclictest3887171-21kworker/u16:2+events_unbound20:46:584
4152523991210,2cyclictest3887171-21kworker/u16:2+events_unbound20:46:584
415253599118,2cyclictest1234-21snmpd19:18:487
415253599118,2cyclictest0-21swapper/723:37:087
415253599117,3cyclictest1234-21snmpd20:07:557
415253599117,3cyclictest1234-21snmpd20:02:257
415253599117,3cyclictest1234-21snmpd19:27:157
415253599114,5cyclictest551624-21grep00:21:597
415253599113,7cyclictest351224-21kthreadcore22:57:037
4152535991111,0cyclictest0-21swapper/721:37:107
4152532991110,1cyclictest0-21swapper/623:38:156
4152532991110,1cyclictest0-21swapper/623:07:496
4152532991110,1cyclictest0-21swapper/621:03:456
4152532991110,1cyclictest0-21swapper/620:59:396
415253299110,11cyclictest0-21swapper/620:48:276
415253299110,11cyclictest0-21swapper/620:48:276
415253299110,0cyclictest0-21swapper/619:38:466
415252399118,2cyclictest4162004-21kworker/u16:3+events_unbound19:21:424
415252399118,2cyclictest3887171-21kworker/u16:2+flush-8:020:26:414
4152523991110,1cyclictest0-21swapper/420:33:124
415253599107,2cyclictest0-21swapper/721:31:557
415253599105,4cyclictest635-21systemd-journal21:16:407
415253599105,4cyclictest320512-21tune2fs22:46:557
415253599100,9cyclictest1234-21snmpd22:12:017
415253299109,1cyclictest0-21swapper/622:05:336
415253299109,1cyclictest0-21swapper/621:53:156
415253299109,1cyclictest0-21swapper/621:27:526
415253299109,1cyclictest0-21swapper/620:29:226
415253299109,1cyclictest0-21swapper/600:06:576
415253299109,1cyclictest0-21swapper/600:06:576
415253299108,2cyclictest86-21ksoftirqd/623:32:096
415253299107,2cyclictest4160979-21ntpq19:07:046
415252399109,1cyclictest0-21swapper/419:56:374
415252399108,2cyclictest66369-21kworker/u16:4+flush-8:020:52:544
415252399108,2cyclictest3887171-21kworker/u16:2+flush-8:019:26:434
41525359994,4cyclictest6101-21gmain19:31:417
41525329998,1cyclictest0-21swapper/623:02:476
41525329998,1cyclictest0-21swapper/622:37:246
41525329997,2cyclictest86-21ksoftirqd/600:34:256
41525329990,8cyclictest4162536-21munin-node19:11:426
41525239997,2cyclictest44841-21kworker/u16:3+flush-8:020:45:234
41525239997,2cyclictest4186814-21kworker/u16:0+events_unbound19:46:254
41525329986,2cyclictest86-21ksoftirqd/623:48:226
41525329976,1cyclictest0-21swapper/620:23:426
41525329976,1cyclictest0-21swapper/619:16:586
41525329971,1cyclictest0-21swapper/600:02:136
41525329965,1cyclictest0-21swapper/619:56:546
41525329964,2cyclictest86-21ksoftirqd/620:36:556
41525329962,1cyclictest0-21swapper/620:16:216
41525329961,5cyclictest0-21swapper/619:33:446
41525329960,6cyclictest0-21swapper/619:46:556
41525329960,6cyclictest0-21swapper/619:26:586
41525329960,1cyclictest0-21swapper/620:46:136
41525329960,1cyclictest0-21swapper/620:10:236
41525329950,5cyclictest0-21swapper/619:41:446
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional