You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 09:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Mar 28, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2555632970,1sleep7255562-21grep23:12:577
3904668994947,2cyclictest160415-21kworker/u16:5+flush-8:023:18:196
3904668994947,2cyclictest160415-21kworker/u16:5+flush-8:023:18:196
390414924838,7sleep40-21swapper/418:59:574
3904668994745,2cyclictest62875-21kworker/u16:4+flush-8:022:08:216
3904668994644,2cyclictest299854-21kworker/u16:1+events_unbound23:46:156
3266862450,1sleep50-21swapper/523:42:285
3904668994341,2cyclictest327094-21kworker/u16:2+events_unbound23:56:276
3904668994341,2cyclictest327094-21kworker/u16:2+events_unbound23:52:446
3904668994341,2cyclictest299854-21kworker/u16:1+events_unbound00:17:536
3904668994341,2cyclictest267077-21kworker/u16:0+events_unbound00:01:476
3904668994341,2cyclictest195975-21kworker/u16:1+events_unbound23:12:196
3904668994341,2cyclictest16099-21kworker/u16:5+events_unbound21:49:436
3904668994340,2cyclictest195975-21kworker/u16:1+events_unbound23:12:586
3904668994240,2cyclictest51900-21kworker/u16:1+events_unbound21:59:026
3904668994240,2cyclictest160415-21kworker/u16:5+events_unbound22:36:436
3904670994134,6cyclictest650-21systemd-journal19:12:577
3904668994139,2cyclictest16099-21kworker/u16:5+events_unbound21:43:556
3904668994139,2cyclictest160415-21kworker/u16:5+events_unbound22:40:126
390414124116,8sleep50-21swapper/518:59:505
3904668994038,2cyclictest4138081-21kworker/u16:3+events_unbound21:05:316
3904668994038,2cyclictest4089870-21kworker/u16:2+events_unbound21:13:596
3904668994038,2cyclictest398728-21kworker/u16:3+events_unbound00:26:156
3904668994038,2cyclictest195975-21kworker/u16:1+events_unbound22:55:526
3904668994038,2cyclictest160415-21kworker/u16:5+events_unbound23:04:476
3904668993937,2cyclictest4089870-21kworker/u16:2+events_unbound21:30:436
3904668993937,2cyclictest4013541-21kworker/u16:4+flush-8:020:33:196
3904668993937,2cyclictest267077-21kworker/u16:0+events_unbound23:42:406
3904668993937,2cyclictest267077-21kworker/u16:0+events_unbound23:35:116
3904668993937,2cyclictest267077-21kworker/u16:0+events_unbound00:21:226
3904668993937,2cyclictest207500-21kworker/u16:2+events_unbound23:26:196
3904668993937,2cyclictest160415-21kworker/u16:5+events_unbound23:02:546
3904668993937,2cyclictest160415-21kworker/u16:5+events_unbound22:50:046
3904668993937,2cyclictest146040-21kworker/u16:1+events_unbound22:27:246
390419823929,7sleep60-21swapper/619:00:396
3904668993836,2cyclictest62875-21kworker/u16:4+events_unbound22:06:046
3904668993836,2cyclictest4186003-21kworker/u16:0+events_unbound21:40:596
3904668993836,2cyclictest4138081-21kworker/u16:3+events_unbound21:21:406
3904668993836,2cyclictest299854-21kworker/u16:1+events_unbound23:32:236
38952722383,30sleep70-21swapper/718:57:597
3904670993735,1cyclictest64250-21ssh21:52:587
3904668993735,2cyclictest62875-21kworker/u16:4+events_unbound21:56:186
3904668993735,2cyclictest4089870-21kworker/u16:2+events_unbound21:24:116
3904668993735,2cyclictest267077-21kworker/u16:0+events_unbound00:05:386
3904666993735,2cyclictest62875-21kworker/u16:4+flush-8:022:02:515
3904670993631,4cyclictest4185595-21latency_hist21:22:567
3904668993634,2cyclictest62875-21kworker/u16:4+events_unbound22:31:166
3904668993634,2cyclictest4138081-21kworker/u16:3+events_unbound21:33:556
3904668993634,2cyclictest4138081-21kworker/u16:3+events_unbound21:09:086
3904668993634,2cyclictest299854-21kworker/u16:1+events_unbound00:29:366
3904666993633,2cyclictest299854-21kworker/u16:1+flush-8:000:03:025
3904668993533,2cyclictest87889-21kworker/u16:0+events_unbound22:47:306
3904668993533,2cyclictest62826-21kworker/u16:2+events_unbound22:20:356
3904668993533,2cyclictest112761-21kworker/u16:1+events_unbound22:14:406
3904668993532,2cyclictest4013541-21kworker/u16:4+events_unbound20:47:596
3904666993533,2cyclictest3914068-21kworker/u16:2+flush-8:019:18:225
3904668993433,1cyclictest267077-21kworker/u16:0+events_unbound00:09:276
3904668993331,2cyclictest3841765-21kworker/u16:0+flush-8:019:07:566
3904670993231,0cyclictest0-21swapper/722:33:287
3904668993028,2cyclictest3946617-21kworker/u16:3+events_unbound20:17:116
3904668993028,2cyclictest3841765-21kworker/u16:0+events_unbound19:34:276
3904668993028,2cyclictest3841765-21kworker/u16:0+events_unbound19:22:086
3904666992927,2cyclictest267077-21kworker/u16:0+flush-8:000:13:305
3904666992927,2cyclictest207500-21kworker/u16:2+flush-8:022:58:275
3904662992927,2cyclictest51900-21kworker/u16:1+events_unbound21:58:524
3904662992926,2cyclictest267077-21kworker/u16:0+events_unbound23:43:104
3904666992825,2cyclictest16099-21kworker/u16:5+flush-8:021:43:035
3904662992825,2cyclictest4071089-21kworker/u16:1+flush-8:021:08:334
3904670992725,1cyclictest0-21swapper/722:43:127
3904668992725,2cyclictest3946823-21kworker/u16:4+events_unbound19:29:126
3904668992725,2cyclictest3946617-21kworker/u16:3+events_unbound19:27:076
3904666992725,2cyclictest87889-21kworker/u16:0+events_unbound22:23:555
3904666992725,2cyclictest4013541-21kworker/u16:4+flush-8:020:47:565
3904666992725,2cyclictest4013541-21kworker/u16:4+flush-8:020:47:565
3904662992725,2cyclictest62826-21kworker/u16:2+events_unbound22:18:214
3904662992725,2cyclictest267077-21kworker/u16:0+flush-8:023:42:134
3904662992725,2cyclictest16099-21kworker/u16:5+flush-8:021:38:354
3904662992724,3cyclictest207500-21kworker/u16:2+events_unbound23:13:084
3904662992724,2cyclictest87889-21kworker/u16:0+flush-8:022:03:164
3904662992724,2cyclictest299854-21kworker/u16:1+flush-8:000:28:064
3904670992625,0cyclictest0-21swapper/723:58:227
390467099260,1cyclictest0-21swapper/723:03:227
3904668992624,2cyclictest4061131-21kworker/u16:0+events_unbound20:32:086
3904668992624,2cyclictest3841765-21kworker/u16:0+events_unbound19:11:436
3904666992624,2cyclictest4186003-21kworker/u16:0+events_unbound21:37:595
3904670992525,0cyclictest0-21swapper/721:50:007
3904668992523,2cyclictest3994673-21kworker/u16:2+flush-8:019:53:076
3904668992523,2cyclictest3946617-21kworker/u16:3+events_unbound20:22:556
3904668992523,2cyclictest3946617-21kworker/u16:3+events_unbound20:04:326
3904666992523,2cyclictest4071089-21kworker/u16:1+flush-8:020:53:225
3904662992524,1cyclictest87889-21kworker/u16:0+events_unbound22:08:304
3904662992523,2cyclictest299854-21kworker/u16:1+flush-8:023:58:114
3904670992423,0cyclictest0-21swapper/720:12:437
3904668992422,2cyclictest3946617-21kworker/u16:3+events_unbound19:44:096
3904666992422,2cyclictest4089870-21kworker/u16:2+flush-8:021:22:565
3904666992422,2cyclictest4013541-21kworker/u16:4+events_unbound20:48:275
3904666992422,2cyclictest195975-21kworker/u16:1+events_unbound23:10:045
3904662992422,2cyclictest62826-21kworker/u16:2+events_unbound21:53:454
3904662992422,2cyclictest207500-21kworker/u16:2+flush-8:022:58:404
3904670992322,0cyclictest0-21swapper/719:38:117
3904668992320,2cyclictest3841765-21kworker/u16:0+events_unbound19:12:596
3904666992321,2cyclictest299854-21kworker/u16:1+events_unbound23:32:585
3904666992320,2cyclictest3946617-21kworker/u16:3+flush-8:019:43:125
3904662992321,2cyclictest4071089-21kworker/u16:1+events_unbound21:23:124
3904662992321,2cyclictest4061131-21kworker/u16:0+events_unbound20:23:224
3904662992321,2cyclictest4013541-21kworker/u16:4+events_unbound20:37:364
3904662992321,2cyclictest3897322-21kworker/u16:1+events_unbound19:08:004
3904662992321,2cyclictest327094-21kworker/u16:2+flush-8:023:53:224
3904662992321,2cyclictest16099-21kworker/u16:5+events_unbound21:48:194
3904662992321,2cyclictest160415-21kworker/u16:5+events_unbound22:48:154
3904670992222,0cyclictest0-21swapper/700:18:457
3904670992221,0cyclictest0-21swapper/719:25:257
3904670992220,1cyclictest4127873-21sshd20:55:377
3904668992220,2cyclictest4013541-21kworker/u16:4+events_unbound20:41:156
3904666992220,2cyclictest3946823-21kworker/u16:4+events_unbound19:37:525
3904666992220,2cyclictest327094-21kworker/u16:2+flush-8:023:48:225
3904666992220,2cyclictest299854-21kworker/u16:1+events_unbound00:32:545
3904666992218,3cyclictest3897322-21kworker/u16:1+flush-8:019:03:185
3904662992220,2cyclictest4089870-21kworker/u16:2+flush-8:021:28:234
3904662992220,2cyclictest3841765-21kworker/u16:0+events_unbound19:13:124
3904662992220,2cyclictest159836-21kworker/u16:3+events_unbound22:38:214
3904662992220,2cyclictest146040-21kworker/u16:1+flush-8:022:32:524
3904668992119,2cyclictest4061131-21kworker/u16:0+events_unbound20:27:486
3904668992119,2cyclictest4013541-21kworker/u16:4+flush-8:020:58:596
3904668992119,2cyclictest3994673-21kworker/u16:2+events_unbound19:59:126
3904668992118,2cyclictest4013541-21kworker/u16:4+events_unbound20:53:006
3904666992120,1cyclictest159836-21kworker/u16:3+events_unbound22:54:345
3904666992119,2cyclictest87889-21kworker/u16:0+events_unbound22:03:395
3904666992119,2cyclictest4071089-21kworker/u16:1+events_unbound20:42:515
3904666992119,2cyclictest267077-21kworker/u16:0+events_unbound23:43:085
3904666992119,2cyclictest267077-21kworker/u16:0+events_unbound23:27:435
3904666992119,2cyclictest207500-21kworker/u16:2+events_unbound23:18:225
3904666992119,2cyclictest207500-21kworker/u16:2+events_unbound23:18:225
3904662992119,2cyclictest3946823-21kworker/u16:4+events_unbound19:28:214
3904662992119,2cyclictest3946617-21kworker/u16:3+events_unbound20:20:464
3904662992119,2cyclictest195975-21kworker/u16:1+events_unbound23:08:204
3904662992119,2cyclictest160415-21kworker/u16:5+flush-8:022:43:264
3904662992119,2cyclictest160415-21kworker/u16:5+events_unbound23:28:264
3904670992019,0cyclictest0-21swapper/723:13:087
3904670992019,0cyclictest0-21swapper/719:06:517
3904668992018,2cyclictest3841765-21kworker/u16:0+flush-8:019:38:076
3904666992018,2cyclictest3994673-21kworker/u16:2+flush-8:020:13:185
3904666992018,2cyclictest398728-21kworker/u16:3+events_unbound00:20:355
3904666992018,2cyclictest195975-21kworker/u16:1+events_unbound23:07:435
3904662992018,2cyclictest4013541-21kworker/u16:4+events_unbound20:00:504
3904662992018,2cyclictest267077-21kworker/u16:0+flush-8:023:33:294
3904662992018,2cyclictest267077-21kworker/u16:0+events_unbound00:03:084
390467099198,9cyclictest0-21swapper/722:28:197
3904670991918,0cyclictest0-21swapper/722:07:577
3904670991918,0cyclictest0-21swapper/721:02:497
3904670991918,0cyclictest0-21swapper/719:14:547
3904670991917,1cyclictest0-21swapper/723:48:147
3904670991913,5cyclictest3994291-21latency_hist19:47:567
3904668991917,2cyclictest3994673-21kworker/u16:2+events_unbound19:51:236
3904666991917,2cyclictest4089870-21kworker/u16:2+flush-8:021:03:135
3904666991917,2cyclictest267077-21kworker/u16:0+events_unbound00:08:105
3904666991917,2cyclictest16099-21kworker/u16:5+flush-8:021:48:275
3904666991917,2cyclictest160415-21kworker/u16:5+flush-8:022:44:595
3904666991917,2cyclictest160415-21kworker/u16:5+events_unbound22:48:485
3904666991917,2cyclictest159836-21kworker/u16:3+events_unbound22:37:385
3904666991916,2cyclictest3946617-21kworker/u16:3+events_unbound19:28:175
3904662991917,2cyclictest4013541-21kworker/u16:4+events_unbound20:52:024
3904662991917,2cyclictest3975566-21kworker/u16:1+events_unbound19:54:014
3904662991917,2cyclictest3841765-21kworker/u16:0+events_unbound19:35:064
3904662991917,2cyclictest267077-21kworker/u16:0+flush-8:023:23:484
3904662991917,2cyclictest112761-21kworker/u16:1+events_unbound22:13:124
390467099186,10cyclictest0-21swapper/723:43:177
3904670991818,0cyclictest0-21swapper/719:20:137
3904670991817,1cyclictest136810-21ssh22:23:117
3904670991812,5cyclictest4003848-21latency_hist19:52:577
3904666991816,2cyclictest4089870-21kworker/u16:2+events_unbound21:32:435
3904666991816,2cyclictest299854-21kworker/u16:1+events_unbound23:57:435
3904666991816,2cyclictest195975-21kworker/u16:1+events_unbound23:15:285
3904666991815,2cyclictest62875-21kworker/u16:4+events_unbound22:27:595
3904666991814,3cyclictest3841765-21kworker/u16:0+flush-8:019:23:155
3904662991816,2cyclictest4138081-21kworker/u16:3+flush-8:021:33:234
3904662991816,2cyclictest3946617-21kworker/u16:3+flush-8:020:08:394
3904662991816,2cyclictest3946617-21kworker/u16:3+events_unbound20:17:344
3904662991816,2cyclictest299854-21kworker/u16:1+events_unbound00:13:234
3904662991813,4cyclictest268554-21cat23:18:104
3904662991813,4cyclictest268554-21cat23:18:104
390467099177,8cyclictest0-21swapper/700:03:197
3904670991717,0cyclictest0-21swapper/722:48:217
3904670991717,0cyclictest0-21swapper/720:38:227
3904670991717,0cyclictest0-21swapper/720:35:457
3904670991717,0cyclictest0-21swapper/720:32:147
3904670991716,0cyclictest0-21swapper/720:46:147
3904670991716,0cyclictest0-21swapper/720:46:147
3904670991716,0cyclictest0-21swapper/720:21:097
3904670991716,0cyclictest0-21swapper/720:17:427
3904670991716,0cyclictest0-21swapper/719:37:057
3904670991716,0cyclictest0-21swapper/719:29:497
3904670991715,1cyclictest443652-21ssh00:28:237
390467099170,16cyclictest1267-21snmpd21:29:517
3904666991716,1cyclictest4138081-21kworker/u16:3+events_unbound21:11:075
3904666991715,2cyclictest87889-21kworker/u16:0+events_unbound22:22:565
3904666991715,2cyclictest4138081-21kworker/u16:3+flush-8:021:33:255
3904666991715,2cyclictest398728-21kworker/u16:3+events_unbound00:26:035
3904666991715,2cyclictest299854-21kworker/u16:1+events_unbound23:59:035
3904662991715,2cyclictest4071089-21kworker/u16:1+events_unbound20:58:114
3904662991715,2cyclictest4071089-21kworker/u16:1+events_unbound20:45:214
3904662991715,2cyclictest4071089-21kworker/u16:1+events_unbound20:45:214
390467099168,7cyclictest0-21swapper/723:53:187
390467099168,7cyclictest0-21swapper/721:43:127
3904670991616,0cyclictest0-21swapper/720:26:227
3904670991615,0cyclictest0-21swapper/722:13:217
3904670991612,3cyclictest303054-21latency_hist23:32:567
3904670991611,4cyclictest4032533-21latency_hist20:07:577
3904666991614,2cyclictest4071089-21kworker/u16:1+events_unbound21:16:435
3904666991614,2cyclictest4061131-21kworker/u16:0+flush-8:020:33:225
3904666991614,2cyclictest3994673-21kworker/u16:2+events_unbound20:18:275
3904666991614,2cyclictest3994673-21kworker/u16:2+events_unbound20:03:245
3904662991614,2cyclictest4071089-21kworker/u16:1+events_unbound20:53:224
3904662991614,2cyclictest4061131-21kworker/u16:0+events_unbound20:31:254
3904662991614,2cyclictest3994673-21kworker/u16:2+flush-8:019:48:174
3904662991614,2cyclictest3994673-21kworker/u16:2+events_unbound20:03:474
3904662991613,2cyclictest4071089-21kworker/u16:1+flush-8:021:17:574
390467099156,8cyclictest0-21swapper/700:23:227
390467099156,8cyclictest0-21swapper/700:13:217
390467099156,7cyclictest0-21swapper/721:13:107
3904670991513,1cyclictest951ktimers/723:38:267
3904670991512,2cyclictest1267-21snmpd23:00:357
3904668991513,2cyclictest4071089-21kworker/u16:1+flush-8:020:44:116
3904668991513,2cyclictest4071089-21kworker/u16:1+flush-8:020:44:116
3904666991513,2cyclictest62875-21kworker/u16:4+events_unbound21:55:195
3904666991513,2cyclictest160415-21kworker/u16:5+events_unbound22:41:425
3904666991512,2cyclictest62875-21kworker/u16:4+events_unbound22:13:005
3904666991512,2cyclictest4061131-21kworker/u16:0+flush-8:020:28:135
3904662991513,2cyclictest4071089-21kworker/u16:1+flush-8:021:03:204
3904662991513,2cyclictest3841765-21kworker/u16:0+events_unbound19:23:124
3904662991513,2cyclictest267077-21kworker/u16:0+events_unbound00:10:314
3904662991513,2cyclictest160415-21kworker/u16:5+events_unbound23:04:104
3904662991513,2cyclictest160415-21kworker/u16:5+events_unbound22:34:164
390467099146,7cyclictest0-21swapper/722:38:217
390467099146,7cyclictest0-21swapper/721:08:337
390467099144,8cyclictest0-21swapper/722:03:227
3904670991414,0cyclictest0-21swapper/720:01:377
3904670991413,0cyclictest0-21swapper/723:33:147
3904670991411,2cyclictest1267-21snmpd21:27:517
390467099140,1cyclictest0-21swapper/721:58:207
3904666991413,1cyclictest0-21swapper/521:23:505
3904662991413,1cyclictest0-21swapper/400:21:424
3904662991412,2cyclictest62826-21kworker/u16:2+events_unbound22:23:314
3904662991412,2cyclictest3946617-21kworker/u16:3+flush-8:019:38:554
3904662991412,2cyclictest3914068-21kworker/u16:2+flush-8:019:18:124
3904662991412,2cyclictest3841765-21kworker/u16:0+events_unbound19:03:224
3904662991412,2cyclictest327094-21kworker/u16:2+events_unbound23:48:094
3904662991412,2cyclictest195975-21kworker/u16:1+flush-8:022:53:224
390467099139,3cyclictest1267-21snmpd21:38:227
390467099139,3cyclictest1267-21snmpd20:49:037
390467099136,6cyclictest0-21swapper/723:23:107
390467099136,6cyclictest0-21swapper/723:18:117
390467099136,6cyclictest0-21swapper/723:18:117
390467099136,6cyclictest0-21swapper/722:54:067
390467099136,6cyclictest0-21swapper/722:18:107
390467099135,7cyclictest0-21swapper/721:33:127
390467099135,7cyclictest0-21swapper/700:08:197
390467099134,8cyclictest0-21swapper/721:03:047
3904666991312,1cyclictest0-21swapper/522:10:115
3904666991311,2cyclictest3994673-21kworker/u16:2+events_unbound19:53:205
3904662991311,2cyclictest4186003-21kworker/u16:0+flush-8:021:43:214
3904662991311,2cyclictest3946617-21kworker/u16:3+events_unbound19:43:104
390467099128,3cyclictest1267-21snmpd19:54:507
3904668991210,2cyclictest3946617-21kworker/u16:3+events_unbound20:11:276
3904662991211,1cyclictest0-21swapper/421:15:124
3904662991210,2cyclictest4013541-21kworker/u16:4+flush-8:020:38:514
3904662991210,2cyclictest299854-21kworker/u16:1+events_unbound00:24:164
390466699119,2cyclictest3841765-21kworker/u16:0+flush-8:019:13:125
390466699119,2cyclictest160415-21kworker/u16:5+events_unbound23:31:385
390466699109,1cyclictest0-21swapper/520:11:385
390466699109,1cyclictest0-21swapper/520:00:265
390466699109,1cyclictest0-21swapper/519:51:565
39046669998,1cyclictest0-21swapper/519:40:255
39046669987,1cyclictest0-21swapper/520:58:185
39046669986,1cyclictest0-21swapper/520:23:255
39046669983,4cyclictest3914757-21tr19:07:585
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional