You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 16:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Mar 26, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21292121040,0sleep40-21swapper/409:23:384
5911662970,1sleep7591167-21tr12:03:227
5715772970,0sleep50-21swapper/511:53:265
4439322780,1sleep7443933-21ssh11:03:037
4115091995553,2cyclictest395620-21kworker/u16:5+events_unbound10:53:325
4115091995553,2cyclictest3415691-21kworker/u16:5+flush-8:007:18:185
4115091995351,2cyclictest335520-21kworker/u16:3+events_unbound10:23:325
411509999520,50cyclictest635476-21latency_hist12:23:027
4115091995149,2cyclictest585448-21kworker/u16:0+flush-8:012:08:325
4115091995149,2cyclictest383629-21kworker/u16:1+flush-8:010:43:325
4115099995049,0cyclictest0-21swapper/707:30:507
4115099995049,0cyclictest0-21swapper/707:30:507
4115091995049,1cyclictest395620-21kworker/u16:5+events_unbound11:06:315
4115091995048,2cyclictest177026-21kworker/u16:4+flush-8:009:13:345
4115099994944,4cyclictest515695-21latency_hist11:33:027
4115091994947,2cyclictest383629-21kworker/u16:1+flush-8:010:58:355
4115091994947,2cyclictest238384-21kworker/u16:2+flush-8:009:43:175
4115091994846,2cyclictest4166519-21kworker/u16:3+events_unbound09:08:315
411478224838,7sleep50-21swapper/507:02:375
4115091994745,2cyclictest441574-21kworker/u16:0+events_unbound11:27:535
4115091994745,2cyclictest395620-21kworker/u16:5+events_unbound12:28:365
4115091994745,2cyclictest261960-21kworker/u16:0+events_unbound09:52:255
4115091994644,2cyclictest261960-21kworker/u16:0+events_unbound10:53:005
4115091994644,2cyclictest261960-21kworker/u16:0+events_unbound10:28:295
4115091994644,2cyclictest238384-21kworker/u16:2+events_unbound10:40:365
4115096994542,2cyclictest3405491-21kworker/u16:4+events_unbound07:08:066
4115091994543,2cyclictest585448-21kworker/u16:0+events_unbound12:05:525
4115091994543,2cyclictest395620-21kworker/u16:5+events_unbound11:44:535
4115091994543,2cyclictest177026-21kworker/u16:4+events_unbound09:41:095
4115091994442,2cyclictest275476-21kworker/u16:1+events_unbound10:07:055
4115091994341,2cyclictest146014-21kworker/u16:1+events_unbound09:25:295
4115091994340,2cyclictest146014-21kworker/u16:1+events_unbound09:28:135
4115089994341,2cyclictest238384-21kworker/u16:2+events_unbound10:38:194
4115091994240,2cyclictest467802-21kworker/u16:2+events_unbound11:15:015
4115091994240,2cyclictest261960-21kworker/u16:0+flush-8:010:13:345
4115091994240,2cyclictest261960-21kworker/u16:0+flush-8:010:13:345
4115091994139,2cyclictest68851-21kworker/u16:2+flush-8:008:28:275
4115091994139,2cyclictest395620-21kworker/u16:5+flush-8:011:33:415
4115091994139,2cyclictest395620-21kworker/u16:5+flush-8:011:33:415
4115091994139,2cyclictest395620-21kworker/u16:5+events_unbound11:48:155
4115091994139,2cyclictest395620-21kworker/u16:5+events_unbound11:40:455
4115091994139,2cyclictest238384-21kworker/u16:2+events_unbound10:01:015
4115091994139,2cyclictest238384-21kworker/u16:2+events_unbound09:36:455
4115091994038,2cyclictest585448-21kworker/u16:0+events_unbound12:18:345
4115091994038,2cyclictest467802-21kworker/u16:2+events_unbound11:20:165
4115091994038,2cyclictest395620-21kworker/u16:5+events_unbound12:26:005
4115091994038,2cyclictest395620-21kworker/u16:5+events_unbound12:02:255
4115091994037,2cyclictest4177880-21kworker/u16:4+events_unbound07:48:165
4115099993934,4cyclictest440837-21switchtime10:58:417
4115096993935,3cyclictest383629-21kworker/u16:1+flush-8:010:43:036
4115091993937,2cyclictest395620-21kworker/u16:5+flush-8:012:13:205
4115091993937,2cyclictest395620-21kworker/u16:5+events_unbound11:30:495
4115091993937,2cyclictest383629-21kworker/u16:1+events_unbound11:10:415
4115091993937,2cyclictest335520-21kworker/u16:3+events_unbound10:20:535
4115091993937,2cyclictest261960-21kworker/u16:0+flush-8:009:54:095
4115091993937,2cyclictest238384-21kworker/u16:2+events_unbound10:10:405
4115091993936,2cyclictest335520-21kworker/u16:3+events_unbound10:33:065
4115089993936,2cyclictest395620-21kworker/u16:5+flush-8:011:48:184
411481123929,7sleep40-21swapper/407:03:004
4115091993836,2cyclictest68851-21kworker/u16:2+flush-8:008:23:325
4115091993835,2cyclictest68851-21kworker/u16:2+events_unbound08:18:175
41145692383,31sleep70-21swapper/706:59:347
4115096993734,2cyclictest585448-21kworker/u16:0+flush-8:012:17:576
4115091993735,2cyclictest146014-21kworker/u16:1+events_unbound09:04:345
4115091993735,2cyclictest11766-21kworker/u16:0+events_unbound08:48:335
4115089993735,2cyclictest467802-21kworker/u16:2+flush-8:011:43:314
4115099993635,0cyclictest0-21swapper/709:32:557
4115089993634,2cyclictest4177879-21kworker/u16:1+events_unbound07:33:304
4115089993634,2cyclictest146014-21kworker/u16:1+events_unbound08:58:274
4115091993533,2cyclictest3405491-21kworker/u16:4+events_unbound07:13:345
4115089993533,2cyclictest4177880-21kworker/u16:4+events_unbound07:39:534
4115089993533,2cyclictest177026-21kworker/u16:4+events_unbound09:13:444
4115099993433,0cyclictest0-21swapper/708:07:547
411509999340,33cyclictest1033-21rs:main7
4115091993432,2cyclictest4166519-21kworker/u16:3+flush-8:007:58:265
4115089993432,2cyclictest383629-21kworker/u16:1+events_unbound11:02:394
411470923424,7sleep60-21swapper/607:01:346
4115099993330,2cyclictest108248-21df08:38:157
4115096993331,2cyclictest395620-21kworker/u16:5+flush-8:011:48:306
4115091993331,2cyclictest177026-21kworker/u16:4+events_unbound09:21:015
4115089993331,2cyclictest238384-21kworker/u16:2+events_unbound10:37:464
4115089993331,2cyclictest238384-21kworker/u16:2+events_unbound10:15:434
4115089993331,2cyclictest238384-21kworker/u16:2+events_unbound10:15:434
4115089993331,2cyclictest146014-21kworker/u16:1+events_unbound09:03:464
4115089993330,2cyclictest261960-21kworker/u16:0+events_unbound10:43:104
4115099993229,2cyclictest393267-21ssh10:38:517
4115099993227,4cyclictest611573-21latency_hist12:13:027
4115089993230,2cyclictest261960-21kworker/u16:0+events_unbound10:49:044
2688962320,1chrt268897-21kthreadcore09:48:257
4115099993128,2cyclictest525416-21ssh11:33:477
4115099993128,2cyclictest525416-21ssh11:33:477
4115091993129,2cyclictest146014-21kworker/u16:1+flush-8:008:58:265
4115089993129,2cyclictest68851-21kworker/u16:2+events_unbound08:19:534
4115089993129,2cyclictest3405491-21kworker/u16:4+events_unbound07:15:494
4115089993129,2cyclictest3405491-21kworker/u16:4+events_unbound07:05:534
4115089993129,2cyclictest275476-21kworker/u16:1+events_unbound10:03:434
4115089993129,2cyclictest146014-21kworker/u16:1+flush-8:009:18:364
4115099993029,0cyclictest0-21swapper/708:28:357
4115099993029,0cyclictest0-21swapper/707:11:417
4115099993025,4cyclictest563610-21latency_hist11:53:027
4115099993024,5cyclictest4147497-21latency_hist07:18:027
4115096993028,2cyclictest383629-21kworker/u16:1+flush-8:011:06:456
4115089993028,2cyclictest585448-21kworker/u16:0+events_unbound12:09:024
4115089993028,2cyclictest467802-21kworker/u16:2+events_unbound11:33:594
4115089993028,2cyclictest467802-21kworker/u16:2+events_unbound11:33:594
4115089993028,2cyclictest4177879-21kworker/u16:1+flush-8:008:08:574
4115089993028,2cyclictest4177879-21kworker/u16:1+events_unbound08:04:174
4115089993028,2cyclictest4166519-21kworker/u16:3+events_unbound08:28:154
4115089993028,2cyclictest4166519-21kworker/u16:3+events_unbound07:46:574
4115089993028,2cyclictest177026-21kworker/u16:4+events_unbound09:39:124
4115099992928,0cyclictest0-21swapper/708:44:217
4115099992928,0cyclictest0-21swapper/708:14:057
4115099992928,0cyclictest0-21swapper/707:26:427
4115089992927,2cyclictest4166519-21kworker/u16:3+events_unbound08:50:564
4115089992927,2cyclictest4166519-21kworker/u16:3+events_unbound08:27:344
4115089992927,2cyclictest4166519-21kworker/u16:3+events_unbound07:56:554
4115089992927,2cyclictest4157113-21kworker/u16:0+events_unbound07:25:204
4115089992927,2cyclictest238384-21kworker/u16:2+events_unbound10:09:434
2723252290,1sleep40-21swapper/409:48:304
4115099992825,2cyclictest249285-21ssh09:39:067
4115091992826,2cyclictest3405491-21kworker/u16:4+flush-8:007:08:095
4115091992825,2cyclictest4177880-21kworker/u16:4+flush-8:007:43:195
4115089992826,2cyclictest4177879-21kworker/u16:1+events_unbound07:59:534
4115089992826,2cyclictest4177879-21kworker/u16:1+events_unbound07:51:114
4115089992826,2cyclictest3405491-21kworker/u16:4+events_unbound07:19:344
4115089992826,2cyclictest11766-21kworker/u16:0+events_unbound08:41:584
4115099992726,0cyclictest0-21swapper/708:50:267
4115099992726,0cyclictest0-21swapper/708:19:577
4115099992726,0cyclictest0-21swapper/707:51:417
4115099992726,0cyclictest0-21swapper/707:21:497
4115091992725,2cyclictest4177880-21kworker/u16:4+events_unbound07:33:225
4115091992725,2cyclictest4177879-21kworker/u16:1+events_unbound08:13:465
4115091992725,2cyclictest4157113-21kworker/u16:0+events_unbound07:27:375
4115091992725,2cyclictest4116518-21kworker/u16:2+flush-8:007:28:215
4115091992725,2cyclictest4116518-21kworker/u16:2+flush-8:007:28:215
4115089992725,2cyclictest395620-21kworker/u16:5+events_unbound11:12:584
4115089992725,2cyclictest238384-21kworker/u16:2+events_unbound09:54:254
4115089992725,2cyclictest177026-21kworker/u16:4+flush-8:009:33:234
4115099992626,0cyclictest0-21swapper/710:09:277
4115099992622,3cyclictest650-21systemd-journal12:03:027
4115096992622,3cyclictest4166519-21kworker/u16:3+flush-8:008:23:286
4115091992624,2cyclictest4177879-21kworker/u16:1+events_unbound07:53:155
4115091992624,2cyclictest4166519-21kworker/u16:3+flush-8:008:43:205
4115089992624,2cyclictest68851-21kworker/u16:2+events_unbound08:34:524
4115089992624,2cyclictest4166519-21kworker/u16:3+events_unbound07:31:414
4115089992624,2cyclictest4166519-21kworker/u16:3+events_unbound07:31:414
4115089992624,2cyclictest238384-21kworker/u16:2+flush-8:010:18:174
4115089992624,2cyclictest177026-21kworker/u16:4+events_unbound09:10:114
4115089992624,2cyclictest136207-21kworker/u16:2+events_unbound08:56:404
4115089992624,2cyclictest11766-21kworker/u16:0+events_unbound08:46:224
4115099992525,0cyclictest0-21swapper/707:45:027
4115099992524,0cyclictest0-21swapper/709:01:417
4115099992524,0cyclictest0-21swapper/708:12:497
4115099992524,0cyclictest0-21swapper/708:00:307
4115099992524,0cyclictest0-21swapper/707:34:457
4115096992523,2cyclictest623938-21kworker/u16:1+flush-8:012:28:246
4115096992523,2cyclictest395620-21kworker/u16:5+flush-8:011:33:376
4115096992523,2cyclictest395620-21kworker/u16:5+flush-8:011:33:376
4115089992523,2cyclictest395620-21kworker/u16:5+events_unbound11:14:424
4115091992422,2cyclictest4177879-21kworker/u16:1+events_unbound08:08:175
4115089992422,2cyclictest335520-21kworker/u16:3+events_unbound10:28:034
4115089992422,2cyclictest11766-21kworker/u16:0+events_unbound08:16:324
4115099992322,0cyclictest0-21swapper/708:23:547
4115096992321,2cyclictest441574-21kworker/u16:0+flush-8:011:28:336
4115091992321,2cyclictest68851-21kworker/u16:2+events_unbound08:33:325
4115091992321,2cyclictest4166519-21kworker/u16:3+events_unbound08:39:145
4115091992321,2cyclictest11766-21kworker/u16:0+events_unbound08:03:155
4115089992321,2cyclictest395620-21kworker/u16:5+events_unbound11:58:384
4115089992321,2cyclictest3405491-21kworker/u16:4+events_unbound07:11:454
4115099992221,0cyclictest0-21swapper/708:54:017
4115099992217,4cyclictest371414-21latency_hist10:33:037
4115089992220,2cyclictest238384-21kworker/u16:2+events_unbound09:44:284
4115099992121,0cyclictest0-21swapper/712:15:587
4115099992121,0cyclictest0-21swapper/710:04:107
4115099992120,0cyclictest0-21swapper/707:56:577
4115089992119,2cyclictest395620-21kworker/u16:5+flush-8:012:18:454
4115099992020,0cyclictest0-21swapper/711:54:227
4115099992018,1cyclictest0-21swapper/710:45:187
4115096992018,2cyclictest4177879-21kworker/u16:1+flush-8:008:08:286
1912192200,1chrt191218-21ssh09:17:567
4115099991917,1cyclictest263640-21latency_hist09:48:037
4115091991917,2cyclictest4166519-21kworker/u16:3+events_unbound07:41:155
4115091991917,2cyclictest136207-21kworker/u16:2+events_unbound08:53:325
4115089991918,1cyclictest441574-21kworker/u16:0+events_unbound11:23:224
4115099991814,3cyclictest902-21dbus-daemon10:38:027
4115089991816,2cyclictest395620-21kworker/u16:5+flush-8:011:42:574
4115089991816,2cyclictest395620-21kworker/u16:5+flush-8:011:07:064
4115099991717,0cyclictest0-21swapper/708:36:407
4115099991712,4cyclictest179254-21latency_hist09:13:037
4115096991715,2cyclictest441574-21kworker/u16:0+flush-8:011:13:456
4115091991715,2cyclictest4116518-21kworker/u16:2+events_unbound07:04:175
4115099991616,0cyclictest0-21swapper/711:08:407
4115099991613,2cyclictest1267-21snmpd09:53:467
4115099991611,4cyclictest167222-21latency_hist09:08:037
4115096991614,2cyclictest146014-21kworker/u16:1+flush-8:009:42:576
4115089991614,2cyclictest261960-21kworker/u16:0+events_unbound10:28:094
6498212150,0sleep40-21swapper/412:28:204
411509999158,6cyclictest0-21swapper/711:18:377
411509999156,8cyclictest645768-21ssh12:24:527
411509999155,9cyclictest0-21swapper/710:21:087
4115099991513,1cyclictest470018-21ssh11:13:207
4115099991512,2cyclictest199798-21cut09:18:257
4115099991512,2cyclictest0-21swapper/711:38:337
4115096991513,2cyclictest11766-21kworker/u16:0+flush-8:008:18:516
4115096991512,2cyclictest238384-21kworker/u16:2+flush-8:010:13:036
4115096991512,2cyclictest238384-21kworker/u16:2+flush-8:010:13:036
411509999146,7cyclictest299421-21sshd-session10:03:007
411509999146,7cyclictest0-21swapper/709:37:377
411509999146,6cyclictest0-21swapper/710:53:047
411509999145,8cyclictest0-21swapper/709:27:547
4115096991413,1cyclictest0-21swapper/611:56:196
4115096991413,1cyclictest0-21swapper/611:46:236
4115096991413,1cyclictest0-21swapper/611:22:256
4115096991413,1cyclictest0-21swapper/610:58:186
411509699140,1cyclictest0-21swapper/609:51:376
411509699140,1cyclictest0-21swapper/607:58:166
411509699140,14cyclictest0-21swapper/609:18:596
411509699140,13cyclictest0-21swapper/607:38:146
4115089991413,1cyclictest0-21swapper/412:15:454
4115089991413,1cyclictest0-21swapper/409:58:174
4115089991412,2cyclictest395620-21kworker/u16:5+flush-8:012:03:274
411509999139,3cyclictest358981-21ssh10:27:127
411509999139,3cyclictest1267-21snmpd11:23:367
411509999136,6cyclictest0-21swapper/710:15:397
411509999136,6cyclictest0-21swapper/710:15:397
411509999135,7cyclictest0-21swapper/712:30:097
411509999135,7cyclictest0-21swapper/711:43:367
411509999134,8cyclictest409194-21irqcore10:48:187
4115099991312,0cyclictest0-21swapper/707:03:117
4115096991312,1cyclictest0-21swapper/611:26:226
4115096991312,1cyclictest0-21swapper/610:44:266
4115096991312,1cyclictest0-21swapper/610:34:206
4115096991312,1cyclictest0-21swapper/607:53:136
411509699130,1cyclictest0-21swapper/611:10:266
411509699130,13cyclictest0-21swapper/611:38:216
411509699130,13cyclictest0-21swapper/609:24:586
411509699130,13cyclictest0-21swapper/607:28:186
411509699130,13cyclictest0-21swapper/607:28:186
4115096991211,1cyclictest0-21swapper/612:24:046
4115096991211,1cyclictest0-21swapper/611:58:126
4115096991211,1cyclictest0-21swapper/610:48:226
411509699120,12cyclictest0-21swapper/612:18:046
4115089991211,1cyclictest0-21swapper/410:56:274
4115089991210,2cyclictest467802-21kworker/u16:2+events_unbound11:19:024
4115096991110,1cyclictest0-21swapper/612:12:056
4115096991110,1cyclictest0-21swapper/610:22:126
4115096991110,1cyclictest0-21swapper/609:07:006
4115096991110,1cyclictest0-21swapper/609:00:516
4115096991110,1cyclictest0-21swapper/608:49:396
4115096991110,1cyclictest0-21swapper/608:35:566
4115096991110,1cyclictest0-21swapper/608:29:106
4115096991110,1cyclictest0-21swapper/607:16:196
4115096991110,1cyclictest0-21swapper/607:04:206
411509699110,1cyclictest0-21swapper/608:45:056
411509699110,11cyclictest0-21swapper/608:15:276
4115089991110,1cyclictest0-21swapper/411:56:034
4115089991110,1cyclictest0-21swapper/409:29:354
411509699109,1cyclictest0-21swapper/612:06:056
411509699109,1cyclictest0-21swapper/610:28:116
411509699109,1cyclictest0-21swapper/610:08:106
411509699109,1cyclictest0-21swapper/609:43:156
41150969998,1cyclictest0-21swapper/610:04:046
41150969998,1cyclictest0-21swapper/610:02:016
41150969998,1cyclictest0-21swapper/609:55:436
41150969998,1cyclictest0-21swapper/609:35:036
41150969998,1cyclictest0-21swapper/608:38:096
41150969998,1cyclictest0-21swapper/608:05:406
41150969998,1cyclictest0-21swapper/607:48:106
41150899997,2cyclictest585448-21kworker/u16:0+events_unbound12:27:454
41150899997,2cyclictest395620-21kworker/u16:5+events_unbound11:31:134
41150969987,1cyclictest0-21swapper/609:12:596
41150969987,1cyclictest0-21swapper/607:33:126
41150969987,1cyclictest0-21swapper/607:23:256
41150969985,2cyclictest5755-21JS21:50:166
41150969971,1cyclictest0-21swapper/610:53:096
41150969965,1cyclictest0-21swapper/608:54:146
41150969965,1cyclictest0-21swapper/607:43:076
41150969965,1cyclictest0-21swapper/607:21:036
41150969964,2cyclictest261960-21kworker/u16:0+nfsiod10:26:126
41150969953,2cyclictest177026-21kworker/u16:4+nfsiod09:13:166
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional