You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 23:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Tue Nov 18, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10654625519,32sleep70-21swapper/715:20:107
107126995452,2cyclictest658208-21kworker/u16:3+events_unbound19:54:146
107124995048,2cyclictest670947-21kworker/u16:4+flush-8:020:19:175
107124995048,2cyclictest618013-21kworker/u16:0+events_unbound19:49:175
107129994840,6cyclictest589235-21systemd-journal19:38:477
107126994846,2cyclictest211925-21kworker/u16:4+flush-8:016:34:126
107126994845,2cyclictest632300-21kworker/u16:2+flush-8:020:09:016
107124994846,2cyclictest688866-21kworker/u16:3+events_unbound20:38:055
107124994846,2cyclictest323129-21kworker/u16:2+events_unbound17:14:175
107126994744,3cyclictest222511-21kworker/u16:1+flush-8:016:30:226
107124994745,2cyclictest632300-21kworker/u16:2+events_unbound20:29:175
107124994745,2cyclictest303467-21kworker/u16:0+events_unbound17:26:225
107124994744,2cyclictest252219-21kworker/u16:5+flush-8:016:38:475
107124994644,2cyclictest272432-21kworker/u16:1+events_unbound16:43:225
107124994642,3cyclictest670947-21kworker/u16:4+flush-8:020:04:095
10679224636,7sleep60-21swapper/615:23:306
10672524635,8sleep40-21swapper/415:22:394
107124994543,2cyclictest181766-21kworker/u16:0+events_unbound16:19:205
107124994543,2cyclictest170619-21kworker/u16:2+flush-8:015:54:025
107126994442,2cyclictest520615-21kworker/u16:3+events_unbound18:49:176
107126994441,2cyclictest537390-21kworker/u16:2+flush-8:019:29:026
10667724434,7sleep50-21swapper/515:22:005
107126994341,2cyclictest405567-21kworker/u16:2+events_unbound18:10:436
107124994341,2cyclictest648105-21kworker/u16:1+events_unbound20:43:075
107124994341,2cyclictest282770-21kworker/u16:0+flush-8:016:49:165
107117994341,2cyclictest383984-21kworker/u16:0+events_unbound17:49:044
107129994237,4cyclictest648426-21latency_hist19:48:467
107126994240,2cyclictest405567-21kworker/u16:2+flush-8:018:29:166
107124994240,2cyclictest394617-21kworker/u16:5+flush-8:019:44:155
107124994240,2cyclictest272432-21kworker/u16:1+flush-8:016:59:045
107124994240,2cyclictest151110-21kworker/u16:4+flush-8:015:44:025
107124994140,1cyclictest373800-21kworker/u16:3+events_unbound17:41:075
107126994038,2cyclictest394617-21kworker/u16:5+events_unbound19:44:166
107124994038,2cyclictest648105-21kworker/u16:1+events_unbound20:44:145
107124994038,2cyclictest50708-21kworker/u16:1+events_unbound15:52:225
107124994038,2cyclictest117169-21kworker/u16:3+flush-8:015:59:225
107129993934,3cyclictest589235-21systemd-journal16:35:357
107126993937,2cyclictest516711-21kworker/u16:1+flush-8:018:59:036
107126993937,2cyclictest383984-21kworker/u16:0+flush-8:017:39:196
107126993936,2cyclictest292690-21kworker/u16:6+flush-8:017:34:026
107124993938,1cyclictest394617-21kworker/u16:5+flush-8:019:04:095
107124993937,2cyclictest373800-21kworker/u16:3+events_unbound17:47:225
107124993937,2cyclictest373800-21kworker/u16:3+events_unbound17:47:225
107126993836,2cyclictest50708-21kworker/u16:1+flush-8:016:09:216
107126993836,2cyclictest50708-21kworker/u16:1+flush-8:015:29:156
107124993836,2cyclictest223023-21kworker/u16:2+flush-8:016:30:155
107117993836,2cyclictest50708-21kworker/u16:1+events_unbound15:28:494
107126993735,2cyclictest476661-21kworker/u16:0+events_unbound18:34:596
107126993734,3cyclictest632300-21kworker/u16:2+flush-8:020:49:186
107124993735,2cyclictest537390-21kworker/u16:2+events_unbound19:20:225
107126993634,2cyclictest658208-21kworker/u16:3+events_unbound19:52:466
107126993634,2cyclictest222511-21kworker/u16:1+flush-8:016:24:186
107126993634,2cyclictest170619-21kworker/u16:2+events_unbound16:02:576
107124993634,2cyclictest658208-21kworker/u16:3+events_unbound19:56:215
107124993634,2cyclictest50708-21kworker/u16:1+events_unbound15:42:225
107124993634,2cyclictest383984-21kworker/u16:0+events_unbound17:59:215
107126993533,2cyclictest648105-21kworker/u16:1+flush-8:020:39:026
107126993533,2cyclictest394617-21kworker/u16:5+flush-8:017:54:186
107126993533,2cyclictest151110-21kworker/u16:4+events_unbound15:44:056
107124993533,2cyclictest466323-21kworker/u16:1+events_unbound18:21:225
107124993533,2cyclictest383984-21kworker/u16:0+flush-8:017:49:035
107124993533,2cyclictest292690-21kworker/u16:6+events_unbound17:04:175
107126993432,2cyclictest516711-21kworker/u16:1+flush-8:019:05:586
107126993432,2cyclictest354090-21kworker/u16:2+flush-8:017:26:316
107126993432,2cyclictest292690-21kworker/u16:6+events_unbound16:59:166
107126993432,2cyclictest252219-21kworker/u16:5+events_unbound16:44:196
107126993432,2cyclictest121274-21kworker/u16:5+events_unbound15:33:596
107126993431,2cyclictest537390-21kworker/u16:2+flush-8:019:23:496
107126993431,2cyclictest394617-21kworker/u16:5+events_unbound17:44:016
107126993431,2cyclictest394617-21kworker/u16:5+events_unbound17:44:016
107126993431,2cyclictest252219-21kworker/u16:5+flush-8:016:42:266
107124993431,2cyclictest632300-21kworker/u16:2+events_unbound20:24:065
107126993331,2cyclictest723482-21kworker/u16:5+flush-8:020:32:296
107126993331,2cyclictest394617-21kworker/u16:5+events_unbound19:09:506
107124993331,2cyclictest670947-21kworker/u16:4+events_unbound20:11:225
107124993331,2cyclictest537389-21kworker/u16:0+events_unbound19:16:215
107124993331,2cyclictest506134-21kworker/u16:4+events_unbound18:44:165
107124993331,2cyclictest170619-21kworker/u16:2+flush-8:016:09:125
107124993330,2cyclictest223023-21kworker/u16:2+flush-8:016:24:025
107126993230,2cyclictest670947-21kworker/u16:4+events_unbound19:59:136
107126993230,2cyclictest648105-21kworker/u16:1+events_unbound20:25:346
107126993230,2cyclictest632300-21kworker/u16:2+events_unbound20:19:136
107126993230,2cyclictest50708-21kworker/u16:1+events_unbound15:40:546
107126993230,2cyclictest405567-21kworker/u16:2+flush-8:018:03:306
107126993230,2cyclictest323130-21kworker/u16:4+events_unbound17:23:106
107126993230,2cyclictest323130-21kworker/u16:4+events_unbound17:11:016
107126993230,2cyclictest252219-21kworker/u16:5+events_unbound16:56:026
107126993230,2cyclictest211925-21kworker/u16:4+events_unbound16:16:146
107126993229,2cyclictest723482-21kworker/u16:5+events_unbound20:33:496
107124993230,2cyclictest50708-21kworker/u16:1+flush-8:015:24:195
107124993230,2cyclictest394617-21kworker/u16:5+events_unbound19:30:495
107124993230,2cyclictest373800-21kworker/u16:3+flush-8:017:34:175
107124993230,2cyclictest252219-21kworker/u16:5+flush-8:016:58:415
107124993230,2cyclictest117169-21kworker/u16:3+events_unbound15:37:215
107124993229,2cyclictest668546-21kworker/u16:0+flush-8:019:59:025
107129993130,0cyclictest0-21swapper/720:44:307
107126993129,2cyclictest670947-21kworker/u16:4+events_unbound20:08:096
107126993129,2cyclictest466323-21kworker/u16:1+events_unbound18:22:196
107126993129,2cyclictest292690-21kworker/u16:6+flush-8:017:31:026
107126993129,2cyclictest272432-21kworker/u16:1+events_unbound16:50:576
107124993129,2cyclictest668546-21kworker/u16:0+events_unbound20:17:205
107124993129,2cyclictest618013-21kworker/u16:0+events_unbound19:34:165
107124993129,2cyclictest537389-21kworker/u16:0+events_unbound19:11:345
107124993129,2cyclictest181766-21kworker/u16:0+flush-8:016:05:225
107117993129,2cyclictest223023-21kworker/u16:2+events_unbound16:30:324
107129993028,1cyclictest252210-21PK-Backend16:30:337
107129993027,2cyclictest27944-21gnome-software17:41:007
107129993025,4cyclictest589235-21systemd-journal19:28:487
107129993022,6cyclictest589235-21systemd-journal18:58:477
107126993028,2cyclictest537390-21kworker/u16:2+events_unbound19:15:256
107126993027,3cyclictest181766-21kworker/u16:0+flush-8:016:19:026
107124993028,2cyclictest520615-21kworker/u16:3+flush-8:018:49:135
107124993028,2cyclictest516711-21kworker/u16:1+events_unbound19:24:165
107124993028,2cyclictest323130-21kworker/u16:4+events_unbound17:19:125
107124993028,2cyclictest252219-21kworker/u16:5+events_unbound16:46:145
107124993028,2cyclictest117169-21kworker/u16:3+events_unbound15:29:065
7401112290,0chrt0-21swapper/420:34:014
10712999290,28cyclictest589235-21systemd-journal20:34:117
10712999290,27cyclictest597967-21latency_hist19:23:477
107126992927,2cyclictest506134-21kworker/u16:4+events_unbound18:44:516
107126992927,2cyclictest343380-21kworker/u16:1+events_unbound17:49:216
107126992927,2cyclictest117169-21kworker/u16:3+events_unbound16:06:576
107124992927,2cyclictest476661-21kworker/u16:0+events_unbound18:39:065
107124992927,2cyclictest394617-21kworker/u16:5+events_unbound19:41:305
107124992927,2cyclictest343380-21kworker/u16:1+events_unbound17:56:225
10712999280,27cyclictest405584-21latency_hist17:48:477
10712999280,27cyclictest405584-21latency_hist17:48:477
107126992826,2cyclictest632300-21kworker/u16:2+flush-8:019:40:266
107126992826,2cyclictest537390-21kworker/u16:2+flush-8:018:58:256
107126992826,2cyclictest537389-21kworker/u16:0+events_unbound19:21:386
107126992826,2cyclictest50708-21kworker/u16:1+events_unbound15:49:186
107126992826,2cyclictest405567-21kworker/u16:2+events_unbound18:05:296
107126992826,2cyclictest394617-21kworker/u16:5+events_unbound18:24:146
107124992826,2cyclictest405567-21kworker/u16:2+events_unbound18:29:155
107129992726,0cyclictest0-21swapper/720:26:177
107129992726,0cyclictest0-21swapper/716:12:427
107126992725,2cyclictest648105-21kworker/u16:1+flush-8:020:43:466
107126992725,2cyclictest394617-21kworker/u16:5+events_unbound18:39:256
107129992625,0cyclictest0-21swapper/717:54:187
107129992620,5cyclictest313182-21latency_hist17:03:477
107126992624,2cyclictest323129-21kworker/u16:2+events_unbound17:16:146
107124992624,2cyclictest648105-21kworker/u16:1+flush-8:020:48:475
107124992624,2cyclictest466323-21kworker/u16:1+flush-8:018:25:215
107124992624,2cyclictest405567-21kworker/u16:2+events_unbound18:34:125
107117992623,2cyclictest618013-21kworker/u16:0+flush-8:019:35:034
107129992524,0cyclictest0-21swapper/719:02:537
107129992524,0cyclictest0-21swapper/717:09:147
107126992523,2cyclictest394617-21kworker/u16:5+events_unbound18:14:386
107126992523,2cyclictest3596980-21kworker/u16:4+events_unbound15:27:386
107124992523,2cyclictest343380-21kworker/u16:1+events_unbound17:30:515
107124992522,2cyclictest211925-21kworker/u16:4+events_unbound16:13:515
107129992424,0cyclictest0-21swapper/720:39:127
107129992419,4cyclictest719214-21latency_hist20:23:477
107126992422,2cyclictest670947-21kworker/u16:4+events_unbound20:14:146
107126992422,2cyclictest618013-21kworker/u16:0+events_unbound19:36:026
107126992422,2cyclictest303467-21kworker/u16:0+flush-8:017:04:416
107124992422,2cyclictest405567-21kworker/u16:2+events_unbound18:15:295
107129992322,0cyclictest0-21swapper/718:47:007
107129992322,0cyclictest0-21swapper/717:24:427
107129992322,0cyclictest0-21swapper/716:51:177
107129992322,0cyclictest0-21swapper/715:55:047
107124992321,2cyclictest506134-21kworker/u16:4+events_unbound18:59:115
107124992321,2cyclictest323130-21kworker/u16:4+events_unbound17:10:465
107126992220,2cyclictest170619-21kworker/u16:2+events_unbound15:54:256
107124992219,3cyclictest445142-21kworker/u16:3+flush-8:018:12:225
107117992219,3cyclictest343380-21kworker/u16:1+events_unbound17:41:034
107117992219,2cyclictest506134-21kworker/u16:4+flush-8:018:51:034
107129992120,0cyclictest0-21swapper/720:14:577
107129992120,0cyclictest0-21swapper/715:25:037
107124992119,2cyclictest343380-21kworker/u16:1+flush-8:018:04:125
107129992019,0cyclictest0-21swapper/720:10:477
107129992019,0cyclictest0-21swapper/718:15:097
107129992019,0cyclictest0-21swapper/716:27:547
107129992015,4cyclictest476479-21latency_hist18:23:467
10712999200,19cyclictest687626-21sed20:04:127
107129991918,0cyclictest0-21swapper/719:15:277
107129991918,0cyclictest0-21swapper/719:11:327
107129991914,4cyclictest658503-21latency_hist19:53:467
107117991915,3cyclictest354090-21kworker/u16:2+flush-8:017:24:104
107129991817,0cyclictest0-21swapper/718:49:007
107129991817,0cyclictest0-21swapper/717:36:107
107129991817,0cyclictest0-21swapper/716:23:077
107129991813,4cyclictest191847-21latency_hist16:03:477
107129991717,0cyclictest0-21swapper/717:05:477
107129991716,0cyclictest0-21swapper/719:26:137
107129991714,2cyclictest193053-21iostat_ios16:04:027
107124991715,2cyclictest537390-21kworker/u16:2+flush-8:018:54:235
107129991615,0cyclictest0-21swapper/718:07:227
107129991615,0cyclictest0-21swapper/715:44:437
107129991515,0cyclictest0-21swapper/718:40:277
107129991515,0cyclictest0-21swapper/718:32:097
107129991514,0cyclictest0-21swapper/720:29:517
107129991514,0cyclictest0-21swapper/719:04:347
107129991511,3cyclictest4175659-21snmpd16:55:187
107129991510,4cyclictest589235-21systemd-journal17:52:207
107129991510,4cyclictest343562-21latency_hist17:18:477
10712999150,14cyclictest4175659-21snmpd15:32:527
107129991413,0cyclictest0-21swapper/719:59:337
107129991413,0cyclictest0-21swapper/717:29:357
107117991413,1cyclictest0-21swapper/418:19:094
10712999139,3cyclictest4175659-21snmpd20:49:117
10712999139,3cyclictest4175659-21snmpd18:28:237
10712999138,4cyclictest589235-21systemd-journal18:33:477
10712999138,4cyclictest447294-21cat18:09:027
107129991310,2cyclictest4175659-21snmpd17:19:367
107129991310,2cyclictest4175659-21snmpd15:38:587
107117991312,1cyclictest0-21swapper/417:54:144
107117991310,2cyclictest263540-21kworker/u16:0+flush-8:016:39:284
10711799130,1cyclictest0-21swapper/417:04:544
10711799130,1cyclictest0-21swapper/415:43:434
10711799130,13cyclictest0-21swapper/415:59:574
10712999129,2cyclictest4175659-21snmpd19:57:227
10712999129,2cyclictest267550-21kthreadcore16:39:107
10712999128,3cyclictest27204-21gmain16:44:177
10712999128,3cyclictest163560-21kthreadcore15:49:067
10712999127,4cyclictest428340-21kthreadcore17:59:077
10712999120,11cyclictest141015-21taskset15:34:377
10712999120,10cyclictest629435-21cat19:39:057
10712999120,10cyclictest212583-21cut16:14:017
107117991211,1cyclictest0-21swapper/420:29:224
107117991211,1cyclictest0-21swapper/416:19:204
10711799120,11cyclictest0-21swapper/418:10:004
107117991110,1cyclictest0-21swapper/420:51:264
107117991110,1cyclictest0-21swapper/420:47:204
107117991110,1cyclictest0-21swapper/420:43:144
107117991110,1cyclictest0-21swapper/419:48:324
107117991110,1cyclictest0-21swapper/418:35:144
107117991110,1cyclictest0-21swapper/417:46:404
107117991110,1cyclictest0-21swapper/417:46:404
107117991110,1cyclictest0-21swapper/417:33:544
107117991110,1cyclictest0-21swapper/417:30:554
107117991110,1cyclictest0-21swapper/416:47:244
107117991110,1cyclictest0-21swapper/416:36:124
10711799110,1cyclictest0-21swapper/420:26:034
10711799110,11cyclictest0-21swapper/419:25:414
10711799110,11cyclictest0-21swapper/419:08:584
10711799110,11cyclictest0-21swapper/415:38:024
10711799110,0cyclictest0-21swapper/418:54:374
10711799110,0cyclictest0-21swapper/416:07:124
10711799109,1cyclictest0-21swapper/420:18:394
10711799109,1cyclictest0-21swapper/419:43:394
10711799109,1cyclictest0-21swapper/415:48:364
1071179998,1cyclictest0-21swapper/420:21:574
1071179998,1cyclictest0-21swapper/419:28:594
1071179998,1cyclictest0-21swapper/418:40:354
1071179998,1cyclictest0-21swapper/418:04:014
1071179998,1cyclictest0-21swapper/418:03:144
1071179998,1cyclictest0-21swapper/416:13:404
1071179996,2cyclictest272432-21kworker/u16:1+flush-8:016:48:574
1071179987,1cyclictest0-21swapper/418:45:574
1071179987,1cyclictest0-21swapper/418:18:224
1071179987,1cyclictest0-21swapper/416:58:364
1071179984,3cyclictest658377-21chrt19:52:104
1071179984,3cyclictest151110-21kworker/u16:4+flush-8:015:54:134
1071179982,5cyclictest984965-21wsdd16:18:054
1071179976,1cyclictest0-21swapper/420:13:454
1071179976,1cyclictest0-21swapper/417:12:184
1071179975,2cyclictest632300-21kworker/u16:2+flush-8:019:59:114
1071179973,3cyclictest1-21systemd15:53:474
1071179972,4cyclictest108697-21kthreadcore15:24:084
1071179965,1cyclictest0-21swapper/419:04:144
1071179965,1cyclictest0-21swapper/417:22:434
1071179962,2cyclictest0-21swapper/418:28:214
1071179962,2cyclictest0-21swapper/417:03:144
1071179960,5cyclictest242055-21taskset16:25:214
1071179952,2cyclictest3338622sleep417:13:534
1071179950,4cyclictest666223-21chrt19:54:104
1071179950,4cyclictest597031-21chrt19:19:174
1071179950,4cyclictest587501-21taskset19:14:204
1071179950,4cyclictest487028-21chrt18:29:014
1071179950,3cyclictest0-21swapper/420:04:114
1071179950,3cyclictest0-21swapper/418:59:094
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional