You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 03:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Jun 14, 2026 00:56:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
186339983529,803cyclictest18627-21cyclictest23:39:374
1862999779183,84cyclictest131rcu_sched22:35:020
186339975676,84cyclictest0-21swapper/421:26:324
186339973715,633cyclictest0-21swapper/400:15:074
186339973353,677cyclictest0-21swapper/422:42:514
186339971478,634cyclictest0-21swapper/400:14:444
186339969857,85cyclictest0-21swapper/422:55:024
186339969260,629cyclictest0-21swapper/400:03:544
186349966468,465cyclictest0-21swapper/500:02:515
186339966228,465cyclictest0-21swapper/400:30:454
1863699659147,338cyclictest0-21swapper/723:58:217
186339965417,549cyclictest0-21swapper/422:31:464
1862999645347,126cyclictest0-21swapper/023:59:500
18636996370,84cyclictest0-21swapper/723:47:097
1863099632549,3cyclictest241ktimersoftd/100:03:171
186339962834,591cyclictest0-21swapper/423:47:544
186329962534,126cyclictest0-21swapper/323:48:013
1863399622111,84cyclictest121rcu_preempt00:44:584
1863299621113,126cyclictest0-21swapper/321:17:363
186299961666,126cyclictest0-21swapper/023:46:110
186299961360,380cyclictest0-21swapper/021:30:270
186299960611,126cyclictest0-21swapper/022:42:290
18633995961,592cyclictest27948-21if_eth022:55:174
18636995940,84cyclictest0-21swapper/723:12:577
18636995940,84cyclictest0-21swapper/721:28:137
18634995930,84cyclictest0-21swapper/523:28:385
186319959281,211cyclictest0-21swapper/223:12:312
186319959084,332cyclictest13543-21cron00:00:002
186339958979,507cyclictest27498-21taskset00:26:214
1863699584242,126cyclictest0-21swapper/700:14:177
186319958434,42cyclictest121rcu_preempt22:52:002
186309958331,126cyclictest0-21swapper/122:53:451
186319958229,126cyclictest0-21swapper/222:31:462
1862999579200,41cyclictest0-21swapper/023:30:250
186339957826,549cyclictest0-21swapper/421:19:384
1863599577107,211cyclictest0-21swapper/622:53:526
1862999576107,338cyclictest0-21swapper/021:18:370
186309957522,84cyclictest0-21swapper/123:37:001
186319957461,254cyclictest28017-21munin-run21:30:022
186349957323,42cyclictest0-21swapper/522:52:565
186339957220,549cyclictest0-21swapper/422:20:274
186299957264,83cyclictest0-21swapper/023:13:200
186349957060,295cyclictest29446-21ssh22:18:345
186309957021,126cyclictest0-21swapper/100:43:021
186349956756,296cyclictest13232-21df_abs21:20:165
186349956516,7cyclictest0-21swapper/523:13:265
1863699564138,253cyclictest0-21swapper/722:54:237
186339956112,127cyclictest121rcu_preempt00:21:124
1862999561266,84cyclictest0-21swapper/000:21:060
1863199560222,84cyclictest27262-21sh00:45:002
186309956049,297cyclictest0-21swapper/100:26:411
186339955951,506cyclictest0-21swapper/423:13:284
18630995510,3cyclictest0-21swapper/123:12:341
18633995501,253cyclictest0-21swapper/423:40:164
186319955081,84cyclictest0-21swapper/200:14:532
186339954736,507cyclictest26445-21diskmemload23:59:534
1862999547121,296cyclictest0-21swapper/000:26:210
1863699546122,127cyclictest0-21swapper/723:38:037
186349954681,84cyclictest0-21swapper/500:30:555
186309954634,84cyclictest0-21swapper/122:32:161
186319954377,84cyclictest0-21swapper/221:17:372
1863499542114,380cyclictest0-21swapper/521:29:135
186339954274,253cyclictest121rcu_preempt22:18:314
186339954131,507cyclictest0-21swapper/422:45:184
186339953831,84cyclictest0-21swapper/421:30:274
1863499537416,37cyclictest561ktimersoftd/500:13:005
186339953730,165cyclictest0-21swapper/423:28:524
186339953726,508cyclictest0-21swapper/423:50:354
186309953768,296cyclictest0-21swapper/123:59:161
1863099536110,295cyclictest0-21swapper/121:28:091
186369953364,297cyclictest0-21swapper/722:43:227
186309953325,127cyclictest0-21swapper/123:49:331
186339953125,422cyclictest26445-21diskmemload00:05:054
186349952918,337cyclictest0-21swapper/522:32:015
186329952918,508cyclictest0-21swapper/323:39:243
186299952919,127cyclictest0-21swapper/023:38:000
186299952820,126cyclictest0-21swapper/000:01:310
1863599526185,338cyclictest18627-21cyclictest23:48:156
186309952662,253cyclictest0-21swapper/121:30:101
186339952413,508cyclictest0-21swapper/421:20:124
186369952257,84cyclictest0-21swapper/700:30:557
1863699519180,296cyclictest0-21swapper/700:01:447
186359951911,84cyclictest121rcu_preempt21:30:246
18634995169,85cyclictest0-21swapper/500:21:485
18633995166,168cyclictest29987-21ssh23:30:194
18632995168,84cyclictest0-21swapper/300:43:003
186369951386,126cyclictest0-21swapper/723:40:187
18634995125,84cyclictest0-21swapper/522:43:515
1863499511170,338cyclictest11458-21ssh23:38:205
186329950941,337cyclictest0-21swapper/322:52:343
186309950981,339cyclictest0-21swapper/122:20:271
18630995091,84cyclictest8459-21sh22:42:571
18635995070,86cyclictest641ktimersoftd/600:01:386
1863499507423,3cyclictest551rcuc/521:19:555
186319950738,254cyclictest0-21swapper/200:02:342
186349950578,84cyclictest18627-21cyclictest00:44:355
1863099505422,3cyclictest241ktimersoftd/121:20:211
186319950435,338cyclictest0-21swapper/222:18:062
186309950334,84cyclictest0-21swapper/123:29:431
186359950279,84cyclictest0-21swapper/623:40:196
186359950279,84cyclictest0-21swapper/623:27:256
1863299502418,3cyclictest391rcuc/300:01:323
1863199502118,211cyclictest0-21swapper/223:47:522
186299950274,211cyclictest0-21swapper/022:19:180
186299950235,43cyclictest0-21swapper/000:31:050
1863499501118,295cyclictest121rcu_preempt23:58:055
1863299501122,295cyclictest0-21swapper/321:27:183
1862999501161,126cyclictest0-21swapper/023:27:570
1863199500327,84cyclictest0-21swapper/223:29:022
186299950074,126cyclictest0-21swapper/000:12:370
186359949973,126cyclictest0-21swapper/622:20:326
186309949935,176cyclictest0-21swapper/121:18:301
186359949833,295cyclictest0-21swapper/621:29:046
186309949834,253cyclictest0-21swapper/100:13:201
186299949834,48cyclictest0-21swapper/021:25:460
186359949774,84cyclictest0-21swapper/600:12:146
186359949674,84cyclictest0-21swapper/623:58:206
186349949530,211cyclictest0-21swapper/523:50:315
1863199495111,253cyclictest121rcu_preempt23:40:282
186369949369,126cyclictest0-21swapper/722:32:017
1863299493152,338cyclictest723-21nscd22:45:103
186329949169,256cyclictest18627-21cyclictest22:33:153
186369949030,84cyclictest0-21swapper/700:42:507
1863499489106,210cyclictest29931-21cat21:30:275
186329948720,85cyclictest0-21swapper/323:29:283
1863299486105,134cyclictest121rcu_preempt00:26:463
186319948620,84cyclictest0-21swapper/222:20:282
186329948519,42cyclictest121rcu_preempt23:58:213
1863299485101,381cyclictest1329-21ssh00:11:223
186329948416,211cyclictest0-21swapper/322:41:153
186299948418,126cyclictest0-21swapper/000:44:200
186299947915,296cyclictest0-21swapper/023:50:330
186349947813,126cyclictest26445-21diskmemload23:45:595
186329947714,294cyclictest0-21swapper/322:19:543
186359947610,84cyclictest121rcu_preempt23:12:416
1863599471129,127cyclictest65-21ksoftirqd/600:42:596
18631994661,84cyclictest0-21swapper/200:21:352
186299946581,88cyclictest121rcu_preempt22:51:240
186309946441,3cyclictest0-21swapper/100:21:121
1863699463377,84cyclictest711rcuc/721:30:267
1863299463122,338cyclictest0-21swapper/300:30:263
186369946241,339cyclictest0-21swapper/723:28:257
186369946240,211cyclictest0-21swapper/721:17:127
1863299462121,338cyclictest0-21swapper/323:50:173
186319946276,169cyclictest33-21ksoftirqd/221:30:232
186369946139,84cyclictest121rcu_preempt22:20:217
1863699461120,338cyclictest0-21swapper/721:20:217
186319946177,381cyclictest0-21swapper/223:39:372
186359946075,169cyclictest0-21swapper/623:39:546
1863699459116,340cyclictest0-21swapper/700:26:017
1863199459117,211cyclictest21912-21ntp_states00:05:292
1863099459249,4cyclictest22365-21nscd22:19:491
1863699458118,337cyclictest0-21swapper/700:15:057
1863699458117,338cyclictest0-21swapper/700:05:057
186359945874,219cyclictest0-21swapper/622:42:526
186349945836,297cyclictest0-21swapper/500:15:075
1863199458117,338cyclictest26445-21diskmemload22:55:092
186319945735,256cyclictest0-21swapper/200:26:412
186309945734,126cyclictest0-21swapper/123:30:251
186349945676,295cyclictest0-21swapper/500:05:065
186309945677,295cyclictest0-21swapper/123:40:201
1863599455118,170cyclictest0-21swapper/622:31:386
186349945531,84cyclictest0-21swapper/522:35:045
1863199455114,338cyclictest0-21swapper/221:20:162
186309945534,41cyclictest0-21swapper/100:15:081
186369945431,256cyclictest0-21swapper/722:19:077
186349945329,42cyclictest0-21swapper/523:40:225
186329945326,127cyclictest21913-21ssh00:05:273
186359945225,296cyclictest0-21swapper/622:35:076
186319945269,210cyclictest0-21swapper/222:42:562
186369945171,84cyclictest1-21systemd00:21:077
1863599451407,41cyclictest641ktimersoftd/622:45:026
1863299451112,125cyclictest26445-21diskmemload22:20:033
1863299451109,339cyclictest0-21swapper/300:15:093
186369945027,85cyclictest29850-21rm23:50:057
1863599450108,126cyclictest0-21swapper/621:17:396
186359944661,211cyclictest65-21ksoftirqd/622:19:106
186359944421,295cyclictest0-21swapper/600:21:426
186299944220,260cyclictest0-21swapper/021:20:280
186359944119,2cyclictest0-21swapper/622:55:156
186369944098,339cyclictest0-21swapper/722:45:157
1863599439140,126cyclictest121rcu_preempt21:20:136
186309943912,254cyclictest0-21swapper/122:35:081
186359943863,249cyclictest1553-21runrttasks00:26:346
186309943897,338cyclictest0-21swapper/122:45:151
186299943812,253cyclictest26445-21diskmemload22:20:210
186359943450,210cyclictest65-21ksoftirqd/600:31:506
186329943292,84cyclictest18627-21cyclictest21:20:183
186319942945,170cyclictest33-21ksoftirqd/222:45:022
18632994281,85cyclictest0-21swapper/323:40:213
1863299428127,127cyclictest41-21ksoftirqd/323:13:433
1863299427128,126cyclictest41-21ksoftirqd/300:21:363
186319942483,338cyclictest0-21swapper/222:35:052
186369942383,84cyclictest0-21swapper/722:55:157
186349942384,84cyclictest0-21swapper/522:55:265
186349942383,338cyclictest0-21swapper/522:20:285
186349942339,253cyclictest0-21swapper/500:26:435
18631994221,3cyclictest0-21swapper/200:31:302
186309942281,338cyclictest0-21swapper/123:50:141
186329942183,84cyclictest121rcu_preempt22:35:193
186309942180,338cyclictest0-21swapper/122:55:151
186319942078,211cyclictest33-21ksoftirqd/200:15:072
186299942036,84cyclictest0-21swapper/023:40:230
186339941978,338cyclictest0-21swapper/422:35:224
186299941982,84cyclictest0-21swapper/022:45:150
1862999419122,126cyclictest9-21ksoftirqd/022:35:080
186359941879,84cyclictest0-21swapper/623:30:246
186309941737,254cyclictest0-21swapper/100:30:471
1863199416117,210cyclictest0-21swapper/223:50:332
1862999416116,210cyclictest18627-21cyclictest22:55:240
186349941535,170cyclictest0-21swapper/523:30:175
186329941576,84cyclictest0-21swapper/322:55:253
186369941475,254cyclictest0-21swapper/723:30:167
186329941432,47cyclictest0-21swapper/321:30:123
186309941471,297cyclictest26445-21diskmemload23:15:011
186349941375,84cyclictest0-21swapper/522:45:185
186299941232,84cyclictest0-21swapper/000:05:070
186299941172,84cyclictest0-21swapper/000:15:100
186369941031,48cyclictest27649-21load22:35:187
186319940968,338cyclictest0-21swapper/223:30:242
186329940364,84cyclictest0-21swapper/323:30:173
1863199403282,38cyclictest321ktimersoftd/223:15:032
186309940362,126cyclictest0-21swapper/100:05:211
1863599399101,84cyclictest0-21swapper/623:50:406
186349938082,84cyclictest0-21swapper/523:15:035
1863699373116,254cyclictest0-21swapper/723:15:027
186359937276,211cyclictest0-21swapper/600:15:096
186359937075,211cyclictest0-21swapper/623:15:026
186339936933,252cyclictest0-21swapper/423:15:034
186359936627,126cyclictest65-21ksoftirqd/600:05:286
186299935559,84cyclictest0-21swapper/023:15:020
186329932367,254cyclictest15804-1kworker/u17:223:15:013
1061421360,2sleep41863399cyclictest20:40:214
3239321170,2sleep71863699cyclictest19:30:157
3239321170,2sleep71863699cyclictest19:30:147
1807129366,24sleep40-21swapper/419:08:094
1818428961,5sleep50-21swapper/519:09:475
1633528984,2sleep60-21swapper/619:05:156
1712328782,2sleep20-21swapper/219:05:192
1810828656,27sleep30-21swapper/319:08:423
1801528660,4sleep10-21swapper/119:07:261
1522228656,26sleep00-21swapper/019:05:010
1812128444,8sleep70-21swapper/719:08:537
306742760,0sleep70-21swapper/721:46:357
79172740,0sleep60-21swapper/621:51:146
327382720,0sleep60-21swapper/621:12:276
106642720,0sleep60-21swapper/619:50:006
161952700,0sleep70-21swapper/719:55:227
137172690,0sleep30-21swapper/322:27:013
18633993310,22cyclictest0-21swapper/421:08:584
18633993226,5cyclictest0-21swapper/420:36:434
18633993210,0cyclictest0-21swapper/420:03:434
18634992924,4cyclictest0-21swapper/520:03:445
18633992927,1cyclictest0-21swapper/419:13:354
18632992810,18cyclictest0-21swapper/319:38:373
18631992810,18cyclictest0-21swapper/219:13:122
18636992710,0cyclictest0-21swapper/720:37:047
18636992710,0cyclictest0-21swapper/720:03:417
18636992710,0cyclictest0-21swapper/719:13:137
18635992710,17cyclictest0-21swapper/620:37:006
18635992710,0cyclictest0-21swapper/621:09:246
18635992710,0cyclictest0-21swapper/620:03:256
18635992710,0cyclictest0-21swapper/619:38:456
18634992710,17cyclictest0-21swapper/520:36:435
18634992710,17cyclictest0-21swapper/519:38:425
18634992710,0cyclictest0-21swapper/521:09:255
18634992710,0cyclictest0-21swapper/519:13:115
18632992710,17cyclictest0-21swapper/320:36:493
18632992710,17cyclictest0-21swapper/320:03:273
18632992710,17cyclictest0-21swapper/319:13:173
18632992710,0cyclictest0-21swapper/321:09:003
18631992710,17cyclictest0-21swapper/221:09:042
18631992710,17cyclictest0-21swapper/220:03:132
18631992710,17cyclictest0-21swapper/219:39:002
18630992727,0cyclictest0-21swapper/120:03:181
18630992727,0cyclictest0-21swapper/119:13:101
18630992710,17cyclictest0-21swapper/121:09:061
18630992710,17cyclictest0-21swapper/119:38:371
18630992710,0cyclictest0-21swapper/120:36:411
18629992727,0cyclictest0-21swapper/019:13:110
18629992710,17cyclictest0-21swapper/020:36:430
18629992710,17cyclictest0-21swapper/019:38:400
18629992710,0cyclictest0-21swapper/021:09:230
18629992710,0cyclictest0-21swapper/020:03:140
18636992626,0cyclictest0-21swapper/719:38:417
18633992626,0cyclictest0-21swapper/419:38:444
18635992525,0cyclictest0-21swapper/619:13:266
1863499250,22cyclictest0-21swapper/521:10:205
18631992424,0cyclictest0-21swapper/220:36:492
18636992222,0cyclictest0-21swapper/721:09:057
1863599229,7cyclictest65-21ksoftirqd/621:40:136
18635992212,5cyclictest65-21ksoftirqd/622:11:356
1862999215,7cyclictest0-21swapper/022:00:000
1863599209,7cyclictest65-21ksoftirqd/620:00:006
1863599209,6cyclictest65-21ksoftirqd/622:05:186
1863599209,6cyclictest65-21ksoftirqd/600:35:176
1863599209,6cyclictest0-21swapper/620:55:186
1863599208,8cyclictest65-21ksoftirqd/622:25:146
18635992011,5cyclictest65-21ksoftirqd/621:35:106
18635992010,5cyclictest65-21ksoftirqd/623:20:206
276172190,1sleep10-21swapper/121:10:131
1863599199,6cyclictest65-21ksoftirqd/623:02:596
1863599199,6cyclictest0-21swapper/621:00:186
1863599199,5cyclictest65-21ksoftirqd/620:05:136
1863599199,2cyclictest65-21ksoftirqd/619:55:006
1863599198,6cyclictest65-21ksoftirqd/623:06:396
1863599198,6cyclictest65-21ksoftirqd/623:06:396
1863599198,6cyclictest65-21ksoftirqd/620:30:126
1863599197,7cyclictest65-21ksoftirqd/621:45:016
18635991916,2cyclictest641ktimersoftd/619:40:166
1863599189,4cyclictest65-21ksoftirqd/620:47:476
1863599188,6cyclictest65-21ksoftirqd/621:55:176
1863599187,6cyclictest65-21ksoftirqd/622:01:226
18635991816,1cyclictest641ktimersoftd/620:50:246
18635991810,5cyclictest65-21ksoftirqd/620:20:176
1863599179,5cyclictest65-21ksoftirqd/620:25:226
1863599178,6cyclictest65-21ksoftirqd/620:10:226
1863599178,5cyclictest121rcu_preempt20:15:136
18635991715,1cyclictest641ktimersoftd/619:30:206
18635991715,1cyclictest641ktimersoftd/619:30:206
18635991715,1cyclictest641ktimersoftd/619:15:206
1862999171,8cyclictest0-21swapper/021:05:000
1863599169,4cyclictest65-21ksoftirqd/619:20:226
1863599169,4cyclictest121rcu_preempt20:40:136
18635991614,1cyclictest641ktimersoftd/619:25:126
18633991613,2cyclictest0-21swapper/419:15:164
1862999164,6cyclictest0-21swapper/020:50:000
1863499151,13cyclictest0-21swapper/519:15:125
1863399158,3cyclictest15619-21cat19:55:174
1863299150,13cyclictest0-21swapper/319:15:153
1862999153,6cyclictest0-21swapper/021:15:000
1862999152,6cyclictest0-21swapper/019:25:000
18636991412,1cyclictest23944-21ls19:15:167
1863699140,13cyclictest16410-21kworker/7:122:27:337
18634991412,1cyclictest12339-21latency19:50:185
1863399149,3cyclictest12075-21cut00:35:214
18633991412,1cyclictest207052sleep421:41:444
18633991410,2cyclictest481ktimersoftd/423:02:234
1863299141,8cyclictest11629-21idleruntime-cro22:10:003
18632991412,1cyclictest32004-21ssh21:47:283
18630991410,3cyclictest31718-21tr19:30:131
18630991410,3cyclictest31718-21tr19:30:121
18636991311,1cyclictest698-21ptp4l22:14:167
18636991311,1cyclictest0-21swapper/723:03:417
18636991311,1cyclictest0-21swapper/720:10:177
18636991311,1cyclictest0-21swapper/719:20:137
18634991311,1cyclictest19779-21ssh22:13:425
18634991311,1cyclictest0-21swapper/523:22:065
18634991310,2cyclictest561ktimersoftd/521:35:165
1863399139,3cyclictest11291-21sh21:53:294
18633991311,1cyclictest64450irq/122-eth023:21:264
18633991311,1cyclictest49-21ksoftirqd/421:55:244
18633991311,1cyclictest0-21swapper/423:07:194
18633991311,1cyclictest0-21swapper/423:07:194
18633991310,2cyclictest481ktimersoftd/421:39:584
18633991310,2cyclictest481ktimersoftd/421:10:134
18633991310,2cyclictest1643-21cron19:35:004
18633991310,2cyclictest1643-21cron19:35:004
1863299139,3cyclictest17205-21sh23:23:113
1863299137,2cyclictest41-21ksoftirqd/320:00:003
18632991311,1cyclictest26625-21cstates20:15:133
18632991311,1cyclictest18680-21ssh22:12:563
18632991310,2cyclictest401ktimersoftd/321:13:063
18632991310,2cyclictest401ktimersoftd/320:40:143
18631991311,1cyclictest22042-21ssh21:58:522
18631991311,1cyclictest11983-21ssh21:37:422
18631991311,1cyclictest0-21swapper/223:00:212
18631991311,1cyclictest0-21swapper/222:12:352
18631991311,1cyclictest0-21swapper/222:01:402
18631991311,1cyclictest0-21swapper/221:10:242
18631991311,1cyclictest0-21swapper/220:30:112
18631991310,2cyclictest321ktimersoftd/223:20:122
1863199130,12cyclictest0-21swapper/219:15:022
18630991311,1cyclictest8647-21sh23:01:351
18630991311,1cyclictest32195-21sh22:03:521
18630991311,1cyclictest0-21swapper/119:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional