You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 12:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Jun 29, 2026 00:56:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13421998533,42cyclictest0-21swapper/621:21:426
134219982820,805cyclictest0-21swapper/622:47:536
1342099723125,381cyclictest0-21swapper/521:20:535
1342299690433,254cyclictest9075-21ssh22:48:267
134229968184,383cyclictest0-21swapper/722:50:057
134209967538,465cyclictest0-21swapper/500:06:345
1341799671627,42cyclictest311rcuc/222:53:072
1342199661107,380cyclictest0-21swapper/621:49:286
134219965964,592cyclictest0-21swapper/619:49:276
134229965517,634cyclictest0-21swapper/700:43:377
1341699650270,220cyclictest28129-21latency_hist21:49:591
13420996446,465cyclictest0-21swapper/522:48:265
13415996370,84cyclictest0-21swapper/021:19:000
13416996360,84cyclictest0-21swapper/121:19:011
134229962877,126cyclictest121rcu_preempt00:26:077
134169962630,381cyclictest30510-1kworker/u17:223:48:031
134219962530,592cyclictest0-21swapper/623:34:036
134159962532,126cyclictest121rcu_preempt00:27:100
134159962431,126cyclictest0-21swapper/021:20:530
1341699621367,83cyclictest0-21swapper/100:07:471
1341999620279,338cyclictest64450irq/122-eth000:06:514
1341699619109,295cyclictest0-21swapper/122:55:071
134219961317,593cyclictest0-21swapper/623:14:476
1341599613273,337cyclictest1288-21kworker/u16:000:21:310
134219961259,550cyclictest0-21swapper/600:42:266
1342099612190,168cyclictest121rcu_preempt20:47:005
134199961018,383cyclictest0-21swapper/422:49:074
134219960914,592cyclictest0-21swapper/620:50:126
134229959786,507cyclictest0-21swapper/700:23:417
13417995940,84cyclictest0-21swapper/200:07:172
1341699590207,168cyclictest19238-21cpuspeed_turbos00:25:141
134209958880,85cyclictest121rcu_preempt23:47:495
134169958880,126cyclictest0-21swapper/121:54:081
134229958733,381cyclictest0-21swapper/721:46:077
134219958574,211cyclictest641ktimersoftd/600:23:166
1342299580111,296cyclictest0-21swapper/723:32:277
134219957664,380cyclictest0-21swapper/600:26:536
134189957626,381cyclictest0-21swapper/321:52:313
134219957524,126cyclictest0-21swapper/620:47:006
134209957567,126cyclictest0-21swapper/523:33:425
1341999575236,84cyclictest64450irq/122-eth022:33:584
134219957362,297cyclictest0-21swapper/600:09:196
1341999567226,338cyclictest64450irq/122-eth023:14:504
134209956596,466cyclictest6533-21ssh21:19:195
134179956514,126cyclictest0-21swapper/221:22:042
134179956351,296cyclictest0-21swapper/221:54:122
134189956212,383cyclictest0-21swapper/322:49:063
1341599562348,126cyclictest0-21swapper/022:47:140
1341899559264,84cyclictest0-21swapper/300:26:273
134159955950,127cyclictest698-21ptp4l21:52:410
13422995585,380cyclictest0-21swapper/721:50:367
1341699558515,41cyclictest231rcuc/123:50:071
1341599558131,254cyclictest0-21swapper/000:43:370
13421995573,338cyclictest0-21swapper/622:32:446
134169955788,126cyclictest121rcu_preempt22:46:291
1341699554254,128cyclictest0-21swapper/122:33:061
13415995545,84cyclictest1553-21runrttasks20:49:310
13416995501,126cyclictest0-21swapper/123:57:221
134159955086,253cyclictest0-21swapper/022:54:540
1341599548335,83cyclictest0-21swapper/023:35:070
134199954635,296cyclictest0-21swapper/423:32:014
1341599546120,211cyclictest24898-21ssh00:10:170
1341599545462,3cyclictest101ktimersoftd/023:32:090
134189954435,84cyclictest0-21swapper/322:34:533
1341899543115,127cyclictest0-21swapper/321:24:163
134209954276,126cyclictest0-21swapper/500:43:375
134209954234,85cyclictest0-21swapper/500:21:525
1341899542159,126cyclictest121rcu_preempt23:35:133
134189954130,296cyclictest0-21swapper/323:27:233
134189954130,296cyclictest0-21swapper/323:27:233
1341899541286,126cyclictest0-21swapper/321:47:163
1341899541114,296cyclictest0-21swapper/323:32:433
134169954134,84cyclictest0-21swapper/123:32:091
134229954071,296cyclictest0-21swapper/721:20:507
134189953768,211cyclictest0-21swapper/300:43:273
134169953571,84cyclictest0-21swapper/100:24:011
1341699535363,84cyclictest0-21swapper/123:14:051
134219953424,508cyclictest13413-21cyclictest21:50:026
134209953425,126cyclictest0-21swapper/519:48:035
134159953464,211cyclictest0-21swapper/023:27:240
134159953464,211cyclictest0-21swapper/023:27:230
1342299533277,127cyclictest21632-21kworker/u16:221:17:497
134219953322,84cyclictest0-21swapper/621:25:086
134189953264,465cyclictest0-21swapper/300:21:313
134189953222,127cyclictest0-21swapper/321:18:073
134169952961,253cyclictest0-21swapper/121:20:411
134229952718,86cyclictest0-21swapper/723:14:077
134179952716,84cyclictest0-21swapper/200:44:232
134209952615,338cyclictest0-21swapper/523:15:075
1341799526141,253cyclictest20317-21kworker/u16:323:34:522
134199952516,50cyclictest0-21swapper/421:23:214
134199952420,381cyclictest0-21swapper/421:46:124
134209952318,123cyclictest0-21swapper/523:56:165
134219952256,211cyclictest0-21swapper/621:18:586
134199952114,84cyclictest0-21swapper/422:50:234
13422995197,424cyclictest14900-21ssh22:33:477
13421995196,338cyclictest0-21swapper/623:35:046
13419995142,338cyclictest0-21swapper/423:57:264
13419995131,8cyclictest121rcu_preempt23:49:514
13416995132,126cyclictest0-21swapper/100:10:211
13421995122,41cyclictest0-21swapper/622:54:536
13418995101,84cyclictest0-21swapper/323:49:423
134229950982,211cyclictest73-21ksoftirqd/700:06:387
134209950939,296cyclictest0-21swapper/521:52:415
13418995092,84cyclictest0-21swapper/323:15:063
13417995081,256cyclictest9563-21ssh22:49:072
13420995061,90cyclictest0-21swapper/521:47:525
1341799506461,42cyclictest311rcuc/221:18:442
134169950644,124cyclictest0-21swapper/122:54:451
1341899505205,126cyclictest121rcu_preempt22:51:503
134219950477,211cyclictest0-21swapper/623:56:136
134219950440,253cyclictest0-21swapper/623:48:286
134159950482,42cyclictest0-21swapper/023:12:200
134159950478,296cyclictest0-21swapper/023:49:410
134159950438,126cyclictest0-21swapper/023:57:270
134229950376,211cyclictest73-21ksoftirqd/723:26:597
134229950376,211cyclictest73-21ksoftirqd/723:26:587
1341899503419,3cyclictest401ktimersoftd/300:09:483
1341699503212,80cyclictest0-21swapper/123:15:271
134159950234,126cyclictest28127-21idleruntime-cro21:50:000
134219949973,211cyclictest65-21ksoftirqd/622:55:036
1341999499116,253cyclictest5570-21ssh21:17:594
1341799499413,84cyclictest321ktimersoftd/200:27:102
134199949834,43cyclictest0-21swapper/423:25:564
134199949834,43cyclictest0-21swapper/423:25:554
1341999498159,84cyclictest21256-21diskmemload00:44:074
134169949630,84cyclictest0-21swapper/123:26:391
134169949630,84cyclictest0-21swapper/123:26:391
134209949429,260cyclictest0-21swapper/522:33:415
1341699493367,42cyclictest241ktimersoftd/122:35:231
134199949229,41cyclictest0-21swapper/421:54:264
134199949125,84cyclictest0-21swapper/423:50:194
134179949169,84cyclictest0-21swapper/200:10:082
134199948823,126cyclictest0-21swapper/400:26:114
134199948216,47cyclictest121rcu_preempt22:55:074
134189948213,211cyclictest41-21ksoftirqd/323:56:463
134169948218,84cyclictest0-21swapper/120:48:551
134179948115,126cyclictest0-21swapper/223:48:512
134209948014,126cyclictest0-21swapper/523:27:095
134209948014,126cyclictest0-21swapper/523:27:095
134199948054,253cyclictest121rcu_preempt00:23:084
134179948011,296cyclictest0-21swapper/223:35:092
134189947895,253cyclictest0-21swapper/320:48:223
134179947852,295cyclictest0-21swapper/223:13:402
134159947813,3cyclictest0-21swapper/022:55:330
134199947713,84cyclictest0-21swapper/423:35:134
134179947697,211cyclictest21256-21diskmemload23:15:102
134179947612,302cyclictest0-21swapper/222:55:352
13421994745,84cyclictest0-21swapper/623:27:066
13421994745,84cyclictest0-21swapper/623:27:066
13418994745,338cyclictest0-21swapper/323:50:073
13418994738,2cyclictest0-21swapper/322:55:333
13422994703,211cyclictest0-21swapper/723:49:207
13417994708,373cyclictest0-21swapper/220:48:072
13415994704,84cyclictest0-21swapper/021:25:050
13419994671,50cyclictest0-21swapper/419:49:254
13416994651,84cyclictest0-21swapper/100:44:381
1342099464125,126cyclictest14721-21runrttasks22:52:335
134229946379,254cyclictest0-21swapper/723:50:107
134229946340,256cyclictest0-21swapper/719:48:287
1342199463123,338cyclictest0-21swapper/600:10:246
134209946341,253cyclictest0-21swapper/500:26:415
134189946335,212cyclictest0-21swapper/323:20:093
134229946281,296cyclictest0-21swapper/723:56:377
134179946280,84cyclictest0-21swapper/221:48:482
134179946134,211cyclictest15880-21ssh00:21:432
134159946140,126cyclictest0-21swapper/000:09:500
134229945936,3cyclictest0-21swapper/722:55:077
1341899459117,169cyclictest24196-21runrttasks00:10:083
134159945836,2cyclictest0-21swapper/022:33:510
134179945735,2cyclictest0-21swapper/219:49:442
134169945734,84cyclictest0-21swapper/119:49:011
1342299456374,3cyclictest711rcuc/720:47:217
134209945432,177cyclictest690-21avahi-daemon23:50:065
1341999454113,126cyclictest18019-21rm22:35:234
134199945230,43cyclictest0-21swapper/421:55:114
134179945267,211cyclictest0-21swapper/219:50:122
134159945270,85cyclictest22014-21memory23:50:260
134179944925,84cyclictest0-21swapper/221:55:072
1341599449154,126cyclictest121rcu_preempt19:48:380
134219944865,380cyclictest0-21swapper/623:15:106
134229944725,256cyclictest13413-21cyclictest21:25:097
134229944724,339cyclictest0-21swapper/719:50:117
134199944724,83cyclictest0-21swapper/400:10:074
134229944666,84cyclictest0-21swapper/721:55:147
134209944623,256cyclictest0-21swapper/521:25:085
1342299445105,84cyclictest0-21swapper/723:35:077
134169944562,253cyclictest121rcu_preempt21:55:081
134189944297,296cyclictest0-21swapper/321:25:053
134189944220,253cyclictest0-21swapper/323:15:263
134219944121,253cyclictest13413-21cyclictest22:35:226
134209944059,168cyclictest0-21swapper/522:55:325
134189944014,253cyclictest0-21swapper/319:47:583
134179944018,260cyclictest0-21swapper/223:50:172
1341799439101,172cyclictest0-21swapper/223:26:512
1341799439101,172cyclictest0-21swapper/223:26:512
1341799439101,171cyclictest0-21swapper/221:25:092
134169943897,338cyclictest704-21nscd23:35:071
134209943754,380cyclictest0-21swapper/523:15:105
134199943615,176cyclictest0-21swapper/423:20:064
134199943515,289cyclictest0-21swapper/423:15:274
134189943511,211cyclictest0-21swapper/322:35:233
1341799435179,253cyclictest30558-21nscd23:57:022
134169943394,84cyclictest0-21swapper/123:20:091
13421994283,41cyclictest0-21swapper/623:50:086
134229942641,210cyclictest0-21swapper/700:10:207
13419994253,253cyclictest0-21swapper/420:49:484
134229942483,338cyclictest0-21swapper/722:35:187
134209942483,338cyclictest0-21swapper/523:35:115
13420994231,255cyclictest0-21swapper/520:50:085
134159942382,338cyclictest0-21swapper/021:55:110
1342199421337,3cyclictest631rcuc/621:55:056
134179942181,338cyclictest0-21swapper/222:34:092
1342099419162,84cyclictest121rcu_preempt00:10:265
1342199417120,295cyclictest13413-21cyclictest19:50:136
134209941675,338cyclictest0-21swapper/519:50:125
134199941576,84cyclictest0-21swapper/421:25:054
134209941332,126cyclictest0-21swapper/522:35:255
134169941127,211cyclictest13396-21apt21:25:121
134229941069,338cyclictest0-21swapper/723:15:097
134159941027,126cyclictest16213-21ssh22:35:030
134209940930,211cyclictest0-21swapper/521:55:095
1342099403103,127cyclictest0-21swapper/523:20:095
134219939414,296cyclictest0-21swapper/619:14:126
134199938446,84cyclictest0-21swapper/419:50:124
1341899384169,84cyclictest121rcu_preempt21:55:053
13422993811,213cyclictest0-21swapper/720:50:077
134159938083,84cyclictest0-21swapper/020:50:100
134159937778,296cyclictest0-21swapper/023:20:080
134219937131,126cyclictest31747-21ssh23:20:096
134179937133,127cyclictest33-21ksoftirqd/222:35:042
134159937134,2cyclictest0-21swapper/023:15:290
1341699366110,253cyclictest6246-21apt19:50:121
134189936526,84cyclictest0-21swapper/320:50:123
134169936528,83cyclictest0-21swapper/120:50:121
134209936427,42cyclictest0-21swapper/519:14:115
1341799357100,254cyclictest0-21swapper/220:50:112
134159935718,84cyclictest0-21swapper/019:50:110
134199935417,42cyclictest0-21swapper/420:50:084
134189935415,84cyclictest0-21swapper/319:50:123
134179935358,84cyclictest0-21swapper/223:20:092
134229933680,253cyclictest0-21swapper/723:20:107
134229932530,50cyclictest0-21swapper/719:14:107
134189930814,2cyclictest0-21swapper/319:14:123
13416993036,84cyclictest0-21swapper/119:14:101
134159930043,168cyclictest0-21swapper/019:14:110
134199929783,84cyclictest0-21swapper/419:14:114
134179927115,126cyclictest0-21swapper/219:14:112
1264829645,29sleep60-21swapper/619:08:086
1264829645,29sleep60-21swapper/619:08:086
1255129446,27sleep40-21swapper/419:06:464
1255129446,27sleep40-21swapper/419:06:454
1262529264,5sleep10-21swapper/119:07:471
1262529264,5sleep10-21swapper/119:07:471
1180329263,24sleep70-21swapper/719:05:217
1180329263,24sleep70-21swapper/719:05:217
1275028251,27sleep30-21swapper/319:09:343
1275028251,27sleep30-21swapper/319:09:333
1270028251,28sleep20-21swapper/219:08:532
1270028251,28sleep20-21swapper/219:08:522
1267628251,27sleep50-21swapper/519:08:315
1267628251,27sleep50-21swapper/519:08:305
1256528050,27sleep00-21swapper/019:06:580
1256528050,27sleep00-21swapper/019:06:580
272872750,0sleep50-21swapper/521:31:105
292422720,0sleep70-21swapper/722:08:207
101082710,0sleep70-21swapper/722:15:097
13420993310,17cyclictest0-21swapper/519:35:345
13420993226,5cyclictest0-21swapper/522:18:145
13420993210,0cyclictest0-21swapper/519:19:205
13420993110,17cyclictest0-21swapper/520:31:115
62482290,1sleep30-21swapper/300:16:543
13422992810,18cyclictest0-21swapper/721:44:377
13422992810,18cyclictest0-21swapper/720:07:097
13418992810,18cyclictest0-21swapper/322:17:583
13418992810,18cyclictest0-21swapper/321:44:193
13418992810,18cyclictest0-21swapper/321:04:223
13418992810,18cyclictest0-21swapper/320:44:543
13418992810,18cyclictest0-21swapper/320:16:313
13418992810,0cyclictest0-21swapper/320:07:103
13417992810,18cyclictest0-21swapper/222:17:512
13417992810,18cyclictest0-21swapper/221:44:392
13415992810,18cyclictest0-21swapper/021:44:220
13422992727,0cyclictest0-21swapper/719:35:537
13422992727,0cyclictest0-21swapper/719:27:467
13422992710,17cyclictest0-21swapper/719:18:567
13422992710,0cyclictest0-21swapper/720:30:477
13421992727,0cyclictest0-21swapper/620:30:486
13421992710,17cyclictest0-21swapper/621:44:216
13421992710,17cyclictest0-21swapper/621:04:026
13421992710,17cyclictest0-21swapper/619:35:546
13421992710,17cyclictest0-21swapper/619:27:436
13421992710,17cyclictest0-21swapper/619:19:186
13421992710,0cyclictest0-21swapper/622:17:386
13421992710,0cyclictest0-21swapper/620:16:346
13421992710,0cyclictest0-21swapper/620:07:056
13420992710,17cyclictest0-21swapper/521:04:035
13420992710,17cyclictest0-21swapper/520:16:325
13420992710,17cyclictest0-21swapper/519:27:545
13420992710,0cyclictest0-21swapper/521:44:125
13420992710,0cyclictest0-21swapper/520:44:545
13420992710,0cyclictest0-21swapper/520:07:165
13419992710,17cyclictest0-21swapper/422:17:454
13419992710,17cyclictest0-21swapper/421:44:154
13419992710,17cyclictest0-21swapper/420:30:424
13419992710,17cyclictest0-21swapper/420:16:364
13419992710,17cyclictest0-21swapper/420:06:424
13419992710,17cyclictest0-21swapper/419:27:554
13419992710,17cyclictest0-21swapper/419:19:264
13418992727,0cyclictest0-21swapper/320:30:403
13418992727,0cyclictest0-21swapper/319:35:333
13418992710,17cyclictest0-21swapper/319:27:523
13418992710,0cyclictest0-21swapper/319:19:123
13417992727,0cyclictest0-21swapper/220:30:432
13417992727,0cyclictest0-21swapper/219:35:522
13417992710,17cyclictest0-21swapper/220:44:582
13417992710,17cyclictest0-21swapper/220:07:062
13417992710,0cyclictest0-21swapper/221:04:072
13417992710,0cyclictest0-21swapper/220:16:572
13417992710,0cyclictest0-21swapper/219:27:302
13416992727,0cyclictest0-21swapper/119:18:541
13416992710,17cyclictest0-21swapper/121:44:181
13416992710,17cyclictest0-21swapper/120:16:371
13416992710,17cyclictest0-21swapper/119:35:311
13416992710,17cyclictest0-21swapper/119:27:291
13416992710,0cyclictest0-21swapper/122:17:341
13416992710,0cyclictest0-21swapper/120:44:511
13416992710,0cyclictest0-21swapper/120:31:101
13416992710,0cyclictest0-21swapper/120:07:161
13415992727,0cyclictest0-21swapper/019:19:110
13415992710,17cyclictest0-21swapper/022:17:430
13415992710,17cyclictest0-21swapper/021:03:570
13415992710,17cyclictest0-21swapper/020:44:590
13415992710,17cyclictest0-21swapper/020:30:520
13415992710,17cyclictest0-21swapper/020:16:360
13415992710,17cyclictest0-21swapper/020:06:450
13415992710,17cyclictest0-21swapper/019:35:310
13415992710,0cyclictest0-21swapper/019:27:500
13422992626,0cyclictest0-21swapper/721:04:237
13422992626,0cyclictest0-21swapper/720:44:567
13422992626,0cyclictest0-21swapper/720:16:397
13421992626,0cyclictest0-21swapper/620:44:576
13419992626,0cyclictest0-21swapper/421:04:224
13419992626,0cyclictest0-21swapper/420:44:534
13419992626,0cyclictest0-21swapper/419:35:344
13417992626,0cyclictest0-21swapper/219:18:562
13416992626,0cyclictest0-21swapper/121:04:051
308072210,0sleep40-21swapper/400:31:194
1341599214,8cyclictest13883-21latency_hist00:40:000
68162180,0sleep10-21swapper/100:35:241
34422180,0sleep50-21swapper/520:40:005
1341999184,8cyclictest49-21ksoftirqd/400:05:004
13415991715,1cyclictest0-21swapper/021:10:170
298702160,0sleep50-21swapper/500:30:405
1341999157,2cyclictest49-21ksoftirqd/419:35:004
1341999153,7cyclictest49-21ksoftirqd/422:11:564
1341999153,6cyclictest49-21ksoftirqd/423:44:594
1341999153,6cyclictest49-21ksoftirqd/422:20:174
13419991513,1cyclictest481ktimersoftd/422:00:434
13419991511,1cyclictest0-21swapper/422:06:304
13415991512,2cyclictest101ktimersoftd/020:25:130
1341599150,2cyclictest7947-21irqstats00:00:150
13422991412,1cyclictest3740-21cat21:35:237
13421991412,1cyclictest0-21swapper/600:00:206
1341999147,2cyclictest49-21ksoftirqd/422:40:084
1341999144,6cyclictest49-21ksoftirqd/423:05:114
1341999144,5cyclictest49-21ksoftirqd/421:35:204
1341999143,7cyclictest49-21ksoftirqd/421:32:084
1341999143,6cyclictest49-21ksoftirqd/422:26:154
1341999143,6cyclictest49-21ksoftirqd/420:55:134
1341999143,5cyclictest49-21ksoftirqd/400:16:194
1341999142,6cyclictest49-21ksoftirqd/400:35:194
13419991410,2cyclictest481ktimersoftd/423:00:154
1341799140,13cyclictest0-21swapper/200:00:152
13415991412,1cyclictest3378-21latency_hist22:45:000
1341599140,12cyclictest10622-21wc19:55:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional