You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 06:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Jun 28, 2026 01:00:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117619970630,430cyclictest12802-21kworker/u16:221:30:324
117619966425,557cyclictest0-21swapper/400:36:094
117619966128,630cyclictest0-21swapper/400:26:534
117619966125,549cyclictest0-21swapper/400:01:534
117649965418,126cyclictest0-21swapper/721:29:557
11758996435,422cyclictest19746-21diskmemload22:37:101
117619963137,591cyclictest470-21ssh00:05:084
11761996300,82cyclictest0-21swapper/421:18:294
11761996300,82cyclictest0-21swapper/421:18:294
117619962530,592cyclictest0-21swapper/423:34:014
1175999617107,507cyclictest0-21swapper/221:29:552
117619961621,592cyclictest0-21swapper/423:56:404
117589961019,84cyclictest0-21swapper/122:50:001
117629960752,296cyclictest0-21swapper/523:19:515
117639960610,423cyclictest11755-21cyclictest22:09:066
11761995971,465cyclictest0-21swapper/421:39:564
11761995971,465cyclictest0-21swapper/421:39:554
11761995971,465cyclictest0-21swapper/421:39:554
11761995971,465cyclictest0-21swapper/421:39:554
11761995951,591cyclictest0-21swapper/423:35:044
11764995931,2cyclictest0-21swapper/723:08:467
11762995931,3cyclictest0-21swapper/523:08:465
1175899592123,296cyclictest0-21swapper/123:08:351
1175899591547,42cyclictest231rcuc/122:21:471
11757995911,382cyclictest0-21swapper/023:08:460
1175999585546,3cyclictest321ktimersoftd/221:17:322
1175999585546,3cyclictest321ktimersoftd/221:17:322
117579958334,84cyclictest0-21swapper/000:15:000
117629957930,84cyclictest0-21swapper/521:29:365
117619957826,549cyclictest0-21swapper/423:00:014
117639957321,84cyclictest0-21swapper/622:27:086
117639957321,84cyclictest0-21swapper/622:27:086
117619957128,464cyclictest0-21swapper/423:07:454
117619956916,550cyclictest0-21swapper/421:26:184
117619956012,164cyclictest0-21swapper/422:48:404
11761995531,549cyclictest0-21swapper/422:25:254
11761995531,549cyclictest0-21swapper/422:25:244
1176499552466,84cyclictest711rcuc/721:36:277
1176499552466,84cyclictest711rcuc/721:36:277
1176499552466,84cyclictest711rcuc/721:36:277
1176499552466,84cyclictest711rcuc/721:36:277
117599955283,211cyclictest0-21swapper/200:36:162
117589955187,295cyclictest0-21swapper/123:33:541
117619955083,464cyclictest0-21swapper/422:37:124
11761995501,465cyclictest0-21swapper/423:19:124
1175999547124,85cyclictest121rcu_preempt22:09:232
117619954636,507cyclictest0-21swapper/423:00:164
1175999545506,37cyclictest311rcuc/223:19:242
117589954576,341cyclictest0-21swapper/122:08:521
1175799544244,84cyclictest0-21swapper/022:47:480
117599954379,3cyclictest32629-21ssh22:48:442
117619954173,465cyclictest0-21swapper/422:24:554
117619954134,504cyclictest0-21swapper/400:46:274
1176099541115,296cyclictest0-21swapper/322:29:133
1176099541115,296cyclictest0-21swapper/322:29:133
1175999539112,211cyclictest661-21taskset22:30:082
117609953869,338cyclictest14822-21taskset22:56:363
117589953868,211cyclictest241ktimersoftd/121:26:271
1176199534193,338cyclictest64450irq/122-eth000:14:474
117599953321,380cyclictest0-21swapper/223:48:052
117589953323,296cyclictest0-21swapper/122:26:411
117589953323,296cyclictest0-21swapper/122:26:411
1176299531444,84cyclictest551rcuc/522:58:045
1175799531109,84cyclictest30780-1rm22:26:580
1175799531109,84cyclictest30780-1rm22:26:570
117619952822,422cyclictest0-21swapper/422:09:454
117599952821,380cyclictest0-21swapper/200:13:202
117599952717,3cyclictest0-21swapper/223:06:512
117639952517,126cyclictest0-21swapper/621:29:556
1175899522313,90cyclictest0-21swapper/100:14:591
1176399518122,126cyclictest0-21swapper/622:38:156
1176399515431,3cyclictest631rcuc/621:17:246
1176399515431,3cyclictest631rcuc/621:17:236
117619951514,292cyclictest0-21swapper/423:46:584
1176399514430,3cyclictest631rcuc/622:24:116
11759995143,346cyclictest0-21swapper/200:04:352
1176399513429,3cyclictest631rcuc/600:01:226
11764995100,84cyclictest15573-21ssh22:37:497
11761995101,506cyclictest0-21swapper/400:40:204
117609951086,126cyclictest0-21swapper/323:06:483
11762995090,84cyclictest4205-21ssh21:18:295
11762995090,84cyclictest4205-21ssh21:18:295
117649950843,83cyclictest0-21swapper/700:12:187
1176399508428,78cyclictest631rcuc/623:32:226
11763995081,256cyclictest32483-21ssh23:08:476
11759995081,127cyclictest0-21swapper/222:24:152
11758995070,84cyclictest19746-21diskmemload23:16:051
1175799507124,126cyclictest19746-21diskmemload00:26:540
1176299506164,126cyclictest121rcu_preempt23:48:435
117589950679,211cyclictest0-21swapper/100:28:391
1176099505384,37cyclictest391rcuc/300:45:573
1175999505422,3cyclictest321ktimersoftd/200:46:392
117579950440,338cyclictest0-21swapper/023:17:350
117609950338,381cyclictest0-21swapper/319:32:593
117579950377,211cyclictest9-21ksoftirqd/022:50:090
1175799503124,126cyclictest9-21ksoftirqd/000:45:530
117579950236,303cyclictest0-21swapper/022:24:400
117619950132,466cyclictest6732-21grep21:40:184
117589950132,211cyclictest17029-21turbostat23:00:001
117619949931,465cyclictest0-21swapper/419:54:474
117589949733,298cyclictest0-21swapper/121:30:311
117619949627,466cyclictest0-21swapper/421:20:124
1176099496375,37cyclictest391rcuc/322:38:223
117599949669,211cyclictest0-21swapper/222:27:372
117599949669,211cyclictest0-21swapper/222:27:372
117589949632,126cyclictest0-21swapper/100:00:551
1175799496112,126cyclictest9-21ksoftirqd/023:34:090
117609949529,211cyclictest0-21swapper/321:30:023
117589949527,253cyclictest0-21swapper/123:47:421
117579949569,211cyclictest0-21swapper/021:36:080
117579949569,211cyclictest0-21swapper/021:36:070
117579949569,211cyclictest0-21swapper/021:36:070
117579949569,211cyclictest0-21swapper/021:36:070
117599949428,211cyclictest0-21swapper/222:39:312
117649949371,256cyclictest11755-21cyclictest23:49:317
1176299493108,295cyclictest0-21swapper/519:51:565
117619949328,462cyclictest0-21swapper/419:32:214
1176099492110,127cyclictest121rcu_preempt23:34:113
117649949025,3cyclictest0-21swapper/722:27:087
117649949025,3cyclictest0-21swapper/722:27:087
117629949027,2cyclictest30886-21rm22:27:085
117629949027,2cyclictest30886-21rm22:27:085
1176199490109,84cyclictest0-21swapper/422:50:094
117609949068,256cyclictest11755-21cyclictest00:13:423
117579948963,211cyclictest0-21swapper/022:08:330
117619948824,253cyclictest0-21swapper/400:15:134
117599948866,255cyclictest0-21swapper/221:30:312
117599948718,211cyclictest0-21swapper/223:10:272
117639948621,256cyclictest0-21swapper/621:39:016
117639948621,256cyclictest0-21swapper/621:39:006
117639948621,256cyclictest0-21swapper/621:39:006
117639948621,256cyclictest0-21swapper/621:39:006
117639948617,338cyclictest0-21swapper/600:13:596
117629948622,261cyclictest0-21swapper/500:47:245
117609948663,84cyclictest0-21swapper/321:36:153
117609948663,84cyclictest0-21swapper/321:36:143
117609948663,84cyclictest0-21swapper/321:36:143
117609948663,84cyclictest0-21swapper/321:36:143
1176299485100,211cyclictest31347-21ssh22:09:205
117589948521,380cyclictest0-21swapper/119:33:001
1175999484184,127cyclictest121rcu_preempt22:56:512
117589948420,126cyclictest0-21swapper/121:39:311
117589948420,126cyclictest0-21swapper/121:39:311
117589948420,126cyclictest0-21swapper/121:39:311
117589948420,126cyclictest0-21swapper/121:39:311
1176099483144,84cyclictest121rcu_preempt23:17:493
117579948315,337cyclictest0-21swapper/021:25:560
117629948214,210cyclictest0-21swapper/500:00:315
117599948012,211cyclictest0-21swapper/223:33:562
117629947894,211cyclictest2291-21ssh22:30:175
1176399477430,45cyclictest631rcuc/619:35:256
117629947712,262cyclictest31157-21ssh22:46:205
117589947755,126cyclictest25-21ksoftirqd/123:00:081
1176399475218,126cyclictest65-21ksoftirqd/600:30:036
117579947510,126cyclictest0-21swapper/022:37:450
117579947143,296cyclictest0-21swapper/022:58:300
117649946846,84cyclictest31931-21kworker/u16:222:58:067
117589946684,42cyclictest28282-21fschecks_count19:35:191
11764994651,2cyclictest0-21swapper/723:33:477
117609946542,84cyclictest121rcu_preempt00:28:593
11760994650,84cyclictest121rcu_preempt21:18:453
11760994650,84cyclictest121rcu_preempt21:18:453
117599946541,126cyclictest0-21swapper/223:56:302
117619946439,422cyclictest1081-21ssh22:30:124
1176099464123,338cyclictest11755-21cyclictest00:01:223
117639946384,83cyclictest121rcu_preempt22:50:406
1176099463124,337cyclictest0-21swapper/323:50:023
1176099463122,338cyclictest0-21swapper/323:00:093
1175999463458,3cyclictest321ktimersoftd/221:39:042
1175999463458,3cyclictest321ktimersoftd/221:39:032
1175999463458,3cyclictest321ktimersoftd/221:39:032
1175999463458,3cyclictest321ktimersoftd/221:39:032
1176499462246,84cyclictest0-21swapper/719:32:547
1176499462122,337cyclictest0-21swapper/723:17:337
1176499462121,338cyclictest0-21swapper/722:47:187
117599946278,211cyclictest33-21ksoftirqd/219:34:442
1176399461340,37cyclictest631rcuc/622:47:276
1176299461246,84cyclictest23234-21kworker/u16:300:12:355
1176099461206,253cyclictest0-21swapper/300:36:163
117599946133,211cyclictest0-21swapper/219:55:112
117579946177,211cyclictest101ktimersoftd/021:17:440
117579946177,211cyclictest101ktimersoftd/021:17:440
117619946035,83cyclictest49-21ksoftirqd/422:40:014
117609946037,47cyclictest0-21swapper/321:30:313
117599946034,253cyclictest0-21swapper/219:51:052
117589946080,296cyclictest11755-21cyclictest00:46:211
117649945979,84cyclictest0-21swapper/700:46:217
117629945980,211cyclictest4616-1kworker/u17:121:39:315
117629945980,211cyclictest4616-1kworker/u17:121:39:315
117629945980,211cyclictest4616-1kworker/u17:121:39:315
117629945980,211cyclictest4616-1kworker/u17:121:39:315
1176299459160,127cyclictest121rcu_preempt22:24:235
1176299459118,126cyclictest57-21ksoftirqd/523:34:095
117609945935,126cyclictest0-21swapper/322:08:533
117579945937,85cyclictest0-21swapper/000:36:580
1176099458119,336cyclictest0-21swapper/322:48:073
117599945834,126cyclictest0-21swapper/222:50:392
117579945730,126cyclictest0-21swapper/000:02:180
117639945628,212cyclictest0-21swapper/619:30:216
1175999456114,169cyclictest0-21swapper/222:40:242
117599945532,256cyclictest0-21swapper/200:28:162
1175999455115,209cyclictest2813-21nscd00:40:262
117589945533,256cyclictest0-21swapper/122:50:251
117579945534,260cyclictest0-21swapper/019:54:180
1176499454248,84cyclictest0-21swapper/721:20:077
1176499454197,254cyclictest721ktimersoftd/722:09:327
1175799454112,211cyclictest9-21ksoftirqd/000:30:200
1176499453112,338cyclictest0-21swapper/700:36:287
117639945372,84cyclictest0-21swapper/623:55:386
1176399453116,170cyclictest0-21swapper/623:46:566
1176399453116,170cyclictest0-21swapper/619:53:366
1176299453113,338cyclictest30840-1kworker/u17:000:29:435
1175799453243,42cyclictest6605-21cut21:40:150
1176499452111,338cyclictest0-21swapper/723:56:587
1176399452114,172cyclictest0-21swapper/621:30:316
117629945230,210cyclictest0-21swapper/523:56:275
117599945224,211cyclictest33-21ksoftirqd/221:40:192
1176399451114,171cyclictest0-21swapper/623:00:046
1176099451110,338cyclictest0-21swapper/319:54:573
1176399450109,338cyclictest0-21swapper/623:00:096
117619945023,424cyclictest0-21swapper/423:40:244
117589945066,211cyclictest25-21ksoftirqd/121:40:181
1175899450109,126cyclictest21736-21ssh23:56:401
117579945066,210cyclictest0-21swapper/023:48:010
117649944926,256cyclictest0-21swapper/721:19:377
117649944926,256cyclictest0-21swapper/721:19:367
117589944965,211cyclictest25-21ksoftirqd/121:18:131
117589944965,211cyclictest25-21ksoftirqd/121:18:121
117609944865,380cyclictest0-21swapper/323:55:583
117589944826,169cyclictest0-21swapper/122:10:081
1176099447106,338cyclictest0-21swapper/300:05:143
117629944622,43cyclictest0-21swapper/519:31:205
117629944622,43cyclictest0-21swapper/500:36:505
117639944561,211cyclictest0-21swapper/623:17:156
117619944523,343cyclictest0-21swapper/400:30:094
117629944422,2cyclictest0-21swapper/522:37:285
117619944423,294cyclictest0-21swapper/422:10:034
117629944321,3cyclictest0-21swapper/500:30:115
117599944320,3cyclictest0-21swapper/221:20:142
117629944125,290cyclictest0-21swapper/521:40:285
117589944018,256cyclictest0-21swapper/100:30:111
117619943917,165cyclictest0-21swapper/419:55:114
117579943857,84cyclictest11755-21cyclictest21:30:360
1176299437138,126cyclictest121rcu_preempt21:20:065
117589943614,219cyclictest0-21swapper/122:40:211
11764994336,211cyclictest0-21swapper/700:29:377
11764994307,256cyclictest0-21swapper/722:23:557
11757994282,211cyclictest0-21swapper/019:33:500
1175899427167,126cyclictest121rcu_preempt00:36:081
11760994251,3cyclictest0-21swapper/322:24:213
11764994231,3cyclictest0-21swapper/700:04:287
117639942342,83cyclictest0-21swapper/600:47:026
1175799422123,126cyclictest0-21swapper/023:55:390
117649942181,84cyclictest0-21swapper/721:40:247
117639942040,84cyclictest0-21swapper/600:37:006
117609942040,3cyclictest0-21swapper/323:35:023
117609941980,84cyclictest0-21swapper/322:40:023
117609941980,84cyclictest0-21swapper/322:10:133
117609941980,84cyclictest0-21swapper/319:35:253
117579941981,84cyclictest0-21swapper/022:40:230
117609941879,84cyclictest11755-21cyclictest19:55:123
117649941737,84cyclictest0-21swapper/722:50:097
117649941736,84cyclictest0-21swapper/723:50:207
1176299417372,42cyclictest19746-21diskmemload21:30:295
117589941775,211cyclictest0-21swapper/119:52:551
117609941677,84cyclictest0-21swapper/321:40:243
117649941575,168cyclictest0-21swapper/700:40:347
1176499414115,296cyclictest0-21swapper/700:15:077
117639941471,84cyclictest0-21swapper/622:10:136
1175799414115,126cyclictest121rcu_preempt23:00:150
117649941373,84cyclictest0-21swapper/721:30:237
117629941373,253cyclictest0-21swapper/522:40:315
117629941372,253cyclictest0-21swapper/500:05:065
117579941334,84cyclictest1553-21runrttasks19:55:030
117639941232,177cyclictest0-21swapper/621:20:036
117629941232,41cyclictest0-21swapper/500:15:175
117579941271,216cyclictest0-21swapper/023:40:260
1176399411116,211cyclictest0-21swapper/623:10:296
1176299411116,211cyclictest0-21swapper/523:00:155
117629941071,84cyclictest0-21swapper/522:10:065
117599941069,338cyclictest0-21swapper/219:35:252
1176399409330,76cyclictest641ktimersoftd/600:40:256
1176099409110,297cyclictest0-21swapper/300:15:073
117639940867,84cyclictest0-21swapper/622:40:026
117639940827,84cyclictest1553-21runrttasks00:05:166
117629940827,42cyclictest0-21swapper/522:50:325
117609940869,84cyclictest0-21swapper/321:20:053
117579940769,84cyclictest0-21swapper/019:35:260
117619940522,126cyclictest0-21swapper/419:35:184
1176499404148,84cyclictest121rcu_preempt22:30:177
117579940465,84cyclictest0-21swapper/000:15:180
117649940364,84cyclictest19582-21rm22:40:237
117639940364,84cyclictest0-21swapper/621:40:246
117589940365,84cyclictest121rcu_preempt22:30:061
117649940263,84cyclictest0-21swapper/722:10:067
117589940222,2cyclictest0-21swapper/123:35:021
117589940217,296cyclictest0-21swapper/123:40:261
117639939960,84cyclictest0-21swapper/600:15:176
117619939454,126cyclictest121rcu_preempt23:10:294
117579939455,84cyclictest0-21swapper/022:10:130
117649939355,171cyclictest0-21swapper/719:51:257
117609939356,171cyclictest0-21swapper/300:40:123
11760993929,380cyclictest0-21swapper/322:50:033
117649938848,84cyclictest0-21swapper/723:00:107
1176199387304,3cyclictest481ktimersoftd/423:20:054
117589938791,84cyclictest32486-21kworker/u16:000:05:261
117579938445,84cyclictest0-21swapper/023:35:020
117609937840,3cyclictest0-21swapper/300:30:113
117579937735,127cyclictest0-21swapper/023:10:260
117649937576,126cyclictest121rcu_preempt00:05:087
117649937535,83cyclictest0-21swapper/723:40:287
117599937478,84cyclictest121rcu_preempt22:10:062
117599937475,296cyclictest0-21swapper/200:15:072
117589937432,84cyclictest31070-21fschecks_count00:40:151
117579937433,211cyclictest31745-21memory00:40:190
117639937373,127cyclictest0-21swapper/600:30:126
117609937377,84cyclictest0-21swapper/322:30:043
1175899372161,128cyclictest241ktimersoftd/123:10:271
117589937134,3cyclictest0-21swapper/121:20:141
117629936831,171cyclictest0-21swapper/519:55:045
117629936826,211cyclictest32035-21open_files00:40:275
117599936829,84cyclictest0-21swapper/223:35:042
117609936728,84cyclictest0-21swapper/323:40:283
117589936730,84cyclictest0-21swapper/100:15:171
117639936629,211cyclictest19746-21diskmemload23:40:316
117629936627,84cyclictest0-21swapper/523:35:025
117599936628,47cyclictest33-21ksoftirqd/223:00:192
117579936526,84cyclictest0-21swapper/021:20:120
117579936523,126cyclictest0-21swapper/023:20:050
117629936427,215cyclictest0-21swapper/523:40:325
1176499360103,255cyclictest0-21swapper/719:35:147
117599936022,3cyclictest0-21swapper/200:05:142
117639935918,126cyclictest0-21swapper/623:35:036
117649935713,85cyclictest0-21swapper/723:10:287
117649935423,205cyclictest1553-21runrttasks19:55:097
117619935312,126cyclictest121rcu_preempt23:50:184
11760993508,84cyclictest0-21swapper/323:10:283
117579934994,253cyclictest0-21swapper/023:50:180
117579934514,78cyclictest0-21swapper/000:05:060
11759993445,84cyclictest0-21swapper/223:50:182
1176499339125,126cyclictest13083-21hddtemp_smartct00:30:167
117599933881,254cyclictest0-21swapper/200:30:112
117639933683,85cyclictest640-21ssh22:30:046
117589933439,2cyclictest0-21swapper/119:55:031
117629933379,84cyclictest0-21swapper/519:35:255
117629933136,43cyclictest0-21swapper/523:50:195
117639933029,254cyclictest0-21swapper/619:55:046
117589932880,118cyclictest32486-21kworker/u16:023:20:051
117579932732,84cyclictest0-21swapper/022:30:120
117639932328,47cyclictest0-21swapper/623:50:196
117629932366,254cyclictest0-21swapper/523:10:285
1175999318114,123cyclictest0-21swapper/223:40:282
1176099317106,48cyclictest19746-21diskmemload23:50:193
117629930814,210cyclictest0-21swapper/523:20:045
117599930813,85cyclictest0-21swapper/223:20:042
117589928931,126cyclictest25-21ksoftirqd/123:50:191
117649928834,126cyclictest0-21swapper/723:20:057
1176499285112,126cyclictest12905-21ssh23:35:057
1176399279153,3cyclictest641ktimersoftd/623:20:066
117609925545,2cyclictest0-21swapper/323:20:053
1131228655,27sleep40-21swapper/419:09:494
1131528454,27sleep70-21swapper/719:09:527
1122628250,28sleep10-21swapper/119:08:331
1119328251,27sleep60-21swapper/619:08:066
1128228151,27sleep30-21swapper/319:09:243
1120128150,27sleep50-21swapper/519:08:145
1117028150,28sleep20-21swapper/219:07:462
1111828053,24sleep00-21swapper/019:07:040
16612760,0sleep40-21swapper/423:27:334
48872590,2sleep6631rcuc/621:55:146
1132824138,1sleep00-21swapper/019:10:010
11761993025,5cyclictest0-21swapper/421:07:434
11764992910,18cyclictest0-21swapper/719:13:237
11760992910,18cyclictest0-21swapper/319:13:363
11764992810,0cyclictest0-21swapper/719:22:277
11763992810,17cyclictest0-21swapper/620:28:426
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional