You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 21:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Jul 04, 2026 12:55:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
229069979270,84cyclictest4822-21ssh11:15:374
229069971838,126cyclictest22899-21cyclictest09:09:324
229069971780,84cyclictest23718-21ssh12:40:014
2290499689650,3cyclictest311rcuc/207:50:152
229069965615,508cyclictest0-21swapper/410:07:224
22906996351,429cyclictest29668-21taskset12:05:294
229069963482,423cyclictest0-21swapper/412:03:504
229069962977,549cyclictest0-21swapper/411:55:134
2290599624113,508cyclictest0-21swapper/310:42:273
229069962269,84cyclictest0-21swapper/412:12:204
229019961764,126cyclictest131rcu_sched12:05:010
229019961623,126cyclictest0-21swapper/011:19:080
2290999615104,508cyclictest0-21swapper/710:42:277
229069960611,592cyclictest0-21swapper/409:10:144
229069960595,253cyclictest0-21swapper/410:17:004
2290699600259,338cyclictest64450irq/122-eth011:54:114
22906995983,592cyclictest0-21swapper/410:04:294
22906995961,592cyclictest0-21swapper/410:43:324
22906995940,84cyclictest0-21swapper/411:39:124
22904995940,84cyclictest0-21swapper/211:39:132
22908995930,83cyclictest0-21swapper/611:39:136
22901995930,84cyclictest0-21swapper/011:55:130
229049959283,253cyclictest0-21swapper/210:42:282
229039958834,338cyclictest0-21swapper/111:16:421
229059958776,296cyclictest0-21swapper/310:53:323
229039958777,507cyclictest0-21swapper/110:42:281
229069958634,549cyclictest0-21swapper/412:17:494
2290199586288,84cyclictest0-21swapper/010:05:510
229049958274,296cyclictest0-21swapper/211:29:272
229079958032,124cyclictest0-21swapper/510:09:285
2290799578240,84cyclictest11070-21kworker/u16:009:12:505
229069957867,508cyclictest0-21swapper/412:29:434
2290599575492,3cyclictest391rcuc/310:06:463
229069957425,45cyclictest0-21swapper/409:51:554
229069957422,549cyclictest0-21swapper/410:14:284
229049957467,295cyclictest121rcu_preempt10:37:192
229069957324,465cyclictest0-21swapper/410:38:374
229089957159,88cyclictest121rcu_preempt10:09:366
229039957123,382cyclictest0-21swapper/110:10:371
229079957062,126cyclictest0-21swapper/509:42:545
229079957062,126cyclictest0-21swapper/509:42:545
229069956723,37cyclictest0-21swapper/411:10:154
2290199567101,293cyclictest0-21swapper/011:39:450
229039956613,126cyclictest0-21swapper/109:44:051
229039956613,126cyclictest0-21swapper/109:44:051
229059956313,383cyclictest0-21swapper/310:10:373
229019956256,295cyclictest0-21swapper/012:13:550
229019956149,338cyclictest20293-21rm10:14:300
22908995577,3cyclictest0-21swapper/610:10:376
22906995563,550cyclictest64450irq/122-eth009:15:174
229039955544,296cyclictest0-21swapper/112:36:021
22903995532,127cyclictest0-21swapper/111:28:151
2290699549123,295cyclictest0-21swapper/411:28:154
229059954981,126cyclictest0-21swapper/310:15:103
2290599549207,211cyclictest121rcu_preempt12:40:063
229089954882,47cyclictest2984-21ssh09:11:316
22904995471,331cyclictest0-21swapper/209:12:462
2290899546502,41cyclictest631rcuc/610:04:156
229059954576,211cyclictest0-21swapper/309:52:443
229059954534,295cyclictest0-21swapper/312:04:023
2290599545119,126cyclictest0-21swapper/309:12:153
229089954478,86cyclictest121rcu_preempt11:53:436
2290999543288,253cyclictest721ktimersoftd/711:29:507
229049954130,338cyclictest0-21swapper/212:05:192
229069954029,508cyclictest0-21swapper/409:40:434
229069954029,508cyclictest0-21swapper/409:40:424
229049954075,84cyclictest13070-21ssh10:09:562
2290599539321,126cyclictest0-21swapper/311:51:413
2290499539112,296cyclictest0-21swapper/207:43:452
229099953872,127cyclictest0-21swapper/711:15:227
2290199538196,253cyclictest0-21swapper/009:14:430
229049953730,338cyclictest0-21swapper/212:29:072
229089953526,126cyclictest0-21swapper/610:40:066
229049953523,296cyclictest0-21swapper/212:15:532
229039953566,84cyclictest0-21swapper/112:05:231
229079953426,126cyclictest0-21swapper/511:39:095
229039953125,126cyclictest0-21swapper/111:03:181
229039953024,126cyclictest0-21swapper/109:10:281
229099952922,7cyclictest0-21swapper/710:06:517
229039952923,84cyclictest0-21swapper/110:08:241
229069952825,2cyclictest0-21swapper/407:50:274
2290199528107,134cyclictest0-21swapper/010:53:120
229049952759,296cyclictest0-21swapper/211:02:262
2290999525230,169cyclictest31117-21diskmemload12:12:257
229069952515,126cyclictest0-21swapper/410:54:134
2290199522436,84cyclictest111rcuc/009:52:250
229089952014,295cyclictest0-21swapper/611:18:106
2290999519134,212cyclictest121rcu_preempt12:15:217
229079951853,126cyclictest24261-21ssh12:40:145
22904995177,127cyclictest0-21swapper/210:14:302
2290499516476,37cyclictest321ktimersoftd/211:52:382
22903995162,126cyclictest32140-21kworker/u16:112:40:091
22905995156,84cyclictest0-21swapper/312:17:473
22903995155,126cyclictest0-21swapper/112:15:351
229019951446,211cyclictest0-21swapper/011:53:190
22906995121,508cyclictest64450irq/122-eth010:45:144
22903995125,84cyclictest0-21swapper/110:17:321
22909995103,256cyclictest0-21swapper/710:10:377
22904995100,82cyclictest0-21swapper/212:04:092
22909995090,84cyclictest0-21swapper/710:53:097
229089950944,85cyclictest0-21swapper/612:05:266
22903995091,126cyclictest0-21swapper/107:41:001
22908995080,82cyclictest0-21swapper/612:04:096
22907995082,2cyclictest0-21swapper/510:10:375
229099950783,126cyclictest0-21swapper/709:41:137
229099950783,126cyclictest0-21swapper/709:41:137
229089950682,126cyclictest0-21swapper/612:28:136
229069950540,165cyclictest0-21swapper/410:55:144
229049950439,298cyclictest0-21swapper/209:42:302
229049950439,298cyclictest0-21swapper/209:42:302
229019950435,84cyclictest0-21swapper/010:38:030
2290199504121,380cyclictest32065-21runrttasks09:44:300
2290199504121,380cyclictest32065-21runrttasks09:44:300
229069950334,466cyclictest0-21swapper/412:40:204
229039950334,296cyclictest0-21swapper/109:45:261
229019950275,211cyclictest0-21swapper/012:37:480
229049950135,382cyclictest0-21swapper/212:35:442
229079950034,84cyclictest0-21swapper/512:36:435
229059950076,211cyclictest0-21swapper/310:55:073
229049950073,127cyclictest2928-21df_abs11:15:142
229039950034,257cyclictest0-21swapper/109:51:551
229089949977,126cyclictest15352-21ssh11:40:056
229069949834,42cyclictest0-21swapper/409:45:154
229039949830,258cyclictest0-21swapper/110:39:561
2290999496197,84cyclictest0-21swapper/711:39:547
229059949627,338cyclictest0-21swapper/311:15:233
229089949573,84cyclictest0-21swapper/610:19:516
229079949532,209cyclictest0-21swapper/510:02:485
2290599495280,212cyclictest401ktimersoftd/310:38:593
229079949429,84cyclictest0-21swapper/511:17:115
2290999493113,176cyclictest0-21swapper/710:15:167
229049949327,85cyclictest0-21swapper/212:12:482
229079949270,256cyclictest22899-21cyclictest07:50:185
229079949225,251cyclictest121rcu_preempt12:14:395
229049949227,212cyclictest3664-21ssh10:02:472
229039949226,84cyclictest0-21swapper/112:04:371
2290199491323,7cyclictest0-21swapper/010:17:080
2290899489191,125cyclictest26626-21seq11:28:206
229049948923,84cyclictest0-21swapper/210:55:072
229099948822,84cyclictest0-21swapper/711:48:437
229019948819,85cyclictest0-21swapper/012:04:400
229069948618,127cyclictest29806-21taskset10:20:194
2290899485144,126cyclictest22899-21cyclictest09:40:236
2290899485144,126cyclictest22899-21cyclictest09:40:236
229039948515,211cyclictest0-21swapper/112:12:321
229069948315,168cyclictest0-21swapper/411:04:074
229059948313,381cyclictest0-21swapper/312:27:213
229039948318,84cyclictest0-21swapper/112:27:381
229089948259,127cyclictest31117-21diskmemload10:38:276
229089948255,253cyclictest0-21swapper/612:17:116
229069948113,465cyclictest0-21swapper/411:49:344
229059947914,126cyclictest0-21swapper/307:45:063
229099947813,83cyclictest121rcu_preempt09:14:437
2290999477433,42cyclictest711rcuc/712:04:117
229069947712,385cyclictest0-21swapper/411:30:254
22906994757,465cyclictest0-21swapper/407:41:074
22903994759,126cyclictest0-21swapper/111:53:031
229059947191,126cyclictest0-21swapper/309:42:393
229059947191,126cyclictest0-21swapper/309:42:393
2290199471172,126cyclictest9-21ksoftirqd/010:44:020
22908994692,210cyclictest0-21swapper/610:54:146
229049946990,133cyclictest0-21swapper/209:52:132
2290399467421,3cyclictest231rcuc/111:55:131
229019946742,84cyclictest9-21ksoftirqd/012:15:460
229059946639,296cyclictest0-21swapper/311:39:093
2290499466123,126cyclictest0-21swapper/207:15:162
22907994651,84cyclictest0-21swapper/510:17:085
22904994651,253cyclictest0-21swapper/211:40:022
229079946441,3cyclictest0-21swapper/510:44:505
229039946480,295cyclictest0-21swapper/110:53:201
229019946442,211cyclictest0-21swapper/010:04:260
2290599463125,172cyclictest0-21swapper/311:03:453
229049946379,338cyclictest6861-21ssh09:15:092
2290499463121,127cyclictest33-21ksoftirqd/209:09:262
229089946281,84cyclictest0-21swapper/609:15:166
229079946274,127cyclictest0-21swapper/512:17:135
2290699462121,210cyclictest0-21swapper/411:09:454
229019946240,211cyclictest0-21swapper/011:29:240
229079946180,84cyclictest0-21swapper/510:38:105
2290799461162,296cyclictest22899-21cyclictest09:45:275
229079946079,84cyclictest0-21swapper/511:02:375
229089945977,84cyclictest0-21swapper/611:02:386
2290499459118,126cyclictest33-21ksoftirqd/210:16:182
229049945832,253cyclictest0-21swapper/210:54:592
2290399458117,126cyclictest25-21ksoftirqd/110:02:091
229059945734,168cyclictest0-21swapper/307:50:183
2290899456161,122cyclictest121rcu_preempt07:15:156
229059945671,212cyclictest41-21ksoftirqd/312:13:053
2290599456116,210cyclictest0-21swapper/310:02:583
2290599456115,338cyclictest0-21swapper/311:55:203
229049945634,2cyclictest0-21swapper/209:45:062
229019945634,256cyclictest0-21swapper/009:45:060
229019945629,127cyclictest0-21swapper/012:27:190
229099945576,376cyclictest0-21swapper/711:09:577
229089945533,255cyclictest0-21swapper/609:45:066
229099945432,42cyclictest121rcu_preempt09:51:237
229089945474,84cyclictest17396-21taskset07:50:296
229019945432,84cyclictest0-21swapper/011:48:360
229019945426,8cyclictest0-21swapper/011:05:220
229099945371,212cyclictest121rcu_preempt11:02:387
229099945332,118cyclictest0-21swapper/712:38:047
2290399453111,339cyclictest0-21swapper/109:08:141
2290799452111,126cyclictest0-21swapper/509:06:455
229099945028,126cyclictest0-21swapper/712:05:377
229019945069,84cyclictest0-21swapper/011:02:380
229079944865,169cyclictest0-21swapper/510:20:225
229079944763,211cyclictest13899-21sh09:50:485
229049944725,2cyclictest0-21swapper/210:20:162
229089944661,211cyclictest641ktimersoftd/612:12:306
229059944620,211cyclictest31117-21diskmemload12:40:193
229019944623,126cyclictest0-21swapper/012:40:170
229079944564,84cyclictest0-21swapper/511:53:305
229059944523,2cyclictest0-21swapper/311:09:563
229059944523,2cyclictest0-21swapper/307:43:023
229099944422,84cyclictest0-21swapper/710:04:557
229089944321,253cyclictest65-21ksoftirqd/612:37:096
2290899441146,211cyclictest0-21swapper/607:40:416
229099944012,127cyclictest0-21swapper/711:52:397
229059944018,3cyclictest0-21swapper/311:10:173
2290599439142,126cyclictest121rcu_preempt11:48:433
229069943813,422cyclictest0-21swapper/411:40:134
229039943812,211cyclictest13496-21ssh11:38:301
229079943614,210cyclictest0-21swapper/507:41:165
229099943513,255cyclictest0-21swapper/707:50:177
22901994358,84cyclictest0-21swapper/009:15:160
2290999433350,3cyclictest721ktimersoftd/712:28:207
229049943394,84cyclictest9387-21diskmemload10:45:022
22904994314,169cyclictest0-21swapper/211:48:312
229039942947,125cyclictest22899-21cyclictest07:50:281
2290199429173,168cyclictest0-21swapper/009:06:020
229079942889,84cyclictest16419-21kworker/u16:011:09:505
2290199428255,84cyclictest0-21swapper/011:10:040
22908994274,169cyclictest0-21swapper/612:40:136
22904994251,127cyclictest31117-21diskmemload11:05:262
229059942482,211cyclictest41-21ksoftirqd/309:05:393
229089942386,171cyclictest0-21swapper/609:09:216
229019942382,338cyclictest0-21swapper/007:15:150
229079942282,84cyclictest0-21swapper/512:29:075
229039942280,339cyclictest0-21swapper/111:09:491
229019942281,169cyclictest9-21ksoftirqd/007:50:260
229099942179,84cyclictest121rcu_preempt11:40:157
229059942181,338cyclictest0-21swapper/311:29:463
229059942180,338cyclictest0-21swapper/311:40:043
2290499421122,126cyclictest0-21swapper/212:40:092
229019942141,135cyclictest0-21swapper/010:20:070
229069942079,338cyclictest0-21swapper/407:15:144
229099941978,338cyclictest0-21swapper/712:40:147
229079941981,84cyclictest0-21swapper/510:54:205
2290599419247,84cyclictest0-21swapper/309:15:103
229089941879,84cyclictest0-21swapper/611:48:436
229049941838,296cyclictest0-21swapper/211:10:162
229019941879,84cyclictest0-21swapper/011:40:030
229099941776,338cyclictest0-21swapper/711:10:087
229089941775,127cyclictest15524-21rm09:52:136
229039941776,126cyclictest25-21ksoftirqd/110:45:021
229059941675,338cyclictest0-21swapper/307:15:153
229089941576,84cyclictest28639-21runrttasks10:55:066
229089941534,253cyclictest22899-21cyclictest11:05:336
229079941576,84cyclictest0-21swapper/511:28:205
229089941434,50cyclictest121rcu_preempt11:55:206
229079941475,84cyclictest0-21swapper/512:03:505
229079941474,84cyclictest0-21swapper/510:55:095
229069941476,84cyclictest0-21swapper/407:45:154
229099941374,295cyclictest2987-1kworker/7:1H09:15:167
229069941372,338cyclictest0-21swapper/411:20:034
229059941372,338cyclictest0-21swapper/309:45:193
229019941374,84cyclictest0-21swapper/010:55:070
2290999412156,253cyclictest0-21swapper/710:38:587
229079941273,84cyclictest15347-21ssh11:40:045
229019941235,209cyclictest9-21ksoftirqd/007:40:470
229039941169,339cyclictest0-21swapper/107:15:151
229079941071,84cyclictest0-21swapper/512:05:245
229079941070,84cyclictest0-21swapper/511:48:435
229099940927,84cyclictest0-21swapper/709:06:447
229039940969,338cyclictest0-21swapper/110:55:091
229039940867,338cyclictest0-21swapper/111:40:041
2290399408109,126cyclictest25-21ksoftirqd/111:10:171
229059940767,338cyclictest0-21swapper/312:05:373
229079940627,214cyclictest0-21swapper/511:55:195
229059940665,338cyclictest0-21swapper/310:45:023
229039940625,84cyclictest0-21swapper/111:48:491
229079940567,175cyclictest0-21swapper/510:45:085
229079940323,84cyclictest0-21swapper/509:15:165
229049940263,84cyclictest0-21swapper/211:55:192
229019940263,84cyclictest0-21swapper/010:45:020
229049939960,84cyclictest0-21swapper/207:45:162
2290999398102,211cyclictest0-21swapper/707:40:427
229089939814,212cyclictest29741-21hddtemp_smartct10:20:166
229099939758,84cyclictest0-21swapper/707:45:167
229059939713,296cyclictest0-21swapper/310:20:223
229089939657,84cyclictest0-21swapper/607:45:166
229079939617,259cyclictest0-21swapper/512:20:095
229089939557,84cyclictest0-21swapper/611:10:226
22907993938,254cyclictest27549-21fschecks_count07:15:155
229099939111,84cyclictest0-21swapper/709:45:177
2290399390137,43cyclictest28808-21tr10:20:121
229099938850,84cyclictest724-21nscd11:55:177
229099938587,126cyclictest0-21swapper/710:20:197
229099938041,126cyclictest73-21ksoftirqd/707:15:157
22907993801,42cyclictest0-21swapper/511:10:175
229089937778,169cyclictest10211-21ssh10:45:136
229039937678,294cyclictest0-21swapper/109:15:171
229049937228,296cyclictest0-21swapper/211:20:222
229039936524,126cyclictest0-21swapper/107:45:161
2290899362106,126cyclictest0-21swapper/611:20:226
229039935720,85cyclictest31117-21diskmemload12:20:141
229049935519,124cyclictest0-21swapper/212:20:142
229019935518,211cyclictest2813-21nscd11:30:250
229099935420,173cyclictest0-21swapper/712:20:147
229069935316,253cyclictest0-21swapper/412:20:104
229099935111,84cyclictest0-21swapper/710:55:087
22909993441,84cyclictest0-21swapper/710:45:087
229089934045,84cyclictest121rcu_preempt12:20:096
229059933845,82cyclictest41-21ksoftirqd/312:20:143
229039933131,254cyclictest0-21swapper/111:20:221
2290999330113,214cyclictest0-21swapper/711:30:267
2290199329245,3cyclictest101ktimersoftd/011:20:220
229039932828,213cyclictest31740-21ssh11:30:261
229019932426,125cyclictest0-21swapper/007:45:160
229019932225,49cyclictest0-21swapper/012:20:100
229059932068,47cyclictest11849-21/usr/sbin/munin11:20:223
229079931258,84cyclictest0-21swapper/507:45:165
229079930345,168cyclictest0-21swapper/511:20:225
22909992961,42cyclictest0-21swapper/711:20:227
229049929583,84cyclictest0-21swapper/211:30:272
229079928875,85cyclictest0-21swapper/511:30:275
229089926853,126cyclictest0-21swapper/611:30:266
229059926658,120cyclictest41-21ksoftirqd/311:30:263
2745921340,1sleep50-21swapper/509:25:115
2205028945,40sleep50-21swapper/507:06:585
2209528351,29sleep30-21swapper/307:07:363
2197228352,28sleep10-21swapper/107:05:491
2195828351,28sleep70-21swapper/707:05:407
2224928249,29sleep60-21swapper/607:09:476
2226528149,28sleep20-21swapper/207:09:592
2222728047,29sleep40-21swapper/407:09:294
2203627746,27sleep00-21swapper/007:06:450
171202730,0sleep30-21swapper/309:35:203
22904993410,23cyclictest0-21swapper/209:34:552
22904993410,23cyclictest0-21swapper/208:27:092
22904993327,5cyclictest0-21swapper/208:51:212
22904993326,6cyclictest0-21swapper/209:21:492
22904993310,17cyclictest0-21swapper/210:26:312
22904993310,17cyclictest0-21swapper/208:56:272
22904993310,0cyclictest0-21swapper/210:32:462
22904993210,21cyclictest0-21swapper/208:24:322
22904993126,5cyclictest0-21swapper/207:29:042
22904993026,4cyclictest0-21swapper/208:47:582
22904993026,4cyclictest0-21swapper/208:37:382
22904992925,4cyclictest0-21swapper/208:33:072
22909992828,0cyclictest0-21swapper/709:34:237
22909992828,0cyclictest0-21swapper/708:27:357
22909992810,18cyclictest0-21swapper/709:57:247
22909992810,18cyclictest0-21swapper/709:35:047
22909992810,18cyclictest0-21swapper/709:28:077
22909992810,18cyclictest0-21swapper/709:22:307
22909992810,18cyclictest0-21swapper/708:48:237
22909992810,18cyclictest0-21swapper/708:37:047
22909992810,18cyclictest0-21swapper/708:24:327
22909992810,18cyclictest0-21swapper/708:19:407
22909992810,18cyclictest0-21swapper/707:14:307
22909992810,0cyclictest0-21swapper/710:25:507
22909992810,0cyclictest0-21swapper/707:33:107
22909992810,0cyclictest0-21swapper/707:28:267
22908992810,18cyclictest0-21swapper/609:28:596
22908992810,18cyclictest0-21swapper/607:14:316
22908992810,0cyclictest0-21swapper/610:33:016
22908992810,0cyclictest0-21swapper/609:34:046
22907992810,1cyclictest0-21swapper/510:25:535
22906992810,18cyclictest0-21swapper/409:28:314
22905992828,0cyclictest0-21swapper/308:42:333
22905992810,18cyclictest0-21swapper/310:25:523
22905992810,18cyclictest0-21swapper/309:57:453
22905992810,18cyclictest0-21swapper/309:28:053
22905992810,18cyclictest0-21swapper/308:47:563
22905992810,17cyclictest31117-21diskmemload09:34:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional