You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 19:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Sep 08, 2026 12:57:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52629990714,890cyclictest0-21swapper/309:25:233
526099862818,42cyclictest241ktimersoftd/112:07:361
52629980582,84cyclictest0-21swapper/312:04:503
52629976079,677cyclictest13037-21diskstats10:20:153
52629976079,677cyclictest13037-21diskstats10:20:153
52629974220,719cyclictest0-21swapper/310:41:443
52659972038,338cyclictest0-21swapper/610:21:086
52659972038,338cyclictest0-21swapper/610:21:086
52629970727,677cyclictest0-21swapper/309:37:193
525999700618,80cyclictest111rcuc/012:08:000
52629966531,466cyclictest0-21swapper/311:19:073
52609965521,2cyclictest0-21swapper/110:53:001
5259996350,84cyclictest0-21swapper/011:10:090
52629963178,550cyclictest0-21swapper/311:10:093
526599628544,4cyclictest641ktimersoftd/610:03:326
52639962778,380cyclictest0-21swapper/409:49:454
525999626582,41cyclictest101ktimersoftd/012:25:170
526099625157,465cyclictest0-21swapper/110:21:281
526099625157,465cyclictest0-21swapper/110:21:281
52619962433,338cyclictest0-21swapper/209:49:052
52619962426,465cyclictest0-21swapper/212:17:592
52619962426,465cyclictest0-21swapper/212:17:592
526499622112,507cyclictest0-21swapper/512:24:065
52629962126,592cyclictest0-21swapper/309:50:113
525999621576,42cyclictest111rcuc/011:39:390
526699620109,508cyclictest0-21swapper/712:24:057
52629961726,507cyclictest0-21swapper/311:07:293
526299617105,381cyclictest0-21swapper/311:04:213
52629961317,592cyclictest0-21swapper/312:22:373
52599961262,126cyclictest0-21swapper/008:49:520
52609961018,84cyclictest0-21swapper/112:20:401
526299609141,465cyclictest30779-1kworker/u17:110:53:303
526399605141,253cyclictest121rcu_preempt12:20:474
52659959887,296cyclictest0-21swapper/608:49:486
5262995970,84cyclictest0-21swapper/310:03:043
5262995961,592cyclictest0-21swapper/309:49:243
5266995940,84cyclictest0-21swapper/711:19:087
52659959482,211cyclictest65-21ksoftirqd/612:34:096
5265995940,84cyclictest0-21swapper/612:23:566
5261995940,84cyclictest5257-21cyclictest10:03:052
5264995930,85cyclictest0-21swapper/510:29:255
5263995930,84cyclictest0-21swapper/410:29:254
526199593252,338cyclictest17053-1kworker/u17:210:30:192
526199593252,338cyclictest17053-1kworker/u17:210:30:192
52619959280,380cyclictest0-21swapper/210:20:272
52619959280,380cyclictest0-21swapper/210:20:272
52669958982,169cyclictest0-21swapper/710:55:057
526499589121,465cyclictest0-21swapper/510:21:285
526499589121,465cyclictest0-21swapper/510:21:285
526099587204,126cyclictest0-21swapper/109:39:311
52629958675,508cyclictest0-21swapper/311:58:323
52669958473,508cyclictest0-21swapper/710:24:267
52669958473,508cyclictest0-21swapper/710:24:267
52599958474,507cyclictest0-21swapper/010:24:260
52599958474,507cyclictest0-21swapper/010:24:260
526499583115,254cyclictest20726-21sh11:39:175
52629958334,465cyclictest0-21swapper/312:33:383
52619958334,253cyclictest0-21swapper/208:30:152
52629958130,123cyclictest0-21swapper/312:19:133
52629958130,123cyclictest0-21swapper/312:19:133
526099581113,465cyclictest0-21swapper/110:15:541
52629958027,550cyclictest0-21swapper/312:09:283
52659957972,423cyclictest0-21swapper/612:02:076
52639957870,293cyclictest0-21swapper/412:33:174
52629957766,508cyclictest0-21swapper/311:29:283
526399576235,338cyclictest64450irq/122-eth010:20:164
526399576235,338cyclictest64450irq/122-eth010:20:164
526399576106,211cyclictest0-21swapper/410:01:194
52639957426,296cyclictest0-21swapper/410:42:124
52649957224,83cyclictest121rcu_preempt10:04:185
52619956961,126cyclictest0-21swapper/210:27:592
526599568145,127cyclictest0-21swapper/610:17:016
52619956861,211cyclictest0-21swapper/209:28:152
52619956716,84cyclictest0-21swapper/211:04:202
52629956556,126cyclictest0-21swapper/310:27:583
52599956514,211cyclictest0-21swapper/010:01:410
526399564227,253cyclictest64450irq/122-eth009:36:044
52619956355,126cyclictest0-21swapper/212:24:052
52619956111,384cyclictest0-21swapper/210:52:592
52619955847,423cyclictest0-21swapper/211:59:002
52649955687,338cyclictest1282-21runrttasks08:47:035
5262995541,550cyclictest0-21swapper/310:38:163
52649955342,296cyclictest0-21swapper/512:18:305
52649955342,296cyclictest0-21swapper/512:18:305
526099553431,4cyclictest231rcuc/112:33:461
5266995520,41cyclictest0-21swapper/710:26:287
5260995510,84cyclictest17048-21ssh10:41:451
526699549122,423cyclictest0-21swapper/710:15:537
5264995490,85cyclictest0-21swapper/509:28:445
52629954880,465cyclictest0-21swapper/311:39:003
52619954882,84cyclictest121rcu_preempt12:33:162
526699547463,3cyclictest711rcuc/708:49:407
52619954677,211cyclictest0-21swapper/209:39:042
526099546463,4cyclictest241ktimersoftd/110:29:341
526499545119,422cyclictest0-21swapper/507:57:005
52609954538,127cyclictest0-21swapper/111:05:451
52649954475,296cyclictest0-21swapper/511:17:235
526699542114,212cyclictest20898-21ssh11:39:337
52599954274,126cyclictest0-21swapper/011:17:440
52649954134,127cyclictest13466-21diskmemload10:19:285
52619954173,465cyclictest0-21swapper/210:05:332
52629954033,426cyclictest0-21swapper/308:05:263
526499539113,211cyclictest57-21ksoftirqd/510:52:525
52639953929,84cyclictest6161-21ssh12:08:144
526399539199,338cyclictest64450irq/122-eth010:16:494
52609953729,126cyclictest0-21swapper/109:08:261
52599953730,211cyclictest187-21md0_raid109:39:280
52649953668,210cyclictest0-21swapper/512:34:165
52609953529,295cyclictest0-21swapper/109:26:461
52609953427,253cyclictest0-21swapper/111:57:121
52659953321,211cyclictest0-21swapper/611:17:516
52609953368,84cyclictest0-21swapper/112:04:081
526099531104,253cyclictest0-21swapper/110:04:121
52599953123,126cyclictest0-21swapper/010:26:500
52629953026,165cyclictest0-21swapper/310:18:173
525999530277,84cyclictest7870-21rm11:49:500
52639952922,83cyclictest121rcu_preempt11:18:304
52629952961,465cyclictest0-21swapper/310:30:193
52629952961,465cyclictest0-21swapper/310:30:193
52659952819,84cyclictest0-21swapper/612:25:306
526099528102,211cyclictest22447-21sh11:40:151
52599952860,253cyclictest0-21swapper/011:08:490
525999528102,211cyclictest2592-21rm12:43:500
52619952759,465cyclictest0-21swapper/211:05:592
52639952513,295cyclictest0-21swapper/409:27:594
52609952518,127cyclictest0-21swapper/109:46:031
526699524353,90cyclictest0-21swapper/711:03:187
526599523404,36cyclictest641ktimersoftd/609:48:536
52629952311,508cyclictest0-21swapper/312:43:183
52619952212,295cyclictest0-21swapper/212:04:262
526599521183,84cyclictest32720-1kworker/u17:212:43:366
526099521141,211cyclictest13466-21diskmemload11:38:511
52599952052,380cyclictest0-21swapper/008:08:540
5259995187,380cyclictest0-21swapper/010:41:430
5262995178,127cyclictest0-21swapper/311:49:353
5261995175,84cyclictest0-21swapper/209:10:142
52669951694,338cyclictest0-21swapper/711:28:227
52599951652,126cyclictest0-21swapper/012:04:500
5263995158,84cyclictest0-21swapper/408:09:414
5260995151,126cyclictest121rcu_preempt08:05:191
5259995159,126cyclictest0-21swapper/010:39:150
5262995144,507cyclictest0-21swapper/310:13:533
5265995131,89cyclictest0-21swapper/610:42:126
52619951145,211cyclictest0-21swapper/210:15:272
52659951039,127cyclictest0-21swapper/611:57:206
5265995102,84cyclictest0-21swapper/609:27:196
5264995100,84cyclictest0-21swapper/509:48:575
526399510391,37cyclictest481ktimersoftd/412:01:134
525999510127,126cyclictest9-21ksoftirqd/011:50:180
52669950982,211cyclictest73-21ksoftirqd/712:09:197
5264995071,42cyclictest0-21swapper/512:43:165
525999506164,169cyclictest121rcu_preempt09:27:210
526199505421,3cyclictest311rcuc/212:09:552
52619950540,296cyclictest0-21swapper/211:28:092
526099505121,126cyclictest0-21swapper/112:43:471
52599950438,84cyclictest121rcu_preempt12:22:270
526699502118,211cyclictest27945-21ssh11:05:437
52599950173,380cyclictest0-21swapper/012:33:240
52599950137,41cyclictest0-21swapper/009:45:350
525999500120,84cyclictest121rcu_preempt10:18:370
52669949977,211cyclictest0-21swapper/709:27:037
52659949976,211cyclictest0-21swapper/612:09:156
52599949975,211cyclictest0-21swapper/009:07:170
52639949832,43cyclictest121rcu_preempt10:30:144
52639949832,43cyclictest121rcu_preempt10:30:144
526399498160,126cyclictest20310-21taskset11:38:414
52619949735,166cyclictest0-21swapper/209:30:122
52609949728,296cyclictest0-21swapper/111:04:111
52609949632,168cyclictest0-21swapper/112:25:311
525999496197,211cyclictest14110-21ssh09:10:150
52669949570,338cyclictest0-21swapper/711:57:127
52649949575,289cyclictest0-21swapper/512:08:425
52649949472,84cyclictest0-21swapper/511:29:425
52649949471,83cyclictest0-21swapper/510:44:445
52629949425,466cyclictest0-21swapper/307:57:513
52599949471,168cyclictest0-21swapper/012:17:510
52599949471,168cyclictest0-21swapper/012:17:510
525999493110,380cyclictest0-21swapper/011:57:170
52669949266,423cyclictest0-21swapper/709:10:227
52659949266,210cyclictest0-21swapper/609:40:126
52629949223,466cyclictest0-21swapper/310:55:273
525999492193,125cyclictest3939-21ssh10:14:380
52659949069,337cyclictest0-21swapper/611:09:256
526599490235,253cyclictest641ktimersoftd/610:13:486
52639949023,464cyclictest0-21swapper/410:54:094
52639949021,211cyclictest23069-21ssh11:03:274
526499489233,253cyclictest561ktimersoftd/510:05:335
526399489232,254cyclictest19640-21gltestperf10:05:174
526399489148,211cyclictest121rcu_preempt08:47:164
52609948967,253cyclictest0-21swapper/110:14:211
526699488147,338cyclictest5257-21cyclictest12:34:257
52649948825,83cyclictest0-21swapper/511:07:155
52639948728,422cyclictest0-21swapper/411:07:374
52639948721,84cyclictest0-21swapper/411:59:354
52609948622,126cyclictest0-21swapper/108:49:441
526499485145,165cyclictest20604-1kworker/u17:011:03:365
52629948520,383cyclictest0-21swapper/308:26:453
52649948420,177cyclictest0-21swapper/511:57:595
52629948416,465cyclictest0-21swapper/310:05:093
52609948499,254cyclictest0-21swapper/109:40:261
52639948258,84cyclictest0-21swapper/410:55:294
52629948214,126cyclictest401ktimersoftd/312:25:183
52609948256,211cyclictest0-21swapper/111:19:181
52609948214,296cyclictest11207-21ssh10:38:431
526699481307,85cyclictest0-21swapper/710:40:307
526299481143,218cyclictest14028-21ssh09:10:123
52609948116,127cyclictest0-21swapper/109:30:121
52659948059,168cyclictest65-21ksoftirqd/610:25:396
52669947957,338cyclictest0-21swapper/712:00:527
52599947852,211cyclictest0-21swapper/008:27:110
52649947713,84cyclictest0-21swapper/512:03:015
52639947714,3cyclictest0-21swapper/409:40:234
52659947611,84cyclictest0-21swapper/611:39:336
52639947650,211cyclictest0-21swapper/410:14:064
52609947593,126cyclictest23828-21ssh12:17:561
52609947593,126cyclictest23828-21ssh12:17:561
526599474133,338cyclictest5257-21cyclictest11:10:096
52639947448,423cyclictest0-21swapper/411:49:394
526399474218,253cyclictest64450irq/122-eth009:07:564
52639947417,331cyclictest0-21swapper/411:20:224
5262994734,253cyclictest0-21swapper/308:50:033
5263994728,256cyclictest0-21swapper/410:39:154
52659947189,126cyclictest65-21ksoftirqd/612:19:006
52659947189,126cyclictest65-21ksoftirqd/612:19:006
5262994701,466cyclictest0-21swapper/308:45:253
52619947048,249cyclictest0-21swapper/212:10:042
5265994693,211cyclictest0-21swapper/610:05:336
526499468127,126cyclictest121rcu_preempt08:10:195
526399467124,340cyclictest11202-21interrupts08:10:204
5262994672,126cyclictest0-21swapper/308:30:143
526199467169,296cyclictest5257-21cyclictest10:44:162
526499466124,339cyclictest0-21swapper/510:39:415
5260994660,84cyclictest0-21swapper/111:10:081
52599946682,211cyclictest0-21swapper/008:00:000
526499465124,338cyclictest0-21swapper/508:50:045
525999465122,84cyclictest121rcu_preempt10:05:120
526599464206,84cyclictest0-21swapper/609:09:086
526499464124,337cyclictest0-21swapper/509:10:205
526499464123,338cyclictest0-21swapper/509:37:495
526099464124,338cyclictest0-21swapper/110:55:281
52599946480,211cyclictest0-21swapper/010:54:260
525999464123,338cyclictest0-21swapper/009:50:190
52669946341,302cyclictest0-21swapper/709:40:237
526599463377,84cyclictest641ktimersoftd/609:39:296
52639946383,49cyclictest0-21swapper/412:18:024
52639946383,49cyclictest0-21swapper/412:18:024
52619946340,3cyclictest0-21swapper/211:38:042
526199463122,339cyclictest0-21swapper/210:13:492
526099463122,338cyclictest11162-21if_err_eth008:10:171
52669946238,210cyclictest0-21swapper/709:49:177
526699462378,3cyclictest711rcuc/712:19:007
526699462378,3cyclictest711rcuc/712:19:007
52659946277,169cyclictest0-21swapper/610:38:186
52649946277,211cyclictest561ktimersoftd/508:06:065
526699461119,126cyclictest73-21ksoftirqd/709:09:187
52609946139,2cyclictest0-21swapper/107:57:211
526099461119,339cyclictest0-21swapper/108:50:031
525999461418,37cyclictest111rcuc/009:40:180
525999461120,338cyclictest1551-21snmpd08:50:160
52669945932,211cyclictest0-21swapper/707:57:227
526499459119,337cyclictest0-21swapper/509:07:185
526399459118,338cyclictest0-21swapper/409:50:044
52629945832,423cyclictest0-21swapper/309:07:053
52619945836,213cyclictest5009-21perl08:00:142
52599945832,211cyclictest22075-21ssh11:02:320
526199457118,84cyclictest0-21swapper/211:40:062
525999457117,337cyclictest0-21swapper/011:40:050
526699456115,338cyclictest0-21swapper/711:40:057
52619945634,254cyclictest0-21swapper/211:18:222
52619945534,255cyclictest0-21swapper/208:10:172
52619945532,256cyclictest0-21swapper/208:25:282
526699454115,84cyclictest0-21swapper/710:39:007
52659945432,3cyclictest0-21swapper/610:55:256
52659945432,126cyclictest0-21swapper/611:04:536
52619945432,219cyclictest0-21swapper/208:49:152
52669945369,211cyclictest73-21ksoftirqd/710:04:287
52669945332,337cyclictest0-21swapper/710:05:117
526699453112,338cyclictest0-21swapper/709:37:217
526499453113,338cyclictest5257-21cyclictest08:28:165
526399453113,126cyclictest0-21swapper/412:25:354
52669945228,257cyclictest0-21swapper/708:05:287
52639945272,84cyclictest0-21swapper/407:55:464
52609945230,84cyclictest0-21swapper/109:50:211
52659945129,84cyclictest0-21swapper/610:54:146
52659945027,3cyclictest0-21swapper/609:50:216
526499450110,337cyclictest0-21swapper/509:50:025
52619945066,381cyclictest0-21swapper/207:20:092
526199450111,84cyclictest5257-21cyclictest09:08:382
52659944965,210cyclictest65-21ksoftirqd/608:00:156
526199449110,84cyclictest24104-21ssh09:50:202
52669944826,256cyclictest0-21swapper/710:55:147
52649944868,83cyclictest0-21swapper/510:30:065
52649944868,83cyclictest0-21swapper/510:30:065
52629944830,382cyclictest0-21swapper/311:40:153
526199448109,84cyclictest0-21swapper/207:55:402
525999448107,338cyclictest0-21swapper/008:10:190
52669944724,302cyclictest13466-21diskmemload09:50:197
52619944769,375cyclictest0-21swapper/208:05:182
52669944623,256cyclictest0-21swapper/709:30:137
526199446106,338cyclictest0-21swapper/212:25:292
526099446190,253cyclictest21931-1kworker/u17:010:05:331
52649944565,84cyclictest0-21swapper/511:10:035
52619944522,4cyclictest11185-21diskmemload10:38:382
526099445108,126cyclictest0-21swapper/108:29:351
52659944220,3cyclictest0-21swapper/608:05:286
52629944219,343cyclictest0-21swapper/309:40:223
52619944220,338cyclictest0-21swapper/211:10:042
52659944119,84cyclictest0-21swapper/609:30:086
52649944162,84cyclictest0-21swapper/511:40:035
52609944115,126cyclictest0-21swapper/111:49:101
52629943997,339cyclictest0-21swapper/312:35:163
52599943955,211cyclictest5020-21gltestperf08:00:170
52669943858,296cyclictest0-21swapper/712:25:217
52649943897,338cyclictest0-21swapper/512:25:315
52609943898,337cyclictest0-21swapper/111:50:181
52599943613,126cyclictest0-21swapper/008:35:040
52639943598,84cyclictest0-21swapper/411:40:124
52639943556,84cyclictest0-21swapper/408:30:154
52629943513,256cyclictest0-21swapper/308:10:183
52599943495,84cyclictest0-21swapper/010:55:100
52649943211,255cyclictest0-21swapper/509:40:245
52609943291,338cyclictest0-21swapper/112:35:141
52629943190,338cyclictest0-21swapper/309:30:123
52659942987,339cyclictest0-21swapper/607:20:086
52639942987,126cyclictest0-21swapper/412:43:184
52629942911,381cyclictest0-21swapper/311:30:033
52599942912,291cyclictest0-21swapper/011:20:210
5264994252,84cyclictest0-21swapper/510:55:195
52649942482,339cyclictest0-21swapper/508:00:165
52629942443,84cyclictest0-21swapper/308:00:153
52669942383,338cyclictest0-21swapper/708:28:407
52649942381,211cyclictest0-21swapper/512:35:095
526499423125,126cyclictest57-21ksoftirqd/511:49:395
5263994231,3cyclictest0-21swapper/408:25:294
52609942382,338cyclictest0-21swapper/112:10:031
52609942382,338cyclictest0-21swapper/111:28:571
5259994231,8cyclictest121rcu_preempt09:30:050
52619942281,338cyclictest0-21swapper/209:40:202
52599942237,169cyclictest0-21swapper/012:10:040
52669942180,338cyclictest0-21swapper/710:14:527
52669942179,339cyclictest0-21swapper/711:50:197
52619942180,338cyclictest0-21swapper/212:35:092
526099421122,127cyclictest0-21swapper/108:30:141
52669942080,338cyclictest0-21swapper/710:30:167
52669942080,338cyclictest0-21swapper/710:30:167
52659942079,338cyclictest0-21swapper/612:35:056
526599420121,168cyclictest0-21swapper/611:40:156
526499420122,295cyclictest5257-21cyclictest11:50:035
52639942082,84cyclictest0-21swapper/411:28:584
52629942080,338cyclictest0-21swapper/312:10:063
52619942079,338cyclictest0-21swapper/211:50:192
52609942033,168cyclictest5014-21/usr/sbin/munin08:00:161
52669941978,338cyclictest0-21swapper/712:35:157
52659941978,338cyclictest0-21swapper/607:55:446
52669941876,169cyclictest2593-21diskmemload12:43:517
52669941876,126cyclictest8521-21expr12:10:137
52649941839,84cyclictest0-21swapper/510:14:175
52639941880,84cyclictest0-21swapper/409:10:154
52669941776,338cyclictest0-21swapper/711:49:127
52659941776,338cyclictest0-21swapper/612:10:056
52649941778,84cyclictest0-21swapper/511:20:175
52619941778,84cyclictest0-21swapper/212:43:002
52649941676,84cyclictest0-21swapper/512:10:155
52639941677,84cyclictest0-21swapper/411:10:104
52659941575,338cyclictest0-21swapper/611:29:266
52659941574,338cyclictest0-21swapper/611:50:196
52619941575,338cyclictest0-21swapper/211:49:412
52619941574,338cyclictest0-21swapper/210:55:092
52609941575,338cyclictest0-21swapper/111:30:051
52609941473,126cyclictest17013-21/usr/sbin/munin11:20:221
52649941172,84cyclictest0-21swapper/509:30:045
526499410112,295cyclictest0-21swapper/508:30:145
52669940967,211cyclictest0-21swapper/711:10:077
52659940968,338cyclictest0-21swapper/608:10:196
52629940969,338cyclictest0-21swapper/311:50:203
52669940867,338cyclictest0-21swapper/711:20:227
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional