You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 14:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Jul 24, 2026 12:58:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82509978824,761cyclictest0-21swapper/212:23:272
82509978620,635cyclictest0-21swapper/211:16:472
82509978116,762cyclictest0-21swapper/211:30:522
8249997600,126cyclictest0-21swapper/109:24:021
82509974363,84cyclictest14105-21ssh10:04:352
825199712329,381cyclictest7131-1kworker/u17:211:19:023
82539970327,84cyclictest0-21swapper/512:26:465
82529970370,380cyclictest0-21swapper/410:49:064
82509969922,84cyclictest0-21swapper/211:01:152
82509969616,677cyclictest0-21swapper/211:49:212
82499969052,422cyclictest1553-21runrttasks09:41:081
82499969052,422cyclictest1553-21runrttasks09:41:081
825199677208,210cyclictest6243-1kworker/u17:109:21:573
82499965969,124cyclictest121rcu_preempt10:27:071
82549965761,380cyclictest0-21swapper/611:00:236
82509965214,635cyclictest0-21swapper/212:36:552
825499633122,296cyclictest16342-21taskset09:09:416
825299631122,126cyclictest704-21nscd10:30:174
825599628119,126cyclictest0-21swapper/711:35:447
825599628116,380cyclictest0-21swapper/708:05:167
82529962634,295cyclictest0-21swapper/411:07:354
824999626118,126cyclictest0-21swapper/112:36:431
82549962573,127cyclictest0-21swapper/610:27:516
825299624113,126cyclictest7315-21ssh09:22:174
82509962229,84cyclictest0-21swapper/212:30:372
82509962227,592cyclictest0-21swapper/211:40:282
82509962131,125cyclictest121rcu_preempt12:40:132
82509962131,125cyclictest121rcu_preempt12:40:132
82489962029,46cyclictest0-21swapper/012:26:330
82509961966,550cyclictest0-21swapper/211:26:072
82489961927,126cyclictest0-21swapper/009:09:270
82509961620,127cyclictest0-21swapper/209:07:502
82519961562,423cyclictest0-21swapper/309:57:383
825599614103,126cyclictest73-21ksoftirqd/711:00:287
82519961422,383cyclictest0-21swapper/311:02:053
82509961419,592cyclictest0-21swapper/212:10:152
825199613105,42cyclictest0-21swapper/310:38:363
82489961321,383cyclictest0-21swapper/011:02:060
82509961115,593cyclictest0-21swapper/210:53:052
82499961120,88cyclictest0-21swapper/109:10:301
82519961099,295cyclictest0-21swapper/310:14:073
824999607267,338cyclictest23547-21kworker/u16:010:10:371
8254996057,211cyclictest0-21swapper/608:05:356
825399604560,42cyclictest551rcuc/509:58:315
82499960110,382cyclictest0-21swapper/111:02:061
82489960194,296cyclictest0-21swapper/012:21:490
8248996009,126cyclictest0-21swapper/009:56:420
8252995976,2cyclictest0-21swapper/409:16:084
8250995971,508cyclictest0-21swapper/211:35:222
82519959644,169cyclictest41-21ksoftirqd/307:48:483
8251995953,2cyclictest0-21swapper/309:16:083
82499959482,296cyclictest0-21swapper/110:58:311
8255995930,84cyclictest0-21swapper/710:36:327
8254995930,84cyclictest0-21swapper/610:54:246
824999593124,380cyclictest0-21swapper/111:55:541
8249995930,126cyclictest0-21swapper/110:48:201
82529959282,507cyclictest0-21swapper/410:37:534
82509959239,465cyclictest121rcu_preempt10:49:372
825599591125,178cyclictest8246-21cyclictest10:28:017
82519959181,127cyclictest121rcu_preempt11:31:083
8250995911,2cyclictest0-21swapper/207:30:072
82519959081,126cyclictest121rcu_preempt09:05:213
82519959077,381cyclictest21516-21rm12:23:583
825199589204,254cyclictest0-21swapper/310:29:143
824999588120,338cyclictest0-21swapper/112:07:171
82559958678,126cyclictest0-21swapper/712:36:447
825499586116,126cyclictest0-21swapper/609:56:226
82509958632,84cyclictest0-21swapper/210:27:072
82489958677,507cyclictest0-21swapper/010:37:530
8253995856,3cyclictest0-21swapper/509:16:085
825199584158,296cyclictest0-21swapper/309:10:383
82509958432,296cyclictest30783-21sh10:13:522
82559958372,295cyclictest0-21swapper/709:24:507
82509958334,177cyclictest0-21swapper/209:22:212
82549958231,126cyclictest121rcu_preempt11:33:096
824899582161,254cyclictest8358-21ntpq08:00:390
82509958128,550cyclictest33-21ksoftirqd/209:25:142
82529958030,126cyclictest0-21swapper/410:58:174
82499958072,84cyclictest121rcu_preempt10:09:001
82489958030,126cyclictest0-21swapper/010:12:270
82509957934,383cyclictest0-21swapper/210:39:242
82499957623,126cyclictest0-21swapper/109:08:251
824999576110,126cyclictest10650-21fschecks_time08:05:161
82549957564,381cyclictest0-21swapper/611:26:386
82499957518,381cyclictest0-21swapper/111:16:591
82559957462,296cyclictest0-21swapper/710:58:477
82549957319,169cyclictest0-21swapper/611:38:086
82529957327,83cyclictest121rcu_preempt10:00:244
82489957320,338cyclictest0-21swapper/009:23:090
825599572489,3cyclictest711rcuc/711:30:157
82499957219,126cyclictest0-21swapper/110:53:231
82529957159,422cyclictest0-21swapper/411:29:284
82499957160,380cyclictest0-21swapper/108:00:391
82519956957,127cyclictest0-21swapper/309:43:053
82519956957,127cyclictest0-21swapper/309:43:053
825199569103,254cyclictest0-21swapper/311:35:213
82489956921,295cyclictest0-21swapper/011:26:140
82509956818,126cyclictest0-21swapper/209:59:202
82529956759,126cyclictest121rcu_preempt10:40:364
82519956758,126cyclictest121rcu_preempt10:51:353
825399566309,126cyclictest16382-21diskmemload11:27:315
82519956654,338cyclictest0-21swapper/312:04:593
82489956616,126cyclictest0-21swapper/007:38:350
824899566102,211cyclictest0-21swapper/009:10:540
82559956553,380cyclictest0-21swapper/710:41:407
82499956514,84cyclictest0-21swapper/112:23:591
82549956496,253cyclictest27478-21ssh12:26:356
82539956411,89cyclictest0-21swapper/510:37:465
82519956311,84cyclictest0-21swapper/310:49:053
82539956211,85cyclictest0-21swapper/509:24:455
82529956212,84cyclictest0-21swapper/408:11:084
8249995629,338cyclictest0-21swapper/111:50:161
82509955950,126cyclictest121rcu_preempt09:47:572
8253995578,84cyclictest0-21swapper/512:21:495
82509955746,423cyclictest23275-21ssh12:05:432
825399556301,83cyclictest0-21swapper/511:42:035
82519955687,338cyclictest0-21swapper/309:37:273
8248995553,126cyclictest0-21swapper/011:30:300
8249995545,383cyclictest0-21swapper/109:16:081
8248995544,84cyclictest0-21swapper/012:07:160
82549955383,254cyclictest0-21swapper/608:52:596
825499552427,47cyclictest631rcuc/609:22:496
8254995521,126cyclictest8353-21/usr/sbin/munin08:00:396
82539955240,295cyclictest0-21swapper/510:49:055
8251995521,84cyclictest0-21swapper/311:26:203
8249995511,126cyclictest0-21swapper/111:31:311
8249995510,84cyclictest0-21swapper/111:40:291
8248995512,383cyclictest0-21swapper/009:16:080
825499550124,211cyclictest7410-21taskset10:38:096
8248995501,338cyclictest0-21swapper/010:30:280
82559954983,126cyclictest0-21swapper/710:14:517
82529954981,126cyclictest0-21swapper/411:18:424
824999549123,253cyclictest23434-21taskset11:47:531
8248995491,126cyclictest0-21swapper/011:15:390
82509954878,295cyclictest0-21swapper/212:17:112
82529954739,83cyclictest0-21swapper/407:46:044
825199547248,126cyclictest0-21swapper/312:27:203
82529954635,84cyclictest0-21swapper/410:12:424
82509954632,465cyclictest121rcu_preempt09:40:272
82509954632,465cyclictest121rcu_preempt09:40:272
824899545290,42cyclictest23547-21kworker/u16:010:55:100
82519954374,296cyclictest0-21swapper/308:40:153
825199543121,296cyclictest0-21swapper/310:58:343
82489954336,261cyclictest0-21swapper/010:50:220
825499542286,253cyclictest31922-21rm12:10:506
82529954234,83cyclictest0-21swapper/410:27:584
825299542201,338cyclictest64450irq/122-eth012:05:404
82519954231,338cyclictest0-21swapper/312:07:243
82519954171,297cyclictest0-21swapper/311:40:283
82509954129,465cyclictest0-21swapper/210:59:192
825299540244,84cyclictest64450irq/122-eth009:29:004
82519954069,339cyclictest0-21swapper/311:55:523
82509954033,427cyclictest0-21swapper/208:51:452
82489954034,168cyclictest0-21swapper/011:40:080
82509953970,295cyclictest0-21swapper/212:27:122
82489953931,126cyclictest0-21swapper/009:37:130
825399538238,126cyclictest0-21swapper/508:00:495
82519953829,211cyclictest0-21swapper/311:46:443
82499953827,126cyclictest0-21swapper/110:38:441
825199537110,296cyclictest0-21swapper/307:30:283
82489953731,126cyclictest0-21swapper/011:48:110
82489953729,126cyclictest0-21swapper/010:29:210
82549953670,84cyclictest0-21swapper/611:15:276
82549953667,296cyclictest0-21swapper/609:42:196
82549953667,296cyclictest0-21swapper/609:42:186
825399536279,254cyclictest561ktimersoftd/507:30:065
825299536111,126cyclictest49-21ksoftirqd/407:30:354
82519953624,84cyclictest121rcu_preempt08:00:273
82489953628,126cyclictest0-21swapper/010:43:090
82549953565,296cyclictest0-21swapper/609:51:486
82539953523,126cyclictest6658-21ssh10:59:365
825299535110,254cyclictest303-21systemd-journal12:21:494
82509953524,508cyclictest16829-21kworker/u16:110:40:402
82499953528,126cyclictest0-21swapper/112:27:111
82549953465,211cyclictest0-21swapper/611:46:446
825199534319,126cyclictest0-21swapper/307:27:213
82509953424,507cyclictest30195-21sh12:45:552
82499953465,296cyclictest0-21swapper/112:31:421
82559953367,211cyclictest0-21swapper/710:30:177
82549953266,126cyclictest0-21swapper/608:40:226
825299532276,127cyclictest0-21swapper/411:35:284
82519953262,339cyclictest0-21swapper/309:25:143
82509953224,423cyclictest0-21swapper/212:02:302
825099532105,84cyclictest33-21ksoftirqd/208:05:362
82499953123,126cyclictest0-21swapper/111:35:401
82489953123,84cyclictest0-21swapper/011:55:530
82539953064,126cyclictest0-21swapper/511:02:315
82529953024,126cyclictest121rcu_preempt09:40:514
82529953024,126cyclictest121rcu_preempt09:40:514
82519953023,126cyclictest0-21swapper/308:51:593
82509952959,296cyclictest121rcu_preempt11:56:542
82499952960,211cyclictest25-21ksoftirqd/107:30:251
82529952721,337cyclictest0-21swapper/411:00:134
82499952721,126cyclictest0-21swapper/110:42:371
82549952658,295cyclictest0-21swapper/610:58:016
82509952615,127cyclictest0-21swapper/208:00:142
82559952412,381cyclictest0-21swapper/708:00:307
825399524310,84cyclictest0-21swapper/510:27:575
82509952459,338cyclictest0-21swapper/207:46:332
82489952456,295cyclictest0-21swapper/011:39:230
825399523268,84cyclictest561ktimersoftd/509:05:155
82519952315,300cyclictest0-21swapper/308:10:183
82489952354,296cyclictest23509-21head07:30:350
82549952253,257cyclictest0-21swapper/610:12:276
82509952213,127cyclictest0-21swapper/207:27:222
82499952213,85cyclictest0-21swapper/107:46:331
82519952155,84cyclictest121rcu_preempt10:40:413
82489952195,253cyclictest0-21swapper/011:13:500
82539952013,84cyclictest0-21swapper/510:22:315
82539951911,126cyclictest26927-21ssh10:10:375
82529951915,82cyclictest121rcu_preempt12:36:244
82529951811,42cyclictest0-21swapper/412:17:084
82509951710,341cyclictest0-21swapper/209:16:092
8251995169,84cyclictest0-21swapper/310:30:173
8248995168,127cyclictest19153-21ssh12:04:110
824999513258,253cyclictest241ktimersoftd/110:00:351
82559951243,380cyclictest0-21swapper/712:23:167
8248995115,84cyclictest121rcu_preempt09:28:400
8251995101,126cyclictest0-21swapper/312:46:043
8255995091,84cyclictest0-21swapper/712:04:107
8252995091,211cyclictest0-21swapper/409:47:564
82559950884,126cyclictest0-21swapper/707:30:247
8255995081,84cyclictest0-21swapper/711:26:057
82509950840,465cyclictest0-21swapper/210:30:202
82559950640,85cyclictest0-21swapper/707:46:387
825299506121,126cyclictest49-21ksoftirqd/412:26:484
824999506122,254cyclictest0-21swapper/111:07:341
82489950680,296cyclictest0-21swapper/011:23:230
82489950680,296cyclictest0-21swapper/011:23:230
82559950583,84cyclictest0-21swapper/709:45:147
825599504122,127cyclictest0-21swapper/712:08:047
82549950477,84cyclictest121rcu_preempt07:30:206
82539950335,295cyclictest0-21swapper/511:47:435
82499950338,176cyclictest0-21swapper/112:05:001
824999503248,253cyclictest241ktimersoftd/109:57:201
82549950239,294cyclictest0-21swapper/610:17:346
82529950234,295cyclictest0-21swapper/408:51:154
82559950073,253cyclictest0-21swapper/712:31:037
82539950073,211cyclictest0-21swapper/508:29:035
82529949935,3cyclictest0-21swapper/409:36:394
82509949930,466cyclictest0-21swapper/208:40:052
82539949832,126cyclictest582-21sh11:33:565
82529949832,84cyclictest121rcu_preempt11:41:514
82529949832,43cyclictest0-21swapper/409:57:204
82509949831,84cyclictest121rcu_preempt11:50:142
82509949830,465cyclictest8495-21sed08:55:162
82489949833,210cyclictest8246-21cyclictest12:36:470
82559949728,296cyclictest0-21swapper/710:53:537
82529949775,256cyclictest1553-21runrttasks12:03:134
82529949733,84cyclictest0-21swapper/410:53:544
82529949729,338cyclictest0-21swapper/411:56:064
82519949728,84cyclictest0-21swapper/310:05:143
82489949733,253cyclictest0-21swapper/008:05:140
82529949630,84cyclictest0-21swapper/411:52:434
82529949630,84cyclictest0-21swapper/411:47:424
82509949670,253cyclictest0-21swapper/208:10:172
82489949633,83cyclictest12373-21ssh09:44:420
82489949633,83cyclictest12373-21ssh09:44:420
82549949573,83cyclictest0-21swapper/611:12:396
82549949572,84cyclictest131rcu_sched12:36:426
82529949531,42cyclictest0-21swapper/408:04:014
82529949529,126cyclictest0-21swapper/411:31:024
825199495450,42cyclictest401ktimersoftd/311:07:293
82489949568,211cyclictest1978-21ssh12:31:000
825599494157,4cyclictest721ktimersoftd/709:44:507
825599494157,4cyclictest721ktimersoftd/709:44:507
82519949423,127cyclictest0-21swapper/310:17:343
82509949329,165cyclictest0-21swapper/211:12:372
82559949270,84cyclictest0-21swapper/711:12:397
82549949265,338cyclictest0-21swapper/610:09:256
82529949269,84cyclictest0-21swapper/409:05:164
82559949167,126cyclictest0-21swapper/709:59:467
825499491112,209cyclictest0-21swapper/612:22:306
82529949127,85cyclictest0-21swapper/409:10:534
825399490195,211cyclictest0-21swapper/510:51:165
82519949062,294cyclictest0-21swapper/308:55:153
82549948920,380cyclictest0-21swapper/612:07:016
82539948926,43cyclictest6122-21ssh11:17:025
825399489231,84cyclictest0-21swapper/510:00:365
825399488230,127cyclictest0-21swapper/511:07:455
82509948862,211cyclictest0-21swapper/207:16:032
82499948822,254cyclictest0-21swapper/108:10:271
82529948718,296cyclictest0-21swapper/410:08:254
824899487103,126cyclictest9-21ksoftirqd/009:51:460
824999486102,253cyclictest0-21swapper/110:30:201
82529948517,295cyclictest0-21swapper/412:30:484
82499948520,125cyclictest0-21swapper/108:50:581
825499484100,296cyclictest0-21swapper/612:04:116
82489948317,84cyclictest0-21swapper/011:07:340
82559948217,380cyclictest0-21swapper/709:10:147
82519948297,211cyclictest1553-21runrttasks11:12:393
82549948155,295cyclictest0-21swapper/607:46:506
825399481229,125cyclictest0-21swapper/508:40:145
82529948113,254cyclictest0-21swapper/408:05:594
82539947956,84cyclictest0-21swapper/509:45:135
82539947711,126cyclictest0-21swapper/512:06:335
82559947611,381cyclictest0-21swapper/708:55:077
82539947511,84cyclictest0-21swapper/510:40:585
8251994759,84cyclictest0-21swapper/308:05:263
82509947250,261cyclictest0-21swapper/209:10:262
8248994726,127cyclictest0-21swapper/010:45:580
824899472173,126cyclictest121rcu_preempt12:40:200
824899472173,126cyclictest121rcu_preempt12:40:200
8255994701,254cyclictest0-21swapper/708:51:157
82549947043,296cyclictest0-21swapper/610:00:416
82499947043,296cyclictest0-21swapper/109:37:131
8251994694,126cyclictest0-21swapper/310:04:003
825599468209,255cyclictest16656-21ssh09:29:007
8254994671,211cyclictest0-21swapper/610:47:036
8253994671,44cyclictest0-21swapper/509:10:365
8255994661,297cyclictest0-21swapper/711:19:127
825399466292,85cyclictest0-21swapper/512:30:565
8252994661,211cyclictest0-21swapper/412:10:494
82519946539,211cyclictest0-21swapper/312:36:173
82499946581,211cyclictest0-21swapper/112:11:051
8249994651,126cyclictest0-21swapper/109:29:081
82549946480,126cyclictest65-21ksoftirqd/611:41:596
82509946441,341cyclictest0-21swapper/210:22:242
82489946442,84cyclictest32533-21runrttasks07:45:430
82559946340,177cyclictest0-21swapper/709:06:317
82549946377,296cyclictest0-21swapper/611:07:116
82549946340,3cyclictest0-21swapper/609:36:406
82549946282,84cyclictest0-21swapper/612:17:116
825399462121,338cyclictest0-21swapper/511:56:095
82509946240,254cyclictest3571-21diskmemload09:39:152
82499946282,295cyclictest0-21swapper/112:17:111
82499946240,2cyclictest0-21swapper/112:40:151
82499946240,2cyclictest0-21swapper/112:40:151
825599461119,339cyclictest0-21swapper/710:00:267
825399461294,47cyclictest0-21swapper/508:10:195
825399461122,84cyclictest121rcu_preempt11:38:455
82529946177,169cyclictest49-21ksoftirqd/412:40:224
82529946177,169cyclictest49-21ksoftirqd/412:40:224
82489946135,217cyclictest15482-21ssh09:45:250
825599460118,339cyclictest0-21swapper/712:26:247
82539946081,211cyclictest0-21swapper/509:40:285
82539946081,211cyclictest0-21swapper/509:40:285
82509946034,423cyclictest0-21swapper/210:15:062
82499946034,253cyclictest0-21swapper/107:16:051
82559945980,84cyclictest0-21swapper/712:17:107
82549945975,84cyclictest1551-21snmpd10:43:026
82539945978,84cyclictest121rcu_preempt09:39:405
82539945834,84cyclictest0-21swapper/512:36:185
82529945735,84cyclictest0-21swapper/412:46:284
82559945634,256cyclictest23575-21diskmemload10:49:167
82559945630,295cyclictest0-21swapper/712:46:257
82529945672,211cyclictest0-21swapper/407:16:124
82499945676,295cyclictest0-21swapper/111:12:401
825599455116,84cyclictest187-21md0_raid111:46:567
825599455115,84cyclictest0-21swapper/710:17:517
82549945579,80cyclictest0-21swapper/611:50:166
82539945432,84cyclictest0-21swapper/512:10:155
825399454112,211cyclictest57-21ksoftirqd/512:04:265
824999454114,338cyclictest0-21swapper/111:28:061
824899454114,166cyclictest0-21swapper/010:00:090
824899454113,338cyclictest698-21ptp4l08:36:340
825099453111,212cyclictest22844-21ssh10:08:592
82489945231,84cyclictest0-21swapper/008:10:140
82539945171,84cyclictest0-21swapper/512:40:575
82539945171,84cyclictest0-21swapper/512:40:575
82489945028,255cyclictest0-21swapper/008:18:320
825399449234,127cyclictest0-21swapper/507:46:415
824899449110,127cyclictest1553-21runrttasks08:51:140
82549944824,87cyclictest0-21swapper/611:56:436
82509944725,85cyclictest0-21swapper/211:07:392
82489944725,255cyclictest0-21swapper/010:09:210
825499446104,127cyclictest704-21nscd09:11:176
82519944667,295cyclictest0-21swapper/312:17:103
82489944667,295cyclictest0-21swapper/012:17:100
82559944523,2cyclictest0-21swapper/708:10:147
82559944522,3cyclictest0-21swapper/711:42:577
82549944523,253cyclictest0-21swapper/608:10:346
82559944422,2cyclictest0-21swapper/711:07:297
82489944461,211cyclictest9-21ksoftirqd/008:40:180
82549944316,296cyclictest0-21swapper/612:30:296
82559944220,41cyclictest187-21md0_raid111:57:027
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional