You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 01:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Aug 10, 2026 12:55:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205029984479,762cyclictest0-21swapper/710:23:077
2049599798754,42cyclictest111rcuc/010:34:490
205029979027,760cyclictest14925-21chrt11:45:267
2049999786742,42cyclictest481ktimersoftd/410:34:494
2049699738694,42cyclictest241ktimersoftd/110:34:491
205029971274,84cyclictest0-21swapper/707:30:017
2050199707111,380cyclictest0-21swapper/611:38:166
2050099691181,253cyclictest0-21swapper/512:00:315
205029967882,84cyclictest0-21swapper/708:28:207
2050099671118,380cyclictest0-21swapper/511:33:525
2050099671118,380cyclictest0-21swapper/511:33:515
2050099669116,383cyclictest121rcu_preempt11:52:475
2049699658147,295cyclictest10406-21ssh11:23:251
204989965257,423cyclictest0-21swapper/311:34:253
204989965257,423cyclictest0-21swapper/311:34:253
205029965112,636cyclictest0-21swapper/710:39:317
205029964912,634cyclictest0-21swapper/711:37:547
2050099644100,120cyclictest0-21swapper/511:55:335
205029963782,84cyclictest0-21swapper/709:15:567
2049599633208,253cyclictest28674-21diskmemload11:55:330
205019963139,212cyclictest8317-21ssh11:21:276
2049799631121,380cyclictest0-21swapper/211:05:362
205029963075,83cyclictest0-21swapper/711:21:397
2049999629161,211cyclictest0-21swapper/412:22:434
205029962631,592cyclictest0-21swapper/711:05:447
204959962631,127cyclictest4361-21turbostat.cron08:30:000
2050099624117,296cyclictest0-21swapper/509:22:195
204979962330,126cyclictest0-21swapper/212:26:102
2049599615105,295cyclictest0-21swapper/008:18:060
205029961318,592cyclictest0-21swapper/707:48:377
2049699612188,211cyclictest0-21swapper/111:53:231
2049799610101,126cyclictest0-21swapper/210:32:312
2049699609142,295cyclictest23657-21rm09:25:201
20497996059,126cyclictest0-21swapper/212:00:282
205029960047,550cyclictest20493-21cyclictest12:03:167
204969959988,296cyclictest0-21swapper/107:25:261
2050099598431,48cyclictest12145-21runrttasks07:45:225
20501995971,339cyclictest0-21swapper/611:51:246
20502995950,84cyclictest30558-21nscd09:20:417
20502995940,84cyclictest0-21swapper/711:51:537
20499995930,84cyclictest0-21swapper/407:28:094
20499995930,83cyclictest0-21swapper/412:30:464
20498995930,84cyclictest0-21swapper/312:30:453
20498995930,84cyclictest0-21swapper/307:28:093
20497995930,84cyclictest0-21swapper/211:47:422
205009959036,338cyclictest0-21swapper/507:57:405
205029958939,466cyclictest0-21swapper/708:53:077
204989958881,338cyclictest0-21swapper/311:39:163
2049699588120,253cyclictest0-21swapper/112:14:161
205029958775,296cyclictest0-21swapper/709:45:207
205029958775,296cyclictest0-21swapper/709:45:207
205019958738,383cyclictest0-21swapper/609:20:226
205029958329,551cyclictest0-21swapper/710:40:087
2050299581114,127cyclictest28674-21diskmemload10:32:537
205009958069,126cyclictest0-21swapper/509:19:375
204969957973,126cyclictest0-21swapper/111:06:231
2049599579112,464cyclictest0-21swapper/011:07:020
205029957724,550cyclictest0-21swapper/709:33:177
205029957521,127cyclictest0-21swapper/710:06:287
2049999575107,260cyclictest0-21swapper/409:23:254
2050299574106,465cyclictest3206-21ssh12:15:517
205019957423,126cyclictest698-21ptp4l11:13:426
205009957364,126cyclictest0-21swapper/510:32:505
204979957361,381cyclictest0-21swapper/209:20:592
204999957018,293cyclictest0-21swapper/410:20:364
2049799570230,338cyclictest3768-21kworker/u16:010:38:342
2049699570233,253cyclictest241ktimersoftd/108:27:091
204979956920,338cyclictest0-21swapper/210:21:522
204969956820,126cyclictest0-21swapper/111:33:441
204969956820,126cyclictest0-21swapper/111:33:441
204969956615,127cyclictest131rcu_sched10:50:371
204969956555,293cyclictest0-21swapper/111:13:301
204979956453,380cyclictest0-21swapper/209:45:282
204979956453,380cyclictest0-21swapper/209:45:282
204969956256,253cyclictest0-21swapper/109:45:411
204969956256,253cyclictest0-21swapper/109:45:411
20495995599,126cyclictest0-21swapper/011:36:230
2049899557215,126cyclictest29690-1kworker/u17:110:06:053
20502995561,339cyclictest0-21swapper/711:13:497
204999955548,168cyclictest0-21swapper/409:15:554
20495995541,126cyclictest0-21swapper/007:26:590
205019955346,126cyclictest1651-21ntpd10:32:506
204979955182,338cyclictest0-21swapper/212:44:502
2049599551295,126cyclictest0-21swapper/010:36:490
204959955040,380cyclictest0-21swapper/008:54:230
204989954980,380cyclictest0-21swapper/308:54:323
2049599547124,126cyclictest0-21swapper/011:34:010
2049599547124,126cyclictest0-21swapper/011:34:010
205019954639,211cyclictest0-21swapper/608:27:086
204979954677,211cyclictest0-21swapper/212:30:322
204959954681,126cyclictest23653-21ps09:25:200
204959954678,296cyclictest0-21swapper/010:09:420
204979954579,126cyclictest0-21swapper/211:36:092
204969954578,380cyclictest0-21swapper/110:23:371
204969954533,84cyclictest121rcu_preempt12:23:101
2050099544161,253cyclictest0-21swapper/511:35:485
205019954335,423cyclictest0-21swapper/608:05:276
2049899543120,168cyclictest0-21swapper/311:07:003
2049599543202,338cyclictest26958-21cpuspeed_turbos09:45:310
2049599543202,338cyclictest26958-21cpuspeed_turbos09:45:300
205009954273,254cyclictest0-21swapper/510:21:145
205009954233,85cyclictest0-21swapper/512:15:505
204999954274,295cyclictest0-21swapper/412:35:444
204969954276,463cyclictest0-21swapper/110:36:041
204969954234,253cyclictest20493-21cyclictest10:06:371
205009954130,341cyclictest0-21swapper/512:10:075
2049899541246,211cyclictest21716-21nscd09:15:553
2049999540114,211cyclictest49-21ksoftirqd/411:47:444
204979954031,84cyclictest0-21swapper/210:54:582
204959954075,126cyclictest0-21swapper/012:35:130
205029953927,509cyclictest0-21swapper/711:25:587
204999953931,210cyclictest0-21swapper/412:03:224
204999953928,338cyclictest0-21swapper/408:26:514
2049999539112,338cyclictest0-21swapper/410:09:324
204979953975,253cyclictest0-21swapper/211:27:292
205029953826,509cyclictest23758-21fgrep08:05:277
2050199538240,296cyclictest31097-21kworker/u16:111:25:246
204979953837,255cyclictest0-21swapper/212:35:192
204959953830,127cyclictest28674-21diskmemload11:52:430
2049999537196,338cyclictest64450irq/122-eth011:00:314
205009953671,127cyclictest0-21swapper/510:45:155
204999953670,211cyclictest0-21swapper/410:50:384
205019953528,338cyclictest20493-21cyclictest10:54:576
204999953469,211cyclictest0-21swapper/409:40:124
204999953428,83cyclictest121rcu_preempt12:14:084
204979953423,380cyclictest0-21swapper/211:22:332
2049799534153,84cyclictest121rcu_preempt10:09:142
205009953364,296cyclictest0-21swapper/510:37:595
204979953365,296cyclictest0-21swapper/211:34:182
204979953365,296cyclictest0-21swapper/211:34:172
204999953268,380cyclictest0-21swapper/411:27:324
204969953222,507cyclictest0-21swapper/111:46:181
204969953220,338cyclictest0-21swapper/109:40:141
2049999531104,254cyclictest0-21swapper/411:35:054
205009952965,126cyclictest23841-21swap09:25:245
204999952921,84cyclictest0-21swapper/411:13:414
205019952720,126cyclictest0-21swapper/608:30:136
205009952716,508cyclictest16338-21sh11:46:185
204969952761,126cyclictest0-21swapper/111:38:441
205029952699,296cyclictest0-21swapper/711:00:407
205019952618,84cyclictest0-21swapper/612:22:526
204989952618,126cyclictest0-21swapper/311:46:183
204969952619,337cyclictest121rcu_preempt09:23:201
204989952559,126cyclictest121rcu_preempt11:00:403
204959952519,127cyclictest0-21swapper/011:47:350
204959952418,295cyclictest0-21swapper/009:18:470
205019952211,338cyclictest0-21swapper/611:44:466
205009952299,211cyclictest0-21swapper/511:14:105
204989952213,84cyclictest0-21swapper/308:29:243
204979952159,84cyclictest0-21swapper/209:40:122
2049599517102,41cyclictest121rcu_preempt11:24:520
20502995164,509cyclictest0-21swapper/712:30:037
20495995169,84cyclictest0-21swapper/010:24:050
20497995155,127cyclictest0-21swapper/211:54:272
2050099513176,253cyclictest561ktimersoftd/509:40:135
20502995111,507cyclictest0-21swapper/712:35:367
20502995111,507cyclictest0-21swapper/711:34:327
20502995111,507cyclictest0-21swapper/711:34:327
204999951046,84cyclictest0-21swapper/411:21:054
204989951083,381cyclictest0-21swapper/311:25:413
204989951083,169cyclictest0-21swapper/312:26:073
20498995100,84cyclictest0-21swapper/310:38:383
204979951041,338cyclictest0-21swapper/208:30:012
2049799508124,253cyclictest1553-21runrttasks11:55:122
20495995080,211cyclictest0-21swapper/009:32:530
205019950679,211cyclictest0-21swapper/611:46:196
2049699506122,126cyclictest0-21swapper/112:30:161
2049599506123,126cyclictest9-21ksoftirqd/007:45:280
2049799504121,126cyclictest0-21swapper/207:29:522
204969950338,338cyclictest0-21swapper/109:18:131
204959950376,338cyclictest0-21swapper/010:10:030
205009950276,210cyclictest57-21ksoftirqd/511:00:185
204999950234,338cyclictest0-21swapper/409:45:464
204999950234,338cyclictest0-21swapper/409:45:464
2050199501120,127cyclictest0-21swapper/612:02:136
205009950132,126cyclictest0-21swapper/508:29:565
204969950135,84cyclictest121rcu_preempt12:45:011
204959950174,129cyclictest9-21ksoftirqd/011:26:270
2050199500119,127cyclictest0-21swapper/607:49:136
2049999500121,295cyclictest12532-21ssh11:44:464
204959950035,8cyclictest0-21swapper/010:50:290
204959950034,211cyclictest0-21swapper/011:12:010
2050199499114,211cyclictest0-21swapper/612:35:086
204999949976,84cyclictest0-21swapper/411:34:254
204999949976,84cyclictest0-21swapper/411:34:254
204979949977,84cyclictest0-21swapper/211:13:122
204969949930,50cyclictest121rcu_preempt11:55:201
205009949834,84cyclictest14416-21/usr/sbin/munin10:50:295
2050099497121,161cyclictest5217-21rm12:35:125
204989949674,84cyclictest0-21swapper/307:49:123
204969949531,253cyclictest0-21swapper/109:32:231
2049599495158,126cyclictest121rcu_preempt12:02:330
2049599495116,295cyclictest0-21swapper/012:44:380
205029949369,126cyclictest0-21swapper/710:30:007
2050199493113,296cyclictest0-21swapper/610:07:106
204989949370,84cyclictest0-21swapper/310:45:323
205009949227,84cyclictest0-21swapper/510:06:365
204959949271,84cyclictest0-21swapper/009:59:370
2050299491448,41cyclictest721ktimersoftd/712:22:597
204999949165,253cyclictest0-21swapper/409:04:124
2049599491151,337cyclictest32479-21kworker/u16:209:21:200
204989949067,84cyclictest0-21swapper/309:40:123
204989949063,211cyclictest0-21swapper/310:23:093
2050099489109,296cyclictest0-21swapper/511:27:285
204999948925,84cyclictest0-21swapper/410:36:364
205009948823,84cyclictest20493-21cyclictest12:22:585
204979948823,219cyclictest0-21swapper/209:19:012
2049999486146,337cyclictest20493-21cyclictest11:52:294
2049999486105,297cyclictest0-21swapper/412:44:394
205029948521,386cyclictest27637-21cstates11:15:137
204999948563,84cyclictest0-21swapper/411:55:184
204999948459,422cyclictest0-21swapper/409:32:154
2049699484100,210cyclictest25-21ksoftirqd/107:50:101
2050199483140,295cyclictest0-21swapper/612:15:496
2049899483142,338cyclictest10668-21sh11:23:413
2050199482147,80cyclictest20493-21cyclictest11:06:146
205009948260,338cyclictest0-21swapper/511:07:215
204969948256,126cyclictest0-21swapper/112:01:261
204969948217,126cyclictest6612-21taskset10:45:231
204969948015,126cyclictest0-21swapper/107:46:101
2049999479138,338cyclictest64450irq/122-eth009:59:374
205019947813,85cyclictest0-21swapper/612:30:336
2050199478136,211cyclictest0-21swapper/611:33:566
2050199478136,211cyclictest0-21swapper/611:33:556
2050099478395,3cyclictest551rcuc/509:30:545
20502994767,466cyclictest0-21swapper/711:55:287
204999947654,84cyclictest0-21swapper/411:06:304
204989947593,211cyclictest0-21swapper/310:33:373
20496994696,218cyclictest0-21swapper/108:05:281
20501994680,42cyclictest0-21swapper/609:16:026
204979946882,84cyclictest0-21swapper/210:45:332
20496994682,126cyclictest0-21swapper/111:15:141
205029946741,423cyclictest0-21swapper/709:25:097
204959946783,295cyclictest0-21swapper/012:26:100
2049699466125,339cyclictest0-21swapper/112:35:081
2050199465124,83cyclictest0-21swapper/610:21:206
2050199465123,339cyclictest0-21swapper/610:45:186
205009946582,126cyclictest0-21swapper/508:05:195
2049899465119,89cyclictest121rcu_preempt09:45:313
2049899465119,89cyclictest121rcu_preempt09:45:313
2049699465124,338cyclictest0-21swapper/111:44:561
204959946584,84cyclictest121rcu_preempt10:55:110
2049599465124,338cyclictest0-21swapper/008:55:180
2049599465124,211cyclictest0-21swapper/012:10:030
205029946480,211cyclictest73-21ksoftirqd/710:50:147
2050099464124,337cyclictest0-21swapper/507:27:465
2049699464124,338cyclictest0-21swapper/110:00:191
2050099463122,339cyclictest30152-21nscd09:45:385
2050099463122,339cyclictest30152-21nscd09:45:385
204969946341,256cyclictest0-21swapper/112:26:031
2050199462163,84cyclictest121rcu_preempt07:30:146
204999946239,126cyclictest0-21swapper/407:49:294
204989946240,256cyclictest0-21swapper/311:54:383
204979946278,211cyclictest0-21swapper/207:45:342
2049599462125,253cyclictest0-21swapper/009:40:110
205029946176,84cyclictest0-21swapper/709:40:247
2049999461245,85cyclictest0-21swapper/409:25:084
204979945979,84cyclictest20493-21cyclictest10:00:192
204959945933,126cyclictest30578-21ssh12:30:390
2050199458159,126cyclictest27070-21cpuspeed_turbos09:45:336
2050199458159,126cyclictest27070-21cpuspeed_turbos09:45:336
2050099458116,339cyclictest28674-21diskmemload11:44:565
205019945730,253cyclictest0-21swapper/607:26:576
2050199457116,338cyclictest0-21swapper/609:33:176
2049899457161,126cyclictest41-21ksoftirqd/309:33:263
205029945633,338cyclictest0-21swapper/711:40:417
2050199456116,338cyclictest0-21swapper/609:40:136
204989945676,296cyclictest0-21swapper/312:14:073
205019945527,380cyclictest0-21swapper/610:39:586
2050099455116,337cyclictest0-21swapper/508:40:115
2049999455116,336cyclictest0-21swapper/408:05:194
2049899455113,211cyclictest41-21ksoftirqd/309:21:443
2049799455203,125cyclictest0-21swapper/211:00:182
205029945432,338cyclictest0-21swapper/712:45:017
205009945432,2cyclictest0-21swapper/512:29:555
204969945431,127cyclictest0-21swapper/107:57:401
2049699454114,338cyclictest0-21swapper/110:55:081
205029945369,381cyclictest0-21swapper/708:13:387
204969945377,373cyclictest0-21swapper/111:00:261
2049899452110,339cyclictest0-21swapper/312:00:463
2050299451112,84cyclictest0-21swapper/712:10:057
2050299451111,337cyclictest0-21swapper/712:09:587
205019945128,84cyclictest0-21swapper/609:35:096
2050199451110,338cyclictest0-21swapper/612:45:016
204999945130,84cyclictest0-21swapper/408:53:064
204989945127,126cyclictest0-21swapper/311:59:523
204959945129,84cyclictest0-21swapper/010:25:100
2050299450109,338cyclictest0-21swapper/709:11:417
2049799450150,126cyclictest121rcu_preempt09:33:032
205029944975,338cyclictest0-21swapper/710:00:317
205019944966,126cyclictest3091-21ssh10:25:016
2050199449108,125cyclictest65-21ksoftirqd/611:00:226
2049899449108,338cyclictest303-21systemd-journal10:55:003
2050299448108,338cyclictest0-21swapper/710:45:197
204989944868,84cyclictest0-21swapper/311:12:153
204969944873,372cyclictest0-21swapper/111:26:571
205029944721,126cyclictest0-21swapper/712:26:047
2050199447105,84cyclictest0-21swapper/609:25:196
2049999447106,338cyclictest28674-21diskmemload10:00:214
204979944763,211cyclictest0-21swapper/212:22:532
204959944765,84cyclictest0-21swapper/010:45:320
205019944667,295cyclictest0-21swapper/612:14:076
205019944623,256cyclictest0-21swapper/608:50:516
204989944624,2cyclictest0-21swapper/311:44:573
204979944518,211cyclictest19544-21runrttasks08:53:022
2049799445106,84cyclictest23394-21sh10:55:072
204969944523,84cyclictest0-21swapper/108:30:141
2049599445104,338cyclictest0-21swapper/012:15:490
205019944321,256cyclictest0-21swapper/612:26:026
2049999443102,338cyclictest0-21swapper/412:29:574
2049999443101,126cyclictest0-21swapper/410:40:134
204979944319,84cyclictest0-21swapper/212:14:012
2049699443144,126cyclictest121rcu_preempt12:09:531
205009944259,380cyclictest0-21swapper/512:44:555
2050099442100,339cyclictest0-21swapper/510:55:125
2050099441101,337cyclictest0-21swapper/511:15:125
2050199440141,126cyclictest121rcu_preempt10:00:206
205009944018,255cyclictest0-21swapper/511:22:465
204979944056,211cyclictest8395-21ssh10:10:022
204989943959,83cyclictest0-21swapper/309:11:423
2049599439227,85cyclictest0-21swapper/008:05:140
205019943817,255cyclictest0-21swapper/607:50:056
204989943897,338cyclictest0-21swapper/312:22:033
205029943715,386cyclictest0-21swapper/710:10:017
204999943796,295cyclictest7427-21users10:45:324
204979943798,84cyclictest0-21swapper/209:25:212
2049599436137,126cyclictest121rcu_preempt11:00:260
204959943512,127cyclictest0-21swapper/012:22:180
204959943350,253cyclictest121rcu_preempt10:40:050
20497994297,2cyclictest0-21swapper/208:05:282
204979942847,84cyclictest0-21swapper/209:11:412
20496994287,255cyclictest0-21swapper/108:50:501
205009942787,338cyclictest0-21swapper/508:50:245
20497994251,126cyclictest30658-21chrt08:18:062
205029942483,338cyclictest0-21swapper/707:30:137
20500994241,256cyclictest0-21swapper/512:09:525
2050099424124,127cyclictest20493-21cyclictest12:30:035
20498994242,2cyclictest3187-21diskmemload10:25:083
20498994231,338cyclictest0-21swapper/312:35:203
20498994231,2cyclictest0-21swapper/312:09:513
204969942382,338cyclictest0-21swapper/108:13:381
2049599423124,126cyclictest9-21ksoftirqd/008:40:090
205029942282,337cyclictest0-21swapper/708:55:177
205019942282,338cyclictest0-21swapper/611:15:126
205019942282,338cyclictest0-21swapper/610:55:056
205009942281,338cyclictest0-21swapper/508:30:065
2049999422123,126cyclictest121rcu_preempt07:50:104
204989942283,84cyclictest0-21swapper/310:55:123
204989942282,84cyclictest0-21swapper/308:30:063
204979942283,84cyclictest0-21swapper/212:15:502
204989942182,84cyclictest0-21swapper/312:41:403
204989942182,84cyclictest0-21swapper/310:00:193
204989942181,84cyclictest8395-21ssh10:10:013
204979942183,83cyclictest0-21swapper/210:25:022
205029942080,338cyclictest0-21swapper/708:30:157
2050299420377,41cyclictest73-21ksoftirqd/708:39:397
204979942082,83cyclictest0-21swapper/208:40:072
204969942079,338cyclictest0-21swapper/110:25:011
204969942078,339cyclictest0-21swapper/110:40:191
204969942041,296cyclictest0-21swapper/109:11:521
205019941979,338cyclictest0-21swapper/611:59:586
204979941980,84cyclictest0-21swapper/208:30:152
205029941877,338cyclictest0-21swapper/709:59:367
205019941838,296cyclictest0-21swapper/612:09:586
204979941880,127cyclictest0-21swapper/210:40:122
204979941879,84cyclictest0-21swapper/212:09:442
204959941879,84cyclictest0-21swapper/008:30:130
205029941776,338cyclictest0-21swapper/710:55:127
205019941776,338cyclictest0-21swapper/610:10:016
205009941777,254cyclictest0-21swapper/507:30:155
205009941735,338cyclictest0-21swapper/510:40:045
2049599417122,84cyclictest12723-21dump-pmu-power11:45:000
205029941676,338cyclictest0-21swapper/707:16:157
205029941676,338cyclictest0-21swapper/707:16:157
205009941676,338cyclictest0-21swapper/510:25:035
204999941632,295cyclictest0-21swapper/411:15:124
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional