You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 06:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Sep 23, 2026 00:54:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35699974162,676cyclictest0-21swapper/520:33:445
356899737101,380cyclictest0-21swapper/422:01:594
35699970828,211cyclictest0-21swapper/523:45:315
356499707156,126cyclictest15941-1kworker/u17:121:30:010
356499707156,126cyclictest15941-1kworker/u17:121:30:010
35689969419,84cyclictest0-21swapper/400:13:394
35669967883,380cyclictest2235-21sh23:45:142
35689967680,422cyclictest0-21swapper/423:02:374
357099672118,381cyclictest0-21swapper/600:13:396
35699965114,634cyclictest0-21swapper/522:24:135
35699964815,549cyclictest0-21swapper/523:11:495
356499637170,337cyclictest3562-21cyclictest22:17:020
356499636337,84cyclictest0-21swapper/020:30:430
3564996351,126cyclictest6336-21sh23:29:370
356699632588,41cyclictest311rcuc/222:33:562
356699630504,42cyclictest311rcuc/200:40:212
35689961625,84cyclictest0-21swapper/422:54:194
35699961318,466cyclictest0-21swapper/500:19:165
356699607138,211cyclictest1551-21snmpd22:51:442
35659960698,127cyclictest22551-21chrt20:30:291
35689960192,296cyclictest0-21swapper/422:34:264
3565995985,126cyclictest0-21swapper/100:35:041
3569995961,85cyclictest0-21swapper/523:34:365
3568995930,84cyclictest0-21swapper/422:27:054
35649959383,253cyclictest0-21swapper/000:06:180
35699959040,126cyclictest121rcu_preempt00:39:275
35699958434,126cyclictest0-21swapper/523:23:045
35699958432,464cyclictest0-21swapper/522:34:225
35649958332,127cyclictest0-21swapper/022:51:440
356699582112,127cyclictest0-21swapper/223:35:212
35679958133,255cyclictest0-21swapper/322:05:003
35719957969,338cyclictest0-21swapper/723:01:587
35649957930,125cyclictest0-21swapper/023:59:590
357199577494,3cyclictest711rcuc/719:20:007
357099577108,296cyclictest0-21swapper/623:29:236
356499577111,84cyclictest0-21swapper/023:08:000
356499577111,84cyclictest0-21swapper/023:08:000
356799576108,302cyclictest0-21swapper/323:02:523
35649957670,84cyclictest9432-21kworker/u16:323:02:370
35699957526,465cyclictest0-21swapper/500:06:185
35689957525,84cyclictest0-21swapper/400:25:174
35659957323,84cyclictest0-21swapper/123:34:121
35719956814,381cyclictest0-21swapper/723:08:297
35719956814,381cyclictest0-21swapper/723:08:297
35679956899,254cyclictest121rcu_preempt23:08:203
35679956899,254cyclictest121rcu_preempt23:08:203
35679956515,84cyclictest0-21swapper/300:20:253
35709956495,296cyclictest12544-21ssh23:14:276
35699956352,296cyclictest0-21swapper/500:25:125
35699956311,549cyclictest284882chrt00:34:515
35659956212,126cyclictest0-21swapper/100:40:131
35709956110,126cyclictest0-21swapper/600:06:456
356799560137,254cyclictest3450-1kworker/u17:000:05:553
35689955990,258cyclictest0-21swapper/423:35:434
35689955949,341cyclictest121rcu_preempt23:54:104
3569995573,169cyclictest0-21swapper/522:18:365
35689955749,84cyclictest0-21swapper/423:29:154
356499557471,84cyclictest101ktimersoftd/021:30:150
35659955688,338cyclictest0-21swapper/122:23:301
356599556298,126cyclictest0-21swapper/123:01:231
3571995543,126cyclictest0-21swapper/720:38:047
3565995530,84cyclictest0-21swapper/100:00:291
3565995530,84cyclictest0-21swapper/100:00:291
3568995520,84cyclictest31027-21sh00:00:214
3568995520,84cyclictest31027-21sh00:00:214
35649955244,126cyclictest0-21swapper/022:33:300
35659955139,381cyclictest0-21swapper/122:01:191
356699549123,211cyclictest33-21ksoftirqd/223:08:372
356699549123,211cyclictest33-21ksoftirqd/223:08:372
356499549207,211cyclictest23140-1kworker/u17:100:20:040
35699954736,507cyclictest26142-21switchtime22:25:275
35689954734,422cyclictest0-21swapper/422:19:454
35679954679,84cyclictest0-21swapper/322:19:063
35649954677,338cyclictest0-21swapper/019:16:110
356699545161,126cyclictest121rcu_preempt22:25:202
35669954475,211cyclictest33-21ksoftirqd/200:00:242
35669954475,211cyclictest33-21ksoftirqd/200:00:242
35719954336,423cyclictest0-21swapper/700:06:267
356899543118,296cyclictest121rcu_preempt23:45:224
35669954335,84cyclictest0-21swapper/222:01:182
35699954232,126cyclictest0-21swapper/522:00:405
356899542115,338cyclictest0-21swapper/423:15:124
35649954235,84cyclictest3562-21cyclictest23:19:470
35689954133,85cyclictest698-21ptp4l00:35:094
35669954175,84cyclictest0-21swapper/223:14:052
35669954172,211cyclictest0-21swapper/222:40:132
35659954173,295cyclictest0-21swapper/123:35:271
35699954034,84cyclictest0-21swapper/521:48:365
35689954071,253cyclictest49-21ksoftirqd/422:12:474
356799540329,8cyclictest0-21swapper/320:30:433
35669954031,84cyclictest121rcu_preempt22:20:022
35649954033,126cyclictest0-21swapper/023:34:120
35689953931,84cyclictest0-21swapper/400:05:584
357099538110,296cyclictest0-21swapper/619:30:276
35699953869,296cyclictest7734-21rt-features00:40:305
35669953670,126cyclictest0-21swapper/222:23:142
35709953528,41cyclictest0-21swapper/622:18:286
35689953526,297cyclictest121rcu_preempt23:34:084
356499535194,126cyclictest121rcu_preempt23:14:040
356699534107,296cyclictest0-21swapper/220:38:042
356899533194,337cyclictest64450irq/122-eth000:00:014
35699953272,80cyclictest0-21swapper/500:20:235
35709953165,84cyclictest0-21swapper/600:35:106
35689953122,84cyclictest0-21swapper/422:35:124
356899531106,253cyclictest0-21swapper/421:28:564
356899531106,253cyclictest0-21swapper/421:28:564
35699953024,428cyclictest29279-21cron00:00:005
356799530188,211cyclictest0-21swapper/323:19:423
35669953022,84cyclictest0-21swapper/223:01:592
35659953023,84cyclictest0-21swapper/121:38:551
357199529100,381cyclictest0-21swapper/722:20:017
35689952922,216cyclictest121rcu_preempt20:30:294
35679952918,338cyclictest23068-21ssh00:30:293
35699952860,211cyclictest0-21swapper/523:02:225
35719952761,126cyclictest11935-21runrttasks22:00:047
35699952618,84cyclictest0-21swapper/523:35:315
35699952515,422cyclictest0-21swapper/522:56:365
35659952557,337cyclictest0-21swapper/100:06:161
35699952414,507cyclictest0-21swapper/500:14:185
35679952497,255cyclictest0-21swapper/323:34:113
35679952416,42cyclictest0-21swapper/321:38:553
35719952357,211cyclictest0-21swapper/700:39:177
35709952397,253cyclictest121rcu_preempt23:54:176
356999523440,4cyclictest561ktimersoftd/523:07:375
356999523440,4cyclictest561ktimersoftd/523:07:365
35649952313,422cyclictest0-21swapper/020:56:220
356799521222,126cyclictest0-21swapper/300:25:573
35669952114,126cyclictest0-21swapper/223:56:022
35699951812,422cyclictest0-21swapper/523:19:435
3568995189,127cyclictest11385-21diskmemload00:34:584
35689951810,50cyclictest0-21swapper/423:24:254
35669951851,127cyclictest0-21swapper/223:29:002
35649951853,127cyclictest0-21swapper/000:00:200
35649951853,127cyclictest0-21swapper/000:00:200
356499516133,126cyclictest121rcu_preempt00:40:370
35649951594,126cyclictest0-21swapper/023:35:270
3564995154,84cyclictest0-21swapper/000:35:140
3569995143,126cyclictest0-21swapper/519:32:315
3565995131,48cyclictest0-21swapper/123:08:371
3565995131,48cyclictest0-21swapper/123:08:371
3565995101,85cyclictest0-21swapper/122:27:021
35659950945,253cyclictest0-21swapper/123:40:121
35699950882,211cyclictest31134-21sh23:25:125
3566995081,84cyclictest0-21swapper/200:14:182
356599508297,8cyclictest0-21swapper/123:14:271
3571995073,124cyclictest0-21swapper/700:20:047
35699950740,464cyclictest0-21swapper/521:34:375
35709950679,295cyclictest0-21swapper/622:22:586
35689950637,337cyclictest0-21swapper/423:07:334
35689950637,337cyclictest0-21swapper/423:07:334
35659950637,380cyclictest3562-21cyclictest22:50:541
35709950481,84cyclictest0-21swapper/621:29:076
35709950481,84cyclictest0-21swapper/621:29:076
35699950435,466cyclictest0-21swapper/522:51:165
35719950376,296cyclictest0-21swapper/722:26:507
35679950376,211cyclictest41-21ksoftirqd/323:54:233
35649950381,84cyclictest0-21swapper/023:23:070
356499503417,84cyclictest101ktimersoftd/000:19:570
35699950276,210cyclictest29098-21memory21:35:245
356899502162,337cyclictest64450irq/122-eth000:20:014
35649950234,126cyclictest1667-21cron23:45:000
357199501456,42cyclictest721ktimersoftd/700:19:317
35709950179,84cyclictest0-21swapper/623:23:316
35679950178,126cyclictest0-21swapper/322:56:563
35699950078,341cyclictest0-21swapper/522:45:355
35679950034,126cyclictest0-21swapper/322:20:183
35709949935,126cyclictest0-21swapper/622:04:536
35659949934,84cyclictest0-21swapper/123:55:311
35659949934,83cyclictest0-21swapper/122:57:091
35649949973,84cyclictest0-21swapper/020:26:460
356599498199,126cyclictest0-21swapper/123:24:401
35649949876,84cyclictest0-21swapper/022:00:040
35659949772,253cyclictest0-21swapper/122:18:261
35709949672,85cyclictest0-21swapper/622:26:126
35689949632,253cyclictest0-21swapper/423:12:404
35659949633,84cyclictest0-21swapper/123:19:581
35709949530,42cyclictest0-21swapper/623:19:426
35689949570,337cyclictest0-21swapper/420:38:054
356799494112,125cyclictest15953-21ssh23:35:033
35649949430,84cyclictest0-21swapper/022:24:280
35699949325,127cyclictest0-21swapper/522:08:095
35689949331,82cyclictest0-21swapper/421:30:184
35659949329,126cyclictest0-21swapper/123:54:391
35719949224,126cyclictest0-21swapper/723:34:127
35719949223,296cyclictest0-21swapper/722:20:187
35709949228,168cyclictest0-21swapper/600:00:246
35709949228,168cyclictest0-21swapper/600:00:236
35689949266,423cyclictest0-21swapper/422:56:034
35649949226,84cyclictest0-21swapper/000:13:220
35699949126,383cyclictest17547-21kworker/u16:222:35:075
35689949021,254cyclictest121rcu_preempt20:46:584
35679949063,296cyclictest0-21swapper/323:13:323
356799490191,126cyclictest0-21swapper/322:50:273
35719948821,126cyclictest22881-21munin-run20:35:027
35719948818,296cyclictest0-21swapper/722:40:367
35709948824,83cyclictest0-21swapper/623:35:146
35679948866,126cyclictest0-21swapper/300:14:203
35669948718,338cyclictest0-21swapper/223:23:062
35659948762,381cyclictest0-21swapper/100:34:581
35649948660,126cyclictest0-21swapper/022:56:020
357099485446,36cyclictest631rcuc/600:40:336
35689948520,177cyclictest0-21swapper/422:23:234
35679948516,338cyclictest0-21swapper/321:22:293
35669948519,126cyclictest0-21swapper/200:35:152
35669948518,84cyclictest26207-21strings21:50:192
35669948516,296cyclictest0-21swapper/200:06:242
35719948418,84cyclictest0-21swapper/723:12:467
357099484100,126cyclictest65-21ksoftirqd/600:31:006
35669948419,126cyclictest0-21swapper/221:59:422
35709948315,127cyclictest0-21swapper/621:35:236
35689948357,379cyclictest0-21swapper/419:30:464
356599482223,127cyclictest0-21swapper/121:29:081
356599482223,127cyclictest0-21swapper/121:29:081
35659948217,126cyclictest0-21swapper/121:34:431
35709948198,380cyclictest0-21swapper/622:55:426
35709948157,126cyclictest0-21swapper/622:08:006
356799481101,169cyclictest0-21swapper/323:29:403
35649948198,211cyclictest9-21ksoftirqd/022:25:480
35699948012,465cyclictest0-21swapper/523:54:445
35659948012,338cyclictest0-21swapper/123:28:531
357199479225,84cyclictest0-21swapper/700:40:127
35679947952,127cyclictest41-21ksoftirqd/300:40:213
35679947894,127cyclictest41-21ksoftirqd/319:16:133
35719947713,84cyclictest0-21swapper/723:59:477
356799477432,42cyclictest391rcuc/323:45:233
3570994728,2cyclictest0-21swapper/620:33:146
35699947249,126cyclictest10048-21dump-pmu-power19:20:025
35689947190,84cyclictest0-21swapper/423:44:594
3567994717,42cyclictest0-21swapper/322:28:143
35719947011,79cyclictest0-21swapper/719:30:537
356699470129,126cyclictest33-21ksoftirqd/223:34:122
3565994704,84cyclictest121rcu_preempt23:45:051
3569994691,169cyclictest0-21swapper/522:12:475
356799469170,84cyclictest0-21swapper/323:55:363
357099467213,84cyclictest121rcu_preempt19:27:446
356799467214,41cyclictest0-21swapper/321:00:033
3566994673,126cyclictest0-21swapper/222:39:442
3564994671,84cyclictest0-21swapper/000:25:570
3564994671,211cyclictest0-21swapper/000:30:330
3565994661,42cyclictest0-21swapper/100:25:121
356999465123,126cyclictest24429-21if_eth020:35:165
35669946581,211cyclictest33-21ksoftirqd/200:19:542
35669946580,211cyclictest33-21ksoftirqd/200:25:162
3565994651,84cyclictest0-21swapper/100:14:101
356499465167,84cyclictest0-21swapper/023:49:360
35719946378,210cyclictest11385-21diskmemload23:25:167
357099463208,252cyclictest641ktimersoftd/623:02:026
35669946337,211cyclictest33-21ksoftirqd/223:19:492
356599463122,338cyclictest0-21swapper/100:19:231
357099462121,338cyclictest0-21swapper/600:20:126
35699946281,378cyclictest0-21swapper/500:00:295
35699946281,378cyclictest0-21swapper/500:00:295
356899462167,214cyclictest64450irq/122-eth021:45:064
356799462209,84cyclictest0-21swapper/320:26:323
35659946277,127cyclictest0-21swapper/121:45:081
35659946240,2cyclictest0-21swapper/121:54:151
35649946237,126cyclictest9-21ksoftirqd/023:54:000
356999461122,337cyclictest0-21swapper/521:27:405
356999461122,337cyclictest0-21swapper/521:27:405
35689946034,299cyclictest0-21swapper/419:20:014
356599460119,338cyclictest0-21swapper/122:05:151
356699459117,338cyclictest17991-21sh21:30:102
35689945834,84cyclictest26039-21ssh22:07:544
356899458121,126cyclictest3067-21seq00:20:224
356799458285,85cyclictest0-21swapper/323:23:053
356499458331,81cyclictest0-21swapper/022:35:000
35679945777,296cyclictest0-21swapper/321:29:063
35679945777,296cyclictest0-21swapper/321:29:063
35659945735,84cyclictest121rcu_preempt19:30:221
35719945672,381cyclictest0-21swapper/722:12:477
35719945633,256cyclictest0-21swapper/721:45:067
357199455371,3cyclictest711rcuc/722:51:097
35689945572,254cyclictest0-21swapper/421:50:184
35649945533,253cyclictest0-21swapper/019:31:020
35709945473,84cyclictest0-21swapper/623:07:476
35709945473,84cyclictest0-21swapper/623:07:476
35689945432,126cyclictest49-21ksoftirqd/421:16:514
35709945331,211cyclictest0-21swapper/622:34:406
356799453199,8cyclictest0-21swapper/300:00:163
356799453199,8cyclictest0-21swapper/300:00:153
35699945227,422cyclictest0-21swapper/520:46:525
35689945230,253cyclictest17381-21ssh21:12:204
356799452111,338cyclictest0-21swapper/300:35:073
356699452109,340cyclictest1553-21runrttasks22:55:572
35649945228,84cyclictest0-21swapper/022:45:250
35719945171,127cyclictest0-21swapper/700:34:377
35699945126,422cyclictest0-21swapper/519:22:575
35699945126,422cyclictest0-21swapper/519:22:575
35699945125,423cyclictest0-21swapper/523:40:045
35689945169,85cyclictest0-21swapper/400:40:384
35719945023,84cyclictest0-21swapper/723:24:397
35709945076,118cyclictest0-21swapper/622:54:196
35689945024,296cyclictest0-21swapper/419:20:114
35689945024,296cyclictest0-21swapper/419:20:114
35669945027,126cyclictest0-21swapper/200:30:342
35649945024,126cyclictest0-21swapper/021:38:570
35719944926,2cyclictest0-21swapper/700:01:017
35719944926,2cyclictest0-21swapper/700:01:017
357199447404,41cyclictest711rcuc/722:34:057
356799447152,211cyclictest502-1kworker/u17:000:19:493
35689944618,298cyclictest0-21swapper/420:56:094
357199445190,167cyclictest121rcu_preempt23:35:037
35709944519,212cyclictest8545-21ssh22:35:126
35699944519,126cyclictest0-21swapper/520:51:265
357099444187,126cyclictest0-21swapper/621:30:086
35679944422,256cyclictest0-21swapper/322:08:103
35669944460,211cyclictest0-21swapper/221:00:042
35719944115,253cyclictest0-21swapper/719:20:087
35719944115,253cyclictest0-21swapper/719:20:077
357199441141,126cyclictest121rcu_preempt21:38:437
35669944118,126cyclictest0-21swapper/221:29:342
35669944118,126cyclictest0-21swapper/221:29:342
35719943916,256cyclictest0-21swapper/721:30:197
35649943997,211cyclictest9-21ksoftirqd/022:08:170
35719943816,256cyclictest0-21swapper/723:49:267
35709943816,3cyclictest0-21swapper/620:35:196
35669943812,84cyclictest0-21swapper/221:35:232
35659943816,84cyclictest0-21swapper/119:35:051
35709943713,84cyclictest0-21swapper/623:49:136
35669943716,212cyclictest0-21swapper/223:54:102
35669943710,84cyclictest121rcu_preempt22:45:342
35659943716,253cyclictest0-21swapper/122:34:351
35719943613,256cyclictest0-21swapper/721:54:147
35699943611,126cyclictest0-21swapper/520:59:585
35659943656,211cyclictest0-21swapper/100:20:171
35659943349,211cyclictest0-21swapper/122:35:141
35659943210,177cyclictest0-21swapper/122:45:341
3570994318,84cyclictest0-21swapper/600:19:246
35689943151,84cyclictest30356-21runrttasks22:45:324
3566994315,84cyclictest26158-21ssh22:08:002
35679943050,169cyclictest0-21swapper/322:39:473
356599428213,127cyclictest0-21swapper/121:16:591
3569994271,169cyclictest0-21swapper/521:54:085
3571994263,256cyclictest0-21swapper/723:19:307
357199426128,211cyclictest16569-21kworker/u16:300:12:177
3568994261,422cyclictest0-21swapper/422:40:024
356599426255,126cyclictest121rcu_preempt19:44:341
356599426171,84cyclictest0-21swapper/120:51:481
3567994251,127cyclictest0-21swapper/319:30:473
35719942482,339cyclictest0-21swapper/722:35:197
3566994242,84cyclictest121rcu_preempt19:34:422
3566994241,126cyclictest0-21swapper/200:20:252
35719942383,338cyclictest0-21swapper/722:57:097
35719942382,338cyclictest0-21swapper/721:00:037
35709942383,84cyclictest0-21swapper/623:34:326
35689942382,338cyclictest0-21swapper/421:35:154
35719942281,338cyclictest0-21swapper/722:45:327
356599422215,82cyclictest0-21swapper/120:42:211
357199421125,126cyclictest27648-21sh23:40:277
357099421168,84cyclictest121rcu_preempt21:48:366
35679942141,3cyclictest0-21swapper/322:33:553
35669942183,336cyclictest0-21swapper/221:45:072
35669942141,296cyclictest0-21swapper/222:12:492
35709942081,84cyclictest10038-21ls19:20:006
35699942080,338cyclictest0-21swapper/522:40:135
35689942081,84cyclictest0-21swapper/421:04:264
35649942082,84cyclictest0-21swapper/021:04:260
35649942037,126cyclictest9-21ksoftirqd/021:22:290
35709941979,84cyclictest0-21swapper/623:59:576
35679941938,3cyclictest0-21swapper/323:40:283
35649941939,2cyclictest0-21swapper/020:35:200
35719941877,338cyclictest0-21swapper/721:16:507
35679941838,2cyclictest0-21swapper/321:54:143
35669941834,211cyclictest0-21swapper/223:40:052
35659941877,338cyclictest0-21swapper/120:35:131
35699941776,338cyclictest0-21swapper/521:16:515
35719941675,338cyclictest0-21swapper/721:29:317
35719941675,338cyclictest0-21swapper/721:29:317
357199416116,84cyclictest121rcu_preempt23:54:057
35709941576,84cyclictest0-21swapper/620:26:326
35649941576,84cyclictest0-21swapper/022:40:120
357199414114,176cyclictest0-21swapper/722:05:117
35709941475,84cyclictest0-21swapper/623:40:136
35689941435,295cyclictest0-21swapper/420:51:554
35669941434,84cyclictest0-21swapper/220:35:002
35689941334,295cyclictest0-21swapper/419:44:344
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional