You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 03:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Jul 18, 2026 00:54:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279229986418,2cyclictest0-21swapper/220:02:592
279239986115,510cyclictest0-21swapper/320:02:593
27920998527,509cyclictest0-21swapper/020:02:580
27925998482,510cyclictest0-21swapper/520:02:595
27921998041,509cyclictest0-21swapper/120:02:581
27926997631,510cyclictest0-21swapper/620:02:586
279279974324,510cyclictest0-21swapper/720:02:587
279229970928,84cyclictest0-21swapper/223:34:112
27924996793,2cyclictest28729-21seq20:02:594
2792499676591,83cyclictest481ktimersoftd/400:45:004
2792499676591,83cyclictest481ktimersoftd/400:45:004
279229965561,592cyclictest0-21swapper/222:54:052
279229965358,592cyclictest0-21swapper/222:32:462
279269963241,383cyclictest0-21swapper/622:11:066
279209962129,383cyclictest0-21swapper/022:11:050
279219961120,41cyclictest0-21swapper/123:03:491
279269960698,126cyclictest0-21swapper/621:35:156
279279959990,126cyclictest0-21swapper/721:35:157
279249959711,583cyclictest0-21swapper/422:10:444
27921995940,84cyclictest0-21swapper/122:54:041
279249958675,42cyclictest0-21swapper/423:34:594
279259958537,126cyclictest0-21swapper/500:44:245
279259958537,126cyclictest0-21swapper/500:44:245
2792499582242,338cyclictest64450irq/122-eth023:19:024
279229957969,507cyclictest0-21swapper/223:03:262
279209957770,84cyclictest0-21swapper/023:18:320
279229957421,550cyclictest0-21swapper/223:49:292
279209957463,338cyclictest3089-21diskmemload21:45:350
279229956310,337cyclictest0-21swapper/221:09:352
27922995596,84cyclictest0-21swapper/223:39:472
27924995576,126cyclictest49-21ksoftirqd/423:02:154
279229955586,296cyclictest0-21swapper/200:34:392
27924995531,125cyclictest0-21swapper/400:34:184
27921995530,422cyclictest0-21swapper/121:07:451
27920995510,84cyclictest0-21swapper/022:54:050
279229954639,8cyclictest0-21swapper/200:27:332
2792799545461,3cyclictest721ktimersoftd/723:18:277
2792299544203,126cyclictest121rcu_preempt21:49:322
2792499542116,254cyclictest0-21swapper/422:33:534
279209954273,211cyclictest0-21swapper/000:20:030
279209954273,211cyclictest0-21swapper/000:20:030
2792099542163,129cyclictest704-21nscd23:02:150
279239953830,256cyclictest26821-21taskset22:11:063
2792199537451,84cyclictest231rcuc/122:14:161
2792399536152,211cyclictest9410-21chrt22:54:413
279229953568,41cyclictest0-21swapper/223:18:522
2792399534196,218cyclictest4670-21gltestperf21:10:163
279239952816,296cyclictest0-21swapper/323:05:033
279259952721,340cyclictest0-21swapper/523:40:105
2792599526103,126cyclictest0-21swapper/521:35:145
279239952619,2cyclictest0-21swapper/320:54:323
279259952257,126cyclictest121rcu_preempt22:56:125
279209952114,50cyclictest0-21swapper/023:40:090
279259951710,256cyclictest0-21swapper/522:33:355
27924995177,507cyclictest0-21swapper/421:47:174
279219951795,126cyclictest121rcu_preempt21:48:271
279269951616,415cyclictest0-21swapper/623:49:006
27921995157,257cyclictest0-21swapper/122:33:351
27926995147,383cyclictest0-21swapper/622:33:356
27920995148,2cyclictest0-21swapper/022:33:360
279259951391,256cyclictest0-21swapper/522:11:055
279269951248,126cyclictest0-21swapper/623:04:576
27922995125,427cyclictest0-21swapper/222:55:442
27924995091,126cyclictest0-21swapper/421:35:144
279219950983,253cyclictest121rcu_preempt00:19:151
27921995090,84cyclictest0-21swapper/123:19:251
279279950881,211cyclictest73-21ksoftirqd/700:32:037
27924995081,257cyclictest0-21swapper/423:38:074
27922995081,256cyclictest0-21swapper/222:11:062
2792199505121,211cyclictest25-21ksoftirqd/123:38:551
279209950483,337cyclictest704-21nscd23:05:010
2792699503118,211cyclictest707-21gdbus23:40:016
279219950377,126cyclictest25-21ksoftirqd/100:33:311
279269950273,211cyclictest65-21ksoftirqd/600:34:246
279279950132,210cyclictest27918-21cyclictest23:39:587
279259950179,256cyclictest9228-21ssh22:54:305
27923995019,2cyclictest1888-21sh22:33:363
2792699500416,3cyclictest641ktimersoftd/623:40:086
2792699499415,3cyclictest641ktimersoftd/600:04:566
279219949930,126cyclictest0-21swapper/121:32:401
279209949933,84cyclictest0-21swapper/000:19:120
279249949672,211cyclictest0-21swapper/400:19:514
279219949628,84cyclictest121rcu_preempt23:49:081
279269949531,338cyclictest0-21swapper/600:19:066
279219949530,84cyclictest0-21swapper/100:43:451
279219949530,84cyclictest0-21swapper/100:43:451
2792799494410,3cyclictest711rcuc/722:13:307
279269949323,126cyclictest0-21swapper/622:56:386
2792399492112,126cyclictest0-21swapper/321:49:363
279229948623,121cyclictest0-21swapper/221:35:162
2792499485144,126cyclictest722-21nscd21:32:494
2792499485102,168cyclictest0-21swapper/400:27:454
279209948516,338cyclictest0-21swapper/023:47:510
279249948419,45cyclictest0-21swapper/423:20:044
279279948398,211cyclictest73-21ksoftirqd/721:05:567
279229948218,461cyclictest0-21swapper/220:54:582
279209948198,126cyclictest0-21swapper/023:34:340
2792799480141,84cyclictest27918-21cyclictest23:02:127
279239948053,211cyclictest41-21ksoftirqd/300:04:373
279209948011,84cyclictest0-21swapper/023:35:530
279239947914,84cyclictest0-21swapper/323:04:173
279229947915,338cyclictest0-21swapper/220:05:032
279209947611,211cyclictest0-21swapper/021:32:490
279259947288,211cyclictest1553-21runrttasks23:35:305
27927994695,84cyclictest0-21swapper/723:05:037
279259946884,380cyclictest0-21swapper/500:32:585
27923994680,127cyclictest0-21swapper/323:38:333
27927994670,42cyclictest0-21swapper/720:52:297
27920994670,84cyclictest0-21swapper/000:32:400
2792699465123,339cyclictest0-21swapper/622:54:026
2792299465293,83cyclictest27918-21cyclictest21:33:062
2792099465124,211cyclictest11668-21ssh22:55:260
279249946481,295cyclictest0-21swapper/422:54:524
279249946442,2cyclictest0-21swapper/422:56:354
279269946380,380cyclictest0-21swapper/622:35:146
279259946341,2cyclictest0-21swapper/523:20:055
279259946337,170cyclictest121rcu_preempt21:46:445
2792599463123,338cyclictest0-21swapper/500:19:125
2792499463208,253cyclictest64450irq/122-eth023:49:274
279239946340,3cyclictest0-21swapper/300:33:323
279239946336,126cyclictest41-21ksoftirqd/321:06:553
2792299462121,338cyclictest0-21swapper/200:04:372
279219946278,211cyclictest26762-21ssh23:05:101
279269946138,255cyclictest0-21swapper/621:48:096
279259946140,337cyclictest0-21swapper/500:04:255
2792599461120,338cyclictest0-21swapper/523:04:475
279239946180,84cyclictest0-21swapper/321:33:513
279219946176,211cyclictest0-21swapper/100:27:381
279209946138,256cyclictest0-21swapper/023:20:040
279279946077,380cyclictest0-21swapper/722:34:227
279269946034,253cyclictest0-21swapper/621:34:406
279279945933,169cyclictest1327-1kworker/u17:023:48:307
279279945931,211cyclictest0-21swapper/700:04:437
2792599459117,339cyclictest0-21swapper/521:33:475
279249945974,211cyclictest481ktimersoftd/421:08:454
2792399458117,338cyclictest0-21swapper/300:44:043
2792399458117,338cyclictest0-21swapper/300:44:043
2792599457117,338cyclictest0-21swapper/521:10:165
2792199457117,338cyclictest0-21swapper/120:54:571
279209945735,84cyclictest0-21swapper/000:35:300
279209945733,84cyclictest0-21swapper/020:50:200
279279945678,213cyclictest24619-1kworker/u17:123:40:107
279279945673,380cyclictest0-21swapper/722:35:147
2792799456369,84cyclictest711rcuc/720:55:167
2792799456369,84cyclictest711rcuc/720:55:167
279279945630,126cyclictest0-21swapper/723:20:217
279229945676,83cyclictest0-21swapper/223:05:022
279229945630,423cyclictest0-21swapper/223:20:132
2792799455112,169cyclictest5309-21sh00:19:527
2792199455114,126cyclictest3089-21diskmemload23:34:161
279239945471,127cyclictest0-21swapper/323:34:373
2792799453153,126cyclictest121rcu_preempt22:55:187
279269945332,255cyclictest0-21swapper/623:33:506
2792599453112,338cyclictest27706-21fschecks_count20:55:225
2792599453112,338cyclictest27706-21fschecks_count20:55:215
279209945330,256cyclictest0-21swapper/000:43:370
279209945330,256cyclictest0-21swapper/000:43:370
279279945267,338cyclictest0-21swapper/722:15:237
2792599452112,337cyclictest0-21swapper/523:49:145
2792599452111,338cyclictest0-21swapper/523:05:035
2792199452112,338cyclictest0-21swapper/122:15:011
2792799451194,84cyclictest721ktimersoftd/721:10:207
279219945028,2cyclictest3089-21diskmemload22:35:101
2792799449148,85cyclictest121rcu_preempt21:33:267
2792699449109,338cyclictest0-21swapper/620:54:576
279239944927,45cyclictest0-21swapper/323:40:103
2792199449108,338cyclictest0-21swapper/122:56:461
279279944861,211cyclictest73-21ksoftirqd/722:55:017
2792599448108,337cyclictest0-21swapper/500:20:055
2792599448108,337cyclictest0-21swapper/500:20:045
279249944722,254cyclictest0-21swapper/400:04:544
279229944725,127cyclictest0-21swapper/200:19:522
2792199447106,338cyclictest0-21swapper/123:40:111
279279944663,380cyclictest0-21swapper/700:44:137
279279944663,380cyclictest0-21swapper/700:44:137
2792699446105,338cyclictest0-21swapper/621:07:276
279219944624,7cyclictest0-21swapper/120:55:121
279219944624,7cyclictest0-21swapper/120:55:111
279269944522,50cyclictest0-21swapper/623:18:326
279239944564,84cyclictest0-21swapper/322:55:263
279209944565,211cyclictest0-21swapper/000:27:040
279229944317,423cyclictest5000-21taskset22:35:182
2792799442102,338cyclictest0-21swapper/721:48:267
2792399442228,126cyclictest3089-21diskmemload23:18:223
279209944157,211cyclictest9-21ksoftirqd/021:08:440
279239944059,84cyclictest0-21swapper/323:49:293
279279943916,256cyclictest0-21swapper/723:34:167
279269943815,257cyclictest0-21swapper/600:43:376
279269943815,257cyclictest0-21swapper/600:43:376
279229943614,338cyclictest0-21swapper/200:20:122
279229943614,338cyclictest0-21swapper/200:20:122
279229943596,84cyclictest0-21swapper/222:15:022
279209943550,126cyclictest0-21swapper/022:15:170
27924994347,211cyclictest0-21swapper/420:53:214
27921994347,211cyclictest22757-21apt23:20:121
279229943191,85cyclictest3587-21ssh21:10:092
279219943149,126cyclictest25-21ksoftirqd/100:04:551
27920994297,2cyclictest0-21swapper/020:05:160
27922994282,423cyclictest0-21swapper/223:40:122
279209942483,338cyclictest0-21swapper/022:35:140
279259942382,338cyclictest0-21swapper/522:35:135
279259942381,339cyclictest0-21swapper/521:07:515
27925994232,43cyclictest0-21swapper/520:52:475
279239942383,84cyclictest0-21swapper/300:20:143
279239942383,84cyclictest0-21swapper/300:20:143
279229942383,85cyclictest0-21swapper/220:55:232
279229942383,85cyclictest0-21swapper/220:55:222
279259942279,211cyclictest57-21ksoftirqd/522:15:195
279239942182,84cyclictest0-21swapper/319:25:183
279229942183,83cyclictest0-21swapper/200:42:482
279229942183,83cyclictest0-21swapper/200:42:482
2792699420124,84cyclictest121rcu_preempt00:27:396
279259941876,339cyclictest0-21swapper/523:33:475
279249941778,84cyclictest0-21swapper/422:35:184
279239941676,85cyclictest0-21swapper/321:35:083
279249941577,84cyclictest0-21swapper/421:10:094
2792499415158,126cyclictest121rcu_preempt23:40:104
279239941576,84cyclictest0-21swapper/323:50:193
279269941473,338cyclictest0-21swapper/600:20:056
279269941473,338cyclictest0-21swapper/600:20:056
279239941476,83cyclictest0-21swapper/320:55:193
279239941476,83cyclictest0-21swapper/320:55:193
279259941333,3cyclictest0-21swapper/523:19:255
279219941329,84cyclictest13904-21memory23:50:191
279239941273,84cyclictest0-21swapper/300:27:453
279239941272,84cyclictest0-21swapper/300:19:333
279209941030,3cyclictest0-21swapper/021:35:070
279249940970,84cyclictest0-21swapper/422:15:214
279219940968,338cyclictest0-21swapper/119:25:181
279249940766,169cyclictest0-21swapper/420:55:104
279249940766,169cyclictest0-21swapper/420:55:104
279209940768,84cyclictest0-21swapper/000:04:500
2792599405233,84cyclictest0-21swapper/523:50:195
279239940566,84cyclictest0-21swapper/300:35:303
279219940526,258cyclictest0-21swapper/100:20:131
279219940526,258cyclictest0-21swapper/100:20:131
279219940463,169cyclictest20368-21/usr/sbin/munin21:35:181
279249940324,84cyclictest0-21swapper/423:05:014
279209940364,84cyclictest0-21swapper/021:10:210
279239940263,84cyclictest0-21swapper/323:20:113
279239940161,84cyclictest0-21swapper/322:35:033
279229940016,296cyclictest0-21swapper/223:50:192
279269939919,255cyclictest0-21swapper/620:05:166
279219939959,338cyclictest0-21swapper/121:10:151
279279939717,214cyclictest0-21swapper/700:27:317
279269939756,126cyclictest0-21swapper/620:55:226
279269939756,126cyclictest0-21swapper/620:55:216
2792799395138,126cyclictest121rcu_preempt00:20:147
2792799395138,126cyclictest121rcu_preempt00:20:147
279269939553,338cyclictest5215-21needreboot21:10:216
279239939414,2cyclictest30464-21irqstats20:05:173
279279939312,258cyclictest0-21swapper/720:05:067
279269939313,3cyclictest0-21swapper/622:15:076
279259939212,257cyclictest0-21swapper/520:05:165
279239939253,84cyclictest0-21swapper/322:15:023
279219939296,211cyclictest0-21swapper/120:05:161
27925993919,127cyclictest0-21swapper/500:27:385
279209938849,84cyclictest0-21swapper/020:55:080
279209938849,84cyclictest0-21swapper/020:55:070
2792699382167,125cyclictest121rcu_preempt23:05:086
2792299373115,127cyclictest7090-21/usr/sbin/munin19:25:182
279249937233,85cyclictest0-21swapper/419:25:184
279249937133,84cyclictest0-21swapper/400:20:044
279249937133,84cyclictest0-21swapper/400:20:044
279229936827,338cyclictest27918-21cyclictest21:50:082
279279936624,212cyclictest0-21swapper/723:50:187
279259936625,85cyclictest0-21swapper/519:25:175
279269936427,168cyclictest0-21swapper/623:20:206
279269936363,211cyclictest65-21ksoftirqd/623:50:196
279269936123,83cyclictest0-21swapper/619:25:176
279279933981,254cyclictest7091-21sendmail_mailst19:25:187
279249933982,126cyclictest0-21swapper/420:05:224
279259933882,254cyclictest0-21swapper/500:35:315
279209933478,253cyclictest0-21swapper/023:50:180
279279933375,254cyclictest0-21swapper/700:35:307
279209933135,84cyclictest27918-21cyclictest19:25:180
279249932427,46cyclictest0-21swapper/400:35:304
279219932165,253cyclictest0-21swapper/100:35:311
279269931963,253cyclictest0-21swapper/600:35:316
279249931721,84cyclictest0-21swapper/423:50:174
279239929138,3cyclictest0-21swapper/321:50:083
279209928832,84cyclictest0-21swapper/021:50:070
279249928231,206cyclictest0-21swapper/421:50:094
279219927720,92cyclictest0-21swapper/121:50:071
279279927522,45cyclictest0-21swapper/721:50:087
279269927421,3cyclictest0-21swapper/621:50:096
279229926610,253cyclictest0-21swapper/200:35:312
279259926449,126cyclictest0-21swapper/521:50:075
1021821350,2sleep22792299cyclictest21:29:412
311282870,0sleep30-21swapper/321:23:483
2747028656,27sleep30-21swapper/319:09:413
2724328655,28sleep20-21swapper/219:06:292
2747328453,27sleep60-21swapper/619:09:456
2741828352,27sleep70-21swapper/719:08:587
2726628251,27sleep50-21swapper/519:06:475
2733728151,27sleep10-21swapper/119:07:481
2731028048,28sleep40-21swapper/419:07:264
2728827847,28sleep00-21swapper/019:07:070
106212780,0sleep40-21swapper/422:03:344
159912710,0sleep50-21swapper/520:35:165
2749324340,1sleep60-21swapper/619:10:016
27925992927,1cyclictest0-21swapper/519:32:065
27925992910,18cyclictest0-21swapper/519:38:435
27927992828,0cyclictest0-21swapper/721:22:447
27927992828,0cyclictest0-21swapper/720:31:147
27927992810,18cyclictest0-21swapper/719:38:337
27927992810,18cyclictest0-21swapper/719:31:267
27927992810,18cyclictest0-21swapper/719:13:417
27927992810,0cyclictest0-21swapper/719:46:137
27926992828,0cyclictest0-21swapper/619:52:456
27926992810,17cyclictest0-21swapper/622:44:096
27925992827,1cyclictest0-21swapper/522:44:455
27925992810,18cyclictest0-21swapper/519:13:445
27925992810,17cyclictest0-21swapper/522:28:215
27925992810,17cyclictest0-21swapper/519:52:245
27924992810,17cyclictest0-21swapper/422:44:074
27924992810,17cyclictest0-21swapper/422:28:164
27924992810,17cyclictest0-21swapper/420:14:264
27924992810,17cyclictest0-21swapper/419:31:214
27923992828,0cyclictest0-21swapper/319:38:353
27923992810,18cyclictest0-21swapper/322:44:173
27923992810,18cyclictest0-21swapper/320:49:493
27923992810,0cyclictest0-21swapper/322:02:373
27923992810,0cyclictest0-21swapper/320:31:023
27923992810,0cyclictest0-21swapper/319:53:073
27923992810,0cyclictest0-21swapper/319:32:073
27923992810,0cyclictest0-21swapper/319:13:403
27922992810,18cyclictest0-21swapper/219:31:432
27922992810,0cyclictest0-21swapper/221:23:132
27921992810,17cyclictest0-21swapper/122:28:201
27921992810,17cyclictest0-21swapper/122:02:371
27921992810,17cyclictest0-21swapper/120:13:501
27920992810,0cyclictest0-21swapper/019:38:410
27927992727,0cyclictest0-21swapper/719:52:537
27927992710,17cyclictest0-21swapper/722:44:167
27927992710,17cyclictest0-21swapper/721:45:007
27927992710,17cyclictest0-21swapper/720:39:417
27927992710,17cyclictest0-21swapper/720:13:487
27927992710,17cyclictest0-21swapper/719:24:467
27927992710,0cyclictest0-21swapper/722:28:117
27927992710,0cyclictest0-21swapper/722:01:587
27927992710,0cyclictest0-21swapper/719:19:127
27926992727,0cyclictest0-21swapper/619:24:506
27926992710,17cyclictest0-21swapper/622:27:556
27926992710,17cyclictest0-21swapper/621:22:516
27926992710,17cyclictest0-21swapper/620:49:446
27926992710,17cyclictest0-21swapper/620:31:326
27926992710,17cyclictest0-21swapper/620:21:226
27926992710,17cyclictest0-21swapper/620:13:506
27926992710,17cyclictest0-21swapper/619:46:156
27926992710,17cyclictest0-21swapper/619:38:336
27926992710,17cyclictest0-21swapper/619:19:126
27926992710,0cyclictest0-21swapper/622:02:026
27926992710,0cyclictest0-21swapper/620:39:156
27926992710,0cyclictest0-21swapper/619:31:226
27925992726,1cyclictest0-21swapper/521:22:525
27925992726,1cyclictest0-21swapper/519:46:095
27925992726,0cyclictest0-21swapper/519:19:325
27925992710,17cyclictest0-21swapper/520:13:475
27925992710,16cyclictest0-21swapper/522:02:035
27925992710,0cyclictest0-21swapper/520:31:035
27925992710,0cyclictest0-21swapper/520:21:195
27925992710,0cyclictest0-21swapper/519:24:525
27924992727,0cyclictest0-21swapper/421:22:534
27924992727,0cyclictest0-21swapper/419:13:424
27924992726,1cyclictest0-21swapper/420:39:274
27924992710,17cyclictest0-21swapper/420:31:064
27924992710,17cyclictest0-21swapper/419:52:474
27924992710,17cyclictest0-21swapper/419:46:164
27924992710,17cyclictest0-21swapper/419:38:074
27924992710,17cyclictest0-21swapper/419:24:464
27924992710,0cyclictest0-21swapper/420:49:494
27924992710,0cyclictest0-21swapper/419:19:404
27923992727,0cyclictest0-21swapper/320:39:153
27923992727,0cyclictest0-21swapper/320:13:503
27923992727,0cyclictest0-21swapper/319:46:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional