You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 23:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Apr 28, 2026 12:56:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132989980280,719cyclictest0-21swapper/210:38:372
132989980280,719cyclictest0-21swapper/210:38:372
132989965863,592cyclictest0-21swapper/211:48:092
132989965863,592cyclictest0-21swapper/211:48:082
132989965012,635cyclictest0-21swapper/212:12:002
132989964999,384cyclictest0-21swapper/210:50:432
133009964351,126cyclictest20980-21fschecks_count10:55:164
1329699623163,162cyclictest9-21ksoftirqd/010:39:240
1329699623163,162cyclictest9-21ksoftirqd/010:39:230
133019962267,381cyclictest0-21swapper/509:40:465
13298995989,166cyclictest0-21swapper/212:43:392
13302995930,84cyclictest0-21swapper/609:48:086
132979958739,296cyclictest0-21swapper/111:24:011
132989957926,550cyclictest0-21swapper/212:03:002
132989957223,165cyclictest0-21swapper/212:27:002
133009956921,379cyclictest0-21swapper/410:33:584
132999956759,126cyclictest121rcu_preempt12:04:203
132979956756,211cyclictest0-21swapper/109:48:001
1329999563485,76cyclictest391rcuc/311:39:563
133019955541,127cyclictest0-21swapper/510:54:595
13296995550,84cyclictest21592-21ssh11:48:090
13296995550,84cyclictest21592-21ssh11:48:090
13298995541,550cyclictest0-21swapper/211:25:142
1330099551295,84cyclictest0-21swapper/410:53:254
132989955140,380cyclictest0-21swapper/209:47:372
13296995510,84cyclictest12299-21rm12:02:330
1330099549123,423cyclictest0-21swapper/410:47:244
132989954781,211cyclictest0-21swapper/209:40:182
132989954780,465cyclictest0-21swapper/211:20:272
133029954680,84cyclictest0-21swapper/612:29:086
132989954635,508cyclictest0-21swapper/210:33:082
13298995441,458cyclictest0-21swapper/211:38:432
132989954332,508cyclictest0-21swapper/212:22:072
132979954335,88cyclictest0-21swapper/110:37:481
132979954335,88cyclictest0-21swapper/110:37:471
132989953629,504cyclictest0-21swapper/209:39:482
132989953626,507cyclictest0-21swapper/211:59:492
1330199535195,337cyclictest27620-1kworker/u17:012:15:285
132979953526,84cyclictest0-21swapper/111:18:511
1330399533106,424cyclictest21100-21diskmemload12:40:387
132989953369,253cyclictest121rcu_preempt10:29:432
132989952821,164cyclictest0-21swapper/208:00:192
132969952820,169cyclictest0-21swapper/011:58:410
132989952615,508cyclictest0-21swapper/207:58:202
133039952559,84cyclictest0-21swapper/711:48:517
133039952559,84cyclictest0-21swapper/711:48:517
132989952515,507cyclictest0-21swapper/212:38:212
132989952515,507cyclictest0-21swapper/212:38:212
1330299523138,126cyclictest121rcu_preempt11:19:266
132969952315,126cyclictest18329-21ssh10:53:250
133039952255,170cyclictest0-21swapper/712:37:217
133039952255,170cyclictest0-21swapper/712:37:217
133019952217,336cyclictest0-21swapper/512:28:215
132979951812,383cyclictest0-21swapper/110:30:591
132979951648,338cyclictest121rcu_preempt11:55:571
13298995143,508cyclictest0-21swapper/211:18:162
1330299509124,169cyclictest11299-21ssh11:25:186
13302995090,84cyclictest0-21swapper/610:37:296
13302995090,84cyclictest0-21swapper/610:37:286
13301995090,85cyclictest13666-21sh12:04:215
13301995080,84cyclictest0-21swapper/510:37:295
13301995080,84cyclictest0-21swapper/510:37:295
132979950882,211cyclictest0-21swapper/107:58:361
132979950679,211cyclictest25-21ksoftirqd/110:53:421
1329799506424,79cyclictest241ktimersoftd/110:28:421
133039950582,84cyclictest0-21swapper/712:28:437
133019950583,84cyclictest0-21swapper/511:57:425
1329999505249,254cyclictest401ktimersoftd/311:58:563
133029950338,127cyclictest0-21swapper/612:02:236
1330199503163,253cyclictest0-21swapper/511:50:145
1330199502207,84cyclictest121rcu_preempt12:13:555
1329699502203,126cyclictest121rcu_preempt12:41:390
1330399501164,172cyclictest721ktimersoftd/709:41:227
1330199501161,126cyclictest121rcu_preempt12:22:355
1330099501121,336cyclictest0-21swapper/412:04:204
132979950136,42cyclictest121rcu_preempt09:40:191
132979950135,84cyclictest24351-21uniq11:50:141
132989950034,124cyclictest4291-21ssh12:17:382
1330399499124,78cyclictest0-21swapper/711:21:437
1330099499119,295cyclictest0-21swapper/411:57:414
1329699498412,84cyclictest101ktimersoftd/007:59:490
132969949631,211cyclictest0-21swapper/011:38:410
133029949428,211cyclictest0-21swapper/611:58:566
132979949471,84cyclictest121rcu_preempt12:43:071
132979949367,211cyclictest0-21swapper/111:49:321
132979949367,211cyclictest0-21swapper/111:49:321
132969949327,84cyclictest0-21swapper/011:21:160
132979949163,338cyclictest121rcu_preempt12:16:591
133019948967,84cyclictest0-21swapper/510:50:035
132979948965,84cyclictest121rcu_preempt11:38:051
133009948862,253cyclictest0-21swapper/412:27:094
132999948722,254cyclictest0-21swapper/311:17:193
1330099486104,379cyclictest0-21swapper/409:40:224
132999948663,299cyclictest0-21swapper/308:00:043
1330299484228,254cyclictest641ktimersoftd/611:38:416
132979948459,169cyclictest0-21swapper/112:22:261
132979948458,211cyclictest0-21swapper/111:40:221
1329799484101,126cyclictest25-21ksoftirqd/112:03:111
132969948415,84cyclictest0-21swapper/010:55:160
133009948360,127cyclictest49-21ksoftirqd/410:37:044
133009948360,127cyclictest49-21ksoftirqd/410:37:044
1329699483142,127cyclictest121rcu_preempt10:28:560
132989948214,465cyclictest0-21swapper/210:47:412
133039948117,374cyclictest0-21swapper/712:22:237
132979948114,253cyclictest0-21swapper/112:38:471
132979948114,253cyclictest0-21swapper/112:38:471
132999948015,296cyclictest10665-21chrt12:43:263
133009947915,169cyclictest0-21swapper/412:20:464
132999947856,84cyclictest0-21swapper/310:35:283
132999947856,84cyclictest0-21swapper/310:35:283
133039947755,296cyclictest0-21swapper/709:46:337
133019947711,295cyclictest0-21swapper/511:47:155
133019947711,295cyclictest0-21swapper/511:47:145
1329699477102,372cyclictest0-21swapper/010:34:150
133009947651,127cyclictest0-21swapper/412:36:374
133009947651,127cyclictest0-21swapper/412:36:374
132989947610,166cyclictest0-21swapper/212:05:082
132969947655,50cyclictest0-21swapper/012:28:440
1330099475347,126cyclictest481ktimersoftd/412:43:184
1329999471387,3cyclictest391rcuc/312:27:523
13298994711,466cyclictest29938-21ssh10:04:472
132999947086,126cyclictest41-21ksoftirqd/309:47:553
132999946787,84cyclictest0-21swapper/310:29:433
13297994671,85cyclictest0-21swapper/112:13:081
1329999466125,338cyclictest0-21swapper/311:23:203
1329999466124,211cyclictest0-21swapper/310:34:133
132969946683,126cyclictest121rcu_preempt09:40:280
1330099465125,337cyclictest1551-21snmpd11:49:244
1330099465125,337cyclictest1551-21snmpd11:49:244
132989946580,381cyclictest29390-21expr10:40:172
1330399464123,338cyclictest698-21ptp4l12:17:067
1329999464207,126cyclictest121rcu_preempt12:21:223
1329999464123,338cyclictest0-21swapper/312:38:453
1329999464123,338cyclictest0-21swapper/312:38:443
1329999464123,338cyclictest0-21swapper/310:52:213
1329699464123,338cyclictest0-21swapper/008:40:130
133019946383,84cyclictest0-21swapper/509:45:525
1329799463124,84cyclictest21100-21diskmemload10:50:021
1329699463122,338cyclictest0-21swapper/012:30:250
133029946240,85cyclictest0-21swapper/610:51:076
133019946282,84cyclictest4318-21ssh11:38:265
1329699462121,338cyclictest0-21swapper/012:05:160
133019946180,84cyclictest0-21swapper/510:29:435
1330099461121,337cyclictest0-21swapper/407:58:124
132989946134,339cyclictest0-21swapper/208:39:242
1329699461120,338cyclictest0-21swapper/012:37:480
1329699461120,338cyclictest0-21swapper/012:37:480
1330399460421,37cyclictest711rcuc/711:39:387
1330199460206,84cyclictest561ktimersoftd/511:23:205
1329999460119,126cyclictest0-21swapper/309:41:413
132989946081,82cyclictest21655-21missed_timers10:55:242
132989945977,126cyclictest7742-21strings11:40:302
132969945836,84cyclictest0-21swapper/008:00:150
1329999457116,338cyclictest1578-21lldpd11:49:243
1329999457116,338cyclictest1578-21lldpd11:49:233
1330399456115,338cyclictest0-21swapper/710:31:347
1330399456114,339cyclictest0-21swapper/710:51:317
1330299456117,336cyclictest0-21swapper/611:40:186
133019945673,380cyclictest0-21swapper/512:40:395
1330099456116,337cyclictest0-21swapper/409:45:574
132969945676,296cyclictest0-21swapper/012:16:260
133039945528,296cyclictest0-21swapper/712:03:187
1330399455198,254cyclictest21100-21diskmemload10:35:277
1330399455198,254cyclictest21100-21diskmemload10:35:267
1330399455114,126cyclictest73-21ksoftirqd/712:05:177
1330099455116,253cyclictest0-21swapper/410:40:234
132969945575,126cyclictest0-21swapper/011:50:040
133039945427,296cyclictest0-21swapper/711:18:317
133029945432,255cyclictest0-21swapper/609:41:226
133019945474,84cyclictest0-21swapper/510:04:315
132989945432,419cyclictest0-21swapper/212:30:182
132969945471,126cyclictest30279-21sh09:48:240
1329699454113,338cyclictest0-21swapper/012:21:180
1329699454113,338cyclictest0-21swapper/010:48:460
133029945372,84cyclictest0-21swapper/610:49:406
132989945330,341cyclictest0-21swapper/210:05:092
132979945369,211cyclictest0-21swapper/112:27:261
133029945230,2cyclictest0-21swapper/611:49:416
133029945230,2cyclictest0-21swapper/611:49:416
133019945271,84cyclictest0-21swapper/511:19:345
133029945166,84cyclictest0-21swapper/611:23:456
1330099450110,338cyclictest0-21swapper/410:28:154
1329999450109,126cyclictest0-21swapper/312:15:273
133009944922,177cyclictest0-21swapper/412:12:424
1330399448110,171cyclictest0-21swapper/708:00:057
133019944869,83cyclictest0-21swapper/512:38:525
133019944869,83cyclictest0-21swapper/512:38:525
132969944866,84cyclictest121rcu_preempt11:40:210
1330399446105,338cyclictest0-21swapper/712:30:037
133029944661,169cyclictest65-21ksoftirqd/612:23:306
132999944662,211cyclictest22421-21chrt12:30:233
132999944459,211cyclictest41-21ksoftirqd/310:04:313
132989944321,165cyclictest0-21swapper/208:40:042
1329699443106,172cyclictest704-21nscd11:19:250
133029944258,211cyclictest15466-21diskstats12:05:166
133029944258,210cyclictest0-21swapper/611:50:146
132999944199,84cyclictest29391-21gltestperf10:40:183
132999944160,84cyclictest0-21swapper/308:00:203
133009944060,85cyclictest698-21ptp4l12:15:534
133009944018,296cyclictest0-21swapper/411:39:514
132989944060,84cyclictest0-21swapper/211:50:142
132999943854,211cyclictest0-21swapper/312:11:493
133029943694,339cyclictest0-21swapper/612:15:566
133029943648,126cyclictest0-21swapper/612:40:396
132979943510,212cyclictest0-21swapper/112:30:231
1329999434179,253cyclictest13294-21cyclictest10:46:543
133029943247,219cyclictest29201-21grep10:40:156
133009943248,169cyclictest0-21swapper/411:21:174
13302994302,296cyclictest0-21swapper/610:28:536
1329799430130,84cyclictest121rcu_preempt10:04:331
13302994297,256cyclictest0-21swapper/610:55:286
13302994286,256cyclictest0-21swapper/610:31:466
13302994280,211cyclictest2705-21ssh12:37:136
13302994280,211cyclictest2705-21ssh12:37:136
133019942742,126cyclictest29882-21taskset10:40:215
13300994274,3cyclictest0-21swapper/411:18:294
133039942647,85cyclictest0-21swapper/708:00:167
13303994252,169cyclictest21681-1kworker/7:2H10:55:297
133029942582,126cyclictest65-21ksoftirqd/607:58:066
133039942445,84cyclictest0-21swapper/712:12:347
13296994244,290cyclictest0-21swapper/012:14:070
1330199423166,84cyclictest121rcu_preempt08:40:115
13300994231,84cyclictest6408-21ssh11:40:154
132979942384,337cyclictest0-21swapper/110:40:171
133039942178,127cyclictest0-21swapper/711:59:047
133019942183,84cyclictest0-21swapper/508:00:035
133019942182,84cyclictest0-21swapper/510:32:455
132999942182,84cyclictest0-21swapper/310:55:113
133019942081,84cyclictest0-21swapper/511:40:205
133019942079,211cyclictest0-21swapper/509:39:145
132999942082,84cyclictest0-21swapper/311:50:143
132979942079,338cyclictest0-21swapper/110:55:141
132969942082,84cyclictest0-21swapper/010:04:330
133019941981,83cyclictest0-21swapper/508:00:155
133019941735,125cyclictest57-21ksoftirqd/508:39:455
1329799417118,169cyclictest0-21swapper/108:38:241
133029941677,84cyclictest0-21swapper/612:13:056
133029941677,84cyclictest0-21swapper/609:39:116
133019941677,84cyclictest0-21swapper/512:05:165
132969941475,84cyclictest0-21swapper/009:39:110
133039941374,84cyclictest0-21swapper/711:25:147
133039941374,84cyclictest0-21swapper/710:28:167
133009941333,84cyclictest0-21swapper/412:30:034
1329999413113,126cyclictest41-21ksoftirqd/311:40:073
132969941374,84cyclictest0-21swapper/008:39:240
133029941274,84cyclictest0-21swapper/610:04:316
133019941273,84cyclictest0-21swapper/510:55:305
1329799412113,84cyclictest121rcu_preempt08:00:061
133039941131,83cyclictest0-21swapper/710:40:027
132999941070,84cyclictest0-21swapper/311:25:143
132969940968,126cyclictest0-21swapper/011:25:150
133039940727,253cyclictest0-21swapper/710:04:577
133029940666,84cyclictest0-21swapper/612:30:256
132979940665,338cyclictest0-21swapper/112:05:151
133039940524,254cyclictest0-21swapper/710:48:357
133009940528,84cyclictest0-21swapper/410:04:484
133029940465,84cyclictest0-21swapper/608:00:156
133019940321,168cyclictest57-21ksoftirqd/512:30:045
133039940121,260cyclictest0-21swapper/711:40:007
132999939898,126cyclictest0-21swapper/310:05:153
133029939759,173cyclictest30676-21runrttasks10:05:146
133009939516,211cyclictest0-21swapper/410:05:014
132999939556,84cyclictest0-21swapper/312:05:153
133029939455,84cyclictest0-21swapper/608:40:136
133029939455,84cyclictest0-21swapper/608:39:246
133019939398,211cyclictest0-21swapper/511:25:225
132979939353,338cyclictest0-21swapper/109:39:401
1330399387133,42cyclictest0-21swapper/709:39:407
133009938647,84cyclictest0-21swapper/408:38:384
133009938043,83cyclictest0-21swapper/408:00:174
132969938045,80cyclictest0-21swapper/010:40:140
133009937940,85cyclictest23408-21ssh11:50:034
1330099374120,251cyclictest0-21swapper/411:25:144
133039937031,84cyclictest0-21swapper/711:50:047
133009937032,84cyclictest0-21swapper/412:05:154
132979936469,211cyclictest0-21swapper/111:25:241
1329699364244,37cyclictest101ktimersoftd/010:05:130
1329999363109,87cyclictest2971-21munin-run08:40:003
1330099362106,253cyclictest64450irq/122-eth009:39:354
1329799361151,80cyclictest121rcu_preempt08:40:091
133039935259,173cyclictest121rcu_preempt08:40:117
133019935013,171cyclictest0-21swapper/510:05:145
132999935011,84cyclictest0-21swapper/309:39:113
13297993509,338cyclictest0-21swapper/110:05:141
133039934710,2cyclictest0-21swapper/708:38:137
133009934445,126cyclictest49-21ksoftirqd/408:40:114
133039933275,128cyclictest30672-21apt-get10:05:157
132999932975,84cyclictest401ktimersoftd/308:40:063
1637421120,2sleep01329699cyclictest09:57:180
1237128756,28sleep70-21swapper/707:05:547
1249428546,35sleep00-21swapper/007:07:380
1249128555,27sleep60-21swapper/607:07:376
1248828553,28sleep30-21swapper/307:07:333
319402830,0sleep20-21swapper/208:30:222
1239628342,5sleep50-21swapper/507:06:165
1266128250,28sleep20-21swapper/207:09:572
1251528251,28sleep10-21swapper/107:07:561
1234828251,28sleep40-21swapper/407:05:354
226962700,0sleep70-21swapper/711:12:117
13298993410,0cyclictest0-21swapper/209:19:252
13298993210,17cyclictest0-21swapper/209:29:402
13298993127,4cyclictest0-21swapper/209:01:532
13303992927,1cyclictest0-21swapper/708:52:357
13303992910,18cyclictest0-21swapper/710:21:127
13303992910,18cyclictest0-21swapper/709:29:047
13303992910,18cyclictest0-21swapper/709:19:127
13303992910,18cyclictest0-21swapper/707:46:587
13303992910,18cyclictest0-21swapper/707:29:257
13300992926,2cyclictest0-21swapper/410:21:314
13298992925,4cyclictest0-21swapper/207:13:502
13303992810,17cyclictest0-21swapper/708:28:017
13303992810,17cyclictest0-21swapper/708:28:007
13303992810,0cyclictest0-21swapper/709:01:597
13303992810,0cyclictest0-21swapper/707:14:097
13302992828,0cyclictest0-21swapper/609:01:526
13302992828,0cyclictest0-21swapper/607:46:486
13302992810,18cyclictest0-21swapper/609:29:296
13302992810,18cyclictest0-21swapper/608:12:556
13300992827,1cyclictest0-21swapper/409:29:114
13300992826,1cyclictest0-21swapper/409:10:034
13300992810,18cyclictest0-21swapper/407:13:494
13300992810,17cyclictest0-21swapper/409:19:164
13299992827,0cyclictest0-21swapper/307:29:283
13299992810,18cyclictest0-21swapper/308:20:403
13299992810,18cyclictest0-21swapper/307:46:273
13299992810,18cyclictest0-21swapper/307:22:093
13299992810,17cyclictest0-21swapper/310:21:133
13299992810,0cyclictest0-21swapper/309:29:043
13299992810,0cyclictest0-21swapper/309:09:293
13298992810,18cyclictest0-21swapper/207:46:512
168992270,0sleep20-21swapper/207:15:012
13303992726,1cyclictest0-21swapper/707:55:017
13303992725,1cyclictest0-21swapper/707:38:237
13303992710,17cyclictest0-21swapper/708:12:407
13303992710,17cyclictest0-21swapper/707:21:477
13303992710,0cyclictest0-21swapper/709:10:037
13303992710,0cyclictest0-21swapper/708:20:377
13302992727,0cyclictest0-21swapper/608:52:346
13302992727,0cyclictest0-21swapper/608:20:386
13302992710,17cyclictest0-21swapper/610:21:136
13302992710,17cyclictest0-21swapper/609:18:426
13302992710,17cyclictest0-21swapper/609:09:306
13302992710,17cyclictest0-21swapper/608:27:426
13302992710,17cyclictest0-21swapper/608:27:426
13302992710,17cyclictest0-21swapper/607:55:016
13302992710,17cyclictest0-21swapper/607:21:496
13302992710,17cyclictest0-21swapper/607:13:416
13302992710,0cyclictest0-21swapper/611:14:456
13302992710,0cyclictest0-21swapper/609:10:046
13302992710,0cyclictest0-21swapper/607:29:356
13301992727,0cyclictest0-21swapper/511:14:565
13301992727,0cyclictest0-21swapper/510:21:125
13301992727,0cyclictest0-21swapper/507:38:305
13301992727,0cyclictest0-21swapper/507:21:465
13301992727,0cyclictest0-21swapper/507:13:375
13301992726,1cyclictest0-21swapper/509:18:395
13301992710,17cyclictest0-21swapper/509:29:055
13301992710,17cyclictest0-21swapper/509:10:015
13301992710,17cyclictest0-21swapper/509:09:595
13301992710,17cyclictest0-21swapper/508:52:465
13301992710,17cyclictest0-21swapper/508:28:005
13301992710,17cyclictest0-21swapper/508:27:595
13301992710,17cyclictest0-21swapper/508:20:425
13301992710,17cyclictest0-21swapper/508:12:275
13301992710,17cyclictest0-21swapper/507:46:285
13301992710,0cyclictest0-21swapper/509:01:275
13301992710,0cyclictest0-21swapper/507:29:295
13300992727,0cyclictest0-21swapper/408:12:314
13300992727,0cyclictest0-21swapper/407:38:224
13300992710,17cyclictest0-21swapper/408:52:304
13300992710,17cyclictest0-21swapper/408:28:074
13300992710,17cyclictest0-21swapper/408:28:074
13300992710,17cyclictest0-21swapper/408:20:374
13300992710,17cyclictest0-21swapper/407:21:464
13300992710,0cyclictest0-21swapper/409:09:344
13300992710,0cyclictest0-21swapper/409:01:264
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional