You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 19:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri May 01, 2026 12:57:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12537997241,84cyclictest0-21swapper/612:00:506
12537997241,84cyclictest0-21swapper/612:00:496
12537997241,84cyclictest0-21swapper/612:00:496
125279970528,2cyclictest16360-21ssh10:33:133
12520996782,2cyclictest0-21swapper/210:33:132
12515996395,2cyclictest0-21swapper/110:33:131
12515996360,84cyclictest0-21swapper/110:43:011
125109962370,380cyclictest0-21swapper/009:13:360
125109961322,339cyclictest18602-21ssh09:44:120
125279960855,380cyclictest0-21swapper/312:14:283
12532995940,84cyclictest0-21swapper/409:45:044
125389959384,84cyclictest121rcu_preempt11:23:507
1251599587419,3cyclictest241ktimersoftd/110:35:291
125109958577,126cyclictest0-21swapper/010:35:340
1253299583500,3cyclictest481ktimersoftd/411:14:424
1253299583500,3cyclictest481ktimersoftd/411:14:424
1251099583115,295cyclictest0-21swapper/012:24:410
1253299581498,3cyclictest481ktimersoftd/412:33:544
125329957667,85cyclictest121rcu_preempt09:24:474
1252799575109,211cyclictest12501-21cyclictest12:31:413
125209957121,381cyclictest20729-21diskmemload10:42:532
125279956818,127cyclictest0-21swapper/311:27:163
125279956652,381cyclictest0-21swapper/310:13:333
125279956652,381cyclictest0-21swapper/310:13:323
12537995551,84cyclictest0-21swapper/611:21:086
125389955286,211cyclictest0-21swapper/711:19:177
12538995520,84cyclictest0-21swapper/711:44:457
12520995520,86cyclictest0-21swapper/209:14:042
1251599552167,296cyclictest0-21swapper/109:24:481
125209954981,211cyclictest0-21swapper/211:15:242
125209954941,126cyclictest0-21swapper/212:01:232
125209954941,126cyclictest0-21swapper/212:01:232
125209954941,126cyclictest0-21swapper/212:01:232
125379954838,507cyclictest14471-21taskset08:56:156
125379954838,507cyclictest14471-21taskset08:56:156
125279954739,84cyclictest121rcu_preempt09:24:333
125379954677,466cyclictest0-21swapper/612:32:366
125369954579,126cyclictest32633-1kworker/u17:109:44:215
1251599545459,84cyclictest231rcuc/109:38:561
125159954537,126cyclictest121rcu_preempt11:29:561
125279954377,211cyclictest0-21swapper/310:43:053
125329954234,42cyclictest0-21swapper/411:21:344
125209954176,45cyclictest21716-21nscd10:35:262
125369954075,126cyclictest121rcu_preempt12:33:095
125329953933,337cyclictest0-21swapper/409:44:514
125109953970,338cyclictest0-21swapper/011:23:500
125159953874,84cyclictest10394-21sh10:13:361
125159953874,84cyclictest10394-21sh10:13:361
125109953726,50cyclictest0-21swapper/012:34:360
125389953629,44cyclictest0-21swapper/712:33:017
125329953670,211cyclictest0-21swapper/411:30:194
1253699534278,253cyclictest1127-21cat11:20:325
125279953423,127cyclictest0-21swapper/312:05:023
125279953423,127cyclictest0-21swapper/312:05:023
125279953423,127cyclictest0-21swapper/312:05:023
1251599533234,126cyclictest12501-21cyclictest11:58:441
1251099533192,211cyclictest0-21swapper/009:24:040
125389953227,205cyclictest73-21ksoftirqd/711:29:197
125209953220,296cyclictest0-21swapper/211:55:172
1251599532192,338cyclictest2673-21kworker/u16:110:57:181
125209952960,296cyclictest20729-21diskmemload10:14:362
125209952960,296cyclictest20729-21diskmemload10:14:362
125369952719,42cyclictest0-21swapper/510:47:105
125379952617,466cyclictest0-21swapper/609:14:466
125329952658,210cyclictest0-21swapper/412:01:374
125329952658,210cyclictest0-21swapper/412:01:374
125329952658,210cyclictest0-21swapper/412:01:374
125279952616,211cyclictest15281-21ssh09:40:293
1253299525185,338cyclictest64450irq/122-eth010:42:164
125279952598,296cyclictest0-21swapper/311:16:403
1252799525142,126cyclictest121rcu_preempt11:30:073
125209952555,211cyclictest0-21swapper/211:43:192
125379952257,383cyclictest0-21swapper/611:53:466
1251599522180,211cyclictest20729-21diskmemload12:03:101
1251599522180,211cyclictest20729-21diskmemload12:03:101
1251599522180,211cyclictest20729-21diskmemload12:03:101
125379952114,256cyclictest0-21swapper/612:24:526
125329952114,297cyclictest0-21swapper/412:15:194
1251099520140,169cyclictest0-21swapper/011:57:580
1253299519181,84cyclictest64450irq/122-eth011:19:174
12536995159,42cyclictest0-21swapper/509:38:455
125329951591,167cyclictest49-21ksoftirqd/411:54:594
12538995147,3cyclictest0-21swapper/712:24:517
12527995135,3cyclictest0-21swapper/312:24:523
125369951287,422cyclictest0-21swapper/508:59:285
125369951287,422cyclictest0-21swapper/508:59:275
12536995126,255cyclictest0-21swapper/512:24:525
125329951286,253cyclictest49-21ksoftirqd/411:55:274
12510995126,2cyclictest0-21swapper/010:33:120
1251099512128,254cyclictest0-21swapper/012:02:170
1251099512128,254cyclictest0-21swapper/012:02:170
1251099512128,254cyclictest0-21swapper/012:02:170
12537995100,507cyclictest0-21swapper/610:45:476
12520995100,84cyclictest10047-21sendmail-mta11:27:162
12538995091,84cyclictest0-21swapper/709:13:357
12536995090,84cyclictest0-21swapper/511:27:165
125279950982,211cyclictest0-21swapper/311:45:243
125279950982,211cyclictest0-21swapper/311:45:243
125109950982,296cyclictest0-21swapper/011:25:170
125159950784,126cyclictest121rcu_preempt08:56:521
125159950784,126cyclictest121rcu_preempt08:56:521
125329950681,295cyclictest0-21swapper/410:12:004
125329950681,295cyclictest0-21swapper/410:11:594
125329950679,211cyclictest0-21swapper/411:26:184
1253299506461,42cyclictest471rcuc/407:24:594
1253799505123,380cyclictest65-21ksoftirqd/611:58:026
125369950578,126cyclictest57-21ksoftirqd/512:13:435
125329950541,384cyclictest0-21swapper/410:34:314
125379950440,42cyclictest121rcu_preempt10:35:326
125369950477,169cyclictest57-21ksoftirqd/509:12:425
1253299504499,3cyclictest481ktimersoftd/412:13:284
1252799504122,338cyclictest0-21swapper/312:15:113
125209950482,217cyclictest0-21swapper/210:59:432
125109950435,92cyclictest0-21swapper/010:48:210
1252799502459,41cyclictest401ktimersoftd/308:57:233
1252799502459,41cyclictest401ktimersoftd/308:57:233
125109950233,211cyclictest0-21swapper/011:54:280
12538995010,376cyclictest0-21swapper/709:22:567
125369949935,84cyclictest0-21swapper/510:44:095
125279949977,127cyclictest5432-21/usr/sbin/munin10:45:233
125369949874,381cyclictest0-21swapper/510:35:345
125279949872,126cyclictest41-21ksoftirqd/309:10:553
1252099498200,126cyclictest121rcu_preempt11:00:142
125389949775,256cyclictest12501-21cyclictest11:53:357
125209949732,384cyclictest0-21swapper/212:24:522
125159949733,2cyclictest0-21swapper/111:43:101
1253899496113,381cyclictest0-21swapper/711:56:327
125369949674,84cyclictest0-21swapper/511:53:055
125209949631,253cyclictest0-21swapper/212:33:022
1253799495112,380cyclictest0-21swapper/611:19:106
125329949430,380cyclictest0-21swapper/410:48:124
125389949371,256cyclictest12501-21cyclictest12:04:537
125389949371,256cyclictest12501-21cyclictest12:04:537
125389949371,256cyclictest12501-21cyclictest12:04:537
125379949324,466cyclictest0-21swapper/609:42:276
125379949265,296cyclictest0-21swapper/609:24:346
125389949064,211cyclictest11306-21ssh10:14:377
125389949064,211cyclictest11306-21ssh10:14:377
125329949064,211cyclictest49-21ksoftirqd/410:04:054
1253899489148,127cyclictest121rcu_preempt11:14:247
1253899489148,127cyclictest121rcu_preempt11:14:247
125159948922,169cyclictest25-21ksoftirqd/109:40:201
125389948823,210cyclictest0-21swapper/710:57:177
125369948867,84cyclictest0-21swapper/510:57:085
1253299488405,3cyclictest481ktimersoftd/411:44:194
125159948621,7cyclictest0-21swapper/111:16:031
125329948416,41cyclictest0-21swapper/409:15:044
125279948419,219cyclictest0-21swapper/311:54:143
125379948318,213cyclictest8795-1kworker/u17:111:14:116
125379948318,213cyclictest8795-1kworker/u17:111:14:116
125329948356,211cyclictest49-21ksoftirqd/409:12:354
1252099483143,338cyclictest2816-1kworker/u17:011:24:002
125159948121,164cyclictest0-21swapper/111:54:551
1253899479223,254cyclictest27812-21kworker/u16:212:25:207
125379947910,85cyclictest0-21swapper/610:44:586
125369947995,381cyclictest0-21swapper/509:24:055
125279947956,219cyclictest0-21swapper/311:58:193
125109947910,296cyclictest0-21swapper/012:25:200
125369947855,211cyclictest0-21swapper/511:57:255
12532994789,210cyclictest0-21swapper/412:24:524
125329947814,215cyclictest12667-21cstates08:55:154
125329947814,215cyclictest12667-21cstates08:55:144
125109947714,173cyclictest0-21swapper/012:13:400
125209947612,298cyclictest11759-21turbostat.cron08:55:012
125159947610,84cyclictest0-21swapper/112:25:211
125109947592,210cyclictest0-21swapper/009:38:450
1251099474141,122cyclictest121rcu_preempt11:00:140
12527994727,7cyclictest0-21swapper/312:05:193
1252799471129,126cyclictest41-21ksoftirqd/309:38:553
12510994710,84cyclictest0-21swapper/010:43:010
125279947046,169cyclictest0-21swapper/310:02:273
12520994672,256cyclictest0-21swapper/209:40:582
1251599467168,126cyclictest20729-21diskmemload10:48:131
12510994670,84cyclictest12501-21cyclictest07:22:050
1253899466125,338cyclictest2673-21kworker/u16:110:46:507
1253899466125,338cyclictest0-21swapper/710:03:097
1253899466124,339cyclictest0-21swapper/708:55:017
1252799466125,338cyclictest0-21swapper/311:12:593
1252799466125,338cyclictest0-21swapper/311:12:583
1253899465124,338cyclictest0-21swapper/710:33:557
12537994653,459cyclictest0-21swapper/610:56:546
125159946581,254cyclictest1060-21timerandwakeup11:20:301
1251099465124,338cyclictest0-21swapper/008:55:000
125379946439,422cyclictest0-21swapper/611:25:306
12520994640,84cyclictest0-21swapper/211:53:492
12510994640,2cyclictest0-21swapper/011:43:200
125379946380,380cyclictest0-21swapper/612:25:186
125159946379,211cyclictest25-21ksoftirqd/110:04:111
125159946340,3cyclictest0-21swapper/108:53:481
1251099463124,337cyclictest0-21swapper/011:13:410
1251099463124,337cyclictest0-21swapper/011:13:400
1253899462120,339cyclictest11820-21sh09:39:207
125329946239,339cyclictest26258-21ssh10:58:244
125209946278,211cyclictest33-21ksoftirqd/211:45:252
125209946278,211cyclictest33-21ksoftirqd/211:45:252
125159946241,2cyclictest0-21swapper/109:13:441
125159946240,2cyclictest0-21swapper/111:00:061
125109946240,3cyclictest0-21swapper/012:35:190
125209946139,256cyclictest0-21swapper/212:13:272
125209946138,214cyclictest0-21swapper/210:03:512
125109946178,168cyclictest0-21swapper/008:55:150
125109946178,168cyclictest0-21swapper/008:55:150
1253899460119,338cyclictest0-21swapper/710:44:457
125279946080,296cyclictest0-21swapper/311:23:043
125209946038,256cyclictest0-21swapper/211:13:302
125209946038,256cyclictest0-21swapper/211:13:292
125209946038,256cyclictest0-21swapper/209:21:412
1252099460118,127cyclictest33-21ksoftirqd/210:50:112
125109946080,177cyclictest2673-21kworker/u16:110:57:570
1253899459415,42cyclictest711rcuc/708:57:377
1253899459415,42cyclictest711rcuc/708:57:377
125379945979,84cyclictest0-21swapper/610:32:096
1251099459161,83cyclictest121rcu_preempt10:14:120
1251099459161,83cyclictest121rcu_preempt10:14:110
1252799458116,339cyclictest0-21swapper/311:00:143
1253899457116,338cyclictest0-21swapper/712:05:307
1252799457156,169cyclictest0-21swapper/310:35:323
125209945735,338cyclictest0-21swapper/210:48:502
125159945634,2cyclictest0-21swapper/112:13:281
125109945635,83cyclictest0-21swapper/012:05:300
1253799455115,338cyclictest0-21swapper/610:04:006
1252799455114,338cyclictest0-21swapper/311:43:513
1252799455109,172cyclictest0-21swapper/309:25:053
125369945432,256cyclictest0-21swapper/512:04:545
125369945432,256cyclictest0-21swapper/512:04:545
125369945432,256cyclictest0-21swapper/512:04:545
125159945433,2cyclictest0-21swapper/112:24:381
125109945432,2cyclictest0-21swapper/011:17:470
125329945372,84cyclictest121rcu_preempt12:05:064
125329945332,41cyclictest0-21swapper/409:38:214
125329945175,246cyclictest12501-21cyclictest09:25:104
1251599451109,340cyclictest0-21swapper/111:30:081
125379945068,84cyclictest0-21swapper/607:23:286
125379944869,83cyclictest0-21swapper/610:12:006
125379944869,83cyclictest0-21swapper/610:11:596
1251599448107,338cyclictest0-21swapper/110:15:101
125389944724,3cyclictest0-21swapper/709:43:277
1253799447105,339cyclictest32633-1kworker/u17:109:38:296
1251599447147,126cyclictest0-21swapper/112:32:541
125109944721,253cyclictest0-21swapper/009:15:060
125389944625,42cyclictest0-21swapper/711:30:177
125369944666,84cyclictest0-21swapper/511:15:055
1253899445193,85cyclictest18437-21apt-get10:35:127
125159944561,338cyclictest0-21swapper/111:14:461
125159944561,338cyclictest0-21swapper/111:14:461
125279944358,212cyclictest0-21swapper/310:56:363
125379944216,211cyclictest0-21swapper/612:15:116
125369944220,256cyclictest0-21swapper/510:13:345
125369944220,256cyclictest0-21swapper/510:13:335
1252799442185,126cyclictest41-21ksoftirqd/309:45:163
125209944266,373cyclictest0-21swapper/211:30:082
125329944115,253cyclictest0-21swapper/412:35:074
125209944018,255cyclictest0-21swapper/207:24:462
125109943913,253cyclictest0-21swapper/011:30:280
1253899438100,171cyclictest0-21swapper/712:13:287
125369943853,211cyclictest57-21ksoftirqd/507:22:475
125379943797,338cyclictest0-21swapper/611:00:146
125159943756,127cyclictest121rcu_preempt12:05:121
12520994346,3cyclictest0-21swapper/208:55:192
12520994346,3cyclictest0-21swapper/208:55:182
12538994328,169cyclictest0-21swapper/707:24:157
12536994296,256cyclictest0-21swapper/510:34:055
125369942948,84cyclictest0-21swapper/511:44:325
12527994295,3cyclictest0-21swapper/307:25:113
12538994286,3cyclictest0-21swapper/707:25:127
12520994286,84cyclictest0-21swapper/209:25:012
12515994285,126cyclictest26612-21apt-get12:15:101
12510994284,42cyclictest0-21swapper/010:04:540
125379942784,169cyclictest65-21ksoftirqd/612:35:186
12537994264,2cyclictest0-21swapper/612:05:136
125329942545,296cyclictest64450irq/122-eth008:53:384
12515994250,84cyclictest0-21swapper/107:22:051
125389942487,89cyclictest26625-21dpkg12:15:137
12536994243,2cyclictest0-21swapper/507:25:125
12510994240,50cyclictest0-21swapper/009:45:050
125379942347,373cyclictest0-21swapper/612:14:086
125329942383,338cyclictest20729-21diskmemload11:00:214
125329942383,338cyclictest0-21swapper/410:35:314
125159942381,169cyclictest25-21ksoftirqd/109:45:101
12510994231,2cyclictest0-21swapper/007:25:110
125369942283,84cyclictest0-21swapper/510:02:105
12527994222,332cyclictest0-21swapper/309:15:113
125109942280,211cyclictest0-21swapper/010:05:120
1253799421164,126cyclictest131rcu_sched11:43:006
125369942182,84cyclictest0-21swapper/509:15:045
125209942183,335cyclictest0-21swapper/207:25:192
125109942182,84cyclictest0-21swapper/012:15:270
125379942081,84cyclictest0-21swapper/609:25:086
1253799420164,126cyclictest121rcu_preempt09:45:106
125369942081,84cyclictest0-21swapper/511:30:065
125369942081,84cyclictest0-21swapper/509:45:115
125369942036,211cyclictest57-21ksoftirqd/511:12:595
125369942036,211cyclictest57-21ksoftirqd/511:12:595
125369941980,84cyclictest0-21swapper/511:45:085
125369941980,84cyclictest0-21swapper/511:45:085
125369941879,84cyclictest0-21swapper/509:25:095
125279941879,84cyclictest0-21swapper/312:35:073
125209941778,337cyclictest0-21swapper/212:15:202
125209941737,254cyclictest0-21swapper/209:39:372
125209941736,214cyclictest0-21swapper/212:05:182
125389941675,84cyclictest0-21swapper/709:15:057
125329941675,338cyclictest0-21swapper/410:15:114
125279941677,84cyclictest0-21swapper/308:54:103
125209941675,338cyclictest0-21swapper/209:15:052
125379941536,375cyclictest26336-21ssh10:05:136
125329941574,338cyclictest0-21swapper/412:25:164
125279941535,256cyclictest0-21swapper/307:23:273
125109941534,85cyclictest0-21swapper/011:45:260
125109941534,85cyclictest0-21swapper/011:45:250
125209941474,338cyclictest0-21swapper/212:25:172
125159941434,2cyclictest0-21swapper/112:35:201
125379941374,84cyclictest0-21swapper/611:45:256
125379941374,84cyclictest0-21swapper/611:45:256
125329941372,338cyclictest0-21swapper/410:05:134
125389941273,84cyclictest0-21swapper/709:45:117
125209941271,338cyclictest0-21swapper/210:15:112
125159941233,2cyclictest11793-21timerandwakeup11:45:241
125159941233,2cyclictest11793-21timerandwakeup11:45:241
125379941172,84cyclictest0-21swapper/610:50:046
125379941128,84cyclictest0-21swapper/610:15:106
125279941168,169cyclictest0-21swapper/310:50:083
125159941170,168cyclictest25-21ksoftirqd/109:15:121
125369941067,169cyclictest57-21ksoftirqd/511:00:265
125209940767,338cyclictest0-21swapper/209:45:112
125329940627,296cyclictest0-21swapper/410:50:034
125369940567,84cyclictest0-21swapper/512:35:145
125369940566,84cyclictest0-21swapper/512:25:175
125379940465,84cyclictest0-21swapper/608:52:516
1251099404104,168cyclictest0-21swapper/010:50:040
125389940319,42cyclictest0-21swapper/710:15:117
125369940324,2cyclictest0-21swapper/508:51:525
125379940223,3cyclictest22375-21apt07:25:126
125159940221,3cyclictest0-21swapper/109:25:031
125109940222,84cyclictest0-21swapper/009:25:090
125279939859,84cyclictest0-21swapper/312:25:173
125389939758,84cyclictest0-21swapper/711:45:237
125389939758,84cyclictest0-21swapper/711:45:237
1253699397141,253cyclictest24616-21nscd12:15:195
125379939657,84cyclictest0-21swapper/609:15:056
125329939516,295cyclictest0-21swapper/411:45:134
125329939516,295cyclictest0-21swapper/411:45:134
125159939213,255cyclictest0-21swapper/107:25:201
125159938587,126cyclictest25-21ksoftirqd/110:50:111
1253899380124,253cyclictest15850irq/123-ahci[0010:05:107
125369938082,85cyclictest0-21swapper/512:05:105
12527993805,293cyclictest0-21swapper/310:05:103
125389937940,84cyclictest0-21swapper/712:35:067
125379937737,337cyclictest0-21swapper/611:30:076
125209937638,171cyclictest30720-21memory12:35:202
1253899375164,43cyclictest0-21swapper/711:00:057
125369937478,84cyclictest0-21swapper/510:15:085
125369937031,42cyclictest121rcu_preempt10:05:175
125159936930,84cyclictest0-21swapper/110:05:181
125209936829,84cyclictest0-21swapper/210:05:182
125389936426,84cyclictest0-21swapper/710:50:057
125109935960,210cyclictest0-21swapper/010:15:100
125329935816,211cyclictest49-21ksoftirqd/407:25:184
125369935557,84cyclictest0-21swapper/510:50:075
125279935354,168cyclictest121rcu_preempt10:15:123
1253899311100,129cyclictest0-21swapper/709:25:037
1191029249,27sleep10-21swapper/107:07:181
1200729164,24sleep40-21swapper/407:08:404
1197929051,35sleep30-21swapper/307:08:153
1180728857,28sleep20-21swapper/207:05:502
950128353,27sleep50-21swapper/507:05:055
1187728353,27sleep70-21swapper/707:06:517
1203828251,27sleep60-21swapper/607:09:076
1200327948,27sleep00-21swapper/007:08:370
33032620,0sleep40-21swapper/409:52:374
42862290,1sleep30-21swapper/310:26:263
12538992810,18cyclictest0-21swapper/708:07:587
12538992810,18cyclictest0-21swapper/708:00:027
12538992810,18cyclictest0-21swapper/708:00:017
12538992810,18cyclictest0-21swapper/707:13:417
12537992826,1cyclictest0-21swapper/608:17:246
12537992810,17cyclictest0-21swapper/607:43:156
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional