You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 01:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Jul 27, 2026 12:56:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269999973454,84cyclictest0-21swapper/509:56:365
269959969922,211cyclictest0-21swapper/112:40:341
269989969123,506cyclictest0-21swapper/411:41:304
2699499681339,126cyclictest0-21swapper/009:32:180
26996996780,84cyclictest0-21swapper/210:30:182
2699599677170,126cyclictest121rcu_preempt09:20:101
2699799672202,296cyclictest0-21swapper/312:34:413
2699999670118,381cyclictest0-21swapper/510:18:365
270019966872,465cyclictest0-21swapper/710:40:287
269969966328,126cyclictest0-21swapper/209:33:282
269949966270,126cyclictest121rcu_preempt09:56:260
2699599661108,380cyclictest0-21swapper/109:44:211
269949964815,2cyclictest0-21swapper/012:16:320
269989964693,295cyclictest0-21swapper/411:29:014
26995996449,126cyclictest121rcu_preempt10:39:341
2700099637337,84cyclictest0-21swapper/609:30:256
2699999634123,295cyclictest0-21swapper/511:52:015
2699799631120,296cyclictest0-21swapper/311:16:153
269959963076,127cyclictest0-21swapper/111:43:111
269999962730,465cyclictest0-21swapper/509:41:445
2699999627117,380cyclictest0-21swapper/509:33:295
269969962731,84cyclictest0-21swapper/211:52:352
269959962774,380cyclictest0-21swapper/111:24:441
2699599627286,126cyclictest0-21swapper/111:09:231
269949962534,83cyclictest0-21swapper/011:11:120
2699899623283,337cyclictest64450irq/122-eth010:58:484
2699699621195,296cyclictest2461-21kworker/u16:012:05:152
2699799619110,84cyclictest0-21swapper/309:30:293
2699499617190,296cyclictest0-21swapper/010:40:110
269969961663,296cyclictest0-21swapper/210:59:592
269999961520,592cyclictest0-21swapper/509:45:185
269969961519,42cyclictest0-21swapper/209:55:042
269999961318,127cyclictest0-21swapper/510:35:115
269999961262,464cyclictest0-21swapper/510:08:565
269949961097,295cyclictest0-21swapper/011:41:250
269949961016,84cyclictest0-21swapper/010:35:080
2699599608101,126cyclictest724-21nscd10:40:341
269969960795,296cyclictest0-21swapper/211:37:142
2699799606180,296cyclictest0-21swapper/309:56:173
269989960312,126cyclictest1651-21ntpd12:05:344
26996996037,42cyclictest0-21swapper/208:58:592
26994996029,126cyclictest0-21swapper/008:33:170
26996995986,384cyclictest0-21swapper/212:33:542
26995995986,3cyclictest0-21swapper/112:33:541
27001995954,383cyclictest0-21swapper/712:33:557
27000995950,85cyclictest0-21swapper/611:38:296
26997995950,84cyclictest0-21swapper/311:38:293
26999995940,126cyclictest22294-21cstates11:10:135
26998995940,84cyclictest0-21swapper/410:30:174
26998995930,84cyclictest0-21swapper/411:38:294
2699799593123,338cyclictest2740-21diskmemload10:47:563
269979959286,295cyclictest0-21swapper/309:15:223
2699899591124,127cyclictest0-21swapper/410:18:424
269969959040,297cyclictest0-21swapper/211:24:552
2699699590124,126cyclictest0-21swapper/210:39:542
2699799587288,126cyclictest0-21swapper/309:42:193
269999958431,508cyclictest0-21swapper/508:56:475
2699899584118,126cyclictest0-21swapper/409:43:414
269949958473,296cyclictest0-21swapper/008:10:490
269949958435,8cyclictest0-21swapper/008:05:360
269949958334,126cyclictest0-21swapper/010:19:060
269969958228,382cyclictest0-21swapper/211:30:272
269989958032,84cyclictest0-21swapper/411:08:014
2699499580112,126cyclictest30814-21ssh09:42:570
269999957930,381cyclictest26992-21cyclictest11:30:045
269989957971,126cyclictest0-21swapper/408:31:114
269999957522,550cyclictest0-21swapper/509:20:135
269999957419,508cyclictest0-21swapper/510:58:495
269989957424,42cyclictest0-21swapper/409:30:254
269969957424,127cyclictest0-21swapper/209:40:592
2699599574103,296cyclictest0-21swapper/109:58:591
270019957362,296cyclictest0-21swapper/711:25:027
270009957362,338cyclictest0-21swapper/611:16:016
270009957361,296cyclictest0-21swapper/610:53:596
269989957320,211cyclictest2740-21diskmemload10:05:324
2699699573104,295cyclictest0-21swapper/211:00:282
2700199572146,210cyclictest0-21swapper/710:49:417
269999957219,549cyclictest9143-21/usr/sbin/munin11:20:265
269969957264,126cyclictest0-21swapper/210:09:542
269959957220,422cyclictest0-21swapper/109:31:251
2699499570144,215cyclictest121rcu_preempt11:07:220
269979956918,126cyclictest0-21swapper/310:08:523
269949956919,126cyclictest0-21swapper/011:15:490
2699499569185,253cyclictest0-21swapper/009:15:410
269969956818,339cyclictest0-21swapper/207:15:532
2699499567268,126cyclictest0-21swapper/012:44:560
270019956654,296cyclictest0-21swapper/709:33:487
270019956614,126cyclictest0-21swapper/711:57:017
269969956655,296cyclictest0-21swapper/210:49:322
269969956616,296cyclictest0-21swapper/211:09:582
2700199565138,296cyclictest0-21swapper/709:03:397
269949956515,126cyclictest0-21swapper/010:59:510
269959956411,342cyclictest0-21swapper/112:04:291
269979956312,48cyclictest0-21swapper/310:52:043
26999995619,549cyclictest0-21swapper/510:52:255
269969956150,296cyclictest0-21swapper/210:19:282
269959956114,124cyclictest0-21swapper/110:30:271
269979956091,296cyclictest0-21swapper/310:40:083
270009955847,295cyclictest0-21swapper/612:04:596
26999995585,467cyclictest0-21swapper/511:30:265
2699899556130,126cyclictest0-21swapper/411:10:534
269999955586,339cyclictest121rcu_preempt10:47:355
2699599555129,211cyclictest0-21swapper/110:08:531
26995995523,84cyclictest10810-1kworker/u17:112:21:361
26994995523,295cyclictest0-21swapper/010:50:480
26996995511,2cyclictest0-21swapper/212:16:332
27001995501,2cyclictest0-21swapper/712:16:327
269999954880,295cyclictest0-21swapper/512:16:105
269999954838,507cyclictest0-21swapper/510:30:245
269999954835,465cyclictest0-21swapper/507:19:215
2699799548124,126cyclictest9517-21sensors11:20:343
269999954736,381cyclictest0-21swapper/512:27:105
2699799547121,126cyclictest41-21ksoftirqd/310:55:243
2699999545120,422cyclictest6490-21ssh11:56:175
269999954431,510cyclictest0-21swapper/511:40:555
2699699544118,295cyclictest0-21swapper/211:19:552
269999954374,380cyclictest0-21swapper/511:16:085
269969954335,126cyclictest0-21swapper/210:30:012
269959954337,126cyclictest0-21swapper/108:10:581
2699499543206,84cyclictest3989-21kworker/u16:311:24:360
2699899542245,127cyclictest0-21swapper/409:56:234
2699799542115,297cyclictest0-21swapper/310:19:563
269959954230,127cyclictest7243-21ssh11:56:511
2699699541284,126cyclictest0-21swapper/208:31:202
2699599541114,211cyclictest25-21ksoftirqd/111:00:001
270019954031,127cyclictest26283-21sshd10:53:387
270019954029,508cyclictest0-21swapper/711:29:487
269969954032,169cyclictest0-21swapper/212:27:172
270019953971,210cyclictest0-21swapper/709:42:227
2699899539453,84cyclictest49-21ksoftirqd/412:17:154
270019953826,381cyclictest0-21swapper/711:50:537
269949953830,126cyclictest0-21swapper/010:30:250
269959953729,126cyclictest0-21swapper/111:29:091
269949953728,84cyclictest0-21swapper/010:25:320
269959953669,127cyclictest25-21ksoftirqd/110:19:421
270009953569,126cyclictest0-21swapper/612:40:506
269969953566,296cyclictest0-21swapper/210:53:232
269999953465,211cyclictest57-21ksoftirqd/511:46:245
269999953322,508cyclictest0-21swapper/510:40:095
2699799533491,40cyclictest391rcuc/310:30:273
270009953264,337cyclictest0-21swapper/610:59:446
2699599532105,126cyclictest0-21swapper/111:53:011
270019952960,296cyclictest0-21swapper/708:58:337
269999952961,465cyclictest0-21swapper/511:39:185
269999952919,507cyclictest0-21swapper/508:15:025
2699799529356,84cyclictest0-21swapper/312:04:093
269979952821,2cyclictest10862-21ssh12:16:323
2699699528274,85cyclictest0-21swapper/212:40:352
269989952699,253cyclictest0-21swapper/408:57:264
269959952660,126cyclictest0-21swapper/110:25:031
270019952556,338cyclictest0-21swapper/708:10:387
269959952422,85cyclictest0-21swapper/110:49:061
269949952315,126cyclictest0-21swapper/011:00:280
270009952215,337cyclictest0-21swapper/609:56:466
269979952112,84cyclictest0-21swapper/311:30:353
269969952111,211cyclictest33-21ksoftirqd/210:20:152
269949952152,294cyclictest10985-21taskset12:34:540
269999952052,338cyclictest17101-21dump-pmu-power10:30:005
26995995208,381cyclictest0-21swapper/111:46:381
270009951993,295cyclictest27305-21chrt08:55:346
270009951912,295cyclictest0-21swapper/609:44:246
26999995188,507cyclictest0-21swapper/511:09:345
26999995188,127cyclictest20819-21ssh12:05:165
270009951751,126cyclictest121rcu_preempt10:09:306
2699699517260,126cyclictest0-21swapper/212:04:512
269969951710,296cyclictest0-21swapper/211:58:032
26999995161,380cyclictest0-21swapper/509:03:355
26996995168,90cyclictest0-21swapper/210:40:382
27001995153,296cyclictest0-21swapper/711:31:147
26997995156,126cyclictest0-21swapper/311:09:213
2699499515134,126cyclictest121rcu_preempt12:05:410
26998995147,127cyclictest0-21swapper/411:20:254
26994995145,84cyclictest0-21swapper/010:20:140
26994995143,84cyclictest0-21swapper/011:29:380
2699599512128,126cyclictest121rcu_preempt08:32:461
269989951184,85cyclictest121rcu_preempt08:11:034
27000995102,8cyclictest121rcu_preempt08:11:516
269979951039,253cyclictest0-21swapper/308:34:273
26996995101,126cyclictest0-21swapper/211:29:012
2700199509124,254cyclictest0-21swapper/711:37:567
270009950986,257cyclictest2740-21diskmemload11:42:046
269999950940,296cyclictest0-21swapper/512:12:335
26999995081,383cyclictest0-21swapper/512:33:545
26997995080,84cyclictest0-21swapper/311:10:133
27000995071,295cyclictest0-21swapper/610:48:106
26995995071,2cyclictest0-21swapper/112:16:321
26994995071,253cyclictest0-21swapper/009:45:190
2700099506165,126cyclictest121rcu_preempt10:20:306
269979950683,338cyclictest0-21swapper/312:41:243
2699499506210,126cyclictest121rcu_preempt11:38:230
2699699505121,126cyclictest698-21ptp4l11:10:442
269989950478,253cyclictest0-21swapper/411:52:264
270019950380,85cyclictest121rcu_preempt11:40:297
269999950334,466cyclictest0-21swapper/509:35:105
2699599503248,253cyclictest241ktimersoftd/111:00:291
2700199502163,84cyclictest29512-21sh10:55:207
270019950175,423cyclictest0-21swapper/711:06:537
2700199501164,125cyclictest121rcu_preempt12:05:277
270009950134,42cyclictest121rcu_preempt10:40:126
269999950175,211cyclictest0-21swapper/511:01:175
270019949973,423cyclictest24571-21ssh11:10:497
270009949976,253cyclictest0-21swapper/612:05:346
269989949975,84cyclictest121rcu_preempt10:52:264
269989949934,380cyclictest0-21swapper/410:39:344
269959949930,126cyclictest0-21swapper/110:20:111
270009949876,84cyclictest121rcu_preempt10:30:116
270009949829,254cyclictest0-21swapper/611:10:236
269999949834,2cyclictest0-21swapper/512:41:235
269999949834,172cyclictest0-21swapper/512:04:025
269959949872,211cyclictest0-21swapper/111:38:071
270009949777,82cyclictest0-21swapper/611:56:416
2699999497117,84cyclictest0-21swapper/509:25:145
2699899497114,216cyclictest49-21ksoftirqd/410:49:234
269989949670,211cyclictest0-21swapper/412:33:474
269949949628,295cyclictest0-21swapper/008:56:490
2699799495196,296cyclictest30531-1kworker/u17:111:41:203
269959949570,295cyclictest0-21swapper/110:53:181
270019949467,211cyclictest0-21swapper/712:04:387
270009949468,295cyclictest0-21swapper/608:34:086
269999949325,126cyclictest0-21swapper/508:31:205
269989949327,50cyclictest0-21swapper/410:41:294
2699599493150,126cyclictest121rcu_preempt08:56:491
269949949328,85cyclictest0-21swapper/010:09:370
269989949064,84cyclictest0-21swapper/412:40:044
269989949025,125cyclictest121rcu_preempt10:10:144
269959949024,127cyclictest6947-21sh11:19:551
269969948925,84cyclictest0-21swapper/211:42:112
269949948967,211cyclictest26992-21cyclictest12:35:010
269999948819,465cyclictest7684-21ssh09:11:355
269989948723,126cyclictest121rcu_preempt11:30:484
2699899487148,84cyclictest2461-21kworker/u16:012:35:464
269979948759,296cyclictest0-21swapper/308:59:123
269949948759,211cyclictest0-21swapper/011:56:380
270019948622,297cyclictest0-21swapper/709:35:147
2699899486232,86cyclictest0-21swapper/412:22:064
269959948621,296cyclictest0-21swapper/111:31:221
269999948517,337cyclictest13690-21/usr/sbin/munin10:10:235
270009948420,46cyclictest0-21swapper/609:49:336
269979948415,296cyclictest0-21swapper/310:35:263
2699699484103,84cyclictest0-21swapper/211:46:062
269979948398,127cyclictest41-21ksoftirqd/308:14:553
269969948260,256cyclictest22722-21sh09:20:022
269969948116,84cyclictest0-21swapper/208:12:192
2699599481312,41cyclictest0-21swapper/112:27:111
269949948113,295cyclictest0-21swapper/009:20:030
270019948011,41cyclictest0-21swapper/709:55:287
269999948012,296cyclictest0-21swapper/512:21:495
269969948015,42cyclictest0-21swapper/212:21:502
269979947994,211cyclictest0-21swapper/311:57:243
2699799479221,127cyclictest0-21swapper/311:29:233
269969947913,126cyclictest0-21swapper/209:15:362
2699699478221,254cyclictest13504-21grep09:50:232
269949947852,295cyclictest0-21swapper/010:47:280
27001994778,41cyclictest0-21swapper/711:20:027
27001994767,296cyclictest0-21swapper/708:34:377
270019947610,126cyclictest0-21swapper/710:15:247
269949947612,84cyclictest0-21swapper/012:04:030
269949947612,84cyclictest0-21swapper/011:30:260
269969947410,84cyclictest0-21swapper/208:15:132
27001994726,211cyclictest0-21swapper/711:00:297
26998994728,253cyclictest0-21swapper/411:56:404
2699799472342,84cyclictest0-21swapper/312:21:363
26994994717,213cyclictest0-21swapper/012:12:520
26994994700,86cyclictest814-21ssh11:54:000
269989946984,296cyclictest22068-21kworker/u16:111:00:294
269989946845,211cyclictest0-21swapper/411:16:324
269979946883,211cyclictest41-21ksoftirqd/312:05:233
270019946786,126cyclictest73-21ksoftirqd/710:09:547
2699599465124,338cyclictest0-21swapper/110:10:161
269949946582,380cyclictest0-21swapper/009:50:230
2699899464123,339cyclictest26992-21cyclictest10:29:364
269979946440,84cyclictest121rcu_preempt09:11:343
269969946438,296cyclictest121rcu_preempt10:14:472
2699599463123,337cyclictest0-21swapper/109:15:431
2699599462121,338cyclictest0-21swapper/108:35:131
270019946036,84cyclictest121rcu_preempt12:40:087
269999946034,295cyclictest0-21swapper/508:51:385
2699899460161,126cyclictest0-21swapper/409:15:334
2699599460120,338cyclictest0-21swapper/111:10:191
270009945977,126cyclictest15595-21if_eth008:35:196
2700099459116,127cyclictest65-21ksoftirqd/610:25:336
269999945937,210cyclictest0-21swapper/508:37:535
269999945933,423cyclictest0-21swapper/510:20:285
269979945933,296cyclictest32564-21smartctl10:20:203
269969945835,256cyclictest0-21swapper/209:49:272
2699699458116,339cyclictest0-21swapper/209:35:092
269999945735,419cyclictest0-21swapper/508:22:285
269979945773,84cyclictest121rcu_preempt10:29:463
270019945672,211cyclictest2414-21ssh10:39:387
270019945634,2cyclictest0-21swapper/709:15:317
269989945531,85cyclictest0-21swapper/412:04:294
269979945534,2cyclictest0-21swapper/309:49:273
269979945427,84cyclictest0-21swapper/311:00:383
270009945331,50cyclictest0-21swapper/609:15:156
269989945368,211cyclictest49-21ksoftirqd/409:00:054
2699899453155,295cyclictest64450irq/122-eth012:12:134
270019945225,253cyclictest0-21swapper/712:12:507
2700099452110,211cyclictest25910-21runrttasks10:15:266
269999945234,415cyclictest13476-21grep09:50:225
269999945225,339cyclictest0-21swapper/508:05:175
269979945230,253cyclictest0-21swapper/311:51:393
269969945272,296cyclictest0-21swapper/212:13:152
269959945272,126cyclictest0-21swapper/112:36:081
2699599452322,43cyclictest0-21swapper/107:15:381
269949945230,256cyclictest0-21swapper/010:10:030
270019945128,256cyclictest0-21swapper/709:20:027
270009945170,126cyclictest121rcu_preempt11:52:016
2700199450109,338cyclictest0-21swapper/710:25:027
269999945025,126cyclictest0-21swapper/512:35:025
269979945028,2cyclictest0-21swapper/308:22:313
269949944923,296cyclictest0-21swapper/007:57:210
270009944864,169cyclictest0-21swapper/611:46:226
269999944826,256cyclictest15945-21runrttasks09:15:405
269969944826,84cyclictest0-21swapper/212:35:032
270009944724,3cyclictest0-21swapper/611:29:106
269979944724,176cyclictest0-21swapper/309:20:123
269969944722,126cyclictest0-21swapper/209:03:282
2699599447107,338cyclictest0-21swapper/109:03:391
270019944665,126cyclictest18884-21irqstats10:30:247
2700099446108,171cyclictest0-21swapper/611:31:206
269979944623,219cyclictest28995-21sh10:00:173
2699599446104,295cyclictest121rcu_preempt12:13:141
270009944565,84cyclictest0-21swapper/612:12:506
269949944565,295cyclictest0-21swapper/009:25:130
270009944418,296cyclictest698-21ptp4l11:09:386
2700099443105,206cyclictest31742-21nscd10:10:146
269979944362,126cyclictest121rcu_preempt12:13:173
2699799441357,81cyclictest401ktimersoftd/310:15:003
269969944118,256cyclictest0-21swapper/208:05:272
2699599441100,127cyclictest0-21swapper/109:45:081
269959943918,84cyclictest0-21swapper/112:05:161
270019943859,296cyclictest0-21swapper/709:50:227
270009943816,256cyclictest0-21swapper/608:06:156
269989943713,84cyclictest13483-21sed09:50:224
269949943611,84cyclictest22165-21ssh09:38:070
269989943555,123cyclictest121rcu_preempt10:20:104
269959943511,84cyclictest28899-21gltestperf10:00:171
269949943556,83cyclictest987-21taskset07:19:200
269949943491,254cyclictest0-21swapper/007:28:510
269949943411,84cyclictest0-21swapper/012:27:100
270009943249,253cyclictest0-21swapper/612:17:006
269949943111,126cyclictest21522-21sh11:46:140
270019943046,295cyclictest0-21swapper/712:36:087
26998994307,262cyclictest0-21swapper/409:45:184
27001994271,41cyclictest0-21swapper/710:14:477
26994994277,84cyclictest0-21swapper/012:22:060
26997994253,298cyclictest0-21swapper/309:00:123
26997994241,3cyclictest0-21swapper/311:46:243
269949942483,338cyclictest0-21swapper/008:35:130
27000994231,2cyclictest0-21swapper/611:01:236
26998994231,42cyclictest0-21swapper/411:46:344
269969942383,338cyclictest0-21swapper/208:35:182
270019942238,126cyclictest73-21ksoftirqd/710:20:107
270009942283,84cyclictest0-21swapper/611:20:106
270009942283,83cyclictest0-21swapper/610:35:336
269989942283,84cyclictest0-21swapper/408:05:144
269979942281,211cyclictest13464-21ssh09:50:223
270009942183,84cyclictest0-21swapper/612:35:476
269969942080,338cyclictest0-21swapper/208:22:222
270019941877,338cyclictest0-21swapper/707:15:437
270009941879,84cyclictest0-21swapper/612:22:106
270019941779,84cyclictest0-21swapper/709:49:427
270009941634,126cyclictest0-21swapper/610:00:186
269989941635,126cyclictest0-21swapper/410:00:184
269949941632,211cyclictest0-21swapper/010:00:180
270019941575,338cyclictest0-21swapper/708:05:217
269989941576,84cyclictest0-21swapper/408:22:224
269949941575,338cyclictest0-21swapper/008:22:220
270019941373,338cyclictest0-21swapper/712:22:097
269949941334,218cyclictest0-21swapper/009:03:290
270009941230,84cyclictest0-21swapper/607:28:516
269979941271,338cyclictest0-21swapper/307:19:413
270009941173,83cyclictest0-21swapper/609:20:036
2699899411111,127cyclictest0-21swapper/407:15:484
269989941033,43cyclictest0-21swapper/409:25:134
269989941030,84cyclictest0-21swapper/409:35:084
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional