You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 15:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Sep 15, 2026 12:54:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6408997210,42cyclictest0-21swapper/010:45:560
6408997200,84cyclictest8408-21chrt10:56:160
64089971233,126cyclictest26815-21ssh09:15:590
64089969962,634cyclictest0-21swapper/009:21:020
641299676208,338cyclictest0-21swapper/412:23:284
641599651607,42cyclictest711rcuc/710:28:477
641099647309,126cyclictest0-21swapper/212:14:252
64089964752,592cyclictest0-21swapper/011:10:170
64089964189,84cyclictest17003-21seq10:06:140
641499638168,211cyclictest121rcu_preempt08:46:556
6409996360,84cyclictest0-21swapper/111:23:411
6414996350,84cyclictest0-21swapper/609:58:416
6410996350,84cyclictest0-21swapper/209:58:412
64159963033,381cyclictest0-21swapper/708:48:067
64089963035,127cyclictest14412-21diskmemload11:49:530
64119962974,381cyclictest0-21swapper/309:15:153
64109962532,254cyclictest0-21swapper/210:59:052
64139962474,126cyclictest0-21swapper/512:12:285
64089962370,338cyclictest0-21swapper/008:18:540
64089962370,338cyclictest0-21swapper/008:18:530
641199622281,339cyclictest4026-21kworker/u16:011:50:503
64129962125,465cyclictest0-21swapper/410:54:244
64129962125,465cyclictest0-21swapper/410:54:234
64119961725,508cyclictest0-21swapper/307:52:353
64089961722,592cyclictest0-21swapper/010:02:540
6408995990,42cyclictest0-21swapper/010:44:050
6408995990,42cyclictest0-21swapper/010:44:040
6411995951,42cyclictest0-21swapper/309:44:413
64159959482,296cyclictest0-21swapper/707:52:587
6415995940,84cyclictest0-21swapper/709:59:577
6415995940,84cyclictest0-21swapper/709:21:137
6411995940,84cyclictest121rcu_preempt11:34:493
6411995940,84cyclictest121rcu_preempt11:34:493
6408995940,42cyclictest0-21swapper/009:42:130
64129959382,338cyclictest121rcu_preempt08:18:364
64129959382,338cyclictest121rcu_preempt08:18:364
641299593124,296cyclictest1551-21snmpd11:23:304
6410995930,84cyclictest0-21swapper/210:46:332
6409995930,84cyclictest0-21swapper/111:59:291
6408995930,41cyclictest0-21swapper/007:43:130
64119958979,338cyclictest0-21swapper/311:59:263
641399587502,82cyclictest551rcuc/510:53:285
641399587502,82cyclictest551rcuc/510:53:285
64149958675,253cyclictest0-21swapper/609:14:256
641399583114,296cyclictest0-21swapper/510:04:495
64109958328,381cyclictest0-21swapper/209:40:372
64089958334,465cyclictest0-21swapper/012:43:370
641299582160,255cyclictest64450irq/122-eth010:31:024
64119958276,422cyclictest0-21swapper/310:28:573
641099580111,254cyclictest0-21swapper/211:50:292
64099958031,84cyclictest0-21swapper/110:30:301
64099957829,84cyclictest0-21swapper/109:35:001
641099576234,168cyclictest0-21swapper/210:40:232
641099576234,168cyclictest0-21swapper/210:40:232
64149957564,295cyclictest0-21swapper/609:45:466
64139957564,380cyclictest0-21swapper/507:50:285
641299575106,253cyclictest121rcu_preempt09:22:364
64099957526,85cyclictest0-21swapper/110:27:441
64089957220,126cyclictest0-21swapper/011:23:420
641299571231,338cyclictest64450irq/122-eth011:41:084
64099957019,127cyclictest0-21swapper/108:18:541
64099957019,127cyclictest0-21swapper/108:18:531
641099568226,126cyclictest24162-21runrttasks12:00:002
64159956755,211cyclictest0-21swapper/709:40:517
64099956210,127cyclictest1551-21snmpd10:01:101
64119956010,127cyclictest0-21swapper/310:05:313
64089955750,84cyclictest0-21swapper/009:47:120
64139955486,337cyclictest0-21swapper/512:08:245
6408995531,41cyclictest0-21swapper/010:39:110
6409995510,84cyclictest0-21swapper/110:09:491
64089955086,126cyclictest1553-21runrttasks11:59:400
6408995500,41cyclictest0-21swapper/012:15:280
6408995500,41cyclictest0-21swapper/011:50:320
641199549292,254cyclictest704-21nscd09:22:103
64149954882,211cyclictest0-21swapper/610:05:216
64089954881,464cyclictest0-21swapper/012:14:110
64139954780,126cyclictest6342-21ssh10:19:165
640999547122,295cyclictest14412-21diskmemload10:46:391
641599546119,126cyclictest73-21ksoftirqd/708:15:397
641599546119,126cyclictest73-21ksoftirqd/708:15:387
64099954638,126cyclictest121rcu_preempt10:19:161
64109954581,295cyclictest0-21swapper/210:10:082
64129954332,42cyclictest0-21swapper/410:16:494
641199543204,336cyclictest5097-1kworker/u17:010:40:533
641199543204,336cyclictest5097-1kworker/u17:010:40:533
64109954375,84cyclictest121rcu_preempt11:24:002
64139954277,211cyclictest0-21swapper/507:42:525
64149954171,211cyclictest0-21swapper/610:59:366
64119954172,211cyclictest0-21swapper/312:23:293
64099954032,84cyclictest0-21swapper/110:59:051
64129953771,126cyclictest0-21swapper/412:13:104
64119953769,169cyclictest9150-21taskset09:25:203
640999537119,334cyclictest0-21swapper/109:58:491
64109953426,84cyclictest0-21swapper/210:53:432
64109953426,84cyclictest0-21swapper/210:53:432
64099953426,126cyclictest0-21swapper/111:50:081
641099533110,211cyclictest0-21swapper/209:13:292
64109953220,339cyclictest0-21swapper/210:25:142
64159953119,340cyclictest0-21swapper/709:33:417
640999531105,211cyclictest0-21swapper/109:25:221
64089953121,507cyclictest0-21swapper/012:23:230
64099952923,126cyclictest0-21swapper/110:10:071
64139952816,338cyclictest0-21swapper/510:30:275
640999528103,210cyclictest0-21swapper/109:17:251
64119952759,465cyclictest0-21swapper/312:14:123
641099527100,384cyclictest0-21swapper/210:03:212
64129952559,85cyclictest121rcu_preempt07:43:054
64089952558,464cyclictest0-21swapper/010:31:540
64089952458,211cyclictest0-21swapper/011:34:480
64089952458,211cyclictest0-21swapper/011:34:480
640899524184,338cyclictest19302-21kworker/u16:012:37:370
64099952317,126cyclictest0-21swapper/110:41:551
64099952317,126cyclictest0-21swapper/110:41:551
64139952253,296cyclictest0-21swapper/510:29:105
641299522182,338cyclictest64450irq/122-eth010:28:534
6412995209,380cyclictest0-21swapper/410:43:084
6412995209,380cyclictest0-21swapper/410:43:074
64139951798,330cyclictest0-21swapper/509:45:405
6408995166,41cyclictest0-21swapper/010:19:160
6408995165,338cyclictest0-21swapper/008:45:430
6410995113,211cyclictest0-21swapper/207:54:092
64089951143,295cyclictest0-21swapper/009:34:500
6415995090,84cyclictest0-21swapper/709:46:527
6415995090,84cyclictest0-21swapper/709:17:137
6415995090,84cyclictest0-21swapper/707:55:177
6414995090,84cyclictest0-21swapper/611:34:496
6414995090,84cyclictest0-21swapper/611:34:496
6413995090,84cyclictest0-21swapper/510:46:335
641099509208,127cyclictest0-21swapper/211:09:442
6409995090,84cyclictest14412-21diskmemload09:21:171
641599508208,92cyclictest73-21ksoftirqd/712:23:227
6414995081,126cyclictest0-21swapper/609:42:146
6413995080,83cyclictest0-21swapper/511:34:495
6413995080,83cyclictest0-21swapper/511:34:495
6412995080,84cyclictest0-21swapper/412:43:004
64089950839,253cyclictest0-21swapper/010:28:490
6412995071,46cyclictest14412-21diskmemload11:58:244
641099506206,127cyclictest0-21swapper/209:15:372
641599505164,338cyclictest15850irq/123-ahci[0012:37:387
640999505422,3cyclictest231rcuc/110:20:081
64149950479,211cyclictest0-21swapper/612:14:346
64109950434,211cyclictest0-21swapper/210:19:152
641599503118,211cyclictest73-21ksoftirqd/710:18:127
641199503123,84cyclictest1651-21ntpd09:58:323
64139950275,296cyclictest0-21swapper/511:23:565
641099501116,126cyclictest0-21swapper/209:46:532
641199500116,126cyclictest121rcu_preempt10:30:203
64109950077,84cyclictest0-21swapper/212:43:432
641099500331,84cyclictest0-21swapper/211:34:192
641099500331,84cyclictest0-21swapper/211:34:192
64099950034,126cyclictest0-21swapper/111:48:391
64119949930,296cyclictest0-21swapper/310:58:303
641399497113,295cyclictest704-21nscd09:44:265
64129949569,210cyclictest49-21ksoftirqd/409:16:014
64119949570,380cyclictest6423-21ssh10:19:233
641199495156,84cyclictest6406-21cyclictest10:03:363
641099495113,127cyclictest17761-21sh10:06:552
64089949568,211cyclictest9-21ksoftirqd/011:40:540
64089949568,211cyclictest0-21swapper/010:54:320
64089949568,211cyclictest0-21swapper/010:54:320
64159949427,127cyclictest0-21swapper/711:59:267
641499494113,126cyclictest20886-21ssh12:15:166
64159949328,126cyclictest0-21swapper/710:03:157
64149949366,380cyclictest0-21swapper/609:15:156
641399493237,253cyclictest561ktimersoftd/509:15:465
64119949365,254cyclictest0-21swapper/310:10:143
64099949125,84cyclictest0-21swapper/111:10:241
64159949023,208cyclictest0-21swapper/710:43:387
64159949023,208cyclictest0-21swapper/710:43:387
64139949062,211cyclictest57-21ksoftirqd/509:20:145
640899489105,296cyclictest0-21swapper/007:50:290
64129948863,209cyclictest0-21swapper/411:48:084
64099948867,256cyclictest1651-21ntpd09:14:121
641299487188,126cyclictest0-21swapper/408:48:224
64089948719,464cyclictest0-21swapper/011:09:410
641499486106,84cyclictest704-21nscd10:29:106
64139948621,126cyclictest1553-21runrttasks09:30:575
640999486101,126cyclictest121rcu_preempt12:43:051
64099948518,127cyclictest8174-21ssh09:42:291
641399483230,84cyclictest5238-21kworker/u16:111:41:155
64139948319,251cyclictest121rcu_preempt12:15:195
64139947999,170cyclictest0-21swapper/510:10:285
64139947913,126cyclictest0-21swapper/509:57:515
64129947995,211cyclictest0-21swapper/409:44:124
64099947914,335cyclictest0-21swapper/112:11:471
6410994788,296cyclictest0-21swapper/211:41:362
64129947752,210cyclictest0-21swapper/409:59:284
6408994776,42cyclictest0-21swapper/010:10:310
64159947613,120cyclictest0-21swapper/710:57:387
6412994743,85cyclictest0-21swapper/410:05:314
64119947491,346cyclictest20866-21ssh09:12:493
6415994737,84cyclictest0-21swapper/709:12:487
64159947351,84cyclictest0-21swapper/710:31:337
640999473131,127cyclictest121rcu_preempt10:53:531
640999473131,127cyclictest121rcu_preempt10:53:531
6414994714,127cyclictest0-21swapper/611:49:376
6409994703,127cyclictest0-21swapper/111:09:441
641399468130,126cyclictest121rcu_preempt09:12:225
6412994671,211cyclictest0-21swapper/411:50:434
64099946740,211cyclictest25-21ksoftirqd/111:19:001
64089946741,423cyclictest0-21swapper/011:19:330
64159946644,84cyclictest0-21swapper/711:21:167
641499466125,338cyclictest0-21swapper/607:50:236
641399466125,338cyclictest0-21swapper/510:10:015
6409994660,84cyclictest0-21swapper/107:52:371
6408994660,42cyclictest0-21swapper/009:59:090
6414994651,2cyclictest0-21swapper/610:31:026
641399465124,338cyclictest0-21swapper/511:50:525
641299465124,338cyclictest22365-21nscd11:00:004
641299465124,338cyclictest0-21swapper/411:34:564
641299465124,338cyclictest0-21swapper/411:34:564
640999465124,338cyclictest0-21swapper/111:34:501
640999465124,338cyclictest0-21swapper/111:34:501
64159946481,209cyclictest73-21ksoftirqd/710:46:567
641299464380,3cyclictest481ktimersoftd/410:20:214
641299464379,3cyclictest481ktimersoftd/409:12:594
641199464123,126cyclictest41-21ksoftirqd/312:43:383
641099464123,338cyclictest0-21swapper/209:21:302
64119946383,295cyclictest0-21swapper/311:21:163
641199463123,338cyclictest6406-21cyclictest12:15:353
64089946337,423cyclictest0-21swapper/009:35:170
641499462121,338cyclictest0-21swapper/608:19:546
641499462121,338cyclictest0-21swapper/608:19:536
64129946237,253cyclictest0-21swapper/409:47:194
641499461119,127cyclictest16047-21sh11:19:016
641399461120,338cyclictest0-21swapper/511:59:545
641199461119,339cyclictest0-21swapper/309:30:433
641099461123,127cyclictest121rcu_preempt08:18:432
641099461123,127cyclictest121rcu_preempt08:18:432
640999461124,126cyclictest18905-21ssh09:49:491
640999461120,338cyclictest0-21swapper/112:15:271
64149946080,84cyclictest0-21swapper/610:43:126
64149946080,84cyclictest0-21swapper/610:43:126
641499460120,127cyclictest21763-21/usr/sbin/munin10:10:266
64119946037,257cyclictest0-21swapper/311:09:413
641499459160,126cyclictest6876-21ssh10:19:546
641099459118,338cyclictest0-21swapper/210:30:212
64099945936,126cyclictest0-21swapper/111:41:171
641599458117,338cyclictest0-21swapper/711:50:077
64149945878,84cyclictest0-21swapper/610:02:016
64129945879,295cyclictest64450irq/122-eth010:03:154
64109945833,211cyclictest20095-21runrttasks12:15:092
641099458117,338cyclictest0-21swapper/209:32:462
640999458117,126cyclictest0-21swapper/112:23:101
641399457116,338cyclictest0-21swapper/511:49:075
64109945778,84cyclictest0-21swapper/207:41:042
64109945734,127cyclictest0-21swapper/211:48:472
641099457115,339cyclictest0-21swapper/210:39:062
64089945735,341cyclictest0-21swapper/009:13:590
64089945731,295cyclictest0-21swapper/009:25:200
641399456116,337cyclictest0-21swapper/510:56:295
641399456115,338cyclictest0-21swapper/512:43:435
641099456115,338cyclictest0-21swapper/211:19:212
64159945576,168cyclictest0-21swapper/711:41:447
641599455114,338cyclictest0-21swapper/710:06:037
64129945572,168cyclictest0-21swapper/411:10:194
64129945571,211cyclictest0-21swapper/410:45:184
641599454333,37cyclictest721ktimersoftd/712:15:157
64129945470,211cyclictest0-21swapper/412:15:064
641199454112,126cyclictest41-21ksoftirqd/310:45:193
64109945473,84cyclictest0-21swapper/212:37:382
64129945273,210cyclictest0-21swapper/409:35:104
64119945229,257cyclictest0-21swapper/307:41:273
64119945129,257cyclictest0-21swapper/309:35:103
64119945129,253cyclictest0-21swapper/307:15:113
64139944922,296cyclictest0-21swapper/511:09:445
64149944832,297cyclictest0-21swapper/611:20:336
641399448111,170cyclictest0-21swapper/511:10:195
64089944823,168cyclictest0-21swapper/010:20:030
641399447110,170cyclictest0-21swapper/509:35:115
641599446148,296cyclictest6406-21cyclictest12:43:237
64119944661,211cyclictest0-21swapper/309:47:203
64119944661,210cyclictest0-21swapper/310:52:513
64119944661,210cyclictest0-21swapper/310:52:513
64159944459,211cyclictest14412-21diskmemload11:00:117
64159944418,423cyclictest0-21swapper/711:10:267
64129944359,210cyclictest0-21swapper/409:34:354
64159944018,84cyclictest0-21swapper/712:13:197
64149944017,339cyclictest0-21swapper/607:40:596
641299439139,126cyclictest121rcu_preempt11:18:484
64149943812,84cyclictest0-21swapper/610:54:156
64149943812,84cyclictest0-21swapper/610:54:156
64119943815,42cyclictest0-21swapper/308:15:453
64119943815,42cyclictest0-21swapper/308:15:443
64109943896,340cyclictest0-21swapper/208:48:222
641099438352,84cyclictest311rcuc/212:23:032
64129943758,168cyclictest0-21swapper/411:09:414
64119943757,296cyclictest0-21swapper/311:41:183
641099437182,253cyclictest704-21nscd12:08:242
641399436137,126cyclictest121rcu_preempt10:42:555
641399436137,126cyclictest121rcu_preempt10:42:555
6411994369,256cyclictest0-21swapper/308:45:223
641399435140,126cyclictest121rcu_preempt12:31:355
64149943412,2cyclictest0-21swapper/609:23:356
64139943414,333cyclictest0-21swapper/508:48:245
6408994347,42cyclictest0-21swapper/012:31:340
64129943311,84cyclictest0-21swapper/410:10:144
64109943010,84cyclictest0-21swapper/209:25:052
6408994304,42cyclictest0-21swapper/008:20:110
64139942846,85cyclictest14412-21diskmemload10:39:215
64149942789,84cyclictest6406-21cyclictest12:23:196
6410994275,256cyclictest0-21swapper/212:31:302
64139942687,84cyclictest7453-21chrt10:20:025
64159942583,339cyclictest0-21swapper/711:19:037
6414994251,84cyclictest0-21swapper/611:50:296
64139942584,168cyclictest2562-21df07:55:175
64149942485,84cyclictest6406-21cyclictest11:40:496
64139942444,84cyclictest0-21swapper/511:19:345
64089942483,338cyclictest0-21swapper/007:45:090
64089942483,338cyclictest0-21swapper/007:45:090
641499423128,49cyclictest24176-21cron12:00:016
64159942281,338cyclictest704-21nscd11:09:447
64159942281,338cyclictest0-21swapper/710:54:047
64159942281,338cyclictest0-21swapper/710:54:047
64149942283,84cyclictest0-21swapper/607:15:146
641499422124,126cyclictest121rcu_preempt09:35:166
64129942283,336cyclictest0-21swapper/407:55:164
641299422207,126cyclictest121rcu_preempt10:39:194
64119942282,338cyclictest0-21swapper/310:39:193
6412994210,82cyclictest121rcu_preempt12:37:404
64109942182,84cyclictest0-21swapper/210:20:162
64149942082,84cyclictest0-21swapper/610:45:196
64149942081,84cyclictest0-21swapper/609:34:276
64119942080,338cyclictest0-21swapper/311:19:033
64119942080,338cyclictest0-21swapper/311:10:123
64099942081,84cyclictest0-21swapper/108:48:231
64099942081,84cyclictest0-21swapper/107:41:501
64149941980,84cyclictest0-21swapper/610:39:046
64139941980,84cyclictest0-21swapper/508:15:575
64139941980,84cyclictest0-21swapper/508:15:575
64119941978,338cyclictest0-21swapper/312:31:313
64119941978,338cyclictest0-21swapper/310:20:163
64119941978,169cyclictest0-21swapper/311:49:273
64159941874,338cyclictest0-21swapper/711:34:197
64159941874,338cyclictest0-21swapper/711:34:197
64139941879,84cyclictest0-21swapper/509:25:145
64129941877,338cyclictest0-21swapper/407:53:424
64099941879,84cyclictest0-21swapper/110:39:211
64139941738,84cyclictest0-21swapper/508:50:105
64129941780,126cyclictest0-21swapper/409:25:144
64089941777,338cyclictest0-21swapper/007:55:170
64089941734,168cyclictest13984-21irqstats11:00:170
641499416117,126cyclictest0-21swapper/611:35:296
64119941675,338cyclictest0-21swapper/312:37:403
64149941576,84cyclictest0-21swapper/612:43:086
641099415118,42cyclictest704-21nscd11:10:262
64099941577,171cyclictest0-21swapper/112:31:301
64159941472,339cyclictest0-21swapper/710:10:207
64149941475,84cyclictest0-21swapper/611:09:376
64109941476,83cyclictest0-21swapper/207:15:142
64159941333,2cyclictest0-21swapper/707:41:277
64149941374,84cyclictest0-21swapper/609:25:246
64159941271,338cyclictest0-21swapper/709:25:147
64159941232,3cyclictest0-21swapper/709:35:117
64129941272,337cyclictest0-21swapper/411:35:284
64109941173,84cyclictest0-21swapper/209:35:192
64119941070,337cyclictest0-21swapper/312:08:243
64159940867,126cyclictest0-21swapper/710:20:097
640999407107,211cyclictest13984-21irqstats11:00:191
64159940667,84cyclictest5549-21sh11:49:277
64129940667,337cyclictest0-21swapper/412:08:234
64159940566,84cyclictest0-21swapper/710:39:067
640999404109,259cyclictest0-21swapper/112:37:381
64139940168,249cyclictest0-21swapper/512:23:225
64099940063,171cyclictest0-21swapper/109:35:111
64149939960,84cyclictest0-21swapper/612:37:496
64149939759,85cyclictest0-21swapper/611:00:116
64119939756,338cyclictest0-21swapper/311:35:293
641499396315,78cyclictest641ktimersoftd/612:08:256
64099939657,84cyclictest0-21swapper/107:15:141
64089939415,84cyclictest8780-21ssh12:08:230
64109938849,84cyclictest0-21swapper/207:55:152
64139938548,83cyclictest0-21swapper/511:00:205
64119938442,339cyclictest0-21swapper/308:50:033
64149938042,83cyclictest0-21swapper/611:10:136
6415993781,122cyclictest0-21swapper/708:50:027
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional