You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 00:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Aug 25, 2026 12:54:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
783299720125,380cyclictest0-21swapper/209:40:302
783799702322,296cyclictest15850irq/123-ahci[0011:40:017
78309965519,549cyclictest0-21swapper/009:36:580
7830996457,549cyclictest0-21swapper/011:01:030
7835996373,384cyclictest0-21swapper/509:38:505
7832996362,383cyclictest0-21swapper/209:38:502
7837996351,2cyclictest0-21swapper/709:38:507
7834996351,383cyclictest0-21swapper/409:38:504
7830996350,84cyclictest0-21swapper/009:42:250
78319962778,126cyclictest0-21swapper/109:41:521
78309962530,507cyclictest121rcu_preempt10:51:380
78309962530,507cyclictest121rcu_preempt10:51:380
78309962372,126cyclictest121rcu_preempt10:14:010
78339961624,2cyclictest0-21swapper/309:38:573
783499613401,43cyclictest0-21swapper/410:53:334
783499613401,43cyclictest0-21swapper/410:53:334
78309961317,168cyclictest6436-21rm12:05:000
783399612273,126cyclictest23514-1kworker/u17:011:37:433
78369961018,383cyclictest0-21swapper/609:38:516
783299610270,338cyclictest2243-1kworker/u17:211:07:362
783399609310,126cyclictest0-21swapper/312:18:323
78329960955,296cyclictest0-21swapper/211:10:202
78369960853,465cyclictest17517-21kworker/u16:011:06:186
78349960710,338cyclictest0-21swapper/412:30:224
78329960714,211cyclictest0-21swapper/209:15:232
78339960554,126cyclictest0-21swapper/309:45:243
783399604305,126cyclictest0-21swapper/312:09:323
7830996038,592cyclictest0-21swapper/009:16:070
783299597549,3cyclictest311rcuc/212:42:162
7830995960,4cyclictest0-21swapper/011:44:490
7830995940,7cyclictest0-21swapper/010:21:570
7830995940,7cyclictest0-21swapper/010:21:570
7830995940,7cyclictest0-21swapper/010:21:570
7833995930,83cyclictest0-21swapper/310:15:183
7830995930,42cyclictest0-21swapper/011:29:570
78379959284,84cyclictest0-21swapper/711:41:447
78349958435,84cyclictest0-21swapper/412:43:194
78339958374,127cyclictest0-21swapper/309:40:143
78339958172,127cyclictest0-21swapper/312:11:493
783199581115,84cyclictest121rcu_preempt11:05:031
783199579111,295cyclictest0-21swapper/112:06:041
78319957724,126cyclictest0-21swapper/111:41:241
78359957525,46cyclictest121rcu_preempt11:23:465
78369957423,126cyclictest10203-21ssh12:06:046
78309957325,125cyclictest0-21swapper/011:37:510
78379956798,338cyclictest14000-21pmu-power10:55:297
78379956756,295cyclictest0-21swapper/710:47:227
78369956712,296cyclictest27540-21ssh12:16:376
78319956714,253cyclictest0-21swapper/109:29:291
78319956618,337cyclictest0-21swapper/111:25:481
78329956416,41cyclictest0-21swapper/211:44:352
78369956314,126cyclictest0-21swapper/611:27:166
783299557346,7cyclictest0-21swapper/209:45:172
7837995543,91cyclictest0-21swapper/712:09:437
783299551208,254cyclictest0-21swapper/210:22:432
783299551208,254cyclictest0-21swapper/210:22:432
783299551208,254cyclictest0-21swapper/210:22:432
7830995510,41cyclictest0-21swapper/011:09:380
7832995501,84cyclictest0-21swapper/210:07:402
7830995500,41cyclictest0-21swapper/010:06:010
783799549249,126cyclictest0-21swapper/711:08:567
78359954878,211cyclictest57-21ksoftirqd/510:15:145
783399547163,211cyclictest27854-21chrt11:40:203
78309954678,211cyclictest16064-21diskmemload12:08:530
78339954478,296cyclictest0-21swapper/309:15:223
78319954335,84cyclictest0-21swapper/112:18:321
78379954234,84cyclictest0-21swapper/712:18:387
783299542115,296cyclictest0-21swapper/212:04:132
78309954278,337cyclictest0-21swapper/010:39:260
783399541326,126cyclictest0-21swapper/310:13:023
78329954172,296cyclictest0-21swapper/212:07:412
783399540113,211cyclictest41-21ksoftirqd/311:27:313
783199538199,168cyclictest14171-21python10:55:331
783399537109,381cyclictest0-21swapper/310:05:173
78319953730,84cyclictest0-21swapper/110:13:421
78369953626,126cyclictest0-21swapper/610:08:436
78309953527,126cyclictest0-21swapper/010:47:010
783799534107,296cyclictest0-21swapper/709:40:407
783299534192,339cyclictest7828-21cyclictest12:18:312
783799533194,296cyclictest121rcu_preempt12:03:537
783499533195,84cyclictest28321-21kworker/u16:211:19:344
78319953326,84cyclictest0-21swapper/109:14:311
78329953225,84cyclictest0-21swapper/211:29:442
78319953263,211cyclictest0-21swapper/110:05:041
78379953165,211cyclictest0-21swapper/710:53:387
78379953165,211cyclictest0-21swapper/710:53:387
78309953121,296cyclictest0-21swapper/012:12:090
78329953021,84cyclictest0-21swapper/210:40:152
78369952921,423cyclictest0-21swapper/610:42:096
783299526227,126cyclictest0-21swapper/211:36:052
78349952518,338cyclictest0-21swapper/410:20:594
78349952518,338cyclictest0-21swapper/410:20:594
78349952518,338cyclictest0-21swapper/410:20:594
78369952312,86cyclictest0-21swapper/610:12:296
78349952316,338cyclictest0-21swapper/410:49:254
78309952311,296cyclictest31183-21rm11:23:460
78339952154,127cyclictest0-21swapper/310:24:033
78339952154,127cyclictest0-21swapper/310:24:033
78339952154,127cyclictest0-21swapper/310:24:023
78329952113,84cyclictest0-21swapper/211:22:312
78379952054,169cyclictest0-21swapper/712:30:257
7831995209,84cyclictest0-21swapper/110:40:491
7835995199,380cyclictest0-21swapper/511:40:205
7831995199,337cyclictest0-21swapper/109:55:191
7830995189,84cyclictest121rcu_preempt10:55:280
783599516433,3cyclictest551rcuc/510:22:155
783599516433,3cyclictest551rcuc/510:22:155
783599516433,3cyclictest551rcuc/510:22:155
7831995142,380cyclictest0-21swapper/111:37:281
7836995133,296cyclictest121rcu_preempt11:43:546
7830995122,126cyclictest0-21swapper/012:17:190
7836995111,338cyclictest0-21swapper/611:14:466
7832995100,85cyclictest5201-21df_abs10:15:172
7830995091,126cyclictest0-21swapper/012:43:130
7834995080,83cyclictest0-21swapper/409:43:214
7830995080,41cyclictest0-21swapper/009:50:250
783299507293,84cyclictest121rcu_preempt10:39:272
7830995070,3cyclictest0-21swapper/012:30:290
783799506207,211cyclictest121rcu_preempt11:55:177
783599503123,126cyclictest31205-21ssh10:10:245
78349950339,126cyclictest0-21swapper/409:15:204
783499502122,83cyclictest1551-21snmpd10:14:354
783099502164,254cyclictest9952-21kworker/0:211:15:040
78329950134,84cyclictest0-21swapper/210:48:282
78369950035,385cyclictest0-21swapper/610:24:236
78369950035,385cyclictest0-21swapper/610:24:236
78369950035,385cyclictest0-21swapper/610:24:236
78339950034,126cyclictest0-21swapper/309:30:063
783399500159,338cyclictest17515-21rm10:39:053
78309950035,3cyclictest0-21swapper/009:30:190
78369949930,338cyclictest0-21swapper/610:47:466
783799498412,84cyclictest721ktimersoftd/710:22:227
783799498412,84cyclictest721ktimersoftd/710:22:217
783799498412,84cyclictest721ktimersoftd/710:22:217
78369949834,127cyclictest0-21swapper/609:13:426
78339949832,126cyclictest0-21swapper/311:22:433
78369949773,251cyclictest25750-21ssh11:01:456
78319949730,84cyclictest6431-21cron12:05:001
78369949627,380cyclictest5132-21ssh10:15:156
783199496115,84cyclictest121rcu_preempt09:15:161
78349949530,295cyclictest0-21swapper/412:18:194
78329949529,211cyclictest0-21swapper/212:31:412
78369949427,209cyclictest65-21ksoftirqd/612:12:306
783599494109,169cyclictest0-21swapper/511:55:175
78309949433,3cyclictest0-21swapper/009:29:430
78349949329,84cyclictest0-21swapper/411:42:384
78339949335,291cyclictest0-21swapper/311:03:063
78379949226,299cyclictest721ktimersoftd/710:09:537
78359949228,297cyclictest0-21swapper/511:03:015
78319949268,169cyclictest0-21swapper/112:43:081
78349949122,211cyclictest0-21swapper/411:29:414
783099491238,50cyclictest22140-21ssh10:40:520
78379949067,127cyclictest0-21swapper/709:29:357
78319948963,210cyclictest3760-21ssh12:38:581
783799486102,381cyclictest0-21swapper/710:13:157
78379948519,3cyclictest0-21swapper/711:01:147
78349948521,84cyclictest0-21swapper/409:14:464
78329948518,127cyclictest0-21swapper/210:54:442
78329948518,127cyclictest0-21swapper/210:54:442
78369948416,465cyclictest0-21swapper/609:41:526
78349948418,44cyclictest0-21swapper/410:08:194
78319948418,126cyclictest0-21swapper/111:19:291
78339948318,42cyclictest0-21swapper/312:04:183
78319948317,84cyclictest0-21swapper/110:20:401
78319948317,84cyclictest0-21swapper/110:20:401
78319948317,84cyclictest0-21swapper/110:20:401
78379948214,295cyclictest0-21swapper/712:12:467
78349948297,211cyclictest0-21swapper/410:42:404
78339948259,126cyclictest0-21swapper/311:19:283
78369948155,295cyclictest0-21swapper/609:15:236
783599481185,85cyclictest28321-21kworker/u16:210:54:425
783599481185,85cyclictest28321-21kworker/u16:210:54:425
783499481141,338cyclictest28321-21kworker/u16:211:08:494
78339947953,126cyclictest121rcu_preempt11:45:043
78329947914,254cyclictest0-21swapper/210:14:382
78309947915,41cyclictest0-21swapper/009:13:590
78379947813,84cyclictest0-21swapper/709:14:467
78369947813,381cyclictest0-21swapper/610:39:256
7836994766,211cyclictest0-21swapper/610:52:546
7836994766,211cyclictest0-21swapper/610:52:546
78359947610,86cyclictest0-21swapper/510:39:085
78349947552,337cyclictest0-21swapper/411:35:434
78379947410,2cyclictest0-21swapper/711:24:257
78359947448,211cyclictest23983-21ssh10:25:185
783799472132,338cyclictest7828-21cyclictest09:55:267
7835994727,257cyclictest0-21swapper/510:09:485
78349947246,423cyclictest17035-21ssh09:45:244
783199472131,338cyclictest3474-1kworker/u17:010:39:051
7832994712,253cyclictest0-21swapper/212:11:182
7831994717,338cyclictest0-21swapper/109:35:381
7834994691,295cyclictest0-21swapper/411:02:364
7831994682,84cyclictest0-21swapper/112:30:121
7834994671,127cyclictest0-21swapper/409:55:154
7834994670,84cyclictest0-21swapper/412:10:214
7834994670,42cyclictest0-21swapper/411:14:374
7832994671,126cyclictest0-21swapper/211:01:452
7831994660,84cyclictest0-21swapper/111:10:211
78379946583,84cyclictest0-21swapper/711:26:417
78369946582,380cyclictest0-21swapper/612:31:426
78349946540,422cyclictest0-21swapper/412:05:524
7830994650,41cyclictest0-21swapper/007:18:050
783699463121,169cyclictest27084-21ssh09:50:336
783399463164,126cyclictest121rcu_preempt10:54:443
783399463164,126cyclictest121rcu_preempt10:54:443
78349946240,340cyclictest0-21swapper/407:19:034
783199462246,84cyclictest0-21swapper/110:00:251
78369946135,253cyclictest0-21swapper/612:03:546
783599461121,337cyclictest0-21swapper/509:13:415
78349946177,211cyclictest26392-21mailstats09:50:204
78349946138,42cyclictest5159-21sh10:15:164
78339946037,256cyclictest0-21swapper/311:09:453
78379945975,253cyclictest11771-21sh12:43:087
78359945837,302cyclictest0-21swapper/509:17:305
783599458115,340cyclictest6263-21ssh12:04:535
78319945836,2cyclictest0-21swapper/112:13:191
78359945734,256cyclictest0-21swapper/512:13:195
78379945675,84cyclictest0-21swapper/710:39:377
78369945674,380cyclictest0-21swapper/611:45:296
78369945634,297cyclictest0-21swapper/609:55:156
78359945634,253cyclictest0-21swapper/512:08:155
783799455116,336cyclictest0-21swapper/710:42:237
78339945571,211cyclictest0-21swapper/312:31:013
78319945533,84cyclictest0-21swapper/111:04:321
78309945530,422cyclictest0-21swapper/011:14:390
78359945475,295cyclictest13065-21taskset10:00:225
78359945475,252cyclictest0-21swapper/511:14:485
78359945331,256cyclictest0-21swapper/512:17:345
78309945333,44cyclictest0-21swapper/009:55:180
783399452237,41cyclictest0-21swapper/309:14:313
78369945130,83cyclictest0-21swapper/612:42:176
78359945168,380cyclictest0-21swapper/512:31:425
78329945129,2cyclictest0-21swapper/210:25:112
78309945167,211cyclictest0-21swapper/010:25:110
78369945028,2cyclictest0-21swapper/611:55:396
78309945032,122cyclictest121rcu_preempt10:15:060
78349944925,50cyclictest0-21swapper/411:24:164
78329944966,380cyclictest0-21swapper/211:15:042
78319944661,169cyclictest0-21swapper/110:47:541
78319944620,84cyclictest0-21swapper/110:51:531
78319944620,84cyclictest0-21swapper/110:51:531
78339944522,256cyclictest0-21swapper/310:55:303
783299445104,338cyclictest0-21swapper/209:30:192
78349944320,50cyclictest0-21swapper/412:04:134
78339944319,169cyclictest0-21swapper/309:28:483
783399442274,7cyclictest0-21swapper/310:00:223
78339944220,84cyclictest0-21swapper/310:46:573
78379944156,211cyclictest0-21swapper/710:15:177
78319944115,126cyclictest0-21swapper/111:22:391
78359944018,257cyclictest0-21swapper/511:29:585
78359944014,259cyclictest0-21swapper/509:28:595
78369943916,343cyclictest0-21swapper/611:24:196
783599439183,126cyclictest3788-21nscd11:36:145
78349943917,177cyclictest0-21swapper/410:55:074
78329943710,257cyclictest0-21swapper/210:55:282
78329943612,126cyclictest0-21swapper/209:29:292
783299433133,126cyclictest121rcu_preempt10:00:212
7835994307,211cyclictest0-21swapper/511:06:195
7830994309,41cyclictest0-21swapper/011:45:040
7830994297,343cyclictest0-21swapper/011:55:390
7836994283,84cyclictest0-21swapper/610:55:296
7834994286,2cyclictest0-21swapper/410:25:194
783699427297,42cyclictest0-21swapper/611:19:296
7836994271,41cyclictest24998-21users10:25:276
7834994276,83cyclictest121rcu_preempt10:39:324
7830994272,41cyclictest0-21swapper/011:54:340
7837994260,84cyclictest0-21swapper/709:45:297
783399425341,3cyclictest401ktimersoftd/312:42:493
7830994250,42cyclictest0-21swapper/007:20:050
7835994241,84cyclictest0-21swapper/509:55:315
7832994241,84cyclictest0-21swapper/209:14:462
7837994230,82cyclictest0-21swapper/711:19:427
78359942382,338cyclictest0-21swapper/512:25:045
78359942382,338cyclictest0-21swapper/510:55:095
78359942382,338cyclictest0-21swapper/509:44:525
7833994231,129cyclictest7828-21cyclictest10:41:003
78369942282,338cyclictest0-21swapper/612:38:586
78359942282,338cyclictest0-21swapper/510:42:095
78349942281,338cyclictest0-21swapper/409:30:184
783399422165,169cyclictest0-21swapper/309:55:273
78309942282,338cyclictest0-21swapper/009:45:180
78379942182,84cyclictest0-21swapper/711:45:347
78379942182,84cyclictest0-21swapper/709:30:187
78379942182,84cyclictest0-21swapper/709:17:077
78369942181,338cyclictest0-21swapper/611:35:436
78349942180,338cyclictest0-21swapper/409:29:024
783599420122,126cyclictest16363-21ssh09:45:185
78319942035,84cyclictest0-21swapper/110:15:161
78359941776,338cyclictest0-21swapper/510:46:425
78379941677,84cyclictest0-21swapper/710:25:197
78359941676,337cyclictest0-21swapper/512:41:015
783299416333,2cyclictest311rcuc/211:45:302
78309941675,338cyclictest0-21swapper/012:25:040
78369941535,296cyclictest0-21swapper/609:45:186
78339941575,338cyclictest0-21swapper/309:50:263
78319941535,84cyclictest16353-21cat09:45:171
78359941434,42cyclictest0-21swapper/511:54:475
78329941473,338cyclictest0-21swapper/209:55:152
78369941332,169cyclictest0-21swapper/607:18:046
78339941372,168cyclictest0-21swapper/311:14:573
78309941333,177cyclictest0-21swapper/010:00:160
78359941232,296cyclictest0-21swapper/511:19:295
78369941170,338cyclictest0-21swapper/609:30:206
78369941130,297cyclictest0-21swapper/609:29:016
78359941029,211cyclictest23357-21interrupts09:30:205
78379940970,84cyclictest0-21swapper/712:25:057
78359940969,337cyclictest0-21swapper/512:38:585
78329940968,338cyclictest0-21swapper/212:24:582
78329940866,339cyclictest0-21swapper/212:38:582
78329940726,84cyclictest0-21swapper/209:50:232
78349940665,338cyclictest0-21swapper/412:24:584
78369940568,253cyclictest0-21swapper/610:00:226
78369940564,338cyclictest0-21swapper/612:25:046
78319940525,84cyclictest0-21swapper/110:25:191
783199405153,89cyclictest0-21swapper/111:45:281
783799404152,126cyclictest0-21swapper/711:10:207
783099404104,126cyclictest121rcu_preempt12:38:590
78359940362,168cyclictest0-21swapper/509:50:205
78349940261,338cyclictest0-21swapper/412:38:584
78339940160,126cyclictest41-21ksoftirqd/310:25:263
78379940018,84cyclictest0-21swapper/709:50:217
78349940060,168cyclictest49-21ksoftirqd/411:55:184
78329940020,8cyclictest0-21swapper/207:19:292
78319940020,84cyclictest0-21swapper/109:50:321
78319940020,42cyclictest121rcu_preempt07:18:361
783299395139,126cyclictest16064-21diskmemload12:25:012
78339939412,8cyclictest0-21swapper/311:55:383
78339939313,169cyclictest0-21swapper/307:18:583
78339939212,85cyclictest0-21swapper/311:54:473
7837993894,254cyclictest0-21swapper/710:00:267
78349938544,338cyclictest0-21swapper/410:00:224
78359938039,338cyclictest0-21swapper/512:24:585
78329937939,338cyclictest0-21swapper/211:55:512
78359937837,338cyclictest0-21swapper/507:20:085
783599377121,126cyclictest121rcu_preempt11:45:285
78359937639,256cyclictest0-21swapper/507:15:295
78329937676,168cyclictest0-21swapper/211:54:482
78379937378,126cyclictest0-21swapper/712:39:007
783199372115,169cyclictest0-21swapper/107:20:121
78379937175,212cyclictest0-21swapper/711:54:477
78349937135,41cyclictest0-21swapper/412:25:044
78309937130,338cyclictest0-21swapper/012:24:580
78319937071,126cyclictest0-21swapper/111:55:321
78379936829,84cyclictest0-21swapper/707:20:087
78349936827,338cyclictest0-21swapper/407:20:084
78379936770,84cyclictest0-21swapper/712:24:597
78349936425,42cyclictest0-21swapper/411:45:284
78369936320,295cyclictest0-21swapper/607:20:056
78349936327,41cyclictest19710-21sh11:54:474
78379936122,84cyclictest0-21swapper/707:18:217
78329936021,84cyclictest0-21swapper/207:20:082
783399359188,84cyclictest0-21swapper/307:20:123
78319935614,89cyclictest0-21swapper/112:25:041
783199356103,90cyclictest0-21swapper/111:54:341
783199356100,254cyclictest0-21swapper/109:30:061
78369935414,337cyclictest0-21swapper/612:24:586
78339935112,84cyclictest0-21swapper/312:24:583
78339934145,92cyclictest41-21ksoftirqd/312:25:053
7831993402,169cyclictest9004-21ssh12:24:581
78339932973,126cyclictest0-21swapper/312:38:593
78309932468,126cyclictest0-21swapper/011:30:020
78379932122,126cyclictest0-21swapper/711:30:027
78369931822,211cyclictest0-21swapper/611:54:356
78349931761,253cyclictest7828-21cyclictest11:30:014
78359931616,126cyclictest0-21swapper/511:30:025
7832992961,42cyclictest0-21swapper/211:30:012
78369929535,126cyclictest0-21swapper/611:30:016
78339924838,129cyclictest0-21swapper/311:30:013
78319922716,85cyclictest0-21swapper/111:30:021
710728748,8sleep60-21swapper/607:05:506
737228451,29sleep70-21swapper/707:09:367
731128350,29sleep40-21swapper/407:08:454
717728252,27sleep20-21swapper/207:06:512
716728251,28sleep10-21swapper/107:06:421
715328251,28sleep50-21swapper/507:06:295
714228251,28sleep30-21swapper/307:06:193
726828149,28sleep00-21swapper/007:08:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional