You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 18:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Jul 18, 2026 12:55:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324259978622,125cyclictest121rcu_preempt09:19:547
32425997727,592cyclictest0-21swapper/709:44:497
324229971677,338cyclictest0-21swapper/510:15:165
324199970769,381cyclictest0-21swapper/210:27:482
324259970019,550cyclictest0-21swapper/711:13:247
3242399672119,382cyclictest32415-21cyclictest11:52:306
3242599671416,253cyclictest0-21swapper/711:34:497
324219966432,126cyclictest0-21swapper/412:34:394
324189966026,338cyclictest0-21swapper/112:02:511
324259965421,550cyclictest0-21swapper/708:34:137
324259964951,381cyclictest0-21swapper/712:03:147
324259964047,590cyclictest0-21swapper/710:22:497
3241799635335,89cyclictest0-21swapper/010:30:250
324209963289,161cyclictest0-21swapper/311:45:083
3242199631123,84cyclictest0-21swapper/411:25:024
324259962832,593cyclictest0-21swapper/711:52:557
3242299627201,296cyclictest0-21swapper/510:49:195
3242099625113,296cyclictest0-21swapper/312:41:473
324199962231,126cyclictest0-21swapper/210:30:112
324189962230,126cyclictest0-21swapper/108:31:391
324209962125,338cyclictest0-21swapper/311:35:173
3241799620156,253cyclictest6816-21sh09:43:000
324189961865,386cyclictest0-21swapper/111:35:171
3242099617110,338cyclictest2893-21munin-node12:34:393
324199961721,381cyclictest0-21swapper/212:17:042
324189961764,381cyclictest0-21swapper/110:13:231
3242599614145,84cyclictest22746-21rm11:02:047
3242199610269,338cyclictest7815-21diskmemload09:43:304
324209961099,381cyclictest0-21swapper/311:43:553
324209961099,381cyclictest0-21swapper/311:43:553
324219960898,295cyclictest5181-21sh12:42:384
32417995999,126cyclictest0-21swapper/012:43:030
32417995960,42cyclictest5791-21nscd10:08:290
32425995940,84cyclictest0-21swapper/712:33:057
32422995930,84cyclictest0-21swapper/511:04:415
32421995930,84cyclictest64450irq/122-eth008:35:054
32421995930,84cyclictest19015-21taskset08:34:134
324209959383,127cyclictest0-21swapper/311:02:053
3242199588247,126cyclictest0-21swapper/410:13:534
324199958675,338cyclictest0-21swapper/209:43:302
324179958676,295cyclictest0-21swapper/012:36:190
3242099585121,338cyclictest704-21nscd12:19:453
3241899585503,3cyclictest241ktimersoftd/112:43:471
324179958532,300cyclictest0-21swapper/011:44:580
324179958532,300cyclictest0-21swapper/011:44:580
324189958478,337cyclictest0-21swapper/112:36:321
324219958232,126cyclictest0-21swapper/412:19:454
324239958131,84cyclictest121rcu_preempt09:54:196
3242399579158,210cyclictest0-21swapper/611:44:386
3242399579158,210cyclictest0-21swapper/611:44:386
324259957866,381cyclictest0-21swapper/710:10:537
324179957830,295cyclictest0-21swapper/009:17:010
324179957828,126cyclictest0-21swapper/008:32:200
3242599577106,338cyclictest0-21swapper/712:15:497
3242199577277,127cyclictest0-21swapper/410:39:154
324219957724,295cyclictest26302-21ssh09:20:064
324219957724,295cyclictest26302-21ssh09:20:064
3242199577236,126cyclictest0-21swapper/411:01:124
3242299576110,126cyclictest21961-1kworker/u17:211:43:165
3242299576110,126cyclictest21961-1kworker/u17:211:43:165
324189957624,85cyclictest0-21swapper/110:08:571
324259957569,503cyclictest0-21swapper/710:30:207
324219957429,296cyclictest0-21swapper/412:28:294
324189957424,126cyclictest0-21swapper/109:37:051
3241799574110,295cyclictest0-21swapper/009:54:180
324229957361,380cyclictest0-21swapper/510:10:085
324179957366,83cyclictest121rcu_preempt12:04:190
3241799573317,84cyclictest0-21swapper/010:29:540
3241899572103,296cyclictest0-21swapper/110:29:121
324239957061,127cyclictest0-21swapper/611:15:106
324259956511,551cyclictest0-21swapper/712:13:037
324259956415,126cyclictest0-21swapper/710:39:517
324189956355,126cyclictest0-21swapper/109:18:331
324189956313,83cyclictest121rcu_preempt11:02:521
324219956214,7cyclictest0-21swapper/412:36:334
324199956210,338cyclictest0-21swapper/211:04:052
324199956111,301cyclictest0-21swapper/210:11:572
32417995596,41cyclictest0-21swapper/012:18:110
32421995588,126cyclictest0-21swapper/410:29:544
32422995577,3cyclictest8614-21cron09:45:015
324259955544,508cyclictest0-21swapper/711:24:437
324189955586,296cyclictest0-21swapper/110:15:041
3241899554127,296cyclictest0-21swapper/112:12:511
324229955245,84cyclictest0-21swapper/509:18:145
324259954940,84cyclictest121rcu_preempt10:25:357
3242599549164,169cyclictest721ktimersoftd/710:07:407
324239954983,126cyclictest0-21swapper/610:49:206
3242599548122,423cyclictest0-21swapper/712:41:367
3242199548207,338cyclictest64450irq/122-eth012:03:404
324239954738,93cyclictest121rcu_preempt12:04:166
324219954778,296cyclictest0-21swapper/410:30:194
324209954736,296cyclictest0-21swapper/310:24:243
3241999547120,296cyclictest0-21swapper/210:08:572
324189954778,296cyclictest0-21swapper/112:17:261
324209954634,295cyclictest0-21swapper/310:38:393
3241899546162,126cyclictest121rcu_preempt10:39:521
3242299545246,84cyclictest0-21swapper/512:12:425
324259954478,84cyclictest0-21swapper/712:37:447
3242399544118,296cyclictest0-21swapper/611:04:406
324209954432,380cyclictest0-21swapper/309:42:223
324209954332,84cyclictest0-21swapper/310:28:033
3242099543289,45cyclictest0-21swapper/310:30:353
3241899543116,296cyclictest0-21swapper/112:28:291
3241799542246,43cyclictest0-21swapper/011:23:390
324229954134,85cyclictest0-21swapper/512:42:065
324199954133,84cyclictest121rcu_preempt10:48:352
3242099540113,296cyclictest0-21swapper/311:53:393
324199954073,424cyclictest0-21swapper/209:16:592
324199954032,126cyclictest121rcu_preempt10:23:372
324199953973,211cyclictest0-21swapper/212:03:402
3242299538251,79cyclictest0-21swapper/510:09:165
324219953873,126cyclictest698-21ptp4l10:48:254
324229953730,341cyclictest0-21swapper/510:30:125
324189953768,296cyclictest0-21swapper/111:34:371
324259953523,509cyclictest0-21swapper/710:49:297
324199953525,380cyclictest0-21swapper/211:24:332
3242099534107,253cyclictest1513-21kworker/u16:111:23:543
324259953323,473cyclictest0-21swapper/709:20:147
324259953323,473cyclictest0-21swapper/709:20:137
324219953367,126cyclictest2893-21munin-node12:12:514
3241999533193,338cyclictest32415-21cyclictest10:38:452
324259953219,509cyclictest0-21swapper/709:37:357
324239953161,253cyclictest0-21swapper/612:16:116
3242399531105,423cyclictest0-21swapper/612:41:366
324199953123,126cyclictest0-21swapper/211:43:072
324199953123,126cyclictest0-21swapper/211:43:072
324239953061,84cyclictest121rcu_preempt09:36:046
324189953022,126cyclictest0-21swapper/110:47:121
324239952964,126cyclictest0-21swapper/610:13:556
3242099528142,212cyclictest0-21swapper/312:38:103
324189952860,211cyclictest17198-21seq10:24:131
324179952822,84cyclictest31026-21smartctl11:25:150
324179952815,84cyclictest0-21swapper/009:55:190
3242299527101,253cyclictest0-21swapper/510:39:005
324199952758,296cyclictest0-21swapper/211:45:082
324179952719,126cyclictest121rcu_preempt12:33:180
324239952417,43cyclictest0-21swapper/612:32:346
324219952460,84cyclictest32415-21cyclictest09:53:464
324199952416,88cyclictest0-21swapper/212:34:162
324199952397,296cyclictest0-21swapper/208:31:382
324239952253,84cyclictest121rcu_preempt09:44:596
324189952212,297cyclictest0-21swapper/111:43:321
324189952212,297cyclictest0-21swapper/111:43:311
324189952211,296cyclictest27686-21taskset10:30:311
3241799522264,127cyclictest0-21swapper/010:14:430
324199952114,126cyclictest0-21swapper/212:36:002
324209952097,256cyclictest290042sleep310:49:113
3242299518134,254cyclictest29122-21taskset12:19:475
3241899518262,126cyclictest0-21swapper/111:25:031
3242199516262,84cyclictest481ktimersoftd/411:33:184
32419995157,126cyclictest0-21swapper/211:14:522
324239951387,295cyclictest0-21swapper/611:34:006
32419995121,126cyclictest0-21swapper/209:37:342
324219951187,84cyclictest0-21swapper/411:53:224
32417995112,336cyclictest17229-21ssh10:24:170
32422995100,85cyclictest187-21md0_raid108:34:135
32423995090,84cyclictest0-21swapper/608:34:136
32420995090,84cyclictest0-21swapper/310:11:573
32420995090,84cyclictest0-21swapper/308:34:133
324199950980,211cyclictest33-21ksoftirqd/211:05:132
32417995071,42cyclictest0-21swapper/011:54:520
3242099506122,168cyclictest21577-21ssh12:13:413
324199950639,85cyclictest0-21swapper/209:53:492
3242099505205,126cyclictest41-21ksoftirqd/309:20:063
3242099505205,126cyclictest41-21ksoftirqd/309:20:063
324259950436,465cyclictest0-21swapper/711:15:127
324229950480,84cyclictest121rcu_preempt09:37:355
3242299504120,253cyclictest0-21swapper/512:33:045
324209950476,296cyclictest0-21swapper/312:04:083
324189950438,211cyclictest0-21swapper/109:44:371
324239950238,84cyclictest121rcu_preempt10:23:156
324229950175,295cyclictest0-21swapper/511:53:595
3242599499114,127cyclictest73-21ksoftirqd/709:55:187
3242299499288,7cyclictest0-21swapper/511:34:045
324199949974,423cyclictest0-21swapper/210:15:162
324189949971,211cyclictest0-21swapper/112:20:041
324179949935,298cyclictest0-21swapper/011:01:190
3241799499199,127cyclictest0-21swapper/009:20:160
3241799499199,127cyclictest0-21swapper/009:20:150
324229949834,42cyclictest0-21swapper/510:28:555
324189949871,254cyclictest0-21swapper/112:33:171
3242199497156,126cyclictest32415-21cyclictest11:43:434
3242199497156,126cyclictest32415-21cyclictest11:43:434
324199949728,211cyclictest0-21swapper/211:53:362
324189949733,303cyclictest0-21swapper/109:20:111
324189949733,303cyclictest0-21swapper/109:20:111
324259949568,169cyclictest0-21swapper/709:53:497
324179949468,168cyclictest0-21swapper/010:47:580
324219949228,42cyclictest0-21swapper/409:55:174
324179949223,2cyclictest0-21swapper/009:45:110
324219949022,465cyclictest0-21swapper/411:35:184
324199949024,126cyclictest0-21swapper/212:42:562
324179949026,84cyclictest0-21swapper/011:34:270
324239948966,84cyclictest15230-21/usr/sbin/munin11:35:116
3241999489236,84cyclictest7815-21diskmemload11:32:362
324179948925,42cyclictest0-21swapper/011:15:140
324199948824,380cyclictest0-21swapper/212:14:532
324259948621,2cyclictest0-21swapper/712:05:087
324179948622,84cyclictest0-21swapper/010:40:010
324179948617,126cyclictest0-21swapper/012:20:050
3242199485144,126cyclictest121rcu_preempt09:19:554
324199948558,296cyclictest0-21swapper/209:55:202
3241899485146,126cyclictest121rcu_preempt11:14:091
324189948317,253cyclictest0-21swapper/111:15:041
324239948115,84cyclictest0-21swapper/612:14:356
324209948153,296cyclictest0-21swapper/311:15:103
324179948154,211cyclictest0-21swapper/010:39:540
324259948012,465cyclictest0-21swapper/711:44:197
324259948012,465cyclictest0-21swapper/711:44:197
324209948095,127cyclictest41-21ksoftirqd/312:05:153
324209948053,296cyclictest0-21swapper/309:54:503
324229947915,84cyclictest26264-21ssh09:20:035
324229947915,84cyclictest26264-21ssh09:20:035
324209947915,84cyclictest0-21swapper/310:07:373
324229947854,84cyclictest121rcu_preempt12:35:545
324179947713,126cyclictest0-21swapper/009:37:250
324219947510,126cyclictest32415-21cyclictest10:15:044
3242099475134,168cyclictest121rcu_preempt11:34:103
32420994739,126cyclictest0-21swapper/309:36:283
32419994701,296cyclictest0-21swapper/209:20:062
32419994701,296cyclictest0-21swapper/209:20:062
32417994708,5cyclictest0-21swapper/011:45:140
32423994694,84cyclictest0-21swapper/609:19:516
3242399469170,169cyclictest121rcu_preempt10:26:446
324239946844,84cyclictest0-21swapper/611:23:516
3242299468133,122cyclictest121rcu_preempt10:24:135
32418994671,84cyclictest0-21swapper/111:54:371
32417994661,83cyclictest32415-21cyclictest12:13:450
3242399465124,338cyclictest726-21gmain11:12:256
324199946480,126cyclictest33-21ksoftirqd/211:25:232
324229946382,84cyclictest0-21swapper/512:05:005
3242299463169,176cyclictest0-21swapper/511:25:015
3241899463249,126cyclictest0-21swapper/111:45:041
32420994621,377cyclictest0-21swapper/309:55:193
324189946135,338cyclictest0-21swapper/112:05:061
3241799459118,338cyclictest0-21swapper/011:35:170
324239945874,126cyclictest0-21swapper/611:05:076
3242299458117,338cyclictest10177-21chrt11:14:165
324209945835,126cyclictest9252-21ssh11:13:113
324219945733,42cyclictest0-21swapper/410:25:004
3242099457115,253cyclictest0-21swapper/309:19:543
324189945773,211cyclictest0-21swapper/111:25:231
3242299456245,8cyclictest0-21swapper/509:53:365
3242399455201,125cyclictest12109-21kworker/u16:312:37:056
3242299455114,338cyclictest1553-21runrttasks09:55:365
324219945571,253cyclictest0-21swapper/411:14:324
324259945428,423cyclictest0-21swapper/711:25:167
324199945470,211cyclictest33-21ksoftirqd/211:15:142
324179945433,217cyclictest0-21swapper/010:15:100
324239945366,211cyclictest0-21swapper/609:20:186
324239945366,211cyclictest0-21swapper/609:20:186
3242199453161,81cyclictest0-21swapper/411:45:054
324209945373,296cyclictest0-21swapper/310:15:093
3242099453110,84cyclictest25502-21ssh11:05:073
3241799453154,126cyclictest121rcu_preempt11:15:000
324239945230,256cyclictest0-21swapper/610:30:256
324199945234,203cyclictest0-21swapper/211:35:172
324199945227,84cyclictest0-21swapper/212:05:042
324189945167,211cyclictest0-21swapper/109:45:131
3242599450109,338cyclictest0-21swapper/712:20:027
324239944865,210cyclictest65-21ksoftirqd/610:39:536
324189944725,84cyclictest0-21swapper/109:54:171
324259944620,423cyclictest0-21swapper/710:40:127
324219944623,42cyclictest0-21swapper/410:07:124
324209944565,211cyclictest0-21swapper/311:25:193
3242299444230,83cyclictest0-21swapper/511:25:165
324189944421,296cyclictest32415-21cyclictest09:55:301
324239944262,170cyclictest0-21swapper/610:07:216
3242199442317,41cyclictest471rcuc/409:37:244
324199943916,254cyclictest0-21swapper/209:45:122
324179943815,126cyclictest14215-21ssh12:28:300
324199943495,126cyclictest0-21swapper/212:28:302
324199943493,126cyclictest33-21ksoftirqd/212:20:022
32423994328,127cyclictest1651-21ntpd09:55:326
324179943210,84cyclictest0-21swapper/012:05:020
324179942786,338cyclictest0-21swapper/011:05:070
32422994250,84cyclictest0-21swapper/508:35:055
324219942542,83cyclictest31508-21ssh11:25:224
324189942483,338cyclictest0-21swapper/111:05:091
324229942340,380cyclictest0-21swapper/511:35:085
324239942242,84cyclictest0-21swapper/609:45:076
324239942181,84cyclictest0-21swapper/612:28:306
324229942081,84cyclictest0-21swapper/512:20:175
324229941980,84cyclictest0-21swapper/511:05:135
324239941879,84cyclictest0-21swapper/611:25:226
324259941733,381cyclictest0-21swapper/711:35:137
324239941775,84cyclictest121rcu_preempt10:15:186
324209941573,339cyclictest0-21swapper/312:20:163
324259941172,84cyclictest0-21swapper/710:15:047
324219941172,83cyclictest0-21swapper/412:05:094
324219941131,84cyclictest0-21swapper/411:15:224
324199941171,338cyclictest0-21swapper/208:35:142
324199941170,338cyclictest0-21swapper/210:40:122
324259941026,127cyclictest0-21swapper/708:35:047
324259941025,127cyclictest0-21swapper/709:45:067
324219941071,84cyclictest0-21swapper/411:05:074
324189940930,84cyclictest0-21swapper/110:40:021
324239940869,84cyclictest0-21swapper/612:20:166
324229940769,84cyclictest0-21swapper/511:15:215
3242599406109,127cyclictest0-21swapper/711:05:137
324239940566,84cyclictest0-21swapper/612:05:156
324239940562,211cyclictest65-21ksoftirqd/608:35:146
324229940567,84cyclictest0-21swapper/512:05:095
324219940566,84cyclictest30782-21runrttasks12:20:164
324259939959,338cyclictest0-21swapper/711:45:097
324179939915,42cyclictest0-21swapper/008:35:130
324189939817,126cyclictest0-21swapper/108:35:151
32421993821,43cyclictest0-21swapper/410:40:044
324239937840,83cyclictest0-21swapper/611:45:076
324229937783,84cyclictest57-21ksoftirqd/510:40:015
324259937475,126cyclictest0-21swapper/712:28:307
3242099370114,253cyclictest0-21swapper/309:45:133
324229936828,42cyclictest0-21swapper/512:28:325
324239936768,90cyclictest0-21swapper/610:40:016
324219936728,84cyclictest0-21swapper/409:45:134
324229936264,126cyclictest57-21ksoftirqd/511:45:145
324209935826,160cyclictest121rcu_preempt08:35:133
324209935599,126cyclictest121rcu_preempt10:40:133
324229935417,41cyclictest0-21swapper/509:45:125
324209933377,126cyclictest121rcu_preempt12:28:303
295892105100,2sleep20-21swapper/207:05:122
3197128857,27sleep40-21swapper/407:09:484
3175028745,7sleep70-21swapper/707:06:397
3186028250,28sleep60-21swapper/607:08:146
3171428252,27sleep10-21swapper/107:06:091
3168228150,27sleep50-21swapper/507:05:415
3179728050,27sleep00-21swapper/007:07:200
3177328048,28sleep30-21swapper/307:06:593
105792750,0sleep40-21swapper/408:20:124
38562690,0sleep40-21swapper/409:25:124
32419993410,23cyclictest0-21swapper/207:36:422
32419993310,17cyclictest0-21swapper/210:59:232
32419993310,0cyclictest0-21swapper/210:04:052
32419993310,0cyclictest0-21swapper/209:33:472
32419993310,0cyclictest0-21swapper/209:14:382
32419993227,4cyclictest0-21swapper/209:04:332
32419993210,21cyclictest0-21swapper/207:41:542
32419993210,21cyclictest0-21swapper/207:18:132
32419993210,21cyclictest0-21swapper/207:18:132
32419993126,5cyclictest0-21swapper/208:02:222
32419993026,4cyclictest0-21swapper/207:14:152
32419993025,4cyclictest0-21swapper/207:46:272
32425992910,18cyclictest0-21swapper/710:59:247
32425992910,18cyclictest0-21swapper/707:22:317
32419992924,4cyclictest0-21swapper/209:08:492
32425992828,0cyclictest0-21swapper/708:42:077
32425992828,0cyclictest0-21swapper/708:02:317
32425992810,18cyclictest0-21swapper/708:57:327
32425992810,18cyclictest0-21swapper/708:52:557
32425992810,18cyclictest0-21swapper/708:24:497
32425992810,18cyclictest0-21swapper/708:18:107
32425992810,0cyclictest0-21swapper/710:03:447
32425992810,0cyclictest0-21swapper/709:27:507
32425992810,0cyclictest0-21swapper/709:04:047
32425992810,0cyclictest0-21swapper/708:47:357
32425992810,0cyclictest0-21swapper/707:18:457
32425992810,0cyclictest0-21swapper/707:18:457
32423992810,18cyclictest0-21swapper/610:04:106
32423992810,18cyclictest0-21swapper/607:18:446
32423992810,18cyclictest0-21swapper/607:18:436
32423992810,17cyclictest0-21swapper/609:34:066
32423992810,17cyclictest0-21swapper/608:57:356
32423992810,17cyclictest0-21swapper/607:37:206
32420992828,0cyclictest0-21swapper/309:14:253
32420992827,0cyclictest0-21swapper/310:59:183
32420992810,18cyclictest0-21swapper/308:57:323
32420992810,18cyclictest0-21swapper/308:18:323
32420992810,18cyclictest0-21swapper/308:12:393
32420992810,18cyclictest0-21swapper/307:52:223
32420992810,18cyclictest0-21swapper/307:26:293
32420992810,18cyclictest0-21swapper/307:18:353
32420992810,18cyclictest0-21swapper/307:18:353
32420992810,0cyclictest0-21swapper/310:03:443
32420992810,0cyclictest0-21swapper/309:33:483
32420992810,0cyclictest0-21swapper/309:09:233
32420992810,0cyclictest0-21swapper/308:42:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional