You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 22:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Sep 19, 2026 12:56:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
103029970066,296cyclictest57-21ksoftirqd/511:05:335
102999962530,592cyclictest17886-21diskmemload10:48:272
1030399624112,296cyclictest0-21swapper/610:54:136
102999962271,82cyclictest0-21swapper/210:26:082
102999961670,462cyclictest0-21swapper/210:21:372
1030299615107,126cyclictest0-21swapper/511:58:445
103049961199,381cyclictest0-21swapper/710:26:567
1029799607562,42cyclictest111rcuc/009:42:310
10301995921,42cyclictest0-21swapper/409:40:184
1030199592123,211cyclictest121rcu_preempt10:55:534
10300995921,296cyclictest0-21swapper/311:50:503
10299995921,544cyclictest0-21swapper/210:55:432
1030299588331,84cyclictest0-21swapper/510:44:175
1030299588331,84cyclictest0-21swapper/510:44:175
1030199588505,3cyclictest471rcuc/412:23:014
1030199587505,2cyclictest471rcuc/410:20:434
103049958535,381cyclictest0-21swapper/710:20:237
1030399585116,211cyclictest25267-21ssh10:24:356
1030099585117,465cyclictest31139-1kworker/u17:211:47:343
102999958532,471cyclictest0-21swapper/212:00:132
103039958029,381cyclictest0-21swapper/610:33:026
103029958029,126cyclictest0-21swapper/511:17:185
1030299579113,211cyclictest0-21swapper/510:12:045
1030499576235,338cyclictest15495-21kworker/u16:310:43:397
1030499576235,338cyclictest15495-21kworker/u16:310:43:397
102979957325,126cyclictest0-21swapper/011:06:320
1030299571486,3cyclictest551rcuc/510:35:325
1030299568185,126cyclictest0-21swapper/511:30:165
1029799562140,177cyclictest704-21nscd10:45:490
102999956010,2cyclictest0-21swapper/212:06:322
102999955241,508cyclictest0-21swapper/211:50:002
102999955042,126cyclictest0-21swapper/208:50:132
1030499548291,254cyclictest721ktimersoftd/711:51:467
102979954839,127cyclictest0-21swapper/010:17:000
103049954778,254cyclictest121rcu_preempt11:16:527
103019954634,296cyclictest0-21swapper/410:45:524
102999954639,261cyclictest0-21swapper/210:50:562
1029899545203,254cyclictest0-21swapper/110:43:231
1029899545203,254cyclictest0-21swapper/110:43:231
102999954331,508cyclictest0-21swapper/211:18:482
102999954277,384cyclictest10113-1kworker/u17:011:59:472
102999954235,504cyclictest0-21swapper/210:32:352
102999954034,164cyclictest0-21swapper/211:10:052
102999953933,123cyclictest0-21swapper/211:31:382
102999953932,345cyclictest0-21swapper/212:37:262
103039953869,253cyclictest0-21swapper/610:13:176
102999953730,343cyclictest0-21swapper/212:23:382
102989953730,42cyclictest0-21swapper/110:53:421
102999953630,343cyclictest0-21swapper/212:42:492
102999953531,384cyclictest0-21swapper/212:26:292
103049953425,126cyclictest0-21swapper/710:45:517
103039953464,337cyclictest0-21swapper/609:42:386
1030399534490,42cyclictest631rcuc/610:19:326
103019953428,84cyclictest0-21swapper/411:17:404
102999953326,427cyclictest0-21swapper/210:12:362
102989953326,125cyclictest0-21swapper/111:18:551
102979953364,381cyclictest0-21swapper/011:58:220
1029799533150,127cyclictest31762-1kworker/u17:010:28:470
1030199532234,295cyclictest31520-21kworker/u16:210:12:054
102989953062,337cyclictest0-21swapper/110:14:331
1030199529314,84cyclictest0-21swapper/410:32:374
102989952921,211cyclictest0-21swapper/110:32:281
102979952817,465cyclictest10295-21cyclictest10:40:210
102979952817,465cyclictest10295-21cyclictest10:40:200
10304995271,17cyclictest0-21swapper/711:47:347
102999952716,508cyclictest0-21swapper/211:51:212
102989952359,92cyclictest0-21swapper/110:49:131
102979952316,84cyclictest0-21swapper/012:14:060
1029999521140,379cyclictest10295-21cyclictest11:06:062
102999952111,507cyclictest0-21swapper/207:59:222
102979952113,126cyclictest0-21swapper/010:14:240
103009951911,296cyclictest0-21swapper/312:18:113
103019951711,87cyclictest0-21swapper/410:07:264
103009951795,211cyclictest0-21swapper/311:05:023
10299995177,507cyclictest0-21swapper/210:00:242
10298995134,127cyclictest0-21swapper/110:36:041
102999951041,382cyclictest0-21swapper/209:59:482
1029999508124,296cyclictest0-21swapper/209:41:372
102999950739,301cyclictest0-21swapper/210:36:102
1030099506166,126cyclictest121rcu_preempt10:59:203
102989950581,211cyclictest25-21ksoftirqd/110:25:521
102979950579,126cyclictest7788-21sh11:31:110
102989950438,211cyclictest0-21swapper/111:20:021
102989950438,211cyclictest0-21swapper/111:20:021
102989950336,126cyclictest31520-21kworker/u16:209:44:521
103019950238,254cyclictest0-21swapper/412:03:004
1029899502124,376cyclictest0-21swapper/108:01:091
1029899502124,376cyclictest0-21swapper/108:01:091
1029899502124,376cyclictest0-21swapper/108:01:091
102999950136,386cyclictest0-21swapper/210:07:082
103029950035,175cyclictest18810-21ssh12:14:065
1030299500120,127cyclictest57-21ksoftirqd/511:53:175
103019950077,169cyclictest0-21swapper/412:42:504
1029799500123,39cyclictest0-21swapper/010:53:250
102979949933,211cyclictest0-21swapper/011:04:200
103029949775,84cyclictest0-21swapper/510:34:575
103019949670,210cyclictest49-21ksoftirqd/409:59:484
102999949631,381cyclictest0-21swapper/210:43:132
102999949631,381cyclictest0-21swapper/210:43:132
103039949472,257cyclictest10295-21cyclictest12:27:476
1030399494237,255cyclictest641ktimersoftd/611:20:026
1030399494237,255cyclictest641ktimersoftd/611:20:026
102999949270,253cyclictest0-21swapper/212:14:062
103049949126,84cyclictest10295-21cyclictest11:31:357
1030099491108,381cyclictest0-21swapper/309:41:083
102999949121,466cyclictest0-21swapper/211:29:592
103049949066,422cyclictest0-21swapper/710:57:257
1029899490234,84cyclictest8616-1kworker/u17:211:32:361
102979949064,253cyclictest0-21swapper/010:35:400
102989948921,380cyclictest0-21swapper/110:58:501
1030499488235,87cyclictest721ktimersoftd/709:39:127
103049948820,465cyclictest0-21swapper/710:36:047
103019948820,338cyclictest0-21swapper/411:52:074
102999948823,296cyclictest0-21swapper/212:33:022
102999948823,165cyclictest0-21swapper/208:20:522
103049948722,381cyclictest0-21swapper/710:07:067
103049948717,338cyclictest0-21swapper/710:53:247
103049948618,465cyclictest0-21swapper/707:56:017
102979948621,41cyclictest0-21swapper/011:24:210
102979948621,41cyclictest0-21swapper/011:24:200
102979948620,84cyclictest0-21swapper/012:32:500
1030399485148,171cyclictest6190-21ssh12:06:366
1030499484100,381cyclictest721ktimersoftd/709:41:087
103019948463,41cyclictest121rcu_preempt11:48:374
1029899484104,254cyclictest0-21swapper/111:10:031
1030199483100,169cyclictest121rcu_preempt12:37:104
103009948315,293cyclictest0-21swapper/310:36:303
102979948357,210cyclictest9-21ksoftirqd/011:51:300
102989948214,295cyclictest0-21swapper/108:45:381
103019948113,379cyclictest0-21swapper/410:37:084
103049948052,338cyclictest0-21swapper/712:10:307
102999948014,170cyclictest0-21swapper/210:17:552
102989948015,258cyclictest0-21swapper/111:52:061
102979948053,211cyclictest0-21swapper/007:15:240
103009947914,211cyclictest0-21swapper/310:29:513
1029799478223,253cyclictest101ktimersoftd/010:32:290
102979947712,303cyclictest0-21swapper/009:39:360
102989947649,296cyclictest0-21swapper/112:03:551
103039947594,85cyclictest0-21swapper/612:42:506
102979947510,256cyclictest0-21swapper/008:24:470
10301994725,341cyclictest0-21swapper/410:54:304
10300994693,84cyclictest0-21swapper/310:12:543
10299994691,126cyclictest0-21swapper/208:02:422
10299994691,126cyclictest0-21swapper/208:02:412
10299994691,126cyclictest0-21swapper/208:02:412
103049946840,253cyclictest0-21swapper/711:07:107
10300994683,261cyclictest0-21swapper/310:30:503
103019946783,169cyclictest49-21ksoftirqd/411:32:154
10298994662,43cyclictest0-21swapper/112:42:231
102979946580,211cyclictest9-21ksoftirqd/010:57:410
103039946482,84cyclictest0-21swapper/610:36:046
103029946442,256cyclictest1578-21lldpd07:55:515
1030199464420,42cyclictest471rcuc/408:00:234
1030199464420,42cyclictest471rcuc/408:00:234
1030199464420,42cyclictest471rcuc/408:00:234
1029899464378,84cyclictest241ktimersoftd/112:27:351
1030299463166,126cyclictest121rcu_preempt10:59:395
103019946278,211cyclictest49-21ksoftirqd/411:07:384
103019946239,338cyclictest0-21swapper/407:19:404
1029999462119,340cyclictest0-21swapper/209:49:112
102989946234,295cyclictest0-21swapper/112:18:051
1029899462121,338cyclictest0-21swapper/107:59:251
103049946134,338cyclictest0-21swapper/710:16:547
1030399461119,339cyclictest0-21swapper/610:43:486
1030399461119,339cyclictest0-21swapper/610:43:486
103019946140,255cyclictest0-21swapper/411:04:494
103019946140,255cyclictest0-21swapper/410:17:554
1030199461378,3cyclictest471rcuc/410:29:194
102999946138,249cyclictest11424-21runrttasks09:39:522
102989946177,127cyclictest25-21ksoftirqd/111:49:421
103049946033,296cyclictest0-21swapper/712:32:517
103039946076,219cyclictest0-21swapper/610:28:466
102999946034,423cyclictest0-21swapper/208:49:572
1029999460121,84cyclictest0-21swapper/211:04:312
102989946079,84cyclictest7694-1kworker/u17:011:04:511
102989946037,256cyclictest0-21swapper/110:06:381
1029899460121,336cyclictest0-21swapper/110:21:561
1029899460120,337cyclictest0-21swapper/110:16:351
103029945937,3cyclictest16396-21idleruntime-cro10:00:005
103019945938,255cyclictest0-21swapper/407:57:594
102999945937,255cyclictest0-21swapper/211:23:592
102999945937,255cyclictest0-21swapper/211:23:592
103029945836,48cyclictest0-21swapper/510:00:255
1029999458117,338cyclictest0-21swapper/207:15:242
103039945777,135cyclictest0-21swapper/610:49:186
1030399457369,85cyclictest631rcuc/611:05:336
103029945729,126cyclictest0-21swapper/509:38:355
1030199457374,3cyclictest471rcuc/410:41:314
1030199457374,3cyclictest471rcuc/410:41:314
103009945734,85cyclictest0-21swapper/312:06:363
103009945734,256cyclictest0-21swapper/310:50:573
1030499456116,338cyclictest0-21swapper/710:34:007
1030299456114,339cyclictest17507-21runrttasks10:19:295
103019945634,84cyclictest0-21swapper/412:27:324
103029945533,2cyclictest0-21swapper/507:19:395
1030299455155,85cyclictest121rcu_preempt09:41:205
103009945528,169cyclictest0-21swapper/310:22:283
102979945575,164cyclictest9-21ksoftirqd/010:07:220
103039945432,177cyclictest0-21swapper/608:50:006
1030399454112,168cyclictest0-21swapper/607:59:326
103049945330,256cyclictest0-21swapper/711:42:367
103009945330,256cyclictest0-21swapper/312:27:473
102989945230,3cyclictest0-21swapper/109:39:421
1029899452112,338cyclictest0-21swapper/111:38:021
103049945130,84cyclictest0-21swapper/711:03:577
1030399451112,84cyclictest0-21swapper/610:56:036
103009945129,2cyclictest0-21swapper/307:19:393
102979945127,258cyclictest0-21swapper/012:02:160
103009945067,85cyclictest28889-21rm10:46:403
103049944927,256cyclictest0-21swapper/711:23:487
103049944927,256cyclictest0-21swapper/711:23:487
1030399449109,85cyclictest0-21swapper/608:00:076
1030399449109,85cyclictest0-21swapper/608:00:076
1030399449109,85cyclictest0-21swapper/608:00:076
102989944965,215cyclictest0-21swapper/112:14:121
103049944825,253cyclictest0-21swapper/708:49:417
103039944824,295cyclictest1551-21snmpd12:02:166
102989944826,41cyclictest23419-21munin-run08:25:021
1029899448107,338cyclictest0-21swapper/111:59:151
103049944724,260cyclictest0-21swapper/708:01:047
103049944724,260cyclictest0-21swapper/708:01:047
103049944724,260cyclictest0-21swapper/708:01:047
103049944666,296cyclictest15850irq/123-ahci[0009:59:537
103029944625,210cyclictest24600-21ssh12:16:335
103019944620,423cyclictest0-21swapper/412:14:154
102979944662,295cyclictest0-21swapper/011:47:350
102979944624,256cyclictest0-21swapper/011:19:500
103049944523,2cyclictest0-21swapper/712:27:477
103039944522,259cyclictest0-21swapper/611:37:516
103029944560,211cyclictest561ktimersoftd/510:26:285
103029944523,255cyclictest0-21swapper/510:06:385
102999944519,423cyclictest0-21swapper/212:17:042
102979944523,253cyclictest26688-21ssh12:18:210
103049944422,256cyclictest0-21swapper/710:14:427
1030399444146,126cyclictest121rcu_preempt11:04:086
102989944320,43cyclictest0-21swapper/112:22:361
103029944220,256cyclictest0-21swapper/510:22:095
103009944219,256cyclictest0-21swapper/307:55:513
103009944161,84cyclictest0-21swapper/310:07:263
102989944157,211cyclictest241ktimersoftd/110:00:341
103009944056,210cyclictest10295-21cyclictest10:41:173
103009944056,210cyclictest10295-21cyclictest10:41:173
102979943919,289cyclictest0-21swapper/011:29:470
103049943816,2cyclictest0-21swapper/712:06:367
103039943816,2cyclictest0-21swapper/611:19:496
103029943816,2cyclictest0-21swapper/509:17:025
1030299438139,126cyclictest121rcu_preempt08:23:515
1030099438101,253cyclictest0-21swapper/312:42:233
1030099438101,171cyclictest0-21swapper/311:59:573
102979943854,127cyclictest9-21ksoftirqd/010:22:440
103049943753,381cyclictest0-21swapper/712:03:387
103029943797,337cyclictest0-21swapper/510:52:285
103019943796,338cyclictest0-21swapper/411:14:534
103009943799,92cyclictest0-21swapper/311:19:533
102989943753,126cyclictest31537-21ssh11:09:111
103049943695,338cyclictest0-21swapper/711:59:307
103049943613,256cyclictest0-21swapper/712:23:587
1030399436180,126cyclictest121rcu_preempt11:29:526
103039943614,219cyclictest0-21swapper/609:59:576
103009943512,253cyclictest0-21swapper/310:15:083
102979943513,2cyclictest0-21swapper/012:06:360
103009943310,3cyclictest0-21swapper/309:17:013
103009942949,84cyclictest0-21swapper/311:32:243
103009942779,84cyclictest0-21swapper/308:24:193
10304994264,255cyclictest0-21swapper/712:17:177
10301994265,2cyclictest0-21swapper/412:17:174
10297994251,84cyclictest0-21swapper/011:10:040
103049942384,84cyclictest0-21swapper/711:14:477
103049942383,338cyclictest0-21swapper/710:00:587
103039942381,126cyclictest65-21ksoftirqd/610:06:086
103029942382,84cyclictest0-21swapper/511:04:585
103029942382,338cyclictest0-21swapper/510:46:025
103019942382,338cyclictest0-21swapper/408:24:294
1030099423127,43cyclictest121rcu_preempt11:23:453
1030099423127,43cyclictest121rcu_preempt11:23:453
102999942384,84cyclictest0-21swapper/209:17:012
102999942339,381cyclictest0-21swapper/211:43:012
10298994231,2cyclictest0-21swapper/109:17:021
10297994231,85cyclictest0-21swapper/008:50:020
103039942236,127cyclictest0-21swapper/608:24:576
103019942281,338cyclictest0-21swapper/411:38:134
102979942283,84cyclictest0-21swapper/012:42:270
103039942182,84cyclictest0-21swapper/611:32:466
103019942180,338cyclictest0-21swapper/412:32:154
103019942180,338cyclictest0-21swapper/408:48:454
103009942182,84cyclictest0-21swapper/312:10:213
103009942182,84cyclictest0-21swapper/308:01:103
103009942182,84cyclictest0-21swapper/308:01:093
103009942182,84cyclictest0-21swapper/308:01:093
103009942179,211cyclictest0-21swapper/312:01:103
102999942134,213cyclictest0-21swapper/211:38:022
102979942182,84cyclictest0-21swapper/012:23:140
103039942082,84cyclictest0-21swapper/612:32:296
103029942081,84cyclictest0-21swapper/512:22:515
103029942081,84cyclictest0-21swapper/511:38:025
1030299420163,84cyclictest0-21swapper/512:03:325
103019942040,295cyclictest0-21swapper/411:59:184
103009942082,84cyclictest0-21swapper/311:05:403
10300994204,161cyclictest121rcu_preempt12:32:163
103049941940,296cyclictest0-21swapper/711:29:537
103039941980,84cyclictest0-21swapper/611:50:386
103029941981,83cyclictest0-21swapper/508:00:085
103029941981,83cyclictest0-21swapper/508:00:075
103029941981,83cyclictest0-21swapper/508:00:075
103009941980,84cyclictest0-21swapper/308:50:153
102979941981,84cyclictest0-21swapper/009:49:170
102979941980,84cyclictest0-21swapper/008:50:150
103039941876,211cyclictest13932-21awk12:10:306
103029941879,84cyclictest0-21swapper/512:42:325
103009941879,84cyclictest18790-21diskmemload10:00:263
103009941879,84cyclictest0-21swapper/309:38:533
102979941880,84cyclictest0-21swapper/012:26:030
103049941778,84cyclictest0-21swapper/712:43:127
103029941775,211cyclictest57-21ksoftirqd/512:33:035
1030299417118,126cyclictest57-21ksoftirqd/512:28:085
103019941777,338cyclictest0-21swapper/409:39:434
103019941738,296cyclictest0-21swapper/411:42:364
103049941636,256cyclictest0-21swapper/711:38:027
103039941677,84cyclictest0-21swapper/610:00:266
103039941576,84cyclictest0-21swapper/612:17:216
103029941577,84cyclictest25255-21ssh11:23:465
103029941577,84cyclictest25255-21ssh11:23:465
103019941535,214cyclictest0-21swapper/410:00:264
103039941375,217cyclictest0-21swapper/612:37:306
102989941228,127cyclictest0-21swapper/112:06:381
103049941170,338cyclictest0-21swapper/708:50:147
103039941130,255cyclictest0-21swapper/609:39:376
103029941173,84cyclictest0-21swapper/508:48:285
103009941173,84cyclictest0-21swapper/311:38:023
103049941071,84cyclictest0-21swapper/709:17:017
103029941071,84cyclictest0-21swapper/511:47:355
103019941031,255cyclictest0-21swapper/411:26:094
102979941026,177cyclictest0-21swapper/007:59:100
103039940929,207cyclictest0-21swapper/611:48:046
103019940828,256cyclictest0-21swapper/411:24:214
103019940828,256cyclictest0-21swapper/411:24:214
103019940828,256cyclictest0-21swapper/409:17:014
103009940768,84cyclictest0-21swapper/312:22:393
103009940768,84cyclictest0-21swapper/308:48:283
102979940769,84cyclictest0-21swapper/011:38:030
103049940632,338cyclictest0-21swapper/708:20:587
103039940665,84cyclictest0-21swapper/609:17:016
103009940667,84cyclictest0-21swapper/311:29:593
102979940523,254cyclictest0-21swapper/008:01:410
102979940523,254cyclictest0-21swapper/008:01:400
102979940523,254cyclictest0-21swapper/008:01:400
103039940465,84cyclictest0-21swapper/611:59:156
1030399404236,48cyclictest25583-1kworker/u17:212:24:126
1029999404195,127cyclictest121rcu_preempt09:54:582
103039940364,84cyclictest0-21swapper/608:50:156
102989940261,253cyclictest0-21swapper/109:54:571
103049940121,295cyclictest0-21swapper/712:37:257
1029799401100,126cyclictest9-21ksoftirqd/010:01:010
103019940016,87cyclictest121rcu_preempt09:49:174
102989939962,134cyclictest0-21swapper/108:50:151
103039939818,260cyclictest0-21swapper/611:10:056
103029939899,211cyclictest10295-21cyclictest08:50:145
103019939860,171cyclictest6189-21sh12:06:364
102979939697,126cyclictest16422-21awk10:00:020
1030099395350,42cyclictest391rcuc/311:14:593
102989939352,126cyclictest0-21swapper/112:32:041
1029899392135,126cyclictest121rcu_preempt09:59:581
102979939215,288cyclictest0-21swapper/009:16:520
102989939111,218cyclictest0-21swapper/111:42:361
102999939015,165cyclictest0-21swapper/208:05:122
103029938647,84cyclictest0-21swapper/511:29:575
103009938583,127cyclictest41-21ksoftirqd/308:05:113
103029938243,84cyclictest0-21swapper/512:06:355
1029899379122,126cyclictest0-21swapper/112:37:201
103029937841,2cyclictest0-21swapper/511:14:485
102989937884,91cyclictest0-21swapper/111:29:591
1030399377120,254cyclictest0-21swapper/609:49:166
103029937739,3cyclictest0-21swapper/511:42:355
103029937537,84cyclictest0-21swapper/509:49:115
103049937335,254cyclictest0-21swapper/707:15:247
103039937032,169cyclictest0-21swapper/609:12:136
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional