You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 19:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Aug 09, 2026 12:53:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126199974321,591cyclictest0-21swapper/011:44:060
12619997140,36cyclictest0-21swapper/010:44:450
126199969920,676cyclictest0-21swapper/009:09:110
126199969157,597cyclictest0-21swapper/010:14:580
12619996792,126cyclictest20384-21diskmemload11:09:110
126219966935,2cyclictest0-21swapper/210:10:342
1262399665111,381cyclictest0-21swapper/409:01:274
126269965622,2cyclictest0-21swapper/710:10:357
126199965416,126cyclictest0-21swapper/011:45:120
12619996360,84cyclictest17424-21perf09:05:000
126209963481,380cyclictest0-21swapper/110:09:261
1262199627163,253cyclictest0-21swapper/209:56:122
126209962734,126cyclictest0-21swapper/109:57:501
126239962273,126cyclictest14977-21ssh09:56:114
1262599619108,84cyclictest0-21swapper/611:33:426
126259961867,84cyclictest121rcu_preempt11:39:576
126229961764,253cyclictest41-21ksoftirqd/311:20:003
126199961360,550cyclictest0-21swapper/012:26:300
1262299610103,2cyclictest1553-21runrttasks10:10:343
12626995940,84cyclictest0-21swapper/711:01:207
12623995940,84cyclictest0-21swapper/412:33:044
126219959241,126cyclictest0-21swapper/210:24:442
12619995911,126cyclictest0-21swapper/012:09:230
12619995910,3cyclictest0-21swapper/009:58:210
126199958979,337cyclictest0-21swapper/011:01:450
1262399588119,295cyclictest121rcu_preempt10:56:504
126239958738,83cyclictest121rcu_preempt10:09:294
1262399587289,295cyclictest26129-21ssh12:41:084
1262099587203,254cyclictest0-21swapper/111:25:171
126199958431,507cyclictest18768-21taskset11:10:110
126199958128,550cyclictest0-21swapper/011:25:520
126219958068,127cyclictest0-21swapper/209:43:522
1262499578197,292cyclictest0-21swapper/509:04:275
126219957623,338cyclictest0-21swapper/211:43:282
1262499574106,211cyclictest0-21swapper/511:01:045
1262599572106,211cyclictest0-21swapper/611:08:166
1262099571106,126cyclictest11972-21runrttasks12:34:371
126219957021,295cyclictest0-21swapper/211:01:422
1262399567227,337cyclictest64450irq/122-eth012:08:404
126259956393,381cyclictest0-21swapper/610:09:256
126249956314,384cyclictest0-21swapper/510:10:355
126239956294,296cyclictest14397-21ssh11:42:324
126209955952,296cyclictest0-21swapper/110:55:591
12619995586,549cyclictest0-21swapper/011:57:510
12621995572,339cyclictest0-21swapper/211:57:352
12625995534,383cyclictest0-21swapper/610:10:346
126209955245,3cyclictest9512-21ssh10:10:351
126249955144,126cyclictest0-21swapper/511:06:425
1262099551123,338cyclictest0-21swapper/110:24:381
126239955040,336cyclictest0-21swapper/409:42:084
1262699549294,253cyclictest15850irq/123-ahci[0011:25:237
126199954982,422cyclictest6986-21sh11:20:230
12619995491,469cyclictest226982sleep009:44:150
126219954741,83cyclictest121rcu_preempt12:08:392
126199954781,126cyclictest0-21swapper/011:34:130
126269954334,169cyclictest0-21swapper/709:04:567
126239954333,507cyclictest0-21swapper/411:50:174
126209954335,84cyclictest0-21swapper/112:19:031
126199954131,84cyclictest3071-21kworker/u16:311:54:420
126239954075,168cyclictest0-21swapper/411:03:194
126199953971,380cyclictest0-21swapper/012:19:030
126239953871,464cyclictest0-21swapper/412:26:234
1262599537110,255cyclictest0-21swapper/612:07:336
126199953727,507cyclictest0-21swapper/012:34:340
126219953528,296cyclictest0-21swapper/208:35:522
126199953268,84cyclictest0-21swapper/008:17:200
1262199531445,84cyclictest311rcuc/210:45:182
126239953063,464cyclictest0-21swapper/409:05:164
1262499529102,211cyclictest7732-21sh10:45:165
126239952960,254cyclictest121rcu_preempt11:39:424
1262299529274,253cyclictest17876-21df_abs11:45:133
126199952922,259cyclictest0-21swapper/010:23:580
126209952758,296cyclictest0-21swapper/111:54:381
126229952620,84cyclictest0-21swapper/311:43:433
126199952616,379cyclictest0-21swapper/010:55:360
126219952357,211cyclictest0-21swapper/208:19:132
126229952214,84cyclictest0-21swapper/311:34:443
126199952296,296cyclictest121rcu_preempt12:02:110
1262399521264,126cyclictest11076-21sh10:12:144
126229952110,296cyclictest0-21swapper/311:03:493
12619995199,295cyclictest0-21swapper/010:50:110
126229951810,126cyclictest0-21swapper/308:36:043
12619995188,507cyclictest0-21swapper/007:31:460
126229951610,7cyclictest0-21swapper/311:26:393
12625995157,86cyclictest0-21swapper/608:40:146
126259951545,338cyclictest0-21swapper/610:20:576
12624995101,84cyclictest0-21swapper/511:25:175
126239950983,423cyclictest0-21swapper/411:25:284
12622995090,84cyclictest17792-21sh11:09:363
1262199509171,84cyclictest0-21swapper/211:19:532
126269950882,211cyclictest73-21ksoftirqd/710:09:317
1262599508336,84cyclictest0-21swapper/611:26:476
12624995080,83cyclictest0-21swapper/511:57:445
126239950882,423cyclictest0-21swapper/411:09:054
126209950880,89cyclictest0-21swapper/111:34:451
12620995081,211cyclictest0-21swapper/111:42:521
126209950784,126cyclictest121rcu_preempt09:06:421
12619995070,84cyclictest29271-21ssh09:14:200
126209950637,339cyclictest0-21swapper/111:06:551
126229950582,84cyclictest0-21swapper/310:09:303
1262299505122,126cyclictest121rcu_preempt12:09:053
126219950578,211cyclictest33-21ksoftirqd/210:09:382
1262599504124,296cyclictest0-21swapper/609:56:106
126219950439,84cyclictest121rcu_preempt10:57:332
1262199504246,84cyclictest0-21swapper/209:14:422
1262699503290,84cyclictest0-21swapper/708:35:357
126249950234,465cyclictest0-21swapper/512:25:455
126199950234,465cyclictest0-21swapper/011:35:110
1262399501247,252cyclictest481ktimersoftd/408:16:164
126219950134,127cyclictest0-21swapper/211:25:272
126199950133,465cyclictest15936-21sh12:35:350
1262299500286,84cyclictest20384-21diskmemload11:39:523
126219950076,211cyclictest0-21swapper/211:49:222
126199950032,465cyclictest0-21swapper/012:40:310
126269949977,338cyclictest0-21swapper/711:33:057
126269949934,126cyclictest0-21swapper/708:16:387
126249949976,380cyclictest0-21swapper/512:34:375
126219949933,126cyclictest0-21swapper/207:32:552
1262399498241,254cyclictest64450irq/122-eth010:45:314
126229949874,211cyclictest41-21ksoftirqd/312:15:253
126219949832,126cyclictest0-21swapper/211:50:282
126199949829,253cyclictest0-21swapper/010:08:480
1262299497157,338cyclictest12617-21cyclictest09:57:423
126259949574,210cyclictest0-21swapper/609:07:196
1262699494324,46cyclictest0-21swapper/711:49:337
126249949429,210cyclictest0-21swapper/510:21:585
126199949426,465cyclictest0-21swapper/007:35:120
1262299493110,126cyclictest41-21ksoftirqd/308:19:143
126259949126,43cyclictest121rcu_preempt11:40:516
126229949125,211cyclictest0-21swapper/312:41:093
126259948922,296cyclictest0-21swapper/612:26:116
126249948921,84cyclictest0-21swapper/512:35:535
1262199489405,3cyclictest321ktimersoftd/212:26:032
126199948925,165cyclictest0-21swapper/008:37:390
1262699488147,338cyclictest12617-21cyclictest11:15:157
1262599488191,166cyclictest0-21swapper/611:03:506
126219948762,211cyclictest0-21swapper/212:20:092
126209948658,211cyclictest0-21swapper/112:26:291
126259948520,126cyclictest0-21swapper/610:57:156
126269948458,423cyclictest0-21swapper/710:58:117
126259948356,211cyclictest65-21ksoftirqd/609:05:026
126229948357,175cyclictest0-21swapper/310:22:143
126229947956,84cyclictest0-21swapper/310:56:363
126229947894,211cyclictest0-21swapper/311:15:133
126229947821,203cyclictest10773-21ssh12:33:323
126219947899,122cyclictest33-21ksoftirqd/211:35:062
12619994758,464cyclictest0-21swapper/010:25:120
12619994758,464cyclictest0-21swapper/010:25:120
12622994745,211cyclictest41-21ksoftirqd/309:05:023
126219947490,295cyclictest0-21swapper/212:34:022
12625994738,260cyclictest0-21swapper/611:57:306
126259947343,253cyclictest0-21swapper/612:20:076
1262599473130,127cyclictest121rcu_preempt10:50:236
1262399473133,83cyclictest121rcu_preempt11:20:154
1262099472391,79cyclictest241ktimersoftd/110:45:071
126249947150,337cyclictest0-21swapper/511:49:125
126249947149,338cyclictest0-21swapper/510:57:455
1262099470170,126cyclictest121rcu_preempt11:14:291
12622994690,211cyclictest41-21ksoftirqd/309:45:113
126219946985,126cyclictest33-21ksoftirqd/209:01:012
12619994691,295cyclictest0-21swapper/010:38:510
126269946844,126cyclictest0-21swapper/710:22:157
12626994671,85cyclictest0-21swapper/712:25:467
12620994670,84cyclictest0-21swapper/109:05:001
1262599465124,338cyclictest0-21swapper/608:19:126
1262099465210,253cyclictest0-21swapper/111:02:341
1262099465124,338cyclictest6994-21ssh11:20:251
1262599464124,338cyclictest0-21swapper/609:54:146
1262599464122,339cyclictest0-21swapper/607:33:106
126239946480,381cyclictest0-21swapper/411:57:314
126239946439,126cyclictest0-21swapper/411:49:144
1262599463122,126cyclictest0-21swapper/612:02:226
126259946282,253cyclictest0-21swapper/612:15:356
1262499462292,168cyclictest561ktimersoftd/512:02:105
1262199462121,339cyclictest0-21swapper/211:14:562
1262599461120,338cyclictest0-21swapper/608:35:276
126249946181,296cyclictest0-21swapper/510:09:315
126239946134,169cyclictest0-21swapper/411:34:474
126229946134,168cyclictest0-21swapper/311:57:363
126219946175,211cyclictest33-21ksoftirqd/212:19:092
1262199461119,168cyclictest0-21swapper/212:41:082
126269946082,375cyclictest0-21swapper/710:45:257
1262699460119,338cyclictest0-21swapper/711:14:157
1262599459118,338cyclictest0-21swapper/611:14:286
1262199459117,339cyclictest0-21swapper/210:15:062
126209945975,211cyclictest0-21swapper/111:49:371
126209945937,41cyclictest0-21swapper/112:08:341
126199945933,84cyclictest28467-21ssh11:15:160
126249945875,127cyclictest57-21ksoftirqd/511:43:295
126239945834,338cyclictest0-21swapper/412:19:284
126229945882,120cyclictest0-21swapper/311:14:553
126219945875,253cyclictest2779-1kworker/u17:210:45:002
126209945874,169cyclictest25736-21ssh12:40:471
1262099458117,338cyclictest0-21swapper/111:58:351
126269945735,2cyclictest0-21swapper/709:44:587
1262699457119,254cyclictest15850irq/123-ahci[0009:57:487
126259945772,212cyclictest25206-21unixbench-2d12:40:216
1262599457116,338cyclictest0-21swapper/610:15:066
1262399457116,338cyclictest0-21swapper/410:38:514
126219945730,212cyclictest0-21swapper/211:33:242
1261999457117,338cyclictest0-21swapper/010:45:240
126259945672,169cyclictest6868-21ssh10:45:066
1262599456115,339cyclictest0-21swapper/612:34:406
1262599456115,338cyclictest0-21swapper/611:45:236
126269945533,84cyclictest0-21swapper/711:35:077
126209945570,211cyclictest0-21swapper/108:15:561
126269945431,168cyclictest0-21swapper/712:35:317
1262199454113,338cyclictest0-21swapper/211:09:532
126209945477,80cyclictest0-21swapper/110:45:001
1262699453112,338cyclictest1651-21ntpd11:20:247
126249945331,256cyclictest0-21swapper/508:16:125
126249945329,259cyclictest0-21swapper/507:55:175
126249945226,84cyclictest0-21swapper/507:33:025
126229945267,211cyclictest1551-21snmpd09:42:233
126219945230,169cyclictest0-21swapper/209:05:292
126269945130,2cyclictest0-21swapper/711:40:127
126239945124,424cyclictest0-21swapper/410:24:284
1262299451112,126cyclictest41-21ksoftirqd/311:50:203
126249945026,126cyclictest0-21swapper/508:40:145
126239945069,208cyclictest0-21swapper/407:55:174
126239945067,211cyclictest49-21ksoftirqd/411:14:104
126239945066,381cyclictest0-21swapper/408:36:504
1262199450109,338cyclictest0-21swapper/209:54:152
126269944967,338cyclictest0-21swapper/712:09:247
126249944963,169cyclictest57-21ksoftirqd/509:56:535
126239944928,255cyclictest0-21swapper/407:32:534
126239944928,254cyclictest64450irq/122-eth010:45:014
126209944763,169cyclictest121rcu_preempt09:14:191
126259944624,3cyclictest0-21swapper/610:45:016
126249944421,85cyclictest0-21swapper/511:20:295
126249944419,168cyclictest0-21swapper/512:09:175
1262199443148,211cyclictest3533-21df_abs08:40:142
126269944220,256cyclictest0-21swapper/711:08:587
126249944258,296cyclictest57-21ksoftirqd/509:05:305
126209944220,168cyclictest25-21ksoftirqd/112:35:531
1262099442103,84cyclictest0-21swapper/110:50:291
1262099442103,84cyclictest0-21swapper/109:44:311
126259944014,126cyclictest0-21swapper/611:20:126
126229943812,127cyclictest41-21ksoftirqd/310:50:123
126229943795,126cyclictest41-21ksoftirqd/312:25:503
126219943715,3cyclictest0-21swapper/207:23:362
126199943720,206cyclictest9542-21rm09:54:140
126269943694,339cyclictest0-21swapper/712:34:407
126269943657,83cyclictest0-21swapper/711:58:107
1262599436138,126cyclictest121rcu_preempt09:44:086
126269943594,338cyclictest0-21swapper/709:54:147
126199943514,2cyclictest0-21swapper/008:40:150
126229943495,84cyclictest0-21swapper/309:07:463
126219943249,169cyclictest121rcu_preempt10:50:292
12619994327,126cyclictest9472-21/usr/sbin/munin07:55:160
12623994319,255cyclictest0-21swapper/411:15:134
12621994308,219cyclictest0-21swapper/207:55:142
12619994297,126cyclictest0-21swapper/012:20:040
12623994287,255cyclictest0-21swapper/412:01:234
126229942788,84cyclictest9544-21ssh09:54:143
126209942746,84cyclictest28063-21/usr/sbin/munin11:15:131
1261999427388,37cyclictest101ktimersoftd/010:15:060
12621994264,256cyclictest0-21swapper/212:01:222
126269942483,338cyclictest0-21swapper/712:40:257
126269942483,210cyclictest73-21ksoftirqd/707:32:457
12626994242,126cyclictest0-21swapper/710:44:397
126249942484,338cyclictest0-21swapper/509:43:575
126249942438,211cyclictest57-21ksoftirqd/508:35:395
12626994231,2cyclictest0-21swapper/711:54:507
126239942383,338cyclictest0-21swapper/407:16:394
126209942386,171cyclictest0-21swapper/112:01:221
1262499422123,127cyclictest57-21ksoftirqd/512:18:575
126229942283,84cyclictest0-21swapper/307:50:303
126259942178,340cyclictest0-21swapper/610:38:516
126259942141,3cyclictest0-21swapper/611:15:146
126249942181,338cyclictest0-21swapper/511:54:505
126249942180,338cyclictest0-21swapper/510:38:505
126239942182,337cyclictest0-21swapper/412:35:374
126229942182,84cyclictest0-21swapper/307:30:253
1262599420376,42cyclictest631rcuc/611:50:296
126239942039,257cyclictest0-21swapper/410:50:184
126219942079,338cyclictest0-21swapper/210:38:502
126229941980,84cyclictest0-21swapper/312:01:533
126229941938,42cyclictest0-21swapper/307:55:163
126209941976,127cyclictest25-21ksoftirqd/107:34:441
126199941978,338cyclictest0-21swapper/007:16:390
126249941877,338cyclictest0-21swapper/511:10:145
126249941877,338cyclictest0-21swapper/510:44:545
126219941836,84cyclictest121rcu_preempt09:45:112
126209941877,168cyclictest0-21swapper/108:39:121
1262699417334,3cyclictest711rcuc/710:50:137
126229941778,84cyclictest0-21swapper/310:45:083
126209941733,211cyclictest0-21swapper/112:20:071
126249941678,302cyclictest0-21swapper/512:41:065
126229941677,84cyclictest0-21swapper/312:35:393
126249941474,337cyclictest31888-21ssh11:34:435
126229941476,84cyclictest0-21swapper/309:14:203
126249941372,338cyclictest0-21swapper/511:15:145
126249941272,338cyclictest0-21swapper/511:39:595
126249941272,338cyclictest0-21swapper/510:25:125
126249941272,338cyclictest0-21swapper/510:25:125
126249941271,338cyclictest0-21swapper/509:54:155
126269941069,338cyclictest0-21swapper/710:25:137
126269941069,338cyclictest0-21swapper/710:25:137
126249941030,169cyclictest0-21swapper/510:50:135
126229941071,84cyclictest0-21swapper/310:38:513
126219940968,338cyclictest0-21swapper/211:20:172
126239940867,338cyclictest0-21swapper/409:20:054
126209940868,84cyclictest0-21swapper/111:35:051
126199940867,338cyclictest0-21swapper/008:02:290
126239940565,338cyclictest0-21swapper/410:15:054
126259940422,126cyclictest0-21swapper/607:55:156
126229940465,84cyclictest0-21swapper/310:25:133
126229940465,84cyclictest0-21swapper/310:25:133
126269940366,170cyclictest0-21swapper/712:01:237
126199940362,338cyclictest0-21swapper/007:50:320
126239940223,255cyclictest0-21swapper/412:20:104
126239940161,338cyclictest0-21swapper/410:25:054
126239940161,338cyclictest0-21swapper/410:25:054
126229940162,84cyclictest0-21swapper/312:20:083
126269940059,338cyclictest0-21swapper/712:19:267
126269940018,84cyclictest0-21swapper/709:05:257
126229940061,84cyclictest0-21swapper/310:44:463
126199940059,338cyclictest0-21swapper/009:45:110
1262599398144,250cyclictest641ktimersoftd/612:35:316
126269939556,84cyclictest0-21swapper/707:16:387
126239939516,216cyclictest0-21swapper/407:23:364
126209939556,84cyclictest0-21swapper/110:38:561
126259939415,3cyclictest0-21swapper/607:23:366
126249939251,338cyclictest0-21swapper/509:14:305
126209939253,84cyclictest0-21swapper/107:35:121
126239939111,42cyclictest0-21swapper/409:14:214
1262199391305,84cyclictest311rcuc/212:35:392
126259938484,127cyclictest0-21swapper/610:25:146
126259938484,127cyclictest0-21swapper/610:25:146
126259938444,85cyclictest12617-21cyclictest07:35:126
126209938385,89cyclictest121rcu_preempt07:55:161
126269938241,296cyclictest0-21swapper/707:55:167
12624993812,84cyclictest17276-21ssh12:20:065
1262199379123,253cyclictest32402-21/usr/sbin/munin10:25:122
1262199379123,253cyclictest32402-21/usr/sbin/munin10:25:112
126259937841,3cyclictest0-21swapper/607:50:316
126239937880,126cyclictest121rcu_preempt09:45:104
1262599376119,255cyclictest0-21swapper/609:45:116
1262599376119,254cyclictest0-21swapper/609:14:266
126209937680,84cyclictest0-21swapper/110:25:051
126209937680,84cyclictest0-21swapper/110:25:051
1262099376120,253cyclictest0-21swapper/109:20:051
126239937476,295cyclictest0-21swapper/407:50:294
126239937433,338cyclictest0-21swapper/408:20:114
126209937478,84cyclictest0-21swapper/110:15:051
126249937373,169cyclictest0-21swapper/507:50:295
126199937335,256cyclictest0-21swapper/008:20:120
126269937228,126cyclictest0-21swapper/709:14:397
126219937235,217cyclictest0-21swapper/207:35:022
126269937134,43cyclictest24700-21/usr/sbin/munin09:45:137
126259937133,3cyclictest0-21swapper/607:16:406
126209937175,84cyclictest9546-21ssh09:54:151
126209937175,84cyclictest0-21swapper/109:45:111
126269936931,2cyclictest0-21swapper/712:20:107
126239936725,339cyclictest0-21swapper/408:40:154
126219936729,168cyclictest0-21swapper/208:20:122
1262399366110,125cyclictest28627-21/usr/sbin/munin07:35:124
126249936425,84cyclictest0-21swapper/509:20:055
126249935920,84cyclictest0-21swapper/510:15:075
126269935819,84cyclictest0-21swapper/710:38:527
126269935617,84cyclictest0-21swapper/708:40:137
126249935213,84cyclictest0-21swapper/509:45:125
126249935213,84cyclictest0-21swapper/508:02:305
126219935213,84cyclictest0-21swapper/209:20:052
126229935154,84cyclictest0-21swapper/307:35:113
126209935013,171cyclictest0-21swapper/107:16:401
12624993489,84cyclictest0-21swapper/507:35:125
126269934411,120cyclictest0-21swapper/710:15:057
12624993445,84cyclictest0-21swapper/508:20:115
12626993434,84cyclictest0-21swapper/709:20:047
1262699343224,37cyclictest0-21swapper/707:23:357
12622993431,169cyclictest0-21swapper/310:15:063
12625993401,84cyclictest0-21swapper/608:20:126
12626993390,84cyclictest0-21swapper/708:20:127
126249933781,126cyclictest0-21swapper/507:16:395
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional