You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 19:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jul 29, 2026 12:57:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5311997319,126cyclictest14246-21ssh09:29:436
53119971434,677cyclictest11623-21ssh11:32:356
531299710118,423cyclictest13709-21kworker/u16:012:18:347
53119970063,634cyclictest0-21swapper/609:20:226
530699677124,380cyclictest0-21swapper/111:37:361
53059967139,2cyclictest0-21swapper/010:47:040
530999670159,295cyclictest0-21swapper/412:10:034
53119965626,3cyclictest17127-21ssh09:11:006
53089965659,381cyclictest0-21swapper/309:42:263
53089964653,126cyclictest0-21swapper/310:22:553
53069964448,380cyclictest0-21swapper/110:23:391
5311996381,634cyclictest0-21swapper/610:27:216
53119963783,380cyclictest0-21swapper/612:29:206
5308996371,384cyclictest0-21swapper/312:07:133
53119963683,378cyclictest0-21swapper/610:20:316
530799636124,296cyclictest0-21swapper/209:27:472
5307996360,84cyclictest0-21swapper/210:27:292
531199629118,295cyclictest0-21swapper/611:40:106
531099628114,297cyclictest0-21swapper/509:31:375
531299627116,296cyclictest0-21swapper/709:25:507
53119962730,465cyclictest0-21swapper/611:58:406
530599627119,126cyclictest0-21swapper/009:27:470
530999626286,337cyclictest704-21nscd10:26:154
53119962428,381cyclictest0-21swapper/611:37:096
531099624117,253cyclictest27236-1kworker/u17:210:15:365
53059962369,84cyclictest121rcu_preempt10:24:560
53119962130,2cyclictest0-21swapper/609:32:136
53069962130,422cyclictest11915-21sshd09:25:391
53059961823,422cyclictest0-21swapper/009:41:380
53129961523,383cyclictest0-21swapper/710:47:037
53099961562,211cyclictest0-21swapper/409:25:564
53119961217,592cyclictest0-21swapper/611:47:076
530999612357,84cyclictest0-21swapper/411:47:064
530899611309,128cyclictest0-21swapper/311:57:043
53059961013,338cyclictest0-21swapper/012:37:100
53119960914,127cyclictest3083-21ssh12:44:446
53119960755,549cyclictest0-21swapper/610:16:266
530799607223,42cyclictest19634-21ssh10:47:142
5311996037,170cyclictest28305-21sh10:12:356
5311995953,169cyclictest0-21swapper/612:20:146
530999595342,43cyclictest0-21swapper/410:24:254
5312995940,84cyclictest0-21swapper/712:36:427
5312995940,84cyclictest0-21swapper/711:57:497
5312995940,126cyclictest17087-21ssh09:10:547
5308995940,84cyclictest0-21swapper/311:48:453
5307995940,85cyclictest0-21swapper/211:48:462
5305995940,84cyclictest0-21swapper/010:27:220
53109959382,338cyclictest10511-21ssh10:24:295
5310995930,84cyclictest0-21swapper/511:48:455
5308995935,373cyclictest0-21swapper/310:12:443
53089959183,126cyclictest121rcu_preempt11:32:543
530799591253,42cyclictest0-21swapper/212:43:342
530599591126,126cyclictest121rcu_preempt10:14:210
53089958978,508cyclictest0-21swapper/309:14:163
53119958734,550cyclictest0-21swapper/611:15:316
53119958734,550cyclictest0-21swapper/611:15:316
53099958779,126cyclictest0-21swapper/410:11:414
53089958574,381cyclictest0-21swapper/309:30:203
53129958436,337cyclictest0-21swapper/712:42:537
530599584285,84cyclictest0-21swapper/012:15:480
531299583157,210cyclictest121rcu_preempt10:22:047
53079958332,87cyclictest0-21swapper/212:09:332
530799583202,126cyclictest121rcu_preempt09:32:142
53109958231,384cyclictest0-21swapper/512:07:135
53129958132,338cyclictest0-21swapper/711:39:307
53079958026,381cyclictest0-21swapper/212:10:332
53099957971,126cyclictest121rcu_preempt11:50:124
53069957929,126cyclictest0-21swapper/110:19:261
53069957929,126cyclictest0-21swapper/109:14:371
53119957420,551cyclictest0-21swapper/612:10:056
53099957464,299cyclictest121rcu_preempt10:17:114
53099957319,342cyclictest0-21swapper/409:40:514
53059956920,303cyclictest0-21swapper/010:20:020
53079956858,126cyclictest0-21swapper/210:23:242
53109956712,338cyclictest0-21swapper/509:15:205
53099956718,134cyclictest0-21swapper/410:35:144
530799567144,126cyclictest22825-21ssh11:58:472
53069956718,84cyclictest0-21swapper/111:56:581
53099956353,507cyclictest0-21swapper/409:14:164
530699563139,295cyclictest9207-21sh12:09:331
530799562182,210cyclictest704-21nscd10:15:332
5307995562,126cyclictest0-21swapper/209:14:412
5311995542,41cyclictest0-21swapper/610:55:076
5311995542,41cyclictest0-21swapper/610:55:066
53099955183,465cyclictest0-21swapper/412:16:184
5305995510,84cyclictest0-21swapper/009:35:300
531199550124,423cyclictest0-21swapper/612:16:196
5309995501,298cyclictest0-21swapper/412:07:134
5308995490,126cyclictest0-21swapper/311:40:213
53129954840,338cyclictest0-21swapper/710:16:117
53089954881,465cyclictest0-21swapper/312:16:183
53089954734,296cyclictest0-21swapper/312:41:213
53079954783,211cyclictest0-21swapper/212:28:112
53129954632,296cyclictest0-21swapper/709:44:427
53099954678,338cyclictest0-21swapper/412:41:424
53069954640,295cyclictest23205-21runrttasks11:40:191
530699546162,380cyclictest22058-21nscd09:30:371
53099954478,84cyclictest121rcu_preempt11:38:314
530999544122,3cyclictest64450irq/122-eth010:46:384
53069954478,127cyclictest121rcu_preempt11:15:221
53069954478,127cyclictest121rcu_preempt11:15:221
53079954332,253cyclictest0-21swapper/212:20:212
53079954134,84cyclictest11864-21ssh12:30:142
53099954029,422cyclictest0-21swapper/411:57:564
53089953931,126cyclictest0-21swapper/311:37:093
53129953873,295cyclictest0-21swapper/709:33:217
531099536114,127cyclictest26101-21ssh12:37:035
530999536118,84cyclictest704-21nscd12:28:594
53119953424,507cyclictest0-21swapper/612:38:186
53069953322,422cyclictest0-21swapper/110:28:321
530699533111,295cyclictest5303-21cyclictest11:33:351
53059953368,211cyclictest0-21swapper/009:34:320
53129953124,84cyclictest0-21swapper/710:12:447
53069953165,126cyclictest0-21swapper/112:20:211
53079953021,127cyclictest121rcu_preempt09:45:082
53069952918,126cyclictest5303-21cyclictest12:41:521
53059952919,126cyclictest0-21swapper/012:10:020
531099527102,253cyclictest0-21swapper/509:04:145
53089952762,135cyclictest41-21ksoftirqd/311:04:543
53059952758,296cyclictest0-21swapper/011:57:290
53099952658,253cyclictest0-21swapper/411:33:464
53059952699,211cyclictest1173-21sh09:20:220
53059952618,126cyclictest26705-21kworker/u16:209:14:330
530599525101,83cyclictest121rcu_preempt12:28:580
53099952417,3cyclictest0-21swapper/412:38:384
53079952415,126cyclictest0-21swapper/209:00:242
53069952411,296cyclictest4075-21ssh09:43:201
53119952314,84cyclictest0-21swapper/612:09:436
53079952316,126cyclictest0-21swapper/210:14:262
53119952114,87cyclictest0-21swapper/611:50:246
53069952110,84cyclictest0-21swapper/110:55:071
53069952110,84cyclictest0-21swapper/110:55:071
5305995198,382cyclictest0-21swapper/012:42:100
53089951811,253cyclictest0-21swapper/309:35:213
53069951810,127cyclictest0-21swapper/110:46:281
53069951610,84cyclictest0-21swapper/110:14:151
5305995169,383cyclictest0-21swapper/012:30:150
53069951593,84cyclictest25-21ksoftirqd/111:48:511
53099951446,465cyclictest5303-21cyclictest09:32:364
53129951390,338cyclictest0-21swapper/710:28:427
5305995135,3cyclictest7062-21chrt12:07:130
5308995100,84cyclictest0-21swapper/310:16:253
5308995090,84cyclictest0-21swapper/310:27:293
5308995090,84cyclictest0-21swapper/309:27:463
5307995090,84cyclictest0-21swapper/212:18:062
53109950781,211cyclictest0-21swapper/510:10:375
5306995070,42cyclictest0-21swapper/112:17:331
531099505124,84cyclictest0-21swapper/511:33:045
53099950579,380cyclictest121rcu_preempt11:15:144
53099950579,380cyclictest121rcu_preempt11:15:144
53109950440,380cyclictest0-21swapper/509:27:355
53079950439,84cyclictest0-21swapper/212:38:132
530799503161,211cyclictest0-21swapper/209:43:212
53069950338,219cyclictest0-21swapper/109:02:061
530599503464,3cyclictest111rcuc/011:04:510
53119950233,127cyclictest0-21swapper/609:49:146
531199501416,83cyclictest631rcuc/610:46:436
53109950136,296cyclictest0-21swapper/512:42:405
531099501118,126cyclictest20279-21sh11:38:475
53069950137,254cyclictest0-21swapper/112:38:101
53119950074,423cyclictest0-21swapper/608:07:436
53079949933,84cyclictest0-21swapper/208:26:562
53069949976,84cyclictest131rcu_sched12:10:071
53069949933,84cyclictest0-21swapper/108:34:511
53119949832,126cyclictest0-21swapper/609:44:416
53119949830,465cyclictest0-21swapper/609:35:026
53109949875,125cyclictest0-21swapper/509:42:255
53089949770,126cyclictest0-21swapper/312:36:543
53059949729,258cyclictest0-21swapper/011:39:210
53109949632,212cyclictest0-21swapper/512:16:305
53119949527,465cyclictest0-21swapper/608:33:256
53109949470,380cyclictest0-21swapper/509:20:225
53059949470,84cyclictest0-21swapper/011:32:580
530999493321,83cyclictest0-21swapper/409:04:374
53079949268,211cyclictest0-21swapper/211:32:552
53079949226,83cyclictest0-21swapper/208:33:572
530799491110,126cyclictest121rcu_preempt11:38:312
53099948925,380cyclictest0-21swapper/409:20:284
53059948921,211cyclictest0-21swapper/009:04:510
530599489190,127cyclictest0-21swapper/008:33:350
531099488147,126cyclictest121rcu_preempt11:59:135
53129948617,297cyclictest0-21swapper/707:57:277
53109948662,84cyclictest0-21swapper/510:46:235
53079948659,212cyclictest0-21swapper/211:50:062
53079948621,252cyclictest0-21swapper/209:20:272
53119948563,338cyclictest0-21swapper/610:35:236
53099948521,87cyclictest0-21swapper/409:58:324
53129948414,296cyclictest0-21swapper/711:47:197
531099483141,339cyclictest5303-21cyclictest11:15:265
531099483141,339cyclictest5303-21cyclictest11:15:265
53069948315,126cyclictest0-21swapper/112:27:571
53059948357,211cyclictest0-21swapper/012:20:110
53129948259,260cyclictest0-21swapper/709:03:147
53109948255,295cyclictest121rcu_preempt12:30:025
53129948053,295cyclictest73-21ksoftirqd/712:29:537
53109948014,84cyclictest0-21swapper/510:58:225
53109948014,84cyclictest0-21swapper/510:58:225
530699480185,84cyclictest0-21swapper/111:04:461
53059948096,211cyclictest0-21swapper/011:40:180
53109947814,257cyclictest0-21swapper/509:11:315
530899478183,211cyclictest0-21swapper/312:29:153
530899477224,84cyclictest401ktimersoftd/310:39:083
53129947653,339cyclictest5303-21cyclictest10:35:237
530799476219,126cyclictest0-21swapper/208:07:362
530699476132,126cyclictest26704-21taskset07:42:001
5305994768,84cyclictest0-21swapper/010:35:210
5310994741,84cyclictest0-21swapper/508:26:565
53109947149,260cyclictest5303-21cyclictest11:05:025
53079947145,210cyclictest33-21ksoftirqd/209:35:202
531199469125,127cyclictest0-21swapper/609:01:016
5308994671,126cyclictest0-21swapper/310:47:263
5305994671,169cyclictest0-21swapper/009:58:360
531099466123,127cyclictest15193-21ssh10:27:005
5307994661,47cyclictest121rcu_preempt09:15:202
531299465125,338cyclictest0-21swapper/711:33:457
531099465124,338cyclictest0-21swapper/512:27:555
5309994651,7cyclictest0-21swapper/408:55:194
53129946483,84cyclictest0-21swapper/711:50:087
53119946336,127cyclictest0-21swapper/611:05:136
53129946279,127cyclictest0-21swapper/711:05:037
53079946177,171cyclictest121rcu_preempt11:15:142
53079946177,171cyclictest121rcu_preempt11:15:132
53119946035,126cyclictest20190-21ssh11:04:556
53119946034,423cyclictest0-21swapper/612:30:116
53109946079,126cyclictest0-21swapper/511:40:065
53119945933,127cyclictest0-21swapper/609:05:166
53099945934,211cyclictest0-21swapper/411:04:564
53069945937,256cyclictest0-21swapper/110:35:161
53129945835,169cyclictest6624-21ssh12:06:447
531299458116,339cyclictest0-21swapper/712:30:027
530899458117,338cyclictest0-21swapper/309:15:213
53059945835,84cyclictest0-21swapper/008:12:260
53069945735,256cyclictest0-21swapper/108:07:361
53089945633,338cyclictest0-21swapper/311:15:253
53089945633,338cyclictest0-21swapper/311:15:253
531299455115,338cyclictest0-21swapper/711:04:507
53109945533,254cyclictest0-21swapper/510:35:155
530899455280,85cyclictest0-21swapper/308:32:023
53069945529,295cyclictest0-21swapper/109:35:281
53059945533,42cyclictest0-21swapper/011:15:210
53059945533,42cyclictest0-21swapper/011:15:210
53119945429,422cyclictest0-21swapper/608:16:496
53109945432,255cyclictest0-21swapper/512:20:145
53099945474,126cyclictest13297-21diskmemload09:35:234
53079945431,256cyclictest0-21swapper/211:40:062
531299453113,338cyclictest1553-21runrttasks12:20:137
53069945373,296cyclictest0-21swapper/111:05:031
53069945332,337cyclictest0-21swapper/112:30:011
53069945331,255cyclictest0-21swapper/109:05:141
53099945230,338cyclictest0-21swapper/412:30:144
530699452112,338cyclictest0-21swapper/109:49:121
531099450109,338cyclictest0-21swapper/509:35:285
53099945028,2cyclictest0-21swapper/408:07:374
530999449110,337cyclictest0-21swapper/409:15:194
53129944825,338cyclictest23251-21/usr/sbin/munin09:35:307
531299448110,84cyclictest0-21swapper/708:34:377
531099448149,126cyclictest121rcu_preempt11:04:305
530899448107,338cyclictest0-21swapper/309:05:143
53119944721,423cyclictest0-21swapper/609:58:436
530699447107,338cyclictest0-21swapper/109:20:211
53069944663,380cyclictest0-21swapper/112:00:171
53129944562,380cyclictest0-21swapper/709:20:237
53089944565,295cyclictest0-21swapper/309:20:233
53059944527,211cyclictest8263-21taskset10:58:230
53059944527,211cyclictest8263-21taskset10:58:220
53129944421,256cyclictest0-21swapper/708:07:367
53079944218,84cyclictest0-21swapper/210:44:042
531299441102,84cyclictest10185-21sh11:15:237
531299441102,84cyclictest10185-21sh11:15:237
53109944120,303cyclictest0-21swapper/508:32:425
53129944018,338cyclictest0-21swapper/711:40:017
53099944016,84cyclictest0-21swapper/411:23:234
53079944018,2cyclictest0-21swapper/210:35:152
531299439143,215cyclictest12588-21ssh12:10:317
53099943955,380cyclictest0-21swapper/410:58:314
53099943955,380cyclictest0-21swapper/410:58:304
53079943917,2cyclictest0-21swapper/208:12:412
53109943816,255cyclictest0-21swapper/509:05:145
53099943854,253cyclictest0-21swapper/408:12:254
53079943815,85cyclictest0-21swapper/210:58:232
53079943815,85cyclictest0-21swapper/210:58:222
53109943614,211cyclictest0-21swapper/512:10:185
5309994348,253cyclictest0-21swapper/410:34:554
5309994348,253cyclictest0-21swapper/410:34:544
53079943395,335cyclictest0-21swapper/209:58:362
53129943147,381cyclictest0-21swapper/710:34:547
53129943147,381cyclictest0-21swapper/710:34:547
53129942989,85cyclictest0-21swapper/708:50:157
5308994286,256cyclictest11888-21ssh12:30:153
5311994271,423cyclictest0-21swapper/608:55:126
5305994263,169cyclictest0-21swapper/011:47:210
53129942583,339cyclictest0-21swapper/710:58:127
53129942583,339cyclictest0-21swapper/710:58:117
53129942483,338cyclictest0-21swapper/709:45:047
53119942483,338cyclictest0-21swapper/608:50:166
5310994241,42cyclictest0-21swapper/511:50:225
53089942483,338cyclictest0-21swapper/310:34:543
53089942483,338cyclictest0-21swapper/310:34:543
53079942483,338cyclictest0-21swapper/208:17:012
5307994242,84cyclictest0-21swapper/211:04:342
53109942383,337cyclictest0-21swapper/509:45:145
5309994231,255cyclictest0-21swapper/411:40:014
53089942383,338cyclictest0-21swapper/311:50:063
53089942382,338cyclictest0-21swapper/312:10:173
530899423123,211cyclictest0-21swapper/309:04:423
53069942383,338cyclictest0-21swapper/109:15:141
53059942283,84cyclictest0-21swapper/008:22:250
53129942182,84cyclictest0-21swapper/709:58:377
53129942141,297cyclictest0-21swapper/709:15:137
53089942180,338cyclictest0-21swapper/308:16:503
530899421122,126cyclictest41-21ksoftirqd/308:50:133
53069942181,338cyclictest0-21swapper/108:16:501
53099942036,84cyclictest121rcu_preempt12:20:204
53089942040,3cyclictest0-21swapper/310:58:063
53089942040,3cyclictest0-21swapper/310:58:063
53059942037,84cyclictest20656-21ssh11:05:040
53129941977,339cyclictest0-21swapper/708:16:497
53129941938,297cyclictest0-21swapper/710:43:547
53119941938,296cyclictest0-21swapper/609:15:126
53099941978,338cyclictest0-21swapper/412:00:164
53079941978,338cyclictest0-21swapper/208:55:202
53079941978,338cyclictest0-21swapper/208:22:262
53059941980,84cyclictest0-21swapper/008:55:190
53109941876,339cyclictest0-21swapper/510:34:555
53109941876,339cyclictest0-21swapper/510:34:545
53099941877,338cyclictest0-21swapper/408:34:364
53099941877,338cyclictest0-21swapper/408:22:254
53089941878,338cyclictest0-21swapper/309:49:133
53059941879,84cyclictest698-21ptp4l11:50:180
53109941777,338cyclictest0-21swapper/512:00:175
531099417163,84cyclictest561ktimersoftd/510:43:555
53089941776,338cyclictest0-21swapper/312:20:103
53129941535,296cyclictest1553-21runrttasks08:49:247
53109941575,338cyclictest0-21swapper/509:58:365
53069941575,338cyclictest0-21swapper/108:22:261
53119941474,337cyclictest0-21swapper/611:23:236
53089941473,338cyclictest0-21swapper/309:58:363
53069941473,211cyclictest0-21swapper/111:50:281
53059941475,84cyclictest0-21swapper/009:45:060
53129941374,84cyclictest0-21swapper/708:55:197
53109941333,42cyclictest0-21swapper/508:07:445
530899413156,254cyclictest401ktimersoftd/312:00:023
53059941375,84cyclictest0-21swapper/010:54:250
53129941270,126cyclictest121rcu_preempt11:23:237
53119941271,338cyclictest0-21swapper/610:43:576
53069941272,338cyclictest0-21swapper/108:50:161
53069941232,214cyclictest0-21swapper/109:58:311
53069941229,126cyclictest0-21swapper/110:44:101
53119941170,338cyclictest0-21swapper/612:00:176
53099941130,84cyclictest0-21swapper/408:27:174
53089941131,211cyclictest0-21swapper/308:55:193
53059941172,84cyclictest0-21swapper/008:17:000
53059941132,126cyclictest0-21swapper/012:00:020
53129940968,338cyclictest0-21swapper/710:54:247
53119940930,295cyclictest0-21swapper/607:57:216
53109940968,338cyclictest0-21swapper/508:55:195
53119940867,126cyclictest0-21swapper/608:12:326
53079940866,339cyclictest0-21swapper/211:05:012
53059940870,83cyclictest0-21swapper/009:05:130
53129940768,84cyclictest0-21swapper/712:00:167
53109940766,338cyclictest0-21swapper/508:23:095
53099940766,338cyclictest0-21swapper/409:45:054
53099940764,340cyclictest0-21swapper/409:05:134
531199406362,41cyclictest0-21swapper/608:22:516
53099940665,338cyclictest0-21swapper/408:16:494
53059940626,84cyclictest121rcu_preempt10:43:580
53099940567,211cyclictest121rcu_preempt08:50:144
53099940524,85cyclictest0-21swapper/410:54:254
53059940568,84cyclictest0-21swapper/009:15:150
53059940567,84cyclictest0-21swapper/008:50:150
53129940318,211cyclictest0-21swapper/708:26:557
53109940261,338cyclictest0-21swapper/508:16:495
53109940223,84cyclictest2319-21expr08:50:135
531099400314,84cyclictest551rcuc/511:23:245
53079940019,84cyclictest0-21swapper/210:34:552
53079940019,84cyclictest0-21swapper/210:34:552
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional