You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 14:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Sep 15, 2026 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102769911569,8cyclictest181rcu_preempt00:01:141
995321116,15sleep00-21swapper/019:07:050
10276991072,79cyclictest4380-21ssh23:29:491
102769910565,12cyclictest181rcu_preempt00:29:321
102769910552,9cyclictest181rcu_preempt21:44:141
102769910142,15cyclictest10264-21cyclictest20:54:351
102729910135,31cyclictest0-21swapper/021:31:040
1765221000,6sleep30-21swapper/322:57:343
938929913,56sleep18776-21/usr/sbin/munin19:05:021
10276999949,12cyclictest181rcu_preempt19:54:481
10276999750,12cyclictest181rcu_preempt19:29:471
10276999632,24cyclictest0-21swapper/120:04:481
291082950,7sleep30-21swapper/322:22:083
291082950,7sleep30-21swapper/322:22:083
10276999563,13cyclictest181rcu_preempt22:53:441
10276999350,8cyclictest181rcu_preempt00:24:141
10284999275,9cyclictest0-21swapper/223:44:502
1027699923,52cyclictest10455-21apt-get20:49:261
10284999170,11cyclictest0-21swapper/219:14:142
10276999172,11cyclictest200-21systemd-journal21:14:121
10276999156,13cyclictest181rcu_preempt21:15:391
10276999131,26cyclictest0-21swapper/123:46:221
10284998969,9cyclictest0-21swapper/221:34:152
10276998963,8cyclictest181rcu_preempt21:35:231
10276998963,8cyclictest181rcu_preempt21:35:231
10276998951,15cyclictest181rcu_preempt23:24:481
10276998951,15cyclictest181rcu_preempt23:24:481
10284998847,25cyclictest10264-21cyclictest00:13:222
10276998849,16cyclictest181rcu_preempt19:52:171
10276998849,16cyclictest181rcu_preempt19:52:171
1027699882,62cyclictest13087-21latency_hist23:44:151
1027699882,62cyclictest13087-21latency_hist23:44:151
10272998811,36cyclictest343-21runrttasks20:59:380
10276998729,25cyclictest0-21swapper/121:49:481
892628616,35sleep20-21swapper/219:04:342
10284998639,13cyclictest0-21swapper/200:19:342
10276998660,11cyclictest181rcu_preempt23:24:121
10276998646,12cyclictest181rcu_preempt19:19:451
10276998632,30cyclictest0-21swapper/121:04:341
10276998632,12cyclictest0-21swapper/119:39:391
10276998632,12cyclictest0-21swapper/119:39:391
10276998625,9cyclictest181rcu_preempt23:54:351
10276998625,9cyclictest181rcu_preempt23:54:351
10272998624,36cyclictest0-21swapper/023:55:160
10272998624,36cyclictest0-21swapper/023:55:160
1029099853,44cyclictest0-21swapper/323:54:273
1029099853,44cyclictest0-21swapper/323:54:273
10276998557,13cyclictest181rcu_preempt20:24:321
10276998557,13cyclictest181rcu_preempt20:24:321
10276998539,14cyclictest359-21snmpd00:09:491
10276998529,25cyclictest0-21swapper/100:24:281
10276998529,25cyclictest0-21swapper/100:24:281
10272998520,35cyclictest2491-21ssh22:31:480
10272998517,25cyclictest0-21swapper/021:39:230
10276998429,29cyclictest0-21swapper/121:30:581
10276998355,9cyclictest181rcu_preempt21:25:051
10276998355,8cyclictest181rcu_preempt19:29:151
10276998333,29cyclictest0-21swapper/122:27:491
10276998330,20cyclictest0-21swapper/123:13:511
10276998328,32cyclictest0-21swapper/123:19:151
10276998328,26cyclictest0-21swapper/122:08:511
10272998318,38cyclictest0-21swapper/023:30:130
10276998232,10cyclictest0-21swapper/122:19:141
10276998230,29cyclictest0-21swapper/122:19:341
10276998230,29cyclictest0-21swapper/122:19:341
10276998221,29cyclictest0-21swapper/119:09:221
10276998218,20cyclictest0-21swapper/122:30:121
1027299822,23cyclictest5869-21apt-get20:34:260
10284998110,31cyclictest39-21ksoftirqd/223:14:082
10276998145,12cyclictest181rcu_preempt22:44:361
10276998145,12cyclictest181rcu_preempt22:44:361
10276998139,12cyclictest181rcu_preempt20:09:581
10276998129,21cyclictest0-21swapper/100:04:291
10276998128,13cyclictest0-21swapper/119:39:161
10276998128,13cyclictest0-21swapper/119:39:161
10276998123,27cyclictest0-21swapper/123:34:181
10276998123,27cyclictest0-21swapper/123:34:181
10276998050,8cyclictest181rcu_preempt00:15:371
10276998050,8cyclictest181rcu_preempt00:15:371
10276998029,30cyclictest0-21swapper/123:01:171
10276998028,13cyclictest0-21swapper/121:59:371
10276998028,13cyclictest0-21swapper/121:59:371
10284997949,7cyclictest181rcu_preempt22:16:562
10284997944,7cyclictest181rcu_preempt22:39:432
10284997916,23cyclictest371rcuc/200:00:492
10276997929,27cyclictest0-21swapper/119:14:191
10276997926,31cyclictest0-21swapper/120:34:321
10276997920,31cyclictest0-21swapper/122:39:211
10276997920,18cyclictest0-21swapper/121:21:211
1027299794,29cyclictest26623-21ssh22:18:350
1028499782,33cyclictest39-21ksoftirqd/222:00:412
1028499782,33cyclictest39-21ksoftirqd/222:00:412
10276997846,11cyclictest181rcu_preempt20:16:411
10276997846,11cyclictest181rcu_preempt20:16:411
10276997842,9cyclictest181rcu_preempt20:34:151
10276997842,9cyclictest181rcu_preempt20:34:151
10276997819,29cyclictest0-21swapper/123:52:511
10272997834,16cyclictest0-21swapper/000:27:490
10272997834,16cyclictest0-21swapper/000:27:490
10276997739,11cyclictest181rcu_preempt20:02:261
10276997724,29cyclictest0-21swapper/123:06:391
10276997723,27cyclictest0-21swapper/121:54:521
10276997720,26cyclictest0-21swapper/119:49:121
10276997720,26cyclictest0-21swapper/119:49:121
10276997715,34cyclictest0-21swapper/121:03:181
1027299774,28cyclictest2643-21ssh23:26:160
1027299774,28cyclictest2643-21ssh23:26:160
10272997719,11cyclictest20276-21latency_hist21:14:140
10284997655,15cyclictest6877-21latency_hist23:34:142
10284997637,18cyclictest20298-21df_inode23:55:222
10284997637,18cyclictest20298-21df_inode23:55:222
10284997630,23cyclictest39-21ksoftirqd/200:34:432
10284997630,23cyclictest39-21ksoftirqd/200:34:432
10276997643,10cyclictest181rcu_preempt22:09:371
10276997641,8cyclictest181rcu_preempt21:46:471
10272997657,12cyclictest21195-21/usr/sbin/munin22:09:400
10284997558,11cyclictest26436-21awk00:04:442
10284997547,8cyclictest181rcu_preempt21:10:322
10284997545,23cyclictest24048-21kworker/u19:1+nfsiod23:53:022
10284997534,20cyclictest14367-21diskstats20:59:342
10284997534,10cyclictest20660-21df21:14:302
1028499752,34cyclictest39-21ksoftirqd/222:12:462
10276997553,9cyclictest181rcu_preempt22:54:401
10276997553,7cyclictest181rcu_preempt22:34:461
10276997527,26cyclictest0-21swapper/100:36:251
10276997527,26cyclictest0-21swapper/100:36:251
1027299759,23cyclictest14109-21ssh22:50:580
1027299752,28cyclictest28689-21ssh23:15:050
1027299752,27cyclictest31421-21apt-get00:14:240
1027299752,27cyclictest31421-21apt-get00:14:240
10272997517,32cyclictest0-21swapper/023:19:500
10272997516,8cyclictest0-21swapper/019:34:210
10272997516,8cyclictest0-21swapper/019:34:210
10284997457,10cyclictest28552-21unixbench_singl23:14:462
10284997452,16cyclictest14121-21latency_hist20:59:152
1028499744,28cyclictest39-21ksoftirqd/200:30:052
10284997438,11cyclictest10264-21cyclictest20:32:572
10284997438,11cyclictest10264-21cyclictest20:32:572
10284997432,21cyclictest30012-21unin-run20:09:132
10276997427,20cyclictest0-21swapper/120:44:291
1027299748,24cyclictest17172-21ssh22:02:030
1027299748,24cyclictest17172-21ssh22:02:030
1027299747,29cyclictest16693-21awk22:54:510
1027299743,23cyclictest15240-21ssh23:46:540
10284997358,10cyclictest10264-21cyclictest20:24:282
10284997358,10cyclictest10264-21cyclictest20:24:282
10284997344,8cyclictest181rcu_preempt21:41:422
10284997315,8cyclictest181rcu_preempt21:38:152
10284997315,8cyclictest181rcu_preempt21:38:152
10276997332,13cyclictest0-21swapper/120:39:381
10272997330,17cyclictest6133-21sh22:38:440
10272997323,17cyclictest0-21swapper/022:07:580
1029099726,37cyclictest0-21swapper/323:29:303
10284997238,9cyclictest181rcu_preempt23:02:292
10284997236,21cyclictest359-21snmpd23:26:032
10284997236,21cyclictest359-21snmpd23:26:032
1028499723,27cyclictest39-21ksoftirqd/220:50:222
10276997228,23cyclictest0-21swapper/120:19:361
10276997228,23cyclictest0-21swapper/120:19:361
10272997256,10cyclictest7430-21mailstats22:39:450
10272997255,11cyclictest16609-21apt-get23:50:310
1027299725,28cyclictest26470-21rm00:04:450
1027299722,29cyclictest25140-21ntp_states23:09:410
10284997153,13cyclictest27117-21kworker/u19:2+nfsiod00:15:412
10284997153,13cyclictest27117-21kworker/u19:2+nfsiod00:15:412
10284997150,15cyclictest27967-21unixbench_singl19:59:502
10284997132,18cyclictest19996-21ssh22:06:392
10284997131,9cyclictest181rcu_preempt20:38:422
10284997111,30cyclictest39-21ksoftirqd/222:24:452
1027299719,22cyclictest30587-21ssh00:11:510
1027299716,20cyclictest0-21swapper/023:07:140
10272997155,11cyclictest10264-21cyclictest23:00:370
10272997152,13cyclictest700-21kernelversion21:34:370
10272997152,13cyclictest700-21kernelversion21:34:370
10272997140,23cyclictest2532-21apt-get00:19:290
1018427110,36sleep30-21swapper/319:09:163
10284997051,14cyclictest21729-21kworker/u17:0+events_unbound22:24:122
10284997051,14cyclictest21729-21kworker/u17:0+events_unbound22:24:122
10284997048,12cyclictest0-21swapper/219:24:342
10284997041,7cyclictest181rcu_preempt20:10:232
10284997041,10cyclictest181rcu_preempt22:29:402
10284997039,7cyclictest181rcu_preempt22:46:082
10284997039,7cyclictest181rcu_preempt22:46:082
10284997038,8cyclictest181rcu_preempt23:05:022
10284997034,16cyclictest9128-21ssh23:37:112
10284997034,16cyclictest9128-21ssh23:37:112
10284997033,9cyclictest181rcu_preempt21:04:462
10284997032,8cyclictest181rcu_preempt21:51:362
1028499701,34cyclictest39-21ksoftirqd/223:21:022
10284997013,32cyclictest39-21ksoftirqd/221:27:312
10284997010,26cyclictest39-21ksoftirqd/220:14:472
10284997010,26cyclictest39-21ksoftirqd/220:14:472
10272997051,13cyclictest1397-21kernelversion20:19:360
10272997051,13cyclictest1397-21kernelversion20:19:360
10272997017,23cyclictest26787-21ssh21:24:300
10272997012,33cyclictest11200-21seq21:52:020
10284996953,10cyclictest25617-21fschecks_time19:54:352
10284996952,9cyclictest0-21swapper/221:19:442
10284996951,11cyclictest10264-21cyclictest22:35:292
10284996943,8cyclictest181rcu_preempt19:34:412
10284996943,8cyclictest181rcu_preempt19:34:412
10284996939,8cyclictest181rcu_preempt19:14:512
10284996938,20cyclictest24584-21wc19:49:472
10284996938,20cyclictest24584-21wc19:49:472
10284996931,8cyclictest181rcu_preempt23:40:502
10284996931,8cyclictest181rcu_preempt23:40:502
10284996929,9cyclictest181rcu_preempt19:39:592
10284996929,9cyclictest181rcu_preempt19:39:592
10284996914,18cyclictest39-21ksoftirqd/200:29:152
10284996914,18cyclictest39-21ksoftirqd/200:29:152
10272996945,18cyclictest11149-21ssh23:40:330
10272996945,18cyclictest11149-21ssh23:40:330
10272996914,18cyclictest21901-21cron19:44:110
10272996914,18cyclictest21901-21cron19:44:110
10272996911,32cyclictest8987-21munin-run21:49:120
10284996849,12cyclictest9168-21latency_hist21:49:152
10272996850,12cyclictest23115-21unixbench_singl19:44:480
10272996850,12cyclictest23115-21unixbench_singl19:44:480
10272996836,22cyclictest27608-21processes19:59:460
10272996818,7cyclictest0-21swapper/022:44:180
10272996818,7cyclictest0-21swapper/022:44:180
10272996813,23cyclictest17316-21/usr/sbin/munin19:29:480
10272996812,19cyclictest25331-21ssh00:03:480
10272996810,23cyclictest11446-21ssh00:34:240
10272996810,23cyclictest11446-21ssh00:34:240
10272996810,22cyclictest14226-21rm21:57:130
1028499676,28cyclictest39-21ksoftirqd/219:44:382
1028499676,28cyclictest39-21ksoftirqd/219:44:382
1028499671,27cyclictest39-21ksoftirqd/220:39:432
1027299676,25cyclictest24061-21fschecks_time19:49:340
1027299676,25cyclictest24061-21fschecks_time19:49:340
10272996753,8cyclictest0-21swapper/020:59:120
10272996751,10cyclictest21010-21ssh21:14:400
10272996712,26cyclictest4803-21taskset20:29:430
10272996712,26cyclictest4803-21taskset20:29:430
10272996712,22cyclictest10348-21taskset00:32:020
10284996648,12cyclictest17165-21diskmemload22:54:522
10284996638,19cyclictest18753-21latency_hist19:34:152
1028499663,28cyclictest39-21ksoftirqd/221:55:432
10284996627,7cyclictest181rcu_preempt19:21:292
1027299669,21cyclictest26247-21wc19:54:480
10272996641,20cyclictest30154-21apt22:24:270
10272996641,19cyclictest28694-21ssh22:20:590
10272996641,19cyclictest28694-21ssh22:20:590
10272996640,19cyclictest25080-21kworker/u17:2+nfsiod21:23:400
10272996636,20cyclictest12298-21modprobe20:54:120
1027299663,27cyclictest4131-21date20:29:140
1027299663,27cyclictest4131-21date20:29:140
10272996613,17cyclictest15713-21/usr/sbin/munin19:24:380
10272996612,18cyclictest8713-21rm23:36:000
10272996612,18cyclictest8713-21rm23:36:000
1028499652,27cyclictest39-21ksoftirqd/222:54:022
1027299656,37cyclictest12466-21/usr/sbin/munin19:14:370
10272996547,12cyclictest524-21in:imuxsock20:09:130
1027299654,23cyclictest894-21latency_hist20:19:150
1027299654,23cyclictest894-21latency_hist20:19:150
10272996515,15cyclictest16930-21sshd21:06:250
10272996511,18cyclictest14105-21/usr/sbin/munin19:19:320
1029099642,36cyclictest0-21swapper/323:40:213
1029099642,36cyclictest0-21swapper/323:40:213
10284996414,22cyclictest39-21ksoftirqd/220:44:312
294322630,6sleep30-21swapper/300:09:443
1029099633,42cyclictest901-21kworker/3:1+events23:38:483
1029099633,42cyclictest901-21kworker/3:1+events23:38:483
1028499632,29cyclictest39-21ksoftirqd/220:19:442
1028499632,29cyclictest39-21ksoftirqd/220:19:442
1027299637,23cyclictest0-21swapper/020:39:290
10272996318,7cyclictest0-21swapper/019:09:350
10272996312,20cyclictest31538-21seq20:13:470
1027299623,22cyclictest9109-21dpkg20:44:230
1029099593,37cyclictest901-21kworker/3:1+events21:09:463
1029099592,37cyclictest9469-21taskset21:49:293
267552570,7sleep30-21swapper/321:24:243
1029099569,32cyclictest0-21swapper/323:50:033
1029099569,25cyclictest0-21swapper/320:49:263
1029099563,38cyclictest14507-21chrt00:39:163
1029099563,38cyclictest14507-21chrt00:39:163
1029099553,36cyclictest23755-21taskset21:19:343
1029099553,28cyclictest901-21kworker/3:1+events22:29:143
1029099552,40cyclictest3557-21chrt00:19:503
1029099544,40cyclictest16143-21taskset23:49:133
1029099543,39cyclictest27885-21taskset19:59:493
1029099543,37cyclictest10476-21taskset20:49:123
1029099543,36cyclictest901-21kworker/3:1+events19:34:273
1029099543,36cyclictest901-21kworker/3:1+events19:34:273
1029099542,36cyclictest901-21kworker/3:1+events22:12:493
1029099533,37cyclictest7170-21chrt21:44:473
1029099533,37cyclictest3543-21taskset20:24:473
1029099533,37cyclictest3543-21taskset20:24:473
1029099533,37cyclictest2527-21chrt20:24:143
1029099533,37cyclictest2527-21chrt20:24:143
1029099533,36cyclictest5836-21chrt22:37:523
1029099533,36cyclictest507-21chrt21:34:333
1029099533,36cyclictest507-21chrt21:34:333
1029099523,36cyclictest2092-21chrt23:24:493
1029099523,36cyclictest2092-21chrt23:24:493
1029099523,35cyclictest14073-21taskset21:56:473
1029099523,34cyclictest25618-21chrt19:54:353
1029099523,32cyclictest13048-21chrt20:54:393
1029099522,36cyclictest32454-21chrt21:34:133
1029099522,35cyclictest24418-21chrt19:49:453
1029099522,35cyclictest24418-21chrt19:49:453
1029099513,37cyclictest27430-21chrt00:06:203
1029099513,35cyclictest763-21taskset20:19:123
1029099513,35cyclictest763-21taskset20:19:123
1029099513,34cyclictest7294-21taskset22:39:433
1029099512,34cyclictest25333-21taskset00:03:483
1029099503,38cyclictest14950-21chrt22:53:203
1029099503,34cyclictest16767-21chrt19:25:273
1029099503,32cyclictest5733-21chrt20:34:143
1029099503,32cyclictest5733-21chrt20:34:143
1029099502,35cyclictest24248-21taskset22:14:263
1029099502,35cyclictest19154-21taskset22:59:413
1029099502,33cyclictest8259-21chrt20:39:493
1029099502,32cyclictest15539-21chrt21:59:353
1029099502,32cyclictest15539-21chrt21:59:353
1029099493,36cyclictest901-21kworker/3:1+events00:33:213
1029099493,33cyclictest27420-21chrt23:14:153
1029099493,33cyclictest1419-21taskset22:29:463
1029099493,32cyclictest6593-21chrt20:34:473
1029099493,30cyclictest10955-21taskset19:09:403
1029099492,39cyclictest901-21kworker/3:1+events21:41:243
1029099484,33cyclictest27462-21chrt23:14:193
1029099483,30cyclictest8295-21chrt00:29:143
1029099483,30cyclictest8295-21chrt00:29:143
1029099482,33cyclictest21349-21chrt21:14:473
1029099474,33cyclictest1197-21chrt00:16:253
1029099474,33cyclictest1197-21chrt00:16:253
1029099463,33cyclictest21999-21taskset19:44:143
1029099463,33cyclictest21999-21taskset19:44:143
1029099463,32cyclictest16311-21taskset21:04:393
1029099463,32cyclictest14010-21chrt19:19:153
1029099463,31cyclictest19381-21chrt22:04:543
1029099463,30cyclictest901-21kworker/3:1+events22:44:383
1029099463,30cyclictest901-21kworker/3:1+events22:44:383
1029099462,33cyclictest32183-21taskset23:21:293
1029099462,31cyclictest14206-21chrt20:59:243
1029099434,28cyclictest23372-21taskset19:47:263
1029099434,28cyclictest23372-21taskset19:47:263
1029099433,28cyclictest901-21kworker/3:1+events19:19:373
1029099433,27cyclictest17952-21chrt19:29:443
1029099422,32cyclictest23152-21taskset23:06:133
1029099403,25cyclictest28650-21chrt20:04:263
1029099383,26cyclictest30579-21taskset20:09:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional