You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 23:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Mon Apr 27, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1189699122106,10cyclictest16029-21sshd07:13:080
11902991074,48cyclictest31559-21ssh10:17:361
11902999750,40cyclictest28524-21ssh11:07:211
11896999353,26cyclictest181rcu_preempt11:52:370
11902999249,35cyclictest0-21swapper/109:12:241
11902999242,42cyclictest0-21swapper/111:37:491
1190299914,34cyclictest18898-21ssh09:02:221
1190299914,34cyclictest18898-21ssh09:02:221
11902999137,47cyclictest17106-21sh10:47:421
1190299913,34cyclictest4742-21/usr/sbin/munin09:32:301
11902999034,48cyclictest0-21swapper/109:42:481
11902999034,48cyclictest0-21swapper/109:42:481
1190299903,35cyclictest13973-21latency_hist08:47:211
1190299903,34cyclictest22359-21taskset10:56:481
1190299903,33cyclictest8039-21/usr/sbin/munin10:32:361
1190299903,33cyclictest24374-21if_eth007:37:421
1190299903,22cyclictest17405-21ssh11:42:351
1190299903,22cyclictest17405-21ssh11:42:351
1190299902,35cyclictest6651-21grep08:22:491
1090329011,52sleep210913-21/usr/sbin/munin06:57:552
1190299893,35cyclictest87-21kswapd009:57:371
11896998964,12cyclictest181rcu_preempt07:37:560
1190299884,31cyclictest6577-21grep11:22:571
1190299884,31cyclictest6577-21grep11:22:571
11902998835,45cyclictest0-21swapper/107:12:231
1190299883,36cyclictest4533-21cpu08:17:371
1190299883,36cyclictest14585-21latency08:47:461
1190299883,35cyclictest27118-21latency_hist07:47:221
1190299883,34cyclictest11860-21/usr/sbin/munin12:27:411
11902998832,50cyclictest0-21swapper/109:06:141
11902998745,33cyclictest0-21swapper/110:37:231
11902998745,33cyclictest0-21swapper/110:37:231
1190299874,31cyclictest20153-21grep07:22:551
1190299874,28cyclictest28268-21/usr/sbin/munin09:17:551
11902998734,47cyclictest0-21swapper/111:47:411
1190299873,37cyclictest8730-21fschecks_time11:27:431
1190299873,34cyclictest7652-21modprobe10:32:191
1190299873,34cyclictest13438-21modprobe07:07:191
1190299873,32cyclictest29107-21fschecks_time11:07:411
1190299873,32cyclictest17797-21fschecks_count07:17:431
1190299873,32cyclictest12177-21taskset11:32:531
1190299873,32cyclictest12177-21taskset11:32:531
11902998727,9cyclictest0-21swapper/111:53:181
1190299872,33cyclictest31841-21ntpq09:22:481
1190299872,33cyclictest29156-21ntpq10:12:481
11902998720,13cyclictest0-21swapper/109:17:211
11896998759,20cyclictest17307-21latency_hist08:57:220
11896998757,23cyclictest11888-21cyclictest09:04:140
1189699874,34cyclictest15579-21grep08:52:190
1190299865,32cyclictest32333-21latency_hist12:07:221
1190299863,34cyclictest8575-21timerwakeupswit08:27:541
1190299863,34cyclictest8575-21timerwakeupswit08:27:541
1190299863,34cyclictest6224-21fschecks_time12:17:391
1190299863,30cyclictest16052-21tune2fs08:52:411
11902998630,47cyclictest0-21swapper/111:57:551
1190299862,35cyclictest11828-21timerwakeupswit08:37:561
1190299862,35cyclictest11828-21timerwakeupswit08:37:561
1190299854,29cyclictest27479-21tune2fs07:47:421
1190299853,36cyclictest352-21runrttasks10:42:571
1190299853,36cyclictest30425-21latency_hist07:57:221
1190299853,36cyclictest30425-21latency_hist07:57:221
1190299853,36cyclictest22424-21/usr/sbin/munin07:32:531
1190299853,35cyclictest7702-21/usr/sbin/munin09:37:371
1190299853,35cyclictest16921-21timerwakeupswit07:13:541
1190299853,34cyclictest9138-21fschecks_count12:22:401
1190299853,34cyclictest25804-21fschecks_count10:07:411
1190299853,34cyclictest25804-21fschecks_count10:07:411
1190299853,34cyclictest21012-21fschecks_count07:27:421
1190299853,33cyclictest30893-21cat07:57:441
1190299853,33cyclictest30893-21cat07:57:441
1190299853,33cyclictest2974-21/usr/sbin/munin12:12:531
1190299853,33cyclictest2974-21/usr/sbin/munin12:12:531
1190299853,33cyclictest13938-21fschecks_time09:47:401
1190299853,33cyclictest1334-21cpuspeed08:07:371
11896998567,13cyclictest18808-21diskmemload09:50:490
1190299844,34cyclictest3425-21sed08:12:481
1190299843,34cyclictest16687-21cpu09:52:361
1190299843,34cyclictest16687-21cpu09:52:361
1190299843,32cyclictest25516-21latency_hist11:02:221
1190299843,32cyclictest25516-21latency_hist11:02:221
1190299843,31cyclictest3594-21sort11:18:271
1190299842,35cyclictest730-21mailstats12:07:531
11896998463,15cyclictest8081-21kernelversion08:27:440
11896998463,15cyclictest8081-21kernelversion08:27:440
11896998456,19cyclictest22338-21latency_hist07:32:230
11906998360,15cyclictest12696-21cstates08:42:392
11906998353,20cyclictest25275-21sh11:01:412
11906998353,20cyclictest25275-21sh11:01:412
11906998349,23cyclictest7474-21munin-run08:27:202
1190299834,33cyclictest9475-21cstates08:32:381
1190299834,33cyclictest9475-21cstates08:32:381
1190299833,34cyclictest23041-21latency10:02:441
1190299833,34cyclictest23041-21latency10:02:441
1190299833,33cyclictest277-21dbus-daemon11:17:201
1190299833,30cyclictest4513-21latency_hist09:32:221
1190299833,26cyclictest11903-21cat07:02:241
1190299832,31cyclictest2009-21/usr/sbin/munin10:22:421
11896998352,9cyclictest181rcu_preempt09:52:530
11896998352,9cyclictest181rcu_preempt09:52:530
11896998352,22cyclictest5317-21latency_hist11:22:220
11906998261,15cyclictest406-21kernelversion12:07:442
11896998240,25cyclictest21783-21kworker/u17:0+xprtiod10:57:360
11896998240,25cyclictest21783-21kworker/u17:0+xprtiod10:57:360
11896998239,26cyclictest181rcu_preempt12:21:460
1190299813,31cyclictest32604-21ntpq08:02:471
11906998052,19cyclictest25989-21kernelversion10:07:452
11906998052,19cyclictest25989-21kernelversion10:07:452
11896998053,12cyclictest181rcu_preempt09:38:420
11896998040,9cyclictest181rcu_preempt09:35:590
11906997955,15cyclictest352-21runrttasks07:12:222
11896997957,14cyclictest29506-21ssh09:18:160
11896997953,18cyclictest22628-21latency09:07:470
11896997950,10cyclictest181rcu_preempt10:47:350
11896997926,38cyclictest25376-21apt-get09:12:480
11906997856,16cyclictest27369-21threads11:57:542
11896997843,11cyclictest181rcu_preempt09:29:250
1189699783,48cyclictest15-21ksoftirqd/012:10:000
11906997759,11cyclictest28836-21awk09:17:482
11896997758,12cyclictest23148-21apt-config11:52:210
11896997754,17cyclictest0-21swapper/007:02:240
11906997653,16cyclictest17207-21fschecks_time10:47:432
11906997651,17cyclictest0-21swapper/211:32:222
11896997655,14cyclictest28361-21latency_hist10:12:220
11896997655,14cyclictest28361-21latency_hist10:12:220
11896997624,13cyclictest181rcu_preempt11:22:590
11896997624,13cyclictest181rcu_preempt11:22:590
11906997556,13cyclictest8381-21sh11:27:232
11906997523,39cyclictest9640-21ssh09:40:172
11906997519,13cyclictest26427-21awk11:02:482
11906997510,25cyclictest16571-21ssh10:47:192
11896997547,8cyclictest181rcu_preempt10:44:520
11896997541,17cyclictest181rcu_preempt10:05:510
11896997541,17cyclictest181rcu_preempt10:05:510
11906997458,10cyclictest20523-21rm09:57:572
11906997448,17cyclictest352-21runrttasks12:02:402
11896997450,17cyclictest11888-21cyclictest09:44:420
11896997450,17cyclictest11888-21cyclictest09:44:420
11896997450,10cyclictest181rcu_preempt07:46:500
11896997447,18cyclictest22369-21latency_hist10:02:210
11896997447,11cyclictest181rcu_preempt08:37:550
11896997447,11cyclictest181rcu_preempt08:37:550
11896997438,14cyclictest181rcu_preempt10:32:460
11896997436,17cyclictest181rcu_preempt11:15:530
11896997434,11cyclictest0-21swapper/012:31:120
1189699743,33cyclictest9397-21grep11:27:570
34992733,6sleep00-21swapper/010:23:590
11906997355,9cyclictest0-21swapper/209:02:452
11906997354,11cyclictest18808-21diskmemload10:18:032
11906997340,10cyclictest181rcu_preempt10:07:212
11906997340,10cyclictest181rcu_preempt10:07:212
11896997353,14cyclictest22502-21cpuspeed07:32:360
11896997352,15cyclictest11888-21cyclictest08:02:430
11896997330,11cyclictest181rcu_preempt10:30:570
11896997254,11cyclictest13617-21ssh10:42:190
11896997254,11cyclictest13617-21ssh10:42:190
11896997251,15cyclictest15492-21latency_hist07:12:240
1189699724,57cyclictest29296-21latency_hist12:02:210
11896997245,12cyclictest181rcu_preempt07:52:230
11896997236,22cyclictest181rcu_preempt08:47:220
1189699723,55cyclictest18939-21cat09:02:220
1189699723,55cyclictest18939-21cat09:02:220
1189699723,31cyclictest12511-21unixbench_singl11:32:560
1189699723,31cyclictest12511-21unixbench_singl11:32:560
11896997225,24cyclictest0-21swapper/008:17:500
256472710,6sleep30-21swapper/311:55:473
11906997155,10cyclictest11189-21fschecks_count10:37:412
11906997155,10cyclictest11189-21fschecks_count10:37:412
11906997152,11cyclictest0-21swapper/211:52:302
11906997140,22cyclictest32589-21netstat08:02:472
11896997148,16cyclictest11745-21latency_hist12:27:220
11896997145,20cyclictest4454-21latency_hist08:17:230
11896997141,13cyclictest181rcu_preempt11:03:520
11906997055,10cyclictest11888-21cyclictest11:12:252
11906997051,13cyclictest15100-21sh09:48:562
11906997049,16cyclictest1455-21fschecks_count08:07:412
11906997049,15cyclictest21535-21sh10:54:272
1190699704,48cyclictest24813-21apt-get09:12:272
11906997025,8cyclictest0-21swapper/208:17:562
11896997052,11cyclictest30905-21rm12:03:520
1189699703,35cyclictest29552-21unixbench_multi10:12:560
1189699703,35cyclictest20212-21latency_hist11:47:220
1189699703,35cyclictest20212-21latency_hist11:47:220
11896997027,10cyclictest181rcu_preempt10:17:560
11896997022,10cyclictest5410-21ssh12:16:410
11896997022,10cyclictest5410-21ssh12:16:410
11906996952,12cyclictest11888-21cyclictest08:47:572
11906996951,14cyclictest28989-21kworker/u17:0-xprtiod07:07:192
11906996946,15cyclictest2374-21systemd-journal07:23:542
11906996944,18cyclictest2014-21fschecks_count09:27:422
11906996943,16cyclictest0-21swapper/209:07:582
1190699693,51cyclictest3328-21cut12:12:422
1190699693,51cyclictest3328-21cut12:12:422
1190699693,39cyclictest11470-21sh11:32:342
1190699693,39cyclictest11470-21sh11:32:342
11906996911,43cyclictest2374-21systemd-journal09:02:192
11906996911,43cyclictest2374-21systemd-journal09:02:192
11896996947,9cyclictest181rcu_preempt07:22:530
11896996945,9cyclictest181rcu_preempt08:27:200
1189699692,41cyclictest12372-21fschecks_time07:02:420
11906996842,18cyclictest0-21swapper/207:52:542
11906996842,18cyclictest0-21swapper/207:52:542
11906996838,20cyclictest31197-21sh09:22:252
1190699683,47cyclictest12469-21latency_hist08:42:222
1190699683,47cyclictest12469-21latency_hist08:42:222
11906996818,35cyclictest17387-21cat08:57:232
1189699686,32cyclictest2663-21sendmail-msp08:12:200
11896996853,10cyclictest0-21swapper/008:32:310
11896996853,10cyclictest0-21swapper/008:32:310
11896996849,12cyclictest20757-21switchtime10:52:560
1189699684,29cyclictest31450-21latency_hist11:12:230
11906996753,10cyclictest11888-21cyclictest11:37:442
11906996746,15cyclictest31455-21/usr/sbin/munin11:12:212
11906996745,15cyclictest1-21systemd12:32:202
11906996717,12cyclictest2717-21ssh11:18:032
11896996750,11cyclictest32141-21ssh09:22:550
11896996738,12cyclictest181rcu_preempt07:17:460
11896996738,10cyclictest181rcu_preempt11:37:520
11906996648,12cyclictest1-21systemd10:34:072
11906996648,11cyclictest0-21swapper/209:42:552
11906996648,11cyclictest0-21swapper/209:42:552
1190699663,48cyclictest5620-21cstates11:22:372
1190699663,44cyclictest8669-21unixbench_singl08:27:552
1190699663,44cyclictest8669-21unixbench_singl08:27:552
11906996634,24cyclictest0-21swapper/209:57:222
11906996634,24cyclictest0-21swapper/209:57:222
1189699664,50cyclictest15-21ksoftirqd/007:52:310
1189699664,50cyclictest15-21ksoftirqd/007:52:310
11906996543,15cyclictest298-21in:imuxsock09:34:112
11906996541,15cyclictest0-21swapper/207:37:422
11906996541,14cyclictest0-21swapper/210:27:422
1190699653,46cyclictest544-21cron12:27:182
1190699653,45cyclictest23441-21latency_hist11:52:232
1190699653,42cyclictest23904-21latency_hist07:37:222
1190699652,42cyclictest4243-21cron08:17:192
11906996514,39cyclictest0-21swapper/207:17:332
11906996510,28cyclictest26442-21timerandwakeup07:42:542
1189699654,35cyclictest30922-21latency07:57:440
1189699654,35cyclictest30922-21latency07:57:440
11906996447,11cyclictest352-21runrttasks08:32:422
11906996447,11cyclictest352-21runrttasks08:32:422
1190699643,41cyclictest18092-21find11:42:532
1190699643,41cyclictest18092-21find11:42:532
1190699643,41cyclictest17498-21latency_hist07:17:222
11906996430,14cyclictest0-21swapper/210:12:452
1190699633,41cyclictest8778-21sh12:22:222
1190699633,39cyclictest352-21runrttasks07:51:132
1176526316,29sleep30-21swapper/307:02:203
1190699622,41cyclictest352-21runrttasks10:26:032
1191399612,38cyclictest917-21kworker/3:1+events07:42:363
1190699613,41cyclictest32013-21latency_hist08:02:222
1190699613,41cyclictest32013-21latency_hist08:02:222
1191399602,28cyclictest917-21kworker/3:1+events11:17:293
11906996041,12cyclictest0-21swapper/207:27:562
1191399593,39cyclictest12973-21taskset09:46:183
1191399593,39cyclictest12973-21taskset09:46:183
1191399584,36cyclictest571-21taskset12:07:473
1191399563,40cyclictest29737-21chrt12:02:413
1191399563,38cyclictest28497-21taskset09:17:403
1191399553,38cyclictest2004-21chrt11:17:193
1191399553,35cyclictest15847-21taskset07:12:233
1191399553,34cyclictest21055-21chrt11:47:533
1191399553,34cyclictest1703-21chrt10:22:183
1191399552,37cyclictest19577-21taskset09:57:253
179252540,8sleep30-21swapper/307:17:453
1191399542,38cyclictest29000-21chrt07:52:363
1191399542,38cyclictest29000-21chrt07:52:363
1191399542,35cyclictest10939-21chrt08:37:233
1191399542,34cyclictest4926-21taskset08:17:473
1191399542,34cyclictest29341-21taskset11:07:473
11913995410,27cyclictest0-21swapper/307:13:083
1191399534,31cyclictest22651-21chrt09:07:493
1191399533,36cyclictest6648-21chrt08:22:493
1191399533,36cyclictest18851-21chrt09:56:033
1191399533,36cyclictest18851-21chrt09:56:033
1191399533,34cyclictest32279-21chrt08:02:403
1191399525,32cyclictest3510-21chrt12:12:463
1191399525,32cyclictest3510-21chrt12:12:463
1191399524,37cyclictest28130-21chrt11:06:213
1191399523,39cyclictest15630-21taskset11:38:163
1191399523,34cyclictest11705-21chrt11:32:403
1191399523,34cyclictest11705-21chrt11:32:403
1191399523,32cyclictest917-21kworker/3:1+events07:07:223
1191399513,37cyclictest27925-21taskset07:47:543
1191399513,34cyclictest9243-21chrt09:39:093
1191399513,33cyclictest7968-21chrt12:20:323
1191399513,33cyclictest6311-21chrt10:28:313
1191399513,30cyclictest2202-21taskset09:27:463
1191399512,35cyclictest7570-21chrt09:37:223
1191399512,34cyclictest16195-21taskset10:46:143
1191399512,33cyclictest23939-21chrt10:57:583
1191399512,33cyclictest23939-21chrt10:57:583
1191399512,32cyclictest14166-21chrt08:47:233
1191399512,29cyclictest917-21kworker/3:1+events07:37:343
1191399504,36cyclictest14054-21chrt12:30:583
1191399503,33cyclictest21932-21chrt10:55:353
1191399503,32cyclictest917-21kworker/3:1+events10:52:233
1191399502,32cyclictest1490-21chrt08:07:423
1191399494,33cyclictest10145-21chrt10:35:563
1191399493,34cyclictest8592-21chrt11:27:373
1191399493,34cyclictest25374-21chrt09:12:313
1191399492,31cyclictest9619-21chrt12:22:513
1191399483,33cyclictest20578-21chrt07:27:203
1191399483,32cyclictest18304-21taskset08:57:563
1191399483,32cyclictest18304-21taskset08:57:563
1191399483,31cyclictest26513-21taskset11:57:303
1191399483,31cyclictest11748-21chrt08:37:553
1191399483,31cyclictest11748-21chrt08:37:553
1191399473,33cyclictest31322-21chrt07:57:543
1191399473,33cyclictest31322-21chrt07:57:543
1191399473,33cyclictest26087-21taskset10:07:473
1191399473,33cyclictest26087-21taskset10:07:473
1191399473,33cyclictest15859-21chrt09:51:053
1191399472,35cyclictest20923-21chrt09:04:533
1191399472,26cyclictest1205-21chrt09:26:403
1191399464,31cyclictest30097-21chrt10:14:123
1191399464,29cyclictest17648-21chrt11:42:423
1191399464,29cyclictest17648-21chrt11:42:423
1191399463,33cyclictest8680-21taskset08:27:553
1191399463,33cyclictest8680-21taskset08:27:553
1191399463,32cyclictest20899-21taskset07:27:373
1191399463,31cyclictest22933-21chrt07:32:473
1191399462,34cyclictest7372-21taskset11:25:103
1191399462,34cyclictest7372-21taskset11:25:103
1191399454,30cyclictest17407-21taskset08:57:233
1191399453,30cyclictest917-21kworker/3:1+events08:47:573
1191399452,33cyclictest22808-21chrt10:02:403
1191399452,33cyclictest22808-21chrt10:02:403
1191399443,29cyclictest9383-21taskset08:32:373
1191399433,29cyclictest12880-21taskset10:40:143
1191399433,29cyclictest12880-21taskset10:40:143
1191399422,30cyclictest3637-21chrt10:24:213
1191399412,29cyclictest917-21kworker/3:1+events08:12:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional