You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 21:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sat Jun 27, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1730021590,10sleep3451rcuc/306:53:393
17610214511,96sleep017658-21grep06:53:540
185139912638,63cyclictest6880-21apt-get10:13:550
18513991225,94cyclictest11647-21apt-get08:13:280
185139911537,14cyclictest0-21swapper/012:23:300
185139911537,14cyclictest0-21swapper/012:23:300
185139911237,12cyclictest0-21swapper/011:18:350
185139911237,12cyclictest0-21swapper/011:18:350
18419211123,55sleep218382-21/usr/sbin/munin06:58:162
18513991083,25cyclictest16158-21apt-get11:23:330
18513991073,45cyclictest24572-21latency_hist11:38:140
18513991073,45cyclictest24572-21latency_hist11:38:140
18513991053,31cyclictest24803-21/usr/sbin/munin10:43:350
18513991053,31cyclictest15139-21df_inode09:33:330
185139910472,23cyclictest13382-21latency_hist12:13:180
185139910472,23cyclictest13382-21latency_hist12:13:180
185139910472,23cyclictest13382-21latency_hist12:13:180
18513991046,46cyclictest8109-21apt-get08:03:340
185349910361,12cyclictest13093-21kworker/u18:2-rpciod10:29:172
1786021029,60sleep117952-21unixbench_multi06:53:591
1851399996,48cyclictest16637-21apt-get12:18:300
18513999545,8cyclictest2640-21kworker/u17:1+rpciod11:13:210
18534999360,8cyclictest181rcu_preempt10:58:092
1852499933,33cyclictest31-21ksoftirqd/107:23:261
18534999271,15cyclictest2563-21latency_hist09:13:152
18534999052,8cyclictest181rcu_preempt10:00:302
18534998949,8cyclictest181rcu_preempt07:58:252
18513998925,35cyclictest7749-21uname11:08:470
18534998855,12cyclictest181rcu_preempt07:18:162
18534998855,12cyclictest181rcu_preempt07:18:162
18534998754,16cyclictest181rcu_preempt10:38:362
18534998753,8cyclictest181rcu_preempt12:18:432
18524998664,10cyclictest0-21swapper/110:18:471
1851399854,60cyclictest14840-21kworker/u19:2+ext4-rsv-conversion11:43:280
1851399854,60cyclictest14840-21kworker/u19:2+ext4-rsv-conversion11:43:280
18534998462,9cyclictest181rcu_preempt10:18:012
1852499843,33cyclictest31-21ksoftirqd/110:53:251
18513998463,15cyclictest30425-21cpu07:33:280
1854399839,46cyclictest116532sleep308:13:283
18524998336,8cyclictest181rcu_preempt12:13:291
18524998336,8cyclictest181rcu_preempt12:13:291
1851399833,24cyclictest4635-21apt-get11:58:270
18534998147,7cyclictest181rcu_preempt08:18:152
18524998155,10cyclictest22679-21ssh09:45:441
18524998155,10cyclictest22679-21ssh09:45:441
18524998136,10cyclictest181rcu_preempt11:12:121
18513998148,12cyclictest374-21kworker/u17:1-ext4-rsv-conversion07:18:160
18513998148,12cyclictest374-21kworker/u17:1-ext4-rsv-conversion07:18:160
232832800,3sleep0211rcuc/008:48:360
18534998044,9cyclictest181rcu_preempt09:22:312
18534998044,9cyclictest181rcu_preempt09:22:312
18534997960,13cyclictest22322-21latency_hist12:28:152
18534997960,13cyclictest22322-21latency_hist12:28:152
18524997938,9cyclictest181rcu_preempt10:11:151
18524997937,8cyclictest181rcu_preempt10:30:401
18534997841,10cyclictest15293-21latency08:23:402
18534997818,14cyclictest371rcuc/210:18:262
18524997863,8cyclictest0-21swapper/109:53:141
18524997860,12cyclictest2374-21systemd-journal11:58:151
18524997858,12cyclictest19220-21systemd-run12:23:131
18524997857,14cyclictest2374-21systemd-journal06:58:361
18524997855,9cyclictest181rcu_preempt09:20:501
18524997855,9cyclictest181rcu_preempt09:20:501
18524997840,9cyclictest22989-21ssh10:39:431
18524997834,9cyclictest181rcu_preempt10:03:511
18513997852,17cyclictest544-21cron09:28:120
1851399783,33cyclictest352-21runrttasks10:22:010
1851399782,41cyclictest29570-21apt-get09:58:290
18534997761,9cyclictest17686-21kworker/u17:3-xprtiod09:53:162
18534997761,9cyclictest17686-21kworker/u17:3-xprtiod09:53:162
18534997756,14cyclictest28018-21latency10:48:382
18534997756,14cyclictest28018-21latency10:48:382
18534997754,7cyclictest181rcu_preempt09:33:582
18534997752,9cyclictest8581-21ssh11:10:062
18524997737,8cyclictest181rcu_preempt07:38:161
18534997652,8cyclictest181rcu_preempt10:25:402
18534997652,15cyclictest352-21runrttasks11:24:462
18534997646,8cyclictest181rcu_preempt08:28:252
18534997643,9cyclictest181rcu_preempt11:06:162
18534997643,9cyclictest181rcu_preempt11:06:162
18534997630,18cyclictest28134-21unixbench_singl07:23:502
18524997640,10cyclictest181rcu_preempt10:36:321
18524997640,10cyclictest181rcu_preempt09:07:341
18524997634,10cyclictest181rcu_preempt09:37:041
18524997633,10cyclictest181rcu_preempt11:24:341
18524997630,7cyclictest181rcu_preempt11:18:311
18524997630,7cyclictest181rcu_preempt11:18:311
1851399766,42cyclictest0-21swapper/009:12:270
18513997647,10cyclictest18504-21cyclictest09:48:140
18513997647,10cyclictest18504-21cyclictest09:48:140
1851399763,43cyclictest4853-21tune2fs07:53:340
18534997556,13cyclictest4441-21sh09:15:292
18534997556,13cyclictest4441-21sh09:15:292
18534997549,8cyclictest181rcu_preempt08:21:102
18534997549,8cyclictest181rcu_preempt08:21:102
18534997544,9cyclictest181rcu_preempt08:58:322
18524997558,9cyclictest301ktimers/109:53:251
18524997558,9cyclictest301ktimers/109:53:251
18524997554,15cyclictest20641-21latency_hist09:43:141
18524997542,9cyclictest181rcu_preempt12:28:151
18524997542,9cyclictest181rcu_preempt12:28:151
18524997537,8cyclictest181rcu_preempt12:00:541
18524997537,11cyclictest181rcu_preempt11:43:531
18524997537,11cyclictest181rcu_preempt11:43:531
18524997535,8cyclictest181rcu_preempt12:08:301
18524997535,8cyclictest181rcu_preempt12:08:301
18524997535,8cyclictest181rcu_preempt12:08:301
18524997528,12cyclictest181rcu_preempt12:05:011
18513997552,17cyclictest26637-21sh09:53:140
18513997548,19cyclictest8774-21latency_hist09:23:150
18513997548,19cyclictest8774-21latency_hist09:23:150
18513997531,17cyclictest3318-21cat10:08:120
18534997456,13cyclictest5134-21netstat07:53:402
18534997449,7cyclictest181rcu_preempt11:43:402
18534997449,7cyclictest181rcu_preempt11:43:402
18534997445,10cyclictest181rcu_preempt12:02:102
18534997441,9cyclictest181rcu_preempt11:01:212
18524997453,14cyclictest24939-21cpuspeed11:38:271
18524997433,11cyclictest181rcu_preempt11:35:051
18524997433,11cyclictest181rcu_preempt11:35:051
18524997425,13cyclictest181rcu_preempt07:53:491
1851399743,33cyclictest20273-21munin-node10:08:210
1851399743,21cyclictest29038-21fschecks_time07:28:350
18534997357,10cyclictest13441-21/usr/sbin/munin12:13:332
18534997357,10cyclictest13441-21/usr/sbin/munin12:13:332
18534997353,7cyclictest181rcu_preempt11:20:332
18534997353,7cyclictest181rcu_preempt11:20:332
18534997353,13cyclictest28101-21kworker/u17:0-rpciod11:48:382
18534997351,8cyclictest39-21ksoftirqd/207:52:132
18534997347,9cyclictest181rcu_preempt12:11:132
18534997347,9cyclictest181rcu_preempt12:11:132
18534997347,9cyclictest181rcu_preempt12:11:132
18534997340,8cyclictest181rcu_preempt11:16:272
18534997326,7cyclictest181rcu_preempt10:03:272
18524997356,10cyclictest21704-21latency08:43:371
18524997356,10cyclictest21704-21latency08:43:371
18524997354,13cyclictest27403-21sh10:48:151
1852499733,30cyclictest31-21ksoftirqd/108:48:271
1851399737,45cyclictest30181-21kworker/0:0-events08:23:460
18534997253,13cyclictest26175-21sh11:39:302
18534997251,15cyclictest26564-21cron09:53:122
18534997248,14cyclictest0-21swapper/211:53:352
18534997242,8cyclictest181rcu_preempt12:04:392
18534997218,16cyclictest0-21swapper/209:29:392
18524997258,10cyclictest18504-21cyclictest08:59:121
18524997237,8cyclictest181rcu_preempt08:18:471
18524997237,8cyclictest181rcu_preempt08:18:471
18524997231,8cyclictest181rcu_preempt07:18:371
18524997231,10cyclictest181rcu_preempt08:17:361
1851399722,38cyclictest7749-21entropy12:03:340
18534997148,8cyclictest181rcu_preempt06:58:412
18534997142,11cyclictest181rcu_preempt08:52:292
18534997139,7cyclictest181rcu_preempt10:08:282
18534997128,12cyclictest181rcu_preempt09:25:122
1853499712,23cyclictest22232-21tail08:43:482
1853499712,23cyclictest22232-21tail08:43:482
18524997157,10cyclictest18504-21cyclictest07:40:011
18524997153,12cyclictest4168-21apt-get11:03:361
18524997153,12cyclictest4168-21apt-get11:03:361
1852499713,30cyclictest31-21ksoftirqd/108:08:271
18524997131,12cyclictest181rcu_preempt10:48:511
18524997131,12cyclictest181rcu_preempt10:48:511
18524997130,12cyclictest181rcu_preempt09:18:151
18524997130,12cyclictest181rcu_preempt09:18:151
18524997126,13cyclictest181rcu_preempt10:24:011
18513997152,12cyclictest11637-21kworker/u18:1+events_unbound07:28:120
1851399712,43cyclictest18158-21kworker/u19:2+ext4-rsv-conversion07:38:390
1851399712,31cyclictest5301-21find11:04:510
1851399712,31cyclictest5301-21find11:04:510
18534997056,8cyclictest0-21swapper/207:18:482
18534997044,8cyclictest181rcu_preempt10:46:272
18524997041,9cyclictest181rcu_preempt08:29:051
18524997036,11cyclictest18504-21cyclictest11:02:531
18524997034,12cyclictest181rcu_preempt11:29:051
18513997048,16cyclictest298-21in:imuxsock10:28:070
18513997031,26cyclictest181rcu_preempt11:33:070
1854399695,36cyclictest0-21swapper/307:38:423
18534996949,8cyclictest181rcu_preempt10:34:372
18534996946,16cyclictest18504-21cyclictest09:38:302
18534996938,9cyclictest181rcu_preempt07:43:282
18534996938,9cyclictest181rcu_preempt07:43:282
18534996937,8cyclictest181rcu_preempt07:39:532
18534996936,7cyclictest181rcu_preempt11:31:002
18524996950,12cyclictest31212-21ssh11:48:341
18513996949,14cyclictest21266-21idleruntime-cro10:38:120
18513996948,11cyclictest0-21swapper/008:38:360
18513996944,15cyclictest29875-21apt-key09:58:170
18513996943,18cyclictest32029-21latency_hist09:08:150
18513996938,7cyclictest181rcu_preempt11:51:230
18534996851,12cyclictest0-21swapper/208:13:122
18534996846,7cyclictest181rcu_preempt08:37:012
18534996840,7cyclictest181rcu_preempt09:03:442
18534996840,14cyclictest181rcu_preempt08:42:592
18534996837,12cyclictest0-21swapper/208:05:132
18534996831,7cyclictest181rcu_preempt11:34:062
18534996831,7cyclictest181rcu_preempt11:34:062
18524996836,8cyclictest181rcu_preempt10:00:411
18524996830,8cyclictest181rcu_preempt08:38:411
18524996829,12cyclictest181rcu_preempt09:27:351
1852499682,22cyclictest7167-21df10:14:061
1851399684,32cyclictest12290-21fschecks_time09:28:350
1851399683,28cyclictest26992-21cat07:23:140
1851399682,35cyclictest20593-21munin-run09:43:120
1851399682,30cyclictest18334-21unin-run10:33:130
1851399681,42cyclictest991-21apt-get10:58:240
1854399677,34cyclictest0-21swapper/310:13:273
1854399673,32cyclictest0-21swapper/308:03:273
18534996734,10cyclictest181rcu_preempt07:08:362
18524996744,10cyclictest181rcu_preempt07:28:471
18524996739,7cyclictest181rcu_preempt09:11:511
1852499673,27cyclictest3567-21awk07:48:401
18513996728,11cyclictest181rcu_preempt10:48:150
18513996728,11cyclictest181rcu_preempt10:48:150
1851399672,32cyclictest7731-21dpkg08:03:140
18513996710,14cyclictest26170-21latency_hist08:58:160
1854399663,50cyclictest16678-21chrt12:18:413
18534996651,8cyclictest0-21swapper/207:03:432
18534996645,8cyclictest181rcu_preempt09:43:372
18534996645,8cyclictest181rcu_preempt09:43:372
18524996647,13cyclictest15688-21timerwakeupswit08:23:501
18524996646,14cyclictest7914-21apt-config08:03:161
18524996616,30cyclictest10112-21sort11:13:301
18513996645,8cyclictest181rcu_preempt06:58:260
18513996644,16cyclictest4215-21apt-key11:58:150
1851399663,23cyclictest27340-21latency09:53:380
18513996628,12cyclictest181rcu_preempt08:29:470
1851399662,43cyclictest13507-21fschecks_time08:18:360
1851399662,43cyclictest13507-21fschecks_time08:18:360
1851399662,33cyclictest27677-21apt-config11:43:140
18534996536,8cyclictest181rcu_preempt07:33:162
18534996522,8cyclictest0-21swapper/207:38:122
18524996544,15cyclictest12312-21ssh09:28:361
1852499653,47cyclictest25293-21switchtime08:53:471
18524996532,12cyclictest181rcu_preempt07:13:291
18524996532,12cyclictest181rcu_preempt07:13:291
18524996516,42cyclictest301ktimers/108:05:041
18513996542,14cyclictest0-21swapper/007:48:340
18513996530,27cyclictest0-21swapper/010:41:080
1851399652,38cyclictest20905-21fschecks_count07:03:360
18513996521,34cyclictest1704-21sshd07:43:370
18513996521,34cyclictest1704-21sshd07:43:370
18524996440,11cyclictest181rcu_preempt07:44:391
18524996440,11cyclictest181rcu_preempt07:44:391
18513996449,9cyclictest16116-21apt-config12:18:120
18513996449,9cyclictest16116-21apt-config12:18:120
18513996447,12cyclictest26909-21proc_pri08:58:470
18513996441,14cyclictest4424-21kworker/u18:2-nfsiod09:18:150
18513996441,14cyclictest4424-21kworker/u18:2-nfsiod09:18:150
18513996439,10cyclictest181rcu_preempt10:53:250
18513996438,13cyclictest181rcu_preempt07:08:470
1854399634,37cyclictest0-21swapper/309:58:303
1854399632,37cyclictest917-21kworker/3:1+events10:58:413
18513996333,9cyclictest181rcu_preempt08:08:330
1852499622,43cyclictest23825-21latency_hist07:13:151
18524996222,8cyclictest181rcu_preempt07:03:361
18534996133,8cyclictest181rcu_preempt08:53:402
1851399612,31cyclictest22852-21latency_hist08:48:160
1851399612,31cyclictest22852-21latency_hist08:48:160
1852499603,45cyclictest18103-21apt-get08:33:261
1854399592,37cyclictest917-21kworker/3:1+events08:08:503
18513995912,22cyclictest30181-21kworker/0:0-events08:33:360
1854399583,36cyclictest4551-21chrt11:04:253
1854399583,36cyclictest4551-21chrt11:04:253
1854399582,36cyclictest917-21kworker/3:1+events10:48:523
1854399582,36cyclictest917-21kworker/3:1+events10:48:523
1854399573,36cyclictest10398-21chrt11:13:383
1854399573,35cyclictest20070-21chrt09:41:463
1854399564,35cyclictest31034-21taskset07:33:453
1854399563,39cyclictest6548-21taskset07:58:363
1854399563,36cyclictest9611-21taskset09:23:463
1854399563,35cyclictest9596-21chrt11:13:013
1854399562,38cyclictest3008-21chrt09:13:363
1854399562,38cyclictest3008-21chrt09:13:363
306862550,6sleep30-21swapper/310:53:343
1854399544,34cyclictest4933-21chrt10:09:203
1854399543,37cyclictest20529-21taskset12:23:503
1854399543,37cyclictest20529-21taskset12:23:503
1854399533,38cyclictest22101-21taskset07:08:133
1854399533,37cyclictest22482-21chrt11:33:413
1854399533,37cyclictest22482-21chrt11:33:413
1854399533,36cyclictest29903-21chrt09:58:163
1854399533,36cyclictest29903-21chrt09:58:163
1854399533,36cyclictest16157-21chrt11:23:233
1854399533,35cyclictest25152-21chrt09:49:123
1854399533,34cyclictest12717-21chrt10:23:293
1854399533,33cyclictest18808-21chrt06:58:323
18543995311,21cyclictest0-21swapper/311:58:273
1854399524,33cyclictest22122-21chrt09:44:093
1854399524,33cyclictest22122-21chrt09:44:093
1854399523,36cyclictest16035-21chrt10:28:363
1854399522,37cyclictest21466-21taskset11:32:523
1854399522,35cyclictest10823-21taskset12:08:343
1854399522,35cyclictest10823-21taskset12:08:343
1854399522,35cyclictest10823-21taskset12:08:343
1854399522,34cyclictest9992-21taskset10:18:343
1854399522,34cyclictest24958-21chrt11:38:283
1854399522,33cyclictest8314-21taskset09:22:203
1854399522,33cyclictest8314-21taskset09:22:203
1854399522,33cyclictest3871-21chrt07:48:483
1854399513,37cyclictest15030-21taskset08:23:353
1854399513,35cyclictest22888-21chrt07:08:413
1854399513,32cyclictest2146-21chrt09:12:263
1854399512,34cyclictest21286-21chrt08:43:163
1854399512,34cyclictest13724-21chrt08:18:413
1854399512,34cyclictest13724-21chrt08:18:413
1854399512,33cyclictest8715-21chrt12:04:043
1854399503,31cyclictest29461-21taskset09:03:343
1854399503,29cyclictest917-21kworker/3:1+events08:53:383
1854399502,33cyclictest28721-21chrt09:02:453
1854399494,32cyclictest30370-21chrt07:33:163
1854399493,32cyclictest17233-21chrt09:37:123
1854399493,30cyclictest24734-21chrt07:13:483
1854399493,30cyclictest24734-21chrt07:13:483
1854399492,34cyclictest21840-21chrt08:43:413
1854399492,34cyclictest21840-21chrt08:43:413
1854399483,31cyclictest23716-21chrt08:48:473
1854399482,34cyclictest18649-21chrt08:33:443
1854399482,34cyclictest13764-21taskset09:30:473
1854399482,31cyclictest13854-21chrt12:13:533
1854399482,31cyclictest13854-21chrt12:13:533
1854399482,30cyclictest27113-21chrt07:23:153
1854399472,33cyclictest27324-21taskset07:23:323
1854399472,31cyclictest31279-21chrt11:48:353
1854399472,31cyclictest25162-21chrt10:43:443
1854399463,31cyclictest2680-21taskset10:06:283
1854399463,30cyclictest4087-21chrt11:58:123
1854399463,30cyclictest18796-21taskset10:33:303
1854399463,30cyclictest13285-21chrt11:18:373
1854399463,30cyclictest13285-21chrt11:18:373
18543994610,24cyclictest0-21swapper/311:43:323
18543994610,24cyclictest0-21swapper/311:43:323
1854399453,28cyclictest23586-21chrt10:41:253
1854399433,24cyclictest18036-21chrt08:33:153
1854399432,27cyclictest2278-21chrt07:43:493
1854399432,27cyclictest2278-21chrt07:43:493
1854399383,26cyclictest5851-21taskset07:56:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional