You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 19:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Mar 16, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9424214811,48sleep29469-21sensors_temp07:00:512
8782212423,51sleep00-21swapper/007:00:240
102529910333,12cyclictest0-21swapper/111:30:111
102529910333,12cyclictest0-21swapper/111:30:111
102529910143,9cyclictest0-21swapper/107:45:291
10252991002,88cyclictest30947-21ssh11:15:251
10252991002,88cyclictest30947-21ssh11:15:251
10259999974,16cyclictest30336-21apt-get11:15:072
10252999836,12cyclictest0-21swapper/112:05:311
10252999836,12cyclictest0-21swapper/112:05:311
10252999835,13cyclictest0-21swapper/111:35:251
10252999835,13cyclictest0-21swapper/111:35:251
10252999829,23cyclictest277-21dbus-daemon07:10:091
1025299973,38cyclictest22325-21ntp_offset11:00:371
1025299963,31cyclictest0-21swapper/110:02:211
10246999556,30cyclictest0-21swapper/007:10:420
93692938,56sleep19422-21mailstats07:00:501
1025299934,35cyclictest30073-21/usr/sbin/munin10:20:421
10252999336,10cyclictest0-21swapper/110:15:311
1025299923,68cyclictest352-21runrttasks10:25:301
1025299923,42cyclictest17002-21wc11:45:391
10246999244,8cyclictest181rcu_preempt08:10:220
1025299912,40cyclictest7833-21latency11:30:321
10259999013,67cyclictest509-21apt-get09:30:252
10246999013,67cyclictest904-21modprobe10:25:310
10259998958,23cyclictest8629-21sh10:37:492
10252998966,17cyclictest6537-21sh09:40:291
10259998813,30cyclictest1093-21sh12:14:032
10259998813,30cyclictest1093-21sh12:14:032
10252998839,15cyclictest4241-21kworker/u17:1-rpciod09:05:101
1025999873,74cyclictest30986-21sh11:15:312
1025999873,74cyclictest30986-21sh11:15:312
1025299876,37cyclictest13512-21ssh12:35:091
10259998658,21cyclictest13698-21latency_hist12:35:102
10252998668,12cyclictest24137-21sh09:16:211
10246998644,12cyclictest181rcu_preempt07:45:360
10259998569,12cyclictest10236-21cyclictest11:55:452
10259998569,12cyclictest10236-21cyclictest11:55:452
10259998568,10cyclictest11462-21unixbench_singl11:35:462
10259998568,10cyclictest11462-21unixbench_singl11:35:462
10259998563,16cyclictest25794-21sh11:05:462
10252998570,7cyclictest0-21swapper/112:20:231
10246998563,16cyclictest1466-21cpu11:20:240
10246998461,14cyclictest6912-21rm11:29:440
10246998461,14cyclictest6912-21rm11:29:440
10246998459,17cyclictest13263-21latency_hist11:40:110
10246998459,17cyclictest13263-21latency_hist11:40:110
10259998363,13cyclictest10236-21cyclictest08:17:152
10259998355,19cyclictest24750-21sh10:10:392
10259998313,24cyclictest29387-21ntp_states08:00:372
10259998313,24cyclictest29387-21ntp_states08:00:372
10252998362,15cyclictest19676-21snmpd09:08:141
10252998341,18cyclictest0-21swapper/108:45:111
10252998262,15cyclictest10236-21cyclictest07:45:111
10246998259,14cyclictest7236-21ssh10:35:340
10246998246,28cyclictest8252-21timerandwakeup11:30:420
10259998163,11cyclictest277-21dbus-daemon07:35:092
1024699813,56cyclictest18404-21sh10:55:070
10246998110,38cyclictest13494-21munin-run12:35:090
10252998062,13cyclictest10236-21cyclictest10:41:081
10259997923,12cyclictest0-21swapper/208:50:072
10259997923,12cyclictest0-21swapper/208:50:072
10252997947,12cyclictest181rcu_preempt12:20:091
1025299793,28cyclictest31264-21timerandwakeup08:05:441
1025299793,28cyclictest31264-21timerandwakeup08:05:441
10246997957,14cyclictest9571-21fschecks_count08:40:330
1024699794,57cyclictest24134-21taskset09:16:200
1009227911,43sleep30-21swapper/307:05:083
10252997853,15cyclictest801-21sh12:13:131
10252997853,15cyclictest801-21sh12:13:131
1025299782,63cyclictest509-21apt-get09:30:261
10246997857,15cyclictest297-21systemd-logind12:25:080
10246997855,15cyclictest10236-21cyclictest10:45:250
10259997717,40cyclictest16253-21cut11:45:112
10252997756,15cyclictest10236-21cyclictest07:39:481
10252997753,15cyclictest28161-21latency_hist12:05:101
10252997748,11cyclictest181rcu_preempt08:15:101
10246997760,12cyclictest352-21runrttasks11:57:050
10246997760,12cyclictest352-21runrttasks11:57:050
10259997656,14cyclictest298-21in:imuxsock08:45:092
10259997613,25cyclictest7109-21users08:30:442
10252997660,10cyclictest20241-21ssh10:56:501
10246997659,11cyclictest200-21systemd-journal07:30:080
10246997659,11cyclictest200-21systemd-journal07:30:080
10246997659,11cyclictest10236-21cyclictest09:23:130
10246997659,11cyclictest10236-21cyclictest09:23:130
10259997552,12cyclictest0-21swapper/207:20:242
10259997552,12cyclictest0-21swapper/207:20:242
10259997549,19cyclictest0-21swapper/209:05:082
10259997544,22cyclictest31203-21vmstat10:20:482
10259997514,25cyclictest11933-21latency_hist09:50:092
10259997510,36cyclictest843-21apt-get10:25:272
10252997524,11cyclictest0-21swapper/111:43:531
10252997521,34cyclictest6404-21fschecks_time08:30:291
10246997548,22cyclictest21701-21/usr/sbin/munin11:00:320
1024699754,58cyclictest28268-21/usr/sbin/munin12:05:240
1024699754,58cyclictest28268-21/usr/sbin/munin12:05:240
10259997456,12cyclictest200-21systemd-journal10:35:072
10259997449,16cyclictest6277-21sshd09:40:122
10252997449,19cyclictest16935-21vmstat07:20:461
10252997449,19cyclictest16935-21vmstat07:20:461
10252997438,9cyclictest0-21swapper/110:05:341
10252997438,9cyclictest0-21swapper/110:05:341
10246997449,19cyclictest1-21systemd09:30:560
10246997446,10cyclictest20791-21kworker/u19:1-rpciod12:19:410
10246997442,9cyclictest181rcu_preempt09:57:450
10246997442,9cyclictest181rcu_preempt09:57:450
10246997435,20cyclictest27626-21/usr/sbin/munin11:10:290
1025999735,47cyclictest10838-21unixbench_singl10:40:442
1025999733,51cyclictest27973-21modprobe12:05:062
10259997313,23cyclictest8009-21grep08:35:302
10252997356,12cyclictest10236-21cyclictest10:35:091
10252997354,12cyclictest10236-21cyclictest07:30:101
10252997354,12cyclictest10236-21cyclictest07:30:101
10252997337,11cyclictest181rcu_preempt10:50:191
1025299733,47cyclictest11768-21apt-get07:10:231
1025299733,29cyclictest7962-21fschecks_count08:35:291
1024699733,36cyclictest29878-21sort09:25:240
10246997322,16cyclictest15-21ksoftirqd/008:55:230
10259997249,12cyclictest0-21swapper/212:25:392
10259997241,22cyclictest27908-21systemctl09:21:422
10259997241,22cyclictest27908-21systemctl09:21:422
10259997210,25cyclictest17176-21diskmemload12:15:362
10252997252,12cyclictest277-21dbus-daemon11:15:081
10252997250,14cyclictest7876-21ssh12:25:221
10252997235,13cyclictest0-21swapper/109:50:101
10252997234,16cyclictest0-21swapper/108:55:411
10246997250,9cyclictest181rcu_preempt07:20:280
10246997250,9cyclictest181rcu_preempt07:20:280
1024699724,58cyclictest6012-21cron09:40:070
1024699724,58cyclictest6012-21cron09:40:070
10246997239,26cyclictest0-21swapper/011:45:430
10259997146,17cyclictest0-21swapper/209:50:432
1025999713,45cyclictest12802-21fschecks_time08:50:292
10252997149,16cyclictest32421-21sh09:30:071
1025299713,32cyclictest15880-21find09:55:411
1025299713,32cyclictest15880-21find09:55:411
1025299712,28cyclictest12965-21mailstats09:50:411
10246997150,14cyclictest17176-21diskmemload12:00:300
1024699714,57cyclictest17176-21diskmemload09:40:190
10246997142,22cyclictest0-21swapper/010:58:500
10246997121,40cyclictest19739-21uname11:50:320
1025999704,43cyclictest32550-21latency08:10:332
1025999704,31cyclictest0-21swapper/209:35:452
1025999704,31cyclictest0-21swapper/209:35:452
10259997043,19cyclictest19676-21snmpd07:20:092
10259997043,19cyclictest19676-21snmpd07:20:092
10259997043,19cyclictest12058-21apt-key07:10:122
1025999702,46cyclictest4261-21latency_hist11:25:102
10259997018,39cyclictest32056-21cat08:10:112
10259997018,39cyclictest32056-21cat08:10:112
10252997047,17cyclictest29062-21fschecks_count08:00:291
10252997047,17cyclictest29062-21fschecks_count08:00:291
10252997030,18cyclictest0-21swapper/107:15:251
10252997030,18cyclictest0-21swapper/107:15:251
10246997056,7cyclictest0-21swapper/011:10:060
10246997054,11cyclictest31859-21idleruntime-cro08:10:070
10246997054,11cyclictest31859-21idleruntime-cro08:10:070
10246997051,13cyclictest7654-21latency_hist08:35:110
10246997050,15cyclictest10236-21cyclictest07:15:400
10246997050,15cyclictest10236-21cyclictest07:15:400
10246997043,19cyclictest23184-21modprobe09:15:070
10246997043,13cyclictest181rcu_preempt10:15:350
1024699703,56cyclictest6449-21modprobe10:35:070
1024699703,30cyclictest14469-21vmstat11:40:470
133132690,7sleep00-21swapper/009:50:500
10268996914,39cyclictest12816-21chrt07:10:423
1025999698,27cyclictest0-21swapper/208:55:352
10259996949,13cyclictest10236-21cyclictest12:24:142
10259996947,15cyclictest0-21swapper/209:20:122
10259996944,11cyclictest10236-21cyclictest09:10:102
10259996925,15cyclictest181rcu_preempt11:25:292
10259996925,15cyclictest181rcu_preempt11:25:292
10252996950,13cyclictest27330-21cron11:10:071
10252996945,19cyclictest20743-21fschecks_count09:10:281
10252996944,18cyclictest14003-21latency_hist08:55:091
10252996914,27cyclictest31-21ksoftirqd/108:45:291
10252996914,27cyclictest31-21ksoftirqd/108:45:291
10246996952,11cyclictest11524-21sh09:49:080
10246996943,9cyclictest181rcu_preempt08:20:240
10246996942,19cyclictest22125-21modprobe07:40:070
1024699693,33cyclictest7732-21/usr/sbin/munin12:25:290
10246996932,8cyclictest181rcu_preempt07:40:240
10246996914,39cyclictest25101-21kworker/u17:0+xprtiod11:15:130
10246996914,39cyclictest25101-21kworker/u17:0+xprtiod11:15:130
1025999689,43cyclictest24431-21ssh11:05:092
10259996847,13cyclictest200-21systemd-journal11:35:082
10259996845,13cyclictest0-21swapper/207:10:152
1025999683,49cyclictest21380-21grep07:35:412
1025999683,46cyclictest5861-21latency_hist08:30:112
1025999683,39cyclictest12746-21/usr/sbin/munin10:45:452
1025999683,32cyclictest27417-21fschecks_time10:15:302
10259996830,28cyclictest18978-21cat07:30:102
10259996830,28cyclictest18978-21cat07:30:102
10259996810,23cyclictest21689-21ssh10:05:362
10259996810,23cyclictest21689-21ssh10:05:362
10252996848,7cyclictest181rcu_preempt10:47:031
1025299684,43cyclictest26193-21proc_pri07:50:401
10252996842,15cyclictest0-21swapper/108:20:101
1024699686,33cyclictest15-21ksoftirqd/008:15:240
10246996850,12cyclictest16760-21unixbench_singl09:00:440
10259996745,13cyclictest0-21swapper/210:00:392
10259996744,12cyclictest0-21swapper/207:45:112
1025999672,46cyclictest3663-21switchtime08:20:422
10252996749,12cyclictest27442-21fschecks_count07:55:291
10246996754,9cyclictest10236-21cyclictest10:23:320
10246996754,8cyclictest23359-21rm10:08:540
10246996754,8cyclictest23359-21rm10:08:540
10246996748,13cyclictest17494-21sh09:05:190
1024699673,32cyclictest24799-21uname10:10:400
10246996728,8cyclictest0-21swapper/007:50:320
1025999665,44cyclictest19001-21apt11:50:072
10259996648,9cyclictest22259-21sh11:55:112
1025999664,47cyclictest15844-21ssh09:55:402
1025999664,47cyclictest15844-21ssh09:55:402
10259996641,14cyclictest0-21swapper/209:10:292
1025999663,34cyclictest30830-21grep09:25:452
10259996633,22cyclictest27637-21latency07:55:332
10252996634,11cyclictest181rcu_preempt08:20:321
10246996644,16cyclictest28581-21modprobe08:00:080
1024699663,33cyclictest19516-21uname07:30:330
10246996612,38cyclictest11996-21apt-key07:10:110
1025999654,44cyclictest23990-21acpi07:45:182
1025999654,44cyclictest21416-21apt11:00:072
1025999653,30cyclictest0-21swapper/212:05:222
1025999653,30cyclictest0-21swapper/212:05:222
1025299659,25cyclictest0-21swapper/108:30:111
10252996542,12cyclictest0-21swapper/107:30:341
1025299653,42cyclictest22599-21fschecks_time11:55:291
1025299653,42cyclictest22599-21fschecks_time11:55:291
10252996531,12cyclictest181rcu_preempt11:55:071
1025299652,28cyclictest6018-21munin-run09:40:071
1025299652,28cyclictest6018-21munin-run09:40:071
10246996546,13cyclictest352-21runrttasks08:05:070
10246996546,13cyclictest352-21runrttasks08:05:070
1024699654,36cyclictest31239-21/usr/sbin/munin12:10:240
1024699654,36cyclictest31239-21/usr/sbin/munin12:10:240
10246996534,25cyclictest18470-21ssh10:00:300
10252996446,12cyclictest29654-21ssh09:25:111
1025299643,42cyclictest9548-21latency_hist10:40:101
1024699646,28cyclictest9186-21latency_hist08:40:100
10246996435,19cyclictest0-21swapper/010:44:560
1024699643,41cyclictest352-21runrttasks08:25:500
1024699642,42cyclictest13912-21modprobe08:55:070
222742630,5sleep30-21swapper/307:40:103
1025999634,37cyclictest352-21runrttasks07:52:302
10259996341,12cyclictest0-21swapper/210:51:492
10252996348,9cyclictest27560-21ssh09:21:341
10246996342,14cyclictest12530-21latency_hist08:50:100
10246996342,14cyclictest12530-21latency_hist08:50:100
1025299623,42cyclictest352-21runrttasks11:22:191
10268996116,24cyclictest0-21swapper/310:25:313
1025299612,22cyclictest24368-21fschecks_count10:10:291
1026899573,35cyclictest30915-21taskset11:15:203
1026899573,35cyclictest30915-21taskset11:15:203
1026899572,40cyclictest2881-21taskset12:15:443
1026899563,40cyclictest23244-21chrt09:15:083
1026899563,36cyclictest9556-21chrt09:45:293
1026899552,34cyclictest6847-21chrt08:30:413
1026899543,33cyclictest24428-21chrt07:45:333
1026899542,35cyclictest32742-21taskset08:10:403
1026899533,37cyclictest28325-21chrt11:10:373
1026899533,36cyclictest18049-21chrt09:05:363
1026899532,38cyclictest22823-21chrt11:55:333
1026899532,38cyclictest22823-21chrt11:55:333
1026899524,33cyclictest10403-21chrt10:40:383
1026899523,34cyclictest28759-21taskset08:00:113
1026899522,37cyclictest18324-21chrt10:00:253
1026899522,36cyclictest995-21chrt12:13:453
1026899522,36cyclictest995-21chrt12:13:453
1026899522,36cyclictest20265-21taskset11:50:433
1026899522,35cyclictest8799-21chrt09:44:443
1026899522,34cyclictest18468-21chrt10:55:093
1026899522,32cyclictest2274-21chrt11:20:433
1026899513,38cyclictest8544-21taskset08:35:433
1026899513,36cyclictest27600-21chrt10:15:333
1026899513,35cyclictest19167-21chrt11:50:103
1026899512,35cyclictest5984-21taskset12:20:593
1026899504,34cyclictest15956-21taskset09:00:253
1026899503,34cyclictest31056-21chrt10:20:443
1026899503,34cyclictest26862-21taskset11:08:473
1026899503,34cyclictest13736-21chrt09:52:023
1026899502,35cyclictest26727-21chrt10:15:003
1026899502,35cyclictest24021-21chrt11:04:093
1026899502,34cyclictest9548-21chrt12:27:403
1026899493,35cyclictest7129-21taskset10:35:313
1026899493,32cyclictest8107-21chrt11:30:403
1026899492,37cyclictest917-21kworker/3:1+events10:58:223
1026899492,34cyclictest25261-21chrt09:16:513
1026899484,29cyclictest11697-21taskset11:36:203
1026899484,29cyclictest11697-21taskset11:36:203
1026899483,32cyclictest30262-21chrt08:05:093
1026899483,32cyclictest30262-21chrt08:05:093
1026899483,31cyclictest21697-21chrt10:05:363
1026899483,31cyclictest21697-21chrt10:05:363
1026899482,33cyclictest3957-21chrt10:30:243
1026899482,29cyclictest13514-21chrt11:40:253
1026899474,30cyclictest15161-21chrt10:49:253
1026899473,32cyclictest31409-21chrt09:27:163
1026899473,31cyclictest5741-21chrt09:39:213
1026899473,31cyclictest5741-21chrt09:39:213
1026899463,29cyclictest10835-21chrt12:30:233
1026899462,31cyclictest30032-21taskset12:07:333
1026899462,31cyclictest30032-21taskset12:07:333
1026899453,31cyclictest19031-21chrt07:30:103
1026899453,31cyclictest19031-21chrt07:30:103
1026899453,30cyclictest4574-21taskset11:25:253
1026899453,30cyclictest4574-21taskset11:25:253
1026899453,27cyclictest16436-21chrt09:56:123
1026899453,27cyclictest16436-21chrt09:56:123
1026899452,27cyclictest917-21kworker/3:1+events09:20:203
1026899452,27cyclictest917-21kworker/3:1+events09:20:203
1026899443,30cyclictest2509-21chrt09:33:343
1026899443,30cyclictest11846-21chrt07:10:093
1026899442,29cyclictest1514-21taskset08:15:303
1026899433,28cyclictest27015-21chrt07:55:093
1026899433,27cyclictest15957-21taskset07:20:223
1026899433,27cyclictest15957-21taskset07:20:223
1026899432,30cyclictest22547-21chrt07:40:273
1026899432,28cyclictest15151-21chrt08:55:433
1026899423,29cyclictest5887-21taskset08:30:083
1026899422,28cyclictest14170-21taskset08:55:113
1026899413,28cyclictest27616-21taskset12:04:093
1026899413,27cyclictest3074-21taskset08:20:283
1026899413,27cyclictest20558-21chrt07:35:083
10268994127,8cyclictest114472chrt08:45:353
10268994127,8cyclictest114472chrt08:45:353
1026899412,28cyclictest9344-21taskset08:40:163
1026899412,28cyclictest31879-21taskset08:10:073
1026899412,28cyclictest31879-21taskset08:10:073
1026899403,28cyclictest14349-21taskset07:15:203
1026899403,28cyclictest14349-21taskset07:15:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional