You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 13:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Apr 19, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157721620,17sleep30-21swapper/318:58:403
22619912243,18cyclictest18971-21sendmail19:52:540
22619912048,11cyclictest0-21swapper/020:28:170
22619911652,13cyclictest12582-21latency_hist19:32:570
22619911651,59cyclictest14223-21timerwakeupswit22:03:290
2261991143,32cyclictest29091-21ssh23:23:270
22729911034,37cyclictest0-21swapper/100:08:081
22729911034,37cyclictest0-21swapper/100:08:081
2261991103,42cyclictest23727-21processes00:09:010
2261991103,42cyclictest23727-21processes00:09:010
22619910955,47cyclictest0-21swapper/023:53:220
950210412,59sleep01006-21fschecks_time18:58:220
227299982,62cyclictest13773-21cat23:52:591
227299982,62cyclictest13773-21cat23:52:591
13372979,53sleep21367-21ps18:58:362
227299959,51cyclictest12804-21apt-get19:33:161
227299954,47cyclictest0-21swapper/100:13:161
2272999510,65cyclictest16494-21apt-get22:08:081
2261999577,12cyclictest25244-21ssh22:23:090
2261999577,12cyclictest25244-21ssh22:23:090
2272999266,19cyclictest2117-21latency_hist19:02:571
2279999154,11cyclictest181rcu_preempt00:08:372
2279999154,11cyclictest181rcu_preempt00:08:372
2279999050,12cyclictest181rcu_preempt21:16:282
2261999073,10cyclictest2334-21ssh00:28:100
2272998869,14cyclictest31997-21switchtime22:33:271
2272998843,37cyclictest0-21swapper/100:03:261
2272998744,36cyclictest0-21swapper/122:18:321
2279998664,16cyclictest23063-21switchtime22:18:292
227999863,46cyclictest14830-21ssh23:54:202
227299869,28cyclictest4382-21apt-get21:48:111
227299869,28cyclictest4382-21apt-get21:48:111
2261998645,27cyclictest181rcu_preempt00:03:260
2279998546,9cyclictest181rcu_preempt20:13:072
2272998549,14cyclictest30084-21kworker/u19:1-writeback20:33:211
2261998562,15cyclictest0-21swapper/022:38:160
2261998546,17cyclictest181rcu_preempt19:08:240
2279998462,14cyclictest28601-21ssh22:28:202
2279998461,14cyclictest12210-21ssh22:54:392
2279998440,8cyclictest181rcu_preempt20:03:052
227999843,46cyclictest1153-21ssh22:37:162
2272998437,39cyclictest0-21swapper/121:13:271
227299843,67cyclictest4782-21apt-get23:38:041
2261998445,32cyclictest30714-21kworker/u17:3+nfsiod22:57:380
2272998364,12cyclictest2251-21cyclictest21:33:161
227299833,63cyclictest9329-21apt-get19:23:071
2272998334,42cyclictest7437-21latency_hist22:47:561
2272998334,42cyclictest7437-21latency_hist22:47:561
2272998324,53cyclictest0-21swapper/123:03:201
2279998231,13cyclictest181rcu_preempt21:28:202
2272998240,36cyclictest0-21swapper/121:08:161
2261998262,14cyclictest26485-21threads20:13:270
2261998260,15cyclictest2251-21cyclictest23:18:310
2261998260,15cyclictest2251-21cyclictest23:18:310
2272998160,14cyclictest29208-21unixbench_multi22:28:321
2272998157,16cyclictest0-21swapper/122:38:111
2261998164,10cyclictest23902-21ssh22:20:080
2279998043,8cyclictest181rcu_preempt19:33:332
2272998066,8cyclictest0-21swapper/122:07:531
2272998052,20cyclictest21894-21kernelversion21:23:201
2272998031,40cyclictest0-21swapper/123:17:561
2272998024,48cyclictest28697-21cut23:23:161
227299802,43cyclictest10562-21cat23:47:571
227299802,43cyclictest10562-21cat23:47:571
2261998062,12cyclictest5367-21ntp_offset21:49:300
2261998062,12cyclictest5367-21ntp_offset21:49:300
227299793,67cyclictest0-21swapper/119:03:061
227299793,67cyclictest0-21swapper/119:03:061
2261997961,12cyclictest2374-21systemd-journal21:07:550
2261997958,15cyclictest8505-21switchtime20:58:280
2261997956,16cyclictest1706-21apt-key22:37:570
227299783,66cyclictest0-21swapper/120:38:051
2272997834,36cyclictest0-21swapper/121:38:041
2272997834,33cyclictest0-21swapper/120:23:051
2272997834,33cyclictest0-21swapper/120:23:051
2272997831,40cyclictest2254-21grep21:43:311
2272997822,45cyclictest1-21systemd20:07:541
2261997859,11cyclictest19140-21sh22:12:570
2261997855,9cyclictest1631-21ssh23:32:560
2261997848,12cyclictest181rcu_preempt21:23:310
2261997842,29cyclictest8109-21cat19:18:200
240012770,7sleep30-21swapper/322:20:253
2279997762,10cyclictest2251-21cyclictest19:58:212
2279997757,12cyclictest19735-21ssh22:13:202
2279997757,12cyclictest19735-21ssh22:13:202
2272997757,14cyclictest300-21rs:main1
2272997757,14cyclictest300-21rs:main1
2272997749,22cyclictest11134-21fschecks_count19:28:161
227299774,64cyclictest0-21swapper/121:18:041
2261997749,20cyclictest2879-21unixbench_multi23:33:300
2285997611,37cyclictest0-21swapper/323:52:593
2285997611,37cyclictest0-21swapper/323:52:593
2279997647,20cyclictest1978-21latency_hist00:27:562
2279997646,21cyclictest7015-21tail19:13:312
2272997633,35cyclictest0-21swapper/119:43:211
2272997630,35cyclictest0-21swapper/120:13:101
2272997628,37cyclictest0-21swapper/100:29:151
2272997625,45cyclictest0-21swapper/100:22:211
2272997615,34cyclictest181rcu_preempt22:13:161
2272997615,34cyclictest181rcu_preempt22:13:161
2261997647,22cyclictest0-21swapper/021:18:310
2279997558,10cyclictest9150-21diskmemload21:08:152
2279997556,13cyclictest8977-21sh23:43:552
2279997556,13cyclictest8977-21sh23:43:552
2279997551,18cyclictest12280-21sendmail19:32:542
2272997551,14cyclictest10190-21ssh21:57:571
227299753,56cyclictest6117-21apt-get19:13:051
2272997527,40cyclictest0-21swapper/123:33:451
2261997556,13cyclictest17352-21sh23:03:290
2261997555,14cyclictest1083-21latency_hist21:42:570
2261997548,13cyclictest181rcu_preempt20:22:550
2261997548,13cyclictest181rcu_preempt20:22:550
2261997536,25cyclictest11827-21ssh21:59:380
2261997536,25cyclictest11827-21ssh21:59:380
2279997439,11cyclictest181rcu_preempt22:40:452
227999742,28cyclictest39-21ksoftirqd/222:03:192
227299743,55cyclictest13301-21apt-get23:53:061
2261997453,15cyclictest13495-40gzip23:52:560
2261997453,15cyclictest13495-40gzip23:52:560
2261997451,10cyclictest181rcu_preempt19:58:320
2261997434,12cyclictest181rcu_preempt21:47:530
2279997357,10cyclictest9150-21diskmemload22:58:162
2279997350,13cyclictest0-21swapper/222:09:092
2272997348,16cyclictest9516-21sh21:03:111
227299734,61cyclictest10724-21apt-get22:53:091
2272997335,31cyclictest0-21swapper/122:23:051
2272997335,31cyclictest0-21swapper/122:23:051
2272997335,31cyclictest0-21swapper/100:23:271
227299732,57cyclictest3197-21cut20:43:161
2261997346,10cyclictest181rcu_preempt21:12:030
2261997326,11cyclictest181rcu_preempt21:33:110
2279997250,15cyclictest15037-21sendmail_mailst19:38:272
2279997249,16cyclictest2251-21cyclictest22:43:182
2279997249,16cyclictest2251-21cyclictest22:43:182
2279997241,13cyclictest0-21swapper/220:43:172
2279997231,8cyclictest181rcu_preempt23:59:482
2279997231,8cyclictest181rcu_preempt23:59:482
2272997229,36cyclictest0-21swapper/121:28:161
2261997255,10cyclictest0-21swapper/000:13:150
2261997254,12cyclictest297-21systemd-logind20:42:540
2261997253,13cyclictest22477-21acpi20:03:030
2261997253,12cyclictest16284-21kworker/u18:323:02:530
2279997136,14cyclictest181rcu_preempt19:07:562
2279997136,14cyclictest181rcu_preempt19:07:562
227999713,55cyclictest27479-21ssh21:33:052
2272997152,9cyclictest0-21swapper/123:29:151
227299713,59cyclictest0-21swapper/119:38:051
227299713,58cyclictest18972-21apt19:52:541
2272997127,36cyclictest9150-21diskmemload23:08:271
2272997127,36cyclictest9150-21diskmemload23:08:271
2272997126,34cyclictest20602-21modprobe19:57:531
2261997155,10cyclictest277-21dbus-daemon22:52:540
2261997154,11cyclictest19668-21ssh22:13:190
2261997154,11cyclictest19668-21ssh22:13:190
2261997141,22cyclictest7856-21sort23:43:110
2261997141,22cyclictest7856-21sort23:43:110
226199713,32cyclictest8396-21unixbench_multi21:53:330
2279997038,9cyclictest181rcu_preempt19:23:092
2272997047,13cyclictest20860-21/usr/sbin/munin19:58:221
2272997046,13cyclictest0-21swapper/121:58:171
2272997046,13cyclictest0-21swapper/121:58:171
227299704,48cyclictest8329-21/usr/sbin/munin19:18:271
2261997052,11cyclictest0-21swapper/020:53:130
2261997049,12cyclictest0-21swapper/019:03:160
2261997049,12cyclictest0-21swapper/019:03:160
226199703,32cyclictest352-21runrttasks23:38:240
2279996951,13cyclictest17947-21sh23:04:162
2279996949,14cyclictest5015-21sh00:32:562
2279996946,17cyclictest298-21in:imuxsock20:57:532
2279996945,18cyclictest8803-21unixbench_singl22:48:312
2279996943,7cyclictest181rcu_preempt23:27:232
2272996953,10cyclictest17381-21ntp_kernel_err23:58:211
2272996953,10cyclictest17381-21ntp_kernel_err23:58:211
2272996947,15cyclictest2251-21cyclictest20:48:161
2272996947,15cyclictest2251-21cyclictest20:48:161
227299693,38cyclictest13643-21/usr/sbin/munin22:58:221
2272996923,37cyclictest0-21swapper/120:53:111
2261996955,9cyclictest0-21swapper/019:38:190
2261996952,13cyclictest2251-21cyclictest00:18:190
2261996951,8cyclictest0-21swapper/020:48:170
2261996951,8cyclictest0-21swapper/020:48:170
2261996947,16cyclictest25018-21ntp_kernel_err21:28:220
2261996946,15cyclictest9150-21diskmemload23:14:180
226199692,35cyclictest28582-21irqstats22:28:190
2279996852,9cyclictest0-21swapper/200:18:322
2279996847,12cyclictest0-21swapper/222:02:532
2279996847,12cyclictest0-21swapper/222:02:532
2279996836,23cyclictest26803-21ssh23:19:152
2279996836,23cyclictest26803-21ssh23:19:152
227999683,42cyclictest31298-21/usr/sbin/munin23:28:162
2272996826,31cyclictest8353-21ntpq22:48:231
2272996824,36cyclictest0-21swapper/119:08:171
2261996852,7cyclictest0-21swapper/020:33:290
2261996849,13cyclictest25459-21idleruntime-cro20:12:540
2261996847,15cyclictest18161-21sh21:17:530
2261996846,16cyclictest22423-21latency_hist23:12:570
2261996846,16cyclictest22423-21latency_hist23:12:570
2285996711,33cyclictest0-21swapper/322:08:083
2279996746,12cyclictest0-21swapper/221:22:572
2279996743,18cyclictest298-21in:imuxsock20:25:562
2279996743,18cyclictest298-21in:imuxsock20:25:562
2279996737,9cyclictest4455-21munin-node19:08:062
227999673,46cyclictest9280-21latency_hist19:22:572
227999673,42cyclictest28198-21timerwakeupswit20:18:292
227999673,42cyclictest28198-21timerwakeupswit20:18:292
227999673,37cyclictest28438-21latency_hist00:17:562
2279996733,14cyclictest181rcu_preempt23:52:532
2279996733,14cyclictest181rcu_preempt23:52:532
227999672,44cyclictest1255-21cpuspeed21:43:102
227999672,27cyclictest7036-21munin-run21:52:542
227999672,27cyclictest7036-21munin-run21:52:542
227299673,56cyclictest0-21swapper/120:28:071
2261996748,8cyclictest0-21swapper/019:37:560
2261996748,7cyclictest181rcu_preempt20:47:560
2261996744,15cyclictest0-21swapper/000:27:560
2261996726,35cyclictest0-21swapper/023:58:150
2261996726,35cyclictest0-21swapper/023:58:150
2279996642,13cyclictest0-21swapper/221:03:312
2279996636,11cyclictest181rcu_preempt19:47:572
227999663,43cyclictest31267-21grep21:39:062
2272996649,10cyclictest0-21swapper/121:02:531
227299663,52cyclictest24091-21apt-get20:08:041
2261996645,15cyclictest0-21swapper/019:43:190
2261996636,23cyclictest0-21swapper/022:43:090
2261996636,23cyclictest0-21swapper/022:43:090
2279996546,10cyclictest0-21swapper/220:38:262
227999654,34cyclictest7427-21latency_hist23:42:572
227999653,45cyclictest30786-21fschecks_time20:28:172
227999653,42cyclictest24123-21cpu20:08:092
227999653,41cyclictest352-21runrttasks20:37:202
227999653,41cyclictest2164-21fschecks_time23:33:162
227999653,34cyclictest18004-21latency19:48:182
2279996521,34cyclictest22283-21switchtime21:23:292
2279996518,10cyclictest20604-21modprobe19:57:532
227999644,38cyclictest25139-21idleruntime-cro23:17:532
227299643,51cyclictest27492-21df_inode20:18:131
227299643,51cyclictest27492-21df_inode20:18:131
2261996442,12cyclictest0-21swapper/020:27:530
2261996442,12cyclictest0-21swapper/020:27:530
2285996315,37cyclictest0-21swapper/322:38:173
2279996347,11cyclictest58-21kcompactd023:08:532
2279996347,11cyclictest58-21kcompactd023:08:532
2261996323,31cyclictest6371-21fschecks_time19:13:170
227999623,34cyclictest5468-21grep20:48:312
227999623,34cyclictest5468-21grep20:48:312
2279996229,13cyclictest181rcu_preempt20:58:302
226199623,40cyclictest352-21runrttasks19:24:170
2279996143,8cyclictest0-21swapper/200:07:542
2279996122,8cyclictest181rcu_preempt21:53:062
226199611,22cyclictest19841-21wc19:53:280
2285996017,21cyclictest0-21swapper/321:38:093
227999603,44cyclictest25763-21ntp_kernel_err22:23:212
227999603,44cyclictest25763-21ntp_kernel_err22:23:212
228599593,38cyclictest0-21swapper/323:53:253
2285995927,21cyclictest4291-21chrt21:47:583
2285995924,22cyclictest2046-21chrt23:33:143
2285995923,24cyclictest32424-21taskset23:28:323
2285995923,24cyclictest31188-21taskset22:33:053
2285995923,23cyclictest7885-21taskset19:18:153
2285995921,25cyclictest22894-21taskset21:24:263
2285995920,25cyclictest22174-21taskset00:07:163
2285995823,24cyclictest17784-21taskset19:48:133
2285995823,22cyclictest29013-21chrt23:23:253
2285995823,21cyclictest6784-21chrt23:41:053
2285995822,23cyclictest4907-21chrt20:48:193
2285995822,23cyclictest4907-21chrt20:48:193
2285995822,23cyclictest1116-21chrt00:25:433
2285995822,22cyclictest4495-21chrt00:31:553
2285995726,21cyclictest20603-21chrt19:57:533
2285995725,20cyclictest13323-21chrt21:08:293
2285995724,21cyclictest28602-21chrt21:33:353
2285995723,22cyclictest31098-21chrt20:28:273
2285995723,21cyclictest2961-21chrt20:43:093
2285995723,20cyclictest20790-21chrt23:08:583
2285995723,20cyclictest20790-21chrt23:08:583
2285995722,23cyclictest9330-21taskset19:23:053
2285995722,22cyclictest24366-21chrt23:15:433
2285995722,21cyclictest27621-21taskset00:15:343
2285995721,23cyclictest16875-21taskset21:14:173
2285995721,22cyclictest26466-21chrt21:31:033
2285995624,20cyclictest14137-21chrt22:58:193
2285995622,22cyclictest27012-21chrt22:25:313
2285995622,22cyclictest27012-21chrt22:25:313
2285995622,22cyclictest25742-21chrt20:13:083
2285995622,22cyclictest18339-21chrt23:59:423
2285995622,22cyclictest18339-21chrt23:59:423
2285995622,21cyclictest7524-21chrt20:57:513
2285995622,20cyclictest11679-21chrt21:59:133
2285995622,20cyclictest11679-21chrt21:59:133
2285995621,22cyclictest14384-21chrt22:03:313
2285995620,24cyclictest20866-21taskset19:58:053
2285995618,25cyclictest9372-21taskset22:50:003
228599553,36cyclictest7332-21taskset22:47:373
228599553,36cyclictest7332-21taskset22:47:373
228599553,36cyclictest19348-21chrt23:07:563
2285995523,21cyclictest5112-21chrt21:49:243
2285995523,21cyclictest5112-21chrt21:49:243
2285995523,21cyclictest3719-21chrt19:07:223
2285995523,21cyclictest3719-21chrt19:07:223
2285995523,20cyclictest7549-21chrt21:53:133
2285995523,20cyclictest23630-21chrt00:08:573
2285995523,20cyclictest23630-21chrt00:08:573
2285995523,20cyclictest19669-21chrt22:13:193
2285995523,20cyclictest19669-21chrt22:13:193
2285995523,19cyclictest6857-21chrt19:13:293
2285995523,19cyclictest18885-21chrt21:18:183
2285995522,21cyclictest17047-21chrt19:44:003
2285995522,20cyclictest2438-21chrt20:39:533
2285995521,22cyclictest13085-21chrt22:57:103
2285995521,21cyclictest27584-21chrt23:21:303
2285995521,21cyclictest27584-21chrt23:21:303
228599543,33cyclictest24729-21chrt20:08:263
228599543,32cyclictest6021-21taskset19:12:573
2285995423,19cyclictest28947-21chrt00:18:133
2285995422,21cyclictest12807-21taskset19:33:063
2285995421,21cyclictest30388-21chrt22:31:403
2285995421,20cyclictest30038-21chrt20:24:543
2285995421,20cyclictest30038-21chrt20:24:543
228599532,37cyclictest27983-21chrt20:18:263
228599532,37cyclictest27983-21chrt20:18:263
2285995323,19cyclictest22483-21chrt20:03:033
2285995322,19cyclictest11151-21chrt19:28:163
2285995321,21cyclictest8871-21chrt20:59:293
2285995321,20cyclictest732-21chrt20:33:413
2285995221,19cyclictest9038-21chrt23:44:093
2285995221,19cyclictest9038-21chrt23:44:093
2285995220,20cyclictest10753-21chrt21:03:593
2285995219,21cyclictest14561-21chrt19:38:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional