You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 08:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Sep 20, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
118579910578,18cyclictest1229-21fschecks_count00:14:150
118689910256,35cyclictest4109-21runrttasks21:37:291
118689910256,35cyclictest4109-21runrttasks21:37:291
11857999840,26cyclictest0-21swapper/021:24:490
116842987,69sleep10-21swapper/119:08:391
11876999775,16cyclictest358-21ntpd21:23:542
11857999782,9cyclictest30133-21modprobe00:08:510
11857999782,9cyclictest30133-21modprobe00:08:510
11876999464,23cyclictest18991-21diskmemload00:00:082
11876999415,39cyclictest39-21ksoftirqd/221:17:222
11876999336,24cyclictest181rcu_preempt23:09:142
1187699932,53cyclictest39-21ksoftirqd/221:55:082
1187699932,53cyclictest39-21ksoftirqd/221:55:082
1187699923,35cyclictest27218-21apt-get19:54:052
11868999276,11cyclictest11844-21cyclictest21:15:271
11868999240,45cyclictest833-21latency23:19:191
11868999240,45cyclictest833-21latency23:19:191
11876999169,17cyclictest29046-21processes21:24:262
1186899913,32cyclictest3968-21open_files23:24:231
1186899902,30cyclictest411-21wc20:09:271
1186899902,30cyclictest411-21wc20:09:271
11857999014,29cyclictest0-21swapper/023:24:060
11876998970,12cyclictest11844-21cyclictest19:14:162
11876998970,12cyclictest11844-21cyclictest19:14:162
11876998961,21cyclictest524-21in:imuxsock00:14:152
1186899894,43cyclictest30202-21kernelversion23:14:171
1186899893,31cyclictest31808-21latency_hist20:08:541
1186899893,31cyclictest31808-21latency_hist20:08:541
1186899893,30cyclictest3644-21grep22:29:281
1186899893,30cyclictest3644-21grep22:29:281
11876998867,15cyclictest6067-21latency_hist23:28:532
1187699881,59cyclictest39-21ksoftirqd/219:45:152
1187699881,59cyclictest39-21ksoftirqd/219:45:152
11876998811,45cyclictest39-21ksoftirqd/220:44:142
11868998846,35cyclictest1-21systemd21:23:521
11868998845,35cyclictest0-21swapper/122:44:081
1186899882,30cyclictest5148-21ssh21:39:111
11868998766,15cyclictest31786-21sh22:23:521
11868998766,15cyclictest31786-21sh22:23:521
11868998763,17cyclictest29781-21sh00:07:521
11868998763,17cyclictest29781-21sh00:07:521
1186899874,39cyclictest12018-21/usr/sbin/munin19:09:181
1186899873,34cyclictest1-21systemd19:53:521
1186899873,32cyclictest26798-21apt-get23:09:041
1186899873,27cyclictest30441-21/usr/sbin/munin00:09:281
1186899873,16cyclictest28388-21ssh21:24:071
1186899872,28cyclictest14577-21/usr/sbin/munin22:49:281
1186899864,42cyclictest5604-21/usr/sbin/munin22:34:131
1186899863,44cyclictest21125-21idleruntime22:59:471
1186899863,33cyclictest22639-21taskset19:39:211
1186899863,32cyclictest2571-21cron20:18:511
1186899863,32cyclictest18658-21latency_hist19:28:541
1186899863,32cyclictest16307-21grep23:44:291
1186899863,32cyclictest16307-21grep23:44:291
1186899862,33cyclictest18534-21tail21:04:281
11857998664,12cyclictest29676-21sh22:20:110
11857998664,12cyclictest29676-21sh22:20:110
1067128611,40sleep00-21swapper/019:04:220
11876998568,11cyclictest13413-21ssh21:53:242
11876998559,18cyclictest4621-21sh00:19:222
1187699852,45cyclictest39-21ksoftirqd/220:14:012
1186899857,23cyclictest18991-21diskmemload21:54:291
1186899857,23cyclictest18991-21diskmemload21:54:291
11868998566,11cyclictest0-21swapper/122:39:061
11868998566,11cyclictest0-21swapper/122:39:061
1186899854,32cyclictest28059-21cat19:55:031
1186899854,29cyclictest17042-21modprobe19:23:511
1186899854,29cyclictest17042-21modprobe19:23:511
11868998539,39cyclictest29117-21fschecks_time19:59:151
1186899853,40cyclictest19311-21unixbench_singl23:49:281
1186899853,36cyclictest23988-21systemd-run23:58:521
1186899853,34cyclictest5816-21modprobe20:28:511
1186899853,33cyclictest4421-21ssh00:19:171
1186899853,33cyclictest25629-21latency_hist22:13:531
1186899853,33cyclictest25629-21latency_hist22:13:531
1186899853,33cyclictest1747-21ssh22:27:141
1186899853,32cyclictest14024-21latency19:14:031
1186899853,32cyclictest14024-21latency19:14:031
1186899853,31cyclictest23558-21/usr/sbin/munin23:04:141
1186899853,31cyclictest15857-21latency_hist00:38:551
1186899853,26cyclictest12495-21latency_hist20:48:551
1107928514,38sleep30-21swapper/319:04:373
11876998465,14cyclictest11844-21cyclictest19:09:142
11868998462,17cyclictest21583-21kworker/u19:2+events_unbound20:38:521
11868998462,17cyclictest21583-21kworker/u19:2+events_unbound20:38:521
11868998462,15cyclictest9145-21ssh00:27:301
11868998462,15cyclictest9145-21ssh00:27:301
1186899844,39cyclictest14353-21latency_hist20:53:551
11868998440,39cyclictest11844-21cyclictest00:29:291
1186899843,36cyclictest20204-21taskset21:09:291
1186899843,33cyclictest19622-21cat19:29:271
1186899843,30cyclictest9541-21fschecks_count23:34:121
1186899842,33cyclictest26046-21sh22:14:091
1186899842,32cyclictest3394-21ntpq20:19:231
1186899842,32cyclictest22755-21latency_hist22:08:551
1186899842,31cyclictest1924-21timerandwakeup00:14:291
11868998416,32cyclictest17593-21latency_hist21:03:551
11857998423,43cyclictest28724-21sh23:11:490
1186899832,28cyclictest343-21runrttasks20:39:151
1186899832,27cyclictest13592-21ls21:53:511
11868998316,59cyclictest0-21swapper/123:39:161
11876998263,13cyclictest343-21runrttasks22:09:192
11876998263,13cyclictest343-21runrttasks22:09:192
11876998255,18cyclictest2911-21sh23:23:362
11876998255,18cyclictest2911-21sh23:23:362
1187699823,57cyclictest12284-21apt-get20:49:062
1187699822,48cyclictest39-21ksoftirqd/222:29:502
1187699822,48cyclictest39-21ksoftirqd/222:29:502
1186899824,30cyclictest7909-21/usr/sbin/munin21:44:231
1186899824,30cyclictest23971-21fschecks_count19:44:161
1186899824,30cyclictest23971-21fschecks_count19:44:161
1186899823,30cyclictest20702-21cut19:34:141
1186899823,29cyclictest17694-21cat22:54:091
1186899823,29cyclictest17694-21cat22:54:091
1186899823,29cyclictest14129-21latency_hist20:53:551
1186899823,29cyclictest14129-21latency_hist20:53:551
1186899823,25cyclictest24476-21/usr/sbin/munin23:59:031
1186899822,30cyclictest343-21runrttasks23:28:551
11857998256,18cyclictest2454-21latency_hist22:28:540
11857998244,33cyclictest11844-21cyclictest22:18:550
11876998159,14cyclictest200-21systemd-journal00:35:152
11876998142,11cyclictest343-21runrttasks22:23:312
11876998142,11cyclictest343-21runrttasks22:23:312
1187699812,39cyclictest39-21ksoftirqd/220:01:182
11876998118,18cyclictest0-21swapper/222:37:342
1187699811,30cyclictest39-21ksoftirqd/223:04:282
11868998117,22cyclictest18558-21seq22:00:561
11857998153,20cyclictest21978-21latency_hist19:38:540
11857998148,23cyclictest15967-21grep19:19:140
11857998148,23cyclictest15967-21grep19:19:140
1170028118,37sleep211722-21idleruntime-cro19:08:522
11876998011,38cyclictest39-21ksoftirqd/219:29:472
1186899803,36cyclictest31977-21ssh21:29:231
11876997962,11cyclictest524-21in:imuxsock20:23:512
11876997958,14cyclictest662-21cron23:43:512
11876997956,16cyclictest524-21in:imuxsock00:07:112
11876997956,16cyclictest524-21in:imuxsock00:07:112
1187699792,38cyclictest39-21ksoftirqd/223:58:442
11876997921,27cyclictest0-21swapper/219:42:482
1186899793,36cyclictest6398-21if_err_eth020:29:161
1185799797,38cyclictest0-21swapper/022:41:120
1185799797,38cyclictest0-21swapper/022:41:120
11857997955,16cyclictest23950-21fschecks_count19:44:160
11857997955,16cyclictest23950-21fschecks_count19:44:160
11876997856,8cyclictest181rcu_preempt21:46:102
11857997863,9cyclictest0-21swapper/023:58:540
11857997854,16cyclictest23389-21latency_hist23:03:540
11857997840,25cyclictest14258-21modprobe22:48:500
11876997761,10cyclictest21839-21sed23:00:022
1187699774,45cyclictest39-21ksoftirqd/223:37:012
11876997739,20cyclictest343-21runrttasks23:32:082
11876997733,12cyclictest181rcu_preempt21:41:422
11857997712,25cyclictest9845-21runrttasks21:46:460
11876997647,12cyclictest115-21hwrng21:35:042
11876997647,12cyclictest115-21hwrng21:35:042
1187699762,42cyclictest39-21ksoftirqd/200:24:122
1187699762,42cyclictest39-21ksoftirqd/200:24:122
1185799765,30cyclictest14680-21/usr/sbin/munin20:54:150
1185799765,30cyclictest14680-21/usr/sbin/munin20:54:150
11857997652,17cyclictest18898-21kworker/u19:0+events_unbound21:08:510
11857997623,25cyclictest0-21swapper/019:13:520
1187699758,26cyclictest39-21ksoftirqd/222:01:042
11876997555,14cyclictest17089-21latency_hist19:23:532
11876997555,14cyclictest17089-21latency_hist19:23:532
11876997552,14cyclictest0-21swapper/219:28:542
1187699752,32cyclictest39-21ksoftirqd/223:51:092
1185799752,30cyclictest30529-21sendmail_mailtr23:14:250
276122740,7sleep30-21swapper/321:22:423
11876997460,9cyclictest17785-21sh22:54:142
11876997460,9cyclictest17785-21sh22:54:142
11876997434,8cyclictest181rcu_preempt23:48:452
11876997434,8cyclictest181rcu_preempt23:48:452
1187699742,39cyclictest39-21ksoftirqd/220:36:572
1187699742,39cyclictest39-21ksoftirqd/220:36:572
1185799748,38cyclictest343-21runrttasks23:23:350
1185799748,38cyclictest343-21runrttasks23:23:350
11857997446,21cyclictest6051-21/usr/sbin/munin22:34:180
11857997420,32cyclictest0-21swapper/019:54:550
11857997411,23cyclictest14063-21/usr/sbin/munin19:14:050
11857997411,23cyclictest14063-21/usr/sbin/munin19:14:050
11876997349,8cyclictest181rcu_preempt22:39:422
11876997349,8cyclictest181rcu_preempt22:39:422
11876997342,11cyclictest181rcu_preempt20:30:142
1187699732,33cyclictest39-21ksoftirqd/221:11:242
11876997312,37cyclictest39-21ksoftirqd/223:14:212
1185799739,26cyclictest20108-21ssh23:51:350
11857997352,13cyclictest15669-21kworker/u17:3+xprtiod21:19:280
1185799734,37cyclictest0-21swapper/000:23:410
11857997340,26cyclictest0-21swapper/021:29:220
1185799733,53cyclictest23902-21apt-get00:00:050
11857997321,10cyclictest5192-21ssh22:33:340
11857997321,10cyclictest5192-21ssh22:33:340
11857997312,20cyclictest7765-21/usr/sbin/munin00:24:270
11857997312,20cyclictest7765-21/usr/sbin/munin00:24:270
11876997258,10cyclictest11844-21cyclictest22:16:202
11876997257,11cyclictest11844-21cyclictest22:44:292
11876997254,13cyclictest15265-21proc_pri22:49:262
11876997215,27cyclictest39-21ksoftirqd/219:49:162
11876997210,32cyclictest39-21ksoftirqd/221:05:572
1185799725,23cyclictest0-21swapper/019:24:040
11857997213,24cyclictest2136-21sh21:34:140
11857997213,24cyclictest2136-21sh21:34:140
11876997151,9cyclictest0-21swapper/222:25:452
11876997149,17cyclictest20191-21fschecks_time22:04:152
1187699713,37cyclictest39-21ksoftirqd/220:24:242
1187699712,40cyclictest39-21ksoftirqd/200:31:352
1185799717,29cyclictest17191-21ssh23:46:450
1185799717,29cyclictest17191-21ssh23:46:450
11857997154,11cyclictest26569-21ssh23:08:550
1185799714,54cyclictest343-21runrttasks21:55:200
1185799714,54cyclictest343-21runrttasks21:55:200
11857997110,28cyclictest19432-21ssh22:03:240
11876997036,8cyclictest181rcu_preempt00:09:482
11876997035,16cyclictest181rcu_preempt21:30:242
1185799709,25cyclictest32429-21ssh00:11:570
11857997040,22cyclictest29172-21if_err_eth019:59:160
11857997037,27cyclictest11939-21unixbench_multi21:49:290
1185799703,57cyclictest12533-21fschecks_count23:39:120
11857997019,13cyclictest10077-21switchtime23:34:250
11857997010,24cyclictest19842-21sh22:57:460
11857997010,24cyclictest19842-21sh22:57:460
11876996944,10cyclictest181rcu_preempt20:10:512
11876996944,10cyclictest181rcu_preempt20:10:512
1185799698,31cyclictest15-21ksoftirqd/022:52:000
1185799698,28cyclictest7217-21ls23:29:280
1185799698,28cyclictest0-21swapper/021:39:250
11857996958,7cyclictest0-21swapper/020:19:170
11857996950,13cyclictest18991-21diskmemload21:12:310
1185799693,30cyclictest25658-21latency_hist22:13:530
1185799693,30cyclictest25658-21latency_hist22:13:530
1188199682,49cyclictest29158-21chrt22:19:073
1188199682,49cyclictest29158-21chrt22:19:073
11876996843,17cyclictest0-21swapper/220:59:102
1187699682,22cyclictest39-21ksoftirqd/220:07:372
1187699682,22cyclictest39-21ksoftirqd/220:07:372
1185799688,44cyclictest11997-21ssh00:32:090
11857996848,14cyclictest343-21runrttasks20:49:570
1185799683,42cyclictest19689-21timerandwakeup19:29:280
11857996820,23cyclictest0-21swapper/020:03:570
11857996820,23cyclictest0-21swapper/020:03:570
11857996819,14cyclictest10902-21date20:43:550
11857996815,16cyclictest22355-21ssh21:14:090
11857996811,21cyclictest22236-21ssh22:07:540
11876996747,10cyclictest0-21swapper/220:39:132
1187699672,30cyclictest39-21ksoftirqd/220:54:472
1187699672,30cyclictest39-21ksoftirqd/220:54:472
11857996719,10cyclictest4491-21taskset20:24:060
11857996714,14cyclictest14775-21sh00:36:340
11881996611,46cyclictest26922-21taskset23:09:243
11857996640,17cyclictest11844-21cyclictest20:48:550
11857996617,32cyclictest2186-21grep20:14:300
1185799655,24cyclictest16201-21/usr/sbin/munin20:59:150
11876996447,10cyclictest0-21swapper/219:34:142
1185799643,43cyclictest25748-21kernelversion19:49:170
11857996417,13cyclictest8894-21chrt20:37:140
11857996417,13cyclictest8894-21chrt20:37:140
11857996411,29cyclictest7627-21latency_hist20:33:550
1185799636,18cyclictest789-21taskset20:11:450
1185799636,18cyclictest789-21taskset20:11:450
1185799625,46cyclictest22145-21/usr/sbin/munin19:39:210
1188199617,39cyclictest12796-21taskset20:49:113
1188199614,43cyclictest24894-21taskset00:00:093
11881995940,9cyclictest271772sleep319:53:553
1188199573,43cyclictest6326-21chrt23:29:053
11881995541,8cyclictest451rcuc/320:30:093
11881995539,10cyclictest210672sleep319:34:253
1188199533,36cyclictest31530-21taskset00:09:303
1188199532,38cyclictest32086-21chrt21:29:273
11881995240,8cyclictest451rcuc/319:39:353
1188199523,37cyclictest7230-21chrt21:42:483
1188199514,32cyclictest19955-21chrt22:58:053
1188199514,32cyclictest19955-21chrt22:58:053
1188199513,36cyclictest12723-21chrt00:33:533
1188199513,35cyclictest15049-21chrt20:54:263
1188199513,35cyclictest15049-21chrt20:54:263
1188199513,32cyclictest5952-21chrt20:28:543
1188199512,33cyclictest17238-21taskset19:23:553
1188199512,33cyclictest17238-21taskset19:23:553
1188199512,32cyclictest27254-21chrt19:54:283
11881995036,9cyclictest451rcuc/320:18:143
1188199503,36cyclictest21149-21chrt22:59:483
1188199503,36cyclictest12666-21chrt19:09:253
1188199503,35cyclictest23840-21chrt22:09:343
1188199503,35cyclictest23840-21chrt22:09:343
1188199503,34cyclictest22619-21chrt23:55:153
1188199503,34cyclictest19858-21taskset22:03:553
1188199503,34cyclictest15925-21chrt21:57:023
1188199503,34cyclictest15925-21chrt21:57:023
1188199503,33cyclictest14102-21taskset19:14:113
1188199503,33cyclictest14102-21taskset19:14:113
1188199493,35cyclictest26233-21chrt23:08:513
1188199492,36cyclictest5430-21chrt22:33:543
1188199492,36cyclictest5430-21chrt22:33:543
1188199492,35cyclictest7922-21chrt21:44:023
1188199483,34cyclictest17431-21chrt19:24:113
1188199483,33cyclictest8734-21chrt00:26:203
1188199483,33cyclictest8734-21chrt00:26:203
1188199483,33cyclictest14710-21chrt22:49:103
1188199483,33cyclictest10042-21taskset23:34:243
1188199483,32cyclictest32420-21taskset23:18:483
1188199483,32cyclictest20203-21chrt23:51:503
1188199483,31cyclictest6293-21taskset00:22:513
1188199483,31cyclictest17464-21chrt21:03:533
1188199482,38cyclictest20685-21chrt21:10:133
1188199482,36cyclictest11890-21chrt21:49:293
1188199482,31cyclictest28773-21chrt22:18:543
1188199473,33cyclictest29033-21taskset00:05:453
1188199473,33cyclictest29033-21taskset00:05:453
1188199473,32cyclictest12895-21chrt22:45:013
11881994733,10cyclictest451rcuc/320:23:543
1188199472,36cyclictest2247-21chrt22:28:393
1188199472,35cyclictest1769-21chrt23:20:223
1188199472,35cyclictest1769-21chrt23:20:223
11881994717,22cyclictest31945-21chrt20:08:543
11881994717,22cyclictest31945-21chrt20:08:543
1188199463,33cyclictest5046-21chrt23:26:143
1188199463,33cyclictest1001-21taskset20:13:523
1188199463,33cyclictest1001-21taskset20:13:523
1188199463,28cyclictest8255-21chrt22:38:493
11881994628,10cyclictest0-21swapper/323:44:293
11881994628,10cyclictest0-21swapper/323:44:293
1188199454,30cyclictest2501-21taskset21:34:213
1188199454,30cyclictest2501-21taskset21:34:213
1188199453,32cyclictest11298-21chrt20:44:173
1188199453,29cyclictest3479-21chrt00:18:213
1188199452,31cyclictest18942-21chrt22:02:013
1188199452,31cyclictest15117-21chrt00:37:303
1188199452,30cyclictest12850-21taskset23:39:193
1188199452,28cyclictest9976-21chrt22:40:103
1188199452,28cyclictest9976-21chrt22:40:103
1188199443,29cyclictest29901-21chrt21:25:423
1188199413,25cyclictest17892-21chrt21:04:143
1188199403,28cyclictest24303-21taskset19:44:243
1188199403,28cyclictest24303-21taskset19:44:243
1188199402,29cyclictest24300-21taskset21:16:543
1188199402,29cyclictest19083-21chrt19:29:133
1188199402,26cyclictest9180-21chrt20:38:553
1188199402,26cyclictest9180-21chrt20:38:553
1188199383,26cyclictest9484-21taskset20:39:113
1188199373,23cyclictest28835-21taskset19:59:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional