You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 16:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Apr 24, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8427212911,91sleep07886-21/usr/sbin/munin06:58:550
8550212310,30sleep30-21swapper/306:59:023
9298212218,71sleep29309-21ls07:02:362
9379991103,68cyclictest27177-21apt-get11:07:522
9370991103,32cyclictest17675-21mailstats09:04:000
9370991094,45cyclictest31934-21/usr/sbin/munin09:27:540
93709910854,48cyclictest16017-21diskmemload11:29:300
9370991074,30cyclictest1583-21cat11:18:060
9370991065,25cyclictest13485-21latency_hist12:32:330
9370991064,28cyclictest352-21runrttasks07:30:150
9370991064,28cyclictest352-21runrttasks07:30:150
9370991063,37cyclictest30852-21ssh12:07:450
9370991063,31cyclictest29881-21/usr/sbin/munin10:17:580
93709910551,47cyclictest5323-21kernelversion08:27:560
9370991053,38cyclictest2209-21ssh09:32:410
93709910351,46cyclictest23061-21ssh09:12:560
9379991027,67cyclictest4095-21apt-get12:17:462
9370991024,29cyclictest352-21runrttasks11:57:090
9370991023,25cyclictest4611-21/usr/sbin/munin12:18:180
9370991014,36cyclictest6819-21fschecks_count08:32:530
9370991013,37cyclictest19842-21fschecks_count09:07:530
9370991013,37cyclictest19842-21fschecks_count09:07:530
9370991013,29cyclictest28626-21ssh12:03:060
9370991007,22cyclictest19221-21/usr/sbin/munin11:47:560
9370991007,22cyclictest19221-21/usr/sbin/munin11:47:560
9370991003,43cyclictest9485-21runrttasks09:43:340
9370991003,42cyclictest14232-21/usr/sbin/munin09:52:410
9370991003,32cyclictest7724-21cpuspeed12:22:470
9370991003,32cyclictest7724-21cpuspeed12:22:470
9370991002,34cyclictest21069-21latency_hist07:37:330
9370991002,34cyclictest21069-21latency_hist07:37:330
93709910015,16cyclictest0-21swapper/010:07:410
937099993,37cyclictest13337-21tune2fs08:52:530
937099993,34cyclictest352-21runrttasks11:37:190
937099993,34cyclictest352-21runrttasks11:37:190
937099993,32cyclictest27155-21/usr/sbin/munin11:08:470
937099993,31cyclictest26928-21latency_hist11:07:340
937099993,22cyclictest15496-21grep10:47:590
937099992,40cyclictest4628-21rm11:23:050
9370999837,53cyclictest0-21swapper/012:14:150
937099983,34cyclictest24822-21/usr/sbin/munin11:57:540
937099983,33cyclictest352-21runrttasks07:42:350
937099983,33cyclictest352-21runrttasks07:42:350
937099983,33cyclictest26567-21grep10:12:530
937099983,33cyclictest13896-21/usr/sbin/munin11:38:090
937099983,32cyclictest28304-21modprobe09:22:310
937099982,36cyclictest28605-21cat07:58:070
9370999816,31cyclictest947-21runrttasks10:23:070
937099974,32cyclictest8835-21cat08:38:050
937099974,30cyclictest352-21runrttasks08:12:550
937099974,30cyclictest352-21runrttasks08:12:550
937099973,38cyclictest8046-21latency_hist09:42:350
937099973,38cyclictest8046-21latency_hist09:42:350
937099973,34cyclictest21984-21unixbench_multi10:58:080
937099972,38cyclictest21679-21latency07:37:560
937099972,38cyclictest21679-21latency07:37:560
937099964,35cyclictest11899-21ps09:48:020
937099964,35cyclictest11899-21ps09:48:020
937099963,37cyclictest8249-21sshd10:36:380
937099963,37cyclictest8249-21sshd10:36:380
937099963,31cyclictest12990-21grep08:52:350
937099963,30cyclictest16769-21timerwakeupswit11:43:070
937099963,28cyclictest3101-21munin-plugin-st08:22:310
937099963,28cyclictest3101-21munin-plugin-st08:22:310
937099955,33cyclictest3344-21/usr/sbin/munin08:23:050
937099955,33cyclictest3344-21/usr/sbin/munin08:23:050
937099954,35cyclictest9685-21ssh10:38:040
937099953,37cyclictest29208-21runrttasks09:22:590
937099953,30cyclictest352-21runrttasks10:43:440
937099953,23cyclictest14145-21unixbench_multi07:13:080
937099952,33cyclictest16454-21apt-get07:22:430
937099952,30cyclictest21022-21ssh10:03:040
937099944,27cyclictest11114-21latency_hist07:07:360
937099944,27cyclictest11114-21latency_hist07:07:360
937099943,35cyclictest11155-21munin-node07:07:400
937099943,34cyclictest2845-21/usr/sbin/munin10:28:040
937099943,33cyclictest26496-21cut07:52:560
937099943,30cyclictest31589-21awk08:08:040
937099942,36cyclictest9797-21/usr/sbin/munin08:42:570
937099942,29cyclictest17958-21ssh10:52:450
9370999375,13cyclictest16265-21latency_hist07:22:340
937099934,32cyclictest30752-21latency_hist08:07:340
937099934,32cyclictest15435-21timerandwakeup08:58:060
937099934,32cyclictest15435-21timerandwakeup08:58:060
937099933,36cyclictest17839-21ntp_kernel_pll_09:57:590
937099932,32cyclictest26008-21runrttasks07:52:340
89342937,54sleep18961-21users06:59:081
937099923,31cyclictest30193-21/usr/sbin/munin11:12:400
938599865,54cyclictest0-21swapper/311:07:483
9374998512,52cyclictest4095-21apt-get12:17:491
9379998259,16cyclictest32319-21idleruntime-cro08:12:322
9379998258,19cyclictest4126-21kworker/u18:2+events_unbound08:52:312
9379998145,7cyclictest155221systemd-run11:42:322
9374998151,24cyclictest9549-21sh10:38:031
9379997956,17cyclictest9362-21cyclictest09:42:562
9379997941,16cyclictest181rcu_preempt10:27:592
9374997955,17cyclictest19676-21snmpd09:32:311
9374997921,22cyclictest0-21swapper/109:25:061
9379997849,22cyclictest31906-21unixbench_singl12:08:072
9374997858,13cyclictest25796-21sh11:58:081
9379997754,17cyclictest16145-21apt-key09:02:352
9379997754,17cyclictest16145-21apt-key09:02:352
937999774,40cyclictest2026-21latency_hist09:32:342
937999774,33cyclictest21587-21latency_hist11:52:332
937999774,33cyclictest21587-21latency_hist11:52:332
937999773,33cyclictest8103-21latency_hist08:37:342
9379997719,22cyclictest10074-21diskmemload11:32:532
9379997719,22cyclictest10074-21diskmemload11:32:532
9374997746,23cyclictest20163-21netstat07:32:591
9374997746,23cyclictest20163-21netstat07:32:591
9379997659,11cyclictest9466-21ntp_kernel_err10:37:582
9379997656,13cyclictest803-21sendmail-mta07:42:312
9379997656,13cyclictest803-21sendmail-mta07:42:312
937499764,28cyclictest0-21swapper/110:32:571
937499764,28cyclictest0-21swapper/110:32:571
9374997550,17cyclictest9362-21cyclictest12:13:041
9379997454,13cyclictest21840-21timerandwakeup10:58:072
9379997452,16cyclictest13055-21latency_hist07:12:342
9379997448,19cyclictest18241-21fschecks_time10:52:532
9379997446,21cyclictest544-21cron10:12:322
9374997459,10cyclictest24300-21unixbench_singl10:08:061
937999735,30cyclictest7932-21runrttasks09:42:322
937999735,30cyclictest7932-21runrttasks09:42:322
9379997352,12cyclictest4910-21sh09:37:312
9379997351,14cyclictest13783-21switchtime08:53:052
937999733,43cyclictest16270-21sshd09:55:382
9374997357,9cyclictest15482-21kworker/u17:0-rpciod12:22:491
9374997357,9cyclictest15482-21kworker/u17:0-rpciod12:22:491
9374997355,13cyclictest5350-21latency08:27:561
9374997347,16cyclictest0-21swapper/111:42:541
9374997342,24cyclictest0-21swapper/110:52:301
9374997328,15cyclictest20434-21kworker/u17:1-rpciod11:09:131
9379997253,11cyclictest0-21swapper/210:02:342
9379997250,15cyclictest26694-21interrupts10:12:552
9379997247,16cyclictest11012-21idleruntime12:27:542
937999723,45cyclictest20536-21ssh09:08:082
937999723,45cyclictest20536-21ssh09:08:082
9374997257,9cyclictest11163-21munin-plugin-st08:47:311
9374997255,10cyclictest0-21swapper/109:18:041
9374997252,15cyclictest9362-21cyclictest11:14:461
937999714,46cyclictest2162-21sendmail_mailtr12:13:052
9379997054,11cyclictest9362-21cyclictest07:42:522
9379997054,11cyclictest9362-21cyclictest07:42:522
9374997051,14cyclictest21612-21latency_hist11:52:341
9374997051,14cyclictest21612-21latency_hist11:52:341
9374997049,14cyclictest21479-21ssh10:03:261
9374997048,10cyclictest0-21swapper/107:07:421
937499703,32cyclictest16314-21rm09:02:351
937499703,32cyclictest16314-21rm09:02:351
9379996945,18cyclictest30910-21sh09:26:262
9379996923,10cyclictest0-21swapper/211:22:472
9374996923,37cyclictest19603-21ssh10:01:351
9374996920,20cyclictest28237-21seq10:15:261
9379996853,9cyclictest0-21swapper/212:23:062
9379996853,9cyclictest0-21swapper/212:23:062
9379996853,8cyclictest0-21swapper/209:18:082
9379996851,11cyclictest9362-21cyclictest11:06:002
9379996849,12cyclictest30681-21latency_hist12:07:342
9379996848,15cyclictest0-21swapper/209:52:322
9379996848,15cyclictest0-21swapper/209:52:322
9379996845,14cyclictest27600-21sh12:02:342
9379996844,13cyclictest0-21swapper/211:13:062
9379996841,20cyclictest352-21runrttasks08:22:462
9379996841,20cyclictest352-21runrttasks08:22:462
937499686,36cyclictest31-21ksoftirqd/111:28:181
9374996853,9cyclictest15482-21kworker/u17:0-nfsiod12:07:331
9374996852,10cyclictest8687-21ntp_kernel_err08:38:001
9374996852,10cyclictest8416-21/usr/sbin/munin09:42:511
9374996850,12cyclictest352-21runrttasks11:37:501
9374996848,14cyclictest32319-21idleruntime-cro08:12:321
937499684,41cyclictest19420-21latency_hist09:07:341
8532680,7sleep20-21swapper/210:23:062
9379996749,14cyclictest12942-21kworker/u18:1+events_unbound09:07:312
9379996745,16cyclictest297-21systemd-logind08:32:322
9379996741,17cyclictest0-21swapper/211:43:062
937999673,49cyclictest1804-21tail11:18:082
9374996748,13cyclictest2374-21systemd-journal11:37:321
9374996748,13cyclictest2374-21systemd-journal11:37:321
9374996743,17cyclictest9362-21cyclictest09:52:491
9374996742,18cyclictest0-21swapper/109:12:311
9374996742,18cyclictest0-21swapper/109:12:311
9374996734,25cyclictest0-21swapper/112:12:311
937499672,25cyclictest0-21swapper/111:03:031
9379996644,13cyclictest0-21swapper/208:43:042
9374996648,12cyclictest740-21/usr/sbin/munin11:17:591
9374996647,14cyclictest27710-21latency_hist07:57:351
9374996646,15cyclictest18948-21unixbench_multi10:53:071
9374996646,14cyclictest388-21fschecks_time08:12:521
9374996646,14cyclictest388-21fschecks_time08:12:521
9374996642,18cyclictest22631-21latency_hist07:42:331
9374996642,18cyclictest22631-21latency_hist07:42:331
9374996640,19cyclictest0-21swapper/112:28:071
9374996639,20cyclictest0-21swapper/109:52:321
9374996639,20cyclictest0-21swapper/109:52:321
9374996638,21cyclictest0-21swapper/107:12:531
9374996632,20cyclictest0-21swapper/111:53:001
937499662,34cyclictest4703-21apt08:27:311
937499662,34cyclictest4703-21apt08:27:311
9379996541,13cyclictest0-21swapper/210:49:552
9379996540,18cyclictest0-21swapper/211:52:512
937999653,43cyclictest23482-21find09:13:052
937999653,40cyclictest22949-21latency_hist10:07:342
937999652,42cyclictest1093-21head08:13:072
937999652,42cyclictest1093-21head08:13:072
9374996550,11cyclictest9362-21cyclictest08:52:561
9374996541,18cyclictest0-21swapper/111:22:531
9379996443,14cyclictest0-21swapper/208:02:592
9379996442,12cyclictest0-21swapper/210:18:032
9379996440,13cyclictest0-21swapper/207:02:522
9379996440,13cyclictest0-21swapper/207:02:522
937999643,21cyclictest12429-21seq10:42:582
9374996441,12cyclictest0-21swapper/107:02:471
9374996441,12cyclictest0-21swapper/107:02:471
9374996440,18cyclictest16017-21diskmemload10:59:191
937499643,38cyclictest352-21runrttasks09:33:571
937499642,35cyclictest23375-21netstat07:42:571
937499642,35cyclictest23375-21netstat07:42:571
9379996348,9cyclictest0-21swapper/208:18:082
9379996348,9cyclictest0-21swapper/208:18:082
9379996342,11cyclictest0-21swapper/207:57:542
9379996336,20cyclictest24979-21netstat07:47:592
937999633,37cyclictest19675-21/usr/sbin/munin07:32:592
937999633,37cyclictest19675-21/usr/sbin/munin07:32:592
9374996336,20cyclictest0-21swapper/107:52:311
937499633,40cyclictest30014-21grep10:18:031
937499632,44cyclictest352-21runrttasks07:20:401
9385996213,35cyclictest0-21swapper/312:17:583
9379996248,7cyclictest0-21swapper/207:27:592
9379996248,7cyclictest0-21swapper/207:27:592
9379996241,11cyclictest0-21swapper/207:52:532
937999623,43cyclictest8439-21fschecks_time08:37:542
937999623,30cyclictest7448-21grep11:28:042
937999622,40cyclictest15802-21head07:18:072
9374996247,9cyclictest29836-21ntp_kernel_err08:02:591
9374996247,8cyclictest0-21swapper/110:23:071
9374996231,21cyclictest6267-21grep09:38:071
9374996231,21cyclictest6267-21grep09:38:071
938599614,40cyclictest5534-21chrt09:37:533
938599614,40cyclictest5534-21chrt09:37:533
9379996145,11cyclictest9362-21cyclictest10:37:332
9379996145,11cyclictest9362-21cyclictest10:37:332
9379996141,14cyclictest13995-21threads07:13:072
937999613,36cyclictest16436-21/usr/sbin/munin07:22:482
9374996140,11cyclictest0-21swapper/108:48:051
9374996139,12cyclictest0-21swapper/107:32:341
9374996139,12cyclictest0-21swapper/107:32:341
9374996137,13cyclictest0-21swapper/108:02:351
9374996128,25cyclictest0-21swapper/110:32:351
937499612,20cyclictest352-21runrttasks07:23:301
9374996014,38cyclictest7559-21unixbench_singl08:33:081
937499601,30cyclictest13622-21ssh10:44:501
938599584,36cyclictest16309-21chrt09:02:353
938599584,36cyclictest16309-21chrt09:02:353
9374995839,13cyclictest25280-21ssh09:17:301
9374995838,11cyclictest0-21swapper/108:17:521
9374995838,11cyclictest0-21swapper/108:17:521
938599574,36cyclictest6598-21taskset08:32:423
938599573,42cyclictest10471-21taskset09:46:203
938599564,39cyclictest28206-21chrt10:15:213
938599563,36cyclictest9747-21chrt08:42:353
938599562,42cyclictest17112-21taskset09:57:343
938599553,41cyclictest9463-21chrt10:37:583
938599543,38cyclictest8183-21chrt12:22:583
938599543,38cyclictest8183-21chrt12:22:583
938599543,37cyclictest4083-21chrt12:17:313
938599543,35cyclictest2991-21chrt10:27:493
938599543,35cyclictest18821-21chrt11:47:443
938599543,35cyclictest18821-21chrt11:47:443
938599543,34cyclictest12724-21taskset11:37:353
938599543,34cyclictest12724-21taskset11:37:353
938599533,38cyclictest28388-21chrt09:22:333
938599533,38cyclictest11384-21taskset12:28:053
938599533,36cyclictest19192-21chrt10:00:263
938599533,34cyclictest29643-21chrt08:02:543
938599532,39cyclictest14640-21chrt11:40:103
938599527,33cyclictest15986-21taskset11:42:503
938599525,32cyclictest31022-21taskset08:07:483
938599523,36cyclictest17346-21chrt10:51:523
938599523,32cyclictest11481-21chrt07:07:423
938599523,31cyclictest3259-21chrt08:22:343
938599523,31cyclictest3259-21chrt08:22:343
938599522,36cyclictest32507-21chrt11:16:283
938599522,35cyclictest31035-21taskset09:26:473
9385995211,33cyclictest0-21swapper/309:02:513
938599514,34cyclictest13968-21chrt09:52:323
938599514,34cyclictest13968-21chrt09:52:323
938599513,36cyclictest28704-21chrt07:58:083
938599513,35cyclictest19842-21taskset10:55:213
938599513,35cyclictest16891-21chrt07:22:573
938599513,34cyclictest32159-21taskset10:22:343
938599513,33cyclictest640-21chrt08:12:583
938599513,33cyclictest640-21chrt08:12:583
938599512,36cyclictest26256-21chrt11:06:313
938599512,34cyclictest13286-21chrt07:12:483
938599504,34cyclictest2396-21chrt11:19:363
938599504,33cyclictest32724-21taskset09:28:093
938599504,32cyclictest11576-21taskset08:47:493
938599503,37cyclictest25677-21chrt11:58:053
938599503,34cyclictest2617-21chrt10:27:333
938599503,34cyclictest15756-21chrt07:18:073
938599503,33cyclictest21996-21taskset10:58:083
9385995028,13cyclictest0-21swapper/309:12:533
938599502,37cyclictest29718-21taskset12:05:193
938599502,36cyclictest521-21chrt12:11:023
938599502,35cyclictest23894-21taskset11:55:463
938599502,34cyclictest3991-21chrt09:35:013
938599494,32cyclictest9739-21chrt07:02:523
938599494,32cyclictest9739-21chrt07:02:523
938599493,33cyclictest21770-21chrt10:04:153
938599493,33cyclictest10587-21chrt08:43:033
938599493,29cyclictest23202-21chrt10:07:353
938599492,35cyclictest4047-21chrt11:22:523
938599492,35cyclictest20202-21taskset09:08:033
938599492,35cyclictest20202-21taskset09:08:033
938599483,31cyclictest7420-21chrt11:28:033
938599482,37cyclictest12417-21chrt10:42:573
938599482,32cyclictest7289-21chrt10:33:573
938599482,32cyclictest7289-21chrt10:33:573
938599474,29cyclictest26860-21taskset07:53:063
938599473,35cyclictest3397-21taskset08:22:463
938599473,35cyclictest3397-21taskset08:22:463
938599473,33cyclictest21250-21chrt07:37:353
938599472,33cyclictest23462-21chrt07:43:013
938599472,33cyclictest23462-21chrt07:43:013
938599463,28cyclictest20041-21chrt07:32:573
938599452,29cyclictest13112-21taskset08:52:473
938599433,25cyclictest25008-21chrt07:48:003
938599423,29cyclictest19447-21chrt07:32:323
938599423,29cyclictest19447-21chrt07:32:323
938599423,27cyclictest22433-21taskset07:40:063
938599423,27cyclictest22433-21taskset07:40:063
938599373,24cyclictest5222-21chrt08:27:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional