You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 03:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Tue Apr 21, 2026 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2127821099,70sleep121322-21/usr/sbin/munin18:58:281
22188999651,23cyclictest13346-21ssh22:23:142
22188999411,43cyclictest39-21ksoftirqd/219:18:342
22179999431,28cyclictest0-21swapper/023:00:160
2218899912,64cyclictest1555-21kworker/u18:2+ext4-rsv-conversion22:58:322
22188999111,39cyclictest39-21ksoftirqd/223:22:042
22188999111,39cyclictest39-21ksoftirqd/223:22:042
208672919,54sleep220946-21fschecks_time18:58:132
2218899902,40cyclictest39-21ksoftirqd/221:50:332
22188998921,34cyclictest39-21ksoftirqd/223:49:482
22188998816,39cyclictest39-21ksoftirqd/219:13:072
22188998816,39cyclictest39-21ksoftirqd/219:13:072
22184998868,13cyclictest18082-21/usr/sbin/munin21:38:141
22188998669,12cyclictest22167-21cyclictest20:13:232
22188998669,12cyclictest22167-21cyclictest20:13:232
22184998619,27cyclictest352-21runrttasks19:53:051
2219599844,50cyclictest0-21swapper/322:58:173
22188998319,38cyclictest39-21ksoftirqd/220:27:392
22188998319,38cyclictest39-21ksoftirqd/220:27:392
22188998314,42cyclictest39-21ksoftirqd/220:48:542
2217999831,26cyclictest19468-21kworker/u17:1+rpciod21:27:270
22188998264,13cyclictest330-21sh22:56:052
22188998264,13cyclictest330-21sh22:56:052
22188998249,23cyclictest19590-21idleruntime-cro20:32:452
22188998221,34cyclictest39-21ksoftirqd/219:44:502
22188998221,34cyclictest39-21ksoftirqd/219:44:502
22188998217,36cyclictest39-21ksoftirqd/222:11:122
22188998216,34cyclictest39-21ksoftirqd/223:54:592
22179998213,27cyclictest27917-21ssh23:42:210
22188998166,8cyclictest0-21swapper/223:08:032
22188998151,8cyclictest181rcu_preempt20:43:212
22188998020,19cyclictest0-21swapper/200:13:142
22179998046,25cyclictest23281-21tune2fs20:43:050
22179998043,31cyclictest14441-21ssh23:18:230
22179998043,31cyclictest14441-21ssh23:18:230
22188997961,12cyclictest29918-21sh22:51:272
22188997956,16cyclictest544-21cron19:52:502
22188997948,9cyclictest181rcu_preempt00:23:212
22188997920,34cyclictest39-21ksoftirqd/222:36:452
22179997914,27cyclictest19516-21ssh21:39:150
22179997912,23cyclictest30226-21xargs19:23:200
22188997857,15cyclictest23926-21latency_hist19:07:502
22188997848,11cyclictest181rcu_preempt23:23:112
22188997816,34cyclictest39-21ksoftirqd/219:36:532
22184997822,25cyclictest24359-21seq20:46:591
22179997827,41cyclictest22346-21apt-get19:02:570
22179997814,20cyclictest5654-21ssh21:17:180
22179997814,20cyclictest5654-21ssh21:17:180
22179997813,26cyclictest812-21rm23:50:350
22179997813,21cyclictest1838-21ssh21:10:020
22179997812,27cyclictest16507-21ssh00:17:270
22179997811,26cyclictest28927-21ssh22:48:400
22188997731,28cyclictest8973-21latency19:58:122
22188997731,19cyclictest0-21swapper/221:22:492
22188997728,21cyclictest0-21swapper/222:37:492
22188997728,21cyclictest0-21swapper/222:37:492
22188997717,31cyclictest39-21ksoftirqd/223:04:132
22184997723,25cyclictest27264-21seq21:53:041
22184997723,25cyclictest27264-21seq21:53:041
22179997759,13cyclictest20562-21sh00:23:160
22179997712,42cyclictest23317-21expr23:33:210
22179997712,28cyclictest27073-21seq22:46:510
22179997711,34cyclictest31526-21seq21:05:380
22179997711,34cyclictest31526-21seq21:05:380
2219599763,43cyclictest0-21swapper/319:13:583
2219599763,43cyclictest0-21swapper/319:13:583
22188997658,12cyclictest10158-21/usr/sbin/munin20:03:212
22188997656,14cyclictest25872-21apt-key19:12:482
22188997654,14cyclictest29882-21apt-key21:57:482
22188997654,14cyclictest29882-21apt-key21:57:482
22188997637,9cyclictest1930-21cpuspeed19:38:012
22188997637,9cyclictest1930-21cpuspeed19:38:012
22184997654,15cyclictest26598-21fschecks_time19:14:071
22184997654,15cyclictest26598-21fschecks_time19:14:071
22184997621,24cyclictest19319-21seq20:29:381
22184997621,24cyclictest17765-21seq20:25:161
22184997621,24cyclictest17765-21seq20:25:161
22179997613,23cyclictest30859-21rm23:47:140
22179997613,23cyclictest30859-21rm23:47:140
22179997612,25cyclictest6538-21ssh23:59:450
22179997612,25cyclictest6538-21ssh23:59:450
22179997612,23cyclictest5386-21ssh22:09:430
22179997611,27cyclictest7307-21ssh21:18:320
22179997611,27cyclictest23079-21ssh21:45:520
22179997611,27cyclictest23079-21ssh21:45:520
22188997556,12cyclictest22167-21cyclictest00:08:502
22188997539,13cyclictest181rcu_preempt00:18:202
22188997539,13cyclictest181rcu_preempt00:18:202
22188997538,21cyclictest8125-21df_inode00:03:052
22188997538,20cyclictest23718-21mailstats00:28:192
22188997538,20cyclictest23718-21mailstats00:28:192
22188997513,27cyclictest39-21ksoftirqd/221:16:122
22188997513,27cyclictest39-21ksoftirqd/221:16:122
22184997560,10cyclictest31933-21ntp_kernel_pll_23:48:121
22184997539,21cyclictest6243-21cpuspeed21:18:031
2217999759,22cyclictest19373-21seq20:30:190
22179997514,22cyclictest10436-21ssh00:07:190
22179997511,27cyclictest13592-21ssh21:29:260
22179997511,27cyclictest13592-21ssh21:29:260
22188997448,19cyclictest6384-21ssh21:18:082
22188997437,11cyclictest23304-21find23:33:212
22188997435,12cyclictest181rcu_preempt21:41:052
22184997431,33cyclictest0-21swapper/119:23:011
22179997452,15cyclictest544-21cron19:37:460
22179997448,21cyclictest0-21swapper/021:59:090
22179997412,25cyclictest4441-21ssh23:57:140
22179997411,24cyclictest22925-21taskset22:38:340
22179997411,24cyclictest22925-21taskset22:38:340
22179997410,25cyclictest6604-21ssh23:06:160
2219599738,44cyclictest917-21kworker/3:1+events22:57:453
2219599738,44cyclictest917-21kworker/3:1+events22:57:453
22188997350,8cyclictest181rcu_preempt23:28:152
22188997350,8cyclictest181rcu_preempt23:28:152
22188997348,19cyclictest553-21sh22:02:482
22188997340,9cyclictest181rcu_preempt23:47:442
22188997340,9cyclictest181rcu_preempt23:47:442
22184997357,10cyclictest1845-21/usr/sbin/munin19:38:121
22184997357,10cyclictest1845-21/usr/sbin/munin19:38:121
22184997321,22cyclictest11417-21seq20:06:411
22184997314,21cyclictest352-21runrttasks23:34:531
22179997351,16cyclictest298-21in:imuxsock21:01:510
22179997349,15cyclictest2688-21timerwakeupswit19:38:200
22179997349,15cyclictest2688-21timerwakeupswit19:38:200
22179997313,23cyclictest25348-21sh21:48:510
22179997312,23cyclictest19180-21sh00:21:340
22179997312,23cyclictest19180-21sh00:21:340
22179997312,22cyclictest25020-21ssh00:31:070
22179997312,22cyclictest25020-21ssh00:31:070
22179997311,26cyclictest19941-21ssh22:33:330
22179997311,22cyclictest20572-21ssh23:28:310
22179997311,22cyclictest20572-21ssh23:28:310
22179997311,21cyclictest0-21swapper/023:13:520
22179997311,21cyclictest0-21swapper/023:13:520
22179997310,26cyclictest380-21rm22:56:130
22179997310,26cyclictest380-21rm22:56:130
2218899727,34cyclictest39-21ksoftirqd/220:37:442
22188997251,12cyclictest25610-21entropy23:38:052
2218899724,33cyclictest39-21ksoftirqd/220:38:572
22188997239,16cyclictest181rcu_preempt19:52:362
22188997239,16cyclictest181rcu_preempt19:52:362
22188997236,20cyclictest31730-21mailstats19:28:192
22188997230,10cyclictest0-21swapper/220:08:062
2218899722,41cyclictest29298-21diskmemload23:58:072
2218899722,41cyclictest29298-21diskmemload23:58:072
22184997256,10cyclictest9801-21acpi22:17:571
2218499725,46cyclictest13021-21fschecks_count22:23:071
22184997253,13cyclictest544-21cron20:37:451
22184997253,13cyclictest10129-21sendmail23:12:451
22184997235,32cyclictest0-21swapper/123:28:001
22184997235,32cyclictest0-21swapper/123:28:001
22179997251,15cyclictest16734-21fschecks_time23:23:080
22184997157,9cyclictest22167-21cyclictest20:53:021
22184997157,9cyclictest22167-21cyclictest20:53:021
22184997124,38cyclictest0-21swapper/123:12:581
22184997124,38cyclictest0-21swapper/123:12:581
2217999718,26cyclictest8579-21seq22:15:140
2217999718,26cyclictest8579-21seq22:15:140
22179997150,14cyclictest29298-21diskmemload22:30:080
22179997111,26cyclictest2226-21ssh22:04:130
22179997111,21cyclictest32088-21taskset19:28:370
22195997011,44cyclictest0-21swapper/319:53:413
22188997049,15cyclictest27907-21latency_hist20:57:492
22188997046,9cyclictest181rcu_preempt21:43:222
22188997046,9cyclictest181rcu_preempt21:43:222
22188997039,7cyclictest181rcu_preempt21:32:332
22188997039,7cyclictest181rcu_preempt21:32:332
22188997026,16cyclictest0-21swapper/222:13:072
22188997026,16cyclictest0-21swapper/222:13:072
22188997018,26cyclictest39-21ksoftirqd/222:43:512
22188997017,31cyclictest39-21ksoftirqd/222:18:302
22188997016,30cyclictest39-21ksoftirqd/221:35:172
22184997055,10cyclictest28617-21timerandwakeup22:48:211
22184997028,33cyclictest0-21swapper/121:22:591
22179997012,22cyclictest8677-21rm23:08:430
22179997012,21cyclictest11854-21ssh22:21:040
22179997011,25cyclictest28552-21rm21:54:240
22179997011,25cyclictest28552-21rm21:54:240
22188996948,8cyclictest181rcu_preempt20:22:092
22188996948,8cyclictest181rcu_preempt20:22:092
22188996947,7cyclictest181rcu_preempt21:12:262
22188996938,7cyclictest181rcu_preempt23:16:572
22188996938,7cyclictest181rcu_preempt23:16:572
22188996930,8cyclictest0-21swapper/222:30:092
22188996916,32cyclictest39-21ksoftirqd/220:54:002
22188996913,28cyclictest39-21ksoftirqd/222:07:032
22184996956,9cyclictest22167-21cyclictest21:31:261
22184996956,9cyclictest22167-21cyclictest21:31:261
22184996954,9cyclictest22163-21kernelversion22:38:081
22184996954,9cyclictest22163-21kernelversion22:38:081
22184996952,11cyclictest23936-21munin-node21:32:531
22184996950,13cyclictest10241-21sh00:06:471
22184996931,33cyclictest0-21swapper/119:43:031
22184996931,33cyclictest0-21swapper/119:43:031
22184996930,30cyclictest4971-21rm23:58:001
22184996930,30cyclictest4971-21rm23:58:001
22184996929,36cyclictest0-21swapper/121:03:001
22184996929,36cyclictest0-21swapper/121:03:001
22184996929,35cyclictest0-21swapper/123:42:591
22184996929,35cyclictest0-21swapper/123:42:591
22184996919,21cyclictest2255-21taskset22:04:181
22184996917,24cyclictest0-21swapper/100:19:171
22184996917,24cyclictest0-21swapper/100:19:171
22184996915,22cyclictest0-21swapper/122:16:341
22184996915,22cyclictest0-21swapper/122:16:341
2217999699,22cyclictest12074-21ssh00:08:310
22179996941,19cyclictest26744-21grep20:53:110
22179996941,19cyclictest26744-21grep20:53:110
22179996914,18cyclictest8552-21/usr/sbin/munin19:58:080
22179996911,23cyclictest17313-21ssh21:36:280
22184996854,10cyclictest22167-21cyclictest23:23:521
22184996853,9cyclictest15921-21unixbench_multi20:18:211
22184996853,9cyclictest15921-21unixbench_multi20:18:211
22184996852,8cyclictest0-21swapper/123:18:151
22184996852,8cyclictest0-21swapper/123:18:151
22184996848,14cyclictest25451-21threads20:48:201
22184996847,17cyclictest22167-21cyclictest21:57:571
22184996825,34cyclictest0-21swapper/120:13:021
22184996825,34cyclictest0-21swapper/120:13:021
22184996823,40cyclictest0-21swapper/122:33:011
22179996849,13cyclictest3903-21latency19:43:140
22179996849,13cyclictest3903-21latency19:43:140
22188996728,19cyclictest0-21swapper/219:23:202
22184996747,14cyclictest2374-21systemd-journal22:53:501
22184996747,14cyclictest2374-21systemd-journal22:53:501
22184996746,14cyclictest0-21swapper/119:52:491
22184996746,14cyclictest0-21swapper/119:52:491
22184996729,25cyclictest27869-21apt-get19:17:581
22184996723,39cyclictest0-21swapper/122:08:011
22184996723,22cyclictest9866-21seq20:02:241
22184996721,36cyclictest3247-21ssh23:00:111
22184996712,24cyclictest14584-21ssh00:13:171
2217999676,24cyclictest26125-21latency_hist19:12:490
2217999676,22cyclictest12725-21unixbench_singl20:08:220
22179996748,13cyclictest26747-21latency19:14:110
22179996748,13cyclictest26747-21latency19:14:110
2219599668,32cyclictest0-21swapper/323:52:483
22188996641,10cyclictest181rcu_preempt21:02:512
22188996641,10cyclictest181rcu_preempt21:02:512
22184996651,10cyclictest22835-21munin-plugin-st20:42:451
22184996647,12cyclictest21305-21fschecks_count21:43:071
22184996647,12cyclictest21305-21fschecks_count21:43:071
22184996646,14cyclictest2798-21cron21:12:451
22184996628,31cyclictest0-21swapper/121:12:591
22184996628,31cyclictest0-21swapper/121:12:591
22184996627,32cyclictest0-21swapper/120:08:011
22184996627,26cyclictest28762-21/usr/sbin/munin20:58:211
22184996613,26cyclictest11647-21mailstats00:08:171
2217999668,21cyclictest6932-21/usr/sbin/munin19:54:170
22179996648,12cyclictest277-21dbus-daemon22:27:460
22179996646,9cyclictest0-21swapper/020:23:100
22179996646,9cyclictest0-21swapper/020:23:100
2219599653,40cyclictest917-21kworker/3:1+events23:03:123
2219599653,37cyclictest917-21kworker/3:1+events21:08:063
2218899653,40cyclictest28852-21tail20:58:222
22184996548,11cyclictest0-21swapper/119:32:481
22184996529,31cyclictest0-21swapper/122:27:591
216942655,14sleep30-21swapper/318:58:393
2219599649,34cyclictest0-21swapper/321:58:093
22184996428,31cyclictest0-21swapper/123:37:561
22184996421,23cyclictest26009-21seq22:43:511
22184996419,22cyclictest25565-21seq19:10:481
22184996414,24cyclictest0-21swapper/121:49:071
2217999644,24cyclictest21123-21chrt20:36:470
22179996435,23cyclictest24900-21fschecks_count20:48:070
22179996431,24cyclictest22026-21latency_hist19:02:490
22179996411,18cyclictest6081-21seq19:48:310
22179996411,18cyclictest6081-21seq19:48:310
22184996327,31cyclictest0-21swapper/100:28:011
22184996327,31cyclictest0-21swapper/100:28:011
22184996324,32cyclictest0-21swapper/123:52:581
22184996323,29cyclictest1597-21latency_hist19:37:491
22184996313,20cyclictest0-21swapper/123:07:241
22179996349,10cyclictest22167-21cyclictest20:38:190
22179996344,14cyclictest14356-21unixbench_singl20:13:230
22179996344,14cyclictest14356-21unixbench_singl20:13:230
22179996315,19cyclictest16306-21seq20:22:090
22179996315,19cyclictest16306-21seq20:22:090
2219599623,41cyclictest917-21kworker/3:1+events21:38:053
22184996219,21cyclictest352-21runrttasks19:07:361
22179996213,20cyclictest29137-21seq19:22:020
22179996129,17cyclictest10793-21sendmail_mailqu20:03:180
22184996044,9cyclictest0-21swapper/100:27:471
2219599593,40cyclictest18944-21taskset22:33:043
2219599593,40cyclictest16695-21chrt20:23:053
2219599593,40cyclictest16695-21chrt20:23:053
2219599593,36cyclictest13018-21chrt22:23:073
2219599592,42cyclictest7717-21chrt00:02:483
2219599592,42cyclictest7717-21chrt00:02:483
2219599583,41cyclictest25779-21taskset19:12:463
2219599583,37cyclictest29629-21chrt21:02:583
2219599583,37cyclictest29629-21chrt21:02:583
2219599573,38cyclictest16991-21taskset21:35:333
2219599573,36cyclictest25893-21taskset21:50:243
2219599563,36cyclictest13227-21chrt20:12:483
2219599563,30cyclictest917-21kworker/3:1+events19:33:043
2219599553,36cyclictest10457-21chrt20:03:083
2219599553,34cyclictest22679-21chrt19:03:103
2219599552,39cyclictest24635-21chrt00:30:033
2219599552,39cyclictest24635-21chrt00:30:033
2219599552,28cyclictest917-21kworker/3:1+events19:43:173
2219599552,28cyclictest917-21kworker/3:1+events19:43:173
2219599544,37cyclictest23645-21taskset21:47:283
2219599544,37cyclictest23645-21taskset21:47:283
2219599543,37cyclictest1936-21chrt22:03:253
2219599543,34cyclictest27348-21taskset21:53:073
2219599543,34cyclictest27348-21taskset21:53:073
2219599543,34cyclictest20541-21chrt00:23:143
2219599543,34cyclictest19728-21taskset23:28:073
2219599543,34cyclictest19728-21taskset23:28:073
2219599542,36cyclictest9697-21taskset00:05:153
2219599533,35cyclictest4365-21chrt21:13:403
2219599533,35cyclictest4365-21chrt21:13:403
2219599533,34cyclictest28364-21chrt23:42:543
2219599533,34cyclictest28364-21chrt23:42:543
2219599533,33cyclictest17735-21chrt00:18:203
2219599533,33cyclictest17735-21chrt00:18:203
2219599533,33cyclictest15717-21chrt20:18:193
2219599533,33cyclictest15717-21chrt20:18:193
2219599533,32cyclictest917-21kworker/3:1+events19:57:593
2219599532,37cyclictest10234-21chrt23:12:473
2219599532,36cyclictest15935-21chrt22:28:053
2219599524,34cyclictest23825-21chrt20:43:183
2219599523,37cyclictest13721-21taskset21:29:493
2219599523,37cyclictest13721-21taskset21:29:493
2219599523,36cyclictest15650-21chrt00:15:033
2219599523,35cyclictest3989-21chrt22:08:033
2219599523,32cyclictest7212-21chrt22:13:103
2219599523,32cyclictest7212-21chrt22:13:103
2219599522,34cyclictest30936-21chrt19:27:483
2219599514,35cyclictest7443-21chrt21:18:553
2219599513,34cyclictest31935-21chrt19:28:213
22195995126,15cyclictest0-21swapper/300:12:453
2219599512,35cyclictest24281-21chrt23:35:283
2219599503,35cyclictest22094-21taskset22:38:063
2219599503,35cyclictest22094-21taskset22:38:063
2219599502,37cyclictest26412-21chrt22:44:593
2219599502,36cyclictest16748-21chrt23:23:093
2219599502,34cyclictest29141-21chrt22:49:173
2219599493,35cyclictest10222-21chrt22:18:133
2219599493,33cyclictest20849-21taskset20:33:213
2219599493,30cyclictest28213-21chrt20:58:083
22195994932,10cyclictest0-21swapper/320:52:593
22195994932,10cyclictest0-21swapper/320:52:593
2219599492,34cyclictest2509-21taskset19:38:173
2219599492,34cyclictest2509-21taskset19:38:173
2219599492,34cyclictest19824-21chrt20:32:493
2219599482,35cyclictest12544-21chrt23:16:073
2219599482,35cyclictest12544-21chrt23:16:073
2219599482,33cyclictest15203-21chrt23:20:133
2219599482,33cyclictest15203-21chrt23:20:133
2219599477,30cyclictest3890-21chrt23:55:433
2219599473,30cyclictest26026-21chrt20:52:453
2219599472,34cyclictest26841-21chrt23:39:173
2219599472,27cyclictest917-21kworker/3:1+events20:37:563
2219599463,32cyclictest14168-21taskset20:13:213
2219599463,32cyclictest14168-21taskset20:13:213
22195994527,10cyclictest0-21swapper/321:23:263
2219599413,27cyclictest28123-21taskset19:18:083
22195994012,20cyclictest0-21swapper/319:52:453
22195994012,20cyclictest0-21swapper/319:52:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional