You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 17:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun May 17, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
985821590,19sleep00-21swapper/006:56:450
9272213312,81sleep29322-21fschecks_count06:56:272
106059911594,9cyclictest0-21swapper/111:01:171
106059911594,9cyclictest0-21swapper/111:01:171
10594991153,47cyclictest18753-21apt-get09:01:480
10594991153,47cyclictest18753-21apt-get09:01:480
105949911377,29cyclictest26080-21sh11:01:170
105949911377,29cyclictest26080-21sh11:01:170
10594991112,28cyclictest6803-21ssh12:16:310
105949910952,50cyclictest298-21in:imuxsock09:56:000
105949910952,50cyclictest298-21in:imuxsock09:56:000
10594991092,49cyclictest14367-21/usr/sbin/munin10:41:260
10594991079,73cyclictest12664-21fw_packets07:06:060
10594991073,27cyclictest18583-21sh10:48:300
10594991054,27cyclictest352-21runrttasks09:10:110
10594991033,22cyclictest989-21/usr/sbin/munin12:06:340
105949910323,67cyclictest161ktimers/007:16:120
106109910234,34cyclictest0-21swapper/208:06:312
10594991014,25cyclictest29728-21sh09:19:400
10594991012,23cyclictest11579-21/usr/sbin/munin11:31:090
106059910013,44cyclictest22360-21sh10:01:181
10594991003,34cyclictest352-21runrttasks12:28:260
10594991003,34cyclictest352-21runrttasks12:28:260
10594991003,27cyclictest22294-21/usr/sbin/munin10:02:170
1059499994,38cyclictest19100-21ssh09:56:140
1059499993,32cyclictest6403-21munin-plugin-st08:25:580
1059499993,29cyclictest11742-21/usr/sbin/munin08:41:190
1059499984,27cyclictest352-21runrttasks07:43:190
1059499984,27cyclictest352-21runrttasks07:43:190
1059499983,26cyclictest10959-21seq10:36:170
1059499983,26cyclictest10959-21seq10:36:170
1059499982,39cyclictest14323-21grep08:46:370
1059499982,36cyclictest18421-21switchtime11:41:340
10594999747,44cyclictest2374-21systemd-journal10:20:100
1059499973,32cyclictest9259-21cstates12:21:160
1059499972,30cyclictest352-21runrttasks11:00:370
1059499972,29cyclictest12308-21cat07:06:020
10594999712,29cyclictest19697-21latency_hist07:26:390
10594999712,29cyclictest19697-21latency_hist07:26:390
10594999710,12cyclictest0-21swapper/009:40:270
1059499964,26cyclictest5820-21modprobe12:15:580
1059499964,26cyclictest5820-21modprobe12:15:580
1059499963,35cyclictest24846-21fschecks_time09:11:210
1059499963,35cyclictest24846-21fschecks_time09:11:210
1059499963,30cyclictest14999-21ssh11:36:240
1059499963,30cyclictest14999-21ssh11:36:240
1059499963,28cyclictest32765-21find11:11:330
1059499963,28cyclictest23587-21/usr/sbin/munin11:51:370
1059499963,28cyclictest20001-21df10:51:180
1059499963,26cyclictest29573-21/usr/sbin/munin12:01:340
1059499963,26cyclictest29573-21/usr/sbin/munin12:01:340
1059499963,19cyclictest29033-21apt-get11:06:160
1059499962,30cyclictest10962-21timerandwakeup09:41:350
1059499962,30cyclictest10962-21timerandwakeup09:41:350
1059499962,29cyclictest27498-21timerandwakeup11:56:340
1061099954,50cyclictest0-21swapper/207:41:212
1061099954,50cyclictest0-21swapper/207:41:212
1061099953,51cyclictest6893-21apt-get08:26:222
1061099953,51cyclictest6893-21apt-get08:26:222
10610999528,36cyclictest1261-21sh10:20:212
10594999545,44cyclictest17117-21ntp_kernel_pll_08:56:270
1059499954,29cyclictest8597-21ssh11:26:140
1059499954,29cyclictest8597-21ssh11:26:140
1059499953,31cyclictest3714-21fschecks_time08:16:220
1059499953,31cyclictest3714-21fschecks_time08:16:220
1059499953,31cyclictest352-21runrttasks11:19:110
1059499953,31cyclictest352-21runrttasks11:19:110
1059499953,29cyclictest2537-21/usr/sbin/munin10:21:320
1059499953,29cyclictest2537-21/usr/sbin/munin10:21:320
1059499953,27cyclictest352-21runrttasks07:31:220
1059499953,26cyclictest27814-21/usr/sbin/munin07:51:280
1059499952,27cyclictest1822-21/usr/sbin/munin08:11:360
1059499952,27cyclictest1822-21/usr/sbin/munin08:11:360
1059499952,24cyclictest16106-21grep07:16:010
1059499952,22cyclictest27158-21ssh10:08:460
1059499943,33cyclictest5841-21unixbench_multi10:26:350
1059499943,29cyclictest3965-21latency_hist09:31:030
1059499943,28cyclictest5835-21grep11:21:220
1059499942,30cyclictest26177-21/usr/sbin/munin07:46:200
1059499942,30cyclictest26177-21/usr/sbin/munin07:46:200
10610999347,39cyclictest10337-21cut08:36:212
10610999347,39cyclictest10337-21cut08:36:212
10610999335,48cyclictest2602-21sensors10:21:332
10610999335,48cyclictest2602-21sensors10:21:332
1059499933,29cyclictest14095-21unixbench_multi09:46:360
1059499933,28cyclictest706-21ntp_kernel_pll_08:06:260
1059499933,27cyclictest32377-21modprobe08:05:590
1059499933,22cyclictest8048-21/usr/sbin/munin10:31:210
1059499932,30cyclictest4633-21ntp_kernel_err09:31:290
1059499932,30cyclictest10124-21/usr/sbin/munin08:36:350
1059499932,30cyclictest10124-21/usr/sbin/munin08:36:350
1059499932,28cyclictest6875-21/usr/sbin/munin08:26:370
1059499932,28cyclictest6875-21/usr/sbin/munin08:26:370
1059499931,39cyclictest23100-21rm11:50:330
1059499923,30cyclictest28500-21ssh10:11:190
1061099913,74cyclictest0-21swapper/208:46:122
10610999126,37cyclictest0-21swapper/210:01:292
10610999120,35cyclictest23088-21sh11:50:312
1059499913,24cyclictest31519-21/usr/sbin/munin09:21:360
1059499913,23cyclictest31008-21cat08:01:030
10610999042,41cyclictest27669-21latency_hist07:51:012
10610999042,41cyclictest27669-21latency_hist07:51:012
1061099903,73cyclictest0-21swapper/208:41:142
10610999020,38cyclictest0-21swapper/210:00:392
1059499903,31cyclictest24401-21latency_hist07:41:020
1059499894,29cyclictest15272-21fschecks_time08:51:230
1059499893,27cyclictest9186-21cut08:31:320
1059499893,27cyclictest9186-21cut08:31:320
1059499892,33cyclictest19584-21/usr/sbin/munin07:27:120
10610998848,34cyclictest32210-21sh12:05:512
10610998848,34cyclictest32210-21sh12:05:512
10610998745,35cyclictest0-21swapper/209:16:022
10610998745,35cyclictest0-21swapper/209:16:022
1061099873,78cyclictest0-21swapper/209:06:152
1061099873,77cyclictest0-21swapper/210:36:112
1061099873,77cyclictest0-21swapper/210:36:112
10610998714,44cyclictest0-21swapper/207:06:082
1061099863,52cyclictest24200-21seq07:39:332
1061099862,71cyclictest0-21swapper/212:06:112
10610998623,35cyclictest0-21swapper/212:15:512
10610998623,35cyclictest0-21swapper/212:15:512
10610998543,32cyclictest0-21swapper/208:01:032
10610998541,38cyclictest18651-21sh10:48:412
10605998568,11cyclictest277-21dbus-daemon12:31:001
10605998568,11cyclictest277-21dbus-daemon12:31:001
10605998564,15cyclictest4236-21unixbench_singl12:11:361
10605998564,15cyclictest4236-21unixbench_singl12:11:361
979728418,40sleep30-21swapper/306:56:453
1061099842,51cyclictest21892-21ssh10:54:182
10610998348,29cyclictest32730-21proc_pri11:11:322
10610998340,36cyclictest0-21swapper/208:56:312
1061099832,70cyclictest5577-21apt-get11:21:102
1061099832,50cyclictest10983-21ssh11:30:162
1061099832,50cyclictest10983-21ssh11:30:162
1061099822,67cyclictest0-21swapper/207:26:482
1061099822,50cyclictest22027-21mailstats07:31:352
10619998148,21cyclictest15135-21chrt12:31:023
10619998148,21cyclictest15135-21chrt12:31:023
10610998143,33cyclictest10584-21cyclictest11:38:592
10610998143,33cyclictest10584-21cyclictest11:38:592
10610998138,35cyclictest0-21swapper/209:51:022
1061099813,72cyclictest0-21swapper/211:56:102
10610998136,38cyclictest0-21swapper/210:56:342
10605998160,15cyclictest28608-21sh10:11:221
10605998159,16cyclictest19802-21/usr/sbin/munin10:51:201
10610998062,11cyclictest277-21dbus-daemon10:41:322
10610998039,35cyclictest9025-21latency_hist12:21:022
10610998039,33cyclictest17971-21diskmemload11:41:032
10610998038,36cyclictest28450-21sh11:05:172
10610998038,36cyclictest28450-21sh11:05:172
1061099802,64cyclictest0-21swapper/207:01:152
10610997956,12cyclictest0-21swapper/209:30:532
10610997950,21cyclictest32555-21latency_hist08:06:022
1061099794,50cyclictest0-21swapper/208:55:522
1061099793,69cyclictest0-21swapper/209:21:112
1061099793,69cyclictest0-21swapper/207:16:152
1061099793,65cyclictest0-21swapper/208:11:152
1061099793,65cyclictest0-21swapper/208:11:152
10605997965,10cyclictest10584-21cyclictest12:16:241
10610997855,14cyclictest39-21ksoftirqd/210:30:332
1061099783,53cyclictest4191-21seq11:18:012
1061099783,53cyclictest4191-21seq11:18:012
1061099783,44cyclictest352-21runrttasks09:52:422
1061099783,44cyclictest352-21runrttasks09:52:422
10610997834,37cyclictest0-21swapper/209:16:282
10605997862,9cyclictest0-21swapper/109:09:211
10605997847,8cyclictest0-21swapper/110:26:541
10610997739,31cyclictest297-21systemd-logind07:26:022
10610997739,31cyclictest297-21systemd-logind07:26:022
1061099773,61cyclictest10053-21apt-get09:41:112
1061099773,61cyclictest10053-21apt-get09:41:112
1061099772,67cyclictest0-21swapper/211:31:152
10605997761,10cyclictest15796-21kworker/u17:0-events_unbound10:10:591
1060599773,64cyclictest18508-21apt-get09:01:241
1060599773,64cyclictest18508-21apt-get09:01:241
10605997734,34cyclictest16679-21cat07:16:251
1061099763,48cyclictest29082-21seq07:55:002
10605997658,13cyclictest9167-21cpu12:21:151
10605997655,15cyclictest28460-21ssh09:16:351
1061099753,60cyclictest0-21swapper/210:31:032
10610997530,38cyclictest0-21swapper/209:36:022
10605997561,10cyclictest10584-21cyclictest10:41:411
10605997519,42cyclictest13042-21apt-get07:06:351
10605997457,10cyclictest0-21swapper/107:15:591
10605997452,8cyclictest181rcu_preempt11:37:231
10605997452,8cyclictest181rcu_preempt11:37:231
10605997451,17cyclictest13560-21fschecks_count08:46:211
10605997450,18cyclictest1303-21fschecks_count09:26:211
10605997437,13cyclictest181rcu_preempt08:11:261
10605997437,13cyclictest181rcu_preempt08:11:261
1061099734,61cyclictest20138-21ssh09:03:022
1061099734,61cyclictest20138-21ssh09:03:022
10610997341,24cyclictest352-21runrttasks08:16:252
10610997341,24cyclictest352-21runrttasks08:16:252
10610997333,33cyclictest0-21swapper/208:35:592
10610997333,33cyclictest0-21swapper/208:35:592
10610997326,39cyclictest0-21swapper/210:11:172
1061099732,59cyclictest13228-21ssh12:26:372
1061099732,59cyclictest13228-21ssh12:26:372
10605997354,12cyclictest1-21systemd11:55:591
10605997353,14cyclictest5253-21fschecks_count08:21:201
10605997352,15cyclictest25485-21latency_hist11:01:011
10610997237,30cyclictest0-21swapper/209:36:342
1061099723,54cyclictest15440-21find07:11:342
10610997232,32cyclictest0-21swapper/210:08:512
10610997222,28cyclictest0-21swapper/211:55:002
10605997258,9cyclictest28313-21ntp_kernel_err07:51:301
1060599725,20cyclictest8251-21modprobe11:25:581
10605997250,14cyclictest10961-21fschecks_count07:01:221
10605997245,20cyclictest7275-21fschecks_count09:36:201
10605997223,32cyclictest17571-21sort11:41:091
10610997148,13cyclictest0-21swapper/212:26:012
1061099712,55cyclictest5055-21apt-get08:21:142
10605997150,15cyclictest30202-21sh11:06:481
10605997144,19cyclictest25922-21modprobe07:45:581
10605997144,19cyclictest25922-21modprobe07:45:581
10605997142,19cyclictest19464-21modprobe07:25:591
10605997142,19cyclictest19464-21modprobe07:25:591
1060599713,51cyclictest7865-21unixbench_singl08:26:511
1060599713,51cyclictest7865-21unixbench_singl08:26:511
1049327110,37sleep110492-21munin-run07:01:031
1061099703,34cyclictest29285-21grep11:06:222
10605997056,10cyclictest10584-21cyclictest09:12:101
10605997056,10cyclictest10584-21cyclictest09:12:101
10605997049,14cyclictest18338-21latency_hist09:01:041
10605997047,16cyclictest32366-21ssh10:16:371
1060599703,43cyclictest30389-21unixbench_singl07:56:361
10605996951,13cyclictest1-21systemd09:41:101
10605996951,13cyclictest1-21systemd09:41:101
1060599693,35cyclictest1122-21tail08:06:331
10605996853,9cyclictest21371-21acpi07:31:121
10605996851,13cyclictest10584-21cyclictest12:06:331
10605996850,13cyclictest10584-21cyclictest08:01:221
1060599683,44cyclictest20733-21grep07:27:091
1060599676,9cyclictest181rcu_preempt09:31:221
10605996753,9cyclictest10584-21cyclictest07:46:351
10605996753,9cyclictest10584-21cyclictest07:46:351
1060599675,29cyclictest0-21swapper/110:21:121
1060599675,29cyclictest0-21swapper/110:21:121
10605996751,9cyclictest27149-21kworker/u17:3-rpciod11:26:091
10605996751,9cyclictest27149-21kworker/u17:3-rpciod11:26:091
10605996749,10cyclictest4441-21awk08:16:371
10605996749,10cyclictest4441-21awk08:16:371
10605996748,13cyclictest13657-21latency_hist10:41:011
10605996748,13cyclictest13657-21latency_hist10:41:011
1060599674,43cyclictest352-21runrttasks07:38:231
1060599673,44cyclictest8514-21proc_pri10:31:331
10605996731,14cyclictest181rcu_preempt11:56:191
10605996724,34cyclictest32111-21cpu11:11:161
1060599664,38cyclictest15743-21munin-run09:50:581
1060599663,46cyclictest12651-21ssh11:31:361
1060599663,43cyclictest9442-21unixbench_multi08:31:351
1060599663,43cyclictest9442-21unixbench_multi08:31:351
10605996620,36cyclictest5295-21sh11:21:001
10605996620,36cyclictest5295-21sh11:21:001
10605996553,7cyclictest0-21swapper/108:51:231
10605996542,15cyclictest20555-21/usr/sbin/munin11:46:221
1060599653,49cyclictest16062-21/usr/sbin/munin09:51:321
1060599653,49cyclictest16062-21/usr/sbin/munin09:51:321
1060599653,43cyclictest32510-21latency_hist12:06:031
1060599653,35cyclictest21997-21date10:01:011
1061999643,45cyclictest30658-21taskset09:21:163
1060599649,12cyclictest181rcu_preempt09:26:021
10605996441,14cyclictest0-21swapper/112:03:441
1060599643,41cyclictest17637-21rm10:46:351
1061999633,43cyclictest917-21kworker/3:1+events12:11:183
1061999633,43cyclictest917-21kworker/3:1+events12:11:183
1060599633,41cyclictest11563-21latency_hist08:41:011
1060599633,41cyclictest11563-21latency_hist08:41:011
1061999623,36cyclictest0-21swapper/311:01:153
1061999623,36cyclictest0-21swapper/311:01:153
1060599623,39cyclictest2374-21systemd-journal08:45:591
1061999604,39cyclictest8140-21chrt09:36:363
1061999594,41cyclictest8248-21chrt11:25:583
1061999594,37cyclictest0-21swapper/310:01:183
1061999584,39cyclictest917-21kworker/3:1+events11:26:243
1061999584,39cyclictest917-21kworker/3:1+events11:26:243
1061999584,39cyclictest32056-21taskset12:05:253
1061999584,39cyclictest32056-21taskset12:05:253
1061999584,38cyclictest10372-21chrt09:41:223
1061999584,38cyclictest10372-21chrt09:41:223
1061999583,42cyclictest3564-21taskset08:16:173
1061999583,42cyclictest3564-21taskset08:16:173
1061999574,37cyclictest917-21kworker/3:1+events08:46:163
1061999564,35cyclictest14799-21chrt11:36:203
1061999564,35cyclictest14799-21chrt11:36:203
1061999563,40cyclictest19799-21taskset10:51:093
1061999563,35cyclictest917-21kworker/3:1+events09:11:243
1061999563,35cyclictest917-21kworker/3:1+events09:11:243
1061999562,41cyclictest4119-21chrt11:17:483
1061999562,41cyclictest4119-21chrt11:17:483
1061999562,41cyclictest17941-21chrt11:41:223
1061999555,37cyclictest16221-21taskset07:16:023
1061999555,33cyclictest14574-21chrt09:47:473
1061999553,38cyclictest13143-21chrt07:06:473
1061999553,37cyclictest19924-21taskset09:56:343
1061999553,37cyclictest19232-21chrt10:50:203
1061999553,35cyclictest30074-21chrt07:56:333
1061999552,41cyclictest31883-21taskset10:16:283
10619995512,31cyclictest31761-21taskset11:10:593
1061999547,30cyclictest18156-21chrt07:21:213
1061999547,30cyclictest18156-21chrt07:21:213
1061999543,34cyclictest21919-21chrt09:06:243
1061999543,34cyclictest21445-21taskset11:46:333
1061999542,39cyclictest27311-21taskset10:09:113
1061999534,37cyclictest23390-21chrt10:56:283
1061999533,42cyclictest0-21swapper/308:26:163
1061999533,42cyclictest0-21swapper/308:26:163
1061999533,39cyclictest3700-21taskset10:23:463
1061999533,39cyclictest3700-21taskset10:23:463
1061999533,38cyclictest18538-21chrt09:01:133
1061999533,38cyclictest18538-21chrt09:01:133
1061999533,34cyclictest1736-21chrt08:11:023
1061999524,37cyclictest6532-21chrt08:26:013
1061999524,35cyclictest11652-21taskset07:01:373
1061999524,33cyclictest28051-21chrt09:16:263
1061999523,37cyclictest16720-21chrt09:51:313
1061999523,37cyclictest16720-21chrt09:51:313
1061999523,35cyclictest9002-21taskset12:21:013
1061999522,38cyclictest13309-21chrt10:40:273
1061999522,38cyclictest13309-21chrt10:40:273
1061999522,35cyclictest8475-21chrt10:31:323
1061999513,35cyclictest4792-21chrt09:31:343
1061999513,35cyclictest1596-21chrt09:26:273
1061999513,35cyclictest12755-21chrt08:41:373
1061999513,32cyclictest28571-21chrt10:11:223
1061999513,31cyclictest14125-21chrt10:41:203
1061999512,33cyclictest31262-21chrt08:01:233
1061999504,35cyclictest6508-21chrt10:28:153
1061999504,32cyclictest10911-21chrt12:23:293
1061999503,35cyclictest25470-21taskset07:41:343
1061999503,35cyclictest25470-21taskset07:41:343
1061999503,35cyclictest17722-21taskset07:21:013
1061999503,33cyclictest20268-21chrt07:27:003
10619995020,22cyclictest0-21swapper/307:55:593
1061999494,34cyclictest25803-21chrt11:54:393
1061999493,32cyclictest2887-21taskset12:11:003
1061999492,32cyclictest26567-21chrt07:46:243
1061999492,32cyclictest26567-21chrt07:46:243
1061999492,31cyclictest23598-21chrt07:36:323
1061999484,33cyclictest18087-21chrt09:01:013
1061999483,32cyclictest32425-21chrt11:11:233
1061999483,32cyclictest11894-21taskset11:31:213
1061999473,31cyclictest9074-21chrt08:31:293
1061999473,31cyclictest9074-21chrt08:31:293
1061999463,30cyclictest21540-21taskset07:31:223
1061999463,28cyclictest10142-21chrt08:36:103
1061999463,28cyclictest10142-21chrt08:36:103
1061999453,29cyclictest26988-21chrt11:56:223
1061999452,32cyclictest3242-21chrt08:16:013
1061999452,32cyclictest3242-21chrt08:16:013
10619994312,19cyclictest0-21swapper/308:55:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional