You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 18:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun May 03, 2026 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
310669911967,33cyclictest1750-21ssh11:36:532
310649911470,37cyclictest2374-21systemd-journal07:11:551
310589911150,53cyclictest0-21swapper/010:17:000
310589911150,53cyclictest0-21swapper/010:17:000
3062721096,16sleep00-21swapper/006:58:230
310649910857,44cyclictest5508-21diskmemload12:17:211
310589910529,57cyclictest0-21swapper/012:02:100
310589910529,57cyclictest0-21swapper/012:02:100
929121040,6sleep09260-21ssh09:07:210
929121040,6sleep09260-21ssh09:07:210
31058991033,68cyclictest29640-21latency_hist09:41:590
31058991033,68cyclictest29640-21latency_hist09:41:590
310589910328,70cyclictest15350irq/295-2188000.ethernet10:57:070
31058991024,88cyclictest2095-21apt-get11:37:080
31058991023,66cyclictest0-21swapper/010:05:330
31058991023,66cyclictest0-21swapper/010:05:330
310589910223,72cyclictest0-21swapper/009:44:110
31064991012,31cyclictest19122-21taskset10:17:541
310589910117,51cyclictest0-21swapper/009:27:060
310649910058,34cyclictest0-21swapper/110:26:591
310589910036,57cyclictest0-21swapper/010:52:340
310589910035,58cyclictest0-21swapper/007:07:340
310589910016,75cyclictest20643-21latency_hist09:26:580
31064999952,40cyclictest32277-21processes11:32:291
31064999940,52cyclictest30544-21sh09:42:301
3105899983,83cyclictest0-21swapper/009:17:130
3105899983,83cyclictest0-21swapper/009:17:130
3105899983,72cyclictest17434-21df07:58:100
31058999836,52cyclictest0-21swapper/007:47:290
31058999836,52cyclictest0-21swapper/007:47:290
3105899983,61cyclictest22560-21find11:17:040
31058999831,57cyclictest0-21swapper/008:47:180
31058999831,57cyclictest0-21swapper/008:47:180
31064999631,11cyclictest0-21swapper/108:41:571
31058999637,53cyclictest15386-21ssh11:58:080
3105899962,76cyclictest5508-21diskmemload12:27:150
3106499955,46cyclictest24642-21switchtime09:32:311
31064999523,15cyclictest0-21swapper/112:12:201
3105899953,85cyclictest5508-21diskmemload09:12:080
3105899953,57cyclictest25104-21rm12:15:100
31058999530,58cyclictest0-21swapper/011:42:310
31058999530,58cyclictest0-21swapper/011:42:310
3105899952,77cyclictest21980-21sshd11:16:100
3105899952,77cyclictest21980-21sshd11:16:100
31066999448,40cyclictest31708-21latency_hist12:26:582
31066999448,40cyclictest31708-21latency_hist12:26:582
31064999434,12cyclictest0-21swapper/107:56:591
31064999434,12cyclictest0-21swapper/107:56:591
3105899944,82cyclictest309-21apt-get09:47:070
31058999437,49cyclictest0-21swapper/009:52:300
31058999437,49cyclictest0-21swapper/009:52:300
3105899943,63cyclictest28877-21ssh11:27:180
3105899943,63cyclictest28877-21ssh11:27:180
3105899942,80cyclictest0-21swapper/009:57:090
3105899942,80cyclictest0-21swapper/009:57:090
31058999422,64cyclictest8641-21sendmail07:31:550
31066999338,47cyclictest0-21swapper/208:11:572
31064999335,10cyclictest0-21swapper/110:07:291
31058999341,45cyclictest28918-21ssh12:21:580
3105899933,83cyclictest0-21swapper/010:22:080
3105899933,73cyclictest15429-21ssh10:11:580
31058999331,53cyclictest161ktimers/010:41:550
31058999328,57cyclictest0-21swapper/009:02:300
31058999328,57cyclictest0-21swapper/009:02:300
31058999326,62cyclictest0-21swapper/010:32:320
31066999246,38cyclictest0-21swapper/207:52:172
31066999246,38cyclictest0-21swapper/207:52:172
31064999238,47cyclictest0-21swapper/110:46:581
31064999238,47cyclictest0-21swapper/110:46:581
31064999236,10cyclictest0-21swapper/111:47:341
3106499923,42cyclictest16859-21fschecks_time11:07:171
3106499923,33cyclictest31063-21sed07:02:001
3105899923,79cyclictest4589-21apt-get10:47:110
31058999237,49cyclictest298-21in:imuxsock08:41:550
3105899922,58cyclictest19152-21ssh11:11:400
31066999134,49cyclictest0-21swapper/211:07:322
31066999124,61cyclictest0-21swapper/209:42:182
31064999139,8cyclictest181rcu_preempt07:47:111
31064999139,8cyclictest181rcu_preempt07:47:111
31064999134,49cyclictest0-21swapper/107:31:581
3105899913,80cyclictest8103-21ssh11:47:110
31058999132,52cyclictest0-21swapper/007:36:580
3106699903,40cyclictest5719-21latency_hist09:01:592
3106499907,29cyclictest3298-21xargs08:52:301
3106499903,31cyclictest26256-21proc_pri11:22:301
3105899903,73cyclictest25642-21grep10:28:150
3105899903,54cyclictest0-21swapper/012:22:310
3105899903,54cyclictest0-21swapper/012:22:310
31058999024,59cyclictest0-21swapper/007:42:170
3106699894,35cyclictest31322-21cstates07:02:122
31066998942,39cyclictest0-21swapper/210:01:392
31066998942,39cyclictest0-21swapper/210:01:392
3106699893,25cyclictest5798-21/usr/sbin/munin09:02:192
3106699893,25cyclictest5798-21/usr/sbin/munin09:02:192
31066998929,53cyclictest0-21swapper/207:27:292
31066998927,10cyclictest0-21swapper/211:37:172
31066998924,25cyclictest21090-21grep12:07:322
31066998919,10cyclictest0-21swapper/211:57:052
3106499894,35cyclictest2752-21sort07:12:191
3106499894,29cyclictest809-21taskset08:46:591
3106499893,39cyclictest8788-21/usr/sbin/munin09:07:191
3106499893,39cyclictest8788-21/usr/sbin/munin09:07:191
3106499893,38cyclictest9190-21fschecks_time07:32:181
3106499893,35cyclictest19015-21grep08:02:161
3106499893,34cyclictest13665-21latency_hist07:46:591
31064998932,9cyclictest0-21swapper/111:42:101
31064998932,9cyclictest0-21swapper/111:42:101
31064998931,9cyclictest0-21swapper/107:58:111
31064998928,12cyclictest0-21swapper/108:17:331
31064998928,12cyclictest0-21swapper/108:17:331
31064998924,14cyclictest0-21swapper/110:12:231
31064998924,14cyclictest0-21swapper/110:12:231
3105899893,50cyclictest5521-21awk09:01:550
3105899892,50cyclictest0-21swapper/009:32:460
306842898,55sleep230685-21sshd06:59:102
31066998874,9cyclictest31047-21cyclictest09:41:592
31066998874,9cyclictest31047-21cyclictest09:41:592
31066998838,43cyclictest9687-21sh10:02:212
31066998838,43cyclictest9687-21sh10:02:212
31066998838,43cyclictest0-21swapper/208:52:172
3106699883,35cyclictest17154-21cpuspeed12:02:112
3106699883,35cyclictest17154-21cpuspeed12:02:112
31066998831,49cyclictest0-21swapper/210:52:142
31066998830,50cyclictest0-21swapper/211:17:572
31066998825,8cyclictest0-21swapper/210:42:232
31066998825,8cyclictest0-21swapper/210:42:232
31066998822,8cyclictest0-21swapper/211:27:242
31066998822,8cyclictest0-21swapper/211:27:242
3106499884,36cyclictest5717-21latency_hist09:01:591
3106499884,35cyclictest26143-21mailstats10:28:271
3106499884,32cyclictest17027-21/usr/sbin/munin12:02:191
3106499884,32cyclictest17027-21/usr/sbin/munin12:02:191
3106499884,31cyclictest28591-21cpuspeed08:32:121
3106499883,39cyclictest3318-21/usr/sbin/munin09:52:311
3106499883,39cyclictest3318-21/usr/sbin/munin09:52:311
3106499883,33cyclictest18536-21find09:22:291
3106499883,28cyclictest28531-21/usr/sbin/munin11:27:211
3106499883,28cyclictest28531-21/usr/sbin/munin11:27:211
3106499882,37cyclictest22723-21latency_hist12:11:571
3106499882,35cyclictest10983-21if_eth010:57:191
3106499882,33cyclictest21088-21cut09:27:191
3106499882,31cyclictest4580-21ntp_kernel_pll_07:17:251
3105899885,74cyclictest18838-21apt-get10:17:160
3105899883,76cyclictest13857-21latency_hist11:56:580
3105899882,79cyclictest0-21swapper/011:32:090
31066998744,35cyclictest0-21swapper/212:27:512
3106699873,23cyclictest28070-21apt-get10:32:072
31066998729,52cyclictest0-21swapper/211:47:072
3106499873,35cyclictest21158-21switchtime08:07:301
3106499873,34cyclictest13572-21/usr/sbin/munin11:02:271
3106499873,32cyclictest29189-21vmstat10:32:351
3106499873,32cyclictest15006-21wc11:57:301
3106499873,30cyclictest23406-21modprobe08:16:551
3106499873,30cyclictest23406-21modprobe08:16:551
3106499873,30cyclictest1194-21timerandwakeup09:47:311
3106499872,33cyclictest23265-21processes11:17:271
3105899874,74cyclictest26889-21apt-get08:27:070
3105899873,73cyclictest5673-21apt-get07:22:100
3105899873,72cyclictest18820-21apt-get08:02:070
31058998718,64cyclictest161ktimers/007:02:110
31066998670,8cyclictest0-21swapper/210:37:302
3106699864,24cyclictest1595-21/usr/sbin/munin08:47:292
3106699864,24cyclictest1595-21/usr/sbin/munin08:47:292
3106699863,37cyclictest18604-21apt-config10:16:592
3106699863,37cyclictest18604-21apt-config10:16:592
3106699863,34cyclictest352-21runrttasks11:06:082
3106699863,29cyclictest23580-21latency_hist09:31:582
31066998631,47cyclictest0-21swapper/207:47:192
31066998631,47cyclictest0-21swapper/207:47:192
31066998625,8cyclictest0-21swapper/211:22:302
3106699862,37cyclictest1034-21grep07:07:202
3106699862,34cyclictest26870-21/usr/sbin/munin08:27:122
3106499864,34cyclictest10793-21fschecks_time07:37:191
3106499864,26cyclictest6340-21runrttasks09:57:081
3106499864,26cyclictest6340-21runrttasks09:57:081
31064998640,9cyclictest181rcu_preempt11:52:171
3106499863,31cyclictest27185-21sh09:37:201
3106499863,31cyclictest27185-21sh09:37:201
3106499862,33cyclictest25867-21ps08:22:271
3106499862,32cyclictest15584-21mailstats09:17:311
3106499862,32cyclictest15584-21mailstats09:17:311
31064998613,29cyclictest30801-21diskmemload12:24:251
31064998613,29cyclictest30801-21diskmemload12:24:251
31058998642,38cyclictest467-21kworker/u17:0+rpciod10:42:100
31058998642,38cyclictest467-21kworker/u17:0+rpciod10:42:100
3105899863,68cyclictest0-21swapper/008:12:070
3105899863,68cyclictest0-21swapper/008:12:070
31058998627,51cyclictest0-21swapper/008:52:300
31066998540,38cyclictest5508-21diskmemload09:23:462
31066998539,38cyclictest0-21swapper/209:07:212
31066998539,38cyclictest0-21swapper/209:07:212
31066998534,43cyclictest0-21swapper/211:42:282
31066998534,43cyclictest0-21swapper/211:42:282
3106699853,35cyclictest10807-21ssh10:57:162
31066998533,44cyclictest0-21swapper/210:17:132
31066998531,48cyclictest24971-21latency_hist10:26:592
31066998530,9cyclictest0-21swapper/208:12:182
31066998530,9cyclictest0-21swapper/208:12:182
31066998524,7cyclictest0-21swapper/209:32:302
3106699852,28cyclictest352-21runrttasks12:18:192
31064998534,8cyclictest0-21swapper/110:03:261
31064998534,8cyclictest0-21swapper/110:03:261
3106499853,32cyclictest6375-21grep07:22:321
3106499853,32cyclictest1107-21sort08:47:171
3106499853,32cyclictest1107-21sort08:47:171
3106499853,31cyclictest7733-21cstates10:52:131
3106499853,31cyclictest301-21kernelversion12:27:371
3106499853,28cyclictest6131-21taskset09:02:181
3106499853,28cyclictest6131-21taskset09:02:181
3106499852,34cyclictest12504-21ps09:12:281
3105899853,67cyclictest23680-21apt-get08:17:080
3105899853,67cyclictest23680-21apt-get08:17:080
3106699849,66cyclictest24496-21apt-get10:27:102
31066998455,11cyclictest31175-21kworker/u19:1-rpciod09:13:362
3106699844,31cyclictest29880-21idleruntime-cro08:36:552
3106699844,30cyclictest3002-21latency_hist09:51:592
3106699844,30cyclictest3002-21latency_hist09:51:592
31066998440,37cyclictest0-21swapper/208:17:262
31066998440,37cyclictest0-21swapper/208:17:262
3106699843,37cyclictest10453-21latency_hist07:36:592
3106699843,32cyclictest17433-21sshd07:58:102
31066998428,7cyclictest0-21swapper/207:12:172
31066998425,20cyclictest11210-21cat11:52:122
3106699842,41cyclictest5237-21open_inodes10:47:282
3106699842,34cyclictest12701-21ps07:42:282
3106499844,39cyclictest27071-21fschecks_count08:27:171
3106499843,33cyclictest2358-21fschecks_count11:37:181
31064998423,12cyclictest0-21swapper/111:12:171
31064998423,12cyclictest0-21swapper/111:12:171
3105899843,74cyclictest26420-21/usr/sbin/munin11:22:330
3105899843,70cyclictest28507-21/usr/sbin/munin08:32:220
3105899843,46cyclictest0-21swapper/012:11:570
31058998428,51cyclictest0-21swapper/011:02:310
305422840,7sleep30-21swapper/312:23:413
305422840,7sleep30-21swapper/312:23:413
3106699834,33cyclictest354-21wc09:47:122
31066998337,39cyclictest0-21swapper/207:17:142
3106699833,32cyclictest32004-21fschecks_time08:42:172
31066998329,47cyclictest0-21swapper/212:16:572
3106699832,34cyclictest15480-21open_inodes09:17:302
3106699832,34cyclictest15480-21open_inodes09:17:302
3106499833,33cyclictest4568-21/usr/sbin/munin10:47:061
3106499833,33cyclictest31037-21/usr/sbin/munin10:37:051
3105899838,67cyclictest0-21swapper/007:52:310
3105899838,67cyclictest0-21swapper/007:52:310
3105899833,65cyclictest0-21swapper/008:22:060
3105899833,51cyclictest0-21swapper/008:42:140
3106699824,30cyclictest10738-21fschecks_count07:37:182
3106699823,36cyclictest19570-21/usr/sbin/munin11:12:162
3106699823,36cyclictest19570-21/usr/sbin/munin11:12:162
3106699823,31cyclictest12561-21/usr/sbin/munin10:07:162
31066998225,8cyclictest0-21swapper/208:22:172
3105899823,71cyclictest20692-21grep08:07:180
3106699813,32cyclictest19196-21kernelversion08:02:202
3106699813,24cyclictest5867-21tune2fs07:22:192
31066998128,7cyclictest0-21swapper/208:37:222
3106499814,28cyclictest352-21runrttasks07:02:111
31058998119,55cyclictest5210-21sendmail-mta07:19:360
3105899802,70cyclictest10991-21awk07:37:240
31058997726,47cyclictest0-21swapper/007:11:590
3107199732,32cyclictest21537-21chrt10:21:553
3107199723,26cyclictest703-21taskset07:07:063
2955527214,33sleep30-21swapper/306:57:073
3107199703,27cyclictest24861-21chrt12:14:293
3107199703,25cyclictest9620-21chrt11:48:483
3107199693,25cyclictest23168-21chrt11:17:233
3107199683,26cyclictest16770-21chrt07:56:563
3107199683,26cyclictest16770-21chrt07:56:563
3107199683,24cyclictest15237-21chrt09:17:223
3107199683,24cyclictest15237-21chrt09:17:223
3107199683,22cyclictest17246-21chrt07:57:293
3107199682,30cyclictest1817-21taskset11:36:563
3107199682,24cyclictest23523-21chrt09:31:573
3107199673,22cyclictest13168-21chrt10:07:243
3107199672,25cyclictest25273-21chrt10:27:433
3107199672,21cyclictest12110-21taskset07:42:063
3107199664,26cyclictest11353-21chrt10:57:293
3107199663,28cyclictest25818-21taskset08:22:243
3107199663,24cyclictest9223-21chrt09:07:203
3107199663,24cyclictest9223-21chrt09:07:203
3107199663,24cyclictest30994-21chrt10:36:593
3107199663,24cyclictest13893-21chrt07:47:163
3107199663,24cyclictest13893-21chrt07:47:163
3107199663,23cyclictest26228-21chrt11:22:293
3107199663,22cyclictest8229-21chrt09:59:463
3107199663,22cyclictest8229-21chrt09:59:463
3107199662,24cyclictest4369-21chrt11:40:493
3107199662,24cyclictest27863-21chrt12:19:313
3107199662,24cyclictest21783-21chrt11:15:363
3107199662,24cyclictest21783-21chrt11:15:363
3107199662,21cyclictest32184-21chrt07:02:323
3107199653,26cyclictest30283-21taskset08:37:143
3107199653,25cyclictest13026-21taskset09:12:483
3107199653,24cyclictest17906-21chrt12:02:293
3107199653,24cyclictest17906-21chrt12:02:293
3107199653,23cyclictest8307-21chrt07:28:043
3107199653,23cyclictest29060-21chrt08:32:243
3107199653,22cyclictest3525-21chrt08:52:343
3107199653,22cyclictest23815-21chrt09:32:093
3107199652,32cyclictest21978-21chrt12:09:513
3107199652,24cyclictest1921-21chrt10:42:173
3107199652,24cyclictest1921-21chrt10:42:173
3107199652,23cyclictest19883-21chrt09:25:163
3107199652,22cyclictest4346-21chrt09:52:333
3107199652,22cyclictest4346-21chrt09:52:333
3107199643,29cyclictest31854-21chrt08:42:133
3107199643,24cyclictest455-21chrt10:39:383
3107199643,24cyclictest16921-21taskset10:13:083
3107199643,24cyclictest16921-21taskset10:13:083
3107199643,24cyclictest13629-21chrt11:02:113
3107199643,23cyclictest13453-21chrt11:56:053
3107199643,22cyclictest32376-21chrt12:27:263
3107199643,22cyclictest30335-21taskset09:42:233
3107199643,22cyclictest20961-21chrt08:07:253
3107199642,24cyclictest6928-21chrt09:02:343
3107199642,24cyclictest6928-21chrt09:02:343
3107199642,24cyclictest19198-21chrt11:11:473
3107199642,23cyclictest28753-21chrt11:27:163
3107199642,23cyclictest28753-21chrt11:27:163
3107199642,23cyclictest22434-21chrt10:22:243
3107199642,22cyclictest5446-21chrt09:01:293
3107199642,22cyclictest24869-21chrt08:20:093
3107199642,22cyclictest24869-21chrt08:20:093
3107199642,21cyclictest27667-21chrt09:37:333
3107199642,21cyclictest27667-21chrt09:37:333
3107199633,24cyclictest9361-21taskset10:54:213
3107199633,23cyclictest2987-21taskset07:12:253
3107199633,20cyclictest19169-21chrt08:02:193
3107199632,23cyclictest10269-21chrt07:36:553
3107199632,21cyclictest2191-21chrt09:49:413
3107199624,23cyclictest28123-21chrt08:30:423
3107199623,32cyclictest11005-21chrt07:37:243
3107199623,26cyclictest5026-21chrt11:41:593
3107199623,26cyclictest5026-21chrt11:41:593
3107199623,22cyclictest2005-21chrt08:49:013
3107199623,22cyclictest2005-21chrt08:49:013
3107199623,21cyclictest6151-21chrt10:48:503
3107199622,25cyclictest11387-21chrt10:04:283
3107199622,25cyclictest11387-21chrt10:04:283
3107199622,22cyclictest14273-21chrt11:57:153
3107199622,21cyclictest22075-21chrt08:12:073
3107199622,21cyclictest22075-21chrt08:12:073
3107199613,22cyclictest5097-21chrt07:18:083
3107199612,21cyclictest6828-21chrt07:24:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional