You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 17:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Wed Aug 19, 2026 12:44:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10940213013,76sleep011031-21grep07:05:450
115749910835,15cyclictest0-21swapper/111:50:001
115749910835,15cyclictest0-21swapper/111:50:001
1119021086,17sleep20-21swapper/207:07:022
115749910753,47cyclictest351-21runrttasks12:01:271
115749910753,47cyclictest351-21runrttasks12:01:271
115749910318,33cyclictest2808-21diskmemload11:15:221
115749910310,54cyclictest27474-21taskset07:55:461
11574991006,35cyclictest0-21swapper/108:35:271
11574991006,35cyclictest0-21swapper/108:35:271
115749910042,12cyclictest0-21swapper/111:04:451
11574991003,76cyclictest28614-21apt-get11:05:141
1134121006,16sleep10-21swapper/107:09:001
11560999757,30cyclictest28787-21modprobe09:24:590
11574999683,8cyclictest0-21swapper/111:32:311
11560999414,33cyclictest0-21swapper/012:00:380
11560999414,33cyclictest0-21swapper/012:00:380
1158899934,56cyclictest0-21swapper/307:55:433
11560999372,15cyclictest16085-21latency_hist09:00:010
1158899923,58cyclictest0-21swapper/311:05:143
11581999166,17cyclictest19010-21fschecks_time11:40:232
1158899905,40cyclictest9828-21chrt10:35:343
1157499904,31cyclictest351-21runrttasks09:52:091
11560999066,18cyclictest30486-21latency_hist08:05:010
11574998966,18cyclictest5667-21kworker/u17:0+events_unbound09:59:591
11560998944,36cyclictest0-21swapper/012:00:000
11581998870,9cyclictest0-21swapper/211:45:342
11581998870,9cyclictest0-21swapper/211:45:342
1158899879,40cyclictest0-21swapper/310:41:383
1158199878,62cyclictest31664-21apt-get12:00:142
1158199878,62cyclictest31664-21apt-get12:00:142
11581998772,7cyclictest0-21swapper/208:20:242
1157499873,58cyclictest17285-21chrt07:25:161
1156099877,60cyclictest23966-21apt-get07:45:170
11560998766,12cyclictest0-21swapper/009:40:350
11560998761,18cyclictest24994-21latency_hist11:00:010
11574998660,18cyclictest0-21swapper/108:00:351
11560998667,11cyclictest0-21swapper/008:45:360
11560998663,17cyclictest11550-21cyclictest10:25:190
1156099863,44cyclictest29064-21expr11:05:590
11560998560,17cyclictest29650-21ssh09:25:270
11560998517,25cyclictest19257-21/usr/sbin/munin12:30:350
11581998410,41cyclictest0-21swapper/208:40:122
11581998410,41cyclictest0-21swapper/208:40:122
11560998464,12cyclictest0-21swapper/011:25:340
11560998464,12cyclictest0-21swapper/011:25:340
11560998427,49cyclictest0-21swapper/009:30:120
11581998355,20cyclictest15205-21ssh11:35:002
11560998357,11cyclictest0-21swapper/008:05:220
11574998260,13cyclictest364-21snmpd08:10:241
1157499824,27cyclictest28260-21ssh11:55:151
11560998257,16cyclictest27574-21ssh11:54:100
11574998064,9cyclictest8684-21kworker/u17:3+nfsiod10:50:351
1157499803,52cyclictest13171-21ssh10:41:391
11560998058,12cyclictest0-21swapper/008:25:330
11560998056,16cyclictest9733-21fschecks_time09:45:230
11560998056,14cyclictest0-21swapper/007:55:540
1156099803,57cyclictest32225-21kernelversion11:10:250
1156099803,57cyclictest32225-21kernelversion11:10:250
11581997961,9cyclictest15541-21rm09:55:012
1158199792,55cyclictest23463-21apt-get07:45:142
11574997961,11cyclictest3241-21runrttasks12:05:401
11574997953,18cyclictest29357-21mailstats10:15:341
1156099796,55cyclictest12543-21ssh10:40:270
11581997851,18cyclictest15998-21switchtime12:25:342
1158199783,53cyclictest12435-21apt-get10:40:162
11574997858,14cyclictest31962-21cron09:29:591
11560997858,11cyclictest0-21swapper/007:20:350
11560997857,14cyclictest11550-21cyclictest12:36:480
11560997855,14cyclictest12316-21ssh10:40:030
11560997854,18cyclictest17141-21unixbench_multi09:00:350
11560997852,13cyclictest0-21swapper/011:05:020
11560997834,29cyclictest18727-21ssh11:40:160
11588997710,44cyclictest0-21swapper/311:32:183
11574997761,10cyclictest28469-21cat10:15:011
11574997761,10cyclictest13734-21switchtime08:50:341
11560997758,9cyclictest0-21swapper/007:35:260
11560997716,22cyclictest13667-21grep08:50:330
11560997713,26cyclictest23518-21mailstats09:15:360
11581997652,15cyclictest2630-21sh11:15:172
11574997659,11cyclictest11665-21systemd-run12:20:001
11574997654,14cyclictest202-21systemd-journal09:42:421
11560997658,12cyclictest19195-21diskmemload10:20:290
11560997658,12cyclictest19195-21diskmemload10:20:290
11581997559,7cyclictest0-21swapper/210:15:352
11581997556,9cyclictest0-21swapper/212:05:412
11581997514,30cyclictest29344-21seq11:55:372
11574997550,16cyclictest19195-21diskmemload09:45:361
11574997549,18cyclictest17261-21sh12:28:111
11574997543,13cyclictest0-21swapper/110:35:351
11560997553,14cyclictest0-21swapper/009:35:260
11560997553,14cyclictest0-21swapper/009:35:260
11560997552,17cyclictest19500-21/usr/sbin/munin09:10:380
11560997518,26cyclictest17379-21cpuspeed07:25:330
11560997518,22cyclictest14750irq/292-2188000.ethernet10:45:240
11560997518,22cyclictest14750irq/292-2188000.ethernet10:45:240
11560997512,25cyclictest22026-21cstates11:45:150
11560997512,25cyclictest22026-21cstates11:45:150
11560997511,23cyclictest27320-21latency_hist07:55:030
1158899748,35cyclictest0-21swapper/308:35:273
1158899748,35cyclictest0-21swapper/308:35:273
11581997456,8cyclictest0-21swapper/208:50:352
11581997454,10cyclictest0-21swapper/210:54:232
11581997453,10cyclictest0-21swapper/212:15:012
11581997447,19cyclictest9537-21cpuspeed09:45:182
11581997424,29cyclictest11550-21cyclictest09:30:252
11574997458,10cyclictest423-21sed09:30:281
1157499744,45cyclictest351-21runrttasks09:23:341
11574997435,16cyclictest181rcu_preempt10:30:061
11574997433,12cyclictest181rcu_preempt11:30:011
11574997433,12cyclictest181rcu_preempt11:30:011
11560997453,13cyclictest15305-21ssh11:35:010
11560997449,21cyclictest11550-21cyclictest12:11:060
11560997411,23cyclictest12069-21cat07:10:230
1158199736,50cyclictest26915-21apt-get07:55:132
11574997341,12cyclictest181rcu_preempt10:05:251
11574997341,12cyclictest181rcu_preempt10:05:251
11574997325,10cyclictest181rcu_preempt08:30:341
11560997351,12cyclictest4632-21ssh11:18:060
11560997311,22cyclictest32627-21grep08:10:240
11588997211,36cyclictest0-21swapper/312:00:333
11588997211,36cyclictest0-21swapper/312:00:333
1158199728,28cyclictest0-21swapper/212:33:052
11581997254,10cyclictest22126-21latency_hist10:05:022
1158199723,26cyclictest18611-21modprobe07:29:592
11581997218,21cyclictest0-21swapper/212:15:342
11574997228,11cyclictest181rcu_preempt07:35:031
1156099725,37cyclictest0-21swapper/012:05:200
11560997252,12cyclictest0-21swapper/008:36:190
11560997252,12cyclictest0-21swapper/008:36:190
11560997249,14cyclictest202-21systemd-journal10:14:420
1158199715,46cyclictest28804-21ssh11:05:382
11581997154,12cyclictest351-21runrttasks12:35:152
11581997151,14cyclictest6685-21timerwakeupswit11:20:342
11581997146,20cyclictest11550-21cyclictest08:20:022
11581997144,21cyclictest7822-21sh09:41:452
11581997124,9cyclictest0-21swapper/208:59:592
11581997118,34cyclictest5559-21cat10:30:012
11581997115,23cyclictest11380-21seq08:45:142
11581997111,28cyclictest23928-21seq09:15:522
11574997149,15cyclictest17717-21kworker/u17:1-ext4-rsv-conversion11:00:021
11574997146,19cyclictest23700-21sh09:15:391
11574997145,17cyclictest19195-21diskmemload11:25:021
1157499714,39cyclictest21898-21kernelversion12:35:241
11574997138,10cyclictest0-21swapper/111:51:291
1157499713,45cyclictest2417-21latency_hist10:25:011
1157499713,45cyclictest2417-21latency_hist10:25:011
1157499713,28cyclictest16591-21sed09:00:241
11560997150,10cyclictest0-21swapper/009:50:180
11560997149,11cyclictest0-21swapper/008:15:220
11560997136,28cyclictest0-21swapper/011:35:230
11560997112,27cyclictest22578-21/usr/sbin/munin10:05:230
11560997112,27cyclictest22578-21/usr/sbin/munin10:05:230
11560997112,25cyclictest17436-21ssh12:28:370
11560997111,22cyclictest13973-21fschecks_count07:15:220
11588997017,37cyclictest0-21swapper/307:25:203
11581997052,12cyclictest257-21dbus-daemon07:55:002
11581997048,12cyclictest0-21swapper/211:35:352
11581997025,35cyclictest27289-21ssh11:03:052
1157499704,42cyclictest351-21runrttasks12:14:461
11574997039,21cyclictest3329-21cut08:20:211
1157499703,46cyclictest19341-21latency_hist09:10:021
1157499703,37cyclictest19763-21find10:00:321
11574997031,12cyclictest181rcu_preempt07:55:031
11560997057,7cyclictest0-21swapper/009:05:340
11560997047,15cyclictest0-21swapper/008:20:350
11560997046,18cyclictest6410-21sh11:20:300
11560997043,16cyclictest0-21swapper/008:40:360
11560997043,16cyclictest0-21swapper/008:40:360
11581996949,10cyclictest0-21swapper/208:36:282
11581996949,10cyclictest0-21swapper/208:36:282
11581996946,17cyclictest15717-21cpuspeed10:45:172
11581996946,17cyclictest15717-21cpuspeed10:45:172
11581996945,14cyclictest0-21swapper/210:35:012
11574996934,11cyclictest0-21swapper/109:39:011
11574996934,11cyclictest0-21swapper/109:39:011
11574996931,10cyclictest181rcu_preempt07:35:221
11560996952,12cyclictest0-21swapper/010:15:380
11560996946,17cyclictest18792-21latency_hist10:00:020
11560996921,25cyclictest13019-21unixbench_singl12:20:360
112362694,15sleep30-21swapper/307:07:403
1158899688,39cyclictest17103-21chrt11:36:523
11581996847,11cyclictest0-21swapper/210:10:352
11581996845,13cyclictest0-21swapper/210:05:322
11581996845,13cyclictest0-21swapper/210:05:322
11581996844,13cyclictest0-21swapper/207:10:162
11581996839,19cyclictest22348-21fschecks_time07:40:212
1158199683,43cyclictest1168-21latency_hist08:15:022
11581996811,22cyclictest10359-21seq10:36:152
1157499686,32cyclictest14816-21cut08:55:221
11574996854,10cyclictest5667-21kworker/u17:0-writeback10:46:441
11574996854,10cyclictest5667-21kworker/u17:0-writeback10:46:441
11574996852,10cyclictest15187-21systemd-run07:19:591
11574996850,12cyclictest21684-21kworker/u19:3-rpciod11:15:021
11574996850,12cyclictest21684-21kworker/u19:3-rpciod11:15:021
11574996846,15cyclictest11549-21latencyplot07:15:021
1157499684,53cyclictest2576-21/usr/sbin/munin10:25:321
11574996840,22cyclictest17613-21kworker/u17:0+xprtiod11:40:181
11574996837,21cyclictest18805-21sort12:30:251
1157499683,29cyclictest11954-21dpkg12:20:101
11560996852,10cyclictest7631-21grep08:35:010
11560996850,14cyclictest11550-21cyclictest10:32:330
11560996837,22cyclictest23452-21modprobe07:44:590
11560996821,35cyclictest11719-21latency_hist12:20:010
11581996744,13cyclictest0-21swapper/209:24:592
11581996713,19cyclictest9540-21taskset11:25:292
11581996713,19cyclictest9540-21taskset11:25:292
1158199664,41cyclictest351-21runrttasks07:38:192
11581996644,12cyclictest0-21swapper/207:25:032
11581996620,35cyclictest16722-21timerandwakeup09:55:362
11581996614,43cyclictest18051-21fschecks_count09:05:222
11574996640,9cyclictest181rcu_preempt08:40:101
11574996640,9cyclictest181rcu_preempt08:40:101
11574996635,9cyclictest181rcu_preempt09:10:101
1156099665,27cyclictest0-21swapper/010:55:010
1158199659,28cyclictest0-21swapper/211:10:272
1158199659,28cyclictest0-21swapper/211:10:272
1158199656,29cyclictest2466-21cat10:25:012
1158199656,29cyclictest2466-21cat10:25:012
1158199653,40cyclictest30903-21fschecks_time08:05:222
11574996545,13cyclictest58-21kcompactd011:40:011
1157499654,17cyclictest23947-21/usr/sbin/munin07:45:091
11574996535,12cyclictest181rcu_preempt08:45:101
1157499653,41cyclictest22384-21fschecks_time07:40:221
11560996535,21cyclictest20210-21modprobe07:34:590
11560996512,24cyclictest19694-21open_inodes10:00:310
11581996445,13cyclictest7624-21latency_hist08:35:022
1158199644,38cyclictest351-21runrttasks07:33:512
11581996443,15cyclictest29463-21latency08:00:262
11581996441,13cyclictest0-21swapper/209:37:392
11581996441,13cyclictest0-21swapper/209:37:392
11581996441,12cyclictest0-21swapper/209:10:362
11581996437,19cyclictest23502-21sh10:56:392
1157499644,39cyclictest351-21runrttasks08:09:451
1157499643,41cyclictest1933-21ntp_kernel_pll_08:15:281
1157499643,40cyclictest4915-21fschecks_time08:25:221
11581996345,9cyclictest0-21swapper/209:25:342
1158199634,38cyclictest13462-21cpuspeed07:15:072
1158199634,30cyclictest17069-21timerwakeupswit09:00:342
1158199633,42cyclictest12403-21ssh12:20:242
1157499634,41cyclictest351-21runrttasks07:20:431
1158899622,42cyclictest906-21kworker/3:1+events08:15:173
1158899617,41cyclictest23993-21chrt07:45:273
1158899612,36cyclictest906-21kworker/3:1+events10:55:043
1158899603,38cyclictest906-21kworker/3:1+events09:21:523
11581996041,14cyclictest11550-21cyclictest11:55:002
1158899594,39cyclictest31413-21taskset12:00:023
1158899592,40cyclictest906-21kworker/3:1+events09:12:243
11581995945,10cyclictest11550-21cyclictest08:25:342
1158899583,38cyclictest27308-21chrt07:55:033
1158899582,37cyclictest16588-21chrt09:00:243
1158899554,34cyclictest29520-21chrt09:25:243
1158899553,39cyclictest16323-21chrt09:55:263
1158899553,37cyclictest6616-21taskset12:10:363
1158899553,35cyclictest22315-21chrt07:40:213
1158899552,40cyclictest19106-21chrt07:30:213
1158899552,38cyclictest17056-21chrt07:25:023
1158899552,37cyclictest13878-21chrt07:15:183
1158899543,36cyclictest7418-21taskset09:40:433
1158899543,35cyclictest5097-21chrt09:38:003
1158899543,35cyclictest5097-21chrt09:38:003
1158899542,37cyclictest6200-21taskset10:30:233
1158899534,34cyclictest19106-21taskset12:30:333
1158899533,37cyclictest4380-21chrt11:17:283
1158899533,35cyclictest1168-21chrt09:31:073
1158899532,38cyclictest9234-21chrt11:25:223
1158899532,38cyclictest9234-21chrt11:25:223
1158899532,35cyclictest29299-21taskset08:00:223
1158899532,34cyclictest10439-21chrt12:17:043
1158899523,33cyclictest5881-21chrt11:20:153
1158899523,33cyclictest17637-21chrt12:29:073
1158899522,38cyclictest19106-21chrt11:40:253
1158899522,37cyclictest26791-21chrt10:11:143
1158899522,34cyclictest2919-21taskset10:25:203
1158899517,32cyclictest26679-21chrt11:01:313
1158899514,31cyclictest19156-21taskset10:00:163
1158899513,36cyclictest21888-21taskset12:35:233
1158899513,34cyclictest21246-21chrt07:35:353
1158899513,33cyclictest32400-21chrt10:20:263
1158899513,33cyclictest32400-21chrt10:20:263
1158899513,33cyclictest27705-21chrt11:54:313
1158899512,33cyclictest12075-21taskset12:20:163
1158899503,34cyclictest31249-21chrt08:05:323
1158899502,37cyclictest31697-21chrt10:20:023
1158899502,34cyclictest11782-21taskset08:45:253
1158899493,32cyclictest18781-21chrt10:50:083
1158899493,32cyclictest17670-21chrt10:47:583
1158899493,32cyclictest17670-21chrt10:47:583
1158899493,32cyclictest14420-21chrt09:52:183
1158899493,29cyclictest13922-21chrt08:50:363
1158899492,34cyclictest3779-21taskset12:06:183
1158899492,31cyclictest5209-21chrt08:25:293
1158899474,30cyclictest875-21chrt11:11:403
1158899474,30cyclictest875-21chrt11:11:403
1158899473,31cyclictest25070-21taskset09:18:433
1158899473,30cyclictest3530-21chrt08:20:273
1158899472,34cyclictest23176-21chrt10:05:353
1158899472,34cyclictest23176-21chrt10:05:353
1158899463,31cyclictest22153-21chrt11:45:193
1158899463,31cyclictest22153-21chrt11:45:193
1158899453,29cyclictest1200-21taskset08:15:003
1158899452,30cyclictest7687-21chrt08:35:003
1158899442,28cyclictest18048-21chrt09:05:223
1158899433,27cyclictest11615-21chrt09:48:173
1158899412,27cyclictest9769-21taskset08:40:113
1158899412,27cyclictest9769-21taskset08:40:113
1158899404,27cyclictest13157-21taskset07:15:013
1158899402,26cyclictest15577-21taskset08:55:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional