You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 05:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Jul 25, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19384991213,79cyclictest1611-21apt-get22:01:391
19384991213,79cyclictest1611-21apt-get22:01:391
18245210714,65sleep118274-21irqstats18:51:521
19384991068,85cyclictest4550-21kworker/u19:1+ext4-rsv-conversion23:51:451
19384991009,63cyclictest20530-21apt-get23:26:431
19384991009,63cyclictest20530-21apt-get23:26:431
1929221009,64sleep219307-21systemctl18:56:222
19384999944,47cyclictest0-21swapper/123:01:551
19384999944,47cyclictest0-21swapper/123:01:551
19384999874,17cyclictest297-21systemd-logind21:41:201
19388999678,13cyclictest19370-21cyclictest20:06:212
19388999673,16cyclictest297-21systemd-logind00:01:202
113962960,7sleep00-21swapper/023:11:410
19384999555,35cyclictest19370-21cyclictest21:58:501
19388999476,13cyclictest2374-21systemd-journal22:46:412
19388999476,13cyclictest2374-21systemd-journal22:46:412
19384999420,21cyclictest1-21systemd23:16:201
19384999365,18cyclictest30075-21latency_hist19:26:231
1938499926,76cyclictest27047-21diskmemload00:21:381
1938499924,38cyclictest4795-21basename23:01:191
19384999235,48cyclictest0-21swapper/120:41:191
19384999235,48cyclictest0-21swapper/120:41:191
1938499923,35cyclictest18315-21unixbench_singl23:21:541
19384999166,17cyclictest297-21systemd-logind19:46:221
1938499913,37cyclictest24004-21fschecks_time19:07:021
1938499913,37cyclictest24004-21fschecks_time19:07:021
1938499913,35cyclictest1145-21taskset22:54:311
1938499913,33cyclictest10772-21latency_hist23:11:221
19384999064,19cyclictest23433-21latency_hist19:06:221
19384999036,46cyclictest0-21swapper/122:06:471
1938499903,35cyclictest28251-21modprobe22:46:191
1938499902,38cyclictest9027-21latency_hist00:01:221
19388998973,10cyclictest25590-21ssh21:46:532
1938499894,40cyclictest26559-21timerwakeupswit20:51:541
1938499894,40cyclictest26559-21timerwakeupswit20:51:541
19384998939,44cyclictest0-21swapper/100:11:461
19384998937,44cyclictest0-21swapper/119:53:031
19384998935,46cyclictest0-21swapper/122:31:411
1938499893,36cyclictest21873-21ssh21:41:311
1938499893,32cyclictest9568-21latency_hist21:21:241
19384998925,56cyclictest0-21swapper/123:50:311
19379998977,7cyclictest0-21swapper/019:01:580
19388998867,12cyclictest0-21swapper/222:56:212
1938499887,61cyclictest14309-21apt-get23:16:401
1938499884,32cyclictest18738-21ssh21:36:221
1938499884,31cyclictest19482-21fschecks_time20:31:401
1938499884,31cyclictest19482-21fschecks_time20:31:401
1938499884,30cyclictest13139-21fschecks_count21:26:401
1938499884,30cyclictest13139-21fschecks_count21:26:401
1938499883,35cyclictest27689-21fschecks_time20:56:421
1938499883,35cyclictest15360-21grep20:16:561
1938499883,35cyclictest13171-21/usr/sbin/munin00:06:561
1938499883,34cyclictest24846-21/usr/sbin/munin21:46:481
1938499883,32cyclictest13167-21latency20:11:431
19384998827,8cyclictest0-21swapper/120:26:291
19384998822,12cyclictest0-21swapper/121:11:231
19384998817,30cyclictest4801-21tr19:46:581
19384998815,32cyclictest29034-21ssh22:46:451
19384998815,32cyclictest29034-21ssh22:46:451
1938499874,33cyclictest24292-21fschecks_count20:46:431
1938499874,31cyclictest28271-21modprobe19:21:191
1938499873,35cyclictest9731-21grep20:01:421
1938499873,33cyclictest29477-21/usr/sbin/munin23:41:581
1938499873,33cyclictest29477-21/usr/sbin/munin23:41:581
1938499873,33cyclictest12572-21modprobe21:26:191
1938499873,32cyclictest28753-21timerandwakeup21:51:551
1938499873,32cyclictest28753-21timerandwakeup21:51:551
1938499873,27cyclictest9217-21/usr/sbin/munin00:01:471
1938499873,22cyclictest19785-21fschecks_count18:56:411
1938499872,37cyclictest22681-21fschecks_time20:41:421
1938499872,31cyclictest10366-21ssh22:16:221
1938499864,34cyclictest11873-21switchtime20:06:531
1938499864,33cyclictest352-21runrttasks21:14:161
1938499864,30cyclictest16277-21fschecks_time20:21:421
1938499863,28cyclictest21279-21date00:21:231
19384998628,9cyclictest0-21swapper/121:06:211
1938499862,36cyclictest23380-21/usr/sbin/munin23:31:571
1938499862,34cyclictest31645-21grep19:31:221
1938499862,33cyclictest16393-21cat22:26:221
19388998567,10cyclictest1176-21ssh21:06:412
19388998535,26cyclictest0-21swapper/219:34:462
1938499854,31cyclictest352-21runrttasks22:39:571
1938499853,32cyclictest8527-21ntpq19:57:441
1938499853,32cyclictest8527-21ntpq19:57:441
1938499843,34cyclictest2277-21cron19:41:201
1938499843,29cyclictest13269-21cron22:21:191
1938499842,33cyclictest16600-21/usr/sbin/munin22:26:531
1938499842,33cyclictest16600-21/usr/sbin/munin22:26:531
19379998462,11cyclictest0-21swapper/019:01:220
1938499834,33cyclictest26812-21fschecks_time23:36:411
19379998360,17cyclictest31463-21latency_hist22:51:230
19379998360,17cyclictest31463-21latency_hist22:51:230
19388998266,11cyclictest19370-21cyclictest20:56:232
19388998266,11cyclictest19370-21cyclictest20:56:232
19388998264,13cyclictest5942-21latency_hist23:56:222
19388998259,15cyclictest21406-21munin-node21:01:222
19384998212,21cyclictest32152-21tr19:31:451
19379998236,11cyclictest181rcu_preempt21:53:440
19379998236,11cyclictest181rcu_preempt21:53:440
19388998167,9cyclictest23728-21apt-get19:06:362
19388998167,9cyclictest23728-21apt-get19:06:362
19388998165,10cyclictest4240-21runrttasks19:46:232
19388998164,11cyclictest2374-21systemd-journal23:38:452
19388998160,15cyclictest19907-21fschecks_time22:31:422
1938899813,34cyclictest29906-21awk19:26:192
1938899812,53cyclictest25437-21cron20:51:192
1938899812,46cyclictest39-21ksoftirqd/222:38:132
1938899812,39cyclictest39-21ksoftirqd/221:31:332
1938499812,34cyclictest25604-21sort19:11:431
19379998154,10cyclictest181rcu_preempt20:32:550
19379998154,10cyclictest181rcu_preempt20:32:550
191882816,58sleep00-21swapper/018:55:380
19388998065,11cyclictest19370-21cyclictest22:06:452
19388998060,9cyclictest0-21swapper/220:01:212
19388998060,9cyclictest0-21swapper/220:01:212
19388998052,22cyclictest4537-21cstates19:46:502
19379998049,10cyclictest181rcu_preempt00:22:400
19379998047,14cyclictest181rcu_preempt20:48:180
19379998045,8cyclictest181rcu_preempt23:35:110
1937999802,44cyclictest18902-21cpu21:36:360
19379998023,28cyclictest15-21ksoftirqd/020:16:410
19388997960,13cyclictest3030-21gpgv23:51:222
19388997915,26cyclictest11524-21cut23:11:442
19379997960,13cyclictest27047-21diskmemload23:11:220
19379997959,10cyclictest0-21swapper/023:21:500
19379997946,9cyclictest181rcu_preempt22:07:160
1937999793,67cyclictest3302-21ssh23:51:350
19388997861,11cyclictest4768-21cron23:01:192
19388997856,12cyclictest0-21swapper/220:41:422
19379997830,22cyclictest181rcu_preempt22:16:100
19388997760,10cyclictest170-21jbd2/mmcblk2p2-823:46:212
19388997760,10cyclictest170-21jbd2/mmcblk2p2-823:46:212
19388997758,10cyclictest0-21swapper/219:16:212
19388997757,15cyclictest19370-21cyclictest20:36:422
19388997757,15cyclictest19370-21cyclictest20:36:422
19388997757,10cyclictest0-21swapper/221:36:542
19379997743,28cyclictest277-21dbus-daemon22:01:200
19379997742,13cyclictest181rcu_preempt23:45:370
19379997742,13cyclictest181rcu_preempt23:45:370
19379997737,9cyclictest181rcu_preempt19:16:450
1937999773,36cyclictest15-21ksoftirqd/021:01:230
19388997660,11cyclictest19370-21cyclictest19:51:242
19388997660,10cyclictest655-21sh22:00:122
19379997661,9cyclictest6490-21kworker/u17:0+rpciod23:36:470
19379997657,8cyclictest0-21swapper/019:07:150
19379997657,8cyclictest0-21swapper/019:07:150
19379997626,40cyclictest25985-21idleruntime20:51:410
19379997626,40cyclictest25985-21idleruntime20:51:410
19388997541,8cyclictest181rcu_preempt22:12:582
19388997536,13cyclictest181rcu_preempt21:20:212
1937999756,42cyclictest15-21ksoftirqd/019:23:330
19379997561,7cyclictest0-21swapper/021:41:300
19379997559,8cyclictest0-21swapper/022:02:370
19379997559,8cyclictest0-21swapper/022:02:370
19379997556,12cyclictest31556-21systemd-run19:31:210
1937999754,32cyclictest15-21ksoftirqd/021:46:340
19379997539,13cyclictest181rcu_preempt22:56:110
19379997510,52cyclictest16714-21cat22:26:370
19379997510,52cyclictest16714-21cat22:26:370
19388997459,9cyclictest0-21swapper/220:26:442
19388997459,8cyclictest0-21swapper/220:21:542
1938899745,35cyclictest39-21ksoftirqd/221:51:342
1938899745,35cyclictest39-21ksoftirqd/221:51:342
19388997450,18cyclictest19437-21latency_hist22:31:222
19388997450,18cyclictest19437-21latency_hist22:31:222
19388997447,8cyclictest181rcu_preempt22:22:102
19388997442,12cyclictest181rcu_preempt00:01:242
19388997440,13cyclictest181rcu_preempt00:16:362
1938899743,36cyclictest20596-21modprobe23:26:412
1938899743,36cyclictest20596-21modprobe23:26:412
19388997430,13cyclictest181rcu_preempt23:16:242
19388997412,32cyclictest21467-21apt-get00:21:532
19379997453,7cyclictest181rcu_preempt00:20:210
19379997447,9cyclictest181rcu_preempt23:20:220
19379997443,9cyclictest181rcu_preempt23:47:480
19379997438,8cyclictest181rcu_preempt21:13:500
19379997433,16cyclictest181rcu_preempt22:58:180
19379997431,11cyclictest181rcu_preempt21:27:160
19379997431,11cyclictest181rcu_preempt21:27:160
19379997430,8cyclictest181rcu_preempt20:01:210
19379997430,8cyclictest181rcu_preempt20:01:210
19379997427,10cyclictest181rcu_preempt21:03:340
1937999741,48cyclictest15-21ksoftirqd/020:01:550
19388997359,8cyclictest0-21swapper/223:06:142
19388997359,8cyclictest0-21swapper/223:06:142
19388997358,8cyclictest0-21swapper/219:06:222
19388997339,12cyclictest181rcu_preempt00:06:442
19388997335,20cyclictest0-21swapper/200:15:372
19388997326,13cyclictest181rcu_preempt21:31:222
19388997326,13cyclictest181rcu_preempt21:31:222
19379997355,12cyclictest7540-21apt-key19:56:230
19379997348,7cyclictest181rcu_preempt00:06:150
19379997327,10cyclictest24921-21kworker/u18:1-events_unbound19:40:370
1937999731,34cyclictest15-21ksoftirqd/022:41:190
19388997258,8cyclictest0-21swapper/220:31:552
19388997258,8cyclictest0-21swapper/220:31:552
19388997258,8cyclictest0-21swapper/218:56:452
19388997258,10cyclictest58-21kcompactd023:10:222
19388997256,10cyclictest58-21kcompactd020:06:552
19388997255,10cyclictest0-21swapper/219:26:522
19388997255,10cyclictest0-21swapper/219:21:212
19388997243,13cyclictest181rcu_preempt22:44:272
19388997229,13cyclictest181rcu_preempt22:02:232
19388997229,13cyclictest181rcu_preempt22:02:232
19379997257,11cyclictest19370-21cyclictest23:04:060
19379997257,11cyclictest19370-21cyclictest23:04:060
19379997253,8cyclictest0-21swapper/021:21:520
19379997243,11cyclictest181rcu_preempt22:42:340
19379997227,12cyclictest181rcu_preempt21:06:560
19388997133,12cyclictest181rcu_preempt21:41:482
19379997154,12cyclictest11158-21/usr/sbin/munin20:06:350
19379997150,13cyclictest2770-21fschecks_time19:41:420
19379997145,9cyclictest4550-21kworker/u19:1-rpciod23:29:240
19379997145,9cyclictest4550-21kworker/u19:1-rpciod23:29:240
19379997139,23cyclictest18744-21latency_hist21:36:220
19379997129,12cyclictest181rcu_preempt20:11:530
190782716,14sleep30-21swapper/318:54:113
19388997055,10cyclictest19959-21sendmail23:26:182
19379997035,12cyclictest0-21swapper/020:22:160
19379997034,12cyclictest0-21swapper/019:49:230
19379997032,13cyclictest181rcu_preempt20:41:480
1938899699,17cyclictest39-21ksoftirqd/223:36:012
19388996947,17cyclictest352-21runrttasks21:12:332
19388996929,17cyclictest181rcu_preempt22:16:402
19379996941,6cyclictest181rcu_preempt22:21:180
19379996927,12cyclictest181rcu_preempt20:36:480
19379996927,12cyclictest181rcu_preempt20:36:480
1937999692,37cyclictest26681-21cron19:16:190
19379996921,14cyclictest15-21ksoftirqd/020:30:470
19388996841,17cyclictest0-21swapper/220:11:532
19388996833,12cyclictest181rcu_preempt20:19:022
19379996847,12cyclictest9617-21ssh21:21:220
19379996821,20cyclictest15-21ksoftirqd/000:15:210
19397996716,33cyclictest0-21swapper/322:02:093
19397996716,33cyclictest0-21swapper/322:02:093
19388996717,14cyclictest181rcu_preempt19:36:302
1937999674,52cyclictest352-21runrttasks23:58:220
1937999673,51cyclictest14313-21mailstats22:21:510
19379996734,8cyclictest181rcu_preempt19:35:180
19379996731,13cyclictest181rcu_preempt00:09:110
19388996527,10cyclictest181rcu_preempt21:03:592
19379996542,15cyclictest20261-21sh22:31:510
19388996448,9cyclictest0-21swapper/221:21:462
1939799615,46cyclictest23738-21taskset19:06:353
1939799615,46cyclictest23738-21taskset19:06:353
1939799613,41cyclictest24343-21taskset00:26:233
1939799593,41cyclictest10625-21taskset22:16:333
1939799584,37cyclictest30232-21taskset21:01:233
1939799582,42cyclictest19912-21chrt21:36:573
1939799574,37cyclictest15083-21chrt23:17:203
1939799564,38cyclictest29909-21chrt19:26:193
19397995640,10cyclictest451rcuc/323:37:113
1939799554,38cyclictest10984-21chrt20:06:223
1939799544,36cyclictest2401-21chrt22:56:413
19397995440,9cyclictest451rcuc/321:32:083
19397995440,9cyclictest451rcuc/321:20:123
1939799543,37cyclictest17313-21chrt00:14:393
1939799543,34cyclictest17340-21chrt23:21:333
1939799534,34cyclictest23431-21chrt23:31:303
1939799534,34cyclictest23431-21chrt23:31:303
1939799532,36cyclictest1217-21taskset21:06:423
1939799524,36cyclictest28810-21chrt22:46:403
1939799524,36cyclictest28810-21chrt22:46:403
1939799524,33cyclictest21370-21taskset19:01:243
19397995239,8cyclictest451rcuc/300:17:243
19397995238,9cyclictest451rcuc/322:22:583
1939799523,37cyclictest19215-21chrt20:31:293
1939799523,37cyclictest19215-21chrt20:31:293
1939799523,35cyclictest17828-21chrt22:27:153
1939799523,35cyclictest17828-21chrt22:27:153
1939799522,40cyclictest965-21chrt22:01:043
1939799522,38cyclictest15155-21chrt20:16:553
1939799522,36cyclictest24924-21taskset22:40:243
1939799522,35cyclictest27264-21chrt19:16:443
1939799514,33cyclictest1307-21taskset19:36:443
19397995137,10cyclictest451rcuc/323:02:543
19397995137,10cyclictest451rcuc/323:02:543
19397995136,10cyclictest451rcuc/319:29:043
19397995135,10cyclictest451rcuc/300:01:183
1939799513,37cyclictest31333-21chrt23:44:033
1939799513,37cyclictest31333-21chrt23:44:033
1939799513,36cyclictest21825-21chrt22:35:053
1939799513,34cyclictest22750-21taskset21:41:563
19397995113,28cyclictest2621-21taskset23:51:043
1939799503,37cyclictest12588-21chrt21:26:193
1939799503,35cyclictest15646-21taskset21:31:223
1939799503,35cyclictest15646-21taskset21:31:223
1939799503,34cyclictest30662-21chrt21:56:223
1939799503,34cyclictest30662-21chrt21:56:223
1939799503,31cyclictest5396-21chrt23:54:493
1939799502,36cyclictest26337-21chrt22:41:543
1939799502,32cyclictest6536-21chrt22:09:113
1939799494,30cyclictest21182-21taskset20:36:433
1939799494,30cyclictest21182-21taskset20:36:433
19397994937,8cyclictest451rcuc/323:10:033
1939799493,35cyclictest9280-21chrt00:01:343
1939799493,35cyclictest26043-21chrt20:51:423
1939799493,35cyclictest26043-21chrt20:51:423
1939799493,32cyclictest3317-21chrt19:41:553
1939799492,36cyclictest5953-21taskset21:14:363
1939799492,36cyclictest11648-21taskset20:06:463
1939799492,34cyclictest25729-21chrt21:46:543
1939799484,33cyclictest32418-21chrt21:04:393
1939799484,28cyclictest7478-21chrt19:56:213
1939799483,36cyclictest25777-21taskset23:35:113
1939799483,31cyclictest14921-21chrt00:11:193
1939799482,35cyclictest9200-21chrt22:13:173
19397994733,9cyclictest451rcuc/320:50:543
1939799472,34cyclictest32732-21chrt22:52:033
1939799463,31cyclictest13513-21chrt23:15:413
1939799453,31cyclictest21796-21chrt19:01:323
19397994531,9cyclictest451rcuc/320:23:283
19397994531,9cyclictest451rcuc/319:14:543
19397994528,9cyclictest451rcuc/320:28:133
19397994431,8cyclictest451rcuc/319:58:333
19397994431,8cyclictest451rcuc/319:58:333
1939799436,24cyclictest0-21swapper/319:46:443
19397994331,8cyclictest451rcuc/320:12:513
1939799423,27cyclictest22437-21taskset20:41:293
1939799413,27cyclictest31769-21taskset19:31:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional