You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 07:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Wed Jul 15, 2026 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5847213190,20sleep032646-21kworker/u17:2+writeback18:57:430
59579914861,55cyclictest298-21in:imuxsock22:02:010
5957991193,41cyclictest11556-21cstates22:42:180
5957991193,41cyclictest11556-21cstates22:42:180
59579911334,11cyclictest0-21swapper/018:57:560
5957991122,27cyclictest25778-21modprobe22:12:000
59579911036,13cyclictest0-21swapper/023:57:000
59579911036,13cyclictest0-21swapper/023:57:000
59579911035,11cyclictest0-21swapper/022:07:020
5966991093,75cyclictest20852-21apt-get23:52:202
5966991093,75cyclictest20852-21apt-get23:52:202
59579910849,52cyclictest2374-21systemd-journal21:27:010
59579910846,10cyclictest13917-21ssh20:57:350
59579910749,53cyclictest4861-21kworker/u17:3+rpciod22:42:020
59579910735,14cyclictest0-21swapper/023:25:320
59579910735,14cyclictest0-21swapper/023:25:320
5957991073,44cyclictest27441-21vmstat23:07:410
5957991063,30cyclictest3762-21cstates00:17:160
5957991063,30cyclictest3762-21cstates00:17:160
59579910541,55cyclictest0-21swapper/019:52:040
5957991053,38cyclictest11193-21fschecks_count19:12:220
5957991044,36cyclictest11664-21/usr/sbin/munin23:37:280
5957991044,31cyclictest2630-21latency_hist23:22:030
5957991043,37cyclictest20999-21cstates19:42:180
59579910428,13cyclictest0-21swapper/000:07:340
5957991042,44cyclictest9366-21modprobe20:47:000
5957991034,40cyclictest22078-21latency_hist21:12:030
5957991023,41cyclictest29519-21fschecks_count23:12:220
5957991023,41cyclictest29519-21fschecks_count23:12:220
5957991023,40cyclictest26936-21switchtime22:12:360
5957991023,37cyclictest15734-21grep23:42:380
5957991023,37cyclictest15734-21grep23:42:380
5957991023,35cyclictest18336-21cat22:52:370
5957991023,35cyclictest18336-21cat22:52:370
5957991022,31cyclictest12192-21bash21:48:000
5957991022,31cyclictest12192-21bash21:48:000
59579910137,12cyclictest297-21systemd-logind20:17:010
5957991013,43cyclictest23085-21latency_hist23:02:020
5957991013,38cyclictest352-21runrttasks20:22:370
5957991013,35cyclictest12858-21fschecks_time19:17:220
5957991013,33cyclictest9479-21cstates19:07:180
5957991012,40cyclictest29793-21mailstats22:17:340
5957991012,40cyclictest29793-21mailstats22:17:340
5957991012,37cyclictest18123-21ssh23:47:280
5957991012,34cyclictest25333-21grep23:58:340
496821016,16sleep20-21swapper/218:53:422
5957991004,36cyclictest30478-21latency_hist20:12:030
59579910041,52cyclictest0-21swapper/000:02:250
5957991003,37cyclictest23413-21ls23:02:170
5957991003,37cyclictest23413-21ls23:02:170
5957991003,37cyclictest15578-21tr19:27:000
5957991003,36cyclictest25092-21unixbench_singl19:52:360
5957991003,26cyclictest31620-21sh21:27:200
5957999936,8cyclictest0-21swapper/019:38:470
595799993,37cyclictest28748-21lockfile-create20:07:000
595799993,35cyclictest17742-21idleruntime19:32:260
595799993,34cyclictest10644-21latency_hist21:47:050
595799993,33cyclictest11019-21latency_hist20:52:000
595799992,37cyclictest25243-21cpu21:17:170
595799992,37cyclictest25243-21cpu21:17:170
595799992,36cyclictest352-21runrttasks22:35:380
595799992,36cyclictest352-21runrttasks22:35:380
5966999821,42cyclictest39-21ksoftirqd/221:42:322
5957999840,9cyclictest12871-21diskmemload21:32:590
5966999774,17cyclictest17081-21latency_hist21:57:042
595799974,28cyclictest22183-21/usr/sbin/munin21:12:280
595799973,38cyclictest6459-21chrt20:37:340
595799973,35cyclictest5377-21idleruntime21:37:240
595799973,32cyclictest1596-21timerwakeupswit00:12:370
595799953,39cyclictest9317-21/usr/sbin/munin23:32:290
595799953,39cyclictest9317-21/usr/sbin/munin23:32:290
595799953,36cyclictest352-21runrttasks20:17:050
595799943,34cyclictest14537-21cstates22:47:170
5966999369,8cyclictest181rcu_preempt20:08:442
5966999356,14cyclictest181rcu_preempt21:40:192
595799932,36cyclictest25731-21/usr/sbin/munin19:57:370
595799923,33cyclictest6732-21cstates00:22:190
595799913,31cyclictest9082-21cron19:07:000
595799913,31cyclictest9082-21cron19:07:000
595799912,26cyclictest14797-21awk21:52:310
5961998859,20cyclictest8417-21fschecks_count19:02:471
5961998859,20cyclictest8417-21fschecks_count19:02:471
5961998758,20cyclictest17995-21sh21:57:391
5961998663,14cyclictest23205-21cpuspeed22:07:171
5966998551,9cyclictest181rcu_preempt22:32:462
5966998551,9cyclictest181rcu_preempt22:32:462
5966998544,11cyclictest181rcu_preempt19:42:252
5966998538,18cyclictest19676-21snmpd21:12:032
569528512,45sleep15658-21dpkg-deb18:57:411
5966998459,7cyclictest181rcu_preempt21:58:152
5966998445,9cyclictest181rcu_preempt22:20:392
5966998445,9cyclictest181rcu_preempt22:20:392
5966998438,13cyclictest181rcu_preempt22:03:402
5966998432,17cyclictest0-21swapper/223:02:022
5966998359,9cyclictest181rcu_preempt20:57:202
5966998352,9cyclictest181rcu_preempt00:12:332
5966998349,8cyclictest181rcu_preempt22:47:352
5966998335,14cyclictest181rcu_preempt23:25:402
5966998335,14cyclictest181rcu_preempt23:25:402
596699832,44cyclictest39-21ksoftirqd/223:15:502
596699832,44cyclictest39-21ksoftirqd/223:15:502
5966998324,17cyclictest0-21swapper/218:58:022
5961998360,16cyclictest12871-21diskmemload21:45:021
5966998257,9cyclictest181rcu_preempt21:25:362
5966998255,8cyclictest181rcu_preempt23:07:262
5966998250,15cyclictest181rcu_preempt23:33:542
5966998250,15cyclictest181rcu_preempt23:33:542
5966998240,19cyclictest5945-21cyclictest22:38:202
5966998240,11cyclictest181rcu_preempt21:02:292
596199827,56cyclictest21164-21rm23:52:411
596199827,56cyclictest21164-21rm23:52:411
5957998259,14cyclictest12784-21kworker/u17:0+rpciod21:07:040
5966998161,15cyclictest7783-21netstat19:02:282
5966998161,15cyclictest7783-21netstat19:02:282
5966998158,16cyclictest298-21in:imuxsock22:54:312
5966998158,16cyclictest298-21in:imuxsock22:54:312
5966998143,8cyclictest181rcu_preempt21:34:442
5966998058,9cyclictest181rcu_preempt21:47:412
5966998058,9cyclictest181rcu_preempt21:47:412
5966998050,7cyclictest181rcu_preempt23:21:242
5966998037,27cyclictest0-21swapper/200:07:272
5966998037,13cyclictest181rcu_preempt22:46:322
5966998037,13cyclictest181rcu_preempt22:46:322
5966998027,33cyclictest0-21swapper/223:32:032
5966997963,12cyclictest5945-21cyclictest19:32:002
5966997952,8cyclictest181rcu_preempt23:47:562
5966997948,12cyclictest181rcu_preempt00:21:442
5966997948,12cyclictest181rcu_preempt00:21:442
5966997945,11cyclictest181rcu_preempt19:17:322
5966997942,13cyclictest181rcu_preempt20:38:372
5966997937,20cyclictest23598-21ssh23:02:232
5966997937,20cyclictest23598-21ssh23:02:232
5966997935,12cyclictest181rcu_preempt23:40:442
5966997842,13cyclictest181rcu_preempt19:47:222
5966997822,12cyclictest0-21swapper/200:23:082
596699782,12cyclictest27242-21apt-get00:02:192
5961997857,10cyclictest0-21swapper/120:07:001
597299775,46cyclictest0-21swapper/318:57:563
5966997752,10cyclictest181rcu_preempt20:35:342
5966997747,8cyclictest181rcu_preempt22:22:392
5966997745,13cyclictest181rcu_preempt00:02:032
5966997738,16cyclictest181rcu_preempt19:12:112
5966997738,12cyclictest181rcu_preempt19:22:352
5966997735,13cyclictest181rcu_preempt21:19:182
5966997735,13cyclictest181rcu_preempt21:19:182
5966997735,11cyclictest0-21swapper/220:22:122
5966997733,9cyclictest181rcu_preempt19:38:152
5966997733,13cyclictest181rcu_preempt21:28:122
5961997755,16cyclictest11002-21cpu19:12:171
596199775,49cyclictest24033-21apt-get23:57:171
5966997642,15cyclictest181rcu_preempt19:57:032
5957997653,19cyclictest10933-21kworker/u17:2+flush-179:020:53:040
597299757,34cyclictest0-21swapper/321:22:353
5966997535,14cyclictest181rcu_preempt20:16:502
5966997534,15cyclictest181rcu_preempt22:30:392
5966997534,12cyclictest181rcu_preempt21:12:492
596699753,35cyclictest32622-21wc20:17:262
596699752,39cyclictest39-21ksoftirqd/223:42:192
596699752,39cyclictest39-21ksoftirqd/223:42:192
595799753,48cyclictest5355-21grep22:32:030
595799753,36cyclictest6583-21wc23:27:330
5966997441,12cyclictest181rcu_preempt20:02:242
5966997438,15cyclictest181rcu_preempt22:13:312
5966997436,11cyclictest181rcu_preempt20:27:232
5966997435,9cyclictest181rcu_preempt19:34:392
5961997448,18cyclictest27861-21latency_hist21:22:041
5961997448,18cyclictest27861-21latency_hist21:22:041
5966997351,8cyclictest181rcu_preempt20:45:212
5966997338,11cyclictest181rcu_preempt22:08:422
5966997332,11cyclictest0-21swapper/220:53:102
5966997331,18cyclictest181rcu_preempt19:12:032
596199736,29cyclictest0-21swapper/100:07:361
5961997353,11cyclictest4016-21kworker/u17:1-rpciod21:33:281
597299724,48cyclictest0-21swapper/323:57:403
5966997234,13cyclictest181rcu_preempt20:47:372
596699722,36cyclictest39-21ksoftirqd/219:57:542
5957997245,19cyclictest0-21swapper/020:37:000
5961997157,10cyclictest5945-21cyclictest23:22:221
5961997157,10cyclictest5945-21cyclictest23:22:221
5961997156,9cyclictest12871-21diskmemload23:42:571
5961997156,9cyclictest12871-21diskmemload23:42:571
5961997150,11cyclictest0-21swapper/119:27:321
5961997148,14cyclictest18349-21unixbench_multi19:32:391
596199714,46cyclictest5176-21latency_hist22:32:021
5957997150,13cyclictest31973-21/usr/sbin/munin22:22:410
5961997053,11cyclictest277-21dbus-daemon23:37:011
5961997053,11cyclictest277-21dbus-daemon23:37:011
5961997047,15cyclictest11162-21taskset22:42:021
5961997046,15cyclictest0-21swapper/121:27:481
5961997026,12cyclictest181rcu_preempt23:47:401
5961997020,11cyclictest291rcuc/118:57:541
5961996946,17cyclictest9892-21kworker/u18:1+nfsiod21:48:011
5961996946,17cyclictest9892-21kworker/u18:1+nfsiod21:48:011
596199694,34cyclictest24878-21latency_hist21:17:031
5961996937,23cyclictest3353-21grep00:17:011
5961996925,7cyclictest301ktimers/100:02:141
5972996813,31cyclictest0-21swapper/323:47:033
5972996813,31cyclictest0-21swapper/323:47:033
5961996851,11cyclictest297-21systemd-logind22:37:011
5961996851,11cyclictest297-21systemd-logind22:37:011
5961996849,7cyclictest181rcu_preempt19:24:291
5961996849,14cyclictest352-21runrttasks23:17:371
5961996837,16cyclictest0-21swapper/120:52:041
596199683,45cyclictest3914-21fschecks_time00:17:221
596199683,45cyclictest3914-21fschecks_time00:17:221
5961996831,9cyclictest301ktimers/120:57:151
595799683,54cyclictest3056-21cpuspeed20:27:180
596199675,27cyclictest31-21ksoftirqd/121:24:401
5961996733,19cyclictest31-21ksoftirqd/123:29:001
5961996724,7cyclictest301ktimers/120:23:401
5961996724,7cyclictest291rcuc/122:57:291
5961996721,9cyclictest301ktimers/122:47:591
5961996721,10cyclictest301ktimers/122:17:361
5961996721,10cyclictest301ktimers/122:17:361
596199668,37cyclictest0-21swapper/122:12:271
5961996650,11cyclictest16597-21sh21:02:261
5961996644,12cyclictest0-21swapper/120:37:011
596199663,46cyclictest18304-21timerandwakeup22:52:371
596199663,46cyclictest18304-21timerandwakeup22:52:371
5961996621,11cyclictest301ktimers/120:42:181
595799663,49cyclictest15820-21/usr/sbin/munin19:27:240
596199657,47cyclictest11521-21apt-get20:52:351
596199654,46cyclictest10289-21grep19:07:371
596199654,41cyclictest20743-21ntp_states22:02:341
596199653,46cyclictest352-21runrttasks20:12:141
5961996533,10cyclictest11368-21kworker/u17:2-nfsiod23:37:061
5961996523,7cyclictest291rcuc/121:41:591
5961996521,31cyclictest7232-21switchtime20:38:421
5961996520,8cyclictest291rcuc/119:37:271
596199648,36cyclictest31-21ksoftirqd/100:23:491
596199643,44cyclictest352-21runrttasks23:15:261
596199643,44cyclictest352-21runrttasks23:15:261
596199643,44cyclictest25976-21fschecks_time19:57:231
596199643,44cyclictest23444-21grep19:47:371
596199643,27cyclictest26442-21cpuspeed23:07:181
5961996431,9cyclictest181rcu_preempt21:52:281
596199642,26cyclictest31-21ksoftirqd/120:27:271
5961996420,33cyclictest19504-21fschecks_time21:07:221
5961996420,10cyclictest301ktimers/123:02:341
5961996420,10cyclictest301ktimers/123:02:341
5961996418,12cyclictest301ktimers/122:22:191
596199633,33cyclictest1240-21latency_hist20:22:031
5961996320,8cyclictest301ktimers/119:47:031
597299624,41cyclictest19779-21chrt21:07:283
596199624,32cyclictest30333-21latency_hist20:12:031
5961996243,13cyclictest14082-21sendmail22:47:001
5961996243,13cyclictest14082-21sendmail22:47:001
597299613,41cyclictest8143-21chrt19:02:373
597299613,41cyclictest8143-21chrt19:02:373
5961996137,12cyclictest0-21swapper/119:52:211
597299603,36cyclictest917-21kworker/3:1+events00:03:163
5961996040,11cyclictest0-21swapper/119:17:161
533826012,28sleep30-21swapper/318:57:143
180852590,5sleep30-21swapper/323:47:283
597299589,32cyclictest0-21swapper/321:32:193
597299574,33cyclictest0-21swapper/321:47:193
597299574,33cyclictest0-21swapper/321:47:193
597299573,38cyclictest32280-21taskset21:27:463
597299573,37cyclictest25505-21taskset23:05:403
597299573,37cyclictest25505-21taskset23:05:403
39182570,9sleep30-21swapper/300:17:223
39182570,9sleep30-21swapper/300:17:223
597299564,26cyclictest0-21swapper/319:37:153
597299563,37cyclictest27873-21taskset21:22:003
597299563,37cyclictest27873-21taskset21:22:003
597299563,35cyclictest1273-21taskset20:22:033
597299562,42cyclictest13772-21taskset22:46:103
597299562,42cyclictest13772-21taskset22:46:103
597299562,34cyclictest4686-21chrt23:24:583
597299562,34cyclictest4686-21chrt23:24:583
597299554,34cyclictest13078-21chrt19:17:273
597299553,40cyclictest19072-21chrt21:07:043
597299553,39cyclictest8777-21taskset00:25:413
597299553,35cyclictest14238-21chrt20:57:393
597299552,37cyclictest15677-21chrt19:27:033
597299552,35cyclictest21701-21chrt22:58:183
597299544,39cyclictest0-21swapper/320:37:493
597299543,39cyclictest30604-21chrt22:18:583
597299543,39cyclictest30604-21chrt22:18:583
597299543,36cyclictest20588-21chrt22:02:283
597299543,34cyclictest25906-21taskset19:57:213
597299542,34cyclictest27068-21chrt23:07:353
5972995414,23cyclictest0-21swapper/323:52:163
5972995414,23cyclictest0-21swapper/323:52:163
597299534,36cyclictest18267-21chrt19:32:383
597299533,38cyclictest16749-21taskset21:56:483
597299533,37cyclictest32511-21chrt22:22:263
597299533,36cyclictest30498-21chrt20:12:033
597299533,35cyclictest8417-21chrt23:31:593
597299533,33cyclictest967-21taskset00:12:233
597299532,36cyclictest8597-21chrt22:37:183
597299532,34cyclictest31276-21chrt00:07:453
597299532,34cyclictest16453-21chrt19:27:323
597299532,33cyclictest9508-21taskset19:07:183
597299523,37cyclictest1946-21chrt23:20:363
597299523,31cyclictest16208-21taskset22:49:353
597299522,36cyclictest11438-21chrt20:52:043
597299522,35cyclictest22448-21chrt21:12:233
597299522,34cyclictest9243-21chrt21:43:053
597299522,32cyclictest3848-21chrt22:28:143
597299514,34cyclictest17341-21taskset21:57:213
597299513,32cyclictest3362-21chrt20:27:263
597299513,31cyclictest1619-21chrt20:22:243
597299513,29cyclictest5617-21chrt21:37:303
597299512,35cyclictest30225-21taskset23:12:383
597299512,35cyclictest30225-21taskset23:12:383
597299512,35cyclictest28762-21chrt20:07:013
597299503,31cyclictest25469-21chrt19:57:003
597299503,29cyclictest8817-21chrt23:32:163
597299503,29cyclictest8817-21chrt23:32:163
597299502,33cyclictest11923-21chrt20:53:543
597299502,32cyclictest17643-21chrt22:52:223
597299502,32cyclictest17643-21chrt22:52:223
597299493,32cyclictest12419-21chrt19:17:033
597299482,34cyclictest27817-21chrt22:14:283
597299475,30cyclictest8185-21chrt22:37:023
597299475,30cyclictest8185-21chrt22:37:023
597299473,33cyclictest23577-21chrt22:07:263
597299473,26cyclictest22492-21chrt19:47:043
597299453,32cyclictest8315-21chrt20:42:243
597299433,27cyclictest22684-21taskset19:47:203
597299432,29cyclictest30883-21chrt20:12:243
597299422,27cyclictest4967-21chrt20:32:333
597299422,25cyclictest917-21kworker/3:1+events23:37:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional