You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 08:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Sep 16, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5189910618,36cyclictest24565-21sort23:24:192
5189910456,9cyclictest30288-21sh21:44:412
5189910447,15cyclictest24519-21latency_hist20:19:102
5189910447,15cyclictest24519-21latency_hist20:19:102
414210414,64sleep0433-21latency_hist19:09:110
518991033,51cyclictest13148-21wc23:59:132
5079910272,20cyclictest25532-21sh00:19:241
518999948,11cyclictest25434-21latency_hist00:19:112
3232957,16sleep20-21swapper/219:09:012
507999436,50cyclictest0-21swapper/119:44:291
507999436,50cyclictest0-21swapper/119:44:291
497999353,32cyclictest27833-21fschecks_time23:29:300
50799922,31cyclictest3906-21latency_hist23:44:101
50799906,18cyclictest26828-21ssh21:39:351
50799904,30cyclictest16291-21latency_hist19:54:111
507999041,43cyclictest18348-21timerandwakeup21:24:451
50799903,30cyclictest3625-21cat21:54:331
50799902,29cyclictest10133-21sort23:54:251
507999020,11cyclictest0-21swapper/120:34:241
497999070,13cyclictest15335-21switchtime21:19:440
33429014,47sleep1372-21munin-run19:09:081
50799892,29cyclictest18871-21fschecks_time23:14:311
507998835,44cyclictest0-21swapper/119:39:311
507998723,57cyclictest0-21swapper/120:04:111
50799872,32cyclictest28200-21rm23:29:401
50799872,29cyclictest343-21runrttasks19:14:291
50799872,29cyclictest343-21runrttasks19:14:291
50799863,30cyclictest28178-21grep22:34:441
50799863,30cyclictest24708-21ntpq22:29:361
50799863,30cyclictest24708-21ntpq22:29:361
50799862,32cyclictest6589-21expr19:24:571
50799862,32cyclictest6589-21expr19:24:571
50799862,32cyclictest6589-21expr19:24:571
50799862,30cyclictest15522-21ssh23:09:121
50799862,28cyclictest17870-21awk22:19:081
50799853,31cyclictest7479-21runrttasks23:49:331
50799853,31cyclictest5388-21timerandwakeup19:19:441
50799853,31cyclictest25442-21/usr/sbin/munin20:19:451
50799853,31cyclictest21166-21processes21:29:421
50799853,30cyclictest19411-21apt-key00:09:121
507998523,10cyclictest10605-21unixbench_singl19:34:431
50799852,30cyclictest4764-21runrttasks23:44:411
50799852,24cyclictest1167-21grep21:49:451
497998574,7cyclictest0-21swapper/000:09:380
497998574,7cyclictest0-21swapper/000:09:380
497998564,15cyclictest9465-21unixbench_multi21:09:450
50799843,33cyclictest5814-21apt-get21:59:231
50799843,29cyclictest15002-21/usr/sbin/munin21:19:361
50799843,28cyclictest3953-21fschecks_time22:49:301
50799842,33cyclictest2622-21cat20:49:411
50799842,33cyclictest2622-21cat20:49:411
50799842,31cyclictest7572-21timerandwakeup21:04:421
50799842,31cyclictest7572-21timerandwakeup21:04:421
50799842,31cyclictest31756-21fschecks_time00:29:321
50799842,31cyclictest30575-21ssh21:44:441
50799842,30cyclictest28070-21cut20:29:301
50799842,30cyclictest24377-21timerandwakeup21:34:471
50799842,30cyclictest24377-21timerandwakeup21:34:471
49799844,71cyclictest30541-21ssh23:34:210
50799833,30cyclictest19555-21chrt22:20:321
50799833,30cyclictest19555-21chrt22:20:321
507998331,44cyclictest0-21swapper/100:10:251
507998331,44cyclictest0-21swapper/100:10:251
507998323,8cyclictest0-21swapper/121:17:331
50799832,31cyclictest12171-21/usr/sbin/munin22:09:281
50799832,30cyclictest32465-21cron20:44:081
507998317,19cyclictest7843-21seq22:55:051
507998317,19cyclictest7843-21seq22:55:051
497998362,14cyclictest0-21swapper/000:00:170
497998362,14cyclictest0-21swapper/000:00:170
497998352,8cyclictest181rcu_preempt23:49:130
50799824,29cyclictest29291-21sort00:24:421
50799824,29cyclictest29291-21sort00:24:421
507998233,41cyclictest23989-21unixbench_singl20:14:441
507998233,41cyclictest23989-21unixbench_singl20:14:441
50799822,32cyclictest24555-21/usr/sbin/munin23:24:421
50799822,32cyclictest22758-21fschecks_count00:14:381
50799822,32cyclictest22758-21fschecks_count00:14:381
50799822,31cyclictest343-21runrttasks21:10:021
50799822,30cyclictest2360-21apt-config19:14:121
49799823,45cyclictest15-21ksoftirqd/022:49:180
518998164,10cyclictest951-21sensors21:49:432
51899812,61cyclictest13302-21apt-get23:59:282
51899812,61cyclictest13302-21apt-get23:59:282
50799815,25cyclictest8332-21fschecks_time19:29:471
50799813,34cyclictest10041-21sed22:59:311
50799813,30cyclictest17797-21latency_hist19:59:101
50799812,33cyclictest27206-21tail20:24:461
50799812,32cyclictest14370-21find00:00:411
50799812,32cyclictest14370-21find00:00:411
50799812,31cyclictest776-21netstat20:44:361
50799812,31cyclictest776-21netstat20:44:361
50799812,31cyclictest22380-21grep20:09:461
50799812,30cyclictest20603-21switchtime20:05:471
50799812,29cyclictest15774-21df23:09:261
497998166,10cyclictest485-21cyclictest22:55:380
497998166,10cyclictest485-21cyclictest22:55:380
497998149,13cyclictest58-21kcompactd019:19:260
497998141,17cyclictest181rcu_preempt21:07:380
497998141,17cyclictest181rcu_preempt21:07:380
50799804,28cyclictest30097-21/usr/sbin/munin22:39:341
50799803,30cyclictest31154-21ssh23:34:401
50799803,27cyclictest4987-21latency_hist20:59:101
50799802,34cyclictest2229-21fschecks_count00:34:291
50799802,31cyclictest9707-21latency22:04:341
50799802,28cyclictest3514-21rm22:49:111
50799802,28cyclictest343-21runrttasks21:03:301
518997957,14cyclictest8118-21diskmemload23:37:122
507997947,12cyclictest181rcu_preempt23:21:351
50799782,32cyclictest21280-21cstates22:24:241
497997859,13cyclictest28172-21sh00:24:070
49799783,44cyclictest18730-21ntp_kernel_err22:19:350
49799783,44cyclictest18730-21ntp_kernel_err22:19:350
3164427824,33sleep30-21swapper/319:04:343
518997758,13cyclictest17719-21fschecks_count21:24:312
51899772,57cyclictest26794-21ssh21:39:302
497997762,10cyclictest8118-21diskmemload00:19:100
497997762,10cyclictest8118-21diskmemload00:19:100
497997660,10cyclictest2319-21latencyplot19:14:120
497997656,14cyclictest2991-21latency_hist21:54:110
497997656,14cyclictest29310-21munin-run21:44:080
49799765,36cyclictest15-21ksoftirqd/019:54:250
518997560,9cyclictest32035-21ssh00:29:382
518997557,14cyclictest13012-21kworker/u18:1+events_unbound21:39:072
518997557,14cyclictest13012-21kworker/u18:1+events_unbound21:39:072
518997557,10cyclictest20083-21fschecks_count00:10:252
518997557,10cyclictest20083-21fschecks_count00:10:252
497997561,9cyclictest9254-21rm22:04:190
497997558,10cyclictest23594-21ssh21:34:280
497997558,10cyclictest23594-21ssh21:34:280
497997547,8cyclictest19112-21sshd00:09:100
518997454,15cyclictest485-21cyclictest00:19:452
518997454,14cyclictest11131-21idleruntime-cro21:14:082
518997453,15cyclictest21244-21latency_hist20:09:102
518997452,16cyclictest662-21cron19:44:082
497997460,10cyclictest485-21cyclictest22:11:290
497997458,10cyclictest8118-21diskmemload23:07:560
497997458,10cyclictest1-21systemd22:35:070
497997448,9cyclictest485-21cyclictest23:27:550
49799744,38cyclictest343-21runrttasks21:57:120
497997430,12cyclictest181rcu_preempt20:09:440
518997358,8cyclictest0-21swapper/222:49:232
518997355,12cyclictest343-21runrttasks23:48:202
518997353,14cyclictest6561-21latency_hist21:04:102
518997347,17cyclictest18945-21apt-get00:09:112
497997355,13cyclictest11001-21sendmail19:39:080
497997335,8cyclictest181rcu_preempt19:54:100
518997254,10cyclictest16980-21kworker/u17:3-ext4-rsv-conversion22:39:072
518997253,13cyclictest25172-21sendmail00:19:072
518997252,14cyclictest581-21latency_hist22:44:122
518997251,15cyclictest7882-21latency_hist19:29:102
518997251,15cyclictest7882-21latency_hist19:29:102
518997251,15cyclictest7882-21latency_hist19:29:102
497997257,11cyclictest485-21cyclictest23:39:430
497997256,10cyclictest17790-21ssh21:24:320
497997253,13cyclictest526-21rs:main0
497997251,14cyclictest4686-21kworker/u19:3-rpciod21:17:230
497997247,19cyclictest2227-21fschecks_count00:34:290
49799722,35cyclictest24405-21fschecks_time22:29:300
49799722,35cyclictest24405-21fschecks_time22:29:300
518997157,10cyclictest485-21cyclictest19:49:452
518997156,11cyclictest485-21cyclictest23:39:382
497997154,11cyclictest16109-21ssh23:09:340
497997154,11cyclictest12550-21ssh23:58:430
497997151,14cyclictest10852-21cron23:00:070
518997057,9cyclictest485-21cyclictest20:09:392
518997051,12cyclictest358-21ntpd20:34:102
518997049,8cyclictest181rcu_preempt22:57:472
518997049,8cyclictest181rcu_preempt22:57:472
497997052,12cyclictest19403-21switchtime23:14:440
497997051,13cyclictest8118-21diskmemload23:44:470
49799703,57cyclictest21377-21fschecks_count22:24:280
518996949,14cyclictest16080-21latency23:09:332
51899693,23cyclictest27934-21/usr/sbin/munin23:29:322
497996955,10cyclictest485-21cyclictest22:44:090
497996947,16cyclictest19437-21apt-key20:04:110
497996946,10cyclictest181rcu_preempt20:44:330
497996946,10cyclictest181rcu_preempt20:44:330
518996852,9cyclictest0-21swapper/222:19:292
518996852,9cyclictest0-21swapper/222:19:292
518996848,9cyclictest0-21swapper/221:54:172
51899682,44cyclictest21622-21cpu23:19:232
497996852,9cyclictest23929-21ssh23:23:160
497996850,11cyclictest181rcu_preempt20:29:370
49799683,53cyclictest343-21runrttasks22:16:450
518996754,8cyclictest39-21ksoftirqd/222:14:352
518996753,10cyclictest58-21kcompactd022:33:302
518996753,10cyclictest58-21kcompactd022:33:302
518996749,13cyclictest11088-21sh23:00:462
518996748,13cyclictest200-21systemd-journal00:36:112
518996746,15cyclictest7355-21cut23:49:302
518996746,15cyclictest26546-21cut20:24:312
518996743,8cyclictest181rcu_preempt21:18:292
51899674,35cyclictest7619-21timerwakeupswit21:04:432
51899674,35cyclictest7619-21timerwakeupswit21:04:432
518996741,14cyclictest0-21swapper/220:39:112
518996740,17cyclictest6274-21latency_hist19:24:112
518996739,22cyclictest21491-21unixbench_multi21:29:462
49799678,31cyclictest343-21runrttasks22:45:560
497996742,12cyclictest181rcu_preempt20:54:240
497996741,19cyclictest26723-21kworker/u17:3+nfsiod00:25:460
497996741,19cyclictest26723-21kworker/u17:3+nfsiod00:25:460
497996741,19cyclictest13820-21kworker/u17:1+nfsiod00:32:200
497996737,12cyclictest181rcu_preempt20:14:430
497996737,12cyclictest181rcu_preempt20:14:430
49799673,40cyclictest21171-21munin-plugin-st20:09:070
49799663,47cyclictest21202-21awk21:29:420
49799663,46cyclictest7926-21latency_hist19:29:150
49799663,46cyclictest7926-21latency_hist19:29:150
49799663,46cyclictest7926-21latency_hist19:29:150
49799663,40cyclictest8930-21latency_hist22:04:070
49799663,31cyclictest29765-21fschecks_time20:34:300
518996549,8cyclictest0-21swapper/219:54:322
518996547,14cyclictest20111-21kworker/u17:1+events_unbound23:19:072
49799653,52cyclictest24942-21grep20:19:320
49799653,51cyclictest2406-21munin-node19:14:200
49799653,51cyclictest2406-21munin-node19:14:200
49799653,50cyclictest8008-21/usr/sbin/munin19:29:290
518996444,13cyclictest0-21swapper/200:29:102
518996444,13cyclictest0-21swapper/200:29:102
518996443,11cyclictest0-21swapper/220:44:122
518996442,15cyclictest8933-21munin-plugin-st22:04:102
518996441,13cyclictest0-21swapper/220:54:102
518996441,13cyclictest0-21swapper/220:54:102
518996437,21cyclictest9793-21netstat22:04:362
51899642,45cyclictest23316-21ssh22:27:442
49799643,41cyclictest11525-21fschecks_time19:39:310
497996430,12cyclictest181rcu_preempt19:44:550
497996430,12cyclictest181rcu_preempt19:44:550
52899635,42cyclictest28440-21taskset20:29:403
518996347,10cyclictest12831-21fschecks_count23:04:292
518996341,13cyclictest0-21swapper/220:04:112
518996334,9cyclictest181rcu_preempt21:20:232
518996244,13cyclictest13602-21needreboot19:44:552
518996244,13cyclictest13602-21needreboot19:44:552
518996242,14cyclictest4274-21threads20:54:432
518996238,17cyclictest1542-21kworker/u17:3+events_unbound20:49:082
518996238,17cyclictest1542-21kworker/u17:3+events_unbound20:49:082
497996241,15cyclictest31307-21fschecks_count20:39:300
497996238,9cyclictest181rcu_preempt21:02:060
497996227,12cyclictest181rcu_preempt20:24:260
52899613,47cyclictest29767-21taskset22:39:073
518996139,11cyclictest0-21swapper/219:34:292
518996136,17cyclictest0-21swapper/219:14:122
51899613,34cyclictest9052-21awk19:30:032
51899613,25cyclictest2967-21apt-get19:14:232
51899613,25cyclictest2967-21apt-get19:14:232
497996144,11cyclictest343-21runrttasks20:49:380
497996144,11cyclictest343-21runrttasks20:49:380
52899603,43cyclictest12195-21taskset22:09:193
518996044,9cyclictest0-21swapper/222:09:512
518996031,19cyclictest0-21swapper/222:46:572
518995938,15cyclictest24910-21fschecks_time20:19:322
52899583,35cyclictest12707-21chrt23:04:253
52899573,41cyclictest17787-21chrt19:59:103
528995727,21cyclictest389-21chrt00:30:313
52899564,35cyclictest9697-21taskset22:59:223
52899563,40cyclictest976-21chrt20:44:423
52899563,40cyclictest976-21chrt20:44:423
52899563,39cyclictest4317-21taskset23:44:303
52899563,37cyclictest12788-21chrt23:59:093
52899553,39cyclictest15083-21taskset21:19:383
52899553,36cyclictest6218-21chrt19:24:113
52899548,26cyclictest0-21swapper/323:59:283
52899548,26cyclictest0-21swapper/323:59:283
52899544,37cyclictest25904-21chrt23:25:243
52899544,35cyclictest6478-21chrt22:54:113
52899543,39cyclictest9368-21taskset22:59:103
52899543,39cyclictest9368-21taskset22:59:103
52899535,34cyclictest13930-21chrt21:18:373
52899534,39cyclictest7467-21taskset23:49:323
52899534,35cyclictest26678-21chrt00:19:573
52899533,36cyclictest10057-21chrt21:11:113
52899532,38cyclictest9921-21taskset22:04:413
52899524,35cyclictest21871-21taskset23:19:293
52899524,34cyclictest20303-21chrt21:29:113
52899524,34cyclictest18966-21chrt22:19:413
52899524,34cyclictest18966-21chrt22:19:413
52899523,37cyclictest21308-21taskset23:19:083
52899523,36cyclictest31645-21taskset21:47:213
52899522,37cyclictest891-21chrt22:44:303
52899522,33cyclictest24615-21chrt20:19:113
52899522,33cyclictest24615-21chrt20:19:113
528995212,26cyclictest0-21swapper/300:09:233
528995212,26cyclictest0-21swapper/300:09:233
52899513,37cyclictest12928-21chrt19:44:123
52899513,36cyclictest27171-21chrt21:40:043
52899513,35cyclictest5934-21chrt21:59:093
52899513,35cyclictest2675-21chrt00:34:413
52899513,35cyclictest25101-21chrt20:19:353
52899513,35cyclictest19341-21chrt20:04:083
52899504,34cyclictest29741-21chrt20:34:303
52899504,33cyclictest924-21taskset23:39:113
52899504,29cyclictest27836-21chrt20:29:113
52899503,37cyclictest7383-21taskset22:00:563
52899503,35cyclictest26190-21taskset21:39:083
52899503,35cyclictest26190-21taskset21:39:083
52899503,34cyclictest2512-21chrt23:40:373
52899503,33cyclictest7623-21chrt21:04:433
52899503,33cyclictest7623-21chrt21:04:433
52899503,33cyclictest3735-21chrt19:15:453
52899503,33cyclictest3735-21chrt19:15:453
52899502,35cyclictest21854-21taskset21:30:323
52899494,35cyclictest32055-21taskset22:42:073
52899494,31cyclictest25341-21chrt22:30:033
52899494,31cyclictest25341-21chrt22:30:033
52899493,32cyclictest17385-21chrt23:11:423
52899492,35cyclictest2728-21chrt21:53:543
52899484,30cyclictest779-21chrt19:09:263
52899483,32cyclictest27837-21chrt23:29:303
52899483,32cyclictest10003-21taskset19:34:323
52899474,29cyclictest16305-21chrt00:04:203
52899473,35cyclictest7381-21chrt19:25:293
52899473,35cyclictest7381-21chrt19:25:293
52899473,35cyclictest7381-21chrt19:25:293
52899473,29cyclictest29823-21taskset00:25:243
52899473,29cyclictest29823-21taskset00:25:243
52899463,34cyclictest23315-21chrt22:27:443
52899463,32cyclictest3354-21chrt20:54:103
52899463,32cyclictest3354-21chrt20:54:103
52899463,32cyclictest22413-21chrt20:09:473
528994613,20cyclictest0-21swapper/319:44:303
528994613,20cyclictest0-21swapper/319:44:303
52899453,31cyclictest19825-21taskset20:04:213
52899453,30cyclictest8135-21taskset19:29:253
52899453,29cyclictest15185-21chrt22:14:223
52899453,28cyclictest23878-21chrt00:15:353
52899453,28cyclictest23878-21chrt00:15:353
52899442,29cyclictest5516-21chrt20:59:363
52899434,29cyclictest31613-21chrt20:39:363
52899423,25cyclictest14742-21taskset19:49:223
52899402,28cyclictest4058-21chrt20:54:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional