You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 12:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Jun 21, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208189912343,73cyclictest17090-21systemctl22:28:390
208189912343,73cyclictest17090-21systemctl22:28:390
208189911331,13cyclictest0-21swapper/020:44:010
20818991132,38cyclictest26491-21latency_hist20:53:420
208189910836,13cyclictest0-21swapper/020:09:050
20818991074,37cyclictest27361-21unixbench_multi22:44:160
20818991074,37cyclictest27361-21unixbench_multi22:44:160
20818991073,53cyclictest12471-21ssh00:08:390
208189910734,15cyclictest0-21swapper/020:14:050
208189910734,15cyclictest0-21swapper/020:14:050
20818991073,36cyclictest5454-21/usr/sbin/munin22:08:590
208189910730,17cyclictest0-21swapper/019:04:170
208189910635,12cyclictest0-21swapper/000:20:140
208189910635,12cyclictest0-21swapper/000:20:140
208189910563,25cyclictest15-21ksoftirqd/021:54:310
20818991053,31cyclictest5821-21uniq19:49:000
20818991053,31cyclictest5821-21uniq19:49:000
20818991043,44cyclictest352-21runrttasks23:04:580
208189910128,13cyclictest0-21swapper/022:29:010
208189910034,11cyclictest0-21swapper/021:41:330
1981929811,60sleep119847-21nfs4_client18:54:141
2081899972,25cyclictest5371-21basename19:48:390
309992960,7sleep10-21swapper/123:45:081
20828999676,11cyclictest24802-21kworker/u17:2-rpciod22:54:162
20828999676,11cyclictest24802-21kworker/u17:2-rpciod22:54:162
20822999572,15cyclictest20857-21ssh23:28:491
2068229419,49sleep220706-21munin-run18:58:392
20822999271,11cyclictest0-21swapper/119:49:011
20822999271,11cyclictest0-21swapper/119:49:011
2081899922,44cyclictest22092-21if_eth020:39:030
2081899922,44cyclictest22092-21if_eth020:39:030
20828999173,12cyclictest27963-21diskmemload22:14:142
20822999170,12cyclictest0-21swapper/120:04:021
20828998970,12cyclictest0-21swapper/219:59:022
20828998969,10cyclictest0-21swapper/220:04:152
20822998870,10cyclictest2203-21ssh22:03:421
20822998870,10cyclictest2203-21ssh22:03:421
2081899883,71cyclictest7380-21fschecks_count00:00:070
2081899883,35cyclictest31363-21/usr/sbin/munin19:29:050
2081899883,35cyclictest31363-21/usr/sbin/munin19:29:050
20822998770,10cyclictest0-21swapper/119:08:431
20828998667,13cyclictest23571-21ssh23:33:402
20828998656,8cyclictest181rcu_preempt19:49:062
20828998656,8cyclictest181rcu_preempt19:49:062
20822998664,16cyclictest1850-21sh21:08:561
2081899853,55cyclictest32706-40ogrotate23:48:390
20822998470,7cyclictest0-21swapper/119:18:561
20822998470,7cyclictest0-21swapper/119:18:561
20822998457,15cyclictest181rcu_preempt22:23:561
20822998457,15cyclictest181rcu_preempt22:23:561
20818998456,20cyclictest298-21in:imuxsock23:18:390
20818998456,20cyclictest298-21in:imuxsock23:18:390
20818998438,12cyclictest0-21swapper/021:44:050
2081899842,38cyclictest24931-21apt-get19:09:040
20822998363,11cyclictest0-21swapper/120:24:001
20822998361,16cyclictest20527-21fschecks_count21:40:011
20822998357,7cyclictest181rcu_preempt00:02:371
20822998349,9cyclictest181rcu_preempt20:44:151
20818998357,18cyclictest1-21systemd22:57:460
20818998357,18cyclictest1-21systemd22:57:460
20828998267,11cyclictest20810-21cyclictest20:39:112
20828998267,11cyclictest20810-21cyclictest20:39:112
20828998266,9cyclictest0-21swapper/200:09:132
20828998266,9cyclictest0-21swapper/200:09:132
20828998265,11cyclictest17124-21kworker/u17:1-ext4-rsv-conversion00:23:432
20828998265,11cyclictest17124-21kworker/u17:1-ext4-rsv-conversion00:23:432
20828998259,9cyclictest181rcu_preempt22:31:552
20828998253,9cyclictest181rcu_preempt20:19:092
20828998253,9cyclictest181rcu_preempt20:19:092
20822998263,9cyclictest0-21swapper/122:44:021
20822998263,9cyclictest0-21swapper/122:44:021
20822998260,16cyclictest17008-21fschecks_time21:34:021
20828998151,11cyclictest181rcu_preempt23:22:282
20822998165,10cyclictest0-21swapper/123:28:391
20822998165,10cyclictest0-21swapper/123:28:391
20822998160,8cyclictest181rcu_preempt20:38:501
20822998160,8cyclictest181rcu_preempt20:38:501
20822998154,11cyclictest181rcu_preempt22:34:041
20822998154,11cyclictest181rcu_preempt22:34:041
20822998151,8cyclictest181rcu_preempt20:18:421
20822998151,8cyclictest181rcu_preempt20:18:421
20822998147,9cyclictest6082-21ssh21:14:481
20828998061,9cyclictest0-21swapper/219:08:432
20828998060,9cyclictest0-21swapper/223:34:152
20828998057,8cyclictest181rcu_preempt23:39:142
20828998056,15cyclictest6432-21ssh21:15:482
20828998054,7cyclictest181rcu_preempt19:54:102
20828998054,7cyclictest181rcu_preempt19:54:102
20822998039,8cyclictest181rcu_preempt19:23:541
201352809,39sleep00-21swapper/018:54:260
20828997964,8cyclictest0-21swapper/219:34:462
20828997956,15cyclictest16295-21ntp_kernel_err00:14:072
20828997945,7cyclictest181rcu_preempt21:54:052
20828997937,12cyclictest17125-21fschecks_time20:24:012
20822997956,10cyclictest0-21swapper/122:52:331
20822997953,10cyclictest181rcu_preempt00:11:431
20822997953,10cyclictest181rcu_preempt00:11:431
2081899792,70cyclictest7571-21kworker/u18:1+ext4-rsv-conversion19:34:150
20828997863,8cyclictest0-21swapper/219:44:022
20828997862,9cyclictest0-21swapper/223:24:022
20828997862,9cyclictest0-21swapper/223:24:022
20828997860,8cyclictest0-21swapper/219:13:412
20828997859,9cyclictest0-21swapper/221:24:082
20828997859,9cyclictest0-21swapper/221:24:082
20828997858,14cyclictest17738-21unixbench_multi21:34:172
20828997854,12cyclictest181rcu_preempt22:41:242
20828997851,7cyclictest181rcu_preempt21:30:302
20828997847,7cyclictest181rcu_preempt19:14:052
20822997847,22cyclictest5919-21cut22:09:051
20822997846,24cyclictest24186-21ls23:34:011
20818997854,16cyclictest15382-21ssh23:19:040
20818997849,21cyclictest31340-21sh21:03:570
20818997838,26cyclictest4898-21ssh23:01:440
20828997760,11cyclictest277-21dbus-daemon23:13:402
20828997759,9cyclictest0-21swapper/221:49:152
20828997758,7cyclictest181rcu_preempt21:45:132
20828997736,12cyclictest0-21swapper/222:35:162
20828997736,12cyclictest0-21swapper/222:35:162
20822997761,8cyclictest0-21swapper/119:33:391
20822997761,8cyclictest0-21swapper/119:33:391
20822997758,12cyclictest0-21swapper/123:54:051
20822997758,12cyclictest0-21swapper/123:54:051
20822997758,11cyclictest0-21swapper/121:49:451
20822997758,11cyclictest0-21swapper/100:26:161
20822997731,7cyclictest181rcu_preempt19:53:531
20822997731,7cyclictest181rcu_preempt19:53:531
20818997749,19cyclictest21696-21latency_hist20:38:430
20818997747,22cyclictest0-21swapper/023:09:010
20818997741,7cyclictest181rcu_preempt23:35:050
20828997661,8cyclictest0-21swapper/219:39:012
20828997652,16cyclictest6256-21apt-key23:58:412
20828997652,16cyclictest6256-21apt-key23:58:412
20828997647,7cyclictest181rcu_preempt00:25:342
20828997642,7cyclictest181rcu_preempt20:53:562
20828997642,7cyclictest181rcu_preempt20:53:562
20828997642,7cyclictest181rcu_preempt20:14:162
20828997642,7cyclictest181rcu_preempt20:14:162
20822997660,9cyclictest0-21swapper/119:44:051
20822997657,12cyclictest277-21dbus-daemon22:18:401
20822997654,15cyclictest20810-21cyclictest20:33:571
20822997645,7cyclictest181rcu_preempt21:58:281
20822997632,18cyclictest9498-21kworker/u17:1-nfsiod21:25:581
20822997632,18cyclictest9498-21kworker/u17:1-nfsiod21:25:581
20818997657,12cyclictest1804-21ssh22:02:450
20818997657,12cyclictest1804-21ssh22:02:450
20818997652,16cyclictest29811-21sh21:00:300
151172760,6sleep30-21swapper/323:19:003
20828997555,10cyclictest0-21swapper/221:10:232
20828997540,7cyclictest181rcu_preempt18:58:572
20828997540,7cyclictest181rcu_preempt18:58:572
2082899753,27cyclictest32727-40mandb23:48:432
20822997561,8cyclictest0-21swapper/120:29:021
20822997545,10cyclictest181rcu_preempt19:34:451
20822997542,14cyclictest10596-21ssh23:10:521
2082299752,38cyclictest32310-21grep21:04:171
20818997554,12cyclictest0-21swapper/019:39:010
20828997457,9cyclictest0-21swapper/200:00:222
20828997457,8cyclictest0-21swapper/222:09:152
20828997453,8cyclictest181rcu_preempt21:43:182
20828997445,9cyclictest181rcu_preempt21:05:422
20828997435,9cyclictest0-21swapper/221:21:052
20828997431,8cyclictest0-21swapper/222:24:102
20828997431,8cyclictest0-21swapper/222:24:102
20822997456,8cyclictest0-21swapper/123:48:541
20822997455,9cyclictest0-21swapper/120:58:561
20822997455,15cyclictest31942-21kworker/u19:0+events_unbound23:18:391
20822997455,15cyclictest31942-21kworker/u19:0+events_unbound23:18:391
20822997454,15cyclictest20810-21cyclictest19:09:281
20822997444,7cyclictest181rcu_preempt23:00:471
20822997440,18cyclictest15059-21ssh21:29:501
20822997439,8cyclictest181rcu_preempt19:03:421
20822997439,8cyclictest181rcu_preempt19:03:421
20828997357,9cyclictest0-21swapper/219:23:572
20828997357,11cyclictest0-21swapper/221:59:022
20828997357,11cyclictest0-21swapper/221:59:022
20828997356,9cyclictest0-21swapper/222:59:052
20828997346,20cyclictest31942-21kworker/u19:0+nfsiod23:17:312
20828997346,20cyclictest31942-21kworker/u19:0+nfsiod23:17:312
20828997343,8cyclictest181rcu_preempt23:52:512
20822997353,13cyclictest14100-21idleruntime-cro22:23:381
20822997352,15cyclictest544-21cron22:58:391
20822997352,15cyclictest544-21cron22:58:391
20822997341,22cyclictest13419-21modprobe20:13:391
20822997338,11cyclictest5881-21ssh23:03:481
20822997338,11cyclictest14870-21apt23:18:481
20822997331,9cyclictest181rcu_preempt00:21:581
20822997331,9cyclictest181rcu_preempt00:21:581
20822997330,19cyclictest24653-21ssh22:39:461
20818997352,15cyclictest11803-21idleruntime-cro20:08:390
20818997335,32cyclictest16599-21ssh00:14:140
2081899732,38cyclictest352-21runrttasks22:03:570
20828997248,9cyclictest181rcu_preempt23:03:512
20828997240,8cyclictest181rcu_preempt20:59:222
20822997255,11cyclictest17802-21runrttasks22:29:031
20822997251,8cyclictest181rcu_preempt19:59:121
20822997229,9cyclictest181rcu_preempt23:38:521
20818997252,12cyclictest8667-21fschecks_count22:14:000
20818997243,20cyclictest19680-21apt-key21:38:430
2081899723,36cyclictest13454-21grep21:28:390
2081899723,36cyclictest13454-21grep21:28:390
2081899722,23cyclictest27489-21grep23:39:120
20828997156,7cyclictest0-21swapper/220:09:012
20828997155,9cyclictest0-21swapper/200:04:082
20828997152,9cyclictest0-21swapper/220:48:492
20828997152,9cyclictest0-21swapper/219:19:132
20828997152,9cyclictest0-21swapper/219:19:132
20828997141,8cyclictest181rcu_preempt20:46:362
20828997129,8cyclictest0-21swapper/222:18:472
20822997152,10cyclictest0-21swapper/121:18:561
20822997141,11cyclictest181rcu_preempt19:14:051
20818997132,24cyclictest58-21kcompactd022:22:400
20828997028,10cyclictest181rcu_preempt22:43:532
20828997028,10cyclictest181rcu_preempt22:43:532
20828997025,9cyclictest0-21swapper/222:48:512
20822997050,7cyclictest181rcu_preempt20:58:371
20822997050,7cyclictest181rcu_preempt20:58:371
20822997035,9cyclictest181rcu_preempt00:14:021
2082299702,40cyclictest25006-21apt-get20:48:491
20818997054,10cyclictest12745-21ssh00:08:480
20818997054,10cyclictest12745-21ssh00:08:480
20818997053,10cyclictest298-21in:imuxsock20:03:390
20818997048,16cyclictest16397-21sh21:33:390
2081899703,29cyclictest21300-21cut23:29:040
20822996928,19cyclictest24786-21ssh21:46:211
20818996949,14cyclictest24354-21idleruntime-cro00:28:380
20818996947,16cyclictest28634-21idleruntime-cro21:53:380
2081899692,40cyclictest7803-21cpu21:18:550
20828996846,9cyclictest181rcu_preempt20:29:052
20828996828,17cyclictest4414-21ssh22:06:402
20828996827,8cyclictest181rcu_preempt19:29:032
20828996827,8cyclictest181rcu_preempt19:29:032
20822996853,8cyclictest0-21swapper/122:03:561
20822996850,8cyclictest0-21swapper/120:19:121
20822996850,8cyclictest0-21swapper/120:19:121
20818996846,15cyclictest18435-21latency_hist20:28:420
2081899682,50cyclictest30395-21grep22:49:150
194192689,36sleep30-21swapper/318:54:003
77662670,8sleep30-21swapper/323:06:233
20822996727,7cyclictest181rcu_preempt00:04:041
20818996749,12cyclictest297-21systemd-logind19:18:400
2081899673,33cyclictest16185-21grep20:19:130
2081899673,33cyclictest16185-21grep20:19:130
20818996728,8cyclictest161ktimers/021:18:310
20822996652,8cyclictest0-21swapper/119:39:051
2081899663,31cyclictest946-21ssh23:49:020
20818996616,23cyclictest23472-21cat22:38:560
20818996550,10cyclictest0-21swapper/023:58:430
20818996550,10cyclictest0-21swapper/023:58:430
20818996540,15cyclictest0-21swapper/023:23:590
20818996540,15cyclictest0-21swapper/023:23:590
2081899652,45cyclictest4616-21latency_hist21:13:420
2081899652,32cyclictest27973-21modprobe20:58:390
2081899652,32cyclictest27973-21modprobe20:58:390
2081899652,28cyclictest31275-21latency_hist19:28:420
2081899652,27cyclictest23154-21latency_hist22:38:410
2081899652,27cyclictest23154-21latency_hist22:38:410
20828996421,8cyclictest181rcu_preempt20:34:152
20835996226,25cyclictest8182-21chrt21:19:063
2081899623,42cyclictest352-21runrttasks20:29:230
2081899623,42cyclictest352-21runrttasks18:59:430
2081899623,42cyclictest352-21runrttasks18:59:430
2081899622,41cyclictest7442-21fschecks_count19:54:000
2081899622,41cyclictest7442-21fschecks_count19:54:000
2081899622,39cyclictest29110-21unixbench_singl19:19:160
2081899622,39cyclictest29110-21unixbench_singl19:19:160
20835995624,22cyclictest17247-21chrt20:24:033
20835995623,22cyclictest27312-21chrt23:39:063
2083599543,36cyclictest7771-21chrt19:54:093
2083599543,36cyclictest7771-21chrt19:54:093
20835995235,9cyclictest228862sleep321:43:433
2083599522,28cyclictest917-21kworker/3:1+events19:23:523
20835995134,10cyclictest205612sleep322:33:573
20835995134,10cyclictest205612sleep322:33:573
2083599513,35cyclictest16202-21taskset21:33:043
2083599493,32cyclictest23011-21taskset19:03:503
2083599493,31cyclictest13520-21taskset20:13:423
2083599483,33cyclictest27142-21taskset22:44:143
2083599483,33cyclictest27142-21taskset22:44:143
2083599463,34cyclictest1799-21taskset22:02:443
2083599463,34cyclictest1799-21taskset22:02:443
2083599463,30cyclictest917-21kworker/3:1+events23:01:013
2083599463,30cyclictest26250-21taskset21:49:023
2083599463,26cyclictest13665-21taskset21:28:433
2083599463,26cyclictest13665-21taskset21:28:433
2083599454,29cyclictest21125-21chrt23:29:013
2083599454,28cyclictest28289-21taskset20:58:513
2083599453,33cyclictest3759-21taskset22:04:503
2083599453,30cyclictest18740-21taskset00:18:543
2083599453,30cyclictest18740-21taskset00:18:543
2083599453,30cyclictest12865-21chrt22:20:153
2083599453,29cyclictest27374-21taskset20:54:133
2083599453,29cyclictest27374-21taskset20:54:133
2083599452,30cyclictest18515-21chrt20:28:453
2083599447,27cyclictest7167-21taskset21:17:523
2083599444,29cyclictest24889-21taskset20:48:423
2083599443,30cyclictest847-21chrt19:34:453
2083599443,30cyclictest25584-21taskset20:49:103
2083599443,30cyclictest25435-21taskset22:41:593
2083599443,30cyclictest12792-21taskset00:08:533
2083599443,30cyclictest12792-21taskset00:08:533
2083599443,30cyclictest10790-21chrt23:11:263
2083599443,30cyclictest10302-21chrt00:04:073
2083599443,29cyclictest16864-21chrt20:23:423
2083599443,28cyclictest8876-21taskset19:58:553
2083599443,28cyclictest5707-21taskset19:48:553
2083599443,28cyclictest5707-21taskset19:48:553
2083599442,32cyclictest24964-21chrt19:09:093
2083599442,29cyclictest14586-21chrt23:18:393
2083599442,29cyclictest14586-21chrt23:18:393
2083599442,24cyclictest30054-21chrt23:43:563
2083599433,30cyclictest22648-21chrt21:43:383
2083599433,29cyclictest17416-21chrt22:28:503
2083599433,28cyclictest3546-21taskset23:53:493
2083599433,28cyclictest3546-21taskset23:53:493
2083599433,28cyclictest13704-21taskset20:13:543
2083599433,28cyclictest13704-21taskset20:13:543
2083599433,28cyclictest10591-21chrt20:03:583
2083599433,27cyclictest6129-21chrt22:09:123
2083599433,27cyclictest21768-21taskset20:38:533
2083599433,27cyclictest21768-21taskset20:38:533
2083599432,30cyclictest6785-21chrt23:58:523
2083599432,30cyclictest15754-21chrt00:13:523
2083599432,29cyclictest18044-21taskset23:23:583
2083599432,29cyclictest18044-21taskset23:23:583
2083599432,28cyclictest15307-21taskset20:18:523
2083599424,28cyclictest27693-21taskset19:16:263
2083599423,29cyclictest8471-21chrt22:13:543
2083599423,28cyclictest3457-21taskset19:40:243
2083599423,28cyclictest32748-21chrt19:33:403
2083599423,28cyclictest32748-21chrt19:33:403
2083599423,28cyclictest32352-21chrt22:53:513
2083599423,28cyclictest32352-21chrt22:53:513
2083599423,28cyclictest31875-21chrt21:04:103
2083599423,27cyclictest22515-21taskset19:03:423
2083599423,27cyclictest22515-21taskset19:03:423
2083599423,27cyclictest1762-21chrt21:08:443
2083599423,27cyclictest14815-21chrt22:24:043
2083599423,27cyclictest14815-21chrt22:24:043
2083599422,30cyclictest23361-21chrt00:25:513
2083599422,28cyclictest28892-21taskset21:53:443
2083599422,27cyclictest23779-21taskset23:33:433
2083599413,29cyclictest30458-21chrt22:49:173
2083599413,27cyclictest576-21chrt23:48:513
2083599413,26cyclictest20152-21chrt20:33:513
2083599403,28cyclictest17355-21chrt21:34:103
2083599402,28cyclictest28152-21taskset19:18:533
2083599402,28cyclictest28152-21taskset19:18:533
2083599393,26cyclictest3993-21chrt19:43:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional