You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 11:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 31, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81429913659,10cyclictest0-21swapper/022:40:580
81479912579,38cyclictest0-21swapper/121:56:281
962121170,20sleep1291rcuc/121:40:581
81479910755,46cyclictest22692-21ssh22:01:301
7987210513,60sleep18011-21munin-run18:55:551
795521056,15sleep00-21swapper/018:55:290
81429910381,16cyclictest26241-21latency_hist19:50:590
814799972,27cyclictest29693-21apt20:00:551
8147999648,41cyclictest4710-21ls21:31:311
8142999674,13cyclictest2374-21systemd-journal22:15:060
8155999375,9cyclictest0-21swapper/200:25:562
8142999377,10cyclictest16441-21ssh20:56:400
814799913,30cyclictest9864-21cpuspeed21:41:121
814799912,41cyclictest19911-21sed23:46:211
814799912,35cyclictest7853-21ntpq22:31:241
8147999024,50cyclictest0-21swapper/122:21:051
8147999024,50cyclictest0-21swapper/122:21:051
8142999063,8cyclictest181rcu_preempt19:31:280
8142999058,9cyclictest181rcu_preempt20:00:570
8155998952,27cyclictest27293-21kworker/u19:1+nfsiod22:26:162
8147998952,30cyclictest30126-21kworker/u17:3-xprtiod23:21:301
8147998952,30cyclictest30126-21kworker/u17:3-xprtiod23:21:301
814799893,53cyclictest28564-21apt-get00:01:101
814799893,36cyclictest352-21runrttasks22:08:051
814799884,27cyclictest2861-21head00:11:341
814799883,26cyclictest24423-21ssh23:54:101
8142998760,15cyclictest0-21swapper/022:06:300
8147998659,18cyclictest758-21ssh22:20:141
814799863,36cyclictest26682-21latency_hist19:51:001
814799862,42cyclictest8125-21if_eth000:21:191
814799862,38cyclictest1272-21munin-run23:15:541
8142998666,14cyclictest24572-21sh23:00:170
8142998666,14cyclictest24572-21sh23:00:170
8142998633,12cyclictest181rcu_preempt22:46:150
8155998557,20cyclictest18765-21kernelversion21:01:242
8155998557,20cyclictest18765-21kernelversion21:01:242
8147998558,19cyclictest15571-21kernelversion19:16:221
814799853,37cyclictest28821-21ssh21:17:381
814799853,37cyclictest12109-21grep20:46:121
814799853,36cyclictest30226-21fschecks_time20:01:171
814799853,36cyclictest30226-21fschecks_time20:01:171
814799853,36cyclictest17297-21ntp_kernel_err19:21:231
814799853,26cyclictest8540-21modprobe20:35:551
8147998519,44cyclictest10812-21seq19:01:241
8147998515,28cyclictest21542-21seq22:55:061
8147998513,31cyclictest1568-21sort00:10:571
8147998513,31cyclictest1568-21sort00:10:571
8155998462,11cyclictest0-21swapper/218:56:222
8155998450,20cyclictest25949-21kworker/u17:3-xprtiod20:59:092
814799843,28cyclictest1475-21switchtime20:11:291
8147998430,43cyclictest0-21swapper/121:06:501
814799842,40cyclictest5099-21/usr/sbin/munin22:26:291
814299845,24cyclictest18924-21apt-get21:56:280
8155998358,18cyclictest8129-21cyclictest22:31:182
814799833,34cyclictest9517-21switchtime20:36:281
814799833,34cyclictest9517-21switchtime20:36:281
814799833,30cyclictest13871-21cut20:51:151
814799833,30cyclictest13871-21cut20:51:151
8142998352,24cyclictest0-21swapper/023:01:310
814799829,30cyclictest855-21/usr/sbin/munin21:26:321
814799824,34cyclictest28147-21apt-key00:00:581
814799823,37cyclictest15320-21/usr/sbin/munin20:56:381
814799823,37cyclictest11397-21unixbench_singl20:41:331
814799823,36cyclictest9781-21cat19:00:581
814799823,36cyclictest18049-21ssh23:42:591
814799823,29cyclictest13086-21grep21:46:191
814799823,24cyclictest24078-21chrt19:41:321
8147998227,47cyclictest0-21swapper/123:39:391
8142998260,8cyclictest181rcu_preempt22:51:150
8142998260,15cyclictest10628-21latency_hist00:25:570
8155998166,10cyclictest8129-21cyclictest23:00:162
8155998166,10cyclictest8129-21cyclictest23:00:162
8155998165,9cyclictest0-21swapper/223:46:302
8155998148,24cyclictest7543-21cat00:20:572
8155998140,12cyclictest181rcu_preempt20:11:302
8155998137,14cyclictest181rcu_preempt19:46:232
8155998130,11cyclictest181rcu_preempt22:46:142
814799813,38cyclictest19025-21processes21:01:311
814799813,38cyclictest19025-21processes21:01:311
814799813,33cyclictest12387-21latency19:06:201
814799813,28cyclictest1-21systemd21:25:561
814799813,27cyclictest14230-21grep22:41:331
814799813,26cyclictest4698-21switchtime20:21:291
814799813,25cyclictest3694-21latency_hist20:20:581
814799812,26cyclictest18810-21apt-key21:55:591
814799812,25cyclictest11197-21sort22:36:311
8142998163,9cyclictest0-21swapper/021:36:330
8142998138,13cyclictest27293-21kworker/u19:1-rpciod23:06:220
8142998138,13cyclictest27293-21kworker/u19:1-rpciod23:06:220
8142998133,10cyclictest0-21swapper/021:35:540
8155998064,9cyclictest0-21swapper/221:16:342
814799803,38cyclictest1776-21df_inode23:16:141
814799803,36cyclictest7767-21fschecks_count23:26:171
814799803,29cyclictest16533-21fschecks_time22:46:211
8147998027,44cyclictest0-21swapper/122:56:181
8147998027,44cyclictest0-21swapper/122:56:181
8142998062,12cyclictest10834-21fschecks_time23:31:170
8142998060,9cyclictest0-21swapper/021:41:290
8142998057,16cyclictest1099-21latency_hist22:20:570
8142998047,15cyclictest181rcu_preempt19:51:340
8142998039,8cyclictest181rcu_preempt20:10:570
8155997958,15cyclictest544-21cron21:50:552
8155997954,9cyclictest181rcu_preempt20:26:072
814799793,35cyclictest4731-21/usr/sbin/munin00:16:331
814799793,26cyclictest24319-21/usr/sbin/munin21:11:231
814799793,26cyclictest24319-21/usr/sbin/munin21:11:231
814799793,23cyclictest14529-21tail19:11:321
814799793,22cyclictest26960-21fschecks_count19:51:341
814799793,20cyclictest22986-21modprobe19:40:551
8142997966,9cyclictest8129-21cyclictest19:30:540
8142997966,9cyclictest8129-21cyclictest19:30:540
8142997953,20cyclictest28601-21ssh00:01:110
814799783,27cyclictest32575-21taskset20:06:321
814799783,26cyclictest352-21runrttasks19:30:591
814799783,22cyclictest28673-21ssh23:06:231
814799783,22cyclictest28673-21ssh23:06:231
814799782,25cyclictest6440-21timerwakeupswit20:26:301
814799782,24cyclictest18895-21taskset19:26:221
814799782,24cyclictest18895-21taskset19:26:221
8142997855,12cyclictest0-21swapper/019:06:160
8142997853,11cyclictest181rcu_preempt21:21:490
8155997751,8cyclictest181rcu_preempt21:26:312
814799773,33cyclictest27834-21/usr/sbin/munin22:11:181
814799773,27cyclictest25765-21chrt23:01:281
814799773,26cyclictest10596-21ssh23:31:101
8142997763,9cyclictest7194-21cron23:25:550
8142997763,9cyclictest7194-21cron23:25:550
8142997761,10cyclictest15025-21diskmemload21:04:230
8142997761,10cyclictest15025-21diskmemload21:04:230
8142997760,8cyclictest0-21swapper/019:05:570
8142997757,8cyclictest181rcu_preempt21:26:130
8142997750,11cyclictest181rcu_preempt22:41:290
8155997657,13cyclictest15944-21ssh22:45:572
8155997636,15cyclictest13790-21kworker/u19:2-events_unbound20:41:202
8142997652,9cyclictest181rcu_preempt23:26:110
8142997648,8cyclictest181rcu_preempt20:31:280
8155997559,10cyclictest7129-21fschecks_time21:36:192
8155997556,13cyclictest31072-21latency_hist00:05:572
8155997555,14cyclictest2186-21timerandwakeup22:21:302
8155997555,14cyclictest2186-21timerandwakeup22:21:302
8155997555,13cyclictest17615-21kworker/u17:0-rpciod22:51:352
8155997540,8cyclictest181rcu_preempt22:16:112
8155997527,12cyclictest181rcu_preempt20:21:232
8142997559,8cyclictest0-21swapper/020:01:160
8142997559,8cyclictest0-21swapper/020:01:160
8142997556,9cyclictest0-21swapper/019:21:320
8142997556,7cyclictest181rcu_preempt21:11:330
8142997556,7cyclictest181rcu_preempt21:11:330
8142997556,12cyclictest1-21systemd21:50:560
8142997555,7cyclictest181rcu_preempt23:41:310
8142997551,15cyclictest2374-21systemd-journal22:04:070
8142997547,8cyclictest181rcu_preempt19:16:320
8155997460,9cyclictest39-21ksoftirqd/219:25:272
8155997457,9cyclictest0-21swapper/200:10:582
8155997457,9cyclictest0-21swapper/200:10:582
8155997455,9cyclictest0-21swapper/223:05:572
8155997452,15cyclictest15012-21sh20:55:552
8155997452,15cyclictest15012-21sh20:55:552
8155997433,8cyclictest181rcu_preempt20:01:192
8155997433,8cyclictest181rcu_preempt20:01:192
8142997459,11cyclictest8129-21cyclictest00:15:420
8142997459,10cyclictest25336-21ssh23:56:020
8142997455,13cyclictest4439-21cstates22:26:120
8142997448,11cyclictest181rcu_preempt23:15:520
8142997435,11cyclictest181rcu_preempt21:10:570
814299743,45cyclictest728-21/usr/sbin/munin20:11:170
815599735,34cyclictest2641-21grep23:16:332
8155997352,15cyclictest15971-21fschecks_count21:51:172
8155997252,14cyclictest24560-21idleruntime-cro22:05:542
8155997251,15cyclictest16633-21sh23:41:142
815599724,27cyclictest24020-21munin-run21:10:552
8142997259,7cyclictest0-21swapper/020:30:590
8142997258,10cyclictest8129-21cyclictest23:48:030
8142997258,10cyclictest28766-21kworker/u18:0-rpciod23:36:160
8142997255,11cyclictest3088-21ssh23:17:400
8142997247,8cyclictest181rcu_preempt00:16:290
8155997155,10cyclictest18969-21ntp_offset19:26:232
8155997155,10cyclictest18969-21ntp_offset19:26:232
8155997154,11cyclictest4440-21ntp_offset21:31:252
8142997135,8cyclictest181rcu_preempt00:08:210
8142997135,8cyclictest181rcu_preempt00:08:210
8142997057,7cyclictest0-21swapper/020:51:300
8142997057,7cyclictest0-21swapper/020:51:300
8142997055,10cyclictest8129-21cyclictest22:21:520
8142997055,10cyclictest8129-21cyclictest22:21:520
8142997054,11cyclictest8129-21cyclictest20:45:580
8142997050,9cyclictest0-21swapper/021:51:330
8142997032,28cyclictest13391-21cron20:50:550
814299703,15cyclictest2355-21apt-get20:16:100
8155996953,10cyclictest15060-21kworker/u17:2-rpciod23:53:262
815599692,58cyclictest22229-21grep19:36:262
8142996942,21cyclictest27945-21ntp_offset21:16:250
8155996852,10cyclictest8139-21ntp_kernel_pll_23:26:242
815599683,49cyclictest647-21latency_hist21:25:582
8155996832,9cyclictest31223-21cstates23:11:132
8155996832,11cyclictest181rcu_preempt23:07:342
8155996832,11cyclictest181rcu_preempt23:07:342
8155996820,20cyclictest28188-21apt-config00:00:572
8142996827,10cyclictest0-21swapper/019:11:300
667526810,35sleep26665-21apt-get18:51:112
815599674,33cyclictest2615-21fschecks_time20:16:172
8155996740,10cyclictest181rcu_preempt22:15:022
815599673,47cyclictest352-21runrttasks19:41:382
815599673,47cyclictest16595-21latency_hist19:20:572
815599672,45cyclictest15065-21latency_hist19:15:582
8142996718,16cyclictest10260-21kworker/0:1-events23:53:400
816299662,34cyclictest190352sleep321:56:253
8155996650,9cyclictest0-21swapper/221:41:182
8155996649,12cyclictest9704-21unixbench_multi20:36:302
8155996649,12cyclictest9704-21unixbench_multi20:36:302
815599664,45cyclictest352-21runrttasks00:12:092
8155996629,11cyclictest181rcu_preempt19:01:332
814299663,36cyclictest7438-21ssh22:31:120
814299663,32cyclictest9081-21fschecks_time20:36:170
814299663,32cyclictest9081-21fschecks_time20:36:170
8155996550,10cyclictest8129-21cyclictest19:31:182
8155996547,12cyclictest32635-21sshd20:07:072
8155996543,16cyclictest0-21swapper/221:11:182
8155996543,16cyclictest0-21swapper/221:11:182
8155996537,7cyclictest181rcu_preempt23:40:102
815599653,50cyclictest26742-21apt-get19:51:182
8155996524,33cyclictest19643-21if_err_eth021:57:172
8142996549,9cyclictest0-21swapper/019:00:590
8142996426,9cyclictest181rcu_preempt20:25:550
8155996347,10cyclictest277-21dbus-daemon23:25:562
8155996347,10cyclictest277-21dbus-daemon23:25:562
815599633,44cyclictest7438-21fschecks_time20:31:162
815599633,44cyclictest28456-21cstates19:56:122
8155996333,21cyclictest12945-21grep20:46:322
8155996331,23cyclictest10827-21grep23:31:162
815599632,40cyclictest12724-21switchtime19:06:292
814299633,44cyclictest22600-21unixbench_singl19:36:310
815599623,36cyclictest10225-21/usr/sbin/munin22:36:302
815599614,38cyclictest24867-21/usr/sbin/munin22:06:282
814299603,40cyclictest23245-21/usr/sbin/munin19:41:200
816299562,32cyclictest917-21kworker/3:1+events20:00:553
756225519,21sleep30-21swapper/318:51:413
816299532,25cyclictest917-21kworker/3:1+events20:46:083
321332530,9sleep30-21swapper/320:06:253
816299523,36cyclictest0-21swapper/300:01:103
816299513,36cyclictest21662-21chrt19:36:073
816299503,35cyclictest8584-21taskset18:56:173
816299503,30cyclictest2896-21chrt23:17:063
816299496,31cyclictest21172-21taskset23:48:193
816299494,33cyclictest15007-21taskset23:37:453
816299493,34cyclictest8738-21chrt00:21:323
816299493,34cyclictest16722-21taskset23:41:183
816299493,28cyclictest30683-21chrt22:15:583
816299483,32cyclictest4933-21taskset00:16:133
816299483,32cyclictest14562-21chrt20:51:303
816299483,32cyclictest14562-21chrt20:51:303
816299483,31cyclictest30968-21chrt23:10:583
816299483,31cyclictest30968-21chrt23:10:583
816299482,34cyclictest14987-21chrt22:43:263
8162994814,23cyclictest22417-21chrt21:06:343
816299474,30cyclictest19362-21chrt19:26:313
816299474,30cyclictest19362-21chrt19:26:313
816299473,33cyclictest6371-21taskset22:29:163
816299473,32cyclictest3068-21chrt21:29:413
816299473,32cyclictest30437-21taskset21:21:133
816299473,32cyclictest25739-21taskset23:01:263
816299473,32cyclictest18914-21taskset21:01:273
816299473,32cyclictest18914-21taskset21:01:273
816299473,32cyclictest10485-21taskset20:41:133
816299473,30cyclictest27666-21chrt21:16:193
816299473,26cyclictest0-21swapper/319:51:103
816299472,32cyclictest3838-21taskset21:31:073
816299472,30cyclictest24969-21taskset21:11:283
816299472,30cyclictest24969-21taskset21:11:283
816299463,32cyclictest7385-21taskset23:25:583
816299463,32cyclictest7385-21taskset23:25:583
816299463,32cyclictest25792-21chrt22:06:303
816299463,32cyclictest19230-21chrt22:51:123
816299463,32cyclictest11033-21chrt22:36:293
816299463,31cyclictest12273-21chrt19:06:173
816299455,29cyclictest8546-21chrt22:31:593
816299453,32cyclictest25169-21chrt23:55:573
816299453,31cyclictest22428-21taskset22:01:233
816299453,31cyclictest20262-21chrt19:31:173
816299453,31cyclictest10762-21chrt21:41:333
816299453,30cyclictest7892-21chrt20:31:283
816299453,30cyclictest1002-21chrt00:09:363
816299453,30cyclictest1002-21chrt00:09:363
816299453,29cyclictest1769-21taskset00:11:063
816299453,27cyclictest888-21taskset23:14:513
816299452,30cyclictest6092-21chrt20:26:223
816299452,27cyclictest15296-21taskset19:16:143
816299443,31cyclictest10510-21chrt23:31:043
816299443,30cyclictest27031-21chrt23:58:083
816299443,29cyclictest23649-21taskset19:41:213
816299443,29cyclictest16020-21chrt21:51:183
816299443,29cyclictest1324-21chrt22:21:053
816299443,29cyclictest1324-21chrt22:21:053
816299443,28cyclictest8826-21taskset20:36:103
816299443,28cyclictest8826-21taskset20:36:103
816299442,33cyclictest8247-21taskset21:37:313
816299442,31cyclictest10602-21chrt19:01:193
816299433,32cyclictest18387-21taskset22:49:343
816299433,30cyclictest24882-21taskset23:00:573
816299433,30cyclictest24882-21taskset23:00:573
816299433,30cyclictest14119-21chrt19:11:243
816299433,28cyclictest15350-21taskset20:56:073
816299433,27cyclictest25828-21taskset19:46:323
816299433,27cyclictest1103-21taskset22:20:573
816299432,30cyclictest7578-21chrt23:26:103
816299423,28cyclictest2808-21chrt20:16:213
816299423,25cyclictest16819-21taskset19:21:083
816299422,29cyclictest29963-21chrt20:01:063
816299422,29cyclictest29963-21chrt20:01:063
816299422,28cyclictest4311-21chrt20:21:203
816299414,28cyclictest13618-21chrt21:46:313
816299382,26cyclictest757-21chrt20:11:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional