You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 04:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed May 27, 2026 00:45:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2843625030,3sleep00-21swapper/019:10:180
2843625030,3sleep00-21swapper/019:10:180
2653621200,3chrt0-21swapper/222:50:192
2653621200,3chrt0-21swapper/222:50:192
2407621100,3chrt0-21swapper/222:46:052
1970721040,3sleep20-21swapper/220:15:262
1970721040,3sleep20-21swapper/220:15:262
2465521010,4sleep20-21swapper/221:31:012
2465521010,4sleep20-21swapper/221:31:012
257762930,9sleep012-21ksoftirqd/022:10:260
257762930,9sleep012-21ksoftirqd/022:10:260
257762930,9sleep012-21ksoftirqd/022:10:260
117162900,3sleep30-21swapper/323:10:293
117162900,3sleep30-21swapper/323:10:293
52132860,3sleep00-21swapper/023:41:000
52132860,3sleep00-21swapper/023:41:000
315662830,4sleep00-21swapper/000:11:350
315662830,4sleep00-21swapper/000:11:350
315662830,4sleep00-21swapper/000:11:350
312502820,3sleep20-21swapper/222:17:352
312502820,3sleep20-21swapper/222:17:352
94262790,3sleep20-21swapper/221:51:432
94262790,3sleep20-21swapper/221:51:432
69362790,3chrt0-21swapper/221:10:272
69362790,3chrt0-21swapper/221:10:272
3852790,3sleep20-21swapper/222:57:342
3852790,3sleep20-21swapper/222:57:342
218952780,3sleep00-21swapper/000:38:360
52692770,3sleep00-21swapper/021:47:390
52692770,3sleep00-21swapper/021:47:390
173612730,4chrt0-21swapper/022:00:210
173612730,4chrt0-21swapper/022:00:210
289372700,2sleep30-21swapper/300:09:093
289372700,2sleep30-21swapper/300:09:093
289372700,2sleep30-21swapper/300:09:093
270522670,3chrt0-21swapper/320:35:283
168712670,3sleep00-21swapper/000:33:130
168712670,3sleep00-21swapper/000:33:130
67732660,3sleep10-21swapper/100:20:521
67732660,3sleep10-21swapper/100:20:521
67732660,3sleep10-21swapper/100:20:521
48482640,3chrt0-21swapper/200:19:452
48482640,3chrt0-21swapper/200:19:452
104062590,2chrt0-21swapper/023:47:480
104062590,2chrt0-21swapper/023:47:480
262032560,2sleep226211-21ssh23:27:052
262032560,2sleep226211-21ssh23:27:052
85362550,3sleep30-21swapper/323:45:253
85362550,3sleep30-21swapper/323:45:253
230122550,3sleep00-21swapper/022:07:040
230122550,3sleep00-21swapper/022:07:040
37772540,3sleep30-21swapper/300:17:453
37772540,3sleep30-21swapper/300:17:453
215622530,3sleep20-21swapper/222:05:222
215622530,3sleep20-21swapper/222:05:222
288082490,3sleep10-21swapper/100:08:551
288082490,3sleep10-21swapper/100:08:551
288082490,3sleep10-21swapper/100:08:551
25232490,3sleep02519-21grep00:15:290
25232490,3sleep02519-21grep00:15:290
130812480,2sleep10-21swapper/122:34:301
130812480,2sleep10-21swapper/122:34:301
59892470,4sleep30-21swapper/321:10:173
59892470,4sleep30-21swapper/321:10:173
306822470,3chrt0-21swapper/123:32:581
306822470,3chrt0-21swapper/123:32:581
306822470,3chrt0-21swapper/123:32:581
295122470,5sleep227-21ksoftirqd/200:10:082
295122470,5sleep227-21ksoftirqd/200:10:082
295122470,5sleep227-21ksoftirqd/200:10:082
23302460,3sleep10-21swapper/122:21:401
23302460,3sleep10-21swapper/122:21:401
23302460,3sleep10-21swapper/122:21:401
39912450,4chrt0-21swapper/323:01:453
39912450,4chrt0-21swapper/323:01:453
39912450,4chrt0-21swapper/323:01:453
29550994510,30cyclictest21661-21ssh00:00:102
29550994510,30cyclictest21661-21ssh00:00:102
29550994510,30cyclictest21661-21ssh00:00:102
203522430,3chrt0-21swapper/122:04:321
203522430,3chrt0-21swapper/122:04:321
180242430,2chrt0-21swapper/323:55:263
180242430,2chrt0-21swapper/323:55:263
180242430,2chrt0-21swapper/323:55:263
153592430,3chrt0-21swapper/222:35:562
153592430,3chrt0-21swapper/222:35:562
2955099412,31cyclictest23269-21ssh00:00:572
2955099412,31cyclictest23269-21ssh00:00:572
2955099412,31cyclictest23269-21ssh00:00:572
228352410,3sleep00-21swapper/021:30:030
228352410,3sleep00-21swapper/021:30:030
2954899403,28cyclictest21691-21ssh00:00:110
2954899403,28cyclictest21691-21ssh00:00:110
2954899403,28cyclictest21691-21ssh00:00:110
166322390,4sleep30-21swapper/300:32:523
166322390,4sleep30-21swapper/300:32:523
157652380,3sleep20-21swapper/223:53:402
157652380,3sleep20-21swapper/223:53:402
114142380,3sleep30-21swapper/300:27:053
301202370,3sleep20-21swapper/200:10:202
301202370,3sleep20-21swapper/200:10:202
301202370,3sleep20-21swapper/200:10:202
2954999371,7cyclictest18890-21cat22:40:191
2954999371,7cyclictest18890-21cat22:40:191
2954999371,7cyclictest18890-21cat22:40:191
2954999370,7cyclictest6844-21ssh22:27:191
141992370,3sleep00-21swapper/023:51:250
141992370,3sleep00-21swapper/023:51:250
2954999362,5cyclictest21599-40mandb00:00:111
2954999362,5cyclictest21599-40mandb00:00:111
2954999362,5cyclictest21599-40mandb00:00:111
2954999361,9cyclictest30200-21ntp_states20:45:241
2954999361,9cyclictest30200-21ntp_states20:45:241
2954999361,9cyclictest23845-21latency_hist23:25:051
2954999361,9cyclictest23845-21latency_hist23:25:051
2954999361,9cyclictest23845-21latency_hist23:25:051
2954999361,7cyclictest19587-21ssh23:19:471
2954999361,6cyclictest30145-21uname00:10:211
2954999361,6cyclictest30145-21uname00:10:211
2954999361,6cyclictest30145-21uname00:10:211
2954999361,4cyclictest14287-21memory22:35:201
2954999361,4cyclictest14287-21memory22:35:201
2954999361,10cyclictest12207-21irqstats19:55:191
2954999361,10cyclictest12207-21irqstats19:55:191
285372360,4sleep333-21ksoftirqd/321:35:523
285372360,4sleep333-21ksoftirqd/321:35:523
285372360,4sleep333-21ksoftirqd/321:35:523
188912360,4sleep30-21swapper/322:40:193
188912360,4sleep30-21swapper/322:40:193
188912360,4sleep30-21swapper/322:40:193
44482350,2sleep20-21swapper/223:02:362
44482350,2sleep20-21swapper/223:02:362
44482350,2sleep20-21swapper/223:02:362
2954999358,24cyclictest14770-21ssh23:14:451
2954999358,24cyclictest14770-21ssh23:14:451
2954999351,9cyclictest6245-21grep21:10:191
2954999351,9cyclictest6245-21grep21:10:191
2954999351,8cyclictest21072-21if_err_eth020:20:211
2954999351,8cyclictest21072-21if_err_eth020:20:211
2954999351,8cyclictest21072-21if_err_eth020:20:211
2954999351,7cyclictest3673-21pluginstate19:30:241
2954999351,7cyclictest3673-21pluginstate19:30:241
2954999351,7cyclictest3253850ssh21:40:511
2954999351,7cyclictest3253850ssh21:40:511
2954999351,12cyclictest27062-21/usr/sbin/munin21:35:311
2954999351,12cyclictest27062-21/usr/sbin/munin21:35:311
2954999351,12cyclictest27062-21/usr/sbin/munin21:35:311
2954999350,9cyclictest4929-21awk23:40:281
2954999350,9cyclictest4929-21awk23:40:281
2954999350,4cyclictest21599-40mandb00:00:341
2954999350,4cyclictest21599-40mandb00:00:341
2954999350,4cyclictest21599-40mandb00:00:341
2954999350,10cyclictest31172-21ntp_states22:55:241
2954999350,10cyclictest31172-21ntp_states22:55:241
62732340,3sleep20-21swapper/223:42:592
62732340,3sleep20-21swapper/223:42:592
2954999341,9cyclictest25645-21ssh23:26:011
2954999341,9cyclictest25645-21ssh23:26:011
2954999341,9cyclictest16025-21ntp_kernel_pll_20:05:231
2954999341,9cyclictest16025-21ntp_kernel_pll_20:05:231
2954999341,9cyclictest16025-21ntp_kernel_pll_20:05:231
2954999341,8cyclictest1807-21needreboot19:25:211
2954999341,8cyclictest1807-21needreboot19:25:211
2954999341,8cyclictest1807-21needreboot19:25:211
2954999341,7cyclictest8056-21ps21:50:261
2954999341,7cyclictest8056-21ps21:50:261
2954999341,6cyclictest2533-21cpuspeed21:00:181
2954999341,6cyclictest2533-21cpuspeed21:00:181
2954999341,5cyclictest17774-21netstat20:10:231
2954999341,5cyclictest17774-21netstat20:10:231
2954999341,4cyclictest26855-21switchtime20:35:271
2954999341,29cyclictest31772-21latency_hist19:20:081
2954999341,29cyclictest31772-21latency_hist19:20:081
2954999341,10cyclictest22793-21grep20:25:191
2954999341,10cyclictest22793-21grep20:25:191
2954999341,10cyclictest22793-21grep20:25:191
2954999338,22cyclictest1312-21/usr/sbin/munin00:15:241
2954999338,22cyclictest1312-21/usr/sbin/munin00:15:241
2954999337,22cyclictest5079-21grep21:05:271
2954999337,22cyclictest5079-21grep21:05:271
2954999337,22cyclictest5079-21grep21:05:271
2954999331,8cyclictest3871-21fschecks_count23:40:171
2954999331,8cyclictest3871-21fschecks_count23:40:171
2954999331,8cyclictest32289-21irqstats19:20:201
2954999331,8cyclictest32289-21irqstats19:20:201
2954999331,8cyclictest31955-21ntpq20:50:241
2954999331,8cyclictest21572-21grep22:05:221
2954999331,8cyclictest21572-21grep22:05:221
2954999331,8cyclictest20079-21taskset00:35:581
2954999331,8cyclictest12378-21perl21:55:181
2954999331,7cyclictest27202-21ssh22:50:261
2954999331,7cyclictest27202-21ssh22:50:261
2954999331,7cyclictest27202-21ssh22:50:261
2954999331,7cyclictest24294-21sed21:30:291
2954999331,7cyclictest24294-21sed21:30:291
2954999331,7cyclictest23236-21proc_pri22:45:251
2954999331,7cyclictest23236-21proc_pri22:45:251
2954999331,7cyclictest23236-21proc_pri22:45:251
2954999331,7cyclictest10874-21ssh21:15:221
2954999331,7cyclictest10874-21ssh21:15:221
2954999331,6cyclictest10250-21expr00:25:251
2954999331,5cyclictest6665-21df_inode19:40:171
2954999331,5cyclictest6665-21df_inode19:40:171
2954999331,5cyclictest10551-21memory19:50:211
2954999331,5cyclictest10551-21memory19:50:211
2954999330,8cyclictest6825-21runrttasks23:05:261
2954999330,8cyclictest6825-21runrttasks23:05:261
2954999330,8cyclictest25405-21missed_timers22:10:211
2954999330,8cyclictest25405-21missed_timers22:10:211
2954999330,8cyclictest25405-21missed_timers22:10:211
2954999330,6cyclictest19515-21netstat20:15:231
2954999330,6cyclictest19515-21netstat20:15:231
2954899332,27cyclictest22259-21ssh00:00:230
2954899332,27cyclictest22259-21ssh00:00:230
2954899332,27cyclictest22259-21ssh00:00:230
172232330,3sleep30-21swapper/323:16:243
161732330,2sleep016187-21ssh21:59:300
14812330,2sleep01488-21rm21:43:260
14812330,2sleep01488-21rm21:43:260
48782320,2sleep30-21swapper/319:35:163
48782320,2sleep30-21swapper/319:35:163
2954999322,7cyclictest1156-21missed_timers20:55:211
2954999322,7cyclictest1156-21missed_timers20:55:211
2954999322,6cyclictest19938-21find21:25:251
2954999322,6cyclictest19938-21find21:25:251
2954999321,9cyclictest8931-21ntp_states19:45:211
2954999321,9cyclictest8931-21ntp_states19:45:211
2954999321,8cyclictest4995-21fschecks_time19:35:181
2954999321,8cyclictest4995-21fschecks_time19:35:181
2954999321,8cyclictest3735-21unixbench-2d21:45:271
2954999321,8cyclictest3735-21unixbench-2d21:45:271
2954999321,8cyclictest27804-21/usr/sbin/munin20:40:261
2954999321,8cyclictest27804-21/usr/sbin/munin20:40:261
2954999321,8cyclictest24868-21ntpq20:30:241
2954999321,7cyclictest817-21runrttasks22:20:131
2954999321,7cyclictest817-21runrttasks22:20:131
2954999321,7cyclictest2756-21ntpq23:00:241
2954999321,7cyclictest2756-21ntpq23:00:241
2954999321,7cyclictest2756-21ntpq23:00:241
2954999321,7cyclictest17603-21rm00:34:171
2954999321,7cyclictest17603-21rm00:34:171
2954999321,10cyclictest12550-21ssh23:50:191
2954999321,10cyclictest12550-21ssh23:50:191
2954999320,8cyclictest15283-21fschecks_count21:20:181
2954999320,8cyclictest15283-21fschecks_count21:20:181
2954999320,8cyclictest15283-21fschecks_count21:20:181
206722320,2sleep020676-21sh22:42:100
206722320,2sleep020676-21sh22:42:100
206722320,2sleep020676-21sh22:42:100
195362320,3chrt19509-21ssh00:35:282
2954999311,8cyclictest7639-21/usr/sbin/munin23:45:251
2954999311,8cyclictest7639-21/usr/sbin/munin23:45:251
250782310,3sleep00-21swapper/020:30:270
2954999301,7cyclictest13946-21cut20:00:191
2954999301,7cyclictest13946-21cut20:00:191
2954999301,7cyclictest13946-21cut20:00:191
294982303,18sleep128123-21ls19:10:361
294982303,18sleep128123-21ls19:10:361
294922305,15sleep20-21swapper/219:10:332
294922305,15sleep20-21swapper/219:10:332
107612300,4sleep30-21swapper/321:53:373
107612300,4sleep30-21swapper/321:53:373
20742290,3sleep30-21swapper/323:37:383
20742290,3sleep30-21swapper/323:37:383
268762280,3sleep30-21swapper/322:11:533
268762280,3sleep30-21swapper/322:11:533
268762280,3sleep30-21swapper/322:11:533
224482280,4chrt0-21swapper/300:00:253
224482280,4chrt0-21swapper/300:00:253
224482280,4chrt0-21swapper/300:00:253
29550992714,10cyclictest10317-21ssh22:30:282
29550992714,10cyclictest10317-21ssh22:30:282
190392270,2sleep219214-21fschecks_time20:15:192
190392270,2sleep219214-21fschecks_time20:15:192
199642260,3sleep00-21swapper/023:20:110
57242250,3sleep20-21swapper/222:25:352
29550992513,10cyclictest31171-21df_inode21:40:162
29550992513,10cyclictest31171-21df_inode21:40:162
29550992513,10cyclictest31171-21df_inode21:40:162
2954899252,20cyclictest28575-21ssh23:30:200
2954899252,20cyclictest28575-21ssh23:30:200
2954899252,20cyclictest28575-21ssh23:30:200
2954899251,3cyclictest0-21swapper/022:22:460
2954899251,3cyclictest0-21swapper/022:22:460
2954899251,3cyclictest0-21swapper/022:22:460
2954899251,20cyclictest9910-21ssh22:30:250
2954899251,20cyclictest9910-21ssh22:30:250
54122240,3sleep20-21swapper/219:35:232
54122240,3sleep20-21swapper/219:35:232
2954899242,19cyclictest9482-21grep00:25:170
2954899242,19cyclictest9482-21grep00:25:170
2955099231,18cyclictest8385-21/usr/sbin/munin19:45:152
2955099231,18cyclictest8385-21/usr/sbin/munin19:45:152
2955099231,18cyclictest10209-21ls00:25:242
2954899239,4cyclictest20698-21needreboot23:20:220
2954899239,4cyclictest20698-21needreboot23:20:220
2954899239,4cyclictest20698-21needreboot23:20:220
29548992317,4cyclictest7827-21ssh23:06:280
29548992317,4cyclictest7827-21ssh23:06:280
2954899231,19cyclictest3943-21fschecks_time23:40:180
45402220,19sleep04548-21ssh23:02:470
45402220,19sleep04548-21ssh23:02:470
45402220,19sleep04548-21ssh23:02:470
29550992213,7cyclictest674-21snmpd19:46:032
29550992213,7cyclictest674-21snmpd19:46:032
2955099221,17cyclictest15723-21ls20:05:202
2955099221,17cyclictest15723-21ls20:05:202
2955099221,17cyclictest15723-21ls20:05:202
29550992210,10cyclictest5909-21gzip00:20:222
29550992210,10cyclictest5909-21gzip00:20:222
29550992210,10cyclictest5909-21gzip00:20:222
2954899222,12cyclictest10992-21sh21:53:560
2954899222,12cyclictest10992-21sh21:53:560
2954899222,11cyclictest849-21grep23:35:280
29548992213,7cyclictest16244-21ssh22:37:130
29548992213,7cyclictest16244-21ssh22:37:130
2954899221,19cyclictest29805-21ls22:15:260
2954899221,19cyclictest29805-21ls22:15:260
2954899221,15cyclictest29779-21grep20:45:190
2954899221,15cyclictest29779-21grep20:45:190
2954899220,12cyclictest28207-21grep21:35:290
2954899220,12cyclictest28207-21grep21:35:290
2954899220,12cyclictest28207-21grep21:35:290
295052223,11sleep30-21swapper/319:10:423
295052223,11sleep30-21swapper/319:10:423
2955199218,9cyclictest8531-21chrt21:12:543
2955199218,9cyclictest8531-21chrt21:12:543
2955199216,11cyclictest30843-21chrt20:46:493
2955199216,11cyclictest30843-21chrt20:46:493
2955099212,3cyclictest131rcu_preempt23:08:392
2955099212,3cyclictest131rcu_preempt23:08:392
29550992113,5cyclictest20831-21ssh22:42:282
29550992113,5cyclictest20831-21ssh22:42:282
29550992113,5cyclictest20831-21ssh22:42:282
29550992110,8cyclictest5754-21diskmemload22:51:052
29550992110,8cyclictest5754-21diskmemload22:51:052
29550992110,8cyclictest5754-21diskmemload22:51:052
2954899215,6cyclictest6851-21sendmail_mailqu21:10:270
2954899215,6cyclictest6851-21sendmail_mailqu21:10:270
29548992115,3cyclictest24427-21ssh23:25:190
29548992115,3cyclictest24427-21ssh23:25:190
2954899211,17cyclictest4716-21missed_timers21:05:220
2954899211,17cyclictest4716-21missed_timers21:05:220
2954899211,17cyclictest4716-21missed_timers21:05:220
2954899211,17cyclictest10123-21sendmail_mailtr00:25:240
2954899211,15cyclictest17603-21ls20:10:200
2954899211,15cyclictest17603-21ls20:10:200
2955199207,10cyclictest3892-21chrt21:03:533
2955199207,10cyclictest3892-21chrt21:03:533
2955199206,10cyclictest672-21chrt19:20:583
2955199206,10cyclictest672-21chrt19:20:583
2955199206,10cyclictest31389-21chrt23:34:163
2955199206,10cyclictest31389-21chrt23:34:163
2955199206,10cyclictest31389-21chrt23:34:163
2955199201,12cyclictest0-21swapper/322:35:193
2955199201,12cyclictest0-21swapper/322:35:193
2955199201,12cyclictest0-21swapper/322:20:293
2955199201,12cyclictest0-21swapper/322:20:293
2955199201,12cyclictest0-21swapper/322:20:293
2955099207,10cyclictest27558-21cron20:40:062
2955099207,10cyclictest18872-21latency_hist21:25:062
2955099207,10cyclictest18872-21latency_hist21:25:062
2955099207,10cyclictest18872-21latency_hist21:25:062
29550992013,5cyclictest5754-21diskmemload22:23:042
29550992013,5cyclictest5754-21diskmemload22:23:042
29550992013,5cyclictest5754-21diskmemload22:23:042
29550992013,5cyclictest31179-21ssh23:33:532
29550992013,5cyclictest31179-21ssh23:33:532
29550992013,5cyclictest31179-21ssh23:33:532
29550992012,6cyclictest1893-21ssh23:37:182
29550992012,6cyclictest1893-21ssh23:37:182
29550992012,6cyclictest0-21swapper/200:30:202
29550992012,6cyclictest0-21swapper/200:30:202
2955099201,16cyclictest19596-21ls21:25:202
2955099201,16cyclictest19596-21ls21:25:202
2955099201,16cyclictest1258-21find19:25:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional