You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 05:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Tue Dec 09, 2025 00:39:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3060862995545,7cyclictest3090317-21sshd20:49:261
3060862995341,8cyclictest422-21dbus-daemon00:40:011
306086199532,23cyclictest3173012-21ntpq22:49:270
3060861995237,13cyclictest3060860-21cyclictest22:59:350
306086199522,27cyclictest3195926-21ntpq23:19:230
306086199481,28cyclictest3069314-21ntp_states19:39:240
3060861994714,25cyclictest3211415-21ssh23:39:260
306086199471,28cyclictest3236275-21sh00:11:310
306086199471,27cyclictest3201960-21ssh23:27:220
306086199461,30cyclictest3096846-21diskmemload22:51:030
3060863994534,4cyclictest0-21swapper/221:19:252
3060861994531,11cyclictest3123865-21munin-plugin-st21:45:020
306086199451,31cyclictest3192175-21ntpq23:14:250
306086199451,28cyclictest3096846-21diskmemload21:53:300
306086199451,26cyclictest3213103-21ssh23:41:230
3060863994437,3cyclictest0-21swapper/200:20:012
3060863994437,3cyclictest0-21swapper/200:20:012
3060863994436,5cyclictest0-21swapper/221:40:022
3060863994434,5cyclictest0-21swapper/221:09:222
3060863994434,5cyclictest0-21swapper/221:09:222
3060862994436,5cyclictest955-21mta-sts-daemon19:19:261
3060862994436,5cyclictest3100494-21timerwakeupswit21:14:361
3060862994436,5cyclictest3100494-21timerwakeupswit21:14:361
3060862994436,3cyclictest0-21swapper/121:19:271
3060862994420,20cyclictest271ktimers/122:04:271
306086199444,35cyclictest3234498-21ntpq00:09:240
306086199442,24cyclictest3249373-21ntpq00:29:250
306086199441,22cyclictest3097934-21ssh21:11:390
306086199441,22cyclictest3097934-21ssh21:11:390
3060863994335,5cyclictest698-21cron23:40:002
3060863994335,5cyclictest3169651-21grep22:44:342
3060863994334,6cyclictest422-21dbus-daemon21:45:022
3060862994335,5cyclictest422-21dbus-daemon00:15:021
3060862994335,5cyclictest3204435-21systemd-run23:30:011
3060861994333,7cyclictest0-21swapper/000:25:010
306086199432,36cyclictest3066287-21ntpq19:29:220
306086199432,24cyclictest3168599-21df_inode22:44:140
306086199431,38cyclictest3093239-21ntpq20:59:270
306086199431,38cyclictest3076823-21ntpq20:04:250
306086199431,36cyclictest3207414-21ntpq23:34:220
306086199431,36cyclictest3207414-21ntpq23:34:220
306086199431,32cyclictest3132985-21ssh21:57:330
306086199431,25cyclictest3094605-21memory21:04:210
306086199431,25cyclictest3094605-21memory21:04:210
306086199431,25cyclictest3073733-21ntpq19:54:210
3060862994234,5cyclictest422-21dbus-daemon22:30:011
3060862994234,5cyclictest3219892-21munin-plugin-st23:50:011
306086199429,29cyclictest3226808-21ssh23:59:260
306086199422,36cyclictest3256378-21ntpq00:39:240
306086199422,35cyclictest3063281-21ntpq19:19:260
306086199421,39cyclictest3164053-21ssh22:38:180
306086199421,36cyclictest3087242-21ntpq20:39:220
306086199421,36cyclictest3075209-21ntpq19:59:200
306086199421,36cyclictest3070784-21ntpq19:44:240
306086199421,36cyclictest3061828-21ntpq19:14:280
306086199421,26cyclictest3223709-21sh23:54:580
3060863994134,4cyclictest0-21swapper/222:19:222
3060863994130,7cyclictest3161104-21latency22:34:192
3060862994133,5cyclictest3227609-21cron00:00:011
3060862994132,6cyclictest3087839-21sendmail20:40:011
306086199418,17cyclictest151ktimers/022:20:380
306086199413,34cyclictest3161330-21ntpq22:34:230
3060861994129,8cyclictest151ktimers/020:14:210
3060861994129,8cyclictest151ktimers/020:14:210
306086199412,34cyclictest3082855-21ntpq20:24:250
306086199411,35cyclictest3188291-21ntpq23:09:240
306086199411,34cyclictest3157688-21ntpq22:29:290
306086199411,22cyclictest3197220-21ssh23:20:180
3060863994034,3cyclictest0-21swapper/221:25:012
3060863994030,5cyclictest0-21swapper/223:24:222
3060863994030,4cyclictest0-21swapper/222:04:222
3060862994033,3cyclictest0-21swapper/122:50:011
3060862994032,5cyclictest3065351-21cron19:25:011
3060862994031,5cyclictest3115797-21unixbench-2d21:34:341
306086199409,28cyclictest3113090-21ssh21:31:120
306086199408,30cyclictest3108875-21ssh21:25:220
306086199408,30cyclictest3108875-21ssh21:25:220
306086199401,35cyclictest3116681-21ssh21:35:430
306086199401,35cyclictest3103842-21ntpq21:19:270
306086199401,34cyclictest3218953-21ntpq23:49:200
306086199401,34cyclictest3107580-21ntpq21:24:240
306086199401,34cyclictest3091776-21ntpq20:54:230
306086199401,34cyclictest3088837-21ntpq20:44:250
306086199401,34cyclictest3064784-21ntpq19:24:220
306086199401,31cyclictest3127504-21ssh21:49:360
306086199401,22cyclictest3147975-21ssh22:16:450
3060863993932,5cyclictest0-21swapper/221:29:192
3060863993932,5cyclictest0-21swapper/221:29:192
3060863993930,6cyclictest3246120-21cut00:24:312
3060863993929,6cyclictest1196112-21cups-browsed21:54:132
3060862993934,2cyclictest0-21swapper/122:59:241
3060862993932,3cyclictest0-21swapper/119:14:281
3060862993930,5cyclictest3093918-21latency_hist21:00:021
306086199399,25cyclictest3252828-21ntpq00:34:230
306086199396,30cyclictest3078246-21ntpq20:09:230
306086199393,33cyclictest3090222-21ntpq20:49:220
3060861993933,3cyclictest0-21swapper/000:04:260
306086199393,32cyclictest3081339-21ntpq20:19:260
306086199392,33cyclictest3242256-21ntpq00:19:280
306086199392,33cyclictest3242256-21ntpq00:19:280
306086199392,32cyclictest3085719-21ntpq20:34:190
306086199391,34cyclictest3182117-21ssh23:00:550
306086199391,34cyclictest3136107-21ssh22:01:000
306086199391,34cyclictest3084264-21ntpq20:29:230
306086199391,33cyclictest3072230-21ntpq19:49:200
306086199390,36cyclictest3141090-21ssh22:08:230
3060863993832,3cyclictest0-21swapper/222:24:212
3060863993829,5cyclictest3249301-21needreboot00:29:212
306086399382,29cyclictest3222957-21ssh23:54:282
306086299388,10cyclictest3073357-21df_inode19:54:141
3060862993830,4cyclictest0-21swapper/122:09:221
306086199381,33cyclictest3067720-21ntpq19:34:220
306086199381,32cyclictest3146180-21ntpq22:14:280
3060863993729,5cyclictest3063891-21systemd-run19:20:012
3060863993729,4cyclictest0-21swapper/200:14:222
3060863993728,3cyclictest0-21swapper/223:49:212
306086399372,30cyclictest3192235-21ssh23:14:282
3060863993716,11cyclictest3202996-21telnet23:29:142
306086299377,7cyclictest3096846-21diskmemload21:29:241
306086299377,7cyclictest3096846-21diskmemload21:29:241
3060862993732,2cyclictest0-21swapper/122:35:011
3060862993729,5cyclictest422-21dbus-daemon22:25:011
3060862993728,6cyclictest422-21dbus-daemon00:30:011
3060862993728,6cyclictest3230813-21processes00:04:291
3060862993728,6cyclictest3184699-21mailstats23:04:301
3060862993727,7cyclictest3246345-21timerwakeupswit00:24:341
3060862993726,8cyclictest3233770-21aten_r2power_cu00:09:121
3060862993713,5cyclictest28-21ksoftirqd/121:55:501
306086199371,32cyclictest3096230-21ntpq21:09:220
306086199371,32cyclictest3096230-21ntpq21:09:220
3060863993628,5cyclictest3086335-21cron20:35:012
3060863993628,3cyclictest0-21swapper/200:09:292
3060863993627,6cyclictest657-21snmpd21:14:312
3060863993627,6cyclictest657-21snmpd21:14:312
3060863993625,7cyclictest3216078-21ssh23:45:022
3060862993630,3cyclictest0-21swapper/123:45:011
3060862993630,3cyclictest0-21swapper/123:34:261
3060862993630,3cyclictest0-21swapper/123:34:261
3060862993625,8cyclictest3071352-21munin-plugin-st19:45:021
3060863993528,3cyclictest0-21swapper/200:00:012
3060863993527,5cyclictest3177610-21munin-run22:55:012
3060863993524,8cyclictest698-21cron20:45:012
306086299356,11cyclictest3130380-21kernelversion21:54:171
3060862993529,3cyclictest0-21swapper/122:55:011
3060862993529,3cyclictest0-21swapper/121:49:351
3060862993528,4cyclictest0-21swapper/122:14:361
3060862993528,3cyclictest0-21swapper/123:14:291
3060862993525,7cyclictest3084865-21sh20:30:021
3060862993522,9cyclictest0-21swapper/123:39:241
3060862993522,7cyclictest956-21mta-sts-daemon22:18:591
3060863993426,5cyclictest3080356-21systemd-run20:15:012
3060863993426,5cyclictest3080356-21systemd-run20:15:012
3060863993426,4cyclictest0-21swapper/222:09:262
3060863993425,5cyclictest955-21mta-sts-daemon00:34:302
3060863993424,6cyclictest3060872-21systemd-run19:10:012
3060863993423,7cyclictest3115150-21needreboot21:34:202
306086299347,9cyclictest3240520-21sh00:17:231
306086299347,9cyclictest3240520-21sh00:17:231
306086299347,5cyclictest171rcu_preempt23:24:241
306086299346,15cyclictest3096846-21diskmemload22:44:411
306086299345,9cyclictest3220299-21ssh23:50:241
306086299344,25cyclictest3107561-21ssh21:24:231
3060862993428,3cyclictest0-21swapper/121:05:021
3060862993428,3cyclictest0-21swapper/121:05:021
306086399339,4cyclictest171rcu_preempt23:19:272
3060863993325,5cyclictest3208063-21unixbench_singl23:34:352
3060863993325,5cyclictest3208063-21unixbench_singl23:34:352
306086299336,8cyclictest3194987-21ssh23:18:431
306086299336,18cyclictest3165328-21ssh22:39:281
3060862993326,4cyclictest3089369-21kworker/u8:1420:45:011
3060862993326,4cyclictest0-21swapper/121:39:201
3060862993325,5cyclictest3081733-21unixbench_multi20:19:321
3060862993325,5cyclictest3069776-21sed19:39:321
3060862993310,5cyclictest28-21ksoftirqd/119:29:321
3060863993227,2cyclictest0-21swapper/222:40:012
3060863993226,3cyclictest0-21swapper/222:59:372
3060863993222,3cyclictest3254812-21sh00:37:132
306086299327,8cyclictest3250879-21sh00:31:091
3060862993225,4cyclictest0-21swapper/120:54:271
3060862993224,5cyclictest0-21swapper/120:05:011
306086299322,23cyclictest3122932-21ssh21:44:221
3060863993124,3cyclictest0-21swapper/222:14:262
3060863993123,5cyclictest3066868-21systemd-run19:30:012
3060863993122,6cyclictest955-21mta-sts-daemon22:46:282
306086399311,25cyclictest3134618-21sshd21:59:262
3060862993122,5cyclictest0-21swapper/123:09:281
306086399307,4cyclictest171rcu_preempt00:04:252
3060863993024,3cyclictest0-21swapper/223:09:312
3060863993023,4cyclictest3075387-21processes19:59:282
3060863993023,3cyclictest0-21swapper/221:49:222
3060863993023,3cyclictest0-21swapper/220:10:012
3060863993022,5cyclictest3062362-21systemd-run19:15:012
3060863993020,8cyclictest3067676-21needreboot19:34:212
306086399301,2cyclictest0-21swapper/219:49:202
306086399300,22cyclictest3157585-21ssh22:29:242
306086299308,5cyclictest28-21ksoftirqd/120:14:251
306086299308,5cyclictest28-21ksoftirqd/120:14:251
3060862993022,5cyclictest3078880-21latency_hist20:10:021
3060862993020,7cyclictest3096645-21timerwakeupswit21:09:341
3060862993020,7cyclictest3096645-21timerwakeupswit21:09:341
3060862993017,8cyclictest3067814-21ntpq19:34:261
306086399299,5cyclictest171rcu_preempt20:24:192
3060863992921,4cyclictest3077347-21cron20:05:012
306086399291,21cyclictest3184482-21ssh23:04:242
306086299295,7cyclictest3071588-21sshd19:47:261
3060863992822,3cyclictest0-21swapper/220:54:202
3060863992821,4cyclictest959-21mta-sts-daemon20:38:022
3060863992820,5cyclictest3064855-21sshd19:24:262
3060863992820,5cyclictest0-21swapper/219:40:012
306086299282,8cyclictest3082380-21diskstats20:24:131
3060862992821,3cyclictest0-21swapper/119:59:281
306086199281,21cyclictest3060956-21latency_hist19:10:020
3060863992722,3cyclictest3048330-21kworker/u8:4+xprtiod19:54:262
3060863992720,4cyclictest3090259-21ntp_kernel_pll_20:49:232
3060863992610,3cyclictest171rcu_preempt21:04:272
3060863992610,3cyclictest171rcu_preempt21:04:272
3060862992613,10cyclictest3085710-21ntpq20:34:191
3060863992520,2cyclictest0-21swapper/221:00:012
3060863992516,6cyclictest1196112-21cups-browsed20:15:272
306086399248,3cyclictest171rcu_preempt20:29:232
3060863992315,5cyclictest956-21mta-sts-daemon19:45:012
3060862992017,2cyclictest0-21swapper/119:10:011
306086499192,10cyclictest0-21swapper/321:39:253
306086499183,7cyclictest0-21swapper/321:29:243
306086499183,7cyclictest0-21swapper/321:29:243
306086499161,8cyclictest0-21swapper/322:19:243
306086499161,8cyclictest0-21swapper/300:29:273
306086499161,7cyclictest0-21swapper/321:49:233
306086499156,5cyclictest0-21swapper/300:09:243
306086499152,6cyclictest0-21swapper/323:29:283
306086499151,8cyclictest0-21swapper/321:59:253
306086499151,8cyclictest0-21swapper/321:44:243
306086499151,7cyclictest0-21swapper/323:34:213
306086499151,7cyclictest0-21swapper/323:34:213
306086499151,7cyclictest0-21swapper/321:54:223
306086499151,7cyclictest0-21swapper/321:24:283
306086499151,7cyclictest0-21swapper/319:39:263
306086499151,7cyclictest0-21swapper/319:19:293
306086499151,7cyclictest0-21swapper/300:19:233
306086499151,7cyclictest0-21swapper/300:19:233
306086499142,6cyclictest0-21swapper/321:34:213
306086499142,6cyclictest0-21swapper/320:49:253
306086499141,8cyclictest0-21swapper/322:34:283
306086499141,7cyclictest0-21swapper/323:59:283
306086499141,7cyclictest0-21swapper/322:24:263
306086499141,7cyclictest0-21swapper/322:04:203
306086499141,7cyclictest0-21swapper/321:04:263
306086499141,7cyclictest0-21swapper/321:04:263
306086499141,6cyclictest0-21swapper/320:44:243
306086499141,6cyclictest0-21swapper/320:19:213
306086499141,6cyclictest0-21swapper/320:09:233
306086499141,6cyclictest0-21swapper/320:04:213
306086499141,6cyclictest0-21swapper/300:39:243
306086499136,5cyclictest0-21swapper/323:54:213
306086499136,4cyclictest0-21swapper/322:59:353
306086499132,7cyclictest0-21swapper/323:24:253
306086499132,7cyclictest0-21swapper/300:25:013
306086499131,7cyclictest0-21swapper/323:16:273
306086499131,7cyclictest0-21swapper/323:04:203
306086499131,7cyclictest0-21swapper/322:54:263
306086499131,7cyclictest0-21swapper/322:14:273
306086499131,7cyclictest0-21swapper/321:14:233
306086499131,7cyclictest0-21swapper/321:14:233
306086499131,7cyclictest0-21swapper/320:29:263
306086499131,7cyclictest0-21swapper/300:34:303
306086499131,7cyclictest0-21swapper/300:14:283
306086499131,6cyclictest0-21swapper/320:34:203
306086499131,5cyclictest0-21swapper/319:44:223
306086499130,7cyclictest0-21swapper/323:39:223
306086499126,4cyclictest0-21swapper/323:14:213
306086499126,4cyclictest0-21swapper/322:44:203
306086499126,4cyclictest0-21swapper/322:09:233
306086499126,4cyclictest0-21swapper/320:55:013
306086499126,4cyclictest0-21swapper/320:24:323
306086499126,4cyclictest0-21swapper/300:04:153
306086499122,5cyclictest0-21swapper/323:44:213
306086499121,7cyclictest0-21swapper/323:09:233
306086499121,7cyclictest0-21swapper/322:39:243
306086499121,7cyclictest0-21swapper/321:19:253
306086499121,6cyclictest0-21swapper/323:49:213
306086499121,6cyclictest0-21swapper/322:49:213
306086499121,6cyclictest0-21swapper/319:34:253
306086499121,6cyclictest0-21swapper/319:14:263
306086499121,5cyclictest0-21swapper/320:39:213
306086499112,5cyclictest0-21swapper/320:59:253
306086499112,4cyclictest0-21swapper/321:09:293
306086499112,4cyclictest0-21swapper/321:09:293
306086499105,3cyclictest0-21swapper/319:59:203
306086499104,4cyclictest0-21swapper/319:54:333
306086499102,6cyclictest0-21swapper/322:29:233
306086499101,5cyclictest0-21swapper/319:29:213
306086499101,5cyclictest0-21swapper/319:24:223
30608649991,5cyclictest0-21swapper/320:14:123
30608649991,5cyclictest0-21swapper/320:14:123
30608649991,3cyclictest0-21swapper/319:45:033
30608649981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional