You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Dec 26, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1233992321,1cyclictest32103-21munin-run21:20:013
123399230,22cyclictest21064-21apt-get19:50:193
1232992321,1cyclictest0-21swapper/223:50:012
1232992321,1cyclictest0-21swapper/223:50:012
123299230,1cyclictest0-21swapper/219:20:002
1227992323,0cyclictest0-21swapper/121:10:221
1227992321,1cyclictest23190-21grep19:55:011
122799230,22cyclictest21317-21munin-run22:05:001
122799230,22cyclictest14380-21apt-get21:50:211
122799230,1cyclictest313-21systemd-journal20:45:011
122399230,2cyclictest3224-21cron20:20:000
1233992220,1cyclictest28897-21wc22:20:013
123399220,21cyclictest0-21swapper/323:55:223
123399220,0cyclictest0-21swapper/321:05:203
123299220,21cyclictest32704-21perf00:40:012
123299220,21cyclictest28177-21apt-get00:30:222
123299220,21cyclictest15523-21apt-get20:45:212
123299220,21cyclictest0-21swapper/223:25:212
123299220,21cyclictest0-21swapper/222:00:212
123299220,1cyclictest2380-21apt-get21:25:192
123299220,1cyclictest20026-21sh20:55:012
1227992220,1cyclictest13002-40mandb00:00:011
122799220,21cyclictest30993-21latency_hist23:30:001
122799220,21cyclictest29635-21apt-get22:20:201
122799220,21cyclictest16774-21apt-get21:55:201
122799220,21cyclictest1453-21apt-get19:10:191
122799220,21cyclictest0-21swapper/123:50:241
122799220,21cyclictest0-21swapper/122:40:221
122799220,21cyclictest0-21swapper/121:20:191
122799220,21cyclictest0-21swapper/120:20:221
122799220,21cyclictest0-21swapper/100:05:211
122799220,1cyclictest8046-21munin-run20:30:011
122799220,1cyclictest14421-21apt-get22:55:221
122799220,1cyclictest0-21swapper/100:10:021
1223992220,1cyclictest20677-21turbostat.cron00:15:000
1223992220,1cyclictest10434-21apt20:35:010
1223992220,1cyclictest0-21swapper/022:30:220
1223992219,2cyclictest14138-21apt22:55:010
122399220,21cyclictest4776-21apt-get21:30:200
122399220,21cyclictest0-21swapper/019:35:180
122399220,1cyclictest10587-21cron23:55:010
1233992121,0cyclictest0-21swapper/300:35:173
1233992120,1cyclictest0-21swapper/320:20:223
1233992120,1cyclictest0-21swapper/319:20:003
1233992120,0cyclictest21583-21apt-get22:05:203
1233992120,0cyclictest0-21swapper/319:30:183
1233992120,0cyclictest0-21swapper/300:00:213
123399210,21cyclictest0-21swapper/323:10:213
123399210,21cyclictest0-21swapper/321:30:203
123399210,20cyclictest7235-21apt-get22:40:223
123399210,20cyclictest0-21swapper/323:40:013
123399210,20cyclictest0-21swapper/322:25:193
123399210,20cyclictest0-21swapper/320:00:233
123399210,1cyclictest30999-21apt23:30:003
123399210,0cyclictest26434-21apt-get23:20:213
123399210,0cyclictest0-21swapper/322:45:213
1232992121,0cyclictest28665-21apt-get20:05:192
1232992120,0cyclictest0-21swapper/220:25:202
1232992119,1cyclictest3232-21lockfile-create20:20:002
1232992119,1cyclictest313-21systemd-journal23:45:012
1232992119,1cyclictest20959-21apt-get00:15:202
1232992119,1cyclictest18914-21perf22:00:002
123299210,20cyclictest32028-21apt-get22:25:192
123299210,20cyclictest0-21swapper/223:30:212
123299210,20cyclictest0-21swapper/219:45:202
123299210,20cyclictest0-21swapper/219:45:202
123299210,20cyclictest0-21swapper/219:35:182
1227992121,0cyclictest0-21swapper/123:00:201
1227992121,0cyclictest0-21swapper/100:15:201
1227992120,1cyclictest1088-21apt-get20:15:211
122799210,21cyclictest0-21swapper/119:25:201
122799210,1cyclictest13198-21munin-run19:35:001
122799210,0cyclictest24373-21apt-get22:10:201
122799210,0cyclictest0-21swapper/123:05:201
122799210,0cyclictest0-21swapper/120:45:211
122799210,0cyclictest0-21swapper/100:30:221
1223992120,1cyclictest23462-21apt-get19:55:210
1223992119,1cyclictest29687-21turbostat21:15:000
1223992119,1cyclictest19228-21apt-get23:05:200
1223992118,2cyclictest10878-21apt-get23:55:220
122399210,21cyclictest0-21swapper/022:10:020
122399210,21cyclictest0-21swapper/000:05:210
122399210,20cyclictest21281-21cron22:05:000
122399210,20cyclictest18669-21apt-get19:45:190
122399210,20cyclictest18669-21apt-get19:45:190
122399210,20cyclictest11066-21apt-get19:30:180
122399210,20cyclictest0-21swapper/021:50:210
122399210,1cyclictest13383-21apt-get00:00:210
122399210,0cyclictest0-21swapper/022:40:220
122399210,0cyclictest0-21swapper/000:35:170
1233992020,0cyclictest0-21swapper/323:15:233
1233992020,0cyclictest0-21swapper/323:00:203
1233992020,0cyclictest0-21swapper/321:40:203
1233992020,0cyclictest0-21swapper/320:15:213
1233992020,0cyclictest0-21swapper/320:10:203
1233992019,1cyclictest20784-21turbostat19:50:013
1233992019,1cyclictest20784-21turbostat19:50:013
1233992018,1cyclictest622-21gdbus23:00:013
123399200,20cyclictest0-21swapper/319:10:193
123399200,20cyclictest0-21swapper/300:10:213
123399200,0cyclictest0-21swapper/322:10:023
123399200,0cyclictest0-21swapper/319:20:213
1232992020,0cyclictest1264-21apt-get23:35:232
1232992020,0cyclictest0-21swapper/219:40:182
1232992020,0cyclictest0-21swapper/219:10:192
1232992020,0cyclictest0-21swapper/200:25:212
1232992018,1cyclictest4132-21apt-get22:35:002
123299200,20cyclictest10878-21apt-get23:55:222
123299200,0cyclictest0-21swapper/223:10:212
123299200,0cyclictest0-21swapper/220:55:222
1227992020,0cyclictest0-21swapper/122:50:211
1227992020,0cyclictest0-21swapper/122:30:221
1227992020,0cyclictest0-21swapper/121:30:201
1227992020,0cyclictest0-21swapper/119:45:201
1227992020,0cyclictest0-21swapper/119:45:201
1227992019,1cyclictest3690-21apt-get23:40:201
1227992019,1cyclictest0-21swapper/123:30:201
1227992019,0cyclictest0-21swapper/123:45:201
1227992019,0cyclictest0-21swapper/123:45:201
1227992019,0cyclictest0-21swapper/100:00:211
122799200,19cyclictest25488-21cron00:25:001
122799200,0cyclictest0-21swapper/122:35:221
122799200,0cyclictest0-21swapper/120:35:201
1223992020,0cyclictest0-21swapper/023:30:210
1223992020,0cyclictest0-21swapper/022:05:200
1223992020,0cyclictest0-21swapper/021:25:200
1223992019,0cyclictest21624-21apt-get23:10:210
1223992017,2cyclictest22452-21tr21:00:000
122399200,20cyclictest0-21swapper/022:20:200
122399200,1cyclictest0-21swapper/022:35:220
122399200,0cyclictest0-21swapper/023:45:200
122399200,0cyclictest0-21swapper/023:45:200
122399200,0cyclictest0-21swapper/021:00:230
122399200,0cyclictest0-21swapper/019:50:190
1233991919,0cyclictest7171-21apt-get21:35:203
1233991919,0cyclictest22733-21apt-get21:00:223
1233991919,0cyclictest13461-21apt-get19:35:183
1233991919,0cyclictest0-21swapper/322:35:223
1233991919,0cyclictest0-21swapper/320:05:193
1233991917,1cyclictest606-21dbus-daemon20:35:013
1233991917,1cyclictest313-21systemd-journal00:20:003
1233991917,1cyclictest0-21swapper/322:00:003
1232991919,0cyclictest24018-21apt-get23:15:232
1232991919,0cyclictest0-21swapper/222:35:022
1232991919,0cyclictest0-21swapper/222:10:202
1232991919,0cyclictest0-21swapper/222:05:202
1232991919,0cyclictest0-21swapper/221:40:202
1232991919,0cyclictest0-21swapper/221:10:222
1232991919,0cyclictest0-21swapper/219:20:212
1232991919,0cyclictest0-21swapper/200:05:212
1227991919,0cyclictest15878-21apt-get19:40:181
1227991919,0cyclictest0-21swapper/123:10:211
1227991919,0cyclictest0-21swapper/122:05:211
1227991919,0cyclictest0-21swapper/121:00:231
1227991919,0cyclictest0-21swapper/100:35:161
1227991918,0cyclictest0-21swapper/121:05:201
122799190,1cyclictest0-21swapper/100:30:011
122799190,19cyclictest0-21swapper/121:28:491
122799190,0cyclictest0-21swapper/123:35:231
1223991919,0cyclictest0-21swapper/023:00:200
1223991919,0cyclictest0-21swapper/021:55:200
1223991919,0cyclictest0-21swapper/021:40:200
1223991919,0cyclictest0-21swapper/019:10:190
1223991918,0cyclictest0-21swapper/022:45:210
1233991818,0cyclictest0-21swapper/321:50:213
1233991818,0cyclictest0-21swapper/319:55:203
1233991818,0cyclictest0-21swapper/300:30:213
1232991818,0cyclictest8318-21apt-get20:30:232
1232991818,0cyclictest0-21swapper/221:30:202
1232991818,0cyclictest0-21swapper/221:20:192
1232991818,0cyclictest0-21swapper/219:55:212
1232991817,0cyclictest0-21swapper/221:35:202
1227991818,0cyclictest6279-21apt-get19:20:211
1227991818,0cyclictest0-21swapper/123:20:211
1227991818,0cyclictest0-21swapper/120:55:221
1227991818,0cyclictest0-21swapper/120:50:191
1227991818,0cyclictest0-21swapper/120:10:201
1227991818,0cyclictest0-21swapper/120:05:191
1223991818,0cyclictest28829-21apt-get23:25:210
1223991818,0cyclictest0-21swapper/023:35:230
1223991818,0cyclictest0-21swapper/021:15:200
1223991818,0cyclictest0-21swapper/020:50:190
1223991818,0cyclictest0-21swapper/020:05:190
1223991818,0cyclictest0-21swapper/020:00:230
1223991818,0cyclictest0-21swapper/000:15:200
1223991817,1cyclictest23392-21apt-get00:20:230
1223991817,1cyclictest0-21swapper/000:30:210
1223991816,1cyclictest1740-21apt22:30:010
1233991717,0cyclictest3690-21apt-get23:40:203
1233991717,0cyclictest11983-21apt-get21:45:203
1233991717,0cyclictest0-21swapper/323:05:203
1233991717,0cyclictest0-21swapper/322:00:213
1233991717,0cyclictest0-21swapper/320:35:203
123399170,16cyclictest4120-21sh22:35:003
1232991717,0cyclictest25125-21apt-get21:05:202
1232991717,0cyclictest23196-21perf19:55:012
1232991717,0cyclictest10711-21apt-get20:35:202
1232991717,0cyclictest0-21swapper/222:20:022
1232991716,0cyclictest23392-21apt-get00:20:232
1227991717,0cyclictest9627-21apt-get22:45:221
1227991717,0cyclictest0-21swapper/120:00:221
1223991717,0cyclictest0-21swapper/023:40:200
1223991717,0cyclictest0-21swapper/019:40:170
1223991717,0cyclictest0-21swapper/019:25:200
1223991717,0cyclictest0-21swapper/000:25:220
122399170,0cyclictest0-21swapper/022:55:220
1233991616,0cyclictest5920-21apt-get20:25:203
1233991615,1cyclictest8485-21apt-get23:50:243
1233991613,2cyclictest29692-21latency_hist21:15:003
1232991616,0cyclictest25881-21apt-get20:00:222
1232991616,0cyclictest0-21swapper/223:50:252
1232991616,0cyclictest0-21swapper/223:05:202
1232991616,0cyclictest0-21swapper/221:45:202
1232991614,1cyclictest0-21swapper/221:20:012
123299160,15cyclictest12315-21processes19:30:252
1227991616,0cyclictest0-21swapper/119:55:201
1227991615,1cyclictest0-21swapper/122:25:191
122799160,14cyclictest9746-21munin-node23:18:141
1223991616,0cyclictest0-21swapper/023:20:200
1223991616,0cyclictest0-21swapper/021:45:200
1223991616,0cyclictest0-21swapper/021:35:200
1223991615,1cyclictest0-21swapper/019:15:190
1223991615,0cyclictest0-21swapper/020:35:200
122399160,0cyclictest0-21swapper/021:20:190
1233991515,0cyclictest32388-21apt-get21:20:193
1233991515,0cyclictest0-21swapper/319:40:183
1232991515,0cyclictest0-21swapper/223:20:212
1232991515,0cyclictest0-21swapper/222:45:212
1232991515,0cyclictest0-21swapper/200:00:212
1232991514,0cyclictest18566-21apt-get00:10:212
123299150,14cyclictest15428-21ntp_states21:50:272
1227991515,0cyclictest0-21swapper/121:15:201
1227991515,0cyclictest0-21swapper/119:15:191
1223991515,0cyclictest0-21swapper/022:15:200
1223991515,0cyclictest0-21swapper/020:45:210
1223991515,0cyclictest0-21swapper/020:25:200
1223991513,1cyclictest0-21swapper/019:25:000
1233991414,0cyclictest0-21swapper/323:45:203
1233991414,0cyclictest0-21swapper/323:45:203
1233991414,0cyclictest0-21swapper/320:40:223
123399140,14cyclictest0-21swapper/323:30:163
123399140,14cyclictest0-21swapper/321:25:113
123399140,14cyclictest0-21swapper/320:55:403
123399140,14cyclictest0-21swapper/320:50:283
123399140,14cyclictest0-21swapper/300:25:073
123399140,14cyclictest0-21swapper/300:20:153
123399140,0cyclictest0-21swapper/322:50:503
123399140,0cyclictest0-21swapper/320:45:123
123399140,0cyclictest0-21swapper/319:25:253
123399140,0cyclictest0-21swapper/300:05:083
1232991414,0cyclictest0-21swapper/222:15:102
1232991414,0cyclictest0-21swapper/220:20:222
123299140,8cyclictest0-21swapper/221:00:232
123299140,14cyclictest0-21swapper/223:00:022
123299140,14cyclictest0-21swapper/222:55:142
123299140,14cyclictest0-21swapper/222:50:182
123299140,14cyclictest0-21swapper/222:40:182
123299140,14cyclictest0-21swapper/220:41:502
123299140,14cyclictest0-21swapper/220:13:512
123299140,0cyclictest0-21swapper/219:26:042
1227991414,0cyclictest13461-21apt-get19:35:181
1227991414,0cyclictest0-21swapper/121:45:201
122799140,0cyclictest0-21swapper/122:15:071
122799140,0cyclictest0-21swapper/121:36:011
122799140,0cyclictest0-21swapper/120:30:481
1223991414,0cyclictest0-21swapper/020:10:200
1223991412,1cyclictest0-21swapper/021:05:190
122399140,14cyclictest0-21swapper/020:40:380
122399140,14cyclictest0-21swapper/020:20:070
122399140,0cyclictest0-21swapper/023:15:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional