You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 07:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Dec 06, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31841992421,2cyclictest13206-21munin-run20:44:593
31837992421,2cyclictest21499-21sh00:20:002
3183799240,1cyclictest313-21systemd-journal22:40:002
31833992422,1cyclictest19728-21cron23:10:001
31841992323,0cyclictest7812-21apt-get22:48:243
3184199230,22cyclictest593-21dbus-daemon00:40:003
3184199230,22cyclictest17908-21apt-get22:00:023
31837992321,1cyclictest24568-21sendmail-msp23:20:002
31833992321,1cyclictest25885-21perf20:05:001
3183399230,2cyclictest20413-21munin-plugin-st21:00:001
3183399230,22cyclictest1089-21awk20:20:001
3182899233,1cyclictest26967-21cpuspeed_turbos20:08:210
31828992321,1cyclictest17287-21sendmail-msp22:00:000
3182899230,22cyclictest4855-21cron22:40:000
3182899230,22cyclictest13900-21cron00:05:000
3182899230,1cyclictest313-21systemd-journal22:25:000
3182899230,1cyclictest0-21swapper/023:48:220
31841992220,1cyclictest25082-21apt-get23:23:223
31841992220,1cyclictest2093-21ls22:35:003
31841992220,0cyclictest0-21swapper/323:53:243
31841992219,2cyclictest17347-21grep23:05:003
3184199220,21cyclictest25388-21apt-get22:18:213
3184199220,21cyclictest11412-21cron00:00:003
3184199220,21cyclictest10659-21apt-get22:53:253
3184199220,21cyclictest0-21swapper/300:23:213
31837992220,1cyclictest0-21swapper/200:35:012
31837992219,2cyclictest11426-40mandb00:00:002
3183799220,21cyclictest7092-21apt-get23:53:242
3183799220,21cyclictest5908-21cron20:30:002
3183799220,21cyclictest15604-21basename20:50:002
3183799220,21cyclictest14883-21awk21:55:002
3183799220,21cyclictest0-21swapper/223:03:222
3183799220,21cyclictest0-21swapper/219:45:002
3183799220,1cyclictest0-21swapper/223:34:592
31833992222,0cyclictest0-21swapper/121:53:211
31833992221,0cyclictest0-21swapper/123:33:211
3183399220,21cyclictest17306-21awk22:00:001
3183399220,21cyclictest0-21swapper/122:53:241
3183399220,21cyclictest0-21swapper/120:48:211
3183399220,21cyclictest0-21swapper/120:30:011
3183399220,21cyclictest0-21swapper/119:53:211
31828992220,1cyclictest0-21swapper/000:25:000
3182899220,21cyclictest4042-21apt-get20:28:200
3182899220,21cyclictest21539-21sleep00:20:000
3182899220,21cyclictest18508-21apt-get20:58:230
31841992121,0cyclictest27479-21apt-get23:28:233
31841992121,0cyclictest25873-21apt-get20:05:023
31841992120,1cyclictest23994-21apt-get20:03:213
31841992120,1cyclictest13708-21apt-get20:48:203
31841992118,2cyclictest6619-21munin-run19:25:003
3184199210,20cyclictest31777-21munin-run23:35:003
3184199210,20cyclictest30201-21apt-get22:28:213
3184199210,20cyclictest2929-21apt-get21:33:223
3184199210,20cyclictest17280-21apt-get22:00:003
3184199210,20cyclictest0-21swapper/323:43:203
3184199210,20cyclictest0-21swapper/320:23:213
3184199210,20cyclictest0-21swapper/319:48:203
3184199210,20cyclictest0-21swapper/300:03:223
3184199210,1cyclictest0-21swapper/323:40:003
3184199210,1cyclictest0-21swapper/321:18:193
3184199210,0cyclictest0-21swapper/322:43:223
3184199210,0cyclictest0-21swapper/300:13:223
31837992121,0cyclictest0-21swapper/222:13:192
31837992119,1cyclictest4691-21apt-get23:48:222
3183799210,20cyclictest20268-21apt-get23:13:242
3183799210,20cyclictest11966-21apt-get19:38:202
3183799210,20cyclictest10194-21apt-get21:48:222
3183799210,20cyclictest0-21swapper/219:33:212
3183799210,0cyclictest0-21swapper/222:18:212
3183799210,0cyclictest0-21swapper/222:08:212
3183799210,0cyclictest0-21swapper/221:03:232
31833992121,0cyclictest0-21swapper/120:23:201
31833992121,0cyclictest0-21swapper/100:15:021
31833992120,1cyclictest9542-21apt-get23:58:241
31833992118,2cyclictest23916-21cron00:25:001
3183399210,21cyclictest0-21swapper/122:58:251
3183399210,20cyclictest5415-21apt-get22:43:231
3183399210,20cyclictest0-21swapper/121:48:231
3183399210,20cyclictest0-21swapper/120:38:201
3183399210,20cyclictest0-21swapper/119:18:211
3183399210,0cyclictest5324-21apt-get21:38:231
3183399210,0cyclictest0-21swapper/122:33:221
3183399210,0cyclictest0-21swapper/122:28:211
3183399210,0cyclictest0-21swapper/119:13:201
31828992120,1cyclictest29183-21apt-get20:13:210
31828992119,1cyclictest476-21apt-get21:28:220
3182899210,21cyclictest0-21swapper/021:23:230
3182899210,20cyclictest32279-21apt-get23:38:220
3182899210,20cyclictest0-21swapper/019:33:200
3182899210,0cyclictest17280-21apt-get22:00:010
3182899210,0cyclictest0-21swapper/019:48:210
3182899210,0cyclictest0-21swapper/000:08:220
31841992020,0cyclictest30534-21apt-get21:23:223
31841992020,0cyclictest21576-21apt-get19:58:203
31841992020,0cyclictest0-21swapper/321:03:243
31841992020,0cyclictest0-21swapper/320:58:233
31841992020,0cyclictest0-21swapper/320:18:213
31841992019,0cyclictest23318-21apt-get21:08:213
3184199200,20cyclictest0-21swapper/300:08:223
3184199200,0cyclictest0-21swapper/323:18:213
3184199200,0cyclictest0-21swapper/322:13:193
31837992020,0cyclictest19180-21apt-get19:53:202
31837992020,0cyclictest0-21swapper/219:28:202
31837992020,0cyclictest0-21swapper/200:28:242
31837992018,1cyclictest32100-21munin-plugin-st22:29:592
31837992018,1cyclictest16319-21awk00:10:002
31837992018,1cyclictest0-21swapper/222:55:002
3183799200,20cyclictest0-21swapper/223:23:222
3183799200,20cyclictest0-21swapper/221:13:222
3183799200,20cyclictest0-21swapper/219:48:212
3183799200,0cyclictest2302-21apt-get19:18:212
3183799200,0cyclictest0-21swapper/222:48:252
31833992020,0cyclictest2993-21apt-get22:38:221
31833992020,0cyclictest0-21swapper/121:33:231
31833992020,0cyclictest0-21swapper/120:33:221
31833992020,0cyclictest0-21swapper/120:13:211
31833992020,0cyclictest0-21swapper/119:43:211
31833992020,0cyclictest0-21swapper/100:28:231
31833992020,0cyclictest0-21swapper/100:08:221
31833992019,1cyclictest27805-21apt-get22:23:211
31833992019,0cyclictest0-21swapper/119:38:201
31833992018,1cyclictest29370-21munin-run23:30:001
3183399200,20cyclictest0-21swapper/120:53:211
3183399200,0cyclictest0-21swapper/123:18:201
3183399200,0cyclictest0-21swapper/121:43:211
31828992020,0cyclictest16107-21apt-get20:53:220
31828992020,0cyclictest0-21swapper/022:48:240
31828992020,0cyclictest0-21swapper/022:35:000
31828992020,0cyclictest0-21swapper/022:18:210
31828992020,0cyclictest0-21swapper/021:08:200
31828992020,0cyclictest0-21swapper/020:48:220
31828992020,0cyclictest0-21swapper/020:33:220
31828992020,0cyclictest0-21swapper/019:38:200
31828992019,1cyclictest0-21swapper/000:28:240
31828992018,1cyclictest29874-21apt-get23:33:210
31828992018,1cyclictest0-21swapper/022:10:010
31841991919,0cyclictest25717-21apt-get21:13:223
31841991919,0cyclictest14386-21apt-get19:43:213
31841991919,0cyclictest0-21swapper/322:58:253
31841991919,0cyclictest0-21swapper/320:53:213
31841991919,0cyclictest0-21swapper/319:18:213
31841991918,1cyclictest0-21swapper/320:13:213
31837991919,0cyclictest15386-21apt-get21:58:242
31837991919,0cyclictest0-21swapper/222:23:212
31837991919,0cyclictest0-21swapper/220:53:212
31837991919,0cyclictest0-21swapper/220:38:192
31837991919,0cyclictest0-21swapper/220:18:222
31837991919,0cyclictest0-21swapper/200:23:212
31837991918,1cyclictest13057-21apt-get22:58:252
31837991917,1cyclictest0-21swapper/223:39:592
31837991917,1cyclictest0-21swapper/220:00:002
31833991919,0cyclictest0-21swapper/123:38:221
31833991919,0cyclictest0-21swapper/123:23:231
31833991919,0cyclictest0-21swapper/122:18:201
31833991919,0cyclictest0-21swapper/122:03:211
31833991919,0cyclictest0-21swapper/121:13:221
31833991919,0cyclictest0-21swapper/119:33:201
3183399190,18cyclictest0-21swapper/100:33:231
31828991919,0cyclictest0-21swapper/023:18:210
31828991919,0cyclictest0-21swapper/022:13:200
31828991919,0cyclictest0-21swapper/019:18:220
31828991919,0cyclictest0-21swapper/000:38:230
31828991918,0cyclictest32309-21apt-get19:13:200
31828991918,0cyclictest0-21swapper/023:53:240
31828991917,1cyclictest7226-21munin-run21:40:000
3182899190,19cyclictest0-21swapper/020:43:250
31841991818,0cyclictest0-21swapper/322:08:213
31841991818,0cyclictest0-21swapper/321:48:213
31841991818,0cyclictest0-21swapper/319:53:203
31841991818,0cyclictest0-21swapper/319:28:213
31841991817,1cyclictest6445-21apt-get20:33:223
31841991817,1cyclictest24448-21apt-get00:28:243
31837991818,0cyclictest0-21swapper/220:11:422
31837991818,0cyclictest0-21swapper/219:23:212
31833991818,0cyclictest28111-21apt-get21:18:181
31833991818,0cyclictest0-21swapper/123:53:241
31833991817,0cyclictest0-21swapper/100:38:221
31833991816,1cyclictest22805-21perf21:05:001
3183399180,3cyclictest0-21swapper/119:28:201
31828991818,0cyclictest0-21swapper/023:13:250
31828991818,0cyclictest0-21swapper/021:33:230
31828991818,0cyclictest0-21swapper/020:38:200
31828991818,0cyclictest0-21swapper/019:43:210
31828991817,0cyclictest0-21swapper/022:28:210
31828991816,1cyclictest14963-21sendmail-msp23:00:000
31828991816,1cyclictest0-21swapper/023:10:000
31841991717,0cyclictest0-21swapper/323:08:223
31841991717,0cyclictest0-21swapper/322:23:213
31841991715,1cyclictest5925-21latency_hist20:30:013
31841991715,1cyclictest1798-21munin-run19:15:003
31841991715,1cyclictest13886-21awk19:40:013
31837991717,0cyclictest1642-21apt-get20:23:212
31837991717,0cyclictest0-21swapper/222:33:212
31837991717,0cyclictest0-21swapper/220:43:252
31837991715,1cyclictest18702-21sh00:15:002
31833991714,2cyclictest28652-21sh20:10:001
31828991717,0cyclictest0-21swapper/023:43:210
31828991717,0cyclictest0-21swapper/021:53:210
31828991717,0cyclictest0-21swapper/019:53:210
31828991717,0cyclictest0-21swapper/019:28:200
31828991716,0cyclictest0-21swapper/021:03:230
31828991715,1cyclictest7741-21apt-get21:43:210
31841991616,0cyclictest0-21swapper/323:48:223
31841991616,0cyclictest0-21swapper/300:33:243
31841991615,1cyclictest2094-21apt-get22:35:013
31837991616,0cyclictest0-21swapper/221:43:212
31837991616,0cyclictest0-21swapper/221:28:222
31837991614,1cyclictest12044-21apt-get00:03:222
3183799160,1cyclictest29238-21apt-get00:38:232
3183799160,15cyclictest4869-21munin-run21:34:592
31833991616,0cyclictest0-21swapper/123:13:241
31833991616,0cyclictest0-21swapper/122:13:201
31833991615,1cyclictest0-21swapper/119:58:191
31833991614,1cyclictest7812-21apt-get22:48:251
31833991614,1cyclictest0-21swapper/121:08:221
31828991616,0cyclictest0-21swapper/023:28:230
31828991616,0cyclictest0-21swapper/023:23:230
31828991616,0cyclictest0-21swapper/000:33:230
31828991615,1cyclictest0-21swapper/019:58:200
31828991614,1cyclictest0-21swapper/022:53:250
31828991613,2cyclictest313-21systemd-journal21:20:010
3182899160,2cyclictest32201-21expr20:18:240
3182899160,2cyclictest2913-21ptp4l20:23:280
3182899160,15cyclictest17260-21diskstats00:13:230
3184199150,14cyclictest0-21swapper/321:52:413
3184199150,12cyclictest593-21dbus-daemon19:33:283
31837991515,0cyclictest0-21swapper/222:00:022
31837991515,0cyclictest0-21swapper/221:18:192
3183799150,1cyclictest0-21swapper/220:58:282
3183799150,14cyclictest7492-21ntp_states20:33:262
31833991515,0cyclictest0-21swapper/123:03:221
31833991515,0cyclictest0-21swapper/119:23:211
3183399150,1cyclictest0-21swapper/121:23:241
31828991515,0cyclictest0-21swapper/022:43:230
31841991414,0cyclictest0-21swapper/323:11:163
3184199140,14cyclictest0-21swapper/321:38:443
3184199140,14cyclictest0-21swapper/300:17:423
3184199140,0cyclictest0-21swapper/321:42:083
3184199140,0cyclictest0-21swapper/320:39:573
31837991414,0cyclictest0-21swapper/223:27:182
31837991414,0cyclictest0-21swapper/221:23:222
31837991414,0cyclictest0-21swapper/220:05:012
3183799140,14cyclictest0-21swapper/223:42:062
3183799140,14cyclictest0-21swapper/222:40:062
3183799140,14cyclictest0-21swapper/221:38:162
3183799140,14cyclictest0-21swapper/220:00:112
3183799140,14cyclictest0-21swapper/219:10:502
3183799140,0cyclictest0-21swapper/221:05:452
31833991414,0cyclictest0-21swapper/123:45:311
31833991414,0cyclictest0-21swapper/121:26:291
3183399140,14cyclictest0-21swapper/100:10:251
3183399140,0cyclictest0-21swapper/123:42:081
3183399140,0cyclictest0-21swapper/122:05:161
3183399140,0cyclictest0-21swapper/120:42:241
3183399140,0cyclictest0-21swapper/119:46:311
31828991414,0cyclictest0-21swapper/023:55:010
31828991414,0cyclictest0-21swapper/023:00:290
31828991414,0cyclictest0-21swapper/021:45:260
3182899140,14cyclictest0-21swapper/020:00:210
31841991313,0cyclictest0-21swapper/321:25:573
31828991313,0cyclictest0-21swapper/021:11:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional