You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 08:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sat Dec 27, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2082799260,25cyclictest25960-21cron19:20:011
20825992625,1cyclictest27810-21cron22:45:010
2083199240,23cyclictest605-21avahi-daemon22:45:012
2082799240,23cyclictest0-21swapper/120:25:241
20835992322,1cyclictest22032-21apt-get21:25:233
2083599230,22cyclictest26004-21sendmail-msp19:20:013
2083199230,2cyclictest1918-21cron00:05:012
2083199230,22cyclictest9802-21latency_hist23:15:012
2083199230,22cyclictest7408-21perf23:10:002
2083199230,22cyclictest22232-21cron23:40:012
2083199230,1cyclictest0-21swapper/221:05:222
20827992323,0cyclictest0-21swapper/121:15:251
2082799230,22cyclictest18209-21munin-plugin-st22:25:011
2082799230,22cyclictest10924-21cron22:10:001
20825992322,1cyclictest11967-21apt-get21:05:220
2082599230,23cyclictest0-21swapper/020:00:250
2082599230,22cyclictest313-21systemd-journal00:05:010
20835992222,0cyclictest0-21swapper/319:20:233
20835992220,1cyclictest18776-21basename00:40:003
2083599220,21cyclictest14651-21cron23:25:013
2083599220,21cyclictest0-21swapper/321:35:233
2083599220,1cyclictest2032-21latency_hist20:45:013
2083599220,1cyclictest1962-21munin-run00:05:013
20831992221,1cyclictest0-21swapper/219:15:022
20831992220,2cyclictest2055-21munin-run20:45:012
20831992220,1cyclictest10369-21perf19:55:012
2083199220,21cyclictest9151-21tr00:20:012
2083199220,21cyclictest3175-21dump-pmu-power19:40:002
2083199220,21cyclictest25414-21tr22:40:012
2083199220,21cyclictest16627-21apt-get00:35:232
2083199220,21cyclictest0-21swapper/221:35:232
2083199220,21cyclictest0-21swapper/200:20:242
2083199220,0cyclictest4769-21apt-get20:50:262
2083199220,0cyclictest0-21swapper/223:50:272
20827992220,1cyclictest313-21systemd-journal21:55:011
20827992220,1cyclictest0-21swapper/121:15:001
20827992219,2cyclictest606-21dbus-daemon19:35:001
2082799220,2cyclictest4474-21cron20:50:011
2082799220,21cyclictest17914-21apt-get20:10:251
2082799220,21cyclictest0-21swapper/123:45:251
2082799220,21cyclictest0-21swapper/123:20:231
2082799220,21cyclictest0-21swapper/122:10:251
2082799220,21cyclictest0-21swapper/120:35:251
2082799220,21cyclictest0-21swapper/119:20:241
2082799220,1cyclictest31351-21turbostat21:45:011
2082799220,1cyclictest16354-21munin-run00:35:001
20825992221,1cyclictest26823-21apt-get21:35:230
20825992220,1cyclictest9801-21perf23:15:010
20825992220,1cyclictest606-21dbus-daemon23:40:010
20825992220,1cyclictest14241-21apt-get00:30:290
2082599220,22cyclictest0-21swapper/023:00:250
2082599220,22cyclictest0-21swapper/020:50:260
2082599220,21cyclictest8830-21apt-get22:05:270
2082599220,21cyclictest16815-21apt-get21:15:250
2082599220,21cyclictest0-21swapper/020:25:000
20835992121,0cyclictest0-21swapper/320:15:263
20835992120,1cyclictest20889-21apt-get22:30:283
20835992119,1cyclictest0-21swapper/320:00:013
20835992119,1cyclictest0-21swapper/300:30:003
2083599210,21cyclictest16088-21apt-get22:20:253
2083599210,21cyclictest0-21swapper/300:20:243
2083599210,20cyclictest0-21swapper/320:50:263
2083599210,1cyclictest0-21swapper/323:50:263
2083599210,1cyclictest0-21swapper/300:05:243
2083599210,1cyclictest0-21swapper/300:05:243
2083599210,0cyclictest0-21swapper/323:10:253
20831992120,0cyclictest0-21swapper/222:10:262
20831992119,1cyclictest6156-21munin-run22:00:012
2083199210,20cyclictest0-21swapper/220:45:252
2083199210,1cyclictest0-21swapper/219:20:242
2083199210,0cyclictest29743-21apt-get23:55:272
20827992121,0cyclictest0-21swapper/121:55:241
20827992120,0cyclictest22736-21apt-get20:20:241
20827992120,0cyclictest0-21swapper/120:55:261
20827992119,1cyclictest9165-21grep00:20:011
20827992118,2cyclictest24642-21cron23:45:001
2082799210,21cyclictest0-21swapper/119:25:241
2082799210,20cyclictest0-21swapper/120:40:241
2082799210,20cyclictest0-21swapper/119:10:231
2082799210,20cyclictest0-21swapper/100:20:241
2082799210,0cyclictest1045-21apt-get19:35:231
20825992121,0cyclictest0-21swapper/023:55:270
20825992121,0cyclictest0-21swapper/023:40:260
20825992121,0cyclictest0-21swapper/019:15:230
20825992120,1cyclictest26279-21apt-get19:20:240
20825992120,1cyclictest25371-21cron22:40:010
2082599210,21cyclictest0-21swapper/023:05:240
2082599210,21cyclictest0-21swapper/019:35:230
2082599210,20cyclictest0-21swapper/023:50:270
2082599210,0cyclictest28674-21apt-get19:25:240
20835992020,0cyclictest29921-21apt-get20:35:253
20835992020,0cyclictest2893-21apt-get23:00:253
20835992020,0cyclictest11222-21apt-get22:10:253
20835992020,0cyclictest0-21swapper/322:40:253
20835992020,0cyclictest0-21swapper/321:30:253
20835992019,1cyclictest24949-21apt-get23:45:253
2083599200,20cyclictest0-21swapper/323:40:263
2083599200,20cyclictest0-21swapper/321:50:263
2083599200,0cyclictest13671-21apt-get22:15:273
2083599200,0cyclictest0-21swapper/321:15:253
20831992020,0cyclictest22553-21apt-get23:40:262
20831992020,0cyclictest0-21swapper/223:45:252
20831992020,0cyclictest0-21swapper/223:00:252
20831992020,0cyclictest0-21swapper/222:45:262
20831992020,0cyclictest0-21swapper/221:25:232
20831992019,1cyclictest0-21swapper/221:20:022
20831992019,0cyclictest0-21swapper/223:25:252
2083199200,0cyclictest17734-21apt-get23:30:262
2083199200,0cyclictest0-21swapper/219:30:262
20827992020,0cyclictest0-21swapper/123:50:271
20827992020,0cyclictest0-21swapper/122:40:251
20827992020,0cyclictest0-21swapper/122:35:251
20827992020,0cyclictest0-21swapper/119:40:241
20827992018,1cyclictest12766-21cron20:00:011
2082799200,20cyclictest0-21swapper/120:50:251
2082799200,19cyclictest2230-21apt-get00:05:241
2082799200,19cyclictest2230-21apt-get00:05:241
2082799200,0cyclictest0-21swapper/123:00:251
20825992020,0cyclictest9443-21apt-get00:20:240
20825992020,0cyclictest0-21swapper/023:30:260
20825992020,0cyclictest0-21swapper/022:10:260
20825992020,0cyclictest0-21swapper/000:35:230
2082599200,20cyclictest0-21swapper/022:50:230
2082599200,20cyclictest0-21swapper/022:25:250
2082599200,20cyclictest0-21swapper/021:10:240
2082599200,20cyclictest0-21swapper/020:10:250
2082599200,0cyclictest0-21swapper/022:30:280
2082599200,0cyclictest0-21swapper/019:30:270
20835991919,0cyclictest7165-21apt-get20:55:273
20835991919,0cyclictest0-21swapper/322:05:273
20835991919,0cyclictest0-21swapper/321:40:243
20835991919,0cyclictest0-21swapper/320:10:013
20835991919,0cyclictest0-21swapper/319:45:243
20835991917,1cyclictest32585-21sh22:55:003
20835991917,1cyclictest31072-21apt-get19:30:263
20831991919,0cyclictest12491-21apt-get23:20:232
20831991919,0cyclictest0-21swapper/220:35:252
20831991919,0cyclictest0-21swapper/200:30:302
20831991919,0cyclictest0-21swapper/200:05:242
20831991919,0cyclictest0-21swapper/200:05:242
20831991918,1cyclictest9578-21apt-get21:00:242
20831991918,1cyclictest26535-21dump-pmu-power21:35:002
20831991918,1cyclictest0-21swapper/222:15:272
20831991918,1cyclictest0-21swapper/221:40:242
20831991916,2cyclictest27252-21awk20:30:002
2083199190,1cyclictest1617-21apt-get21:50:262
20827991919,0cyclictest0-21swapper/123:35:261
20827991919,0cyclictest0-21swapper/123:10:251
20827991919,0cyclictest0-21swapper/120:15:251
20827991919,0cyclictest0-21swapper/100:25:261
20827991917,1cyclictest606-21dbus-daemon23:20:011
20827991917,1cyclictest1959-21perf00:05:011
20825991919,0cyclictest2325-21apt-get20:45:250
20825991919,0cyclictest15517-21apt-get20:05:240
20825991919,0cyclictest0-21swapper/023:20:220
20825991919,0cyclictest0-21swapper/023:15:260
20825991918,1cyclictest15334-21apt-get23:25:250
20825991918,1cyclictest0-21swapper/022:45:260
20825991917,1cyclictest2051-21awk20:45:010
20825991917,1cyclictest10388-21awk19:55:010
2082599190,19cyclictest19150-21kworker/0:220:30:140
2082599190,0cyclictest0-21swapper/021:45:250
20835991818,0cyclictest22736-21apt-get20:20:243
20835991818,0cyclictest0-21swapper/323:25:253
20835991818,0cyclictest0-21swapper/323:15:253
20835991818,0cyclictest0-21swapper/322:45:263
20835991818,0cyclictest0-21swapper/319:25:243
20835991817,1cyclictest23283-21apt-get22:35:243
20835991817,1cyclictest1045-21apt-get19:35:233
20835991817,0cyclictest0-21swapper/323:05:233
20835991816,1cyclictest29619-21awk20:35:003
20831991818,0cyclictest0-21swapper/222:25:252
20831991817,1cyclictest14420-21apt-get21:10:242
20831991817,0cyclictest0-21swapper/220:05:242
2083199180,17cyclictest600-21systemd-logind21:15:332
20827991818,0cyclictest425-21apt-get22:55:261
20827991818,0cyclictest28097-21apt-get22:45:261
20827991818,0cyclictest0-21swapper/122:15:271
20827991818,0cyclictest0-21swapper/121:25:001
20827991818,0cyclictest0-21swapper/121:05:221
20827991817,0cyclictest0-21swapper/121:00:241
2082799180,1cyclictest13072-21apt-get20:00:251
20825991818,0cyclictest0-21swapper/023:45:250
20825991818,0cyclictest0-21swapper/021:25:230
20825991817,1cyclictest1-21systemd22:00:010
20825991816,1cyclictest606-21dbus-daemon21:35:000
20835991717,0cyclictest0-21swapper/322:00:253
20835991717,0cyclictest0-21swapper/319:50:233
20831991717,0cyclictest0-21swapper/220:55:272
20831991717,0cyclictest0-21swapper/220:10:252
20831991717,0cyclictest0-21swapper/200:10:262
20831991716,1cyclictest8830-21apt-get22:05:282
20831991716,0cyclictest5868-21apt-get19:45:242
2083199170,0cyclictest0-21swapper/219:10:242
20827991717,0cyclictest6436-21apt-get22:00:251
20827991717,0cyclictest0-21swapper/122:50:231
20827991717,0cyclictest0-21swapper/122:25:251
20827991717,0cyclictest0-21swapper/119:50:231
2082799170,16cyclictest7457-21cut23:10:011
20825991717,0cyclictest0-21swapper/021:20:020
20825991717,0cyclictest0-21swapper/020:35:250
20825991717,0cyclictest0-21swapper/000:05:240
20825991717,0cyclictest0-21swapper/000:05:240
20825991716,1cyclictest0-21swapper/000:15:260
20835991616,0cyclictest4017-21apt-get21:55:243
20835991616,0cyclictest0-21swapper/322:25:253
20835991616,0cyclictest0-21swapper/300:15:013
20835991615,1cyclictest0-21swapper/320:10:243
20835991614,1cyclictest16543-21munin-run21:15:003
2083599160,15cyclictest31858-21turbostat.cron00:00:003
2083599160,15cyclictest21407-21cat19:10:253
2083599160,15cyclictest0-21swapper/319:40:303
20831991616,0cyclictest10655-21apt-get19:55:232
20831991616,0cyclictest0-21swapper/222:54:012
20831991616,0cyclictest0-21swapper/222:00:252
20831991616,0cyclictest0-21swapper/220:00:242
2083199160,12cyclictest610-21wpa_supplicant22:30:272
20827991616,0cyclictest0-21swapper/123:30:261
20827991616,0cyclictest0-21swapper/119:45:241
20827991614,1cyclictest0-21swapper/121:35:281
20827991614,1cyclictest0-21swapper/121:25:231
20825991616,0cyclictest0-21swapper/022:15:270
20825991616,0cyclictest0-21swapper/021:40:240
20825991616,0cyclictest0-21swapper/019:10:240
20835991515,0cyclictest0-21swapper/321:20:283
20835991515,0cyclictest0-21swapper/300:30:293
20835991514,1cyclictest425-21apt-get22:55:253
2083599150,4cyclictest0-21swapper/320:45:253
20831991514,1cyclictest3475-21apt-get19:40:242
20831991514,0cyclictest12160-21cron23:20:012
2083199150,14cyclictest0-21swapper/220:16:252
20827991515,0cyclictest0-21swapper/123:55:271
20827991515,0cyclictest0-21swapper/121:45:251
20827991515,0cyclictest0-21swapper/100:35:231
20827991513,1cyclictest28692-21grep20:30:311
20825991515,0cyclictest0-21swapper/021:00:240
20825991514,1cyclictest0-21swapper/020:30:000
20825991514,1cyclictest0-21swapper/019:45:240
20825991514,1cyclictest0-21swapper/000:10:260
2082599150,14cyclictest13936-21ls00:30:000
2083599140,14cyclictest0-21swapper/323:36:283
2083599140,14cyclictest0-21swapper/323:30:013
2083599140,14cyclictest0-21swapper/321:45:193
2083599140,14cyclictest0-21swapper/321:05:163
2083599140,14cyclictest0-21swapper/321:00:563
2083599140,14cyclictest0-21swapper/320:25:513
2083599140,14cyclictest0-21swapper/320:02:233
2083599140,0cyclictest0-21swapper/300:15:163
20831991414,0cyclictest0-21swapper/222:21:112
2083199140,14cyclictest0-21swapper/222:56:192
2083199140,14cyclictest0-21swapper/221:45:082
2083199140,14cyclictest0-21swapper/220:20:112
2083199140,0cyclictest0-21swapper/220:31:332
2082799140,0cyclictest0-21swapper/123:26:411
2082799140,0cyclictest0-21swapper/121:30:131
20825991414,0cyclictest0-21swapper/022:00:250
20825991414,0cyclictest0-21swapper/021:50:260
20825991414,0cyclictest0-21swapper/019:55:100
2082599140,14cyclictest0-21swapper/020:55:150
2082599140,14cyclictest0-21swapper/020:15:490
2082599140,0cyclictest0-21swapper/022:55:380
2082599140,0cyclictest0-21swapper/022:20:120
2082599140,0cyclictest0-21swapper/019:40:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional