You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 22:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon Dec 22, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2758099430,42cyclictest7521-21munin-run12:05:010
27586992624,1cyclictest11317-21munin-run08:50:012
2758099260,25cyclictest29178-21apt-get08:20:040
2758699250,24cyclictest12470-21apt-get11:05:022
2758699250,24cyclictest12470-21apt-get11:05:022
2758099250,1cyclictest0-21swapper/007:25:010
2759099240,3cyclictest24144-21munin-run08:10:013
2758299241,22cyclictest19489-21munin-run11:20:011
2758299240,2cyclictest24105-21cron08:10:011
2758299240,23cyclictest0-21swapper/110:00:001
27590992323,0cyclictest0-21swapper/310:35:023
27590992322,1cyclictest11818-21apt-get11:05:023
27590992322,1cyclictest11818-21apt-get11:05:023
2759099230,22cyclictest27037-21idleruntime-cro11:35:003
27586992322,0cyclictest0-21swapper/209:00:022
2758699230,22cyclictest313-21systemd-journal10:45:002
2758699230,0cyclictest0-21swapper/212:10:022
2758299230,22cyclictest7352-21latency_hist12:05:011
2758299230,22cyclictest3364-21cron09:40:011
2758299230,22cyclictest304-21cron07:20:011
2758299230,1cyclictest0-21swapper/112:10:021
2758299230,1cyclictest0-21swapper/110:35:011
27580992321,1cyclictest31570-21apt-get08:25:020
27580992321,1cyclictest0-21swapper/011:05:020
27580992321,1cyclictest0-21swapper/011:05:020
2758099230,2cyclictest28570-21perf09:25:010
2758099230,22cyclictest17812-21perf10:10:010
2758099230,22cyclictest12954-21latency_hist10:00:000
2758099230,22cyclictest0-21swapper/012:30:000
2758099230,1cyclictest0-21swapper/008:50:010
27590992221,1cyclictest20458-21apt-get10:15:023
27590992220,1cyclictest10904-21apt-get08:50:013
27590992220,1cyclictest0-21swapper/312:05:023
2759099220,21cyclictest26501-21munin-run08:15:013
2759099220,21cyclictest16460-21apt-get09:00:023
2759099220,21cyclictest16460-21apt-get09:00:013
2759099220,21cyclictest12304-21apt-get07:45:023
2759099220,21cyclictest10538-21apt09:55:003
2759099220,21cyclictest0-21swapper/308:45:023
2759099220,1cyclictest3956-21apt-get08:35:043
27586992220,1cyclictest622-21gdbus11:20:012
27586992220,1cyclictest32139-21apt-get11:45:032
27586992220,1cyclictest313-21systemd-journal10:10:002
27586992220,1cyclictest24100-21apt-get08:10:012
27586992220,1cyclictest10550-21wc09:55:002
27586992219,2cyclictest16576-21munin-plugin-st09:00:012
2758699220,21cyclictest6371-21apt-get08:40:032
2758699220,21cyclictest27677-21apt-get10:30:022
2758699220,21cyclictest13707-21munin-run08:55:012
2758699220,21cyclictest0-21swapper/207:25:012
2758699220,1cyclictest8392-21diskstats12:05:032
2758699220,1cyclictest20216-21munin-run10:15:012
27582992220,1cyclictest313-21systemd-journal08:45:011
27582992220,1cyclictest0-21swapper/107:30:021
2758299220,21cyclictest19738-21apt-get11:20:051
2758299220,21cyclictest19568-21apt-get08:00:021
2758299220,21cyclictest0-21swapper/112:35:021
2758299220,21cyclictest0-21swapper/112:25:041
2758299220,21cyclictest0-21swapper/111:30:031
2758299220,1cyclictest9684-21apt-get11:00:031
2758299220,1cyclictest16564-21gpgv09:00:011
2758299220,1cyclictest16142-21apt-get09:00:031
2758299220,1cyclictest10904-21apt-get08:50:011
2758299220,1cyclictest0-21swapper/109:20:001
27580992222,0cyclictest0-21swapper/009:30:020
27580992221,0cyclictest0-21swapper/012:30:030
27580992220,1cyclictest4925-21munin-run12:00:010
27580992220,1cyclictest26468-21cron08:15:010
27580992220,1cyclictest22602-21idleruntime-cro10:20:010
2758099220,21cyclictest11449-21apt-config08:50:010
2758099220,21cyclictest0-21swapper/010:30:030
2758099220,21cyclictest0-21swapper/010:00:020
2758099220,21cyclictest0-21swapper/007:10:020
2758099220,1cyclictest3624-21apt-get09:40:020
2758099220,0cyclictest0-21swapper/009:25:030
27590992120,1cyclictest23747-21latency_hist09:15:003
27590992119,1cyclictest7319-21apt-get12:05:013
27590992119,1cyclictest19780-21munin-run12:30:003
2759099210,21cyclictest0-21swapper/309:30:023
2759099210,21cyclictest0-21swapper/308:30:023
2759099210,20cyclictest0-21swapper/308:45:013
2759099210,0cyclictest0-21swapper/310:45:023
27586992120,1cyclictest4872-21apt-get10:50:032
27586992119,1cyclictest3356-21sh09:40:012
27586992119,1cyclictest26142-21apt-get09:19:592
2758699210,20cyclictest29909-21apt-get10:35:022
2758699210,20cyclictest0-21swapper/212:30:032
2758699210,20cyclictest0-21swapper/212:20:042
2758699210,20cyclictest0-21swapper/211:25:032
2758699210,20cyclictest0-21swapper/207:19:592
2758699210,0cyclictest27318-21apt-get11:35:032
2758699210,0cyclictest0-21swapper/212:15:052
27582992120,0cyclictest0-21swapper/109:05:021
27582992119,1cyclictest6016-21apt-get09:45:021
27582992119,1cyclictest2524-21munin-run11:55:011
27582992119,1cyclictest10904-21apt-get08:50:011
2758299210,21cyclictest0-21swapper/107:10:021
2758299210,20cyclictest0-21swapper/111:25:031
2758299210,20cyclictest0-21swapper/110:10:041
2758299210,0cyclictest0-21swapper/107:25:021
27580992121,0cyclictest0-21swapper/007:55:030
27580992119,1cyclictest12763-21apt-get12:15:050
2758099210,20cyclictest0-21swapper/007:25:020
2758099210,1cyclictest29909-21apt-get10:35:020
2758099210,1cyclictest16574-21munin-run09:00:010
2758099210,1cyclictest1-21systemd10:15:010
2758099210,0cyclictest0-21swapper/008:15:020
27590992020,0cyclictest9911-21apt-get07:40:013
27590992020,0cyclictest29743-21apt-get11:40:033
27590992020,0cyclictest22419-21apt-get12:35:023
27590992020,0cyclictest17313-21apt-get11:15:023
27590992020,0cyclictest10805-21apt-get09:55:013
27590992020,0cyclictest0-21swapper/311:55:033
27590992020,0cyclictest0-21swapper/311:20:053
27590992020,0cyclictest0-21swapper/310:55:043
27590992020,0cyclictest0-21swapper/309:40:033
27590992020,0cyclictest0-21swapper/309:05:023
27590992018,1cyclictest9664-21lockfile-create07:40:003
27590992018,1cyclictest11835-21munin-run11:05:013
2759099200,19cyclictest0-21swapper/311:45:033
2759099200,0cyclictest0-21swapper/311:35:033
2759099200,0cyclictest0-21swapper/309:45:023
27586992020,0cyclictest5183-21apt-get12:00:032
27586992020,0cyclictest0-21swapper/212:35:012
27586992020,0cyclictest0-21swapper/210:20:022
27586992020,0cyclictest0-21swapper/210:15:022
27586992020,0cyclictest0-21swapper/209:55:012
27586992020,0cyclictest0-21swapper/208:20:042
27586992020,0cyclictest0-21swapper/207:50:022
27586992020,0cyclictest0-21swapper/207:40:012
27586992020,0cyclictest0-21swapper/207:35:022
27586992018,1cyclictest5733-21cron09:45:012
27586992018,1cyclictest29954-21munin-run07:15:012
2758699200,20cyclictest0-21swapper/207:55:022
2758699200,0cyclictest0-21swapper/211:30:042
2758699200,0cyclictest0-21swapper/210:55:032
27582992020,0cyclictest0-21swapper/112:15:051
27582992020,0cyclictest0-21swapper/111:55:021
27582992020,0cyclictest0-21swapper/111:10:021
27582992020,0cyclictest0-21swapper/109:25:031
27582992020,0cyclictest0-21swapper/108:25:021
27582992020,0cyclictest0-21swapper/107:40:011
27582992019,1cyclictest31217-21apt-get09:30:021
27582992019,1cyclictest0-21swapper/110:25:031
27582992019,0cyclictest0-21swapper/109:50:031
27582992018,1cyclictest0-21swapper/111:05:021
27582992018,1cyclictest0-21swapper/111:05:021
2758299200,20cyclictest0-21swapper/110:45:021
2758299200,0cyclictest0-21swapper/110:35:021
27580992020,0cyclictest32334-21apt-get07:19:590
27580992020,0cyclictest0-21swapper/011:30:030
27580992020,0cyclictest0-21swapper/011:25:030
27580992020,0cyclictest0-21swapper/010:55:040
27580992020,0cyclictest0-21swapper/009:10:030
27580992020,0cyclictest0-21swapper/008:40:030
27580992019,1cyclictest0-21swapper/009:00:020
27590991919,0cyclictest22129-21apt-get11:25:033
27590991919,0cyclictest0-21swapper/312:15:053
27590991919,0cyclictest0-21swapper/312:10:023
27590991919,0cyclictest0-21swapper/309:19:593
27590991919,0cyclictest0-21swapper/308:25:023
27590991919,0cyclictest0-21swapper/307:50:023
27590991917,1cyclictest28883-21turbostat.cron08:20:003
27590991916,2cyclictest25032-21cut10:25:013
2759099190,0cyclictest0-21swapper/310:30:033
27586991919,0cyclictest0-21swapper/211:10:022
27586991919,0cyclictest0-21swapper/209:30:022
27586991919,0cyclictest0-21swapper/209:05:022
27586991919,0cyclictest0-21swapper/208:00:022
27586991919,0cyclictest0-21swapper/207:45:022
27586991919,0cyclictest0-21swapper/207:25:022
27586991917,1cyclictest7150-21munin-run07:35:002
27582991919,0cyclictest0-21swapper/110:40:031
27582991919,0cyclictest0-21swapper/110:00:011
27582991919,0cyclictest0-21swapper/109:40:031
27582991919,0cyclictest0-21swapper/109:10:031
27582991915,2cyclictest0-21swapper/108:35:031
27580991919,0cyclictest0-21swapper/010:50:030
27580991919,0cyclictest0-21swapper/010:20:020
27580991919,0cyclictest0-21swapper/007:35:020
27580991918,1cyclictest24002-21apt-get09:15:020
27580991917,1cyclictest0-21swapper/007:50:010
27590991818,0cyclictest0-21swapper/310:00:023
27590991818,0cyclictest0-21swapper/307:15:023
27590991816,1cyclictest2480-21apt-get07:25:013
27590991815,2cyclictest4719-21cron07:30:003
27590991815,2cyclictest28542-21cron09:25:013
27586991818,0cyclictest0-21swapper/211:00:032
27586991818,0cyclictest0-21swapper/209:10:032
27582991818,0cyclictest20025-21apt-get12:30:031
27582991817,1cyclictest26748-21apt-get08:15:021
27582991817,1cyclictest12304-21apt-get07:45:021
27580991816,1cyclictest0-21swapper/012:40:010
27590991717,0cyclictest19568-21apt-get08:00:033
27590991717,0cyclictest0-21swapper/312:30:033
27590991716,1cyclictest15235-21apt-get12:20:043
27590991715,2cyclictest31326-21munin-run08:25:003
27590991715,1cyclictest17061-21basename11:15:013
27586991717,0cyclictest0-21swapper/212:25:042
27586991717,0cyclictest0-21swapper/211:55:032
27586991717,0cyclictest0-21swapper/211:20:052
27586991717,0cyclictest0-21swapper/209:45:022
27586991717,0cyclictest0-21swapper/209:25:032
27586991716,0cyclictest2473-21apt-get10:45:022
2758699170,16cyclictest0-21swapper/208:15:022
27582991717,0cyclictest7391-21apt-get07:35:021
27582991717,0cyclictest0-21swapper/112:20:041
27582991717,0cyclictest0-21swapper/108:20:051
27582991716,0cyclictest17150-21apt-get07:55:031
27582991714,2cyclictest22616-21perf10:20:011
2758099172,14cyclictest12023-21cron07:45:000
27580991717,0cyclictest0-21swapper/012:20:040
27580991717,0cyclictest0-21swapper/008:00:030
27580991717,0cyclictest0-21swapper/007:30:030
27580991716,1cyclictest29482-21perf11:40:000
27590991616,0cyclictest0-21swapper/307:30:033
27590991614,1cyclictest19323-21sendmail-msp08:00:013
2759099160,15cyclictest27598-21cat10:30:013
27586991616,0cyclictest13221-21apt-get10:00:022
27586991616,0cyclictest0-21swapper/208:26:232
27586991614,1cyclictest0-21swapper/211:55:012
27582991616,0cyclictest0-21swapper/111:45:041
27582991615,0cyclictest0-21swapper/110:05:041
27582991614,1cyclictest29494-21grep11:40:001
27582991614,1cyclictest0-21swapper/109:20:091
27580991616,0cyclictest14920-21apt-get11:10:020
27580991616,0cyclictest0-21swapper/011:45:040
27580991616,0cyclictest0-21swapper/011:20:040
27580991616,0cyclictest0-21swapper/011:15:020
27580991616,0cyclictest0-21swapper/009:50:020
27580991616,0cyclictest0-21swapper/008:10:010
27580991615,1cyclictest14700-21apt-get07:50:010
27580991614,1cyclictest2473-21apt-get10:45:020
27580991614,1cyclictest2225-21perf10:45:000
2758099161,3cyclictest27391-21cron10:30:010
2758099160,1cyclictest7347-21apt-get12:05:020
27582991515,0cyclictest0-21swapper/107:50:011
2758099153,5cyclictest0-21swapper/011:40:020
27590991414,0cyclictest0-21swapper/310:40:033
27590991413,1cyclictest28823-21apt-get09:25:023
2759099140,14cyclictest0-21swapper/310:51:013
2759099140,0cyclictest0-21swapper/311:50:423
2759099140,0cyclictest0-21swapper/310:10:533
2759099140,0cyclictest0-21swapper/310:05:403
2759099140,0cyclictest0-21swapper/309:35:453
2759099140,0cyclictest0-21swapper/307:11:193
27586991414,0cyclictest0-21swapper/208:35:042
2758699140,14cyclictest0-21swapper/211:42:102
2758699140,14cyclictest0-21swapper/209:20:302
2758699140,14cyclictest0-21swapper/208:30:532
2758699140,14cyclictest0-21swapper/208:11:252
27582991414,0cyclictest0-21swapper/111:40:201
27582991414,0cyclictest0-21swapper/110:55:341
2758299140,6cyclictest0-21swapper/110:50:031
2758299140,14cyclictest0-21swapper/112:05:341
2758299140,0cyclictest0-21swapper/108:30:161
2758299140,0cyclictest0-21swapper/108:10:341
27580991414,0cyclictest0-21swapper/008:31:160
27580991412,1cyclictest0-21swapper/011:00:040
2758099140,14cyclictest0-21swapper/011:50:060
2758099140,14cyclictest0-21swapper/009:45:460
2758099140,14cyclictest0-21swapper/009:35:340
2758099140,14cyclictest0-21swapper/009:05:080
2758099140,14cyclictest0-21swapper/008:35:180
2758099140,0cyclictest0-21swapper/012:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional