You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 20:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Dec 23, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2214699270,20cyclictest21541-21apt-get11:35:083
22146992618,7cyclictest11211-21awk11:15:013
22146992420,4cyclictest0-21swapper/312:15:083
2214199240,23cyclictest32599-21apt-get09:45:061
22146992320,3cyclictest0-21swapper/308:00:063
22146992320,2cyclictest10281-21lockfile-create09:00:013
22143992323,0cyclictest0-21swapper/209:10:092
22141992321,1cyclictest28774-21sh10:45:001
2214199230,23cyclictest0-21swapper/112:30:071
2214199230,22cyclictest3646-21perf11:00:001
2214199230,1cyclictest11397-21apt07:55:011
2213699230,22cyclictest4216-21awk07:40:000
2213699230,22cyclictest16057-21latency_hist12:30:000
22146992220,1cyclictest18483-21munin-run12:35:003
2214699220,21cyclictest9543-21sleep10:05:003
2214699220,21cyclictest606-21dbus-daemon11:45:003
2214699220,21cyclictest15458-21turbostat.cron09:10:003
2214699220,21cyclictest0-21swapper/311:05:073
2214699220,21cyclictest0-21swapper/309:25:063
2214699220,21cyclictest0-21swapper/308:45:073
2214699220,21cyclictest0-21swapper/308:15:063
2214699220,21cyclictest0-21swapper/307:30:073
2214699220,1cyclictest606-21dbus-daemon08:40:013
2214699220,1cyclictest3547-21apt-get12:05:053
22143992220,1cyclictest21843-21apt-get10:30:062
2214399220,21cyclictest16332-21apt-get12:30:072
2214399220,21cyclictest16211-21latency_hist08:05:012
2214399220,21cyclictest0-21swapper/209:45:062
2214399220,21cyclictest0-21swapper/209:40:082
2214399220,1cyclictest622-21gdbus07:20:012
2214399220,1cyclictest4215-21wc07:40:002
2214399220,1cyclictest27786-21apt-get09:35:062
22141992220,1cyclictest9090-21apt-get11:10:071
22141992220,1cyclictest4205-21perf07:40:001
22141992220,1cyclictest12686-21basename09:05:001
22141992220,1cyclictest0-21swapper/108:25:001
2214199220,21cyclictest31502-21apt-get10:50:061
2214199220,21cyclictest23452-21cat08:20:001
2214199220,21cyclictest0-21swapper/111:40:071
2214199220,1cyclictest28264-21grep08:30:001
2214199220,1cyclictest20338-21munin-run09:20:001
22136992222,0cyclictest0-21swapper/011:35:080
22136992220,1cyclictest6039-21latency_hist11:05:000
2213699220,21cyclictest30931-21apt-get08:35:070
2213699220,21cyclictest29923-21dump-pmu-power09:40:010
2213699220,21cyclictest26414-21awk10:40:010
2213699220,21cyclictest26359-21apt-get11:45:070
2213699220,21cyclictest0-21swapper/012:05:050
2213699220,21cyclictest0-21swapper/010:15:060
2213699220,21cyclictest0-21swapper/009:10:080
2213699220,21cyclictest0-21swapper/007:55:070
2213699220,1cyclictest6872-21apt-get07:45:050
22146992120,1cyclictest5945-21apt-get12:10:083
22146992120,1cyclictest0-21swapper/307:55:073
22146992120,0cyclictest30203-21apt-get09:40:083
22146992118,3cyclictest0-21swapper/311:45:073
2214699210,20cyclictest16474-21apt-get08:05:073
2214699210,20cyclictest0-21swapper/312:35:083
2214699210,20cyclictest0-21swapper/309:00:063
2214699210,0cyclictest0-21swapper/311:25:083
2214699210,0cyclictest0-21swapper/311:00:063
2214699210,0cyclictest0-21swapper/308:30:063
22143992121,0cyclictest1145-21apt-get12:00:082
22143992121,0cyclictest0-21swapper/212:35:082
22143992121,0cyclictest0-21swapper/207:45:052
22143992120,1cyclictest12653-21apt-get09:05:022
22143992120,1cyclictest0-21swapper/212:20:092
22143992119,1cyclictest30897-21apt11:55:012
22143992118,2cyclictest1194-21idleruntime-cro10:55:002
2214399210,20cyclictest0-21swapper/207:55:072
2214399210,20cyclictest0-21swapper/207:20:072
2214399210,0cyclictest29058-21apt-get10:45:072
2214399210,0cyclictest14577-21apt-get10:15:062
2214399210,0cyclictest0-21swapper/208:50:082
22141992121,0cyclictest30203-21apt-get09:40:071
22141992121,0cyclictest0-21swapper/110:45:081
22141992120,0cyclictest31150-21apt-get11:55:071
22141992120,0cyclictest29576-21apt-get07:25:051
2214199210,21cyclictest0-21swapper/109:25:061
2214199210,21cyclictest0-21swapper/107:40:061
2214199210,0cyclictest13908-21apt-get11:20:111
2214199210,0cyclictest0-21swapper/112:15:081
2214199210,0cyclictest0-21swapper/112:10:081
2214199210,0cyclictest0-21swapper/110:15:061
2214199210,0cyclictest0-21swapper/110:10:071
22136992121,0cyclictest0-21swapper/011:20:110
22136992121,0cyclictest0-21swapper/009:50:070
22136992120,1cyclictest0-21swapper/007:50:070
22136992120,0cyclictest23747-21apt-get08:20:060
22136992119,1cyclictest31698-21dump-pmu-power07:30:000
22136992119,1cyclictest18592-21cron08:10:010
2213699210,21cyclictest0-21swapper/008:15:060
2213699210,0cyclictest0-21swapper/009:25:050
2213699210,0cyclictest0-21swapper/008:25:060
22146992020,0cyclictest10477-21apt-get12:20:033
22146992020,0cyclictest0-21swapper/310:15:063
22146992020,0cyclictest0-21swapper/308:10:083
22146992019,1cyclictest0-21swapper/312:25:073
22146992019,0cyclictest0-21swapper/307:15:083
22146992015,1cyclictest0-21swapper/309:35:063
2214699200,20cyclictest0-21swapper/310:35:113
2214699200,0cyclictest0-21swapper/308:40:073
2214699200,0cyclictest0-21swapper/307:35:053
22143992020,0cyclictest9270-21apt-get07:50:072
22143992020,0cyclictest0-21swapper/209:20:082
22143992020,0cyclictest0-21swapper/208:40:072
22143992020,0cyclictest0-21swapper/207:25:052
22143992019,1cyclictest24252-21apt-get10:35:102
22143992018,1cyclictest8426-21cron11:10:012
22143992018,1cyclictest22995-21apt-get09:25:062
22143992018,1cyclictest0-21swapper/210:10:072
2214399200,20cyclictest0-21swapper/211:18:092
2214399200,20cyclictest0-21swapper/210:55:072
2214399200,20cyclictest0-21swapper/210:40:092
2214399200,19cyclictest0-21swapper/211:10:022
2214399200,0cyclictest18870-21apt-get08:10:082
2214399200,0cyclictest13935-21apt-get12:25:072
2214399200,0cyclictest0-21swapper/210:25:052
2214399200,0cyclictest0-21swapper/210:05:082
2214399200,0cyclictest0-21swapper/209:55:062
2214399200,0cyclictest0-21swapper/208:45:072
2214399200,0cyclictest0-21swapper/208:25:072
22141992020,0cyclictest18731-21apt-get12:35:081
22141992020,0cyclictest0-21swapper/112:05:051
22141992020,0cyclictest0-21swapper/111:45:071
22141992020,0cyclictest0-21swapper/111:15:071
22141992020,0cyclictest0-21swapper/110:25:061
22141992020,0cyclictest0-21swapper/109:20:081
22141992020,0cyclictest0-21swapper/108:10:081
22141992020,0cyclictest0-21swapper/107:10:051
22141992019,0cyclictest0-21swapper/109:30:051
2214199200,19cyclictest0-21swapper/109:05:061
2214199200,0cyclictest0-21swapper/112:00:081
2214199200,0cyclictest0-21swapper/111:25:081
22136992020,0cyclictest3332-21apt-get08:45:080
22136992020,0cyclictest25390-21apt-get09:30:050
22136992020,0cyclictest0-21swapper/011:15:070
22136992020,0cyclictest0-21swapper/009:05:020
22136992020,0cyclictest0-21swapper/008:55:060
22136992019,1cyclictest9793-21apt-get10:05:080
22136992019,1cyclictest19444-21apt-get10:25:060
22136992019,0cyclictest0-21swapper/008:10:080
22136992018,1cyclictest6605-21dump-pmu-power07:45:000
22136992018,1cyclictest313-21systemd-journal12:00:010
2213699200,20cyclictest0-21swapper/012:20:090
2213699200,20cyclictest0-21swapper/010:20:060
2213699200,20cyclictest0-21swapper/009:20:080
2213699200,20cyclictest0-21swapper/009:15:080
2213699200,0cyclictest0-21swapper/012:00:080
2213699200,0cyclictest0-21swapper/011:25:020
2213699200,0cyclictest0-21swapper/007:20:070
22146991919,0cyclictest0-21swapper/310:30:063
22146991919,0cyclictest0-21swapper/310:05:083
22146991918,1cyclictest20596-21apt-get09:20:093
22146991918,0cyclictest26665-21apt-get10:40:093
22146991918,0cyclictest0-21swapper/307:45:053
22143991919,0cyclictest6609-21perf07:45:012
22143991919,0cyclictest3906-21apt-get11:00:062
22143991919,0cyclictest0-21swapper/211:45:002
22143991919,0cyclictest0-21swapper/211:25:022
22143991919,0cyclictest0-21swapper/208:30:072
2214399190,1cyclictest19145-21apt-get11:30:072
22141991919,0cyclictest8121-21apt-get08:55:071
22141991919,0cyclictest28536-21apt-get08:30:071
22141991919,0cyclictest0-21swapper/112:25:061
22141991919,0cyclictest0-21swapper/109:35:061
22141991919,0cyclictest0-21swapper/107:30:071
22141991918,0cyclictest17870-21munin-run09:15:001
22141991918,0cyclictest0-21swapper/108:40:071
22141991915,3cyclictest29303-21idleruntime-cro07:25:001
22136991919,0cyclictest28753-21apt-get11:50:070
22136991919,0cyclictest0-21swapper/011:30:070
22136991918,1cyclictest7397-21apt-get10:00:060
22136991918,1cyclictest0-21swapper/012:35:080
22146991818,0cyclictest0-21swapper/312:00:083
22146991818,0cyclictest0-21swapper/309:50:073
22143991818,0cyclictest22370-21apt-get07:10:052
22143991818,0cyclictest0-21swapper/212:10:082
22143991818,0cyclictest0-21swapper/211:20:112
22143991818,0cyclictest0-21swapper/209:15:092
22143991816,1cyclictest591-21cron08:40:012
22143991816,1cyclictest18616-21perf08:10:012
22143991816,1cyclictest0-21swapper/209:55:012
22143991815,2cyclictest5679-21latency_hist12:10:012
22141991818,0cyclictest0-21swapper/111:30:071
22141991818,0cyclictest0-21swapper/109:55:071
2214199180,0cyclictest0-21swapper/111:50:071
22136991818,0cyclictest926-21apt-get08:40:070
22136991818,0cyclictest0-21swapper/011:05:070
22136991818,0cyclictest0-21swapper/010:55:070
22136991818,0cyclictest0-21swapper/010:40:090
22136991818,0cyclictest0-21swapper/010:30:060
22136991818,0cyclictest0-21swapper/008:00:060
22136991816,1cyclictest10463-21sh12:20:010
2213699180,17cyclictest0-21swapper/011:10:070
22146991717,0cyclictest0-21swapper/311:55:073
22146991717,0cyclictest0-21swapper/310:45:393
22146991717,0cyclictest0-21swapper/308:25:063
22146991716,1cyclictest27183-21apt-get07:20:073
22146991716,0cyclictest15727-21apt-get09:10:083
22146991715,1cyclictest13644-21munin-run11:20:013
22143991717,0cyclictest0-21swapper/208:20:072
22143991717,0cyclictest0-21swapper/207:30:072
22141991717,0cyclictest11665-21apt-get07:55:071
22141991715,1cyclictest26416-21awk10:40:011
2214199170,16cyclictest14080-21apt-get08:00:061
22136991717,0cyclictest12187-21apt-get10:10:080
22136991717,0cyclictest0-21swapper/010:45:080
22136991715,1cyclictest8089-21munin-plugin-st12:15:010
22136991712,1cyclictest1705-21munin-run07:35:000
22146991614,1cyclictest16027-21sh11:25:013
22146991614,1cyclictest1-21systemd07:45:003
22146991614,1cyclictest0-21swapper/307:50:073
2214699160,15cyclictest0-21swapper/308:20:073
22143991616,0cyclictest10537-21apt-get09:00:062
22143991616,0cyclictest0-21swapper/211:55:072
22141991616,0cyclictest16997-21apt-get10:20:061
22141991616,0cyclictest0-21swapper/111:00:061
22141991616,0cyclictest0-21swapper/108:50:081
22141991616,0cyclictest0-21swapper/108:45:071
2214199160,16cyclictest11926-21perf10:10:001
22136991616,0cyclictest16332-21apt-get12:30:070
22136991616,0cyclictest0-21swapper/008:50:080
22136991615,0cyclictest0-21swapper/010:50:060
22136991614,1cyclictest24767-21apt-get07:15:080
22146991515,0cyclictest0-21swapper/310:20:063
22146991515,0cyclictest0-21swapper/309:15:083
22146991514,1cyclictest0-21swapper/307:25:053
2214699150,1cyclictest0-21swapper/311:30:083
2214699150,0cyclictest0-21swapper/310:25:063
22143991515,0cyclictest25390-21apt-get09:30:052
22143991515,0cyclictest0-21swapper/211:35:082
22143991515,0cyclictest0-21swapper/210:20:072
2214399150,14cyclictest0-21swapper/210:00:092
2214199150,14cyclictest0-21swapper/108:05:081
22136991515,0cyclictest0-21swapper/007:10:050
22146991414,0cyclictest0-21swapper/309:55:073
22146991414,0cyclictest0-21swapper/309:30:053
22146991414,0cyclictest0-21swapper/307:10:573
2214699140,14cyclictest0-21swapper/310:55:033
2214699140,14cyclictest0-21swapper/310:50:303
2214699140,14cyclictest0-21swapper/308:50:193
2214699140,0cyclictest0-21swapper/311:50:073
2214699140,0cyclictest0-21swapper/310:10:073
2214699140,0cyclictest0-21swapper/309:45:163
22143991414,0cyclictest0-21swapper/212:15:192
22143991414,0cyclictest0-21swapper/208:55:112
22143991414,0cyclictest0-21swapper/208:15:062
2214399140,14cyclictest0-21swapper/211:45:222
22141991414,0cyclictest0-21swapper/108:35:071
22141991414,0cyclictest0-21swapper/107:15:061
2214199140,14cyclictest1710-21apache211:05:291
2214199140,0cyclictest0-21swapper/109:51:161
22136991414,0cyclictest0-21swapper/009:55:090
22136991414,0cyclictest0-21swapper/009:40:070
22136991414,0cyclictest0-21swapper/009:00:050
2213699140,14cyclictest0-21swapper/011:40:080
2213699140,14cyclictest0-21swapper/009:45:120
2213699140,14cyclictest0-21swapper/008:30:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional