You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-04 - 11:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sun Jan 04, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230099260,3cyclictest16006-21wc20:45:000
2303992523,1cyclictest8039-21apt-get23:46:073
2303992523,1cyclictest28388-21awk21:10:013
230299250,24cyclictest9906-21munin-run19:25:012
230299250,24cyclictest9906-21munin-run19:25:012
2301992523,1cyclictest0-21swapper/120:26:081
230399242,21cyclictest2483-21cron23:35:013
230399240,22cyclictest313-21systemd-journal23:05:003
230199241,21cyclictest313-21systemd-journal20:00:001
2300992423,0cyclictest0-21swapper/020:26:080
230099240,1cyclictest606-21dbus-daemon20:55:010
2302992321,1cyclictest0-21swapper/223:40:002
2302992320,2cyclictest12497-21apt-get22:50:012
2301992321,1cyclictest8335-21apt-get21:36:061
230199230,22cyclictest31877-21apt-get20:11:051
230199230,22cyclictest3183-21apt-get22:31:061
230099230,22cyclictest1868-21munin-run00:40:000
230099230,22cyclictest11191-21awk20:35:000
230099230,1cyclictest0-21swapper/019:16:060
2303992221,0cyclictest25197-21apt-get22:11:063
2303992220,1cyclictest0-21swapper/300:10:013
2303992220,1cyclictest0-21swapper/300:10:013
2303992219,2cyclictest7635-21ls22:40:013
230399220,21cyclictest0-21swapper/321:26:073
230399220,21cyclictest0-21swapper/319:31:073
230399220,1cyclictest31865-21munin-run00:35:003
230399220,1cyclictest0-21swapper/322:50:023
230399220,1cyclictest0-21swapper/320:55:023
2302992222,0cyclictest0-21swapper/222:50:022
2302992218,3cyclictest4294-21apt-get20:21:092
230299220,21cyclictest27072-21perf00:25:012
230299220,21cyclictest26339-21apt-get21:06:052
230299220,21cyclictest22581-21apt-get00:16:082
230299220,21cyclictest11209-21munin-run20:35:002
230299220,1cyclictest2501-21perf23:35:012
2301992220,1cyclictest7835-21apt-get19:21:061
2301992220,1cyclictest7835-21apt-get19:21:061
2301992220,1cyclictest27263-21munin-run22:15:001
2301992220,1cyclictest24668-21perf00:20:011
2301992220,1cyclictest10054-21turbostat22:45:011
230199220,21cyclictest24872-21grep22:10:001
230199220,21cyclictest10752-21apt-get21:41:041
230199220,21cyclictest0-21swapper/122:21:061
230199220,1cyclictest18738-21apt-get20:51:051
230199220,1cyclictest1845-21perf00:40:001
2300992220,1cyclictest17794-21apt-get00:06:080
2300992220,1cyclictest17794-21apt-get00:06:080
2300992220,1cyclictest10061-21wc22:45:010
230099221,20cyclictest26704-21cron20:00:000
230099220,22cyclictest0-21swapper/021:11:060
230099220,21cyclictest24871-21munin-run22:10:000
230099220,21cyclictest1862-21apt-get20:16:050
230099220,21cyclictest0-21swapper/022:46:070
230099220,21cyclictest0-21swapper/021:41:040
230099220,1cyclictest0-21swapper/021:40:010
2303992121,0cyclictest0-21swapper/322:26:073
2303992120,0cyclictest0-21swapper/320:11:053
2303992119,1cyclictest606-21dbus-daemon20:55:013
2303992119,1cyclictest28044-21apt-get23:21:053
2303992119,1cyclictest25626-21apt-get23:16:073
2303992119,1cyclictest24659-21dump-pmu-power00:20:013
2303992119,1cyclictest22473-21munin-run22:05:003
2303992119,1cyclictest0-21swapper/321:56:073
230399210,21cyclictest0-21swapper/320:21:093
230399210,21cyclictest0-21swapper/319:41:053
230399210,20cyclictest0-21swapper/323:41:083
230399210,20cyclictest0-21swapper/322:31:063
230399210,20cyclictest0-21swapper/320:41:063
230399210,20cyclictest0-21swapper/319:21:063
230399210,20cyclictest0-21swapper/319:21:063
230399210,1cyclictest27091-21apt-get20:01:053
230399210,0cyclictest0-21swapper/323:35:033
230399210,0cyclictest0-21swapper/322:16:083
2302992121,0cyclictest0-21swapper/219:46:052
2302992119,1cyclictest29661-21apt-get22:20:002
230299210,2cyclictest3933-21sh20:20:012
230299210,20cyclictest751-21apt-get22:26:072
230299210,20cyclictest15268-21awk21:50:012
230299210,20cyclictest0-21swapper/223:46:072
2301992121,0cyclictest0-21swapper/123:26:061
2301992120,0cyclictest22838-21apt-get23:11:081
2301992120,0cyclictest15074-21apt-get19:36:061
2301992120,0cyclictest0-21swapper/100:06:081
2301992120,0cyclictest0-21swapper/100:06:081
2301992119,1cyclictest0-21swapper/119:20:011
230199210,20cyclictest0-21swapper/121:06:061
230199210,20cyclictest0-21swapper/100:11:061
230199210,1cyclictest211rcuc/122:40:011
230199210,1cyclictest10234-21apt-get19:26:101
230199210,1cyclictest0-21swapper/120:16:051
230199210,0cyclictest24889-21apt-get23:15:021
230199210,0cyclictest12497-21apt-get22:50:031
230199210,0cyclictest0-21swapper/120:41:061
2300992121,0cyclictest0-21swapper/023:26:060
2300992120,1cyclictest24653-21idleruntime-cro00:20:010
2300992120,0cyclictest751-21apt-get22:26:060
2300992119,1cyclictest20068-21sendmail-msp22:00:010
230099210,21cyclictest0-21swapper/019:51:080
230099210,21cyclictest0-21swapper/000:11:060
230099210,20cyclictest0-21swapper/022:21:060
230099210,20cyclictest0-21swapper/022:01:060
230099210,1cyclictest7656-21perf22:40:010
2303992020,0cyclictest0-21swapper/321:46:073
2303992020,0cyclictest0-21swapper/320:46:053
2303992020,0cyclictest0-21swapper/319:56:063
2303992019,0cyclictest0-21swapper/322:56:073
2303992018,1cyclictest724-21cron21:20:003
2303992018,1cyclictest0-21swapper/319:15:023
230399200,0cyclictest24342-21perf19:55:003
230399200,0cyclictest23945-21apt-get21:01:063
230399200,0cyclictest0-21swapper/320:16:053
230399200,0cyclictest0-21swapper/320:06:063
230399200,0cyclictest0-21swapper/300:26:073
2302992020,0cyclictest0-21swapper/219:41:052
2302992020,0cyclictest0-21swapper/219:36:062
2302992018,1cyclictest24870-21perf22:10:002
2302992018,1cyclictest12681-21apt-get19:31:072
230299200,19cyclictest31526-21dump-pmu-power20:10:012
230299200,0cyclictest0-21swapper/222:11:072
230299200,0cyclictest0-21swapper/221:26:072
230299200,0cyclictest0-21swapper/219:51:082
2301992020,0cyclictest0-21swapper/123:36:071
2301992020,0cyclictest0-21swapper/122:26:061
2301992020,0cyclictest0-21swapper/120:56:061
2301992020,0cyclictest0-21swapper/120:31:061
2301992019,1cyclictest0-21swapper/123:46:071
2301992019,1cyclictest0-21swapper/119:31:071
230199200,0cyclictest1130-21apt-get21:21:091
230199200,0cyclictest0-21swapper/122:46:071
230199200,0cyclictest0-21swapper/121:51:471
230199200,0cyclictest0-21swapper/120:46:051
2300992020,0cyclictest3543-21apt-get21:26:070
2300992020,0cyclictest29798-21apt-get00:31:070
2300992020,0cyclictest0-21swapper/023:41:080
2300992020,0cyclictest0-21swapper/023:11:080
2300992020,0cyclictest0-21swapper/020:56:060
2300992020,0cyclictest0-21swapper/019:36:060
2300992020,0cyclictest0-21swapper/019:26:100
2300992019,1cyclictest17492-21apt-get19:41:050
2300992019,0cyclictest0-21swapper/021:01:060
2300992018,1cyclictest29484-21apt-get20:06:050
2300992018,1cyclictest29458-21latency_hist00:30:000
230099200,20cyclictest0-21swapper/023:21:050
230099200,20cyclictest0-21swapper/021:06:060
230099200,0cyclictest5940-21apt-get21:31:080
230099200,0cyclictest0-21swapper/021:51:470
230099200,0cyclictest0-21swapper/020:46:050
2303991917,1cyclictest10064-21awk22:45:013
2302991919,0cyclictest30438-21apt-get23:26:062
2302991919,0cyclictest20187-21apt-get00:11:062
2302991919,0cyclictest0-21swapper/221:31:082
2302991919,0cyclictest0-21swapper/220:01:052
2302991919,0cyclictest0-21swapper/200:26:072
2302991918,0cyclictest15398-21apt-get00:01:072
2302991918,0cyclictest11534-21apt-get20:36:072
2301991919,0cyclictest0-21swapper/123:41:071
2301991919,0cyclictest0-21swapper/123:31:071
2301991919,0cyclictest0-21swapper/123:21:051
2301991919,0cyclictest0-21swapper/123:01:091
2301991919,0cyclictest0-21swapper/121:26:071
2301991919,0cyclictest0-21swapper/121:01:061
2301991919,0cyclictest0-21swapper/120:01:051
2301991919,0cyclictest0-21swapper/100:31:071
2301991918,1cyclictest27592-21apt-get22:16:081
2301991918,1cyclictest20074-21dump-pmu-power22:00:011
2301991918,0cyclictest0-21swapper/120:06:051
2301991916,2cyclictest14974-21sendmail-msp00:00:011
2300991919,0cyclictest0-21swapper/023:46:070
2300991919,0cyclictest0-21swapper/023:31:070
2300991919,0cyclictest0-21swapper/023:01:090
2300991919,0cyclictest0-21swapper/020:01:050
2300991919,0cyclictest0-21swapper/019:31:070
2300991917,1cyclictest21950-21perf19:50:000
2300991917,1cyclictest14959-40mandb00:00:010
230099190,0cyclictest0-21swapper/000:21:070
2303991818,0cyclictest0-21swapper/322:21:063
2303991818,0cyclictest0-21swapper/300:36:063
2303991818,0cyclictest0-21swapper/300:20:383
2302991818,0cyclictest0-21swapper/223:21:052
2302991818,0cyclictest0-21swapper/222:36:072
2302991818,0cyclictest0-21swapper/221:01:062
2302991816,1cyclictest7696-21latency_hist23:45:002
2302991815,2cyclictest7462-21cron19:20:012
2301991817,1cyclictest29454-21perf00:30:001
2301991817,0cyclictest0-21swapper/122:56:071
2300991818,0cyclictest15632-21apt-get22:56:070
2300991818,0cyclictest0-21swapper/023:16:070
2300991818,0cyclictest0-21swapper/022:16:080
2303991717,0cyclictest0-21swapper/323:51:063
2303991717,0cyclictest0-21swapper/321:31:083
2303991717,0cyclictest0-21swapper/321:21:093
2303991717,0cyclictest0-21swapper/320:31:063
2303991717,0cyclictest0-21swapper/319:46:053
2303991715,1cyclictest10419-21perf21:40:013
2302991717,0cyclictest24675-21apt-get19:56:062
2302991717,0cyclictest0-21swapper/221:56:072
2302991716,1cyclictest29798-21apt-get00:31:072
2302991716,0cyclictest0-21swapper/223:11:082
2302991716,0cyclictest0-21swapper/220:55:022
2302991715,1cyclictest30806-21perf21:15:012
2302991715,1cyclictest10363-21cron21:40:012
2302991712,4cyclictest0-21swapper/223:16:132
2302991710,1cyclictest758-21idleruntime-cro21:20:002
2301991717,0cyclictest0-21swapper/119:50:001
2300991717,0cyclictest13120-21apt-get22:50:030
2300991717,0cyclictest0-21swapper/020:11:050
2300991716,1cyclictest141rcuc/020:21:090
2303991614,1cyclictest313-21systemd-journal00:05:013
230399160,10cyclictest0-21swapper/320:36:073
230299163,8cyclictest606-21dbus-daemon22:35:012
230299160,15cyclictest1782-21hddtemp_smartct21:21:112
230299160,0cyclictest0-21swapper/223:05:272
230299160,0cyclictest0-21swapper/222:40:512
230299160,0cyclictest0-21swapper/220:26:532
2301991616,0cyclictest0-21swapper/120:36:061
2301991616,0cyclictest0-21swapper/120:21:091
2300991616,0cyclictest0-21swapper/022:11:070
2300991616,0cyclictest0-21swapper/020:36:060
230099160,15cyclictest20444-21apt-get23:06:070
230099160,15cyclictest0-21swapper/019:25:010
230099160,15cyclictest0-21swapper/019:25:010
2303991515,0cyclictest12881-21apt-get23:56:053
2303991515,0cyclictest0-21swapper/321:51:083
2303991514,0cyclictest0-21swapper/323:11:083
2303991513,1cyclictest32488-21idleruntime-cro23:30:013
2303991513,1cyclictest24841-21awk22:10:003
230399150,14cyclictest0-21swapper/319:36:063
2302991514,1cyclictest32189-21apt-get00:36:062
2302991514,1cyclictest30403-21apt-get22:21:062
2302991514,1cyclictest0-21swapper/223:50:062
230299150,4cyclictest0-21swapper/220:11:052
230299150,1cyclictest0-21swapper/221:41:072
2301991513,1cyclictest32034-21memory21:16:111
2301991513,1cyclictest12539-21apt23:55:001
2300991515,0cyclictest15398-21apt-get00:01:060
2300991514,1cyclictest12549-21ls23:55:000
2303991414,0cyclictest0-21swapper/323:05:023
2303991412,1cyclictest0-21swapper/319:11:153
230399140,14cyclictest0-21swapper/321:40:223
230399140,14cyclictest0-21swapper/321:10:463
230399140,14cyclictest0-21swapper/320:25:453
230399140,14cyclictest0-21swapper/300:10:193
230399140,0cyclictest0-21swapper/322:45:203
2302991414,0cyclictest0-21swapper/222:01:052
2302991414,0cyclictest0-21swapper/220:54:012
2302991413,1cyclictest0-21swapper/220:45:292
2302991413,1cyclictest0-21swapper/219:25:202
230299140,14cyclictest0-21swapper/223:55:022
230299140,14cyclictest0-21swapper/223:00:372
230299140,14cyclictest0-21swapper/220:41:422
230299140,14cyclictest0-21swapper/219:11:052
230299140,14cyclictest0-21swapper/200:06:112
230299140,14cyclictest0-21swapper/200:06:112
230299140,0cyclictest0-21swapper/222:56:002
230299140,0cyclictest0-21swapper/221:50:352
2301991414,0cyclictest0-21swapper/122:00:251
2301991414,0cyclictest0-21swapper/121:45:021
2301991414,0cyclictest0-21swapper/119:50:091
2301991414,0cyclictest0-21swapper/119:11:061
230199140,14cyclictest0-21swapper/123:05:431
230199140,14cyclictest0-21swapper/121:30:021
230199140,14cyclictest0-21swapper/121:11:501
230199140,0cyclictest0-21swapper/100:20:481
230199140,0cyclictest0-21swapper/100:00:121
230099140,14cyclictest0-21swapper/022:31:330
230099140,14cyclictest0-21swapper/021:45:050
230099140,14cyclictest0-21swapper/021:20:070
230099140,0cyclictest0-21swapper/023:35:030
230099140,0cyclictest0-21swapper/021:15:300
230099140,0cyclictest0-21swapper/019:11:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional