You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 12:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jan 02, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3838992423,1cyclictest13785-21apt-get19:30:563
383399240,1cyclictest622-21gdbus19:20:002
382999240,0cyclictest0-21swapper/119:50:551
382499240,23cyclictest3622-21perf23:35:010
3838992323,0cyclictest24348-21apt-get23:10:593
3838992322,1cyclictest0-21swapper/319:45:553
383899230,22cyclictest23765-21munin-run00:15:013
3833992321,1cyclictest3362-21sendmail-msp00:40:012
383399230,2cyclictest17550-21basename21:50:012
3829992321,1cyclictest20578-21apt-get21:55:021
3829992321,1cyclictest14747-21apt-get22:50:571
382999230,2cyclictest15689-21latency_hist00:00:001
382999230,22cyclictest3354-21apt-get00:40:011
382999230,22cyclictest26411-21turbostat23:15:001
382999230,22cyclictest2329-21cron22:25:001
382499230,2cyclictest16499-21apt-get00:00:550
382499230,22cyclictest17551-21turbostat.cron21:50:010
382499230,22cyclictest13258-21sh23:55:000
382499230,22cyclictest0-21swapper/000:00:010
3838992220,1cyclictest30686-21cron21:10:013
3838992219,2cyclictest643-21awk21:15:013
383899220,21cyclictest25492-21apt-get22:05:553
383899220,21cyclictest15494-21apt-get21:45:563
383899220,21cyclictest13271-21perf23:55:003
383899220,21cyclictest11033-21apt-get20:30:553
3833992222,0cyclictest0-21swapper/200:30:572
3833992220,1cyclictest5868-21awk20:20:012
3833992220,1cyclictest5868-21awk20:20:012
3833992220,1cyclictest28807-21latency_hist23:20:002
3833992220,1cyclictest0-21swapper/221:55:022
383399220,21cyclictest23468-21munin-run19:50:002
383399220,21cyclictest20960-21apt-get00:10:022
383399220,21cyclictest13822-21apt-get20:35:542
383399220,21cyclictest0-21swapper/222:35:012
383399220,21cyclictest0-21swapper/222:15:572
383399220,21cyclictest0-21swapper/220:00:022
383399220,1cyclictest606-21dbus-daemon23:55:002
383399220,1cyclictest16022-21wc00:00:012
383399220,1cyclictest0-21swapper/200:00:022
3829992220,1cyclictest18323-21apt-get20:45:021
3829992220,1cyclictest15653-21apt-get00:00:021
382999220,21cyclictest6193-21apt-get20:20:581
382999220,21cyclictest14430-21sleep22:50:011
382999220,21cyclictest0-21swapper/119:20:561
382999220,21cyclictest0-21swapper/100:20:571
382999220,1cyclictest23825-21apt-get20:55:561
382999220,0cyclictest0-21swapper/120:25:551
3824992220,1cyclictest609-21rs:main0
3824992220,1cyclictest22730-21sendmail22:00:010
382499220,21cyclictest15906-21perf20:40:000
382499220,0cyclictest0-21swapper/021:50:590
3838992119,1cyclictest3443-21perf20:15:013
383899210,20cyclictest32702-21apt-get22:20:583
383899210,20cyclictest0-21swapper/321:00:543
383899210,20cyclictest0-21swapper/319:25:543
383899210,20cyclictest0-21swapper/300:05:583
383899210,1cyclictest0-21swapper/323:45:013
383899210,0cyclictest3940-21apt-get23:35:553
3833992120,1cyclictest9955-21apt-get22:40:572
3833992119,1cyclictest21952-21apt-get23:05:562
3833992119,1cyclictest15170-21apt21:45:012
3833992119,1cyclictest0-21swapper/222:25:002
383399210,20cyclictest3415-21cron20:15:012
383399210,20cyclictest26178-21apt-get19:55:552
383399210,1cyclictest25886-21sh21:00:012
383399210,0cyclictest3438-21apt-get21:20:582
383399210,0cyclictest0-21swapper/221:15:552
3829992121,0cyclictest0-21swapper/121:15:551
3829992121,0cyclictest0-21swapper/121:10:561
3829992120,1cyclictest1360-21apt-get20:10:581
3829992119,1cyclictest3940-21apt-get23:35:551
382999210,20cyclictest0-21swapper/122:10:571
382999210,0cyclictest0-21swapper/121:50:591
3824992121,0cyclictest0-21swapper/020:45:020
3824992121,0cyclictest0-21swapper/020:10:580
3824992120,1cyclictest28268-21apt-get20:00:020
3824992120,1cyclictest0-21swapper/019:50:000
3824992119,1cyclictest3378-21awk00:40:010
3824992119,1cyclictest0-21swapper/000:30:570
382499210,21cyclictest0-21swapper/019:15:540
382499210,20cyclictest25899-21ls21:00:010
382499210,20cyclictest0-21swapper/023:40:590
382499210,0cyclictest26739-21apt-get23:15:560
382499210,0cyclictest0-21swapper/022:40:570
3838992020,0cyclictest8993-21apt-get19:20:563
3838992020,0cyclictest26510-21apt-get00:20:583
3838992020,0cyclictest1002-21apt-get21:15:553
3838992020,0cyclictest0-21swapper/322:50:583
3838992020,0cyclictest0-21swapper/321:30:573
3838992020,0cyclictest0-21swapper/320:50:563
3838992020,0cyclictest0-21swapper/319:50:553
3838992020,0cyclictest0-21swapper/300:15:573
3838992019,1cyclictest16184-21apt-get19:35:563
3838992018,1cyclictest14409-21dump-pmu-power22:50:013
383899200,20cyclictest0-21swapper/323:05:563
383899200,0cyclictest5836-21apt-get21:25:563
383899200,0cyclictest31384-21apt-get20:05:553
383899200,0cyclictest0-21swapper/322:35:583
383899200,0cyclictest0-21swapper/300:36:003
383899200,0cyclictest0-21swapper/300:25:593
3833992020,0cyclictest17140-21apt-get22:55:562
3833992020,0cyclictest0-21swapper/222:35:582
3833992020,0cyclictest0-21swapper/222:00:562
3833992020,0cyclictest0-21swapper/220:50:562
3833992020,0cyclictest0-21swapper/220:05:552
3833992020,0cyclictest0-21swapper/219:50:552
3833992020,0cyclictest0-21swapper/219:20:562
3833992020,0cyclictest0-21swapper/219:10:542
3833992019,1cyclictest0-21swapper/200:05:582
3833992019,0cyclictest0-21swapper/219:30:572
383399200,0cyclictest0-21swapper/200:25:592
3829992020,0cyclictest0-21swapper/121:45:561
3829992020,0cyclictest0-21swapper/120:05:551
3829992020,0cyclictest0-21swapper/119:40:561
3829992020,0cyclictest0-21swapper/100:10:561
382999200,20cyclictest0-21swapper/121:20:571
382999200,0cyclictest0-21swapper/122:40:571
382999200,0cyclictest0-21swapper/121:00:541
3824992020,0cyclictest28905-21apt-get00:25:590
3824992020,0cyclictest0-21swapper/021:15:550
3824992018,1cyclictest5860-21perf20:20:010
3824992018,1cyclictest5860-21perf20:20:010
3824992018,1cyclictest18257-21turbostat19:40:010
382499200,20cyclictest0-21swapper/022:00:570
382499200,0cyclictest26178-21apt-get19:55:550
382499200,0cyclictest0-21swapper/022:05:550
382499200,0cyclictest0-21swapper/019:25:010
382499200,0cyclictest0-21swapper/000:05:580
3838991919,0cyclictest0-21swapper/322:55:563
3838991919,0cyclictest0-21swapper/322:25:563
3838991919,0cyclictest0-21swapper/322:15:573
3838991919,0cyclictest0-21swapper/321:55:563
3838991919,0cyclictest0-21swapper/320:00:023
3838991917,2cyclictest18993-21apt19:40:563
3838991917,1cyclictest1208-21munin-run23:30:013
3833991919,0cyclictest24081-21apt-get00:15:572
3833991919,0cyclictest11384-21apt-get19:25:552
3833991919,0cyclictest0-21swapper/220:25:542
3833991919,0cyclictest0-21swapper/219:40:022
3833991918,1cyclictest10878-21turbostat.cron23:50:012
3833991918,1cyclictest0-21swapper/223:10:592
3833991918,1cyclictest0-21swapper/220:30:552
3833991918,0cyclictest31031-21apt-get21:10:562
3833991918,0cyclictest0-21swapper/220:45:592
3833991918,0cyclictest0-21swapper/220:40:562
3833991917,1cyclictest12747-21sh21:40:002
3829991919,0cyclictest0-21swapper/120:00:561
3829991919,0cyclictest0-21swapper/119:25:541
3829991919,0cyclictest0-21swapper/100:26:001
3829991918,1cyclictest32353-21apt22:20:001
3829991918,0cyclictest0-21swapper/122:35:571
3829991917,1cyclictest18323-21apt-get20:45:001
3824991919,0cyclictest7539-21apt-get22:35:580
3824991919,0cyclictest3438-21apt-get21:20:570
3824991919,0cyclictest0-21swapper/022:55:560
3824991919,0cyclictest0-21swapper/021:00:540
3824991919,0cyclictest0-21swapper/000:10:020
3824991918,1cyclictest0-21swapper/020:05:550
3824991918,0cyclictest21430-21apt-get20:50:560
3824991918,0cyclictest0-21swapper/022:30:570
3824991917,1cyclictest13784-21apt19:30:570
3824991916,2cyclictest15158-21cron21:45:000
382499190,15cyclictest10156-21chrt21:32:500
3838991818,0cyclictest23099-21apt-get22:00:563
3838991818,0cyclictest0-21swapper/323:30:573
3838991818,0cyclictest0-21swapper/321:20:573
3838991818,0cyclictest0-21swapper/320:45:023
3838991818,0cyclictest0-21swapper/319:55:553
3838991818,0cyclictest0-21swapper/319:10:543
3838991818,0cyclictest0-21swapper/300:30:563
3838991818,0cyclictest0-21swapper/300:00:023
3838991817,0cyclictest0-21swapper/320:40:563
3833991818,0cyclictest0-21swapper/223:30:572
3833991818,0cyclictest0-21swapper/221:05:542
3833991816,1cyclictest8451-21cron23:45:012
3829991818,0cyclictest0-21swapper/119:55:551
3829991817,1cyclictest0-21swapper/119:35:561
3829991816,1cyclictest5814-21cron20:20:011
3829991816,1cyclictest5814-21cron20:20:011
3824991818,0cyclictest0-21swapper/022:25:550
3824991818,0cyclictest0-21swapper/020:25:550
3824991818,0cyclictest0-21swapper/019:40:020
3824991817,0cyclictest4126-21apt-get19:10:540
3824991816,1cyclictest2372-21munin-run22:25:000
3824991816,1cyclictest10868-21sh23:50:010
3838991717,0cyclictest0-21swapper/320:55:563
3838991717,0cyclictest0-21swapper/320:35:543
3838991717,0cyclictest0-21swapper/320:20:593
3833991717,0cyclictest0-21swapper/222:45:552
3833991715,2cyclictest8300-21cron20:25:012
382999179,7cyclictest606-21dbus-daemon22:10:011
3829991717,0cyclictest0-21swapper/123:40:591
3829991717,0cyclictest0-21swapper/123:00:571
3829991717,0cyclictest0-21swapper/120:35:541
3829991714,2cyclictest13243-21cron23:55:001
3824991717,0cyclictest0-21swapper/019:50:550
3824991717,0cyclictest0-21swapper/019:25:550
3824991717,0cyclictest0-21swapper/000:15:570
3824991716,1cyclictest28632-21apt-get21:05:540
3824991716,1cyclictest0-21swapper/023:05:560
3824991716,1cyclictest0-21swapper/021:10:560
3838991616,0cyclictest19558-21apt-get23:00:573
3838991616,0cyclictest0-21swapper/323:20:573
3838991616,0cyclictest0-21swapper/323:15:563
3838991616,0cyclictest0-21swapper/322:40:573
3838991616,0cyclictest0-21swapper/319:15:543
3838991615,0cyclictest0-21swapper/323:55:563
3838991614,1cyclictest10878-21turbostat23:50:013
383399167,7cyclictest313-21systemd-journal21:35:002
3833991616,0cyclictest0-21swapper/221:50:582
3833991614,2cyclictest6184-21sed23:40:012
383399160,15cyclictest30011-21sleep22:15:002
382999167,8cyclictest0-21swapper/119:50:001
3829991616,0cyclictest29159-21apt-get23:20:571
3829991616,0cyclictest0-21swapper/121:05:551
3829991616,0cyclictest0-21swapper/120:50:561
3829991616,0cyclictest0-21swapper/119:15:541
3829991616,0cyclictest0-21swapper/119:10:541
3829991616,0cyclictest0-21swapper/100:15:571
3829991615,1cyclictest5089-21apt-get22:30:561
3829991615,1cyclictest28834-21munin-run23:20:001
3829991615,1cyclictest18897-21apt-get00:05:581
3829991615,1cyclictest1529-21apt-get23:30:561
382999160,2cyclictest774-21runrttasks19:33:311
382999160,15cyclictest4730-21cron22:30:001
3824991616,0cyclictest0-21swapper/020:30:550
3824991614,1cyclictest30012-21munin-run22:15:000
3824991614,1cyclictest12741-21sh21:40:000
382499160,16cyclictest0-21swapper/022:45:560
3838991515,0cyclictest8635-21apt-get20:25:553
3833991515,0cyclictest0-21swapper/222:25:562
3833991515,0cyclictest0-21swapper/200:20:572
3824991515,0cyclictest0-21swapper/023:10:590
382499150,11cyclictest605-21avahi-daemon23:05:000
383899140,14cyclictest0-21swapper/322:30:513
383899140,14cyclictest0-21swapper/321:50:213
383899140,14cyclictest0-21swapper/321:40:283
383899140,14cyclictest0-21swapper/321:35:113
383899140,14cyclictest0-21swapper/320:15:263
383899140,14cyclictest0-21swapper/320:15:263
383399140,14cyclictest0-21swapper/223:00:302
383399140,14cyclictest0-21swapper/222:50:092
383399140,14cyclictest0-21swapper/221:25:462
383399140,14cyclictest0-21swapper/221:00:482
383399140,0cyclictest0-21swapper/223:26:462
383399140,0cyclictest0-21swapper/223:20:032
383399140,0cyclictest0-21swapper/222:06:002
3829991414,0cyclictest0-21swapper/121:40:051
382999140,14cyclictest0-21swapper/122:00:271
382999140,14cyclictest0-21swapper/121:30:011
382999140,14cyclictest0-21swapper/120:30:481
382999140,0cyclictest0-21swapper/122:55:181
382999140,0cyclictest0-21swapper/121:35:541
382999140,0cyclictest0-21swapper/121:25:041
382999140,0cyclictest0-21swapper/100:30:261
3824991414,0cyclictest0-21swapper/021:28:280
3824991413,0cyclictest0-21swapper/000:20:570
382499140,14cyclictest0-21swapper/023:20:170
382499140,14cyclictest0-21swapper/022:51:060
382499140,0cyclictest0-21swapper/023:35:220
382499140,0cyclictest0-21swapper/023:25:100
382499140,0cyclictest0-21swapper/020:21:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional