You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 11:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Aug 06, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26109992423,1cyclictest19367-21diskmemload21:14:063
26109992420,3cyclictest22800-21apt-get00:19:013
2610899240,2cyclictest313-21systemd-journal22:00:002
2610899240,23cyclictest19367-21diskmemload21:11:052
26104992422,1cyclictest0-21swapper/121:21:141
26104992422,1cyclictest0-21swapper/120:54:001
26109992323,0cyclictest7920-21apt-get23:49:003
26109992322,1cyclictest10345-21apt-get20:54:003
26109992320,2cyclictest23592-21turbostat22:05:003
2610999230,22cyclictest27169-21rm21:16:473
2610999230,22cyclictest14578-21sh21:00:013
26108992322,0cyclictest0-21swapper/223:29:002
26108992321,1cyclictest20400-21apt-get00:13:592
2610899230,22cyclictest0-21swapper/220:19:002
26104992321,1cyclictest0-21swapper/121:15:191
2610499230,22cyclictest22-21ksoftirqd/122:04:011
2610499230,22cyclictest0-21swapper/120:44:001
2610499230,1cyclictest7012-21apt-get21:30:021
2610499230,0cyclictest0-21swapper/121:10:531
26100992322,1cyclictest62550irq/127-eno121:23:460
2610099230,2cyclictest11586-21perf21:40:010
2610099230,22cyclictest29768-21cron20:25:000
2610099230,22cyclictest22871-21sh21:13:340
2610099230,22cyclictest21768-21apt-get22:04:010
26109992222,0cyclictest0-21swapper/321:20:323
26109992220,1cyclictest619-21polkitd20:00:003
26109992220,1cyclictest0-21swapper/321:55:013
26109992219,2cyclictest8121-21latency_hist19:40:003
2610999220,21cyclictest4560-21apt-get21:29:023
2610999220,21cyclictest1848-21perf00:40:003
2610999220,21cyclictest13462-21apt-get22:54:003
2610999220,21cyclictest0-21swapper/321:44:033
2610999220,1cyclictest27616-21apt-get00:29:003
2610999220,1cyclictest26641-21apt-get19:14:013
26108992220,1cyclictest20111-21perf23:05:002
26108992220,1cyclictest0-21swapper/221:20:592
26108992220,1cyclictest0-21swapper/200:10:012
26108992218,3cyclictest17553-21apt-get21:09:022
2610899220,21cyclictest271rcuc/221:30:002
2610899220,21cyclictest13494-21apt-get19:54:032
2610899220,21cyclictest0-21swapper/221:44:032
2610899220,21cyclictest0-21swapper/219:59:012
2610899220,1cyclictest29418-21cron00:30:002
2610899220,1cyclictest0-21swapper/221:40:012
2610899220,0cyclictest0-21swapper/221:17:532
26104992221,1cyclictest22-21ksoftirqd/120:19:011
26104992220,1cyclictest6394-21munin-run21:30:001
2610499220,21cyclictest211rcuc/121:03:591
2610499220,21cyclictest10504-21turbostat.cron22:45:001
2610499220,1cyclictest0-21swapper/123:45:001
2610499220,1cyclictest0-21swapper/123:10:001
26100992222,0cyclictest0-21swapper/023:39:020
26100992220,1cyclictest4962-21cron20:40:000
2610099220,21cyclictest20703-21apt-get20:09:030
2610099220,21cyclictest0-21swapper/021:16:180
2610099220,21cyclictest0-21swapper/000:29:000
2610099220,21cyclictest0-21swapper/000:13:590
2610099220,1cyclictest606-21dbus-daemon20:15:010
2610099220,1cyclictest18798-21munin-plugin-st21:55:010
2610099220,1cyclictest15856-21apt-get22:59:010
26109992121,0cyclictest0-21swapper/319:19:023
26109992120,1cyclictest8671-21apt-get22:44:003
26109992120,1cyclictest0-21swapper/323:09:003
26109992120,0cyclictest15220-21apt-get00:04:023
2610999210,21cyclictest16403-21perf21:50:013
2610999210,20cyclictest32180-21awk23:30:013
2610999210,20cyclictest0-21swapper/321:09:023
2610999210,20cyclictest0-21swapper/300:13:593
2610999210,1cyclictest27911-21apt-get20:24:003
2610999210,0cyclictest28959-21apt-get22:19:003
2610999210,0cyclictest0-21swapper/322:24:013
26108992121,0cyclictest0-21swapper/223:59:002
26108992121,0cyclictest0-21swapper/222:14:012
26108992120,1cyclictest10320-21apt-get23:54:012
26108992120,0cyclictest0-21swapper/219:49:002
2610899210,21cyclictest0-21swapper/200:04:022
2610899210,20cyclictest5727-21munin-run19:35:002
2610899210,20cyclictest0-21swapper/223:19:002
2610899210,20cyclictest0-21swapper/222:39:012
2610899210,20cyclictest0-21swapper/220:34:002
2610899210,20cyclictest0-21swapper/219:19:022
2610899210,0cyclictest11069-21apt-get22:49:022
26104992121,0cyclictest0-21swapper/119:19:021
26104992120,1cyclictest0-21swapper/123:34:011
26104992119,1cyclictest30414-21apt-get20:25:021
26104992119,1cyclictest24895-21apt23:15:011
26104992119,1cyclictest0-21swapper/123:35:011
26104992119,1cyclictest0-21swapper/100:05:011
2610499211,18cyclictest0-21swapper/123:48:591
2610499210,21cyclictest0-21swapper/123:29:001
2610499210,21cyclictest0-21swapper/122:59:011
2610499210,20cyclictest0-21swapper/122:09:001
2610499210,20cyclictest0-21swapper/120:09:041
2610499210,0cyclictest0-21swapper/122:49:021
2610499210,0cyclictest0-21swapper/100:39:021
26100992121,0cyclictest0-21swapper/000:19:010
26100992121,0cyclictest0-21swapper/000:04:020
26100992120,0cyclictest30330-21apt-get23:29:000
26100992119,1cyclictest712-21apt-get20:34:000
26100992119,1cyclictest29782-21apt-get20:25:010
26100992119,1cyclictest12164-21munin-run23:55:000
26100992113,4cyclictest0-21swapper/019:11:510
2610099210,21cyclictest0-21swapper/023:24:000
2610099210,20cyclictest0-21swapper/020:45:000
2610099210,1cyclictest15885-21apt-get19:59:000
2610099210,0cyclictest0-21swapper/023:44:000
2610099210,0cyclictest0-21swapper/021:03:590
2610099210,0cyclictest0-21swapper/020:54:000
2610099210,0cyclictest0-21swapper/000:09:050
26109992020,0cyclictest0-21swapper/323:54:013
26109992020,0cyclictest0-21swapper/323:24:003
26109992018,1cyclictest25489-21apt-get20:19:003
26109992018,1cyclictest0-21swapper/322:49:023
2610999200,19cyclictest0-21swapper/320:14:003
2610999200,0cyclictest0-21swapper/323:14:013
2610999200,0cyclictest0-21swapper/319:54:033
26108992020,0cyclictest27885-21apt-get23:24:002
26108992020,0cyclictest23092-21apt-get20:14:002
26108992020,0cyclictest15156-21apt-get21:03:592
26108992020,0cyclictest1396-21apt-get22:28:582
26108992020,0cyclictest0-21swapper/222:44:002
26108992020,0cyclictest0-21swapper/221:54:012
26108992020,0cyclictest0-21swapper/220:24:002
26108992019,1cyclictest30020-21apt-get00:34:022
26108992017,2cyclictest9182-21idleruntime-cro21:35:002
2610899200,20cyclictest0-21swapper/219:44:042
2610899200,0cyclictest0-21swapper/223:45:002
2610899200,0cyclictest0-21swapper/200:19:012
26104992020,0cyclictest0-21swapper/123:59:011
26104992020,0cyclictest0-21swapper/123:54:001
26104992020,0cyclictest0-21swapper/123:24:001
26104992020,0cyclictest0-21swapper/122:39:011
26104992020,0cyclictest0-21swapper/120:14:001
26104992020,0cyclictest0-21swapper/119:59:011
2610499200,20cyclictest0-21swapper/122:19:001
2610499200,19cyclictest31858-21munin-run00:35:001
2610499200,0cyclictest0-21swapper/123:19:001
2610499200,0cyclictest0-21swapper/100:13:581
26100992020,0cyclictest0-21swapper/022:19:000
26100992020,0cyclictest0-21swapper/019:33:590
26100992019,1cyclictest21187-21perf22:00:000
2610099200,20cyclictest0-21swapper/021:49:010
2610099200,20cyclictest0-21swapper/019:29:000
2610099200,20cyclictest0-21swapper/000:39:020
2610099200,0cyclictest0-21swapper/023:08:590
2610099200,0cyclictest0-21swapper/022:44:000
26109991919,0cyclictest6206-21apt-get22:39:013
26109991919,0cyclictest0-21swapper/323:59:003
26109991919,0cyclictest0-21swapper/323:44:003
26109991919,0cyclictest0-21swapper/321:34:013
26109991919,0cyclictest0-21swapper/320:04:013
26109991919,0cyclictest0-21swapper/319:44:043
26109991918,1cyclictest3108-21apt-get23:39:023
26109991917,1cyclictest0-21swapper/320:10:013
26108991919,0cyclictest0-21swapper/222:09:002
26108991919,0cyclictest0-21swapper/221:49:012
26108991919,0cyclictest0-21swapper/220:09:032
26108991919,0cyclictest0-21swapper/219:29:002
26108991919,0cyclictest0-21swapper/219:23:592
26108991919,0cyclictest0-21swapper/200:39:022
26104991919,0cyclictest0-21swapper/121:09:021
26100991919,0cyclictest8704-21apt-get19:44:040
26100991919,0cyclictest0-21swapper/023:34:010
26100991919,0cyclictest0-21swapper/022:14:000
26100991917,1cyclictest29040-21apt-get19:19:020
26100991916,2cyclictest20124-21dump-pmu-power20:05:010
2610099190,1cyclictest12681-21/usr/sbin/munin23:59:100
26109991818,0cyclictest25218-21apt-get00:24:023
26109991818,0cyclictest0-21swapper/322:28:583
26109991818,0cyclictest0-21swapper/320:29:013
26109991817,0cyclictest0-21swapper/322:14:003
26109991816,1cyclictest606-21dbus-daemon23:00:003
2610999180,12cyclictest0-21swapper/322:34:003
26108991818,0cyclictest20668-21apt-get23:08:592
26108991818,0cyclictest0-21swapper/222:04:012
26108991815,2cyclictest8146-21idleruntime-cro19:40:002
2610499182,1cyclictest211rcuc/119:29:051
26104991818,0cyclictest0-21swapper/121:59:041
26104991818,0cyclictest0-21swapper/119:54:031
26104991818,0cyclictest0-21swapper/119:44:041
26104991818,0cyclictest0-21swapper/119:14:001
26104991817,1cyclictest9750-21apt-get21:39:011
26104991817,0cyclictest3134-21apt-get20:39:001
2610499180,17cyclictest22-21ksoftirqd/120:24:001
26100991818,0cyclictest0-21swapper/022:54:000
26100991818,0cyclictest0-21swapper/022:39:010
26100991817,0cyclictest0-21swapper/019:49:000
26100991816,1cyclictest0-21swapper/021:30:020
26109991716,1cyclictest24159-21apt-get22:09:003
26109991714,2cyclictest27288-21sh23:20:013
26109991714,2cyclictest16998-21wc21:05:013
26108991717,0cyclictest0-21swapper/222:59:012
26108991717,0cyclictest0-21swapper/222:24:012
26108991717,0cyclictest0-21swapper/220:39:002
26108991716,1cyclictest18303-21apt-get20:04:002
26108991716,0cyclictest0-21swapper/222:19:002
2610899170,0cyclictest0-21swapper/220:29:002
26104991717,0cyclictest0-21swapper/123:04:011
26104991717,0cyclictest0-21swapper/100:29:001
26104991717,0cyclictest0-21swapper/100:09:051
26104991716,0cyclictest0-21swapper/120:04:011
26104991714,3cyclictest19617-21kworker/1:121:50:461
26104991714,2cyclictest0-21swapper/120:49:021
26100991717,0cyclictest0-21swapper/021:44:040
26100991717,0cyclictest0-21swapper/020:59:020
26100991716,0cyclictest31429-21apt-get22:24:010
2610099170,16cyclictest27322-21perf23:20:010
26109991616,0cyclictest0-21swapper/320:49:003
26109991614,1cyclictest720-21diskstats23:34:033
26109991614,1cyclictest11092-21apt-get19:49:003
2610999160,1cyclictest0-21swapper/320:44:013
26108991616,0cyclictest0-21swapper/223:49:002
26108991616,0cyclictest0-21swapper/223:14:012
26108991615,1cyclictest28-21ksoftirqd/220:59:012
26104991616,0cyclictest0-21swapper/120:59:021
26104991616,0cyclictest0-21swapper/120:34:001
26104991616,0cyclictest0-21swapper/119:23:591
26104991616,0cyclictest0-21swapper/100:24:021
26104991615,0cyclictest12171-21apt-get21:44:041
26104991614,1cyclictest0-21swapper/122:14:021
2610499160,15cyclictest8190-21munin-run19:40:001
26100991615,1cyclictest0-21swapper/021:09:020
26100991614,1cyclictest4449-21hddtemp_smartct22:34:030
26100991614,1cyclictest0-21swapper/022:49:120
2610099160,1cyclictest0-21swapper/021:29:040
2610099160,1cyclictest0-21swapper/019:24:060
26109991513,1cyclictest20811-21cat21:59:133
26109991513,1cyclictest20088-21awk23:05:003
26109991513,1cyclictest18039-21diskstats00:09:063
26108991515,0cyclictest0-21swapper/220:49:002
26108991515,0cyclictest0-21swapper/219:14:002
26104991515,0cyclictest0-21swapper/122:28:591
26104991515,0cyclictest0-21swapper/119:33:591
26104991513,1cyclictest23702-21memory00:19:051
26104991513,1cyclictest0-21swapper/122:35:011
2610499150,14cyclictest0-21swapper/119:49:001
26100991515,0cyclictest0-21swapper/000:24:020
26100991514,1cyclictest0-21swapper/022:10:000
26100991513,1cyclictest18240-21/usr/sbin/munin23:04:020
2610099150,15cyclictest24486-21switchtime23:14:090
2610999140,14cyclictest0-21swapper/320:37:543
2610999140,14cyclictest0-21swapper/320:30:253
2610999140,14cyclictest0-21swapper/319:33:083
2610999140,14cyclictest0-21swapper/300:30:593
2610999140,0cyclictest0-21swapper/319:25:453
2610999140,0cyclictest0-21swapper/319:22:413
26108991414,0cyclictest0-21swapper/222:52:522
2610899140,14cyclictest0-21swapper/223:36:372
2610899140,14cyclictest0-21swapper/223:31:052
2610899140,14cyclictest0-21swapper/220:50:332
2610899140,14cyclictest0-21swapper/220:41:562
2610899140,0cyclictest0-21swapper/200:24:592
26104991414,0cyclictest0-21swapper/122:54:001
26100991414,0cyclictest0-21swapper/023:45:400
26100991414,0cyclictest0-21swapper/022:25:460
26100991414,0cyclictest0-21swapper/019:52:490
26100991414,0cyclictest0-21swapper/019:35:520
2610099140,14cyclictest0-21swapper/020:15:150
2610099140,0cyclictest0-21swapper/020:45:290
26108991313,0cyclictest0-21swapper/222:34:052
26100991313,0cyclictest0-21swapper/000:34:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional