You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Sep 15, 2026 00:42:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
435385997545,6cyclictest474491-21idleruntime-cro21:15:001
435386995650,3cyclictest0-21swapper/222:06:122
43538699502,38cyclictest472744-21ssh21:11:162
435386994836,6cyclictest590510-21cron00:25:012
435386994737,6cyclictest1-21systemd00:31:202
435386994536,6cyclictest558555-21switchtime23:31:232
435386994435,5cyclictest453386-21systemd-run20:10:012
435386994334,6cyclictest456397-21systemd-run20:20:012
435386994334,6cyclictest439-21systemd-logind21:55:012
435386994334,6cyclictest439-21systemd-logind21:55:012
43538499432,35cyclictest512539-21ssh22:16:140
43538699425,9cyclictest549120-21ssh23:16:132
43538499427,8cyclictest171rcu_preempt23:51:100
435386994132,5cyclictest438373-21munin-run19:20:012
435386994128,10cyclictest490596-21cpu21:41:032
435385994133,5cyclictest493117-21latency_hist21:45:031
435385994130,8cyclictest537488-21unixbench_singl22:56:251
435384994136,2cyclictest0-21swapper/022:41:180
43538699403,21cyclictest573427-21ssh23:56:122
435385994032,5cyclictest421-21dbus-daemon22:40:021
435385994031,5cyclictest0-21swapper/121:16:111
435385994029,8cyclictest516000-21timerwakeupswit22:21:241
435384994028,8cyclictest475864-21ssh21:16:170
435386993932,3cyclictest0-21swapper/221:31:122
435386993930,6cyclictest2910165-21cups-browsed22:25:272
435386993929,4cyclictest0-21swapper/223:30:012
435385993931,5cyclictest505159-21latency_hist22:05:021
43538599392,32cyclictest567420-21ssh23:46:171
435386993833,2cyclictest0-21swapper/223:10:002
435386993830,5cyclictest563910-21fschecks_time23:41:062
435385993830,5cyclictest578343-21ssh00:05:011
435385993827,8cyclictest564621-21switchtime23:41:231
435384993829,5cyclictest471428-21munin-plugin-st21:10:010
435384993829,5cyclictest471428-21munin-plugin-st21:10:010
435384993827,8cyclictest497638-21timerandwakeup21:51:240
435384993827,8cyclictest497638-21timerandwakeup21:51:240
43538699374,19cyclictest428-21mta-sts-daemon20:48:452
43538699374,19cyclictest428-21mta-sts-daemon20:48:452
435386993729,5cyclictest537389-21unixbench-2d22:56:242
435386993729,5cyclictest483705-21idleruntime-cro21:30:012
435386993729,5cyclictest477558-21munin-plugin-st21:20:002
435386993727,7cyclictest2910165-21cups-browsed21:06:122
435386993727,7cyclictest2910165-21cups-browsed21:06:122
435385993730,3cyclictest0-21swapper/122:53:291
435385993730,3cyclictest0-21swapper/122:53:291
435385993729,5cyclictest550856-21sendmail23:20:011
435385993726,8cyclictest452742-21ntp_kernel_pll_20:06:121
435384993730,5cyclictest2910165-21cups-browsed22:01:140
435384993729,4cyclictest0-21swapper/023:41:170
435384993729,4cyclictest0-21swapper/022:06:140
435384993728,7cyclictest478603-21latency21:21:070
435384993727,3cyclictest575222-21cups-browsed00:00:010
435384993725,5cyclictest485-21in:imuxsock20:30:010
43538699363,28cyclictest530814-21ssh22:46:122
435386993627,6cyclictest1002-21mta-sts-daemon23:38:062
435386993627,5cyclictest448861-21munin-plugin-st19:55:012
435386993625,8cyclictest442213-21ntp_kernel_err19:31:102
435385993629,4cyclictest462372-21sendmail20:40:001
435385993629,3cyclictest0-21swapper/123:31:181
435385993627,6cyclictest2910165-21cups-browsed21:21:251
435384993630,4cyclictest502173-21latency_hist22:00:020
435384993627,5cyclictest444395-21kworker/u8:0+xprtiod19:40:010
43538699351,29cyclictest597874-21ssh00:36:142
435385993527,4cyclictest1001-21mta-sts-daemon21:36:061
435385993525,6cyclictest420-21avahi-daemon22:26:441
43538599352,26cyclictest573437-21ssh23:56:121
435384993523,9cyclictest0-21swapper/022:40:010
43538699344,24cyclictest478861-21ssh21:21:132
43538699343,4cyclictest579519-21ssh00:06:102
43538699343,25cyclictest515535-21ssh22:21:132
435386993429,2cyclictest0-21swapper/220:25:012
435386993428,3cyclictest0-21swapper/200:26:132
435386993423,6cyclictest0-21swapper/220:11:162
435386993412,15cyclictest351ktimers/220:41:152
435386993412,15cyclictest351ktimers/220:41:152
435385993422,9cyclictest530083-21aten_r2power_cu22:45:591
435385993416,10cyclictest1002-21mta-sts-daemon22:31:181
43538499348,4cyclictest171rcu_preempt23:06:140
435384993426,6cyclictest546324-21switchtime23:11:200
435384993426,6cyclictest462391-21systemd-run20:40:010
435384993426,5cyclictest420-21avahi-daemon19:20:010
435384993425,5cyclictest151ktimers/019:41:170
435384993422,8cyclictest531934-21kworker/u8:16+nfsiod23:26:140
435384993421,11cyclictest541707-21idleruntime-cro23:05:010
435386993327,3cyclictest0-21swapper/222:51:182
435386993327,3cyclictest0-21swapper/222:51:182
435386993327,3cyclictest0-21swapper/222:01:142
435386993327,3cyclictest0-21swapper/221:00:002
435386993326,4cyclictest1003-21mta-sts-daemon22:15:522
435386993325,5cyclictest578314-21munin-plugin-st00:05:002
435386993325,5cyclictest569650-21/usr/sbin/munin23:51:042
435386993325,5cyclictest509199-21sh22:11:072
435386993322,8cyclictest466285-21ntp_kernel_pll_20:51:112
435385993326,4cyclictest1002-21mta-sts-daemon00:11:131
435385993325,5cyclictest454930-21latency_hist20:15:021
435385993325,5cyclictest0-21swapper/123:21:161
435385993324,5cyclictest589146-21timerandwakeup00:21:251
435385993324,5cyclictest2910165-21cups-browsed21:49:281
435385993323,7cyclictest471423-21diskmemload23:30:011
435384993327,3cyclictest516155-21unixbench_singl22:21:250
435384993326,4cyclictest597582-21kernelversion00:36:070
435384993326,4cyclictest1000-21mta-sts-daemon21:34:480
435384993324,7cyclictest421-21dbus-daemon22:11:090
435384993324,6cyclictest2910165-21cups-browsed22:54:240
435384993324,6cyclictest2910165-21cups-browsed22:54:240
435386993225,4cyclictest1000-21mta-sts-daemon00:13:042
435386993225,3cyclictest0-21swapper/223:46:212
435386993221,8cyclictest445248-21ntp_kernel_pll_19:41:132
43538699321,25cyclictest494336-21grep21:46:182
435385993226,3cyclictest0-21swapper/120:56:161
435385993224,5cyclictest592273-21unixbench-2d00:26:231
435385993224,5cyclictest481441-21cpuspeed21:26:031
435385993223,5cyclictest514438-21latency_hist22:20:021
43538599321,19cyclictest527767-21sh22:41:121
435384993227,3cyclictest1000-21mta-sts-daemon19:51:060
435384993225,5cyclictest420-21avahi-daemon20:51:180
435384993225,4cyclictest437057-21latency_hist19:15:030
435384993224,4cyclictest0-21swapper/000:26:130
435384993220,9cyclictest558729-21unixbench-2d23:31:240
435386993123,5cyclictest468962-21fschecks_time21:01:072
435386993121,7cyclictest460263-21ntp_kernel_pll_20:31:142
435385993124,4cyclictest0-21swapper/123:55:031
435385993124,4cyclictest0-21swapper/100:31:021
435385993124,3cyclictest0-21swapper/122:06:201
435384993125,3cyclictest538675-21sendmail23:00:000
435384993124,5cyclictest420-21avahi-daemon00:15:010
435384993123,6cyclictest1000-21mta-sts-daemon20:41:130
435384993123,6cyclictest1000-21mta-sts-daemon20:41:130
435384993123,5cyclictest0-21swapper/021:41:190
435386993024,3cyclictest0-21swapper/223:15:002
435386993024,3cyclictest0-21swapper/222:00:002
435386993023,3cyclictest0-21swapper/200:20:012
435386993022,5cyclictest489848-21munin-run21:40:012
435386993022,4cyclictest1001-21mta-sts-daemon23:23:202
435385993024,3cyclictest0-21swapper/121:55:011
435385993024,3cyclictest0-21swapper/121:55:011
435385993023,4cyclictest471541-21latency_hist21:10:031
435385993023,4cyclictest471541-21latency_hist21:10:031
435385993023,4cyclictest441185-21timerwakeupswit19:26:231
435384993024,3cyclictest0-21swapper/000:06:110
435384993023,3cyclictest0-21swapper/021:36:100
435384993023,3cyclictest0-21swapper/020:50:010
435384993023,3cyclictest0-21swapper/020:50:010
435384993022,5cyclictest1-21systemd20:35:010
435384993022,5cyclictest0-21swapper/022:46:220
435384993020,6cyclictest2910165-21cups-browsed21:26:120
435386992922,3cyclictest0-21swapper/222:36:112
435386992921,3cyclictest0-21swapper/222:34:592
435386992920,7cyclictest443513-21kernelversion19:36:062
435386992920,6cyclictest540562-21unixbench_singl23:01:302
435385992923,3cyclictest0-21swapper/120:45:001
435385992923,3cyclictest0-21swapper/120:45:001
435385992922,4cyclictest460788-21head20:31:241
435385992922,3cyclictest0-21swapper/123:11:121
435385992919,7cyclictest587449-21sendmail00:20:011
435384992922,4cyclictest596594-21cron00:35:010
435384992914,10cyclictest12650irq/32-eth022:26:150
435384992910,14cyclictest665-21snmpd23:21:160
435386992821,4cyclictest458393-21fschecks_count20:26:042
435386992820,5cyclictest1-21systemd20:40:012
435386992819,4cyclictest0-21swapper/222:40:072
435385992822,4cyclictest489514-21kworker/u8:7-xprtiod21:56:061
435385992822,2cyclictest0-21swapper/123:01:171
435385992821,4cyclictest445742-21unixbench_multi19:41:251
435385992821,3cyclictest0-21swapper/100:36:121
435385992821,3cyclictest0-21swapper/100:06:131
435385992820,5cyclictest444361-21grep19:40:011
435385992817,8cyclictest442181-21needreboot19:31:081
435385992811,4cyclictest171rcu_preempt20:48:451
435385992811,4cyclictest171rcu_preempt20:48:451
435384992823,3cyclictest0-21swapper/022:35:010
435384992822,3cyclictest0-21swapper/023:16:140
435384992821,4cyclictest1-21systemd19:25:020
435384992820,5cyclictest0-21swapper/021:11:090
435386992720,4cyclictest1001-21mta-sts-daemon20:01:162
435385992723,2cyclictest0-21swapper/121:31:201
435385992721,3cyclictest0-21swapper/119:50:011
435385992720,5cyclictest438373-21munin-run19:20:011
435385992720,3cyclictest0-21swapper/123:36:141
435385992720,3cyclictest0-21swapper/120:01:201
435384992717,7cyclictest0-21swapper/000:20:010
435384992715,9cyclictest421-21dbus-daemon00:25:010
435384992712,10cyclictest12650irq/32-eth021:46:100
435384992710,14cyclictest265-21systemd-journal20:25:010
435386992618,5cyclictest449957-21systemctl19:56:212
435385992620,3cyclictest0-21swapper/120:00:011
435385992620,3cyclictest0-21swapper/119:25:011
435385992618,5cyclictest543304-21switchtime23:06:231
435385992618,5cyclictest2910165-21cups-browsed20:19:131
435384992620,4cyclictest560014-21kworker/u8:5-rpciod23:39:440
435384992620,3cyclictest0-21swapper/000:01:010
435385992520,2cyclictest0-21swapper/119:51:281
435385992519,3cyclictest1002-21mta-sts-daemon22:10:361
435385992518,4cyclictest1000-21mta-sts-daemon21:02:421
435385992517,5cyclictest420-21avahi-daemon20:52:471
435385992517,5cyclictest2910165-21cups-browsed20:28:241
435384992519,4cyclictest567714-21threads23:46:250
435384992517,5cyclictest2910165-21cups-browsed20:00:280
435384992517,3cyclictest0-21swapper/020:56:160
435384992516,6cyclictest446782-21ntp_kernel_pll_19:46:130
435384992514,3cyclictest442978-21latency_hist19:35:020
435386992418,3cyclictest0-21swapper/219:30:022
435386992418,3cyclictest0-21swapper/219:25:012
435386992416,5cyclictest436521-21switchtime19:11:212
43538499243,15cyclictest449826-21ntp_states19:56:190
435384992412,9cyclictest0-21swapper/019:26:070
435386992316,4cyclictest447246-21unixbench_multi19:46:222
435385992315,5cyclictest2910165-21cups-browsed19:11:281
435384992310,4cyclictest12650irq/32-eth020:15:010
435385992215,4cyclictest435406-21latency_hist19:10:021
435385992212,7cyclictest457398-21ps20:21:171
43538499221,9cyclictest468796-21aten_r2power_po21:01:040
435384992218,2cyclictest0-21swapper/020:06:050
435384992216,4cyclictest455192-21tail20:16:020
43538799213,12cyclictest0-21swapper/300:16:193
43538799213,11cyclictest0-21swapper/300:06:193
43538799211,12cyclictest0-21swapper/322:06:193
43538799203,10cyclictest0-21swapper/300:11:163
43538799202,9cyclictest0-21swapper/300:21:053
43538799202,11cyclictest0-21swapper/321:46:133
43538799202,11cyclictest0-21swapper/321:16:123
43538799202,10cyclictest0-21swapper/321:11:143
43538799196,9cyclictest0-21swapper/322:01:143
43538799194,9cyclictest0-21swapper/323:36:193
43538799193,8cyclictest0-21swapper/321:26:133
43538799192,10cyclictest0-21swapper/323:55:013
43538799191,8cyclictest0-21swapper/319:31:113
43538799191,10cyclictest0-21swapper/320:51:133
43538799184,8cyclictest0-21swapper/322:21:123
43538799183,7cyclictest0-21swapper/321:06:103
43538799183,7cyclictest0-21swapper/321:06:103
43538799182,8cyclictest0-21swapper/300:31:133
43538799182,7cyclictest0-21swapper/323:16:023
43538799181,10cyclictest0-21swapper/323:26:113
435386991812,3cyclictest0-21swapper/219:10:022
43538799174,7cyclictest0-21swapper/323:01:153
43538799174,7cyclictest0-21swapper/321:36:173
43538799173,9cyclictest0-21swapper/323:21:163
43538799172,9cyclictest0-21swapper/322:56:113
43538799172,8cyclictest0-21swapper/322:41:103
43538799172,6cyclictest0-21swapper/320:11:113
43538799172,11cyclictest0-21swapper/300:01:063
43538799172,10cyclictest0-21swapper/323:41:033
43538799172,10cyclictest0-21swapper/321:21:183
43538799171,10cyclictest0-21swapper/321:31:023
43538799164,7cyclictest0-21swapper/319:51:153
43538799164,5cyclictest0-21swapper/320:31:143
43538799163,8cyclictest0-21swapper/322:11:143
43538799162,9cyclictest0-21swapper/323:31:113
43538799162,9cyclictest0-21swapper/323:06:143
43538799162,9cyclictest0-21swapper/322:46:123
43538799162,9cyclictest0-21swapper/322:36:123
43538799162,8cyclictest0-21swapper/323:56:123
43538799162,8cyclictest0-21swapper/322:51:123
43538799162,8cyclictest0-21swapper/322:51:123
43538799162,8cyclictest0-21swapper/321:51:193
43538799162,8cyclictest0-21swapper/321:51:193
43538799162,7cyclictest0-21swapper/323:45:253
43538799161,9cyclictest0-21swapper/300:36:063
43538799161,9cyclictest0-21swapper/300:26:083
43538799161,8cyclictest0-21swapper/322:26:003
43538799161,7cyclictest0-21swapper/319:11:133
43538799161,6cyclictest0-21swapper/320:46:103
43538799161,6cyclictest0-21swapper/320:46:103
43538799161,10cyclictest0-21swapper/322:31:163
43538499167,6cyclictest421-21dbus-daemon19:10:010
43538799153,6cyclictest0-21swapper/319:56:123
43538799152,8cyclictest0-21swapper/323:11:093
43538799152,8cyclictest0-21swapper/321:41:033
43538799152,7cyclictest0-21swapper/321:56:013
43538799152,6cyclictest0-21swapper/320:06:143
43538799152,6cyclictest0-21swapper/319:36:113
43538799141,8cyclictest0-21swapper/322:16:033
43538799141,8cyclictest0-21swapper/319:46:103
43538799141,7cyclictest0-21swapper/320:01:173
43538799141,7cyclictest0-21swapper/319:41:143
43538799141,7cyclictest0-21swapper/319:21:163
43538799133,6cyclictest0-21swapper/320:21:093
43538799133,5cyclictest0-21swapper/320:41:133
43538799133,5cyclictest0-21swapper/320:41:133
43538799132,7cyclictest0-21swapper/320:26:133
43538799132,7cyclictest0-21swapper/320:16:053
43538799132,6cyclictest0-21swapper/319:26:103
43538799132,6cyclictest0-21swapper/319:16:113
43538799131,7cyclictest0-21swapper/320:56:193
43538799122,6cyclictest0-21swapper/321:01:143
43538799121,7cyclictest0-21swapper/320:36:113
4353879990,5cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional