You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 01:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 08, 2026 00:42:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
65334995950,6cyclictest1-21systemd23:55:012
65333995344,5cyclictest0-21swapper/122:46:111
65333995138,8cyclictest173125-21latency_hist23:05:021
65333995138,8cyclictest173125-21latency_hist23:05:021
65334995038,8cyclictest420-21avahi-daemon22:54:272
65332995042,5cyclictest421-21dbus-daemon21:05:020
65334994737,5cyclictest90824-21systemd-run20:35:012
65334994737,5cyclictest90824-21systemd-run20:35:012
65334994736,6cyclictest0-21swapper/221:36:042
6533499472,8cyclictest139584-21df_inode22:10:572
6533499472,8cyclictest139584-21df_inode22:10:572
65334994721,22cyclictest0-21swapper/222:05:002
65334994721,22cyclictest0-21swapper/222:05:002
65333994738,6cyclictest421-21dbus-daemon20:45:011
6533299471,37cyclictest124463-21ssh21:46:050
6533399463,36cyclictest230145-21ssh00:36:061
65332994634,9cyclictest145026-21sh22:20:000
6533299463,34cyclictest192871-21ssh23:36:080
6533499443,8cyclictest94725-21ntpq20:46:062
65334994435,5cyclictest0-21swapper/222:26:112
65334994434,7cyclictest157430-21idleruntime-cro22:40:002
65334994424,16cyclictest0-21swapper/200:06:132
6533499441,12cyclictest78212-21ntpq19:51:062
65333994434,7cyclictest207120-21ssh00:00:011
65333994430,11cyclictest132569-21idleruntime-cro22:00:011
65334994336,4cyclictest182237-21ssh23:20:012
65334994332,5cyclictest0-21swapper/221:16:122
6533499432,13cyclictest136919-21ssh22:06:072
6533499432,13cyclictest136919-21ssh22:06:072
65334994312,5cyclictest0-21swapper/200:21:122
65332994334,6cyclictest180710-21switchtime23:16:150
65332994331,9cyclictest80307-21grep20:00:000
6533299432,35cyclictest177271-21ssh23:11:070
65334994219,20cyclictest160557-21kworker/u8:4-rpciod22:46:002
65334994218,20cyclictest0-21swapper/222:00:012
65334994216,23cyclictest85091-21aten_r2power_en20:15:542
65334994216,22cyclictest101310-21diskmemload00:26:052
65334994215,4cyclictest69849-21kworker/u8:0-nfsiod19:30:022
65333994232,6cyclictest71339-21systemd-run19:30:011
65333994232,6cyclictest214577-21sh00:11:051
65333994231,8cyclictest179148-21cut23:15:011
65332994232,8cyclictest207129-21latency_hist00:00:020
65334994133,5cyclictest191572-21cut23:35:012
65334994130,7cyclictest173577-21aten_r2power_fr23:05:582
65334994118,20cyclictest183224-21/usr/sbin/munin23:21:002
65334994118,19cyclictest2524656-21cups-browsed20:41:162
65334994117,21cyclictest0-21swapper/221:41:172
65334994116,2cyclictest0-21swapper/221:21:012
65334994115,3cyclictest0-21swapper/221:51:052
65334994115,2cyclictest0-21swapper/222:35:012
6533499411,16cyclictest230155-21rm00:36:062
6533499411,11cyclictest188102-21ssh23:28:562
65333994127,10cyclictest136863-21ssh22:06:041
65333994127,10cyclictest136863-21ssh22:06:041
6533399412,35cyclictest121479-21rm21:41:111
6533299414,32cyclictest127520-21ssh21:51:040
65332994131,7cyclictest202752-21unixbench_singl23:51:210
65332994128,10cyclictest166740-21ssh22:55:010
65334994030,7cyclictest160540-21munin-run22:45:002
65334994016,2cyclictest0-21swapper/223:01:062
65334994016,2cyclictest0-21swapper/223:01:062
65334994015,2cyclictest0-21swapper/223:11:092
65333994030,6cyclictest196146-21mailstats23:41:121
65333994025,9cyclictest420-21avahi-daemon21:30:551
6533399401,4cyclictest171rcu_preempt19:16:111
6533399401,30cyclictest152397-21ssh22:31:041
65333994011,22cyclictest421-21dbus-daemon21:46:091
6533499393,8cyclictest66263-21ntpq19:11:072
6533499392,16cyclictest96287-21ntpq20:51:182
65334993918,18cyclictest0-21swapper/223:56:052
65334993918,17cyclictest141913-21kworker/u8:6-events_unbound23:45:552
65334993918,17cyclictest0-21swapper/223:36:072
65334993918,17cyclictest0-21swapper/200:16:082
65334993916,19cyclictest0-21swapper/221:11:062
65334993914,22cyclictest0-21swapper/221:06:102
65334993913,2cyclictest0-21swapper/200:31:082
6533499391,14cyclictest169840-21/usr/sbin/munin23:00:012
65333993928,8cyclictest101313-21cut21:10:021
65332993932,4cyclictest92339-21systemd-run20:40:010
65332993926,6cyclictest151ktimers/022:46:100
65332993923,3cyclictest171rcu_preempt20:46:060
65332993914,4cyclictest171rcu_preempt21:36:120
6533499383,8cyclictest208415-21ssh00:01:122
65334993813,2cyclictest0-21swapper/219:41:092
65333993830,3cyclictest0-21swapper/123:40:011
65333993829,4cyclictest0-21swapper/121:30:011
65333993828,6cyclictest191583-21idleruntime-cro23:35:011
65333993828,6cyclictest141902-21cut22:15:001
65333993828,6cyclictest141902-21cut22:15:001
65332993829,6cyclictest156106-21unixbench_multi22:36:180
65332993829,6cyclictest141913-21kworker/u8:6-xprtiod23:00:010
65332993826,9cyclictest86298-21cron20:20:010
65332993820,13cyclictest12350irq/32-eth000:36:080
65334993717,17cyclictest0-21swapper/222:21:052
65334993716,18cyclictest0-21swapper/223:41:082
65334993716,17cyclictest0-21swapper/221:31:162
65334993715,19cyclictest0-21swapper/221:45:582
65334993714,2cyclictest0-21swapper/221:25:542
65334993714,2cyclictest0-21swapper/200:15:022
65334993713,5cyclictest145003-21munin-run22:20:002
6533499371,13cyclictest88713-21ntpq20:26:072
65333993729,5cyclictest87844-21systemd-run20:25:011
65333993729,5cyclictest166779-21systemd-run22:55:021
65333993729,5cyclictest113865-21kworker/u8:5+xprtiod22:01:171
65333993729,5cyclictest113865-21kworker/u8:5+xprtiod22:01:171
65333993729,5cyclictest1054-21mta-sts-daemon21:13:581
65333993718,3cyclictest171rcu_preempt21:21:111
65332993728,6cyclictest420-21avahi-daemon22:44:430
65332993727,7cyclictest420-21avahi-daemon00:08:040
6533499361,12cyclictest87234-21ntpq20:21:072
65332993628,6cyclictest219931-21sshd00:20:210
65332993617,4cyclictest171rcu_preempt22:21:050
6533299361,29cyclictest121408-21ssh21:41:080
6533299361,12cyclictest14-21ksoftirqd/000:16:090
6533299360,6cyclictest208472-21ntpq00:01:150
65334993514,2cyclictest0-21swapper/221:00:012
65333993527,5cyclictest219590-21munin-plugin-st00:20:011
65333993527,5cyclictest174812-21unixbench_singl23:06:241
65333993526,5cyclictest204110-21latency_hist23:55:021
65333993523,8cyclictest420-21avahi-daemon22:37:561
6533399352,26cyclictest420-21avahi-daemon19:11:031
65332993529,3cyclictest141913-21kworker/u8:6+xprtiod22:15:010
65332993529,3cyclictest141913-21kworker/u8:6+xprtiod22:15:010
65332993526,6cyclictest98245-21unixbench_singl20:56:200
65332993516,13cyclictest12350irq/32-eth023:21:050
65332993512,12cyclictest2524656-21cups-browsed20:26:060
6533499343,8cyclictest67795-21ntpq19:16:102
65334993418,13cyclictest1054-21mta-sts-daemon20:10:592
65334993415,2cyclictest0-21swapper/219:46:172
65334993413,3cyclictest0-21swapper/219:55:592
6533399343,22cyclictest199074-21ssh23:46:071
65333993426,5cyclictest151380-21latency_hist22:30:021
65333993426,5cyclictest1051-21mta-sts-daemon22:41:261
65332993428,4cyclictest1054-21mta-sts-daemon00:29:580
65332993425,6cyclictest189358-21/usr/sbin/munin23:30:590
65334993325,5cyclictest69835-21munin-plugin-st19:25:012
65334993316,3cyclictest81693-21grep20:01:202
65334993311,2cyclictest0-21swapper/221:00:552
65333993327,3cyclictest0-21swapper/120:40:001
65333993327,3cyclictest0-21swapper/120:00:001
65333993326,4cyclictest145012-21idleruntime-cro22:20:001
65333993325,5cyclictest207818-21aten_r2power_po00:00:571
65333993322,7cyclictest421-21dbus-daemon22:22:201
6533299339,20cyclictest12350irq/32-eth023:46:060
65332993325,5cyclictest228905-21cron00:35:010
65332993325,5cyclictest151ktimers/022:01:110
65332993325,5cyclictest151ktimers/022:01:110
65332993324,6cyclictest420-21avahi-daemon21:20:140
65332993318,11cyclictest12350irq/32-eth019:46:060
65333993227,2cyclictest0-21swapper/119:45:011
6533399322,23cyclictest180337-21ssh23:16:031
65332993224,3cyclictest0-21swapper/021:26:000
65332993223,7cyclictest69829-21munin-plugin-st19:25:020
65332993217,3cyclictest171rcu_preempt22:31:090
65333993125,3cyclictest182285-21kworker/u8:10-xprtiod23:26:131
65333993123,4cyclictest168547-21grep22:56:211
65333993123,4cyclictest0-21swapper/121:51:171
65333993122,5cyclictest83337-21systemd-run20:10:011
65333993120,6cyclictest71618-21aten_r2power_en19:30:541
65333993118,9cyclictest89317-21grep20:30:001
6533299314,8cyclictest14-21ksoftirqd/019:26:070
65332993126,3cyclictest65331-21cyclictest23:01:290
65332993126,3cyclictest65331-21cyclictest23:01:290
65332993125,3cyclictest106307-21grep21:16:200
65332993124,3cyclictest0-21swapper/000:11:040
6533299312,22cyclictest174334-21ssh23:06:170
65332993120,3cyclictest171rcu_preempt21:12:520
65332993119,3cyclictest171rcu_preempt20:06:040
65332993118,3cyclictest171rcu_preempt21:06:030
6533399309,13cyclictest420-21avahi-daemon20:51:141
6533399304,20cyclictest624-21lldpd19:51:071
65333993023,3cyclictest0-21swapper/123:24:121
65333993022,5cyclictest81775-21unixbench_singl20:01:201
6533399302,21cyclictest118195-21ssh21:36:061
65333993021,5cyclictest0-21swapper/100:33:121
65332993026,2cyclictest0-21swapper/020:01:200
65332993025,3cyclictest57-21kcompactd021:30:550
65332993022,5cyclictest439-21systemd-logind20:35:010
65332993022,5cyclictest439-21systemd-logind20:35:010
6533299302,22cyclictest195883-21ssh23:41:040
65332993018,3cyclictest171rcu_preempt22:26:090
65332993015,3cyclictest171rcu_preempt19:31:060
65332993014,5cyclictest171rcu_preempt22:06:050
65332993014,5cyclictest171rcu_preempt22:06:050
65334992920,6cyclictest72402-21mailstats19:31:122
65333992921,5cyclictest421-21dbus-daemon19:25:021
65333992921,5cyclictest1-21systemd21:05:011
65332992918,3cyclictest171rcu_preempt20:41:090
65332992918,3cyclictest171rcu_preempt19:19:280
65332992917,3cyclictest171rcu_preempt21:56:090
65332992914,3cyclictest171rcu_preempt19:55:010
6533399282,19cyclictest211492-21ssh00:06:071
65333992818,6cyclictest2524656-21cups-browsed21:17:181
6533399280,14cyclictest171rcu_preempt20:46:061
65332992818,7cyclictest96116-21needreboot20:51:090
65334992722,2cyclictest0-21swapper/220:10:012
65333992724,2cyclictest0-21swapper/120:11:071
65333992721,3cyclictest0-21swapper/100:26:141
65333992720,4cyclictest0-21swapper/120:20:031
65332992719,5cyclictest420-21avahi-daemon19:40:580
65332992711,3cyclictest171rcu_preempt20:20:580
65332992710,3cyclictest171rcu_preempt23:26:080
65334992619,4cyclictest92148-21unixbench-2d20:36:172
65332992620,3cyclictest0-21swapper/019:11:030
65332992610,8cyclictest171rcu_preempt20:10:580
65333992519,3cyclictest59991-21kworker/u8:8-xprtiod19:40:011
65333992517,5cyclictest221054-21sendmail_mailqu00:21:151
6533299257,6cyclictest14-21ksoftirqd/019:36:080
65333992417,5cyclictest1054-21mta-sts-daemon19:45:561
65333992417,4cyclictest90667-21unixbench-2d20:31:161
65333992417,4cyclictest90667-21unixbench-2d20:31:161
6533299234,5cyclictest14-21ksoftirqd/019:10:020
65334992116,3cyclictest1055-21mta-sts-daemon19:38:462
6533399216,12cyclictest271ktimers/120:56:091
6533599183,10cyclictest0-21swapper/323:01:043
6533599183,10cyclictest0-21swapper/323:01:043
6533599183,10cyclictest0-21swapper/322:01:053
6533599183,10cyclictest0-21swapper/322:01:053
6533599182,9cyclictest0-21swapper/322:46:113
6533599182,8cyclictest0-21swapper/323:21:103
6533599172,10cyclictest0-21swapper/321:16:123
6533599163,8cyclictest0-21swapper/321:26:043
6533599162,9cyclictest0-21swapper/323:06:183
6533599161,8cyclictest0-21swapper/321:51:113
6533599161,6cyclictest0-21swapper/320:31:033
6533599161,6cyclictest0-21swapper/320:31:033
6533499161,11cyclictest65430-21latency_hist19:10:022
6533399168,5cyclictest421-21dbus-daemon19:10:021
6533599153,9cyclictest0-21swapper/319:11:033
6533599153,7cyclictest0-21swapper/322:41:073
6533599153,7cyclictest0-21swapper/300:11:063
6533599152,9cyclictest0-21swapper/300:21:113
6533599152,8cyclictest0-21swapper/323:26:033
6533599152,8cyclictest0-21swapper/322:50:563
6533599152,8cyclictest0-21swapper/322:16:033
6533599152,7cyclictest0-21swapper/320:05:003
6533599152,6cyclictest0-21swapper/323:46:033
6533599151,8cyclictest0-21swapper/321:11:043
6533599151,8cyclictest0-21swapper/321:06:073
6533599151,8cyclictest0-21swapper/320:06:043
6533599151,7cyclictest0-21swapper/319:51:043
6533599151,10cyclictest0-21swapper/321:46:093
6533599143,6cyclictest0-21swapper/322:26:083
6533599142,8cyclictest0-21swapper/323:41:043
6533599142,8cyclictest0-21swapper/321:41:123
6533599142,7cyclictest0-21swapper/321:36:063
6533599141,9cyclictest0-21swapper/321:20:593
6533599141,8cyclictest0-21swapper/323:56:063
6533599141,8cyclictest0-21swapper/321:31:043
6533599141,8cyclictest0-21swapper/300:31:113
6533599141,7cyclictest0-21swapper/322:10:593
6533599141,7cyclictest0-21swapper/322:10:593
6533599141,6cyclictest0-21swapper/320:46:043
6533599133,7cyclictest0-21swapper/300:15:553
6533599133,6cyclictest0-21swapper/300:25:593
6533599133,5cyclictest0-21swapper/320:20:013
6533599133,4cyclictest0-21swapper/319:31:053
6533599132,7cyclictest0-21swapper/323:15:593
6533599132,7cyclictest0-21swapper/322:56:213
6533599132,7cyclictest0-21swapper/322:06:043
6533599132,7cyclictest0-21swapper/322:06:043
6533599132,6cyclictest0-21swapper/319:56:073
6533599131,8cyclictest0-21swapper/322:36:063
6533599131,8cyclictest0-21swapper/322:20:593
6533599131,8cyclictest0-21swapper/300:06:063
6533599131,7cyclictest0-21swapper/323:11:053
6533599131,7cyclictest0-21swapper/322:31:053
6533599131,7cyclictest0-21swapper/320:51:143
6533599131,7cyclictest0-21swapper/300:36:033
6533599131,7cyclictest0-21swapper/300:01:153
6533599131,6cyclictest0-21swapper/319:26:083
6533599122,7cyclictest0-21swapper/321:56:053
6533599122,7cyclictest0-21swapper/320:30:013
6533599122,6cyclictest0-21swapper/323:31:033
6533599122,5cyclictest0-21swapper/320:21:083
6533599121,7cyclictest0-21swapper/323:51:033
6533599121,7cyclictest0-21swapper/323:35:563
6533599121,7cyclictest0-21swapper/319:41:063
6533599121,6cyclictest0-21swapper/321:01:053
6533599121,6cyclictest0-21swapper/320:56:123
6533599121,6cyclictest0-21swapper/320:41:103
6533599121,6cyclictest0-21swapper/319:21:073
6533599121,6cyclictest0-21swapper/319:16:063
6533599120,5cyclictest0-21swapper/319:36:023
6533599111,6cyclictest0-21swapper/320:36:063
6533599111,6cyclictest0-21swapper/320:11:043
6533599101,6cyclictest0-21swapper/319:46:043
653359981,3cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional