You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 19:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Jun 06, 2026 00:42:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
515182995846,7cyclictest563789-21latency_hist21:30:021
515182995242,6cyclictest648775-21munin-plugin-st23:45:011
515183995043,3cyclictest0-21swapper/223:20:012
515181994926,3cyclictest602624-21missed_timers22:31:010
515181994926,3cyclictest602624-21missed_timers22:31:010
515183994839,6cyclictest664514-21cron00:10:012
515181994723,5cyclictest671967-21ntp_kernel_pll_00:21:020
515181994433,8cyclictest151ktimers/019:56:070
515183994335,4cyclictest0-21swapper/223:15:012
515183994231,8cyclictest530146-21/usr/sbin/munin20:00:012
51518299425,9cyclictest171rcu_preempt22:06:041
51518299423,33cyclictest637404-21ssh23:26:021
515181994232,5cyclictest151ktimers/021:56:090
515182994131,6cyclictest645638-21sendmail23:40:011
515182994128,10cyclictest625320-21timerwakeupswit23:06:141
515181994135,4cyclictest536174-21sendmail20:20:000
51518199412,22cyclictest12350irq/32-eth000:36:080
515181994121,14cyclictest12350irq/32-eth021:21:060
51518399405,30cyclictest564989-21ssh21:31:042
515183994034,3cyclictest0-21swapper/220:20:002
515183994031,6cyclictest653711-21unixbench_multi23:51:152
515183994031,5cyclictest551159-21diskmemload21:11:112
515182994032,5cyclictest527179-21systemd-run19:50:011
515182994032,5cyclictest1055-21mta-sts-daemon21:51:081
515182994031,5cyclictest551159-21diskmemload22:55:011
515182994031,5cyclictest551159-21diskmemload22:55:011
515182994029,8cyclictest540652-21grep20:35:011
515182994027,9cyclictest439-21systemd-logind20:55:011
515183993933,3cyclictest0-21swapper/223:05:012
51518299393,28cyclictest599752-21ssh22:26:091
51518299393,28cyclictest599752-21ssh22:26:091
515182993931,4cyclictest549658-21sh21:05:021
515182993929,6cyclictest516685-21systemd-run19:15:011
515181993931,4cyclictest151ktimers/019:51:060
515181993930,5cyclictest519701-21systemd-run19:25:010
515181993930,5cyclictest151ktimers/019:26:020
515183993830,5cyclictest620475-21tr23:00:002
515183993830,5cyclictest605293-21aten_r2power_en22:35:542
515183993829,5cyclictest596609-21ssh22:21:102
515183993829,5cyclictest596609-21ssh22:21:102
51518299384,28cyclictest681270-21ssh00:36:021
515182993830,5cyclictest525666-21latency_hist19:45:011
515182993829,6cyclictest534670-21systemd-run20:15:011
515182993827,8cyclictest564760-21latency21:30:591
515181993831,4cyclictest0-21swapper/022:05:010
515181993830,3cyclictest0-21swapper/020:01:100
51518199382,30cyclictest571297-21ssh21:41:030
515181993822,11cyclictest12350irq/32-eth021:31:040
515183993731,3cyclictest0-21swapper/223:41:032
515183993730,4cyclictest1051-21mta-sts-daemon21:26:402
515183993729,5cyclictest668205-21aten_r2power_fr00:15:542
515183993729,5cyclictest571902-21grep21:41:142
515183993729,5cyclictest533045-21unixbench_multi20:06:142
515183993729,5cyclictest533045-21unixbench_multi20:06:142
51518299374,27cyclictest596542-21ssh22:21:061
51518299374,27cyclictest596542-21ssh22:21:061
51518299373,22cyclictest609123-21ssh22:41:051
515182993728,5cyclictest0-21swapper/100:05:011
515182993727,7cyclictest548-21gdbus19:16:011
515182993723,9cyclictest551159-21diskmemload21:36:081
515181993728,3cyclictest151ktimers/023:31:050
515183993628,5cyclictest540724-21latency_hist20:35:022
515183993626,7cyclictest633977-21if_err_eth023:20:592
515182993628,5cyclictest521700-21fschecks_time19:31:001
515182993628,4cyclictest0-21swapper/123:51:141
515182993626,6cyclictest2965634-21cups-browsed23:19:201
515182993626,5cyclictest0-21swapper/123:21:001
515182993624,8cyclictest620981-21/usr/sbin/munin23:01:141
515182993620,11cyclictest421-21dbus-daemon23:31:151
51518199364,28cyclictest577648-21ssh21:51:070
51518199363,26cyclictest634402-21ssh23:21:090
515181993628,5cyclictest533183-21systemd-run20:10:010
515181993628,5cyclictest533183-21systemd-run20:10:010
51518399356,15cyclictest428-21mta-sts-daemon23:36:102
515183993530,2cyclictest0-21swapper/200:00:012
515183993529,4cyclictest595284-21kworker/u8:14-xprtiod00:05:022
515183993529,3cyclictest579514-21kworker/u8:5-xprtiod22:11:052
515183993529,3cyclictest0-21swapper/222:40:542
515183993528,3cyclictest633103-21kworker/u8:5+xprtiod23:35:012
515183993525,7cyclictest673900-21systemd00:25:012
515183993521,10cyclictest556041-21timerwakeupswit21:16:192
51518299353,5cyclictest171rcu_preempt23:46:071
515182993527,5cyclictest0-21swapper/122:00:011
515182993526,5cyclictest1056-21mta-sts-daemon22:46:281
515182993523,7cyclictest0-21swapper/122:19:311
515182993523,7cyclictest0-21swapper/122:19:311
51518299352,23cyclictest668805-21sh00:16:031
515182993519,9cyclictest551159-21diskmemload23:56:081
515181993529,4cyclictest595224-21cron22:20:000
515181993529,4cyclictest595224-21cron22:20:000
515181993528,4cyclictest647048-21wc23:41:110
515181993525,7cyclictest620445-21ssh23:00:000
515181993525,7cyclictest0-21swapper/023:26:090
515181993515,14cyclictest12350irq/32-eth022:11:050
51518399343,21cyclictest681365-21ssh00:36:062
51518399343,21cyclictest615485-21ssh22:51:082
51518399343,21cyclictest615485-21ssh22:51:082
515183993426,5cyclictest580017-21acpi21:55:522
515183993426,5cyclictest421-21dbus-daemon21:51:372
515183993424,7cyclictest593831-21timerwakeupswit22:16:212
515183993424,7cyclictest593831-21timerwakeupswit22:16:212
51518299347,4cyclictest171rcu_preempt22:56:031
51518299345,15cyclictest584002-21ssh22:01:081
51518299344,18cyclictest2965634-21cups-browsed20:01:111
515182993427,4cyclictest0-21swapper/121:00:011
515182993426,5cyclictest539348-21latency_hist20:30:031
515182993423,7cyclictest606314-21threads22:36:151
51518199343,24cyclictest561930-21ssh21:26:080
51518199342,27cyclictest612251-21ssh22:46:040
515181993420,12cyclictest659-21snmpd22:25:540
515181993420,12cyclictest659-21snmpd22:25:540
515183993327,3cyclictest0-21swapper/220:55:012
515183993327,3cyclictest0-21swapper/220:25:002
51518299333,23cyclictest672054-21ssh00:21:061
51518299333,23cyclictest658221-21cups-browsed00:11:081
51518299333,23cyclictest658221-21cups-browsed00:11:081
515182993324,6cyclictest629903-21cron23:15:001
51518299332,23cyclictest678324-21ssh00:31:091
515181993328,3cyclictest652762-21fschecks_time23:50:570
515181993326,4cyclictest554350-21latency_hist21:15:020
51518399323,23cyclictest678197-21ssh00:31:032
51518399323,22cyclictest624820-21ssh23:06:022
515183993226,3cyclictest0-21swapper/222:25:522
515183993226,3cyclictest0-21swapper/222:25:522
515183993226,3cyclictest0-21swapper/200:26:032
515183993224,5cyclictest559253-21unixbench_multi21:21:182
515183993224,5cyclictest1-21systemd20:40:012
51518299324,22cyclictest675056-21ssh00:26:021
515182993224,5cyclictest664520-21cron00:10:011
515182993224,5cyclictest579514-21kworker/u8:5+xprtiod22:10:561
51518299322,24cyclictest555526-21ssh21:16:071
515181993225,5cyclictest1-21systemd19:20:010
515181993225,4cyclictest668226-21aten_r2power_po00:15:540
515181993222,8cyclictest261-21systemd-journal00:29:120
51518199322,25cyclictest596690-21sh22:21:110
51518199322,25cyclictest596690-21sh22:21:110
515181993216,10cyclictest12350irq/32-eth023:06:020
51518399314,20cyclictest1054-21mta-sts-daemon20:01:142
515183993123,5cyclictest528668-21systemd-run19:55:012
515183993122,6cyclictest0-21swapper/221:40:012
515182993124,4cyclictest0-21swapper/119:55:011
515182993121,6cyclictest536688-21fschecks_count20:20:561
515182993113,13cyclictest261rcuc/120:16:011
515181993126,3cyclictest551159-21diskmemload22:36:020
515181993126,2cyclictest0-21swapper/023:01:110
515181993124,4cyclictest261-21systemd-journal21:16:110
515181993118,8cyclictest609184-21sh22:41:070
515181993111,14cyclictest421-21dbus-daemon21:36:020
515183993024,3cyclictest1054-21mta-sts-daemon21:05:032
515183993023,4cyclictest650575-21unixbench_multi23:46:152
515183993023,4cyclictest543892-21acpi20:45:522
515183993023,4cyclictest1051-21mta-sts-daemon22:03:122
515183993022,5cyclictest551153-21cron21:10:012
51518399302,24cyclictest522083-21sshd19:31:082
515183993021,6cyclictest548143-21grep21:00:012
515183993014,14cyclictest351ktimers/219:16:082
51518299305,17cyclictest428-21mta-sts-daemon19:21:091
51518299303,21cyclictest574489-21sh21:46:091
51518299303,20cyclictest571305-21ssh21:41:041
515182993024,3cyclictest0-21swapper/121:11:011
51518299301,22cyclictest558703-21ssh21:21:071
51518199308,17cyclictest12350irq/32-eth023:46:040
51518199303,19cyclictest12350irq/32-eth020:26:020
515181993025,2cyclictest0-21swapper/019:45:010
51518199301,23cyclictest631165-21ssh23:16:050
51518399293,22cyclictest602796-21ssh22:31:052
51518399293,22cyclictest602796-21ssh22:31:052
515183992923,3cyclictest0-21swapper/219:40:012
515183992921,5cyclictest667589-21ssh00:15:012
515183992921,5cyclictest667589-21ssh00:15:012
515183992916,9cyclictest586433-21aten_r2power_fr22:05:542
51518299292,9cyclictest171rcu_preempt20:41:021
515182992919,5cyclictest604793-21latency_hist22:35:021
515182992919,5cyclictest604793-21latency_hist22:35:021
515182992916,10cyclictest271ktimers/120:06:011
515182992916,10cyclictest271ktimers/120:06:011
515181992922,5cyclictest2965634-21cups-browsed20:45:570
51518199292,22cyclictest659464-21ssh00:01:020
51518199292,21cyclictest643738-21ssh23:36:060
515181992917,9cyclictest0-21swapper/000:30:570
51518199291,13cyclictest656861-21unixbench_multi23:56:150
515183992820,5cyclictest1-21systemd21:50:012
515182992821,3cyclictest0-21swapper/121:10:011
515182992820,5cyclictest529190-21gltestperf19:55:571
515183992720,4cyclictest637995-21unixbench_multi23:26:152
515183992718,6cyclictest1055-21mta-sts-daemon19:21:092
515181992722,3cyclictest1054-21mta-sts-daemon22:07:210
515181992719,6cyclictest541177-21fschecks_time20:35:570
515181992715,8cyclictest12350irq/32-eth000:06:030
51518399265,17cyclictest428-21mta-sts-daemon20:11:042
51518399262,20cyclictest261-21systemd-journal19:41:092
515183992620,3cyclictest0-21swapper/222:46:042
515183992620,3cyclictest0-21swapper/220:41:162
515182992618,5cyclictest545169-21systemd-run20:50:011
515182992617,6cyclictest420-21avahi-daemon19:25:571
515181992620,3cyclictest0-21swapper/019:31:080
515181992617,4cyclictest151ktimers/020:31:030
515181992615,8cyclictest524146-21cron19:40:010
515181992614,8cyclictest12350irq/32-eth023:11:030
515181992614,10cyclictest574343-21missed_timers21:46:030
515183992519,3cyclictest1055-21mta-sts-daemon19:12:222
515181992517,6cyclictest615203-21latency22:50:590
515181992517,6cyclictest615203-21latency22:50:590
51518199251,21cyclictest665862-21ssh00:11:100
51518199251,21cyclictest665862-21ssh00:11:100
515183992416,5cyclictest527064-21unixbench_multi19:46:172
515182992418,3cyclictest0-21swapper/120:40:011
515181992417,4cyclictest543533-21unixbench_multi20:41:160
515181992415,6cyclictest420-21avahi-daemon20:11:120
51518399232,8cyclictest0-21swapper/220:25:552
515183992317,3cyclictest1056-21mta-sts-daemon19:10:032
515183992315,5cyclictest2965634-21cups-browsed19:25:452
515182992313,7cyclictest524112-21grep19:36:151
51518199239,11cyclictest0-21swapper/019:11:110
515181992318,2cyclictest0-21swapper/021:00:580
515181992213,7cyclictest550559-21ntp_kernel_pll_21:06:040
515181992210,9cyclictest547600-21ntpq20:56:080
515182992112,7cyclictest515185-21sh19:10:011
515181992114,4cyclictest0-21swapper/020:50:530
515181992113,6cyclictest0-21swapper/020:21:140
515181992113,5cyclictest151ktimers/019:46:040
51518199199,7cyclictest261-21systemd-journal19:10:020
51518499174,6cyclictest0-21swapper/323:21:083
51518499174,6cyclictest0-21swapper/300:26:043
51518499172,7cyclictest0-21swapper/323:41:063
51518499172,7cyclictest0-21swapper/300:21:023
51518499171,7cyclictest0-21swapper/322:16:093
51518499171,7cyclictest0-21swapper/322:16:093
51518499165,7cyclictest0-21swapper/321:56:023
51518499162,7cyclictest0-21swapper/300:16:053
51518499161,8cyclictest0-21swapper/322:56:073
51518499161,8cyclictest0-21swapper/321:51:033
51518499161,7cyclictest0-21swapper/321:46:093
51518499152,7cyclictest0-21swapper/323:36:053
51518499152,7cyclictest0-21swapper/322:11:033
51518499152,7cyclictest0-21swapper/322:01:023
51518499152,6cyclictest0-21swapper/323:26:023
51518499152,6cyclictest0-21swapper/320:56:073
51518499152,6cyclictest0-21swapper/319:36:093
51518499152,6cyclictest0-21swapper/300:11:023
51518499152,6cyclictest0-21swapper/300:11:023
51518499151,8cyclictest0-21swapper/323:31:093
51518499151,8cyclictest0-21swapper/322:36:073
51518499151,8cyclictest0-21swapper/322:26:053
51518499151,8cyclictest0-21swapper/322:26:053
51518499151,7cyclictest0-21swapper/323:46:023
51518499151,7cyclictest0-21swapper/322:21:043
51518499151,7cyclictest0-21swapper/322:21:043
51518499151,7cyclictest0-21swapper/321:26:063
51518499143,6cyclictest0-21swapper/322:51:043
51518499143,6cyclictest0-21swapper/322:51:043
51518499143,6cyclictest0-21swapper/321:21:063
51518499142,7cyclictest0-21swapper/323:00:523
51518499142,7cyclictest0-21swapper/300:36:043
51518499141,8cyclictest0-21swapper/320:16:113
51518499141,7cyclictest0-21swapper/323:56:033
51518499141,7cyclictest0-21swapper/323:06:033
51518499141,7cyclictest0-21swapper/321:41:053
51518499141,7cyclictest0-21swapper/319:51:033
51518499141,6cyclictest0-21swapper/322:41:023
51518499141,6cyclictest0-21swapper/320:41:053
51518499141,6cyclictest0-21swapper/320:26:043
51518499141,6cyclictest0-21swapper/320:06:023
51518499141,6cyclictest0-21swapper/320:06:023
51518499141,5cyclictest0-21swapper/320:51:033
51518499133,7cyclictest0-21swapper/321:31:043
51518499131,7cyclictest0-21swapper/321:36:023
51518499131,7cyclictest0-21swapper/321:11:023
51518499131,7cyclictest0-21swapper/320:11:073
51518499131,7cyclictest0-21swapper/319:41:133
51518499131,7cyclictest0-21swapper/300:01:023
51518499131,6cyclictest0-21swapper/322:46:023
51518499131,6cyclictest0-21swapper/321:06:023
51518499131,6cyclictest0-21swapper/320:46:053
51518499131,6cyclictest0-21swapper/320:31:063
51518499131,6cyclictest0-21swapper/320:01:103
51518499131,5cyclictest0-21swapper/319:56:023
51518499124,4cyclictest0-21swapper/319:46:073
51518499123,6cyclictest0-21swapper/323:16:033
51518499122,6cyclictest0-21swapper/323:50:593
51518499122,6cyclictest0-21swapper/300:06:063
51518499121,7cyclictest0-21swapper/323:11:073
51518499121,7cyclictest0-21swapper/322:31:043
51518499121,7cyclictest0-21swapper/322:31:043
51518499121,7cyclictest0-21swapper/321:16:063
51518499121,7cyclictest0-21swapper/300:31:023
51518499121,6cyclictest0-21swapper/320:21:053
51518499121,6cyclictest0-21swapper/319:16:053
51518499121,5cyclictest0-21swapper/319:11:033
51518499120,6cyclictest0-21swapper/319:21:043
51518499112,5cyclictest0-21swapper/322:05:533
51518499111,5cyclictest0-21swapper/319:31:053
51518499111,5cyclictest0-21swapper/319:26:033
51518499101,6cyclictest0-21swapper/321:01:073
51518499101,5cyclictest0-21swapper/320:36:033
5151849982,5cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional