You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 11:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Sat Sep 05, 2026 00:42:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2897113995347,2cyclictest0-21swapper/100:20:011
2897112995348,3cyclictest0-21swapper/021:36:050
2897113995139,4cyclictest0-21swapper/120:06:101
2897112995141,7cyclictest2933259-21latency_hist21:10:020
2897113994939,7cyclictest421-21dbus-daemon19:31:091
2897114994736,7cyclictest3036976-21munin-run00:00:012
289711499472,35cyclictest2934412-21ssh21:11:122
2897113994724,3cyclictest171rcu_preempt23:16:031
2897112994632,4cyclictest2907661-21cut19:45:010
2897114994536,6cyclictest3022396-21aten_r2power_po23:35:562
2897112994525,10cyclictest12650irq/32-eth000:01:080
2897114994333,7cyclictest2910655-21sh19:55:012
2897113994335,5cyclictest3004266-21tr23:05:591
2897114994235,3cyclictest0-21swapper/223:20:012
2897113994233,6cyclictest3046369-21latency_hist00:15:031
2897112994232,8cyclictest2990976-21sh22:44:170
2897112994227,12cyclictest3024783-21ssh23:40:010
2897114994132,5cyclictest2982280-21latency_hist22:30:022
2897114994132,5cyclictest2982280-21latency_hist22:30:022
2897113994132,6cyclictest2909163-21systemd-run19:50:011
2897113994132,6cyclictest2909163-21systemd-run19:50:011
2897112994135,4cyclictest2957674-21latency_hist21:50:010
2897114994034,3cyclictest0-21swapper/222:56:112
2897113994032,5cyclictest3049870-21aten_r2power_fr00:20:581
2897113994032,5cyclictest2975402-21ssh22:18:161
2897112994021,14cyclictest151ktimers/022:16:060
2897112994019,4cyclictest171rcu_preempt23:56:100
2897112994014,19cyclictest3050645-21rm00:21:150
2897114993931,5cyclictest3046162-21cron00:15:012
2897114993931,5cyclictest2922668-21systemd-run20:35:012
289711499392,31cyclictest443-21gpm20:51:072
2897113993931,5cyclictest2919685-21systemd-run20:25:021
2897113993930,6cyclictest421-21dbus-daemon23:55:021
2897113993930,5cyclictest1003-21mta-sts-daemon21:19:231
2897112993931,5cyclictest2901530-21head19:21:180
2897112993929,7cyclictest2958177-21/usr/sbin/munin21:51:100
2897114993830,5cyclictest2991227-21munin-run22:45:012
2897113993831,4cyclictest0-21swapper/100:40:011
289711399382,29cyclictest2977344-21ssh22:21:131
289711399382,29cyclictest2977344-21ssh22:21:131
2897112993833,3cyclictest12650irq/32-eth023:11:060
2897114993730,4cyclictest2904638-21cron19:35:012
2897114993729,5cyclictest3028655-21sort23:45:592
2897114993728,5cyclictest2988346-21grep22:40:022
2897114993725,9cyclictest2918149-21/usr/sbin/munin20:20:022
2897113993729,5cyclictest3027915-21latency_hist23:45:021
2897114993630,3cyclictest0-21swapper/222:31:082
2897114993628,4cyclictest1003-21mta-sts-daemon23:22:422
2897114993626,7cyclictest2942373-21cut21:25:022
289711499362,25cyclictest3032259-21ssh23:51:122
2897113993628,5cyclictest3036983-21idleruntime-cro00:00:011
2897113993627,6cyclictest2956145-21mailstats21:46:161
2897113993627,6cyclictest1186442-21cups-browsed22:00:571
2897113993627,5cyclictest3043130-21sh00:10:011
2897113993626,7cyclictest2941020-21timerwakeupswit21:21:181
2897113993623,5cyclictest2998389-21missed_timers22:56:031
2897112993630,3cyclictest0-21swapper/023:41:100
2897112993628,5cyclictest420-21avahi-daemon21:33:580
2897112993627,6cyclictest1186442-21cups-browsed20:01:020
2897112993625,7cyclictest2939277-21munin-run21:20:010
2897112993616,16cyclictest0-21swapper/000:10:020
2897112993611,8cyclictest171rcu_preempt21:26:070
2897114993530,2cyclictest0-21swapper/223:05:012
2897114993530,2cyclictest0-21swapper/200:36:162
2897114993529,3cyclictest0-21swapper/223:30:012
2897114993528,4cyclictest0-21swapper/221:41:102
2897113993527,4cyclictest0-21swapper/123:11:061
2897113993526,5cyclictest2918016-21unixbench_multi20:16:161
289711399351,3cyclictest171rcu_preempt00:31:101
289711399351,3cyclictest171rcu_preempt00:31:101
2897112993529,4cyclictest2906178-21systemd-run19:40:010
2897112993529,3cyclictest0-21swapper/020:11:080
2897112993527,5cyclictest1-21systemd20:40:010
2897114993428,3cyclictest0-21swapper/219:30:012
2897114993427,4cyclictest3055362-21systemd-run00:30:012
2897114993427,4cyclictest3055362-21systemd-run00:30:012
2897114993426,5cyclictest3058545-21latency_hist00:35:022
2897114993426,5cyclictest3058545-21latency_hist00:35:022
2897114993426,5cyclictest2906132-21cron19:40:012
2897114993426,5cyclictest1186442-21cups-browsed21:53:152
2897114993424,7cyclictest2937751-21switchtime21:16:172
2897114993424,6cyclictest3006599-21latency_hist23:10:022
2897113993426,5cyclictest2934978-21grep21:11:231
2897112993428,4cyclictest3001709-21/usr/sbin/munin23:01:120
2897112993428,3cyclictest0-21swapper/000:16:160
2897112993427,4cyclictest2922719-21latency_hist20:35:020
2897112993425,6cyclictest2953302-21timerwakeupswit21:41:160
289711299342,27cyclictest2925453-21sed20:41:170
289711299342,26cyclictest2986400-21ssh22:36:090
2897112993420,4cyclictest2904647-21munin-plugin-st19:35:010
289711299341,29cyclictest2998529-21ntpq22:56:070
289711499334,15cyclictest2974237-21ssh22:16:112
2897114993326,4cyclictest1003-21mta-sts-daemon00:24:592
2897114993326,4cyclictest1002-21mta-sts-daemon23:42:372
2897114993325,6cyclictest0-21swapper/222:00:022
2897114993325,6cyclictest0-21swapper/222:00:022
2897114993325,5cyclictest2910942-21aten_r2power_en19:55:562
2897114993325,5cyclictest1186442-21cups-browsed21:47:002
2897113993327,3cyclictest0-21swapper/120:46:121
2897113993326,4cyclictest2930016-21tail20:56:171
2897113993326,4cyclictest1000-21mta-sts-daemon23:45:571
2897113993325,5cyclictest3054087-21tail00:26:191
2897113993325,5cyclictest3054087-21tail00:26:191
289711399331,26cyclictest2995569-21ssh22:51:091
2897112993326,3cyclictest0-21swapper/023:50:020
2897112993322,8cyclictest2976750-21cpuspeed22:20:590
2897112993322,8cyclictest2976750-21cpuspeed22:20:590
289711299332,24cyclictest3059703-21ssh00:36:100
2897112993321,9cyclictest0-21swapper/023:51:170
2897112993318,11cyclictest0-21swapper/022:01:000
2897114993227,2cyclictest0-21swapper/220:15:012
2897114993225,3cyclictest0-21swapper/223:11:112
2897114993224,5cyclictest3021740-21cron23:35:012
2897113993227,2cyclictest0-21swapper/119:40:011
2897113993226,3cyclictest0-21swapper/121:41:041
2897113993225,3cyclictest0-21swapper/121:36:171
2897113993224,5cyclictest2945461-21systemd-run21:30:011
2897113993223,6cyclictest1002-21mta-sts-daemon23:26:081
2897113993223,5cyclictest2992362-21needreboot22:46:051
2897112993225,4cyclictest3015648-21sh23:25:000
2897112993225,3cyclictest0-21swapper/000:14:360
2897112993224,5cyclictest1186442-21cups-browsed22:09:470
2897114993125,2cyclictest0-21swapper/222:21:092
2897114993125,2cyclictest0-21swapper/222:21:092
2897114993122,6cyclictest420-21avahi-daemon20:55:572
2897114993122,6cyclictest3037545-21basename00:00:552
2897114993122,6cyclictest2901724-21latency_hist19:25:022
2897113993124,5cyclictest0-21swapper/121:05:021
2897113993123,5cyclictest1002-21mta-sts-daemon21:56:051
2897113993123,5cyclictest1002-21mta-sts-daemon21:56:051
2897113993122,6cyclictest1186442-21cups-browsed22:29:141
2897113993122,6cyclictest1186442-21cups-browsed22:29:141
2897112993125,3cyclictest0-21swapper/020:30:020
2897112993123,5cyclictest2982608-21/usr/sbin/munin22:31:150
2897112993122,6cyclictest0-21swapper/000:26:190
2897112993122,6cyclictest0-21swapper/000:26:190
2897112993121,6cyclictest420-21avahi-daemon22:25:450
2897112993121,6cyclictest420-21avahi-daemon22:25:450
2897114993024,3cyclictest0-21swapper/221:40:012
2897114993023,3cyclictest0-21swapper/220:40:012
2897114993022,5cyclictest1001-21mta-sts-daemon22:07:442
2897114993022,3cyclictest0-21swapper/200:10:022
289711399304,16cyclictest428-21mta-sts-daemon19:56:101
2897113993024,3cyclictest0-21swapper/122:35:011
2897113993023,3cyclictest0-21swapper/123:01:121
2897113993022,5cyclictest3038791-21unixbench_multi00:01:181
2897112993023,3cyclictest0-21swapper/023:26:060
2897112993023,3cyclictest0-21swapper/000:31:150
2897112993023,3cyclictest0-21swapper/000:31:150
2897112993022,3cyclictest0-21swapper/022:50:580
2897112993019,8cyclictest2897910-21needreboot19:11:020
2897112993019,8cyclictest1-21systemd21:56:170
2897112993019,8cyclictest1-21systemd21:56:170
2897114992923,3cyclictest0-21swapper/221:10:022
2897114992923,3cyclictest0-21swapper/200:16:042
2897114992922,4cyclictest0-21swapper/221:30:062
2897114992921,5cyclictest1186442-21cups-browsed22:45:452
2897113992923,3cyclictest0-21swapper/120:15:011
2897113992922,4cyclictest2988227-21latency_hist22:40:021
2897113992922,3cyclictest0-21swapper/123:36:001
2897113992922,3cyclictest0-21swapper/121:35:021
289711399292,22cyclictest3019918-21ssh23:31:061
2897113992921,4cyclictest0-21swapper/122:05:251
2897113992920,6cyclictest2988874-21aten_r2power_vo22:40:571
2897113992919,6cyclictest420-21avahi-daemon23:21:101
289711299294,10cyclictest3019966-21ssh23:31:080
2897112992923,3cyclictest2941122-21sed21:21:180
2897112992922,4cyclictest2915046-21unixbench_multi20:06:170
2897112992920,7cyclictest2991530-21sshd22:45:170
2897112992914,11cyclictest12650irq/32-eth023:16:040
289711299291,21cyclictest665-21snmpd22:12:200
2897114992822,3cyclictest1000-21mta-sts-daemon22:02:482
2897114992821,4cyclictest2927089-21unixbench_singl20:46:182
2897114992821,4cyclictest2908177-21fschecks_count19:45:592
2897114992821,4cyclictest2908177-21fschecks_count19:45:592
2897114992821,4cyclictest1003-21mta-sts-daemon21:28:082
2897114992821,3cyclictest0-21swapper/220:41:172
2897114992820,5cyclictest1002-21mta-sts-daemon20:06:112
2897114992820,5cyclictest0-21swapper/222:55:022
2897114992820,5cyclictest0-21swapper/220:25:012
2897113992820,5cyclictest2920810-21switchtime20:26:161
2897113992820,5cyclictest2900139-21systemd-run19:20:011
2897113992819,6cyclictest1186442-21cups-browsed19:12:351
2897112992822,4cyclictest12650irq/32-eth019:26:460
2897112992821,4cyclictest3004542-21needreboot23:06:030
2897112992821,3cyclictest0-21swapper/021:10:090
2897114992719,5cyclictest2931552-21unixbench_multi21:01:182
2897113992720,3cyclictest0-21swapper/122:11:151
2897113992719,5cyclictest2924193-21latency_hist20:40:021
2897113992716,8cyclictest2959497-21unixbench_singl21:51:171
289711299276,18cyclictest0-21swapper/020:46:070
289711299272,4cyclictest171rcu_preempt21:01:100
289711299271,9cyclictest487-21rs:main0
2897112992719,5cyclictest1000-21mta-sts-daemon20:56:030
2897114992619,4cyclictest1002-21mta-sts-daemon22:13:532
2897114992616,4cyclictest1003-21mta-sts-daemon20:01:062
2897113992619,4cyclictest2922642-21idleruntime-cro20:35:011
2897113992619,4cyclictest1002-21mta-sts-daemon20:41:081
2897113992618,5cyclictest265-21systemd-journal19:30:011
2897114992520,2cyclictest0-21swapper/219:20:012
2897113992517,5cyclictest2927662-21fschecks_count20:51:001
2897113992517,5cyclictest2913646-21cron20:05:001
2897112992519,4cyclictest1186442-21cups-browsed20:18:060
2897112992519,3cyclictest0-21swapper/020:00:000
2897112992517,5cyclictest2907633-21kworker/u8:1-xprtiod19:51:170
2897112992516,6cyclictest0-21swapper/020:25:020
2897114992419,2cyclictest0-21swapper/219:45:012
2897114992418,3cyclictest0-21swapper/219:15:012
2897113992416,5cyclictest1186442-21cups-browsed19:42:521
2897113992415,6cyclictest2910522-21sed19:51:171
2897114992314,6cyclictest2921086-21grep20:26:182
2897113992316,4cyclictest0-21swapper/121:05:171
2897113992315,5cyclictest2901491-21unixbench_multi19:21:181
289711299236,13cyclictest151ktimers/020:51:070
2897112992310,11cyclictest265-21systemd-journal19:10:020
2897112992213,6cyclictest2909065-21/usr/sbin/munin19:46:240
2897112992213,6cyclictest2909065-21/usr/sbin/munin19:46:240
289711599215,11cyclictest0-21swapper/300:31:073
289711599215,11cyclictest0-21swapper/300:31:073
289711599213,10cyclictest0-21swapper/300:06:063
289711599212,10cyclictest0-21swapper/300:01:053
289711599203,9cyclictest0-21swapper/300:36:053
289711599203,8cyclictest0-21swapper/321:41:033
289711599201,10cyclictest0-21swapper/321:21:043
2897114992011,3cyclictest171rcu_preempt19:10:022
2897113992014,3cyclictest0-21swapper/119:10:021
289711599193,9cyclictest0-21swapper/321:36:053
289711599193,6cyclictest0-21swapper/320:46:043
289711599192,9cyclictest0-21swapper/323:36:073
289711599192,10cyclictest0-21swapper/322:36:053
289711599184,8cyclictest0-21swapper/300:11:143
289711599183,9cyclictest0-21swapper/323:05:593
289711599183,9cyclictest0-21swapper/323:01:063
289711599183,9cyclictest0-21swapper/321:16:133
289711599182,9cyclictest0-21swapper/322:56:043
289711599182,9cyclictest0-21swapper/322:01:073
289711599182,9cyclictest0-21swapper/321:31:073
289711599182,9cyclictest0-21swapper/319:36:063
289711599182,10cyclictest0-21swapper/321:11:083
289711599181,10cyclictest0-21swapper/323:41:073
289711599173,8cyclictest0-21swapper/300:21:103
289711599173,10cyclictest0-21swapper/300:26:043
289711599173,10cyclictest0-21swapper/300:26:043
289711599172,9cyclictest0-21swapper/323:11:153
289711599172,9cyclictest0-21swapper/322:21:063
289711599172,9cyclictest0-21swapper/322:21:063
289711599172,8cyclictest0-21swapper/322:05:563
289711599172,8cyclictest0-21swapper/320:06:103
289711599172,8cyclictest0-21swapper/319:26:113
289711599172,11cyclictest0-21swapper/322:46:053
289711599171,9cyclictest0-21swapper/321:26:013
289711599171,10cyclictest0-21swapper/323:21:073
289711599171,10cyclictest0-21swapper/322:31:013
289711599164,7cyclictest0-21swapper/322:26:043
289711599164,7cyclictest0-21swapper/322:26:043
289711599163,9cyclictest0-21swapper/321:56:023
289711599163,9cyclictest0-21swapper/321:56:023
289711599163,8cyclictest0-21swapper/321:46:003
289711599163,8cyclictest0-21swapper/300:16:063
289711599162,9cyclictest0-21swapper/323:56:043
289711599162,9cyclictest0-21swapper/323:46:153
289711599162,10cyclictest0-21swapper/323:31:063
289711599161,9cyclictest0-21swapper/322:16:023
289711599161,8cyclictest0-21swapper/321:50:553
289711599161,7cyclictest0-21swapper/320:56:063
289711599161,7cyclictest0-21swapper/320:16:103
289711599161,10cyclictest0-21swapper/323:50:593
289711599152,8cyclictest0-21swapper/323:16:053
289711599152,7cyclictest0-21swapper/320:11:123
289711599152,6cyclictest0-21swapper/319:51:083
289711599152,6cyclictest0-21swapper/319:31:063
289711599151,9cyclictest0-21swapper/322:40:563
289711599151,9cyclictest0-21swapper/322:11:163
289711599143,7cyclictest0-21swapper/323:26:083
289711599142,7cyclictest0-21swapper/321:10:013
289711599142,7cyclictest0-21swapper/321:01:083
289711599142,7cyclictest0-21swapper/320:31:093
289711599142,7cyclictest0-21swapper/320:21:123
289711599142,7cyclictest0-21swapper/320:01:053
289711599142,6cyclictest0-21swapper/319:46:043
289711599142,6cyclictest0-21swapper/319:46:043
289711599142,6cyclictest0-21swapper/319:11:033
289711599142,10cyclictest0-21swapper/322:51:063
289711599141,6cyclictest0-21swapper/319:16:073
289711599140,7cyclictest0-21swapper/319:21:093
289711599132,6cyclictest0-21swapper/320:36:043
289711599131,8cyclictest0-21swapper/320:26:083
289711599131,7cyclictest0-21swapper/320:51:053
289711599131,7cyclictest0-21swapper/319:41:103
289711599121,6cyclictest0-21swapper/320:41:083
289711599121,6cyclictest0-21swapper/319:56:053
289711599111,5cyclictest0-21swapper/319:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional