You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 03:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack2slot7s.osadl.org (updated Sun Apr 19, 2026 00:43:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2912769997761,5cyclictest439-21systemd-logind22:50:010
291276999573,49cyclictest1128531-21cups-browsed23:40:490
2912770995544,7cyclictest3091888-21systemctl00:20:011
2912769995448,4cyclictest2947251-21cron21:05:010
2912770995241,7cyclictest3078577-21/usr/sbin/munin00:00:531
2912770995241,7cyclictest3078577-21/usr/sbin/munin00:00:531
2912769995243,5cyclictest151ktimers/019:15:370
2912769995145,4cyclictest2945764-21sendmail21:00:010
2912771995040,8cyclictest3022269-21latency22:45:342
2912770995042,5cyclictest3013610-21cut22:35:011
2912770995042,5cyclictest3013610-21cut22:35:011
2912770995040,7cyclictest3017440-21/usr/sbin/munin22:40:011
2912771994939,6cyclictest421-21dbus-daemon00:40:012
2912771994939,6cyclictest421-21dbus-daemon00:40:012
2912770994941,5cyclictest3088075-21latency_hist00:15:001
2912769994840,5cyclictest151ktimers/020:05:400
2912771994537,5cyclictest2971093-21systemd-run21:40:012
2912771994537,5cyclictest1056-21mta-sts-daemon21:53:212
2912771994536,5cyclictest1-21systemd00:30:012
2912769994539,4cyclictest0-21swapper/022:25:010
2912769994530,12cyclictest3011476-21tail22:30:490
2912769994530,12cyclictest3011476-21tail22:30:490
2912771994435,6cyclictest421-21dbus-daemon22:25:022
2912771994432,7cyclictest3076692-21cups-browsed00:00:532
2912771994432,7cyclictest3076692-21cups-browsed00:00:532
2912769994336,4cyclictest1-21systemd23:05:020
2912769994331,9cyclictest2969038-21head21:35:500
291277199424,29cyclictest3051825-21ssh23:25:412
2912770994235,3cyclictest0-21swapper/123:10:391
2912770994234,5cyclictest3082303-21head00:05:501
2912770994233,4cyclictest0-21swapper/122:50:431
2912769994236,4cyclictest3088834-21fschecks_time00:15:310
2912769994233,4cyclictest0-21swapper/021:25:010
2912769994231,5cyclictest0-21swapper/022:55:430
291277199413,29cyclictest3030106-21ssh22:55:382
2912771994132,6cyclictest1128527-21cupsd23:40:272
2912771994132,5cyclictest421-21dbus-daemon22:35:022
2912771994132,5cyclictest421-21dbus-daemon22:35:022
2912770994132,6cyclictest421-21dbus-daemon22:30:011
2912769994125,12cyclictest0-21swapper/000:25:410
2912771994033,3cyclictest0-21swapper/222:50:322
2912770994032,5cyclictest3021314-21cron22:45:001
2912770994032,5cyclictest2933786-21systemd-run20:20:011
2912770994032,5cyclictest2930771-21systemd-run20:10:011
2912770994030,6cyclictest2948743-21cron21:10:011
2912770994028,6cyclictest0-21swapper/122:00:421
2912769994034,4cyclictest3095925-21latency_hist00:25:030
2912769994034,3cyclictest0-21swapper/021:10:030
291276999403,24cyclictest3048166-21ssh23:20:400
2912771993933,3cyclictest0-21swapper/221:25:022
291277199393,28cyclictest3081788-21ssh00:05:422
2912771993932,4cyclictest3017437-21sendmail22:40:002
2912771993929,6cyclictest2976194-21sendmail-mta21:45:402
2912770993933,3cyclictest0-21swapper/119:30:011
2912770993933,3cyclictest0-21swapper/119:30:011
2912770993931,5cyclictest421-21dbus-daemon00:40:021
2912770993931,5cyclictest421-21dbus-daemon00:40:021
2912770993931,5cyclictest2920773-21fschecks_count19:35:311
2912770993931,4cyclictest0-21swapper/121:50:381
2912770993931,3cyclictest0-21swapper/120:15:011
2912770993930,6cyclictest2926262-21systemd-run19:55:011
2912770993930,5cyclictest3066940-21switchtime23:45:491
2912769993933,3cyclictest0-21swapper/000:00:010
2912769993932,4cyclictest2935288-21kworker/u8:10+xprtiod20:40:000
2912771993832,3cyclictest0-21swapper/223:05:012
2912771993830,5cyclictest0-21swapper/221:20:012
2912771993828,8cyclictest2940602-21ntp_kernel_err20:40:362
2912771993828,8cyclictest2940602-21ntp_kernel_err20:40:362
2912770993831,3cyclictest0-21swapper/100:35:011
2912770993830,5cyclictest0-21swapper/123:40:011
2912770993828,6cyclictest0-21swapper/122:20:391
291277099381,33cyclictest2953626-21ssh21:15:361
2912769993831,4cyclictest3103329-21latency_hist00:35:020
2912769993828,7cyclictest1128531-21cups-browsed21:15:270
2912771993731,3cyclictest0-21swapper/221:10:522
2912771993730,4cyclictest0-21swapper/223:20:002
2912771993726,7cyclictest420-21avahi-daemon21:27:472
291277199372,30cyclictest2999311-21ssh22:15:402
2912770993731,3cyclictest0-21swapper/123:15:301
2912770993729,5cyclictest1128531-21cups-browsed22:45:351
2912770993728,6cyclictest2994330-21latency_hist22:10:021
2912770993728,5cyclictest0-21swapper/123:20:431
2912769993726,8cyclictest2972725-21timerandwakeup21:40:500
291276999372,27cyclictest3044542-21sh23:15:380
291276999372,27cyclictest3026462-21ssh22:50:430
2912769993720,11cyclictest12350irq/32-eth023:45:410
2912771993629,3cyclictest0-21swapper/200:00:012
2912771993627,6cyclictest421-21dbus-daemon19:15:012
2912771993627,6cyclictest2932172-21head20:10:492
2912771993625,8cyclictest2927084-21ntp_kernel_err19:55:362
291277199362,26cyclictest2972231-21ssh21:40:382
2912770993631,2cyclictest0-21swapper/119:15:011
2912770993626,8cyclictest3032694-21munin-plugin-st23:00:011
2912770993626,7cyclictest1051-21mta-sts-daemon21:43:001
2912770993625,8cyclictest2927759-21sendmail20:00:011
291277099361,27cyclictest2964705-21ssh21:30:391
2912769993629,4cyclictest2921770-21sendmail19:40:010
291276999361,28cyclictest2976126-21ssh21:45:380
291276999361,18cyclictest659-21snmpd19:55:370
2912771993528,4cyclictest1054-21mta-sts-daemon21:55:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional