You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 07:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri Aug 14, 2026 00:43:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2659098998168,5cyclictest0-21swapper/100:16:041
2659098996739,24cyclictest2750223-21sendmail22:40:011
2659098995443,5cyclictest0-21swapper/100:36:551
2659098995443,5cyclictest0-21swapper/100:36:551
2659097995040,2cyclictest0-21swapper/021:00:010
2659097994834,11cyclictest2822557-40mandb00:36:510
2659097994834,11cyclictest2822557-40mandb00:36:510
2659098994638,5cyclictest2805285-21systemd-run00:10:011
2659098994633,10cyclictest2719694-21sh21:50:011
2659097994639,4cyclictest2713599-21systemd-run21:40:020
2659097994639,4cyclictest2713599-21systemd-run21:40:020
2659099994537,5cyclictest2680087-21idleruntime-cro20:20:012
2659098994536,6cyclictest2666605-21systemd-run19:35:021
2659099994441,2cyclictest0-21swapper/200:36:572
2659099994441,2cyclictest0-21swapper/200:36:572
2659099994435,5cyclictest2725785-21sendmail22:00:012
2659097994438,4cyclictest2665069-21kworker/u8:7+xprtiod20:01:010
2659099994334,5cyclictest2799166-21ssh00:00:012
265909899436,31cyclictest2714838-21ssh21:41:011
265909899436,31cyclictest2714838-21ssh21:41:011
2659098994335,5cyclictest2796101-21systemd-run23:55:011
2659098994335,5cyclictest2796101-21systemd-run23:55:011
2659098994335,5cyclictest2662132-21latency_hist19:20:011
2659098994332,7cyclictest0-21swapper/100:26:041
2659098994236,3cyclictest0-21swapper/119:40:011
2659099994132,6cyclictest485-21in:imuxsock21:44:592
2659099994132,6cyclictest485-21in:imuxsock21:44:592
2659099994132,5cyclictest2811417-21diskmemload00:20:022
2659099994131,6cyclictest2699889-21unixbench_multi21:16:092
2659098994133,5cyclictest1001-21mta-sts-daemon22:45:471
265909799415,33cyclictest2730002-21ssh22:05:550
2659097994133,5cyclictest12650irq/32-eth023:21:010
2659097994131,7cyclictest2790901-21latency23:45:510
2659097994131,7cyclictest2790901-21latency23:45:510
2659097994124,14cyclictest151ktimers/021:30:570
2659099994029,8cyclictest2769987-21mailstats23:11:032
2659097994034,3cyclictest1002-21mta-sts-daemon00:10:560
2659097994016,19cyclictest2696277-21ssh21:10:580
265909899392,29cyclictest2757475-21ssh22:50:551
2659097993930,6cyclictest420-21avahi-daemon22:53:490
2659097993923,13cyclictest2741084-21ssh22:25:010
265909799392,29cyclictest2686960-21sshd20:40:540
2659097993922,14cyclictest151ktimers/022:15:550
2659099993830,5cyclictest2681592-21idleruntime-cro20:25:002
2659099993830,5cyclictest2681592-21idleruntime-cro20:25:002
2659099993829,6cyclictest2727562-21unixbench_singl22:01:082
2659099993829,4cyclictest0-21swapper/223:30:572
2659099993827,8cyclictest2756795-21/usr/sbin/munin22:50:522
2659098993830,5cyclictest2735930-21latency22:15:511
2659098993829,6cyclictest2695090-21sh21:10:011
265909799383,29cyclictest2803495-21sshd00:06:030
2659097993830,5cyclictest2799158-21cups-browsed00:26:100
2659097993830,5cyclictest0-21swapper/000:00:000
2659097993829,7cyclictest2681864-21aten_r2power_cu20:25:440
2659097993829,7cyclictest2681864-21aten_r2power_cu20:25:440
265909799382,33cyclictest2733157-21sh22:10:590
2659098993731,3cyclictest0-21swapper/123:40:021
2659098993727,5cyclictest0-21swapper/121:50:581
2659097993731,4cyclictest2786904-21sh23:40:010
2659097993730,4cyclictest2747160-21cron22:35:010
2659097993729,5cyclictest2788605-21unixbench-2d23:41:070
2659097993724,4cyclictest2662173-21latency_hist19:20:020
2659099993630,3cyclictest0-21swapper/222:35:012
2659099993629,4cyclictest2735130-21latency_hist22:15:022
2659099993628,5cyclictest2719835-21latency_hist21:50:022
2659099993628,5cyclictest2663598-21idleruntime-cro19:25:002
2659099993628,5cyclictest2663598-21idleruntime-cro19:25:002
2659099993625,8cyclictest2806756-21switchtime00:11:052
2659098993628,5cyclictest2727522-21grep22:01:081
2659098993628,5cyclictest2704363-21systemd-run21:25:021
2659098993628,5cyclictest1-21systemd23:45:021
2659098993613,18cyclictest421-21dbus-daemon20:50:541
265909999354,27cyclictest2778991-21ssh23:26:012
2659099993529,3cyclictest0-21swapper/221:20:502
2659099993527,3cyclictest0-21swapper/222:25:582
2659099993524,7cyclictest428-21mta-sts-daemon21:35:462
2659099993524,7cyclictest428-21mta-sts-daemon21:35:462
2659099993523,8cyclictest421-21dbus-daemon23:40:022
265909999351,25cyclictest2800312-21ssh00:00:572
2659098993528,3cyclictest0-21swapper/123:31:011
2659098993528,3cyclictest0-21swapper/121:20:011
2659098993527,6cyclictest2814481-21systemd00:25:021
2659098993527,5cyclictest2768576-21ssh23:10:011
2659098993527,5cyclictest2710489-21cron21:35:011
2659098993527,5cyclictest2695090-21diskmemload00:00:011
2659097993530,2cyclictest0-21swapper/021:30:010
2659097993528,5cyclictest2716768-21latency_hist21:45:020
2659097993528,5cyclictest2716768-21latency_hist21:45:020
2659097993527,5cyclictest2751418-21ntp_kernel_pll_22:40:560
2659097993522,9cyclictest421-21dbus-daemon00:00:050
2659097993516,14cyclictest151ktimers/022:56:000
2659097993516,14cyclictest151ktimers/022:56:000
265909799351,27cyclictest12650irq/32-eth023:10:560
2659097993510,18cyclictest2726949-21ssh22:00:560
2659099993427,4cyclictest2767261-21unixbench_multi23:06:072
2659099993426,4cyclictest0-21swapper/221:30:012
2659098993426,5cyclictest2799158-21cups-browsed00:11:071
2659098993425,6cyclictest2770277-21unixbench-2d23:11:081
2659098993425,5cyclictest0-21swapper/122:20:561
2659099993326,3cyclictest0-21swapper/220:06:042
2659099993324,6cyclictest421-21dbus-daemon19:36:112
2659099993322,8cyclictest2683084-21cron20:30:002
2659099993322,8cyclictest2683084-21cron20:30:002
265909999332,25cyclictest2720983-21ssh21:51:052
265909999332,24cyclictest2730001-21sh22:05:552
265909899338,14cyclictest1000-21mta-sts-daemon21:35:551
265909899338,14cyclictest1000-21mta-sts-daemon21:35:551
2659098993326,4cyclictest0-21swapper/122:30:561
2659098993325,5cyclictest0-21swapper/100:31:011
2659098993325,4cyclictest0-21swapper/123:26:101
2659097993325,6cyclictest2741558-21acpi22:25:440
265909999328,18cyclictest2760664-21sshd22:56:002
265909999328,18cyclictest2760664-21sshd22:56:002
2659099993226,3cyclictest0-21swapper/221:30:532
2659099993225,4cyclictest665-21snmpd23:54:262
2659099993225,4cyclictest665-21snmpd23:54:262
2659099993225,3cyclictest0-21swapper/223:25:022
265909999322,23cyclictest2818623-21ssh00:30:552
265909999321,23cyclictest2696343-21ssh21:11:002
2659098993225,4cyclictest2742252-21sshd22:26:001
2659098993225,3cyclictest0-21swapper/120:20:001
265909899321,23cyclictest623-21sshd23:00:591
265909799324,21cyclictest2818633-21ssh00:30:550
2659097993227,2cyclictest0-21swapper/020:40:000
265909799322,22cyclictest2763642-21ssh23:00:550
265909999315,18cyclictest2815712-21ssh00:26:012
265909999314,19cyclictest2791169-21ssh23:45:572
265909999314,19cyclictest2791169-21ssh23:45:572
2659099993125,2cyclictest0-21swapper/220:05:022
2659099993123,5cyclictest926384-21cups-browsed19:40:572
2659099993123,3cyclictest0-21swapper/223:40:532
2659098993124,3cyclictest0-21swapper/122:10:541
2659098993123,5cyclictest2663596-21munin-plugin-st19:25:001
2659098993123,5cyclictest2663596-21munin-plugin-st19:25:001
2659098993122,6cyclictest1001-21mta-sts-daemon21:25:311
2659098993121,7cyclictest421-21dbus-daemon23:45:471
2659098993121,7cyclictest421-21dbus-daemon23:45:471
2659097993125,4cyclictest2701272-21sendmail21:20:010
2659097993125,3cyclictest0-21swapper/021:50:000
2659097993122,6cyclictest926384-21cups-browsed22:48:320
2659097993121,7cyclictest421-21dbus-daemon21:22:510
2659097993120,8cyclictest0-21swapper/019:35:010
2659097993115,13cyclictest926384-21cups-browsed20:20:010
2659099993024,3cyclictest1002-21mta-sts-daemon20:11:022
2659099993023,3cyclictest0-21swapper/222:40:592
2659099993022,5cyclictest2695088-21grep21:10:012
2659099993022,5cyclictest2692421-21aten_r2power_fr21:00:432
2659099993022,5cyclictest2672525-21sed19:51:082
2659098993023,4cyclictest2774704-21sendmail23:20:011
2659098993022,5cyclictest2675017-21ntp_offset20:00:581
2659097993025,3cyclictest0-21swapper/020:15:010
2659097993025,2cyclictest0-21swapper/022:40:010
2659097993024,3cyclictest0-21swapper/000:16:000
2659097993022,5cyclictest420-21avahi-daemon00:22:400
2659097993022,5cyclictest0-21swapper/023:10:010
265909799301,25cyclictest2794187-21ssh23:50:550
265909799301,25cyclictest2794187-21ssh23:50:550
265909799301,24cyclictest2772757-21ssh23:15:550
265909999296,14cyclictest428-21mta-sts-daemon19:30:552
2659099992923,4cyclictest2659096-21cyclictest22:35:552
2659099992921,5cyclictest2735732-21diskmemload22:15:492
2659099992921,3cyclictest0-21swapper/222:46:022
2659099992921,3cyclictest0-21swapper/222:20:512
2659098992924,2cyclictest0-21swapper/122:00:011
265909899292,20cyclictest2760624-21ssh22:55:581
265909899292,20cyclictest2760624-21ssh22:55:581
265909899292,19cyclictest2775930-21ssh23:20:591
2659098992920,6cyclictest2751634-21mailstats22:41:031
2659098992919,7cyclictest926384-21cups-browsed21:11:501
2659097992923,4cyclictest2723519-21fschecks_time21:55:520
2659097992923,4cyclictest2700561-21kworker/u8:9-rpciod23:30:020
2659097992922,4cyclictest2659108-21systemd-run19:10:010
2659097992921,5cyclictest1-21systemd19:46:070
2659097992917,9cyclictest1-21systemd20:00:010
265909999283,21cyclictest2803391-21ssh00:05:592
2659099992821,4cyclictest1002-21mta-sts-daemon23:19:362
2659099992818,7cyclictest441-21thd19:25:522
265909899289,13cyclictest421-21dbus-daemon20:40:591
265909899284,16cyclictest428-21mta-sts-daemon20:11:001
2659098992822,3cyclictest2677099-21kworker/u8:5-xprtiod20:25:011
2659098992822,3cyclictest2677099-21kworker/u8:5-xprtiod20:25:011
2659098992822,3cyclictest0-21swapper/120:40:001
2659098992814,10cyclictest421-21dbus-daemon00:01:231
265909899281,21cyclictest2730011-21ssh22:05:561
2659099992721,4cyclictest2690773-21latency_hist20:55:032
2659099992721,3cyclictest2675610-21kworker/u8:2-xprtiod23:05:002
2659099992719,5cyclictest2673879-21timerwakeupswit19:56:062
2659097992722,3cyclictest2781288-21aten_r2power_cu23:30:450
2659097992721,3cyclictest2677099-21kworker/u8:5-xprtiod20:30:520
2659097992720,3cyclictest0-21swapper/021:52:390
2659097992716,8cyclictest0-21swapper/019:15:020
2659097992714,10cyclictest0-21swapper/021:06:080
2659099992618,5cyclictest0-21swapper/200:24:042
2659099992617,7cyclictest2688403-21needreboot20:45:542
2659099992613,10cyclictest351ktimers/220:55:552
265909899265,14cyclictest1000-21mta-sts-daemon19:45:591
2659098992620,3cyclictest1002-21mta-sts-daemon19:42:141
2659098992619,4cyclictest1000-21mta-sts-daemon19:10:461
2659097992619,5cyclictest2676943-21unixbench-2d20:06:040
2659097992618,6cyclictest2680467-21telnet20:20:450
2659097992618,6cyclictest2680467-21telnet20:20:450
2659099992520,2cyclictest0-21swapper/219:20:012
2659099992519,3cyclictest2684603-21kworker/u8:9-xprtiod20:37:502
2659099992517,5cyclictest2670116-21fschecks_time19:45:522
2659098992517,5cyclictest2692071-21munin-plugin-st21:00:011
2659098992517,5cyclictest2672923-21aten_r2power_po19:55:451
2659098992515,7cyclictest265-21systemd-journal19:55:011
2659097992520,4cyclictest2659096-21cyclictest19:50:550
2659099992418,3cyclictest2675610-21kworker/u8:2+rpciod20:35:012
2659099992418,3cyclictest0-21swapper/219:10:012
2659098992417,4cyclictest1002-21mta-sts-daemon20:32:321
2659098992416,5cyclictest2688969-21unixbench_multi20:46:081
2659098992415,6cyclictest2664454-21awk19:25:541
265909799242,17cyclictest2689691-21awk20:50:490
2659097992420,2cyclictest0-21swapper/019:36:000
265909799241,17cyclictest151ktimers/019:20:550
265909799241,17cyclictest151ktimers/019:20:550
2659099992310,9cyclictest420-21avahi-daemon20:40:592
2659098992316,5cyclictest2679414-21kworker/u8:0+xprtiod20:25:531
2659098992316,5cyclictest2679414-21kworker/u8:0+xprtiod20:25:531
2659098992316,4cyclictest2692613-21fschecks_time21:00:461
2659097992318,2cyclictest0-21swapper/019:41:000
2659097992317,4cyclictest2693507-21head21:01:040
2659097992316,4cyclictest1001-21mta-sts-daemon19:26:010
2659099992217,3cyclictest0-21swapper/219:15:012
2659098992217,2cyclictest0-21swapper/120:06:041
265909799210,18cyclictest2688492-21ntpq20:45:580
2659098991913,3cyclictest0-21swapper/119:10:011
265910099163,7cyclictest0-21swapper/300:16:043
265910099161,9cyclictest0-21swapper/323:50:573
265910099161,9cyclictest0-21swapper/323:50:573
265910099161,8cyclictest0-21swapper/323:16:033
265910099161,6cyclictest0-21swapper/319:45:573
265910099153,7cyclictest0-21swapper/300:01:003
265910099153,6cyclictest0-21swapper/322:29:003
265910099153,6cyclictest0-21swapper/321:50:593
265910099152,8cyclictest0-21swapper/322:00:553
265910099152,6cyclictest0-21swapper/321:30:493
265910099152,5cyclictest0-21swapper/320:25:533
265910099152,5cyclictest0-21swapper/320:25:533
265910099152,5cyclictest0-21swapper/319:15:563
265910099151,6cyclictest0-21swapper/320:55:553
265910099151,6cyclictest0-21swapper/320:20:563
265910099151,6cyclictest0-21swapper/320:20:563
265910099151,5cyclictest0-21swapper/319:50:563
265910099142,7cyclictest0-21swapper/323:00:593
265910099142,7cyclictest0-21swapper/322:05:473
265910099142,6cyclictest0-21swapper/322:30:473
265910099142,6cyclictest0-21swapper/320:00:583
265910099141,7cyclictest0-21swapper/323:35:543
265910099141,7cyclictest0-21swapper/323:10:583
265910099141,7cyclictest0-21swapper/300:36:003
265910099141,7cyclictest0-21swapper/300:36:003
265910099141,6cyclictest0-21swapper/319:40:573
265910099141,5cyclictest0-21swapper/319:55:533
265910099133,6cyclictest0-21swapper/321:10:593
265910099133,6cyclictest0-21swapper/300:00:013
265910099132,7cyclictest0-21swapper/323:05:583
265910099132,7cyclictest0-21swapper/322:55:553
265910099132,7cyclictest0-21swapper/322:55:553
265910099132,7cyclictest0-21swapper/322:45:513
265910099132,6cyclictest0-21swapper/300:35:033
265910099132,6cyclictest0-21swapper/300:26:043
265910099132,6cyclictest0-21swapper/300:10:463
265910099132,5cyclictest0-21swapper/322:35:453
265910099132,4cyclictest0-21swapper/320:50:533
265910099131,7cyclictest0-21swapper/323:30:543
265910099131,7cyclictest0-21swapper/322:20:473
265910099131,7cyclictest0-21swapper/322:20:013
265910099131,7cyclictest0-21swapper/321:55:543
265910099131,7cyclictest0-21swapper/321:41:003
265910099131,7cyclictest0-21swapper/321:41:003
265910099131,6cyclictest0-21swapper/321:10:033
265910099131,6cyclictest0-21swapper/319:20:563
265910099131,6cyclictest0-21swapper/319:20:563
265910099123,7cyclictest0-21swapper/321:05:023
265910099122,6cyclictest0-21swapper/323:45:503
265910099122,6cyclictest0-21swapper/323:45:503
265910099122,6cyclictest0-21swapper/321:40:033
265910099122,6cyclictest0-21swapper/321:40:033
265910099122,5cyclictest0-21swapper/323:25:453
265910099122,5cyclictest0-21swapper/319:36:003
265910099121,8cyclictest0-21swapper/322:40:493
265910099121,7cyclictest0-21swapper/323:20:573
265910099121,7cyclictest0-21swapper/321:20:573
265910099121,7cyclictest0-21swapper/321:15:513
265910099121,7cyclictest0-21swapper/300:20:583
265910099121,6cyclictest0-21swapper/322:50:563
265910099121,6cyclictest0-21swapper/320:20:013
265910099121,6cyclictest0-21swapper/319:31:003
265910099121,6cyclictest0-21swapper/319:25:553
265910099121,5cyclictest0-21swapper/320:45:553
265910099121,5cyclictest0-21swapper/320:35:553
265910099113,5cyclictest0-21swapper/300:05:503
265910099112,6cyclictest0-21swapper/322:10:463
265910099112,5cyclictest0-21swapper/321:45:473
265910099112,4cyclictest0-21swapper/320:30:543
265910099111,7cyclictest0-21swapper/323:40:493
265910099104,4cyclictest0-21swapper/320:10:533
265910099102,5cyclictest0-21swapper/321:25:543
265910099101,6cyclictest0-21swapper/320:40:543
265910099101,5cyclictest0-21swapper/319:10:543
26591009993,4cyclictest0-21swapper/320:05:533
26591009981,6cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional