You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 16:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Aug 18, 2026 12:42:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2677289995742,9cyclictest0-21swapper/211:30:592
2677289995742,9cyclictest0-21swapper/211:30:592
2677288995727,5cyclictest0-21swapper/110:50:581
2677288995630,22cyclictest1883844-21cups-browsed10:34:581
2677289995443,7cyclictest0-21swapper/209:00:002
2677289995345,5cyclictest2768400-21latency_hist10:40:032
2677289995038,7cyclictest420-21avahi-daemon11:21:592
2677289995038,7cyclictest420-21avahi-daemon11:21:592
2677289994837,7cyclictest421-21dbus-daemon12:35:022
2677289994837,7cyclictest421-21dbus-daemon12:35:022
2677289994837,6cyclictest0-21swapper/210:45:552
2677289994735,6cyclictest0-21swapper/210:15:552
267728799472,33cyclictest2763271-21ssh10:30:580
267728999462,34cyclictest2796665-21ssh11:26:002
267728799465,31cyclictest2723750-21ssh09:26:030
2677287994638,5cyclictest265-21systemd-journal10:55:590
2677289994536,6cyclictest2677293-21systemd-run07:10:012
2677289994533,8cyclictest2760852-21unixbench_multi10:26:112
2677287994526,15cyclictest0-21swapper/010:45:590
2677289994436,5cyclictest2683299-21systemd-run07:30:012
2677289994436,5cyclictest2683299-21systemd-run07:30:012
2677288994436,5cyclictest2716357-21ssh09:15:021
2677288994436,5cyclictest2716357-21ssh09:15:021
267728899442,31cyclictest2748228-21ssh10:06:061
267728899442,31cyclictest2748228-21ssh10:06:061
2677289994334,6cyclictest2684147-21sed07:30:592
2677289994334,6cyclictest2684147-21sed07:30:592
2677289994333,7cyclictest2725540-21/usr/sbin/munin09:30:022
2677289994332,7cyclictest1883844-21cups-browsed10:57:352
2677288994335,5cyclictest2787783-21ps11:11:051
2677288994234,5cyclictest2687803-21systemd-run07:45:011
2677288994229,9cyclictest265-21systemd-journal12:11:591
2677287994234,5cyclictest2729994-21processes09:36:060
267728999418,24cyclictest2790619-21ssh11:16:012
267728999418,24cyclictest2790619-21ssh11:16:012
2677289994134,4cyclictest0-21swapper/207:25:002
2677289994133,5cyclictest2698320-21latency_hist08:20:022
2677289994133,5cyclictest2680274-21munin-run07:20:012
2677288994132,6cyclictest2837624-21unin-run12:35:021
2677288994132,6cyclictest2837624-21unin-run12:35:021
2677288994132,5cyclictest2751707-21unixbench_multi10:11:111
2677288994132,5cyclictest2751707-21unixbench_multi10:11:111
2677287994131,5cyclictest0-21swapper/010:50:580
2677289994034,3cyclictest0-21swapper/209:40:582
2677289994020,5cyclictest171rcu_preempt12:01:012
2677288994032,5cyclictest1-21systemd10:40:011
2677287994025,12cyclictest0-21swapper/010:10:520
2677287994025,12cyclictest0-21swapper/010:10:520
2677289993929,6cyclictest2748267-21proc_pri10:06:062
2677289993929,6cyclictest2748267-21proc_pri10:06:062
2677288993930,6cyclictest2772592-21/usr/sbin/munin10:46:081
2677287993931,4cyclictest2830380-21grep12:21:110
2677287993931,4cyclictest2830380-21grep12:21:110
2677287993930,6cyclictest0-21swapper/012:30:560
2677287993930,6cyclictest0-21swapper/012:30:560
267728799391,33cyclictest1883844-21cups-browsed08:45:590
2677289993830,5cyclictest2816529-21cron12:00:012
2677288993830,5cyclictest2737779-21kworker/u8:0-rpciod10:01:061
2677288993826,9cyclictest2815069-21switchtime11:56:091
2677288993825,6cyclictest0-21swapper/112:26:051
2677287993829,5cyclictest2677299-21systemd-run07:10:010
2677287993827,6cyclictest2713734-21/usr/sbin/munin09:11:080
2677287993827,6cyclictest2713734-21/usr/sbin/munin09:11:080
2677287993826,6cyclictest12650irq/32-eth011:16:080
2677287993826,6cyclictest12650irq/32-eth011:16:080
2677287993824,9cyclictest151ktimers/011:56:030
2677287993824,10cyclictest0-21swapper/010:21:590
2677289993730,4cyclictest2812302-21grep11:51:102
267728999372,31cyclictest2787601-21ssh11:10:582
267728899375,5cyclictest171rcu_preempt10:56:081
2677288993729,5cyclictest2819590-21systemd-run12:05:021
2677288993729,5cyclictest2731718-21systemd09:40:021
2677288993729,4cyclictest2741004-21latency_hist09:55:031
267728899372,29cyclictest2720600-21ssh09:20:581
2677287993732,3cyclictest0-21swapper/011:51:010
2677287993731,4cyclictest2828576-21systemctl12:20:010
2677287993727,6cyclictest2771330-21latency_hist10:45:020
2677289993628,4cyclictest0-21swapper/209:10:592
2677289993628,4cyclictest0-21swapper/209:10:592
2677289993625,7cyclictest420-21avahi-daemon12:28:122
267728899363,24cyclictest2799607-21sh11:30:571
267728899363,24cyclictest2799607-21sh11:30:571
2677288993628,5cyclictest2793824-21proc_pri11:21:071
2677288993628,5cyclictest2793824-21proc_pri11:21:071
2677288993628,5cyclictest2698810-21fschecks_time08:20:531
267728899361,26cyclictest2796605-21ssh11:25:571
2677287993629,4cyclictest151ktimers/009:55:580
2677287993628,5cyclictest2738239-21aten_r2power_cu09:50:450
2677287993621,9cyclictest2787026-21aten_r2power_po11:10:480
2677287993612,17cyclictest151ktimers/012:10:570
2677289993529,3cyclictest0-21swapper/212:35:552
2677289993529,3cyclictest0-21swapper/212:35:552
2677289993528,3cyclictest0-21swapper/212:20:012
2677289993526,4cyclictest0-21swapper/209:36:022
2677289993525,7cyclictest2728601-21latency_hist09:35:022
267728899353,27cyclictest2802671-21sshd11:35:591
2677288993529,2cyclictest0-21swapper/109:20:011
2677288993528,5cyclictest0-21swapper/108:00:011
2677288993528,4cyclictest2759647-21aten_r2power_en10:25:481
2677288993527,5cyclictest1000-21mta-sts-daemon11:15:421
2677288993527,5cyclictest1000-21mta-sts-daemon11:15:421
2677288993526,6cyclictest421-21dbus-daemon08:10:011
2677288993526,6cyclictest2713197-21grep09:06:101
2677288993525,6cyclictest1883844-21cups-browsed12:20:301
2677288993525,6cyclictest1883844-21cups-browsed12:20:301
2677288993524,8cyclictest2680309-21sh07:20:011
2677287993527,4cyclictest1003-21mta-sts-daemon11:01:070
2677287993526,7cyclictest2727617-21sshd09:31:590
2677287993522,7cyclictest12650irq/32-eth012:01:000
2677287993516,12cyclictest12650irq/32-eth009:00:590
267728999346,18cyclictest428-21mta-sts-daemon11:36:012
2677289993426,5cyclictest2713194-21unixbench_singl09:06:102
2677289993426,4cyclictest0-21swapper/212:20:582
2677289993426,4cyclictest0-21swapper/212:20:582
2677289993425,3cyclictest0-21swapper/210:21:012
2677289993424,7cyclictest1002-21mta-sts-daemon10:34:582
2677289993417,13cyclictest1000-21mta-sts-daemon09:51:022
267728999340,8cyclictest2713271-21diskmemload09:16:002
2677288993429,2cyclictest0-21swapper/107:15:011
2677288993426,5cyclictest2807533-21systemd-run11:45:011
2677288993425,5cyclictest2724232-21unixbench_multi09:26:111
2677288993423,5cyclictest0-21swapper/111:01:001
2677287993427,5cyclictest0-21swapper/009:25:010
2677287993419,5cyclictest2801149-21sshd11:33:590
2677287993419,5cyclictest2801149-21sshd11:33:590
267728999335,22cyclictest2769503-21ssh10:41:062
267728999335,17cyclictest428-21mta-sts-daemon09:21:022
2677289993324,6cyclictest420-21avahi-daemon07:36:062
2677289993324,6cyclictest420-21avahi-daemon07:36:062
267728999332,26cyclictest2691628-21sshd07:55:592
267728999332,24cyclictest2820865-21ssh12:06:052
267728899336,17cyclictest428-21mta-sts-daemon07:51:031
2677288993323,6cyclictest421-21dbus-daemon12:17:121
2677288993313,5cyclictest171rcu_preempt09:45:571
2677287993326,4cyclictest2754669-21grep10:16:080
2677289993225,3cyclictest0-21swapper/210:01:012
2677289993224,4cyclictest0-21swapper/211:05:572
2677289993223,5cyclictest2708795-21latency_hist08:55:012
2677289993220,3cyclictest2689359-21cat07:50:022
2677288993224,5cyclictest2756027-21ssh10:20:011
2677288993223,5cyclictest2734066-21sshd09:42:591
2677288993223,5cyclictest2706106-21aten_r2power_fr08:45:491
2677288993222,7cyclictest2784446-21missed_timers11:05:541
2677288993214,14cyclictest271ktimers/112:35:591
2677288993214,14cyclictest271ktimers/112:35:591
2677287993226,3cyclictest2737778-21true09:50:010
2677287993224,5cyclictest2719390-21cron09:20:000
2677287993223,6cyclictest0-21swapper/011:40:010
2677287993210,15cyclictest12650irq/32-eth011:46:020
2677289993123,3cyclictest0-21swapper/212:10:582
2677289993122,6cyclictest420-21avahi-daemon11:40:532
2677289993121,7cyclictest2741267-21sh09:55:482
2677289993121,6cyclictest2775048-21fschecks_time10:50:512
2677289993118,3cyclictest171rcu_preempt08:26:012
2677288993125,3cyclictest0-21swapper/110:45:021
2677288993124,4cyclictest2702387-21mailstats08:31:061
2677288993123,5cyclictest2757420-21processes10:21:061
2677288993122,6cyclictest2811720-21sh11:50:591
267728799313,6cyclictest171rcu_preempt09:41:040
2677287993127,2cyclictest0-21swapper/010:30:020
2677287993126,3cyclictest1000-21mta-sts-daemon10:36:330
2677287993125,4cyclictest2701164-21unixbench_multi08:26:110
2677287993125,3cyclictest12750irq/33-eth007:20:570
2677287993124,4cyclictest2746916-21munin-plugin-st10:05:010
2677287993124,3cyclictest0-21swapper/011:45:010
267728799311,26cyclictest2665611-21kworker/u8:1+rpciod07:56:050
2677289993022,5cyclictest2736072-21proc_pri09:46:052
2677289993020,3cyclictest2783391-21diskmemload11:05:012
2677288993024,3cyclictest0-21swapper/109:00:011
2677288993024,3cyclictest0-21swapper/108:20:011
2677288993023,4cyclictest0-21swapper/107:35:001
2677288993023,4cyclictest0-21swapper/107:35:001
2677288993023,3cyclictest0-21swapper/111:46:101
2677288993021,6cyclictest420-21avahi-daemon09:56:501
267728899301,23cyclictest2726715-21ssh09:30:581
267728799308,15cyclictest1000-21mta-sts-daemon12:06:040
267728799302,24cyclictest2793618-21ssh11:21:000
267728799302,24cyclictest2793618-21ssh11:21:000
267728999293,19cyclictest2808667-21rm11:45:572
2677289992917,5cyclictest2689830-21awk07:50:542
2677288992922,4cyclictest2696214-21ntp_offset08:11:001
2677288992921,5cyclictest2689286-21systemd-run07:50:021
2677288992921,5cyclictest2686145-21tail07:36:091
2677288992921,5cyclictest2686145-21tail07:36:091
2677288992920,5cyclictest2821305-21unixbench_multi12:06:111
267728799296,15cyclictest1983337-21munin-node11:05:560
2677287992923,4cyclictest2838390-21gltestperf12:35:510
2677287992923,4cyclictest2838390-21gltestperf12:35:510
2677287992922,3cyclictest0-21swapper/011:30:010
267728799292,21cyclictest12650irq/32-eth007:45:590
2677287992920,6cyclictest627-21lldpd10:06:110
2677287992920,6cyclictest627-21lldpd10:06:110
2677287992917,9cyclictest0-21swapper/008:40:020
2677289992822,3cyclictest0-21swapper/210:10:482
2677289992822,3cyclictest0-21swapper/210:10:482
267728999282,21cyclictest2678184-21sshd07:10:592
2677289992819,6cyclictest1-21systemd08:15:022
2677289992818,6cyclictest351ktimers/208:31:012
2677289992818,4cyclictest2706935-21sed08:46:082
2677289992812,12cyclictest341rcuc/208:40:582
2677288992820,5cyclictest2705163-21sshd08:40:591
2677288992819,6cyclictest2693772-21cron08:05:011
2677288992819,5cyclictest1-21systemd09:05:011
2677287992821,5cyclictest2707801-21gltestperf08:50:540
2677287992821,5cyclictest0-21swapper/008:20:010
2677287992821,4cyclictest2699772-21cron08:25:010
2677287992820,4cyclictest2674575-21kworker/u8:14-xprtiod07:32:590
2677287992820,4cyclictest2674575-21kworker/u8:14-xprtiod07:32:590
2677287992817,8cyclictest0-21swapper/008:40:510
2677287992814,9cyclictest12650irq/32-eth012:26:000
2677289992717,7cyclictest420-21avahi-daemon09:05:012
2677289992717,3cyclictest171rcu_preempt08:00:572
267728899274,16cyclictest428-21mta-sts-daemon08:26:031
2677288992719,5cyclictest421-21dbus-daemon07:25:011
2677288992718,6cyclictest1883844-21cups-browsed08:52:011
2677287992721,3cyclictest0-21swapper/009:10:020
2677287992720,4cyclictest2702783-21systemd-run08:35:010
2677287992719,5cyclictest2693086-21needreboot08:00:550
2677287992719,5cyclictest1001-21mta-sts-daemon07:40:540
2677287992618,5cyclictest567-21gdbus07:26:220
2677287992618,5cyclictest567-21gdbus07:26:220
267728999257,3cyclictest171rcu_preempt07:41:022
2677289992516,4cyclictest351ktimers/208:35:572
2677287992519,4cyclictest1883844-21cups-browsed08:10:440
2677287992515,7cyclictest1883844-21cups-browsed07:10:570
2677287992514,9cyclictest151ktimers/008:56:040
2677287992511,11cyclictest151ktimers/007:35:590
2677287992511,11cyclictest151ktimers/007:35:590
2677289992418,4cyclictest2677286-21cyclictest08:20:512
2677288992416,4cyclictest2703466-21latency08:35:511
2677287992415,6cyclictest2680279-21idleruntime-cro07:20:010
2677289992311,6cyclictest171rcu_preempt08:06:002
2677287992316,5cyclictest1883844-21cups-browsed08:05:250
2677288992217,2cyclictest0-21swapper/107:26:091
2677288992217,2cyclictest0-21swapper/107:26:091
267728799211,17cyclictest2690211-21ntpq07:51:030
267729099204,6cyclictest0-21swapper/310:26:043
267729099202,10cyclictest0-21swapper/312:35:583
267729099202,10cyclictest0-21swapper/312:35:583
267729099193,6cyclictest0-21swapper/309:55:583
267728899197,9cyclictest421-21dbus-daemon07:10:011
267729099182,8cyclictest0-21swapper/307:51:023
267729099182,10cyclictest0-21swapper/311:11:003
267729099172,8cyclictest0-21swapper/311:25:593
267729099171,7cyclictest0-21swapper/308:00:593
267729099163,7cyclictest0-21swapper/312:25:593
267729099163,7cyclictest0-21swapper/311:40:593
267729099163,7cyclictest0-21swapper/309:20:583
267729099162,8cyclictest0-21swapper/311:50:593
267729099162,8cyclictest0-21swapper/311:21:023
267729099162,8cyclictest0-21swapper/311:21:023
267729099162,8cyclictest0-21swapper/309:41:003
267729099162,8cyclictest0-21swapper/309:36:033
267729099162,7cyclictest0-21swapper/310:10:573
267729099162,7cyclictest0-21swapper/310:10:573
267729099162,7cyclictest0-21swapper/308:21:053
267729099161,8cyclictest0-21swapper/310:21:033
267729099161,8cyclictest0-21swapper/310:01:033
267729099161,7cyclictest0-21swapper/308:06:033
267729099153,7cyclictest0-21swapper/311:45:523
267729099152,9cyclictest0-21swapper/310:50:583
267729099152,8cyclictest0-21swapper/312:16:093
267729099152,7cyclictest0-21swapper/312:06:013
267729099152,7cyclictest0-21swapper/310:15:563
267729099152,6cyclictest0-21swapper/312:01:023
267729099151,8cyclictest0-21swapper/311:06:003
267729099151,8cyclictest0-21swapper/309:46:013
267729099151,6cyclictest0-21swapper/308:36:003
267729099151,6cyclictest0-21swapper/307:56:003
267729099145,6cyclictest0-21swapper/309:50:553
267729099144,5cyclictest0-21swapper/311:35:593
267729099143,6cyclictest0-21swapper/312:31:103
267729099143,6cyclictest0-21swapper/312:31:103
267729099143,6cyclictest0-21swapper/312:20:593
267729099143,6cyclictest0-21swapper/312:20:593
267729099142,7cyclictest0-21swapper/307:26:013
267729099142,7cyclictest0-21swapper/307:26:013
267729099142,6cyclictest0-21swapper/311:16:003
267729099142,6cyclictest0-21swapper/311:16:003
267729099142,6cyclictest0-21swapper/309:06:003
267729099142,5cyclictest0-21swapper/307:40:573
267729099142,3cyclictest0-21swapper/312:10:573
267729099141,8cyclictest0-21swapper/310:56:033
267729099141,8cyclictest0-21swapper/309:25:593
267729099141,7cyclictest0-21swapper/311:31:003
267729099141,7cyclictest0-21swapper/311:31:003
267729099141,7cyclictest0-21swapper/311:00:583
267729099141,6cyclictest0-21swapper/308:31:003
267729099141,6cyclictest0-21swapper/307:45:583
267729099141,6cyclictest0-21swapper/307:11:013
267729099141,5cyclictest0-21swapper/308:10:553
267729099134,6cyclictest0-21swapper/308:40:593
267729099133,6cyclictest0-21swapper/310:35:533
267729099133,6cyclictest0-21swapper/310:06:003
267729099133,6cyclictest0-21swapper/310:06:003
267729099133,6cyclictest0-21swapper/309:10:583
267729099133,6cyclictest0-21swapper/309:10:583
267729099132,7cyclictest0-21swapper/307:20:013
267729099132,6cyclictest0-21swapper/310:40:073
267729099132,6cyclictest0-21swapper/308:55:583
267729099132,6cyclictest0-21swapper/307:36:003
267729099132,6cyclictest0-21swapper/307:36:003
267729099132,6cyclictest0-21swapper/307:20:503
267729099131,8cyclictest0-21swapper/309:30:583
267729099131,8cyclictest0-21swapper/309:00:503
267729099131,7cyclictest0-21swapper/310:45:593
267729099131,7cyclictest0-21swapper/307:31:053
267729099131,7cyclictest0-21swapper/307:31:053
267729099131,6cyclictest0-21swapper/308:51:053
267729099131,5cyclictest0-21swapper/308:15:563
267729099123,7cyclictest0-21swapper/309:15:533
267729099122,5cyclictest0-21swapper/308:25:593
267729099121,6cyclictest0-21swapper/308:45:593
267729099112,6cyclictest0-21swapper/311:55:593
267729099111,5cyclictest0-21swapper/310:30:483
26772909981,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional