You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 20:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 08, 2026 12:42:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1000251997367,3cyclictest0-21swapper/109:36:051
1000250996542,20cyclictest1019738-21systemd-run08:15:000
1000250995327,6cyclictest420-21avahi-daemon11:58:370
1000250995023,3cyclictest1066947-21kworker/u8:5-rpciod10:06:010
100025099502,29cyclictest1065457-21ssh09:56:080
1000252994938,7cyclictest1003275-21systemd-run07:20:022
1000251994839,5cyclictest1036228-21grep09:10:011
1000250994837,9cyclictest1062817-21sh09:51:160
1000252994734,7cyclictest0-21swapper/207:21:072
1000251994739,5cyclictest1106298-21grep11:01:201
1000250994738,5cyclictest1036228-21grep09:10:010
1000250994730,12cyclictest207110-21cups-browsed07:41:080
1000251994638,5cyclictest1148716-21if_wlan012:11:031
1000251994539,3cyclictest0-21swapper/109:15:011
1000252994431,7cyclictest1055668-21cpuspeed09:40:552
1000251994435,6cyclictest421-21dbus-daemon11:10:021
1000250994422,15cyclictest12350irq/32-eth012:06:110
1000252994335,5cyclictest1129213-21ssh11:40:002
1000252994335,5cyclictest1129213-21ssh11:40:002
100025199434,31cyclictest1043670-21ssh09:21:041
1000250994334,6cyclictest151ktimers/010:36:060
1000252994223,3cyclictest171rcu_preempt10:55:342
1000250994230,9cyclictest421-21dbus-daemon07:35:010
1000252994111,12cyclictest36-21ksoftirqd/211:51:112
1000252994111,12cyclictest36-21ksoftirqd/211:51:112
1000252994031,5cyclictest1021260-21systemd-run08:20:022
1000252994030,7cyclictest1033254-21unin-run09:00:012
1000251994032,5cyclictest1112122-21sendmail_mailst11:11:111
1000250994032,5cyclictest1-21systemd12:35:580
1000250994031,6cyclictest151ktimers/012:16:120
1000250994027,9cyclictest207110-21cups-browsed10:41:070
1000252993931,5cyclictest1076604-21ssh10:15:002
1000252993930,5cyclictest207110-21cups-browsed09:05:012
1000251993931,5cyclictest1098311-21true10:50:011
1000251993926,6cyclictest0-21swapper/109:41:041
1000252993832,3cyclictest0-21swapper/207:35:012
1000252993829,4cyclictest0-21swapper/211:11:092
1000252993829,4cyclictest0-21swapper/210:35:592
100025199385,26cyclictest1118070-21ssh11:21:051
1000251993829,6cyclictest1036225-21diskmemload10:06:101
1000251993829,5cyclictest1061088-21sh09:50:011
1000251993827,7cyclictest439-21systemd-logind10:05:011
100025299373,24cyclictest1124451-21ssh11:31:142
1000252993728,4cyclictest0-21swapper/210:21:062
1000252993726,6cyclictest1049853-21ntp_kernel_err09:31:032
1000252993725,7cyclictest1140097-21threads11:56:172
100025199373,24cyclictest1077847-21ssh10:16:071
1000251993731,3cyclictest0-21swapper/111:40:001
1000251993731,3cyclictest0-21swapper/111:40:001
1000251993729,5cyclictest1104534-21latency_hist11:00:021
1000250993730,4cyclictest1154595-21cut12:20:590
1000252993628,4cyclictest1056-21mta-sts-daemon11:01:082
1000252993627,5cyclictest0-21swapper/210:05:002
1000251993628,5cyclictest1164027-21gltestperf12:35:581
1000251993628,5cyclictest1085928-21systemd-run10:30:011
1000250993629,5cyclictest1037994-21unixbench_multi09:11:170
1000250993629,5cyclictest1030755-21fschecks_time08:50:590
1000250993627,6cyclictest421-21dbus-daemon10:22:210
1000250993626,5cyclictest151ktimers/011:36:090
1000250993626,5cyclictest151ktimers/011:36:090
1000250993623,9cyclictest0-21swapper/010:30:020
100025099362,27cyclictest659-21snmpd10:56:090
1000252993529,3cyclictest0-21swapper/210:10:012
1000252993527,5cyclictest1010317-21systemctl07:41:132
1000252993525,7cyclictest1006237-21/usr/sbin/munin07:30:022
1000252993525,6cyclictest1143379-21unixbench_multi12:01:172
1000252993524,7cyclictest1154781-21fschecks_time12:21:022
1000252993524,7cyclictest1088998-21grep10:35:012
100025299351,26cyclictest1108822-21ssh11:06:062
1000251993529,3cyclictest0-21swapper/112:26:071
1000251993526,6cyclictest1015389-21latency_hist08:00:021
1000251993525,6cyclictest0-21swapper/109:56:181
100025199352,26cyclictest1087142-21ssh10:31:061
1000250993530,3cyclictest1046741-21cut09:26:060
1000250993529,3cyclictest0-21swapper/010:50:550
1000250993528,4cyclictest1004739-21cron07:25:010
1000250993527,5cyclictest420-21avahi-daemon09:18:140
1000250993527,5cyclictest1-21systemd12:35:010
100025099351,27cyclictest1087232-21ssh10:31:100
100025099351,24cyclictest1077856-21ssh10:16:070
1000252993428,3cyclictest0-21swapper/210:50:012
1000252993426,5cyclictest421-21dbus-daemon12:10:012
1000252993426,5cyclictest1043612-21needreboot09:21:022
1000252993426,4cyclictest0-21swapper/210:51:062
1000252993426,4cyclictest0-21swapper/210:00:012
1000252993426,3cyclictest0-21swapper/209:10:552
1000252993425,6cyclictest421-21dbus-daemon12:20:012
1000252993425,5cyclictest1148368-21aten_r2power_en12:10:552
1000252993424,6cyclictest1051-21mta-sts-daemon11:16:032
1000251993428,4cyclictest1000249-21cyclictest09:00:001
1000251993427,4cyclictest1007725-21sh07:35:011
1000251993427,3cyclictest0-21swapper/111:55:001
1000251993427,3cyclictest0-21swapper/111:55:001
1000251993426,5cyclictest0-21swapper/112:31:081
1000251993424,7cyclictest1074157-21aten_r2power_fr10:10:561
1000250993426,5cyclictest421-21dbus-daemon09:00:010
1000250993423,8cyclictest1021150-21unixbench_singl08:16:160
1000252993327,3cyclictest0-21swapper/212:26:052
1000252993325,5cyclictest1078396-21tail10:16:182
1000252993325,3cyclictest0-21swapper/212:31:092
1000252993323,7cyclictest1022054-21needreboot08:21:022
1000251993324,6cyclictest1116916-21ssh11:20:021
1000251993324,4cyclictest0-21swapper/112:01:091
1000251993323,7cyclictest1081107-21proc_pri10:21:101
1000251993323,6cyclictest421-21dbus-daemon07:26:161
100025199332,23cyclictest1124473-21ssh11:31:141
1000250993326,5cyclictest516-21in:imuxsock09:24:550
1000250993326,4cyclictest1027223-21idleruntime-cro08:40:010
1000250993325,5cyclictest1120515-21aten_r2power_cu11:25:520
1000250993325,5cyclictest1109331-21unixbench-2d11:06:180
1000250993325,4cyclictest1012340-21latency_hist07:50:020
1000250993323,4cyclictest0-21swapper/011:16:060
100025099332,24cyclictest1124375-21ssh11:31:100
100025099331,27cyclictest1130552-21ssh11:41:120
100025099331,27cyclictest1130552-21ssh11:41:120
100025299328,7cyclictest36-21ksoftirqd/207:46:032
1000252993226,3cyclictest0-21swapper/207:40:012
1000252993225,4cyclictest1119973-21cron11:25:012
1000252993224,5cyclictest1093940-21sed10:41:172
1000252993224,5cyclictest1024090-21unixbench-2d08:26:162
1000252993223,6cyclictest548-21gdbus08:51:042
1000252993223,5cyclictest1051809-21kworker/u8:7-xprtiod09:49:562
1000252993223,3cyclictest341rcuc/211:40:202
1000252993223,3cyclictest341rcuc/211:40:202
100025299322,24cyclictest1053012-21ssh09:36:072
1000252993212,5cyclictest36-21ksoftirqd/209:26:082
1000251993226,3cyclictest0-21swapper/112:25:001
1000251993226,3cyclictest0-21swapper/108:05:001
1000251993226,3cyclictest0-21swapper/108:05:001
1000251993224,5cyclictest1100073-21unixbench_multi10:51:171
1000251993222,6cyclictest420-21avahi-daemon09:15:061
1000251993222,6cyclictest261-21systemd-journal08:30:011
1000251993222,6cyclictest1123260-21latency_hist11:30:031
1000250993226,4cyclictest1056-21mta-sts-daemon08:48:280
1000250993220,5cyclictest0-21swapper/011:51:070
1000250993220,5cyclictest0-21swapper/011:51:070
1000250993219,9cyclictest1055925-21latency09:40:590
1000252993125,3cyclictest990302-21kworker/u8:5-xprtiod08:01:072
1000252993125,3cyclictest990302-21kworker/u8:5-xprtiod08:01:072
1000252993124,3cyclictest0-21swapper/210:26:012
1000252993120,7cyclictest1120473-21/usr/sbin/munin11:25:542
1000251993124,3cyclictest0-21swapper/111:46:031
1000251993124,3cyclictest0-21swapper/111:46:031
1000251993123,5cyclictest1026738-21proc_pri08:36:111
1000251993123,5cyclictest1018892-21kernelversion08:11:001
1000251993123,5cyclictest1010191-21ntp_offset07:41:091
1000251993123,5cyclictest0-21swapper/112:05:551
100025199311,5cyclictest171rcu_preempt11:41:131
100025199311,5cyclictest171rcu_preempt11:41:131
1000250993124,4cyclictest1070441-21cron10:05:000
1000250993124,4cyclictest1054-21mta-sts-daemon12:12:380
1000250993124,4cyclictest0-21swapper/011:01:140
100025099312,21cyclictest1142879-21ssh12:01:070
100025299306,6cyclictest36-21ksoftirqd/207:51:042
100025299303,22cyclictest1040618-21ssh09:16:072
1000251993024,3cyclictest0-21swapper/112:00:011
1000251993024,3cyclictest0-21swapper/110:41:001
1000251993020,7cyclictest1151866-21latency12:16:051
1000250993024,4cyclictest1117558-21aten_r2power_po11:20:570
1000250993022,5cyclictest1021469-21/usr/sbin/munin08:20:550
1000250993021,5cyclictest151ktimers/008:26:100
1000250993020,7cyclictest1055-21mta-sts-daemon10:49:180
1000250993018,9cyclictest1051-21mta-sts-daemon08:01:020
1000250993018,9cyclictest1051-21mta-sts-daemon08:01:020
1000250993015,12cyclictest421-21dbus-daemon07:15:010
1000252992923,3cyclictest0-21swapper/212:36:162
1000252992920,3cyclictest171rcu_preempt09:51:102
1000252992914,5cyclictest351ktimers/207:11:002
100025199294,16cyclictest1062283-21ssh09:51:041
1000251992922,4cyclictest1003888-21kernelversion07:21:011
1000251992921,5cyclictest1049685-21latency09:31:001
1000251992920,5cyclictest1089660-21aten2.4-expect10:35:561
1000250992919,4cyclictest12350irq/32-eth007:36:050
100025299286,11cyclictest351ktimers/207:55:562
1000252992822,3cyclictest0-21swapper/208:40:012
1000252992817,3cyclictest171rcu_preempt08:06:102
1000252992812,7cyclictest36-21ksoftirqd/211:50:012
1000252992812,7cyclictest36-21ksoftirqd/211:50:012
1000251992821,4cyclictest1046373-21sh09:25:581
1000251992820,5cyclictest1012167-21unixbench_singl07:46:161
1000251992819,5cyclictest0-21swapper/108:16:091
1000250992823,2cyclictest0-21swapper/010:15:020
1000250992822,3cyclictest0-21swapper/009:46:050
1000250992818,7cyclictest1014531-21needreboot07:56:030
1000250992815,7cyclictest12350irq/32-eth009:31:050
1000250992815,5cyclictest151ktimers/011:46:070
1000250992815,5cyclictest151ktimers/011:46:070
100025299278,5cyclictest36-21ksoftirqd/208:11:042
1000252992722,2cyclictest0-21swapper/208:50:012
1000252992715,3cyclictest171rcu_preempt08:41:012
1000251992719,5cyclictest1030150-21unixbench_singl08:46:171
1000251992716,6cyclictest420-21avahi-daemon07:15:021
100025099273,19cyclictest1158307-21sh12:26:090
1000250992711,12cyclictest1111933-21ssh11:11:060
100025299269,3cyclictest171rcu_preempt09:06:082
1000251992620,3cyclictest0-21swapper/108:55:011
1000251992619,4cyclictest1055-21mta-sts-daemon07:51:461
1000251992618,5cyclictest1028752-21systemd-run08:45:011
1000251992618,5cyclictest1008027-21aten_r2power_en07:35:551
1000251992615,6cyclictest0-21swapper/108:35:021
1000250992619,5cyclictest1052407-21aten2.4-expect09:35:560
1000250992618,5cyclictest420-21avahi-daemon08:32:520
100025299255,6cyclictest36-21ksoftirqd/207:10:022
1000252992518,4cyclictest351ktimers/208:31:082
1000251992517,5cyclictest1003118-21unixbench_multi07:16:151
100025199251,17cyclictest659-21snmpd08:21:041
1000250992517,5cyclictest207110-21cups-browsed07:51:340
100025099251,14cyclictest1002662-21ntpq07:16:070
1000251992415,5cyclictest0-21swapper/109:00:581
100025199233,17cyclictest1017699-21sshd08:06:101
100025099232,16cyclictest1005703-21ntpq07:26:130
1000250992316,5cyclictest1017069-21aten_r2power_fr08:05:560
1000250992315,5cyclictest548-21gdbus09:04:490
1000250992212,4cyclictest1028677-21unixbench_singl08:41:180
1000250991915,2cyclictest0-21swapper/007:10:020
100025399173,9cyclictest0-21swapper/312:31:093
100025399172,7cyclictest0-21swapper/312:11:123
100025399171,6cyclictest0-21swapper/308:06:093
100025399162,9cyclictest0-21swapper/311:10:533
100025199161,11cyclictest1000261-21systemd-run07:10:011
100025399152,7cyclictest0-21swapper/310:50:593
100025399152,7cyclictest0-21swapper/309:36:053
100025399152,6cyclictest0-21swapper/310:16:003
100025399151,9cyclictest0-21swapper/310:21:073
100025399151,8cyclictest0-21swapper/309:56:063
100025399151,8cyclictest0-21swapper/309:16:063
100025399151,7cyclictest0-21swapper/311:21:053
100025399151,7cyclictest0-21swapper/309:21:043
100025399151,7cyclictest0-21swapper/307:16:073
100025399151,6cyclictest0-21swapper/307:11:083
100025399151,5cyclictest0-21swapper/308:31:033
100025399143,7cyclictest0-21swapper/312:06:053
100025399143,7cyclictest0-21swapper/309:40:563
100025399143,6cyclictest0-21swapper/308:26:073
100025399143,4cyclictest0-21swapper/308:46:053
100025399142,7cyclictest0-21swapper/309:26:093
100025399142,6cyclictest0-21swapper/311:51:073
100025399142,6cyclictest0-21swapper/311:51:073
100025399142,6cyclictest0-21swapper/310:01:063
100025399142,6cyclictest0-21swapper/307:21:073
100025399142,5cyclictest0-21swapper/308:01:073
100025399142,5cyclictest0-21swapper/308:01:073
100025399141,7cyclictest0-21swapper/312:01:043
100025399141,7cyclictest0-21swapper/309:11:073
100025399141,7cyclictest0-21swapper/307:51:063
100025399141,6cyclictest0-21swapper/308:21:093
100025399141,6cyclictest0-21swapper/307:26:113
100025399141,5cyclictest0-21swapper/308:56:053
100025399141,5cyclictest0-21swapper/308:11:053
100025399134,4cyclictest0-21swapper/309:46:073
100025399133,7cyclictest0-21swapper/309:31:033
100025399132,7cyclictest0-21swapper/309:06:153
100025399132,6cyclictest0-21swapper/310:31:063
100025399131,7cyclictest0-21swapper/311:26:103
100025399131,6cyclictest0-21swapper/307:46:063
100025399123,6cyclictest0-21swapper/311:31:073
100025399122,7cyclictest0-21swapper/307:41:083
100025399122,6cyclictest0-21swapper/312:25:583
100025399122,6cyclictest0-21swapper/311:01:023
100025399122,6cyclictest0-21swapper/310:56:053
100025399121,7cyclictest0-21swapper/312:35:553
100025399121,7cyclictest0-21swapper/312:21:093
100025399121,7cyclictest0-21swapper/311:56:123
100025399121,7cyclictest0-21swapper/311:40:553
100025399121,7cyclictest0-21swapper/311:40:553
100025399121,7cyclictest0-21swapper/311:16:023
100025399121,7cyclictest0-21swapper/310:11:103
100025399121,6cyclictest0-21swapper/311:06:043
100025399121,6cyclictest0-21swapper/310:06:023
100025399121,6cyclictest0-21swapper/309:50:543
100025399121,6cyclictest0-21swapper/309:01:063
100025399121,6cyclictest0-21swapper/307:56:103
100025399121,6cyclictest0-21swapper/307:36:043
100025399114,4cyclictest0-21swapper/308:51:073
100025399112,6cyclictest0-21swapper/312:15:543
100025399112,5cyclictest0-21swapper/307:31:173
100025399111,7cyclictest0-21swapper/311:35:563
100025399111,7cyclictest0-21swapper/311:35:563
100025399111,7cyclictest0-21swapper/310:40:563
100025399111,6cyclictest0-21swapper/311:45:593
100025399111,6cyclictest0-21swapper/311:45:593
100025399111,6cyclictest0-21swapper/310:35:563
100025399111,6cyclictest0-21swapper/308:36:113
100025399111,5cyclictest0-21swapper/307:10:023
100025399103,5cyclictest0-21swapper/310:25:553
100025399103,5cyclictest0-21swapper/308:41:083
100025399102,5cyclictest0-21swapper/310:46:043
10002539991,5cyclictest0-21swapper/308:15:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional