You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 10:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sun Sep 13, 2026 00:42:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
926676995948,7cyclictest485-21in:imuxsock22:20:122
926674995545,7cyclictest1-21systemd23:55:010
926674995422,7cyclictest171rcu_preempt00:26:110
926674995031,11cyclictest12650irq/32-eth021:36:130
926674995031,11cyclictest12650irq/32-eth021:36:130
926675994840,5cyclictest990376-21systemd-run21:55:011
926676994537,5cyclictest940179-21systemd-run19:55:012
926676994536,5cyclictest1041742-21awk23:20:012
926676994534,7cyclictest421-21dbus-daemon19:40:012
926675994538,4cyclictest1029690-21sendmail23:00:011
926675994538,4cyclictest1029690-21sendmail23:00:011
926676994437,3cyclictest0-21swapper/219:45:002
926676994437,3cyclictest0-21swapper/219:45:002
926676994435,6cyclictest420-21avahi-daemon22:26:382
926675994435,6cyclictest968987-21latency_hist21:20:021
926675994435,6cyclictest265-21systemd-journal21:12:121
926674994435,6cyclictest964501-21unixbench-2d21:11:230
926676994232,7cyclictest956732-21sh20:50:012
926676994229,8cyclictest968880-21cron21:20:012
926675994235,3cyclictest0-21swapper/122:36:111
926675994234,5cyclictest955245-21systemd-run20:45:021
926675994233,6cyclictest421-21dbus-daemon23:55:011
926674994233,7cyclictest999727-21sshd22:10:130
926676994134,4cyclictest1005488-21munin-plugin-st22:20:012
926676994132,6cyclictest1082829-21unixbench-2d00:26:242
926675994129,9cyclictest1018707-21missed_timers22:41:081
926675994125,9cyclictest627-21lldpd19:51:161
926674994131,8cyclictest1053837-21sh23:40:010
926675994032,5cyclictest961251-21systemd-run21:05:011
926676993933,3cyclictest0-21swapper/223:35:012
926675993929,6cyclictest3402845-21cups-browsed21:21:091
92667599392,28cyclictest997755-21ssh22:06:121
926674993931,5cyclictest12650irq/32-eth021:56:200
926676993830,5cyclictest1020627-21sh22:45:012
926676993828,7cyclictest1002466-21munin-plugin-st22:15:012
926675993829,6cyclictest1066091-21latency_hist00:00:031
92667499383,27cyclictest428-21mta-sts-daemon21:21:120
926674993832,3cyclictest0-21swapper/022:26:000
926674993831,5cyclictest935658-21sh19:40:000
926674993824,8cyclictest12650irq/32-eth000:01:180
926676993727,6cyclictest420-21avahi-daemon00:21:592
926676993727,6cyclictest3402841-21cupsd22:02:472
926676993727,5cyclictest0-21swapper/222:56:182
926676993727,5cyclictest0-21swapper/222:56:182
926676993726,7cyclictest421-21dbus-daemon23:38:382
92667699372,31cyclictest1036977-21ssh23:11:142
92667699371,31cyclictest985638-21ssh21:46:182
92667699371,31cyclictest985638-21ssh21:46:182
926675993725,8cyclictest976549-21mailstats21:31:221
926674993731,4cyclictest1029664-21idleruntime-cro23:00:010
926674993731,4cyclictest1029664-21idleruntime-cro23:00:010
926674993725,4cyclictest983035-21unixbench_singl21:41:210
926674993725,4cyclictest983035-21unixbench_singl21:41:210
92667499372,30cyclictest1022000-21ssh22:46:180
926674993721,4cyclictest1073755-21unixbench-2d00:11:270
92667499371,29cyclictest151ktimers/022:36:190
926676993630,3cyclictest0-21swapper/221:36:132
926676993630,3cyclictest0-21swapper/221:36:132
926676993629,3cyclictest0-21swapper/220:20:012
926676993628,5cyclictest1090112-21munin-plugin-st00:40:012
926676993627,5cyclictest1065951-21idleruntime-cro00:00:012
92667699362,28cyclictest976279-21sshd21:31:132
92667599365,16cyclictest1021862-21ssh22:46:121
926675993630,3cyclictest0-21swapper/100:31:151
926675993629,3cyclictest0-21swapper/119:20:021
926675993627,6cyclictest996472-21munin-plugin-st22:05:001
926675993627,6cyclictest1075000-21munin-plugin-st00:15:001
926675993624,5cyclictest0-21swapper/123:21:121
92667599362,26cyclictest1055142-21sshd23:41:131
92667599362,26cyclictest1055142-21sshd23:41:131
92667499363,27cyclictest665-21snmpd20:36:170
926676993529,4cyclictest926673-21cyclictest20:35:012
926676993526,5cyclictest958214-21munin-plugin-st20:55:012
926676993524,7cyclictest0-21swapper/200:01:132
926676993523,3cyclictest1070322-21ntpq00:06:172
926676993523,3cyclictest1070322-21ntpq00:06:172
92667699352,24cyclictest929057-21sshd19:16:122
926676993517,10cyclictest1003-21mta-sts-daemon23:06:122
926676993516,5cyclictest171rcu_preempt23:51:112
926674993528,5cyclictest1072001-21systemd-run00:10:010
926674993528,5cyclictest1072001-21systemd-run00:10:010
926674993528,4cyclictest938685-21systemd-run19:50:010
926674993526,7cyclictest1076830-21unixbench_multi00:16:270
926674993524,9cyclictest1035704-21munin-run23:10:010
926674993523,9cyclictest0-21swapper/000:00:010
926676993427,4cyclictest1003-21mta-sts-daemon21:56:302
926676993426,5cyclictest1021480-21fschecks_count22:46:062
926676993424,6cyclictest420-21avahi-daemon23:20:062
926676993424,5cyclictest1046563-21unixbench_multi23:26:212
926676993422,8cyclictest970259-21sh21:21:172
92667599347,22cyclictest979482-21ssh21:36:161
92667599347,22cyclictest979482-21ssh21:36:161
926675993428,3cyclictest0-21swapper/122:30:011
926675993427,5cyclictest962740-21true21:10:011
926675993426,5cyclictest1041739-21munin-run23:20:011
926674993429,3cyclictest1024500-21fschecks_time22:51:100
926674993428,3cyclictest0-21swapper/020:45:130
926674993415,15cyclictest421-21dbus-daemon23:41:560
926674993415,15cyclictest421-21dbus-daemon23:41:560
926676993327,3cyclictest0-21swapper/221:05:012
926676993326,4cyclictest934178-21kthreadd19:35:012
926676993326,3cyclictest0-21swapper/221:51:012
926676993325,5cyclictest997450-21kernelversion22:06:062
926676993325,5cyclictest1075055-21latency_hist00:15:012
92667699332,23cyclictest1055293-21awk23:41:182
92667699332,23cyclictest1055293-21awk23:41:182
926675993328,2cyclictest0-21swapper/119:40:011
926675993327,3cyclictest0-21swapper/123:35:011
926675993325,5cyclictest984272-21sh21:45:001
926675993325,5cyclictest984272-21sh21:45:001
926675993325,5cyclictest1014685-21latency_hist22:35:021
926675993324,6cyclictest265-21systemd-journal23:40:011
926674993328,3cyclictest1041739-21munin-run23:20:010
926674993327,4cyclictest943168-21cron20:05:010
926674993314,15cyclictest962136-21ntpq21:06:130
92667499331,24cyclictest1085333-21sh00:31:160
926676993226,4cyclictest926673-21cyclictest00:33:522
926676993224,3cyclictest0-21swapper/222:31:212
92667699322,23cyclictest665-21snmpd19:21:182
92667699322,21cyclictest964029-21ssh21:11:142
926675993225,5cyclictest0-21swapper/122:20:011
926675993225,4cyclictest0-21swapper/122:00:011
926675993224,5cyclictest987367-21latency_hist21:50:021
926675993224,5cyclictest987367-21latency_hist21:50:021
926675993224,5cyclictest1088937-21unixbench_singl00:36:241
926675993224,5cyclictest1047803-21cut23:30:011
926675993223,7cyclictest694-21cron20:35:011
926675993222,7cyclictest1067688-21ls00:01:301
92667599322,23cyclictest1000861-21ssh22:11:181
92667499328,20cyclictest3402841-21cupsd21:26:050
92667499323,24cyclictest994677-21sshd22:01:130
926674993227,2cyclictest0-21swapper/021:51:030
926674993225,4cyclictest1049593-21tail23:31:210
926674993224,6cyclictest976733-21timerandwakeup21:31:250
926674993224,6cyclictest567-21gdbus19:21:220
92667499321,24cyclictest1046046-21ssh23:26:110
926676993126,2cyclictest0-21swapper/221:30:022
926676993124,4cyclictest984338-21latency_hist21:45:012
926676993124,4cyclictest984338-21latency_hist21:45:012
926676993122,6cyclictest932602-21unixbench_singl19:26:242
926676993122,6cyclictest3402845-21cups-browsed20:05:012
926676993122,5cyclictest941626-21kworker/u8:9-rpciod20:36:132
926676993116,9cyclictest1057826-21/usr/sbin/munin23:46:062
926675993125,3cyclictest0-21swapper/100:20:011
926675993124,5cyclictest1007091-21switchtime22:21:201
926675993123,5cyclictest949246-21systemd-run20:25:011
926675993123,5cyclictest949246-21systemd-run20:25:011
926674993125,4cyclictest952230-21systemd-run20:35:020
926674993125,4cyclictest948613-21sshd20:21:120
926674993125,4cyclictest948613-21sshd20:21:120
926674993124,4cyclictest997663-21ntp_kernel_err22:06:090
926674993122,7cyclictest265-21systemd-journal00:38:140
926674993121,5cyclictest0-21swapper/023:11:250
926674993116,12cyclictest12650irq/32-eth000:21:140
926676993023,4cyclictest1030666-21kernelversion23:01:072
926676993023,3cyclictest0-21swapper/222:55:012
926676993022,5cyclictest1078049-21idleruntime-cro00:20:012
926676993016,9cyclictest421-21dbus-daemon22:38:122
92667599306,14cyclictest1079387-21ssh00:21:171
926675993023,4cyclictest0-21swapper/100:06:141
926675993023,4cyclictest0-21swapper/100:06:141
926675993022,5cyclictest928028-21tail19:11:251
926675993020,7cyclictest1030878-21ntp_kernel_err23:01:101
926674993024,4cyclictest1003918-21sendmail_mailqu22:16:180
926674993022,5cyclictest3402841-21cupsd19:10:010
926674993021,7cyclictest1013162-21timerandwakeup22:31:210
926676992921,5cyclictest959697-21cron21:00:012
926676992919,6cyclictest949182-21unixbench_singl20:21:242
926676992919,6cyclictest949182-21unixbench_singl20:21:242
926675992921,5cyclictest947724-21sendmail20:20:011
926675992921,5cyclictest946228-21systemd-run20:15:011
926675992920,7cyclictest958569-21aten_r2power_po20:56:021
926675992920,5cyclictest1033634-21if_wlan023:06:051
926675992920,5cyclictest0-21swapper/120:51:141
926674992921,6cyclictest0-21swapper/019:20:010
926674992920,6cyclictest985317-21latency21:46:070
926674992920,6cyclictest985317-21latency21:46:070
926674992913,8cyclictest151ktimers/023:21:140
926676992820,5cyclictest1-21systemd20:45:022
92667599282,22cyclictest1024987-21ssh22:51:211
926675992815,9cyclictest1059619-21sshd23:49:131
926674992822,4cyclictest947717-21ls20:20:010
926674992821,4cyclictest0-21swapper/023:01:220
926674992820,6cyclictest950715-21cron20:30:000
926674992818,4cyclictest0-21swapper/022:21:120
926674992814,11cyclictest151ktimers/021:01:180
926675992722,2cyclictest0-21swapper/120:00:011
926675992720,4cyclictest1002-21mta-sts-daemon19:26:111
926675992720,3cyclictest0-21swapper/121:26:041
926675992719,5cyclictest3502177-21munin-node20:46:231
926675992718,6cyclictest944610-21grep20:06:221
926675992718,6cyclictest938603-21unixbench_singl19:46:241
926675992718,6cyclictest933967-21timerwakeupswit19:31:221
926675992718,6cyclictest1036314-21aten_r2power_en23:11:031
926674992720,5cyclictest959486-21timerwakeupswit20:56:220
926674992720,5cyclictest151ktimers/020:06:150
92667499271,20cyclictest665-21snmpd23:46:140
92667699267,14cyclictest351ktimers/220:26:142
92667699266,11cyclictest428-21mta-sts-daemon20:11:152
926676992618,5cyclictest962733-21basename21:10:012
926675992620,3cyclictest0-21swapper/120:30:011
926675992620,3cyclictest0-21swapper/100:26:011
92667499266,12cyclictest12650irq/32-eth021:16:120
926674992621,3cyclictest0-21swapper/022:41:220
926674992620,4cyclictest946228-21systemd-run20:15:010
926674992618,6cyclictest932450-21timerwakeupswit19:26:230
92667499261,20cyclictest957623-21sshd20:51:120
92667699252,18cyclictest927535-21sshd19:11:132
926676992517,5cyclictest0-21swapper/219:56:142
92667599253,17cyclictest3402841-21cupsd20:36:121
926674992519,3cyclictest0-21swapper/019:56:140
926676992418,3cyclictest0-21swapper/220:10:012
926676992417,3cyclictest0-21swapper/219:46:092
926675992416,5cyclictest943175-21ls20:05:011
926675992415,6cyclictest926695-21latency_hist19:10:021
926674992414,7cyclictest0-21swapper/019:45:000
926674992414,7cyclictest0-21swapper/019:45:000
926674992414,4cyclictest0-21swapper/020:41:090
92667499232,15cyclictest939628-21ntpq19:51:200
926675992216,3cyclictest0-21swapper/119:41:121
926675992216,3cyclictest0-21swapper/119:41:121
926675992214,5cyclictest1-21systemd19:25:021
92667499224,12cyclictest420-21avahi-daemon19:11:190
92667499221,15cyclictest933640-21ntpq19:31:170
92667799203,10cyclictest0-21swapper/323:16:133
92667699197,8cyclictest421-21dbus-daemon19:10:022
92667799181,12cyclictest0-21swapper/323:36:153
92667799181,12cyclictest0-21swapper/322:46:153
92667799181,12cyclictest0-21swapper/320:05:463
92667799172,11cyclictest0-21swapper/323:01:153
92667799172,11cyclictest0-21swapper/321:25:123
92667799172,11cyclictest0-21swapper/320:01:143
926677991711,4cyclictest0-21swapper/320:21:123
926677991711,4cyclictest0-21swapper/320:21:123
92667799171,12cyclictest0-21swapper/322:41:183
92667799171,12cyclictest0-21swapper/322:26:093
92667799171,12cyclictest0-21swapper/322:21:083
92667799171,12cyclictest0-21swapper/321:51:103
92667799171,12cyclictest0-21swapper/321:36:183
92667799171,12cyclictest0-21swapper/321:36:183
92667799171,12cyclictest0-21swapper/321:31:203
92667799171,12cyclictest0-21swapper/321:16:113
92667799171,12cyclictest0-21swapper/300:26:163
92667799171,11cyclictest0-21swapper/323:06:103
92667799171,11cyclictest0-21swapper/321:06:133
92667799171,11cyclictest0-21swapper/321:01:143
92667799171,11cyclictest0-21swapper/319:21:143
92667799171,11cyclictest0-21swapper/319:16:113
92667799170,12cyclictest0-21swapper/319:11:173
92667799162,11cyclictest0-21swapper/319:51:213
92667799161,12cyclictest0-21swapper/321:43:483
92667799161,12cyclictest0-21swapper/321:43:483
92667799161,12cyclictest0-21swapper/300:30:143
92667799161,11cyclictest0-21swapper/323:46:123
92667799161,11cyclictest0-21swapper/323:11:123
92667799161,11cyclictest0-21swapper/322:56:153
92667799161,11cyclictest0-21swapper/322:56:153
92667799161,11cyclictest0-21swapper/322:31:093
92667799161,11cyclictest0-21swapper/322:06:093
92667799161,11cyclictest0-21swapper/321:56:183
92667799161,11cyclictest0-21swapper/321:21:123
92667799161,11cyclictest0-21swapper/321:11:143
92667799161,11cyclictest0-21swapper/320:51:113
92667799161,11cyclictest0-21swapper/320:46:133
92667799161,11cyclictest0-21swapper/320:31:123
92667799161,11cyclictest0-21swapper/320:26:123
92667799161,11cyclictest0-21swapper/319:56:153
92667799161,11cyclictest0-21swapper/319:41:133
92667799161,11cyclictest0-21swapper/319:41:133
92667799161,11cyclictest0-21swapper/319:26:143
92667799161,11cyclictest0-21swapper/300:21:133
92667799161,11cyclictest0-21swapper/300:11:143
92667799161,11cyclictest0-21swapper/300:00:033
92667799160,12cyclictest0-21swapper/323:31:143
92667799160,12cyclictest0-21swapper/323:26:113
92667799160,12cyclictest0-21swapper/320:36:133
92667799160,12cyclictest0-21swapper/320:16:123
92667799160,11cyclictest0-21swapper/323:21:093
92667799151,11cyclictest0-21swapper/323:51:063
92667799151,11cyclictest0-21swapper/323:41:093
92667799151,11cyclictest0-21swapper/323:41:093
92667799151,11cyclictest0-21swapper/322:51:063
92667799151,11cyclictest0-21swapper/322:16:033
92667799151,11cyclictest0-21swapper/322:11:013
92667799151,11cyclictest0-21swapper/322:01:133
92667799151,11cyclictest0-21swapper/321:46:113
92667799151,11cyclictest0-21swapper/321:46:113
92667799151,11cyclictest0-21swapper/320:56:103
92667799151,11cyclictest0-21swapper/320:41:053
92667799151,11cyclictest0-21swapper/320:11:013
92667799151,11cyclictest0-21swapper/319:46:093
92667799151,11cyclictest0-21swapper/319:36:103
92667799151,11cyclictest0-21swapper/300:36:013
92667799151,11cyclictest0-21swapper/300:16:103
92667799151,11cyclictest0-21swapper/300:06:113
92667799151,11cyclictest0-21swapper/300:06:113
92667799150,12cyclictest0-21swapper/322:36:123
92667799150,12cyclictest0-21swapper/300:01:173
92667799140,11cyclictest0-21swapper/319:35:023
92667799140,11cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional