You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 22:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri Aug 28, 2026 12:42:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
993360995237,12cyclictest1035475-21munin-plugin-st09:20:010
993362995040,6cyclictest1133022-21systemd-run12:00:022
993362994939,6cyclictest1136059-21systemd-run12:05:012
993361994840,4cyclictest1047796-21systemd09:40:021
993361994836,7cyclictest1100771-21sshd11:06:101
993360994435,7cyclictest1023354-21systemd-run08:50:010
993360994336,4cyclictest1114740-21systemd-run11:30:010
993360994335,5cyclictest1003879-21systemd-run07:45:010
993362994234,5cyclictest1108573-21idleruntime-cro11:20:012
993361994233,5cyclictest1066136-21latency_hist10:10:021
993361994134,4cyclictest1072048-21cron10:20:011
993361994133,5cyclictest1008334-21munin-plugin-st08:00:001
993361994133,5cyclictest1008334-21munin-plugin-st08:00:001
993361994031,6cyclictest177899-21cups-browsed11:41:001
993360994033,4cyclictest1021949-21latency_hist08:45:020
993362993931,5cyclictest1093337-21ssh10:55:012
993362993931,5cyclictest1002384-21systemd-run07:40:012
993362993831,4cyclictest1093369-21kworker/u8:6-xprtiod11:05:002
993362993831,4cyclictest1093369-21kworker/u8:6-xprtiod11:05:002
993362993830,5cyclictest1143309-21ntp_kernel_pll_12:16:042
993362993829,4cyclictest0-21swapper/208:26:102
993361993831,4cyclictest1084212-21ssh10:40:011
993361993830,5cyclictest1055553-21tail09:51:141
993360993824,6cyclictest177899-21cups-browsed11:23:020
993362993727,8cyclictest1026361-21sh09:00:012
993362993727,7cyclictest1100455-21latency11:06:002
993361993731,3cyclictest0-21swapper/110:05:011
993361993730,4cyclictest1032444-21kthreadd09:15:021
993361993730,3cyclictest0-21swapper/109:50:021
993361993729,5cyclictest996381-21systemd-run07:20:011
993361993729,5cyclictest421-21dbus-daemon12:26:101
993361993729,5cyclictest1029366-21systemd-run09:10:011
993361993729,5cyclictest1020371-21systemd-run08:40:011
993361993728,6cyclictest1-21systemd10:50:011
993360993729,5cyclictest420-21avahi-daemon12:00:260
993360993729,5cyclictest1032435-21sh09:15:020
993362993630,3cyclictest0-21swapper/209:25:012
993362993629,4cyclictest996346-21munin-run07:20:012
993362993628,5cyclictest1095107-21unixbench_multi10:56:132
993362993626,6cyclictest420-21avahi-daemon11:34:032
993361993629,4cyclictest1075139-21systemd-run10:25:011
993361993627,6cyclictest485-21in:imuxsock12:01:011
993360993629,5cyclictest421-21dbus-daemon07:50:010
993360993629,4cyclictest1142269-21latency_hist12:15:020
993360993627,6cyclictest421-21dbus-daemon11:54:350
993362993527,5cyclictest1157428-21latency_hist12:40:022
993362993527,5cyclictest1142102-21cron12:15:012
993361993529,3cyclictest0-21swapper/111:31:101
993361993528,4cyclictest1001-21mta-sts-daemon10:57:181
993361993527,5cyclictest1145140-21ssh12:20:011
993361993527,5cyclictest1099463-21systemd-run11:05:011
993361993527,5cyclictest1099463-21systemd-run11:05:011
993360993527,5cyclictest1130434-21/usr/sbin/munin11:55:530
993360993526,6cyclictest421-21dbus-daemon11:32:130
993362993426,5cyclictest1042833-21ntpq09:31:022
993362993426,5cyclictest1003853-21cron07:45:012
993362993425,6cyclictest265-21systemd-journal10:15:012
993362993424,6cyclictest421-21dbus-daemon10:43:352
993361993429,2cyclictest0-21swapper/112:40:011
993361993426,4cyclictest1003-21mta-sts-daemon11:27:481
993361993425,5cyclictest1006861-21systemd-run07:55:011
993361993425,5cyclictest1006861-21systemd-run07:55:011
993361993423,7cyclictest1038556-21sh09:25:011
993360993428,4cyclictest996282-21head07:16:140
993360993428,4cyclictest421-21dbus-daemon12:19:230
993360993426,5cyclictest420-21avahi-daemon12:27:280
993360993426,5cyclictest177899-21cups-browsed08:15:010
993360993425,6cyclictest177899-21cups-browsed10:57:110
993360993425,6cyclictest1002-21mta-sts-daemon12:23:040
993360993424,7cyclictest0-21swapper/009:55:010
993362993326,5cyclictest993359-21cyclictest10:15:542
993362993326,4cyclictest1045232-21aten_r2power_en09:35:492
993362993325,5cyclictest485-21in:imuxsock09:45:012
993362993325,5cyclictest1008334-21munin-run08:00:002
993362993325,5cyclictest1008334-21munin-run08:00:002
993362993325,5cyclictest1006836-21sh07:55:002
993362993325,5cyclictest1006836-21sh07:55:002
993362993324,6cyclictest177896-21cupsd10:36:022
993361993327,3cyclictest0-21swapper/110:55:021
993361993326,4cyclictest1084906-21aten_r2power_vo10:40:551
993361993325,6cyclictest993359-21cyclictest11:46:111
993361993325,5cyclictest1111626-21latency_hist11:25:011
993360993327,4cyclictest177896-21cupsd10:28:410
993360993326,5cyclictest1049475-21unixbench-2d09:41:170
993360993325,5cyclictest0-21swapper/007:40:010
993360993324,7cyclictest1013710-21ntp_kernel_pll_08:16:020
993360993320,10cyclictest0-21swapper/010:50:010
993362993225,4cyclictest1057782-21kernelversion09:55:582
993362993224,5cyclictest421-21dbus-daemon10:50:002
993362993215,8cyclictest1103770-21sh11:11:072
993361993227,2cyclictest0-21swapper/111:52:011
993361993226,3cyclictest0-21swapper/112:21:041
993361993225,5cyclictest0-21swapper/110:00:011
993361993223,4cyclictest1025053-21kworker/u8:2+xprtiod10:15:011
993361993222,7cyclictest1024234-21ntp_kernel_pll_08:51:061
993360993227,2cyclictest0-21swapper/010:05:010
993360993226,4cyclictest485-21in:imuxsock09:05:010
993360993226,3cyclictest0-21swapper/011:41:010
993360993222,8cyclictest1073892-21grep10:21:150
993360993217,13cyclictest1136607-21aten2.4-expect12:05:520
993362993126,2cyclictest0-21swapper/210:10:012
993362993125,4cyclictest993359-21cyclictest08:20:012
993362993125,3cyclictest0-21swapper/211:25:012
993362993123,5cyclictest1123850-21cron11:45:012
993362993123,5cyclictest1075706-21aten_r2power_fr10:25:532
993362993123,5cyclictest1053807-21sh09:50:012
993361993126,3cyclictest0-21swapper/109:26:011
993361993126,2cyclictest0-21swapper/108:20:011
993361993124,4cyclictest1154477-21latency_hist12:35:031
993361993124,4cyclictest1002333-21cron07:40:011
993361993124,3cyclictest0-21swapper/107:46:031
993361993123,5cyclictest994861-21systemd-run07:15:011
993361993123,5cyclictest265-21systemd-journal07:10:021
993361993123,4cyclictest0-21swapper/112:11:081
993361993122,6cyclictest539-21wpa_supplicant10:31:041
993360993125,4cyclictest1041616-21cron09:30:010
993360993124,5cyclictest1152371-21cut12:31:000
993360993124,4cyclictest1000870-21systemd-run07:35:020
993360993123,5cyclictest1009760-21unixbench_multi08:01:130
993360993122,6cyclictest1093364-21sh10:55:020
993360993122,6cyclictest1072044-21ssh10:20:010
993360993121,7cyclictest421-21dbus-daemon07:51:010
993360993121,7cyclictest421-21dbus-daemon07:51:010
993362993024,3cyclictest1026299-21kworker/u8:8-xprtiod10:01:002
993362993024,3cyclictest0-21swapper/209:00:542
993362993021,6cyclictest177899-21cups-browsed09:17:022
993362993018,9cyclictest1030339-21sh09:10:592
99336299301,22cyclictest1146380-21ssh12:21:032
993361993025,2cyclictest0-21swapper/110:26:051
993361993024,4cyclictest0-21swapper/109:41:061
993361993024,3cyclictest1084515-21kworker/u8:4-xprtiod11:15:541
993361993023,4cyclictest1016399-21gltestperf08:25:581
993360993024,4cyclictest485-21in:imuxsock10:15:010
993360993024,4cyclictest1087264-21cron10:45:010
993360993023,4cyclictest1051551-21ssh09:45:570
993360993018,9cyclictest0-21swapper/010:40:010
993362992922,3cyclictest0-21swapper/209:25:572
993362992921,5cyclictest1127404-21/usr/sbin/munin11:50:582
993362992921,4cyclictest0-21swapper/207:31:022
993362992921,3cyclictest0-21swapper/211:36:062
993362992918,7cyclictest265-21systemd-journal12:30:102
993361992922,5cyclictest0-21swapper/109:00:011
993361992922,3cyclictest0-21swapper/109:16:021
993361992921,5cyclictest999352-21munin-run07:30:011
993361992921,5cyclictest177899-21cups-browsed08:40:301
993361992921,5cyclictest1131367-21mailstats11:56:101
993361992920,6cyclictest1018859-21true08:35:011
993360992923,3cyclictest0-21swapper/011:01:110
993360992923,3cyclictest0-21swapper/011:01:110
993360992921,5cyclictest1118546-21cat11:35:560
993362992823,2cyclictest0-21swapper/210:25:022
993362992822,3cyclictest0-21swapper/209:10:012
993362992820,5cyclictest1020328-21cron08:40:012
993362992820,5cyclictest1009853-21munin-plugin-st08:05:002
993362992818,7cyclictest1079131-21latency10:30:572
993362992818,7cyclictest1005362-21systemd-run07:50:012
993362992817,7cyclictest1149305-21missed_timers12:25:592
993361992822,2cyclictest0-21swapper/109:30:521
993361992820,5cyclictest420-21avahi-daemon11:13:301
99336099283,12cyclictest1029342-21diskmemload10:05:350
993360992823,3cyclictest1001-21mta-sts-daemon07:25:550
993360992822,4cyclictest1100045-21aten_r2power_fr11:05:530
993360992822,3cyclictest1011360-21kworker/u8:13-xprtiod09:20:520
993360992822,3cyclictest1002-21mta-sts-daemon11:11:520
993360992821,5cyclictest0-21swapper/009:56:060
993360992821,4cyclictest993359-21cyclictest12:36:070
993360992820,5cyclictest0-21swapper/011:16:100
993362992718,7cyclictest1015201-21ntp_kernel_err08:21:042
993362992718,6cyclictest0-21swapper/211:46:012
993362992717,7cyclictest177899-21cups-browsed09:51:042
993361992722,2cyclictest0-21swapper/111:40:011
993361992719,5cyclictest996891-21fschecks_time07:20:561
993361992719,5cyclictest1027657-21timerwakeupswit09:01:151
993361992715,9cyclictest1003630-21sed07:41:121
99336099273,10cyclictest1029342-21diskmemload10:34:590
993360992722,3cyclictest988177-21kworker/u8:15-xprtiod07:10:540
993360992719,5cyclictest177899-21cups-browsed11:46:190
993360992717,7cyclictest421-21dbus-daemon08:30:020
993362992620,3cyclictest0-21swapper/207:15:012
993361992620,3cyclictest427-21polkitd08:05:181
993361992618,5cyclictest1011888-21gltestperf08:10:561
993360992621,3cyclictest1046491-21unixbench_singl09:36:110
993360992621,2cyclictest0-21swapper/009:35:010
993360992618,5cyclictest420-21avahi-daemon09:06:080
99336399252,16cyclictest0-21swapper/309:16:073
99336399252,11cyclictest0-21swapper/309:26:023
993362992517,5cyclictest177899-21cups-browsed07:28:382
993362992515,8cyclictest1003-21mta-sts-daemon11:25:392
993362992514,8cyclictest1012155-21needreboot08:11:002
993361992518,4cyclictest1136370-21ssh12:05:201
993361992518,4cyclictest1002-21mta-sts-daemon08:46:061
993361992511,11cyclictest420-21avahi-daemon07:31:081
99336399242,11cyclictest0-21swapper/311:41:023
993362992418,3cyclictest0-21swapper/212:05:252
993362992417,5cyclictest1011229-21unixbench_multi08:06:142
993362992417,4cyclictest997864-21munin-plugin-st07:25:012
993361992417,3cyclictest0-21swapper/108:20:591
99336099247,14cyclictest997960-21sed07:25:020
993360992419,3cyclictest1003-21mta-sts-daemon08:56:070
993360992417,5cyclictest999370-21kworker/u8:8-rpciod08:00:010
993360992417,5cyclictest999370-21kworker/u8:8-rpciod08:00:010
99336399234,12cyclictest0-21swapper/309:21:023
99336399232,13cyclictest0-21swapper/311:06:103
993362992316,4cyclictest1000-21mta-sts-daemon08:35:022
993361992316,4cyclictest487-21rs:main1
993360992317,4cyclictest1011301-21unixbench_singl08:06:140
993360992317,4cyclictest0-21swapper/008:21:180
99336399225,9cyclictest0-21swapper/312:31:033
99336399223,12cyclictest0-21swapper/311:26:013
99336399223,12cyclictest0-21swapper/309:56:033
99336399223,10cyclictest0-21swapper/309:51:013
99336399223,10cyclictest0-21swapper/309:41:033
993362992217,3cyclictest0-21swapper/208:50:542
993362992215,4cyclictest1001-21mta-sts-daemon08:45:592
993362992212,7cyclictest1020893-21gltestperf08:40:562
99336099222,15cyclictest1024306-21ntp_states08:51:100
993360992217,3cyclictest993359-21cyclictest08:36:060
993360992216,3cyclictest0-21swapper/008:31:050
99336399214,12cyclictest0-21swapper/312:21:023
99336399214,11cyclictest0-21swapper/312:16:053
99336399213,11cyclictest0-21swapper/312:01:023
99336399213,11cyclictest0-21swapper/310:56:033
99336399213,10cyclictest0-21swapper/310:21:023
99336399212,12cyclictest0-21swapper/310:16:043
99336399212,12cyclictest0-21swapper/310:06:073
99336399211,12cyclictest0-21swapper/310:46:023
99336399211,11cyclictest0-21swapper/311:46:033
99336399204,8cyclictest0-21swapper/311:11:083
99336399204,8cyclictest0-21swapper/308:01:013
99336399204,11cyclictest0-21swapper/312:26:023
99336399203,9cyclictest0-21swapper/308:06:033
99336399203,12cyclictest0-21swapper/312:36:053
99336399203,12cyclictest0-21swapper/310:01:133
99336399203,11cyclictest0-21swapper/311:56:023
99336399203,11cyclictest0-21swapper/310:41:113
99336399203,11cyclictest0-21swapper/309:31:043
99336399203,11cyclictest0-21swapper/309:11:053
99336399203,10cyclictest0-21swapper/310:26:053
99336399202,7cyclictest0-21swapper/308:16:003
99336399202,12cyclictest0-21swapper/311:21:023
99336399202,12cyclictest0-21swapper/311:01:073
99336399202,12cyclictest0-21swapper/311:01:073
99336399202,12cyclictest0-21swapper/310:36:063
99336399202,12cyclictest0-21swapper/309:45:103
99336399202,11cyclictest0-21swapper/311:51:053
99336399201,10cyclictest0-21swapper/307:16:053
99336399194,8cyclictest0-21swapper/307:56:033
99336399194,8cyclictest0-21swapper/307:56:033
99336399193,8cyclictest0-21swapper/311:36:043
99336399193,8cyclictest0-21swapper/307:41:033
99336399193,11cyclictest0-21swapper/310:31:013
99336399193,10cyclictest0-21swapper/309:35:583
99336399192,12cyclictest0-21swapper/310:10:593
99336399192,11cyclictest0-21swapper/312:11:003
99336399192,11cyclictest0-21swapper/311:16:033
99336399192,10cyclictest0-21swapper/312:06:023
993360991914,3cyclictest0-21swapper/007:10:010
99336399183,8cyclictest0-21swapper/309:01:043
99336399183,8cyclictest0-21swapper/307:21:013
99336399182,7cyclictest0-21swapper/309:05:543
99336399182,11cyclictest0-21swapper/308:46:103
99336399174,7cyclictest0-21swapper/308:51:073
99336399173,9cyclictest0-21swapper/308:36:053
99336399173,8cyclictest0-21swapper/307:11:013
99336399173,6cyclictest0-21swapper/308:56:013
99336399173,10cyclictest0-21swapper/310:51:043
99336399172,9cyclictest0-21swapper/308:41:053
99336399172,9cyclictest0-21swapper/308:31:043
99336399172,9cyclictest0-21swapper/308:21:083
99336399172,9cyclictest0-21swapper/308:11:053
99336399172,9cyclictest0-21swapper/307:36:023
99336399172,8cyclictest0-21swapper/308:26:043
99336399172,8cyclictest0-21swapper/307:26:013
99336399172,7cyclictest0-21swapper/307:46:013
99336399172,10cyclictest0-21swapper/311:31:023
993362991712,2cyclictest0-21swapper/207:10:022
99336399162,9cyclictest0-21swapper/307:35:013
99336399156,5cyclictest0-21swapper/307:51:003
99336399156,5cyclictest0-21swapper/307:51:003
99336399112,7cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional