You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 14:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Sep 05, 2026 12:42:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3827147998367,9cyclictest0-21swapper/110:14:331
3827146995644,10cyclictest3902262-40mandb10:13:390
3827148995340,9cyclictest421-21dbus-daemon12:40:012
3827148994941,4cyclictest3893698-21kworker/u8:22-rpciod10:13:372
3827148994840,5cyclictest3960580-21systemd-run11:50:022
3827147994840,4cyclictest0-21swapper/110:56:091
3827147994824,8cyclictest171rcu_preempt10:21:061
3827147994824,8cyclictest171rcu_preempt10:21:061
3827147994635,7cyclictest3037047-21cups-browsed09:26:171
3827147994536,6cyclictest0-21swapper/109:10:011
3827148994433,7cyclictest3037047-21cups-browsed12:14:582
3827148994433,7cyclictest3037047-21cups-browsed12:14:582
382714799448,5cyclictest171rcu_preempt09:16:071
382714799448,5cyclictest171rcu_preempt09:16:071
3827148994335,5cyclictest3899812-21latency_hist10:10:022
3827148994334,6cyclictest0-21swapper/212:30:022
3827148994331,9cyclictest265-21systemd-journal09:47:452
3827147994333,5cyclictest3962338-21unixbench_multi11:51:221
3827148994236,3cyclictest0-21swapper/210:01:092
3827148994129,9cyclictest3870825-21switchtime09:21:162
3827148994129,9cyclictest3870825-21switchtime09:21:162
3827147994132,4cyclictest0-21swapper/112:01:121
3827147994130,8cyclictest694-21cron07:35:011
3827146994134,4cyclictest0-21swapper/007:21:060
3827148994032,5cyclictest3969689-21munin-plugin-st12:05:012
3827148994032,5cyclictest3837634-21cron07:45:012
3827148994032,4cyclictest3908735-21kworker/u8:5-xprtiod10:30:002
3827148994026,11cyclictest3928702-21timerandwakeup10:56:182
3827147994033,4cyclictest3918798-21fschecks_time10:41:001
3827147994032,5cyclictest3917940-21munin-plugin-st10:40:011
3827147994031,6cyclictest3927064-21cron10:55:011
3827147994015,8cyclictest171rcu_preempt09:36:061
3827146994034,4cyclictest3886410-21unixbench_singl09:46:240
3827146994030,7cyclictest3830135-21munin-run07:20:010
3827146994029,3cyclictest0-21swapper/009:26:190
3827148993931,5cyclictest3877177-21tail09:31:212
3827148993930,6cyclictest3037047-21cups-browsed11:23:562
3827148993930,6cyclictest1003-21mta-sts-daemon09:27:202
3827147993931,4cyclictest0-21swapper/110:35:011
3827146993934,3cyclictest3893685-21kworker/u8:11-rpciod10:05:110
382714699392,28cyclictest3913146-21sh10:31:120
3827148993832,3cyclictest0-21swapper/211:45:012
3827148993827,8cyclictest3933882-21aten2.4-expect11:05:592
3827147993829,7cyclictest3905797-21idleruntime-cro10:20:011
382714799381,4cyclictest171rcu_preempt12:36:111
3827146993830,6cyclictest3923310-21sshd10:47:450
3827146993829,7cyclictest3969272-21sshd12:03:450
382714699382,31cyclictest3876696-21ssh09:31:130
3827148993728,4cyclictest0-21swapper/211:26:132
3827148993728,3cyclictest0-21swapper/211:11:132
3827148993728,3cyclictest0-21swapper/211:11:132
3827148993727,6cyclictest3037039-21cupsd12:30:332
3827148993726,8cyclictest3838485-21ntp_kernel_err07:46:062
3827148993717,12cyclictest0-21swapper/211:31:112
3827147993729,5cyclictest3911857-21cron10:30:001
3827147993729,5cyclictest3896705-21ssh10:05:011
3827147993729,5cyclictest0-21swapper/107:40:011
3827147993715,16cyclictest421-21dbus-daemon08:21:081
3827146993730,4cyclictest3888427-21grep09:51:060
3827146993729,5cyclictest3990957-21systemctl12:40:010
3827146993728,6cyclictest3950056-21timerwakeupswit11:31:190
3827148993627,6cyclictest265-21systemd-journal09:00:022
3827148993624,9cyclictest3890651-21latency_hist09:55:022
3827147993630,3cyclictest0-21swapper/108:00:011
3827147993629,4cyclictest3845074-21unixbench_singl08:06:191
3827146993632,2cyclictest0-21swapper/010:55:010
3827146993628,5cyclictest3868122-21kworker/u8:0+xprtiod09:20:030
3827146993628,5cyclictest3868122-21kworker/u8:0+xprtiod09:20:030
3827146993627,6cyclictest420-21avahi-daemon10:56:340
382714899353,28cyclictest3970904-21ssh12:06:092
382714899353,28cyclictest3970904-21ssh12:06:092
382714899353,27cyclictest3913056-21ssh10:31:092
3827148993528,3cyclictest0-21swapper/209:15:022
3827148993527,5cyclictest3863130-21diskmemload10:16:162
3827148993522,3cyclictest171rcu_preempt08:27:462
3827148993522,3cyclictest171rcu_preempt08:27:462
3827148993515,4cyclictest171rcu_preempt08:06:132
3827147993530,2cyclictest0-21swapper/110:00:011
3827147993529,3cyclictest0-21swapper/111:15:011
3827147993529,3cyclictest0-21swapper/111:15:011
3827147993528,4cyclictest3976562-21fschecks_count12:16:011
3827147993528,4cyclictest3975733-21idleruntime-cro12:15:001
3827147993528,4cyclictest3975733-21idleruntime-cro12:15:001
3827147993528,4cyclictest3972699-21grep12:10:011
3827147993528,4cyclictest3972699-21grep12:10:011
3827147993528,4cyclictest3922572-21ssh10:46:181
3827147993528,3cyclictest0-21swapper/112:00:011
3827147993527,5cyclictest3934948-21unixbench_multi11:06:201
3827147993526,5cyclictest1001-21mta-sts-daemon09:51:141
382714799352,27cyclictest3897982-21ssh10:06:101
382714799351,6cyclictest171rcu_preempt12:26:061
3827146993528,4cyclictest3944056-21unixbench-2d11:21:190
3827146993528,4cyclictest3870661-21proc_pri09:21:130
3827146993528,4cyclictest3870661-21proc_pri09:21:130
3827146993528,4cyclictest3861826-21latency_hist09:05:030
3827146993527,5cyclictest420-21avahi-daemon12:07:380
3827146993527,5cyclictest420-21avahi-daemon12:07:380
3827146993527,5cyclictest3037047-21cups-browsed11:28:100
3827146993526,6cyclictest3882036-21/usr/sbin/munin09:41:080
3827146993524,9cyclictest1002-21mta-sts-daemon11:11:060
3827146993524,9cyclictest1002-21mta-sts-daemon11:11:060
3827146993517,13cyclictest12650irq/32-eth011:41:110
3827146993514,4cyclictest171rcu_preempt07:46:110
3827148993427,4cyclictest3842125-21munin-run08:00:012
3827148993426,5cyclictest3893673-21sh10:00:012
382714899342,22cyclictest1003-21mta-sts-daemon09:41:132
3827147993425,7cyclictest3852668-21latency_hist08:35:011
3827147993425,6cyclictest3863966-21fschecks_count09:11:011
3827147993424,7cyclictest3848146-21basename08:20:011
382714799342,27cyclictest3870429-21ssh09:21:041
382714799342,27cyclictest3870429-21ssh09:21:041
3827146993427,4cyclictest1000-21mta-sts-daemon07:36:100
3827146993425,6cyclictest3037047-21cups-browsed12:22:510
382714699342,28cyclictest3903932-21ssh10:16:070
3827146993421,10cyclictest1001-21mta-sts-daemon12:26:170
382714899333,21cyclictest665-21snmpd08:16:062
3827148993327,3cyclictest0-21swapper/212:20:012
3827148993326,5cyclictest0-21swapper/207:15:012
3827148993324,6cyclictest3918076-21latency_hist10:40:022
3827148993321,2cyclictest171rcu_preempt09:16:112
3827148993321,2cyclictest171rcu_preempt09:16:112
3827148993315,13cyclictest351ktimers/209:36:092
3827147993325,5cyclictest3950155-21unixbench_multi11:31:201
382714699338,12cyclictest14-21ksoftirqd/010:21:130
382714699338,12cyclictest14-21ksoftirqd/010:21:130
3827146993326,4cyclictest3911913-21latency_hist10:30:020
3827146993325,4cyclictest1000-21mta-sts-daemon09:56:050
3827146993318,3cyclictest171rcu_preempt10:43:530
3827146993311,6cyclictest14-21ksoftirqd/011:50:020
3827148993226,3cyclictest0-21swapper/210:46:142
3827148993226,3cyclictest0-21swapper/210:45:012
3827148993224,5cyclictest3831797-21latency_hist07:25:022
3827148993222,5cyclictest171rcu_preempt07:16:232
3827146993227,2cyclictest0-21swapper/010:40:010
3827146993225,4cyclictest3852627-21cron08:35:000
3827146993225,4cyclictest191rcuc/011:05:540
3827146993218,4cyclictest171rcu_preempt08:21:100
3827146993218,11cyclictest3836558-21awk07:41:010
3827146993216,13cyclictest0-21swapper/008:41:090
3827148993125,3cyclictest0-21swapper/212:21:142
3827148993124,3cyclictest0-21swapper/211:51:102
3827148993123,5cyclictest421-21dbus-daemon08:50:022
3827148993123,5cyclictest3852626-21cron08:35:002
3827148993122,4cyclictest0-21swapper/211:36:112
3827147993125,3cyclictest0-21swapper/111:26:091
3827147993124,4cyclictest1001-21mta-sts-daemon09:41:181
3827147993124,4cyclictest1000-21mta-sts-daemon12:21:151
3827147993123,5cyclictest3887572-21cron09:50:011
3827147993123,5cyclictest3877158-21unixbench_multi09:31:211
382714699316,9cyclictest14-21ksoftirqd/008:46:090
3827146993124,4cyclictest0-21swapper/008:36:130
3827146993122,6cyclictest485-21in:imuxsock11:00:450
3827146993121,5cyclictest151ktimers/009:36:060
3827146993119,9cyclictest3846629-21debian-sa108:15:000
3827146993118,4cyclictest171rcu_preempt12:30:140
382714699311,13cyclictest3976991-21ssh12:16:090
3827146993111,3cyclictest191rcuc/008:10:010
382714899309,17cyclictest351ktimers/211:01:062
3827148993025,3cyclictest57-21kcompactd007:31:062
3827148993024,3cyclictest341rcuc/208:21:072
3827148993018,3cyclictest171rcu_preempt08:01:012
3827148993015,3cyclictest171rcu_preempt10:51:122
3827148993013,3cyclictest171rcu_preempt09:01:112
3827147993024,3cyclictest0-21swapper/111:20:001
382714699305,8cyclictest14-21ksoftirqd/008:01:130
382714699304,9cyclictest14-21ksoftirqd/009:06:070
3827146993024,3cyclictest0-21swapper/011:36:060
3827146993023,5cyclictest151ktimers/012:11:080
3827146993023,5cyclictest151ktimers/012:11:080
3827146993023,5cyclictest151ktimers/007:11:130
382714699302,19cyclictest3961909-21ntpq11:51:160
382714899296,10cyclictest3832504-21ntpq07:26:072
3827148992922,4cyclictest1003-21mta-sts-daemon11:15:522
3827148992922,4cyclictest1001-21mta-sts-daemon07:36:092
3827148992921,4cyclictest3827145-21cyclictest10:23:082
3827148992921,4cyclictest3827145-21cyclictest10:23:082
3827148992918,8cyclictest3840031-21ntp_kernel_pll_07:51:072
3827147992923,3cyclictest0-21swapper/109:00:011
3827147992922,4cyclictest1001-21mta-sts-daemon11:38:261
3827147992921,5cyclictest3857651-21fschecks_count08:51:011
3827147992921,4cyclictest1000-21mta-sts-daemon07:21:011
3827147992920,6cyclictest3037047-21cups-browsed08:01:411
382714799290,5cyclictest171rcu_preempt08:36:061
382714699299,7cyclictest14-21ksoftirqd/007:56:120
382714699295,8cyclictest14-21ksoftirqd/007:31:090
3827146992925,3cyclictest3940581-21modprobe11:16:120
3827146992921,5cyclictest151ktimers/008:16:100
3827146992917,3cyclictest171rcu_preempt09:11:120
3827146992913,3cyclictest171rcu_preempt07:30:020
3827146992912,3cyclictest171rcu_preempt10:01:090
382714899282,9cyclictest36-21ksoftirqd/208:11:062
3827148992817,3cyclictest171rcu_preempt08:50:582
3827148992815,2cyclictest171rcu_preempt09:06:082
3827148992813,3cyclictest171rcu_preempt11:57:352
382714799286,17cyclictest421-21dbus-daemon11:01:081
3827147992821,4cyclictest3985734-21gltestperf12:31:031
3827147992816,9cyclictest3832635-21collect207:26:141
3827147992813,4cyclictest171rcu_preempt11:46:061
382714699289,9cyclictest171rcu_preempt08:26:040
382714699289,9cyclictest171rcu_preempt08:26:040
3827146992820,4cyclictest151ktimers/008:56:080
3827146992814,6cyclictest3836116-21kworker/u8:10-xprtiod08:51:030
3827146992813,3cyclictest171rcu_preempt11:56:000
3827146992810,14cyclictest627-21lldpd07:51:040
382714899278,11cyclictest36-21ksoftirqd/208:41:062
3827148992716,3cyclictest171rcu_preempt08:36:072
3827147992719,5cyclictest3037047-21cups-browsed07:47:531
382714699276,6cyclictest14-21ksoftirqd/007:10:010
382714799269,5cyclictest62750lldpd07:42:041
382714799262,18cyclictest3037047-21cups-browsed08:41:071
382714799253,11cyclictest3863130-21diskmemload11:24:291
3827147992519,3cyclictest1002-21mta-sts-daemon08:45:581
3827147992518,4cyclictest3850163-21fschecks_count08:26:011
3827147992518,4cyclictest3850163-21fschecks_count08:26:011
3827147992513,3cyclictest0-21swapper/107:51:171
382714799242,17cyclictest3955686-21sh11:41:081
3827147992410,4cyclictest171rcu_preempt08:11:101
382714999232,14cyclictest0-21swapper/310:13:453
3827147992317,3cyclictest0-21swapper/107:20:011
3827147992315,4cyclictest0-21swapper/109:05:011
382714899225,3cyclictest171rcu_preempt07:10:012
382714799221,7cyclictest171rcu_preempt07:11:061
3827147992217,2cyclictest0-21swapper/107:10:011
382714999201,10cyclictest0-21swapper/311:36:093
382714999194,8cyclictest0-21swapper/311:21:093
382714999193,9cyclictest0-21swapper/310:06:073
382714999193,10cyclictest0-21swapper/310:21:093
382714999193,10cyclictest0-21swapper/310:21:093
382714999192,8cyclictest0-21swapper/308:41:083
382714999192,11cyclictest0-21swapper/309:11:113
382714999192,10cyclictest0-21swapper/312:26:053
382714999192,10cyclictest0-21swapper/311:31:153
382714999191,9cyclictest0-21swapper/308:06:083
382714999184,9cyclictest0-21swapper/312:21:113
382714999184,9cyclictest0-21swapper/312:01:113
382714999184,8cyclictest0-21swapper/308:21:123
382714999183,8cyclictest0-21swapper/308:16:043
382714999183,7cyclictest0-21swapper/310:31:083
382714999183,10cyclictest0-21swapper/310:51:073
382714999183,10cyclictest0-21swapper/309:36:133
382714999182,9cyclictest0-21swapper/309:41:053
382714999182,8cyclictest0-21swapper/311:11:063
382714999182,8cyclictest0-21swapper/311:11:063
382714999182,8cyclictest0-21swapper/311:06:073
382714999182,8cyclictest0-21swapper/310:16:073
382714999182,8cyclictest0-21swapper/307:41:093
382714999182,10cyclictest0-21swapper/311:46:063
382714999182,10cyclictest0-21swapper/310:01:103
382714999182,10cyclictest0-21swapper/309:31:113
382714999182,10cyclictest0-21swapper/309:21:093
382714999182,10cyclictest0-21swapper/309:21:093
382714999175,9cyclictest0-21swapper/309:56:133
382714999173,9cyclictest0-21swapper/312:16:053
382714999173,9cyclictest0-21swapper/311:56:113
382714999173,8cyclictest0-21swapper/307:21:063
382714999172,9cyclictest0-21swapper/311:50:583
382714999172,8cyclictest0-21swapper/308:11:063
382714999172,8cyclictest0-21swapper/307:16:103
382714999172,10cyclictest0-21swapper/311:01:123
382714999164,7cyclictest0-21swapper/310:36:083
382714999163,9cyclictest0-21swapper/311:15:583
382714999163,8cyclictest0-21swapper/311:41:073
382714999163,8cyclictest0-21swapper/311:26:033
382714999163,8cyclictest0-21swapper/308:31:083
382714999163,8cyclictest0-21swapper/307:46:113
382714999163,10cyclictest0-21swapper/312:06:083
382714999163,10cyclictest0-21swapper/312:06:083
382714999162,9cyclictest0-21swapper/310:56:083
382714999162,9cyclictest0-21swapper/310:46:063
382714999162,9cyclictest0-21swapper/309:26:033
382714999162,9cyclictest0-21swapper/308:51:113
382714999162,8cyclictest0-21swapper/309:16:003
382714999162,8cyclictest0-21swapper/309:16:003
382714999162,8cyclictest0-21swapper/307:56:123
382714999162,6cyclictest0-21swapper/307:26:073
382714999162,10cyclictest0-21swapper/312:31:073
382714999161,9cyclictest0-21swapper/312:11:213
382714999161,9cyclictest0-21swapper/312:11:213
382714999154,7cyclictest0-21swapper/309:51:133
382714999153,7cyclictest0-21swapper/312:36:003
382714999153,7cyclictest0-21swapper/309:01:153
382714999153,6cyclictest0-21swapper/307:11:073
382714999152,8cyclictest0-21swapper/308:56:103
382714999151,9cyclictest0-21swapper/309:06:093
382714999151,10cyclictest0-21swapper/309:46:103
382714999147,4cyclictest431ktimers/307:10:013
382714999145,6cyclictest0-21swapper/308:26:143
382714999145,6cyclictest0-21swapper/308:26:143
382714999142,8cyclictest0-21swapper/308:36:093
382714999142,7cyclictest0-21swapper/308:01:123
382714999141,9cyclictest0-21swapper/310:41:063
382714999141,8cyclictest0-21swapper/310:26:013
382714999132,7cyclictest0-21swapper/308:46:053
382714999132,7cyclictest0-21swapper/307:36:053
382714999131,8cyclictest0-21swapper/307:51:043
382714999121,7cyclictest0-21swapper/307:31:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional