You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 08:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Sep 17, 2026 00:42:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4102068995846,8cyclictest265-21systemd-journal22:29:162
4102067995142,6cyclictest4156524-21latency_hist21:40:021
4102068994942,4cyclictest4127567-21kworker/u8:13+xprtiod20:35:012
4102068994942,4cyclictest4127567-21kworker/u8:13+xprtiod20:35:012
4102068994739,5cyclictest4136576-21systemd-run21:05:012
4102068994738,6cyclictest1003-21mta-sts-daemon23:26:212
4102067994638,3cyclictest0-21swapper/123:51:241
410206699469,25cyclictest4138052-21diskmemload21:51:230
410206799452,34cyclictest18634-21ssh23:11:161
410206799452,34cyclictest18634-21ssh23:11:161
4102066994538,5cyclictest539-21wpa_supplicant00:00:010
410206699453,4cyclictest0-21swapper/000:06:170
4102068994437,4cyclictest1001-21mta-sts-daemon23:47:382
4102067994436,5cyclictest1000-21mta-sts-daemon21:56:121
4102067994435,5cyclictest47784-21dpkg-db-backup00:00:011
4102066994436,5cyclictest47853-21cups-browsed00:03:010
4102068994335,4cyclictest4138052-21diskmemload00:00:012
4102067994335,5cyclictest4159557-21systemd-run21:45:011
4102068994236,3cyclictest0-21swapper/222:40:012
4102068994232,7cyclictest1003-21mta-sts-daemon00:21:052
410206799424,26cyclictest421-21dbus-daemon00:31:181
4102068994135,3cyclictest0-21swapper/223:01:012
4102068994135,3cyclictest0-21swapper/223:01:012
4102068994133,5cyclictest4129035-21cron20:40:002
4102068994133,5cyclictest4129035-21cron20:40:002
4102068994132,6cyclictest4152154-21grep21:31:242
4102068994034,3cyclictest0-21swapper/222:49:042
4102068994031,5cyclictest4171701-21cut22:05:012
4102068994030,6cyclictest2402979-21cups-browsed21:56:562
4102067994034,4cyclictest4102065-21cyclictest22:50:011
4102067994032,5cyclictest6943-21unixbench_multi22:51:241
4102067994032,5cyclictest2402979-21cups-browsed23:36:021
4102067994031,4cyclictest0-21swapper/119:51:171
4102066994031,5cyclictest1003-21mta-sts-daemon22:08:480
4102066994020,14cyclictest24818-21ssh23:21:190
4102068993930,5cyclictest9504-21ntpq22:56:172
4102067993934,2cyclictest0-21swapper/121:10:011
4102067993931,5cyclictest4109542-21cron19:35:001
4102067993931,5cyclictest4108073-21systemd-run19:30:011
4102067993931,5cyclictest4108073-21systemd-run19:30:011
4102067993930,5cyclictest4171703-21sh22:05:011
410206799392,28cyclictest9530-21ssh22:56:181
4102066993929,6cyclictest1-21systemd23:45:020
4102066993927,9cyclictest4177787-21munin-plugin-st22:15:010
4102068993830,6cyclictest35630-21basename23:40:012
4102066993829,6cyclictest2402979-21cups-browsed23:46:320
410206899376,8cyclictest171rcu_preempt19:26:122
410206899376,8cyclictest171rcu_preempt19:26:122
4102068993732,2cyclictest0-21swapper/221:55:012
4102068993732,2cyclictest0-21swapper/221:00:012
4102068993729,5cyclictest4178388-21aten_r2power_cu22:16:062
4102068993729,5cyclictest4162618-21latency_hist21:50:022
4102068993729,5cyclictest0-21swapper/221:30:012
4102068993728,6cyclictest4155208-21unixbench_multi21:36:242
4102068993726,8cyclictest4145799-21switchtime21:21:222
410206799374,20cyclictest4176086-21ssh22:11:171
4102067993731,3cyclictest0-21swapper/122:31:171
4102067993728,6cyclictest2402979-21cups-browsed23:06:181
4102067993728,6cyclictest2402979-21cups-browsed23:06:181
4102067993725,9cyclictest4185409-21mailstats22:26:221
4102066993730,4cyclictest63071-21latency_hist00:25:020
4102066993728,7cyclictest4112560-21/usr/sbin/munin19:45:020
4102066993723,9cyclictest1-21systemd20:20:010
4102068993627,6cyclictest6789-21timerandwakeup22:51:242
4102068993625,8cyclictest24575-21missed_timers23:21:112
410206799364,26cyclictest21732-21ssh23:16:181
4102067993629,4cyclictest58764-21head00:16:241
4102067993628,5cyclictest24818-21ssh23:21:191
4102067993627,5cyclictest63030-21sh00:25:001
410206699366,27cyclictest15664-21sshd23:06:170
410206699366,27cyclictest15664-21sshd23:06:170
4102066993631,3cyclictest1002-21mta-sts-daemon20:36:150
4102066993631,3cyclictest1002-21mta-sts-daemon20:36:150
4102066993631,2cyclictest0-21swapper/022:00:010
4102066993630,3cyclictest0-21swapper/023:31:240
4102066993629,4cyclictest4133617-21latency_hist20:55:020
4102066993628,5cyclictest4171722-21systemd-run22:05:020
410206899355,26cyclictest4175951-21ssh22:11:112
4102068993529,3cyclictest0-21swapper/223:20:002
4102068993529,3cyclictest0-21swapper/221:11:172
4102068993527,5cyclictest57870-21if_wlan000:16:062
4102068993524,7cyclictest420-21avahi-daemon22:05:452
4102067993528,4cyclictest4133539-21cron20:55:011
4102067993527,5cyclictest64848-21unixbench_multi00:26:241
4102067993526,5cyclictest1003-21mta-sts-daemon22:36:191
410206699353,29cyclictest12507-21ssh23:01:120
410206699353,29cyclictest12507-21ssh23:01:120
4102066993529,3cyclictest0-21swapper/019:40:010
4102066993526,6cyclictest265-21systemd-journal22:40:160
4102066993526,6cyclictest2402979-21cups-browsed23:53:520
4102066993520,12cyclictest0-21swapper/022:36:240
4102068993426,6cyclictest49680-21unixbench_multi00:01:352
4102068993426,5cyclictest4144162-21idleruntime-cro21:20:002
4102068993426,5cyclictest4144162-21idleruntime-cro21:20:002
4102068993426,5cyclictest2402979-21cups-browsed20:03:292
4102068993424,4cyclictest1001-21mta-sts-daemon00:25:472
4102067993429,2cyclictest0-21swapper/123:01:221
4102067993429,2cyclictest0-21swapper/123:01:221
4102067993427,4cyclictest4161306-21unixbench-2d21:46:221
4102067993426,5cyclictest4183882-21idleruntime-cro22:25:001
4102067993426,5cyclictest4141099-21idleruntime-cro21:15:011
4102067993425,5cyclictest1001-21mta-sts-daemon21:23:401
4102067993424,6cyclictest1002-21mta-sts-daemon22:43:421
410206699346,5cyclictest171rcu_preempt20:11:130
4102066993428,4cyclictest55723-21unixbench_singl00:11:250
4102066993428,4cyclictest55723-21unixbench_singl00:11:250
4102066993427,5cyclictest420-21avahi-daemon21:21:100
4102066993427,5cyclictest4156499-21sendmail-msp21:40:010
4102066993425,6cyclictest47837-21cupsd00:16:350
4102066993424,7cyclictest27052-21/usr/sbin/munin23:26:070
4102066993424,2cyclictest0-21swapper/022:46:260
4102066993422,9cyclictest4148613-21sshd21:26:160
410206699341,29cyclictest4142501-21ssh21:16:210
410206699341,29cyclictest4142501-21ssh21:16:210
4102068993325,5cyclictest51439-21aten_r2power_cu00:06:062
4102068993325,4cyclictest0-21swapper/223:41:172
410206899332,27cyclictest4157744-21ssh21:41:152
4102067993327,3cyclictest0-21swapper/122:20:011
4102067993325,5cyclictest4135037-21sendmail21:00:011
4102067993325,5cyclictest4112549-21cron19:45:011
4102066993322,4cyclictest20712-21ssh23:15:170
4102068993226,3cyclictest0-21swapper/223:11:172
4102068993226,3cyclictest0-21swapper/223:11:172
4102068993226,3cyclictest0-21swapper/200:15:002
4102068993226,3cyclictest0-21swapper/200:15:002
4102068993225,4cyclictest1000-21mta-sts-daemon19:46:242
4102068993225,3cyclictest0-21swapper/222:31:122
4102068993222,8cyclictest4123967-21ntp_kernel_pll_20:21:142
410206899322,26cyclictest15690-21ssh23:06:182
410206899322,26cyclictest15690-21ssh23:06:182
4102067993225,5cyclictest4102065-21cyclictest20:20:011
4102067993225,4cyclictest4129089-21systemd20:40:011
4102067993225,4cyclictest4129089-21systemd20:40:011
4102067993225,4cyclictest4117131-21latency_hist20:00:021
4102067993225,3cyclictest0-21swapper/121:51:251
4102067993224,5cyclictest4113089-21fschecks_time19:46:061
4102067993223,6cyclictest40508-21unixbench_multi23:46:311
4102067993221,8cyclictest4173078-21collect222:06:191
4102067993221,8cyclictest4120064-21sh20:10:011
4102066993224,5cyclictest420-21avahi-daemon22:54:340
4102066993223,6cyclictest421-21dbus-daemon22:33:060
4102066993222,7cyclictest18474-21missed_timers23:11:120
4102066993222,7cyclictest18474-21missed_timers23:11:120
4102066993218,10cyclictest0-21swapper/021:46:110
410206699321,26cyclictest665-21snmpd22:26:120
4102068993124,4cyclictest1003-21mta-sts-daemon00:31:142
4102068993124,4cyclictest1001-21mta-sts-daemon20:51:172
4102068993124,3cyclictest0-21swapper/222:45:012
4102068993124,3cyclictest0-21swapper/220:30:012
4102068993123,5cyclictest43429-21timerwakeupswit23:51:292
4102068993123,5cyclictest0-21swapper/222:21:122
410206899312,23cyclictest30899-21ssh23:31:162
4102067993125,3cyclictest0-21swapper/100:05:011
4102067993123,5cyclictest36502-21fschecks_time23:41:061
4102067993122,6cyclictest0-21swapper/100:11:031
4102067993122,6cyclictest0-21swapper/100:11:031
4102067993121,7cyclictest4142598-21mailstats21:16:241
4102067993121,7cyclictest4142598-21mailstats21:16:241
410206799311,23cyclictest4151617-21ssh21:31:141
4102066993125,4cyclictest4120122-21latency_hist20:10:020
4102066993125,3cyclictest1000-21mta-sts-daemon23:36:340
4102066993124,5cyclictest4108902-21ntp_kernel_err19:31:110
4102066993120,6cyclictest12650irq/32-eth020:46:170
4102066993117,11cyclictest11234-21cron23:00:010
4102066993116,12cyclictest0-21swapper/021:45:030
4102066993114,15cyclictest69830-21sh00:36:040
410206699311,25cyclictest4151672-21ntpq21:31:160
4102068993021,6cyclictest0-21swapper/220:20:012
4102067993022,3cyclictest0-21swapper/100:36:171
4102066993025,3cyclictest4100812-21kworker/u8:15-xprtiod19:21:060
4102066993017,5cyclictest12650irq/32-eth022:16:210
4102066993010,4cyclictest0-21swapper/022:21:170
4102068992924,2cyclictest0-21swapper/219:21:062
4102068992923,3cyclictest1001-21mta-sts-daemon19:35:012
4102068992922,4cyclictest4105053-21munin-plugin-st19:20:012
4102068992922,3cyclictest0-21swapper/200:36:192
410206899292,21cyclictest4119532-21sshd20:06:172
4102068992911,12cyclictest351ktimers/220:11:132
4102067992924,2cyclictest0-21swapper/120:15:011
4102067992922,3cyclictest0-21swapper/123:35:021
4102067992921,5cyclictest4110764-21threads19:36:221
4102066992921,5cyclictest1-21systemd19:30:010
4102066992921,5cyclictest1-21systemd19:30:010
4102066992920,7cyclictest4136575-21sh21:05:010
410206899282,21cyclictest2402979-21cups-browsed20:41:172
410206899282,19cyclictest665-21snmpd19:56:152
4102067992821,4cyclictest4103550-21munin-plugin-st19:15:011
4102067992819,6cyclictest0-21swapper/121:26:031
4102066992823,2cyclictest0-21swapper/019:46:130
4102066992820,6cyclictest4137096-21fschecks_time21:06:100
4102066992817,9cyclictest0-21swapper/000:26:170
410206799274,11cyclictest4138052-21diskmemload23:26:131
4102067992722,2cyclictest0-21swapper/120:30:011
4102067992721,3cyclictest0-21swapper/120:21:161
4102067992720,4cyclictest4135601-21fschecks_time21:01:051
4102067992719,5cyclictest51706-21sort00:06:101
410206699273,19cyclictest67392-21sshd00:31:170
4102066992721,4cyclictest4134900-21unixbench-2d20:56:250
4102066992721,3cyclictest0-21swapper/021:10:200
4102066992719,6cyclictest4117042-21grep20:00:010
4102066992718,7cyclictest4117971-21ntp_kernel_pll_20:01:230
4102068992618,3cyclictest0-21swapper/221:10:022
4102068992616,6cyclictest2402979-21cups-browsed19:15:012
4102067992619,4cyclictest4106511-21unixbench_singl19:21:241
4102066992621,2cyclictest0-21swapper/020:35:000
4102066992621,2cyclictest0-21swapper/020:35:000
4102066992617,7cyclictest4104422-21ntp_kernel_pll_19:16:130
410206899254,13cyclictest428-21mta-sts-daemon19:51:142
4102068992520,2cyclictest0-21swapper/219:40:012
4102068992519,3cyclictest0-21swapper/219:10:022
4102067992519,3cyclictest0-21swapper/120:35:011
4102067992519,3cyclictest0-21swapper/120:35:011
4102067992519,3cyclictest0-21swapper/120:05:011
410206699251,3cyclictest0-21swapper/019:11:140
410206699251,16cyclictest4130021-21ntpq20:41:150
4102068992418,3cyclictest0-21swapper/220:46:172
4102068992418,2cyclictest0-21swapper/219:41:162
4102067992419,2cyclictest0-21swapper/119:20:011
4102066992420,2cyclictest0-21swapper/019:55:010
4102066992416,6cyclictest694-21cron20:25:010
4102067992315,5cyclictest4102124-21latency_hist19:10:021
410206799222,14cyclictest4129910-21ntpq20:41:101
410206799221,16cyclictest4131580-21ps20:46:201
4102066992217,3cyclictest4102065-21cyclictest20:26:030
4102066992211,7cyclictest421-21dbus-daemon19:10:010
410206999162,6cyclictest0-21swapper/321:56:163
410206999162,6cyclictest0-21swapper/321:46:093
410206999161,7cyclictest0-21swapper/320:11:133
410206999153,7cyclictest0-21swapper/300:00:013
410206999152,8cyclictest0-21swapper/323:06:203
410206999152,8cyclictest0-21swapper/323:06:203
410206999151,6cyclictest0-21swapper/323:51:193
410206999151,6cyclictest0-21swapper/321:21:113
410206999142,6cyclictest0-21swapper/322:36:143
410206999142,5cyclictest0-21swapper/321:16:153
410206999142,5cyclictest0-21swapper/321:16:153
410206999133,5cyclictest0-21swapper/319:46:143
410206999132,6cyclictest0-21swapper/323:21:153
410206999132,6cyclictest0-21swapper/322:06:123
410206999131,7cyclictest0-21swapper/322:26:213
410206999131,7cyclictest0-21swapper/321:51:163
410206999131,7cyclictest0-21swapper/321:36:123
410206999131,6cyclictest0-21swapper/322:01:163
410206999131,6cyclictest0-21swapper/319:31:113
410206999131,5cyclictest0-21swapper/321:01:113
410206999131,5cyclictest0-21swapper/320:36:153
410206999131,5cyclictest0-21swapper/320:36:153
410206999131,5cyclictest0-21swapper/319:36:113
410206999130,7cyclictest0-21swapper/300:31:153
410206999122,6cyclictest0-21swapper/322:41:273
410206999122,5cyclictest0-21swapper/320:16:193
410206999121,7cyclictest0-21swapper/323:40:023
410206999121,7cyclictest0-21swapper/323:31:133
410206999121,7cyclictest0-21swapper/300:01:173
410206999121,6cyclictest0-21swapper/323:26:033
410206999121,6cyclictest0-21swapper/323:16:153
410206999121,6cyclictest0-21swapper/323:01:113
410206999121,6cyclictest0-21swapper/323:01:113
410206999121,6cyclictest0-21swapper/322:31:113
410206999121,6cyclictest0-21swapper/322:21:223
410206999121,6cyclictest0-21swapper/321:26:153
410206999121,6cyclictest0-21swapper/319:51:163
410206999121,6cyclictest0-21swapper/319:11:113
410206999121,6cyclictest0-21swapper/300:11:153
410206999121,6cyclictest0-21swapper/300:11:153
410206999121,6cyclictest0-21swapper/300:06:183
410206999120,6cyclictest0-21swapper/320:26:163
410206999114,5cyclictest0-21swapper/300:21:203
410206999112,5cyclictest0-21swapper/323:11:053
410206999112,5cyclictest0-21swapper/323:11:053
410206999111,6cyclictest0-21swapper/323:46:203
410206999111,6cyclictest0-21swapper/321:06:163
410206999111,6cyclictest0-21swapper/320:46:183
410206999111,6cyclictest0-21swapper/320:41:103
410206999111,5cyclictest0-21swapper/321:30:173
410206999111,5cyclictest0-21swapper/300:16:013
410206999110,6cyclictest0-21swapper/320:06:123
410206999103,5cyclictest0-21swapper/323:44:173
410206999102,5cyclictest0-21swapper/322:11:063
410206999101,6cyclictest0-21swapper/322:46:033
410206999101,6cyclictest0-21swapper/321:41:033
410206999101,6cyclictest0-21swapper/319:30:003
410206999101,6cyclictest0-21swapper/319:30:003
410206999101,6cyclictest0-21swapper/300:36:263
410206999101,5cyclictest0-21swapper/322:56:033
410206999101,5cyclictest0-21swapper/322:15:173
410206999101,5cyclictest0-21swapper/321:10:203
410206999101,5cyclictest0-21swapper/320:31:133
410206999101,5cyclictest0-21swapper/320:31:133
410206999101,5cyclictest0-21swapper/319:56:133
410206999101,5cyclictest0-21swapper/319:16:133
410206999101,4cyclictest0-21swapper/320:05:023
41020699992,5cyclictest0-21swapper/319:41:093
41020699991,5cyclictest0-21swapper/322:55:033
41020699991,5cyclictest0-21swapper/320:21:123
41020699991,5cyclictest0-21swapper/319:21:023
41020699991,5cyclictest0-21swapper/300:26:023
41020699991,4cyclictest0-21swapper/320:55:163
41020699981,6cyclictest0-21swapper/319:10:013
41020699981,4cyclictest0-21swapper/320:51:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional