You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 17:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon Sep 07, 2026 12:42:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
331836599548,7cyclictest171rcu_preempt11:51:091
331836599531,22cyclictest2534398-21cups-browsed09:51:111
3318365995142,5cyclictest3362373-21unixbench_singl09:21:211
3318365995134,14cyclictest3342509-21latency_hist08:30:031
3318366994841,3cyclictest0-21swapper/211:26:032
3318366994841,3cyclictest0-21swapper/211:26:032
3318364994731,13cyclictest420-21avahi-daemon11:06:070
331836499472,37cyclictest3453023-21ssh11:51:060
3318366994639,3cyclictest0-21swapper/211:11:162
3318365994617,3cyclictest0-21swapper/111:01:021
3318366994535,6cyclictest3328921-21systemd-run07:45:012
331836599454,36cyclictest3364972-21ssh09:26:211
3318365994536,6cyclictest3375926-21latency_hist09:45:021
3318365994521,21cyclictest3467571-21/usr/sbin/munin12:16:161
3318365994520,3cyclictest0-21swapper/109:50:011
3318365994517,24cyclictest3416668-21sh10:51:151
3318364994536,3cyclictest0-21swapper/009:26:140
3318364994520,15cyclictest12650irq/32-eth010:36:070
3318364994520,15cyclictest12650irq/32-eth010:36:070
3318366994435,5cyclictest3322936-21systemd-run07:25:022
3318365994433,7cyclictest2534398-21cups-browsed11:16:481
3318365994419,2cyclictest0-21swapper/110:25:001
3318365994419,2cyclictest0-21swapper/110:25:001
3318365994413,5cyclictest2534398-21cups-browsed11:11:151
331836499442,35cyclictest3367939-21diskmemload09:31:120
331836499442,34cyclictest151ktimers/011:31:120
3318364994412,25cyclictest3465359-21ssh12:11:130
3318366994337,3cyclictest0-21swapper/208:06:082
3318365994319,3cyclictest0-21swapper/112:26:101
3318365994318,5cyclictest3354237-21grep09:06:191
3318364994321,10cyclictest151ktimers/012:16:100
3318366994235,4cyclictest3482275-21latency_hist12:40:012
331836599422,10cyclictest3401477-21ssh10:26:131
3318365994217,5cyclictest2534398-21cups-browsed08:15:171
3318365994217,3cyclictest0-21swapper/111:00:011
3318365994216,3cyclictest0-21swapper/110:46:181
3318364994230,8cyclictest3459228-21rm12:01:110
3318366994134,4cyclictest3348395-21idleruntime-cro08:50:012
3318366994131,6cyclictest420-21avahi-daemon11:31:402
3318365994133,5cyclictest3406219-21ls10:35:011
3318366994031,5cyclictest2534398-21cups-browsed11:03:322
3318366994020,9cyclictest3354396-21diskmemload11:16:162
3318365994028,9cyclictest3372841-21latency_hist09:40:021
331836599402,10cyclictest3392411-21ssh10:11:151
3318365994017,4cyclictest3476901-21cpu12:30:581
3318365994017,3cyclictest0-21swapper/109:10:581
3318365994015,3cyclictest0-21swapper/111:06:151
3318364994028,9cyclictest3391565-21/usr/sbin/munin10:11:030
3318364994023,15cyclictest3418392-21munin-plugin-st10:55:000
3318366993934,2cyclictest0-21swapper/210:36:032
3318366993934,2cyclictest0-21swapper/210:36:032
3318366993931,5cyclictest3398919-21grep10:21:202
3318366993931,5cyclictest3398919-21grep10:21:202
3318366993930,6cyclictest1-21systemd11:45:012
3318366993930,5cyclictest3334925-21systemd-run08:05:022
3318366993929,7cyclictest3404150-21sshd10:31:032
3318365993931,5cyclictest3442676-21munin-run11:35:011
3318365993930,6cyclictest1-21systemd11:37:031
3318365993930,4cyclictest0-21swapper/108:11:061
3318365993928,5cyclictest0-21swapper/112:11:091
3318365993917,2cyclictest0-21swapper/109:30:591
331836599391,6cyclictest3395285-21ntpq10:16:071
331836599391,6cyclictest3395285-21ntpq10:16:071
3318365993914,6cyclictest3459183-21sed12:01:091
3318365993913,8cyclictest421-21dbus-daemon11:25:261
3318365993913,8cyclictest421-21dbus-daemon11:25:261
331836599391,15cyclictest3319302-21ntpq07:11:121
3318364993932,4cyclictest3340932-21systemd-run08:25:020
331836699386,23cyclictest428-21mta-sts-daemon07:13:252
3318366993832,3cyclictest0-21swapper/210:16:092
3318366993832,3cyclictest0-21swapper/210:16:092
3318366993830,5cyclictest2534398-21cups-browsed09:44:552
331836599384,16cyclictest3383158-21ntpq09:56:081
3318365993830,5cyclictest3386169-21ssh10:01:081
331836599382,15cyclictest3434813-21ntpq11:21:081
3318365993814,5cyclictest0-21swapper/110:40:031
3318365993814,5cyclictest0-21swapper/110:40:031
331836599381,16cyclictest3407279-21memory10:36:041
331836599381,16cyclictest3407279-21memory10:36:041
3318364993832,4cyclictest3462732-21unixbench-2d12:06:210
3318364993830,5cyclictest421-21dbus-daemon11:40:010
3318364993830,5cyclictest3410123-21fschecks_time10:41:020
3318364993830,5cyclictest3410123-21fschecks_time10:41:020
3318364993821,10cyclictest151ktimers/008:56:060
3318366993731,3cyclictest0-21swapper/210:46:032
3318366993730,4cyclictest1001-21mta-sts-daemon12:16:142
3318366993729,5cyclictest3369725-21latency_hist09:35:012
3318366993728,6cyclictest3379561-21aten2.4-expect09:51:002
3318366993728,6cyclictest2534398-21cups-browsed09:21:132
3318366993728,6cyclictest2534392-21cupsd11:20:502
3318366993727,6cyclictest2534398-21cups-browsed10:54:452
331836699372,25cyclictest3453228-21ssh11:51:142
331836599373,21cyclictest3447012-21ssh11:41:111
3318365993730,3cyclictest0-21swapper/108:40:011
3318365993728,5cyclictest0-21swapper/109:16:051
3318364993730,4cyclictest3331915-21systemd-run07:55:010
3318364993727,6cyclictest3333405-21idleruntime-cro08:00:010
3318366993628,5cyclictest3401961-21unixbench_multi10:26:232
3318366993627,6cyclictest3333395-21idleruntime-cro08:00:012
3318366993627,6cyclictest2534398-21cups-browsed12:24:302
3318365993628,5cyclictest3389746-21unixbench-2d10:06:191
3318365993616,5cyclictest3462162-21ntp_kernel_err12:06:081
3318364993627,7cyclictest3371002-21ntp_offset09:36:120
3318364993627,6cyclictest3455624-21cpuspeed11:55:590
3318364993621,10cyclictest151ktimers/007:46:100
3318364993612,5cyclictest171rcu_preempt10:31:070
3318366993529,3cyclictest0-21swapper/211:50:012
3318366993527,5cyclictest3352925-21systemd-run09:05:012
3318366993526,5cyclictest1000-21mta-sts-daemon10:41:112
3318366993526,5cyclictest1000-21mta-sts-daemon10:41:112
3318366993515,15cyclictest351ktimers/211:36:062
331836599358,18cyclictest428-21mta-sts-daemon07:26:071
3318365993513,15cyclictest271ktimers/107:16:121
3318364993529,4cyclictest3377593-21unixbench_multi09:46:200
3318364993527,6cyclictest3477595-21grep12:31:130
3318364993522,10cyclictest0-21swapper/009:06:190
3318366993427,4cyclictest1003-21mta-sts-daemon09:37:392
3318366993424,7cyclictest3365224-21switchtime09:26:262
331836599341,12cyclictest3346398-21sshd08:41:251
331836499343,24cyclictest665-21snmpd12:21:070
3318364993429,3cyclictest3337892-21munin-run08:15:010
3318364993427,4cyclictest694-21cron09:45:010
3318364993427,4cyclictest1001-21mta-sts-daemon10:26:050
3318364993427,4cyclictest1000-21mta-sts-daemon12:38:250
3318364993426,5cyclictest3384104-21sh09:57:250
3318364993426,4cyclictest0-21swapper/011:30:020
3318364993426,4cyclictest0-21swapper/011:30:020
331836499341,30cyclictest3431930-21ssh11:16:190
3318366993327,3cyclictest0-21swapper/212:15:012
3318366993327,2cyclictest0-21swapper/209:10:012
3318366993326,4cyclictest1003-21mta-sts-daemon10:58:402
3318366993323,7cyclictest3392605-21switchtime10:11:202
3318365993324,6cyclictest2534398-21cups-browsed12:35:081
3318365993321,7cyclictest0-21swapper/111:46:121
331836599331,24cyclictest3471444-21sh12:21:121
3318364993324,4cyclictest3323434-21fschecks_count07:26:010
3318364993323,7cyclictest3397130-21munin-run10:20:000
3318364993323,7cyclictest3397130-21munin-run10:20:000
3318364993323,7cyclictest3388004-21cut10:05:020
3318364993321,9cyclictest151ktimers/008:01:110
3318364993311,19cyclictest3422739-21ssh11:01:110
3318366993225,3cyclictest0-21swapper/212:30:022
331836699322,4cyclictest171rcu_preempt09:16:132
3318366993224,5cyclictest2534398-21cups-browsed08:59:102
3318366993223,5cyclictest3321452-21latency_hist07:20:022
3318366993222,7cyclictest3456720-21uptime11:56:202
331836699321,27cyclictest351ktimers/207:36:082
3318364993223,6cyclictest3325279-21ntp_kernel_pll_07:31:130
331836499322,25cyclictest3398547-21grep10:21:140
331836499322,25cyclictest3398547-21grep10:21:140
331836499321,2cyclictest0-21swapper/011:41:080
331836699315,17cyclictest1003-21mta-sts-daemon07:46:062
3318366993126,2cyclictest0-21swapper/212:05:012
3318366993122,6cyclictest1003-21mta-sts-daemon10:06:362
3318366993122,5cyclictest3343896-21grep08:35:012
331836699312,23cyclictest3462352-21ssh12:06:152
3318366993121,4cyclictest0-21swapper/210:00:012
3318365993126,2cyclictest0-21swapper/109:05:011
3318365993125,3cyclictest0-21swapper/107:56:031
3318364993124,4cyclictest3363594-21cron09:25:010
3318364993123,6cyclictest1003-21mta-sts-daemon11:49:520
3318364993123,4cyclictest12750irq/33-eth009:11:130
3318364993123,4cyclictest0-21swapper/008:36:130
3318364993123,4cyclictest0-21swapper/007:21:080
3318364993113,14cyclictest3429062-21mailstats11:11:190
3318366993023,3cyclictest0-21swapper/211:10:012
3318366993021,3cyclictest0-21swapper/210:01:092
3318364993022,5cyclictest3379414-21aten_r2power_cu09:50:580
3318364993021,7cyclictest3391039-21latency_hist10:10:030
3318366992921,5cyclictest421-21dbus-daemon09:46:112
3318366992921,5cyclictest3477212-21latency12:31:032
3318365992923,3cyclictest3451516-21kworker/u8:8-xprtiod11:56:041
331836599292,18cyclictest601-21gmain08:31:091
3318365992921,5cyclictest420-21avahi-daemon07:46:141
3318365992920,7cyclictest3322725-21timerwakeupswit07:21:201
331836499293,21cyclictest3474444-21ssh12:26:110
3318364992916,8cyclictest12650irq/32-eth008:26:080
331836499291,23cyclictest2534398-21cups-browsed07:16:110
331836499290,5cyclictest171rcu_preempt09:01:120
3318366992823,2cyclictest0-21swapper/207:55:012
3318366992820,5cyclictest3344759-21ntp_kernel_err08:36:072
3318366992818,6cyclictest2534398-21cups-browsed08:41:222
3318365992822,3cyclictest0-21swapper/109:00:011
3318365992821,4cyclictest1003-21mta-sts-daemon07:51:011
3318365992820,6cyclictest0-21swapper/107:40:011
3318364992818,8cyclictest3346251-21ntp_kernel_err08:41:140
331836699275,16cyclictest428-21mta-sts-daemon08:21:112
3318366992719,5cyclictest421-21dbus-daemon07:30:012
331836699271,4cyclictest171rcu_preempt09:11:132
3318365992721,3cyclictest0-21swapper/108:10:021
3318365992719,5cyclictest3318369-21systemd-run07:10:011
3318364992721,3cyclictest0-21swapper/009:15:570
3318364992716,8cyclictest3347801-21ntp_kernel_pll_08:46:090
331836499271,23cyclictest151ktimers/008:31:080
3318366992621,2cyclictest0-21swapper/208:16:022
3318366992618,5cyclictest420-21avahi-daemon08:11:042
3318365992618,5cyclictest3325754-21unixbench-2d07:31:251
3318365992618,5cyclictest0-21swapper/108:25:011
331836499262,20cyclictest3434934-21ssh11:21:130
3318364992618,6cyclictest3349692-21timerwakeupswit08:51:210
331836499261,6cyclictest171rcu_preempt08:06:140
3318366992518,4cyclictest3325845-21unixbench_singl07:31:252
3318366992518,4cyclictest3318369-21systemd-run07:10:022
331836499251,19cyclictest3419722-21ntpq10:56:110
331836499251,19cyclictest2534392-21cupsd07:11:130
3318364992418,4cyclictest3339231-21sed08:16:190
331836699233,15cyclictest3349408-21ps08:51:162
3318365992317,4cyclictest1001-21mta-sts-daemon08:51:161
3318365992317,3cyclictest0-21swapper/107:45:011
3318364992318,3cyclictest151ktimers/007:40:570
3318366992216,3cyclictest0-21swapper/208:25:592
3318365992216,3cyclictest0-21swapper/108:01:141
3318364992217,2cyclictest0-21swapper/007:10:020
3318364992213,5cyclictest3412832-21/usr/sbin/munin10:46:060
331836799215,8cyclictest0-21swapper/309:11:093
3318364992112,7cyclictest0-21swapper/007:36:040
331836799203,9cyclictest0-21swapper/312:21:123
331836799203,9cyclictest0-21swapper/310:16:073
331836799203,9cyclictest0-21swapper/310:16:073
331836799202,6cyclictest0-21swapper/307:26:073
331836799201,14cyclictest0-21swapper/307:46:103
331836799201,11cyclictest0-21swapper/309:36:133
3318365992011,6cyclictest3347647-21ls08:46:051
331836799194,8cyclictest0-21swapper/308:06:083
331836799193,9cyclictest0-21swapper/310:56:073
331836799193,7cyclictest0-21swapper/307:51:093
331836799193,10cyclictest0-21swapper/311:21:083
331836799192,9cyclictest0-21swapper/309:46:083
331836799192,10cyclictest0-21swapper/311:01:093
331836799192,10cyclictest0-21swapper/309:31:093
331836799184,8cyclictest0-21swapper/310:51:153
331836799184,8cyclictest0-21swapper/310:31:103
331836799184,8cyclictest0-21swapper/310:11:093
331836799184,8cyclictest0-21swapper/308:16:033
331836799183,9cyclictest0-21swapper/311:51:063
331836799183,7cyclictest0-21swapper/309:41:063
331836799183,6cyclictest0-21swapper/309:17:113
331836799182,9cyclictest0-21swapper/310:21:093
331836799182,9cyclictest0-21swapper/310:21:093
331836799182,8cyclictest0-21swapper/307:21:083
331836799182,7cyclictest0-21swapper/309:06:133
331836799173,8cyclictest0-21swapper/312:01:093
331836799173,8cyclictest0-21swapper/307:45:023
331836799173,6cyclictest0-21swapper/310:41:103
331836799173,6cyclictest0-21swapper/310:41:103
331836799172,9cyclictest0-21swapper/312:11:073
331836799172,9cyclictest0-21swapper/311:41:103
331836799172,9cyclictest0-21swapper/311:36:063
331836799172,9cyclictest0-21swapper/310:36:073
331836799172,9cyclictest0-21swapper/310:36:073
331836799172,9cyclictest0-21swapper/309:51:153
331836799172,8cyclictest0-21swapper/310:26:173
331836799172,7cyclictest0-21swapper/312:30:033
331836799171,8cyclictest0-21swapper/308:26:073
331836799164,4cyclictest0-21swapper/308:41:153
331836799163,7cyclictest0-21swapper/312:16:083
331836799162,9cyclictest0-21swapper/311:46:133
331836799162,9cyclictest0-21swapper/311:31:063
331836799162,8cyclictest0-21swapper/311:56:083
331836799162,8cyclictest0-21swapper/310:01:083
331836799162,8cyclictest0-21swapper/309:21:113
331836799162,8cyclictest0-21swapper/309:00:013
331836799162,10cyclictest0-21swapper/309:56:153
331836799161,7cyclictest0-21swapper/308:01:103
331836799161,7cyclictest0-21swapper/307:56:103
331836799154,6cyclictest0-21swapper/309:26:143
331836799153,8cyclictest0-21swapper/312:36:033
331836799153,7cyclictest0-21swapper/311:26:023
331836799153,7cyclictest0-21swapper/311:26:023
331836799153,7cyclictest0-21swapper/307:16:103
331836799153,7cyclictest0-21swapper/307:11:113
331836799152,8cyclictest0-21swapper/312:26:093
331836799152,8cyclictest0-21swapper/308:21:093
331836799152,7cyclictest0-21swapper/308:11:103
331836799151,9cyclictest0-21swapper/311:16:123
331836799151,9cyclictest0-21swapper/311:11:093
331836799143,6cyclictest0-21swapper/308:36:083
331836799142,8cyclictest0-21swapper/312:06:093
331836799141,8cyclictest0-21swapper/310:50:023
331836799141,7cyclictest0-21swapper/307:31:033
331836799141,6cyclictest0-21swapper/309:01:093
331836799134,5cyclictest0-21swapper/310:06:043
331836799131,7cyclictest0-21swapper/311:06:083
331836799122,8cyclictest0-21swapper/307:10:023
331836799121,6cyclictest0-21swapper/308:31:103
331836799112,5cyclictest0-21swapper/308:51:033
331836799102,6cyclictest0-21swapper/308:46:143
331836799101,6cyclictest0-21swapper/307:36:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional