You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 13:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Sep 08, 2026 00:42:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
46049995949,5cyclictest0-21swapper/122:16:101
46050995419,4cyclictest171rcu_preempt20:11:082
46049995344,5cyclictest77523-21munin-plugin-st20:55:011
4605099472,35cyclictest1002-21mta-sts-daemon21:21:092
4605099465,33cyclictest153749-21ssh23:06:142
46049994633,10cyclictest138724-21switchtime22:41:201
46050994537,5cyclictest82036-21diskmemload21:41:052
46049994435,5cyclictest1002-21mta-sts-daemon21:39:581
46048994436,5cyclictest57-21kcompactd019:51:090
46048994436,5cyclictest439-21systemd-logind19:50:020
46050994335,5cyclictest265-21systemd-journal00:20:002
46048994323,13cyclictest12650irq/32-eth022:56:090
46048994310,7cyclictest0-21swapper/020:06:080
46050994233,6cyclictest420-21avahi-daemon22:40:132
46049994232,6cyclictest420-21avahi-daemon22:11:011
46049994232,4cyclictest0-21swapper/122:21:131
46049994229,10cyclictest128809-21sh22:26:031
46049994133,4cyclictest0-21swapper/123:16:131
46049994130,7cyclictest186014-21cups-browsed00:32:401
46048994132,6cyclictest2534398-21cups-browsed22:26:150
4604899411,16cyclictest14-21ksoftirqd/019:31:090
46049994033,3cyclictest0-21swapper/123:00:011
46049994032,5cyclictest88212-21sh21:20:011
46049994032,5cyclictest150558-21ntp_kernel_err23:01:061
46049994030,6cyclictest420-21avahi-daemon00:01:301
46049994030,6cyclictest420-21avahi-daemon00:01:301
46050993930,6cyclictest180601-21cpu23:51:032
46050993930,4cyclictest0-21swapper/200:06:052
46050993930,4cyclictest0-21swapper/200:06:052
46049993933,3cyclictest0-21swapper/119:20:011
46049993933,3cyclictest0-21swapper/119:20:011
46049993929,6cyclictest420-21avahi-daemon22:00:561
4605099385,26cyclictest156731-21ssh23:11:132
46050993829,4cyclictest0-21swapper/221:16:132
46050993824,11cyclictest428-21mta-sts-daemon21:36:112
4605099381,27cyclictest162789-21ssh23:21:072
4605099381,27cyclictest162789-21ssh23:21:072
46049993832,3cyclictest0-21swapper/123:45:581
46049993831,3cyclictest0-21swapper/100:06:061
46049993831,3cyclictest0-21swapper/100:06:061
46049993827,8cyclictest169127-21mailstats23:31:151
46049993827,7cyclictest420-21avahi-daemon21:33:341
4604899383,29cyclictest117103-21ssh22:06:120
46048993829,6cyclictest2534392-21cupsd21:44:570
46048993828,7cyclictest1-21systemd20:20:010
46048993827,8cyclictest94034-21sshd21:28:590
46048993825,9cyclictest439-21systemd-logind20:30:010
4605199372,8cyclictest0-21swapper/321:21:153
46050993731,3cyclictest0-21swapper/200:40:012
46050993730,4cyclictest1002-21mta-sts-daemon20:21:102
46050993728,6cyclictest109692-21systemd21:55:022
46050993728,5cyclictest129818-21ssh22:26:222
46049993729,5cyclictest73075-21latency_hist20:40:021
46049993729,5cyclictest137152-21tr22:40:011
46049993728,6cyclictest110809-21needreboot21:56:061
46049993728,5cyclictest1003-21mta-sts-daemon22:10:011
46049993728,5cyclictest0-21swapper/100:20:001
46048993731,4cyclictest98279-21fschecks_time21:36:030
46048993728,6cyclictest186011-21cupsd00:00:020
46048993726,8cyclictest111245-21switchtime21:56:190
46050993628,5cyclictest567-21gdbus19:45:022
46050993626,7cyclictest49031-21/usr/sbin/munin19:20:012
46050993626,7cyclictest49031-21/usr/sbin/munin19:20:012
46050993623,10cyclictest151073-21timerwakeupswit23:01:192
4605099361,29cyclictest165935-21ssh23:26:122
4605099361,29cyclictest132236-21ntpq22:31:082
46049993630,4cyclictest58025-21kworker/u8:5-xprtiod20:41:121
46049993628,5cyclictest79010-21latency_hist21:00:001
46049993628,5cyclictest109664-21munin-plugin-st21:55:011
46048993619,4cyclictest171rcu_preempt22:21:110
4604899361,21cyclictest168796-21kworker/0:1+events_power_efficient23:31:080
4605099356,20cyclictest428-21mta-sts-daemon23:16:152
46050993526,6cyclictest193584-21mailstats00:11:222
46050993526,6cyclictest193584-21mailstats00:11:222
46050993526,5cyclictest83439-21wc21:11:152
46050993525,6cyclictest421-21dbus-daemon22:11:022
46050993522,11cyclictest341rcuc/220:26:102
4605099350,3cyclictest171rcu_preempt22:36:202
46049993528,3cyclictest0-21swapper/100:00:011
46049993527,5cyclictest76043-21systemd-run20:50:011
46049993527,3cyclictest0-21swapper/120:16:111
46049993526,6cyclictest2534398-21cups-browsed22:47:111
46049993526,6cyclictest2534398-21cups-browsed22:47:111
46049993524,8cyclictest207852-21/usr/sbin/munin00:36:181
46048993529,4cyclictest173761-21ssh23:40:010
46048993527,5cyclictest2534398-21cups-browsed20:00:570
46048993525,8cyclictest180440-21aten_r2power_cu23:51:020
4604899352,28cyclictest95711-21ssh21:31:170
46048993522,10cyclictest134089-21sh22:35:010
46048993519,11cyclictest12650irq/32-eth000:31:130
46050993428,3cyclictest0-21swapper/219:55:012
46050993427,4cyclictest67033-21idleruntime-cro20:20:012
46050993427,3cyclictest0-21swapper/222:00:012
46050993426,5cyclictest205305-21latency00:31:072
46050993424,5cyclictest0-21swapper/220:01:092
46050993423,8cyclictest694-21cron23:50:002
4604999347,7cyclictest171rcu_preempt00:26:101
46049993425,6cyclictest85108-21basename21:15:011
46049993425,6cyclictest439-21systemd-logind20:15:011
46048993429,3cyclictest196273-21needreboot00:16:060
46048993428,4cyclictest61014-21cron20:00:010
46048993427,4cyclictest162509-21sh23:21:030
46048993427,4cyclictest162509-21sh23:21:030
46048993422,9cyclictest0-21swapper/000:06:190
46048993422,9cyclictest0-21swapper/000:06:190
46048993421,11cyclictest0-21swapper/023:16:230
4604899341,27cyclictest120058-21ssh22:11:110
46050993326,3cyclictest0-21swapper/222:51:182
46050993324,6cyclictest147483-21ntpq22:56:072
46050993314,3cyclictest171rcu_preempt21:31:122
46049993327,3cyclictest0-21swapper/122:31:121
46049993326,4cyclictest166023-21proc_pri23:26:161
46049993325,4cyclictest1001-21mta-sts-daemon00:10:041
46049993325,4cyclictest1001-21mta-sts-daemon00:10:041
46049993324,5cyclictest153268-21sort23:06:021
46049993319,9cyclictest103581-21latency_hist21:45:031
46048993326,4cyclictest174631-21sort23:41:030
46048993326,4cyclictest174631-21sort23:41:030
46048993326,4cyclictest153251-21fschecks_count23:06:020
46048993326,4cyclictest152493-21latency_hist23:05:020
46048993324,6cyclictest138981-21grep22:41:220
46048993323,7cyclictest186014-21cups-browsed00:40:020
4604899331,25cyclictest89539-21rm21:21:150
46050993224,5cyclictest124925-21latency_hist22:20:012
46050993223,5cyclictest126705-21unixbench-2d22:21:202
46050993222,7cyclictest141763-21switchtime22:46:192
46050993222,7cyclictest141763-21switchtime22:46:192
46049993224,5cyclictest105433-21unixbench_singl21:46:211
4604999322,21cyclictest162823-21ssh23:21:091
4604999322,21cyclictest162823-21ssh23:21:091
46049993221,7cyclictest2534398-21cups-browsed21:22:541
46048993226,3cyclictest0-21swapper/023:26:200
46048993221,9cyclictest0-21swapper/022:40:010
4605099313,22cyclictest104845-21ssh21:46:102
46050993125,3cyclictest0-21swapper/200:00:012
46050993124,4cyclictest1003-21mta-sts-daemon23:38:542
46050993123,5cyclictest199175-21kernelversion00:21:042
46050993122,6cyclictest2534398-21cups-browsed21:29:532
46050993120,8cyclictest72400-21ntp_kernel_pll_20:36:092
46049993124,3cyclictest0-21swapper/123:36:081
46049993123,5cyclictest427-21polkitd20:10:011
46049993123,5cyclictest158510-21grep23:15:011
46048993126,3cyclictest202681-21ps00:26:160
46048993126,2cyclictest0-21swapper/019:15:010
46048993126,2cyclictest0-21swapper/019:15:010
46048993120,7cyclictest421-21dbus-daemon22:51:260
46050993023,3cyclictest0-21swapper/200:26:142
46050993022,5cyclictest187842-21unixbench_singl00:01:212
46050993022,5cyclictest187842-21unixbench_singl00:01:212
46050993022,5cyclictest174557-21cpuspeed23:41:012
46050993022,5cyclictest174557-21cpuspeed23:41:012
46050993021,4cyclictest0-21swapper/219:11:142
46050993021,4cyclictest0-21swapper/219:11:142
46050993020,7cyclictest55035-21sendmail19:40:012
46050993018,4cyclictest168942-21collect223:31:102
46049993024,3cyclictest0-21swapper/120:35:001
4604999302,23cyclictest92671-21ssh21:26:141
46049993014,13cyclictest271ktimers/119:31:111
4604899303,13cyclictest14-21ksoftirqd/019:26:120
46048993025,3cyclictest104551-21kernelversion21:46:040
46048993024,4cyclictest82036-21diskmemload22:01:070
46048993024,3cyclictest0-21swapper/021:11:110
46048993021,7cyclictest265-21systemd-journal20:45:010
46048993020,7cyclictest0-21swapper/020:25:010
46048993019,8cyclictest1-21systemd20:15:010
46048993017,4cyclictest50435-21unixbench_multi19:21:190
46048993015,4cyclictest61785-21kworker/u8:2-xprtiod20:50:020
4604899301,24cyclictest665-21snmpd20:31:110
46048993010,17cyclictest191rcuc/022:16:080
4605099296,6cyclictest171rcu_preempt20:56:082
46050992923,3cyclictest73267-21kworker/u8:3-xprtiod20:41:222
46050992920,6cyclictest50453-21unixbench_multi19:21:192
46050992920,5cyclictest0-21swapper/222:00:582
4605099291,20cyclictest665-21snmpd19:46:152
46049992923,3cyclictest0-21swapper/100:25:011
46049992921,5cyclictest62541-21idleruntime-cro20:05:011
46049992921,5cyclictest61013-21cron20:00:011
46049992921,5cyclictest59457-21unixbench_singl19:51:211
4604899293,12cyclictest82036-21diskmemload00:20:490
46048992924,4cyclictest46047-21cyclictest20:56:080
46048992923,4cyclictest54054-21fschecks_count19:36:020
46048992921,5cyclictest2534398-21cups-browsed21:50:160
46050992818,6cyclictest82022-21cron21:10:002
46049992821,4cyclictest487-21rs:main1
46049992820,5cyclictest80424-21unixbench_multi21:01:221
46049992820,5cyclictest181666-21tail23:51:241
46049992820,4cyclictest0-21swapper/123:43:201
46049992820,4cyclictest0-21swapper/123:43:201
46049992819,5cyclictest0-21swapper/119:26:201
46048992822,3cyclictest77536-21kworker/u8:5-xprtiod21:16:020
46048992822,2cyclictest0-21swapper/000:05:030
46048992822,2cyclictest0-21swapper/000:05:030
46048992821,5cyclictest79640-21if_eth021:01:040
46048992821,5cyclictest173808-21kworker/u8:16-rpciod00:15:010
46048992821,5cyclictest173808-21kworker/u8:16-rpciod00:15:010
4604999272,18cyclictest601-21gmain22:50:091
46049992719,5cyclictest70040-21idleruntime-cro20:30:001
46049992718,5cyclictest1-21systemd19:50:021
46049992714,8cyclictest567-21gdbus19:36:081
4604899279,13cyclictest665-21snmpd20:36:110
46048992723,2cyclictest0-21swapper/023:46:160
46048992719,5cyclictest151ktimers/023:11:160
46048992718,6cyclictest49125-21latency_hist19:20:020
46048992718,6cyclictest49125-21latency_hist19:20:020
4605099263,16cyclictest117019-21sh22:06:092
4605099262,4cyclictest171rcu_preempt19:26:102
4605099262,17cyclictest665-21snmpd20:31:112
46050992618,5cyclictest439-21systemd-logind20:50:012
46049992620,3cyclictest0-21swapper/120:21:031
46049992619,4cyclictest81910-21unixbench_multi21:06:221
46048992618,6cyclictest694-21cron21:10:000
46048992614,9cyclictest0-21swapper/019:45:020
4605099258,10cyclictest351ktimers/220:06:082
46050992519,4cyclictest46047-21cyclictest20:00:012
4604899251,21cyclictest14-21ksoftirqd/022:46:150
4604899251,21cyclictest14-21ksoftirqd/022:46:150
4604899251,18cyclictest665-21snmpd20:51:140
4605099241,9cyclictest171rcu_preempt20:51:142
46050992419,2cyclictest0-21swapper/219:10:012
46049992417,4cyclictest55013-21kworker/u8:0-xprtiod19:43:421
46050992318,2cyclictest0-21swapper/221:01:062
46050992315,5cyclictest52444-21aten2.4-expect19:31:002
46049992212,6cyclictest0-21swapper/119:11:161
46049992212,6cyclictest0-21swapper/119:11:161
46048992215,5cyclictest46061-21unin-run19:10:010
46049992111,6cyclictest567-21gdbus19:10:011
4605199193,7cyclictest0-21swapper/323:36:083
4605199172,9cyclictest0-21swapper/300:16:133
4605199172,8cyclictest0-21swapper/320:41:113
4605199172,7cyclictest0-21swapper/300:06:083
4605199172,7cyclictest0-21swapper/300:06:083
4605199171,8cyclictest0-21swapper/323:11:173
4605199171,7cyclictest0-21swapper/321:01:113
4605199163,8cyclictest0-21swapper/322:11:183
4605199162,9cyclictest0-21swapper/322:51:233
4605199162,8cyclictest0-21swapper/322:16:153
4605199161,9cyclictest0-21swapper/321:28:033
4605199161,3cyclictest0-21swapper/322:41:113
4605199154,8cyclictest0-21swapper/323:26:123
4605199153,8cyclictest0-21swapper/321:00:013
4605199153,7cyclictest0-21swapper/322:01:073
4605199153,6cyclictest0-21swapper/323:56:043
4605199153,6cyclictest0-21swapper/300:31:143
4605199152,6cyclictest0-21swapper/322:21:103
4605199151,8cyclictest0-21swapper/322:36:133
4605199151,7cyclictest0-21swapper/321:06:113
4605199151,6cyclictest0-21swapper/320:11:073
4605199151,3cyclictest0-21swapper/320:51:093
4605199143,6cyclictest0-21swapper/323:41:113
4605199143,6cyclictest0-21swapper/323:41:113
4605199143,6cyclictest0-21swapper/321:46:093
4605199142,8cyclictest0-21swapper/321:40:583
4605199142,7cyclictest0-21swapper/323:31:013
4605199142,7cyclictest0-21swapper/321:56:083
4605199142,7cyclictest0-21swapper/300:26:073
4605199142,7cyclictest0-21swapper/300:11:073
4605199142,7cyclictest0-21swapper/300:11:073
4605199142,5cyclictest0-21swapper/320:06:073
4605199141,8cyclictest0-21swapper/322:56:123
4605199141,8cyclictest0-21swapper/322:46:143
4605199141,8cyclictest0-21swapper/322:46:143
4605199141,7cyclictest0-21swapper/321:36:103
4605199141,7cyclictest0-21swapper/300:36:093
4605199141,6cyclictest0-21swapper/319:11:143
4605199141,6cyclictest0-21swapper/319:11:143
4605199133,7cyclictest0-21swapper/319:56:113
4605199133,5cyclictest0-21swapper/319:20:003
4605199133,5cyclictest0-21swapper/319:20:003
4605199133,4cyclictest0-21swapper/319:21:063
4605199132,7cyclictest0-21swapper/322:10:013
4605199132,7cyclictest0-21swapper/321:51:073
4605199132,7cyclictest0-21swapper/320:16:113
4605199132,7cyclictest0-21swapper/319:40:023
4605199132,6cyclictest0-21swapper/323:00:583
4605199132,6cyclictest0-21swapper/321:31:023
4605199132,6cyclictest0-21swapper/321:15:583
4605199132,6cyclictest0-21swapper/320:21:063
4605199132,6cyclictest0-21swapper/300:01:083
4605199132,6cyclictest0-21swapper/300:01:083
4605199131,8cyclictest0-21swapper/322:31:083
4605199131,7cyclictest0-21swapper/323:20:583
4605199131,7cyclictest0-21swapper/323:20:583
4605199131,7cyclictest0-21swapper/319:51:143
4605199131,6cyclictest0-21swapper/322:25:593
4605199131,6cyclictest0-21swapper/320:31:063
4605199131,6cyclictest0-21swapper/319:46:103
4605199131,6cyclictest0-21swapper/319:31:133
4605199124,5cyclictest0-21swapper/323:46:103
4605199122,6cyclictest0-21swapper/323:51:013
4605199122,6cyclictest0-21swapper/323:16:133
4605199122,6cyclictest0-21swapper/320:40:013
4605199121,7cyclictest0-21swapper/323:05:593
4605199121,7cyclictest0-21swapper/321:10:043
4605199121,7cyclictest0-21swapper/320:30:013
4605199111,7cyclictest0-21swapper/300:20:573
4605199101,5cyclictest0-21swapper/320:01:013
4605199101,5cyclictest0-21swapper/319:26:013
460519993,3cyclictest0-21swapper/320:46:133
460519991,5cyclictest0-21swapper/319:40:553
460519991,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional