You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 07:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Aug 25, 2026 00:42:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
256488799526,35cyclictest2605203-21ssh21:16:061
2564886995235,14cyclictest2587382-21cron20:25:010
2564886995235,14cyclictest2587382-21cron20:25:010
2564887994941,5cyclictest2665003-21/usr/sbin/munin22:55:011
2564887994941,5cyclictest2665003-21/usr/sbin/munin22:55:011
2564888994742,2cyclictest0-21swapper/200:00:022
2564887994438,3cyclictest0-21swapper/121:40:011
2564887994438,3cyclictest0-21swapper/119:25:011
2564887994435,6cyclictest2686404-21systemd-run23:30:021
2564887994435,6cyclictest1-21systemd00:30:011
2564888994337,3cyclictest2708484-21kworker/u8:7-xprtiod00:15:012
2564887994335,5cyclictest2608804-21unixbench_multi21:21:131
2564887994235,4cyclictest2695522-21sh23:45:001
2564887994230,8cyclictest1-21systemd22:20:021
2564886994235,5cyclictest744035-21cupsd22:41:000
2564886994233,7cyclictest2702239-21latency_hist00:00:030
2564888994131,6cyclictest439-21systemd-logind23:31:082
2564887994133,5cyclictest2680368-21latency_hist23:20:021
2564886994130,8cyclictest2713302-21latency_hist00:20:020
2564888994032,5cyclictest421-21dbus-daemon00:30:562
2564887994034,3cyclictest0-21swapper/122:30:011
2564887994032,5cyclictest2722980-21aten_r2power_fr00:35:501
256488799400,34cyclictest2696606-21ssh23:47:401
2564886994034,4cyclictest567-21gdbus22:59:010
2564886994033,5cyclictest2641108-21sh22:15:510
2564886994033,4cyclictest2680856-21sh23:20:510
2564886994029,8cyclictest2680266-21sendmail23:20:010
2564888993930,5cyclictest2719344-21cron00:30:012
2564887993932,4cyclictest0-21swapper/121:26:021
2564887993929,7cyclictest2644797-21needreboot22:20:591
2564886993933,4cyclictest2705347-21idleruntime-cro00:05:010
2564886993933,4cyclictest12650irq/32-eth023:06:010
2564886993932,4cyclictest2575373-21cron19:45:010
2564886993931,5cyclictest1-21systemd21:00:010
2564888993829,4cyclictest0-21swapper/221:56:112
2564888993825,9cyclictest2600882-21idleruntime-cro21:10:012
2564888993823,4cyclictest171rcu_preempt21:15:222
2564887993830,5cyclictest2713242-21munin-plugin-st00:20:011
2564887993830,5cyclictest2587380-21cron20:25:011
2564887993830,5cyclictest2587380-21cron20:25:011
2564886993826,9cyclictest2725432-21cron00:40:010
2564888993730,4cyclictest2646718-21cron22:25:012
2564888993729,5cyclictest2705325-21cron00:05:012
2564888993729,5cyclictest2675879-21grep23:11:132
2564888993729,5cyclictest2671149-21sh23:05:022
2564888993728,6cyclictest744038-21cups-browsed22:08:522
2564888993728,6cyclictest420-21avahi-daemon23:06:472
2564888993726,8cyclictest2593378-21latency_hist20:45:012
2564886993730,5cyclictest420-21avahi-daemon22:13:160
2564886993729,5cyclictest420-21avahi-daemon23:49:000
2564888993632,2cyclictest0-21swapper/222:15:032
2564888993630,3cyclictest0-21swapper/219:15:022
2564888993628,5cyclictest694-21cron00:20:012
2564888993628,5cyclictest2633296-21unixbench_singl22:01:162
2564888993628,4cyclictest0-21swapper/220:46:032
2564888993627,6cyclictest2724064-21grep00:36:122
2564888993627,5cyclictest0-21swapper/222:45:022
2564888993626,8cyclictest2621822-21sshd21:43:232
2564888993626,8cyclictest2621822-21sshd21:43:232
2564887993630,3cyclictest0-21swapper/123:40:011
2564887993630,3cyclictest0-21swapper/123:40:011
2564887993624,9cyclictest2594190-21needreboot20:45:581
2564886993629,4cyclictest2573902-21systemd-run19:40:010
2564888993530,2cyclictest0-21swapper/220:10:012
2564888993528,3cyclictest0-21swapper/223:26:042
2564888993528,3cyclictest0-21swapper/200:10:022
2564888993527,5cyclictest2611896-21unixbench_singl21:26:112
2564888993527,5cyclictest2567268-21ntp_kernel_pll_19:16:062
256488799353,3cyclictest171rcu_preempt21:11:091
2564887993527,5cyclictest2674156-21/usr/sbin/munin23:10:021
2564887993527,5cyclictest2636012-21mailstats22:06:111
2564887993526,6cyclictest1000-21mta-sts-daemon21:10:021
2564886993523,9cyclictest0-21swapper/023:15:010
2564888993427,4cyclictest2628417-21cron21:55:002
2564888993426,5cyclictest744038-21cups-browsed23:20:202
2564888993426,5cyclictest2591267-21ntp_kernel_pll_20:36:042
2564888993425,7cyclictest265-21systemd-journal19:35:012
2564888993425,6cyclictest421-21dbus-daemon22:58:062
2564888993425,6cyclictest1003-21mta-sts-daemon20:56:052
2564887993427,4cyclictest1001-21mta-sts-daemon00:01:251
256488799340,28cyclictest665-21snmpd20:01:031
256488799340,28cyclictest665-21snmpd20:01:031
2564886993427,4cyclictest2635181-21aten_r2power_vo22:05:530
2564886993423,8cyclictest265-21systemd-journal22:05:010
2564888993326,3cyclictest0-21swapper/221:31:172
2564888993324,5cyclictest420-21avahi-daemon23:42:012
2564888993322,8cyclictest2662910-21kernelversion22:50:562
2564888993322,8cyclictest2662910-21kernelversion22:50:562
2564887993326,4cyclictest2625474-21latency_hist21:50:021
2564887993326,4cyclictest0-21swapper/122:31:051
2564887993324,5cyclictest2631548-21latency_hist22:00:021
2564887993323,6cyclictest421-21dbus-daemon22:42:411
256488799331,27cyclictest2720644-21sh00:31:061
256488699336,24cyclictest2623523-21ssh21:46:030
2564886993328,3cyclictest694-21cron23:05:010
2564886993326,5cyclictest421-21dbus-daemon23:55:020
2564886993326,4cyclictest2604440-21/usr/sbin/munin21:16:060
2564886993325,6cyclictest2645349-21timerwakeupswit22:21:150
2564886993325,5cyclictest420-21avahi-daemon23:30:030
2564886993321,9cyclictest2607982-21kernelversion21:20:570
256488899325,23cyclictest2690755-21ssh23:36:162
256488899325,23cyclictest2690755-21ssh23:36:162
2564888993225,3cyclictest0-21swapper/221:25:022
2564888993224,5cyclictest421-21dbus-daemon19:25:012
2564888993224,5cyclictest2648485-21unixbench_multi22:26:132
2564888993221,7cyclictest2702384-21cups-browsed00:22:072
2564887993226,3cyclictest0-21swapper/100:00:031
2564887993224,5cyclictest2589402-21fschecks_time20:30:571
2564887993224,5cyclictest2575899-21fschecks_count19:45:551
2564887993218,9cyclictest0-21swapper/100:20:581
2564886993226,4cyclictest2709212-21sh00:10:560
2564886993226,4cyclictest2648448-21unixbench-2d22:26:130
2564886993226,3cyclictest0-21swapper/022:51:280
2564886993226,3cyclictest0-21swapper/022:51:280
2564886993225,4cyclictest1002-21mta-sts-daemon21:42:190
2564886993225,4cyclictest1002-21mta-sts-daemon21:42:190
2564886993224,6cyclictest0-21swapper/021:31:130
2564886993224,5cyclictest421-21dbus-daemon21:40:020
2564886993224,5cyclictest2695636-21latency_hist23:45:020
2564886993223,7cyclictest2705823-21/usr/sbin/munin00:05:590
2564886993223,6cyclictest2718094-21sed00:26:150
2564886993221,8cyclictest12650irq/32-eth021:26:000
2564888993124,4cyclictest2577138-21aten_r2power_cu19:50:512
2564888993124,4cyclictest2577138-21aten_r2power_cu19:50:512
2564888993124,3cyclictest0-21swapper/221:36:292
2564887993125,3cyclictest1000-21mta-sts-daemon20:56:081
2564887993125,3cyclictest0-21swapper/123:30:501
2564887993125,3cyclictest0-21swapper/100:06:071
2564887993125,2cyclictest0-21swapper/119:20:011
2564887993124,4cyclictest2584372-21cut20:15:011
2564887993124,4cyclictest1001-21mta-sts-daemon23:04:361
2564887993123,5cyclictest2616207-21cron21:35:011
2564886993125,3cyclictest2653847-21missed_timers22:35:570
2564886993122,7cyclictest2627023-21timerwakeupswit21:51:110
2564886993118,10cyclictest0-21swapper/022:00:010
2564888993024,3cyclictest0-21swapper/223:16:012
2564888993024,2cyclictest0-21swapper/219:40:012
2564888993023,4cyclictest2641221-21aten_r2power_fr22:15:522
2564887993025,3cyclictest0-21swapper/122:36:121
2564887993025,2cyclictest0-21swapper/123:00:001
2564887993024,4cyclictest0-21swapper/120:00:011
2564887993024,4cyclictest0-21swapper/120:00:011
2564887993024,3cyclictest0-21swapper/120:20:011
2564887993023,4cyclictest1001-21mta-sts-daemon21:42:231
2564887993023,4cyclictest1001-21mta-sts-daemon21:42:231
2564887993023,3cyclictest0-21swapper/121:55:011
2564887993022,5cyclictest1-21systemd23:15:021
256488699303,24cyclictest2720566-21ssh00:31:030
256488699302,6cyclictest171rcu_preempt20:36:070
2564886993024,3cyclictest2578555-21latency_hist19:55:020
2564886993024,3cyclictest2578555-21latency_hist19:55:020
2564886993023,5cyclictest421-21dbus-daemon23:30:010
256488699302,22cyclictest2602039-21ntpq21:11:010
2564886993021,6cyclictest2591899-21kworker/u8:10-rpciod20:45:010
2564886993017,10cyclictest265-21systemd-journal22:49:180
2564886993017,10cyclictest265-21systemd-journal22:49:180
256488699301,26cyclictest2714612-21ssh00:21:220
2564888992922,3cyclictest0-21swapper/222:31:062
2564887992923,3cyclictest0-21swapper/119:55:011
2564887992923,3cyclictest0-21swapper/119:55:011
256488799292,21cyclictest2709657-21ssh00:11:071
2564887992921,5cyclictest2592076-21latency_hist20:40:031
256488699292,8cyclictest2650999-21ntpq22:31:030
2564886992921,6cyclictest2594711-21unixbench-2d20:46:130
2564886992920,6cyclictest2676021-21kworker/u8:0-xprtiod23:36:080
2564886992920,6cyclictest2676021-21kworker/u8:0-xprtiod23:36:080
2564886992914,12cyclictest151ktimers/019:21:060
2564886992911,15cyclictest2579914-21latency_hist20:00:010
2564886992911,15cyclictest2579914-21latency_hist20:00:010
2564888992823,2cyclictest0-21swapper/221:45:542
2564888992822,3cyclictest2579905-21kworker/u8:14-xprtiod21:11:092
2564888992822,3cyclictest0-21swapper/223:55:012
2564888992822,2cyclictest0-21swapper/222:36:012
256488899282,21cyclictest2660070-21ssh22:45:592
256488899282,21cyclictest2660070-21ssh22:45:592
2564888992818,7cyclictest2596016-21switchtime20:51:112
2564887992821,4cyclictest1002-21mta-sts-daemon23:53:491
2564887992821,4cyclictest1000-21mta-sts-daemon22:00:241
2564886992823,3cyclictest2580909-21proc_pri20:01:070
2564886992823,3cyclictest2580909-21proc_pri20:01:070
2564886992813,12cyclictest485-21in:imuxsock19:18:050
2564888992718,3cyclictest1003-21mta-sts-daemon23:47:382
2564887992721,2cyclictest0-21swapper/122:45:531
2564887992721,2cyclictest0-21swapper/122:45:531
2564887992720,4cyclictest1003-21mta-sts-daemon21:05:021
2564887992719,5cyclictest420-21avahi-daemon19:10:571
2564887992718,6cyclictest2639215-21timerwakeupswit22:11:111
2564886992720,4cyclictest2570755-21grep19:26:180
2564886992719,5cyclictest2576874-21cut19:50:010
2564888992620,3cyclictest0-21swapper/220:00:002
2564888992620,3cyclictest0-21swapper/220:00:002
2564888992617,5cyclictest2585882-21systemctl20:20:012
2564888992615,7cyclictest2581383-21munin-run20:05:002
2564888992615,7cyclictest2581383-21munin-run20:05:002
2564887992618,5cyclictest2575397-21systemd-run19:45:011
2564887992617,7cyclictest2680756-21/usr/sbin/munin23:21:131
2564887992617,6cyclictest439-21systemd-logind19:30:011
2564886992622,2cyclictest0-21swapper/021:06:150
256488899257,5cyclictest62750lldpd19:45:562
2564888992516,5cyclictest2599406-21systemd-run21:05:012
256488799253,12cyclictest1001-21mta-sts-daemon20:26:051
256488699257,14cyclictest421-21dbus-daemon20:06:010
256488699252,10cyclictest2596223-21unixbench-2d20:51:120
2564886992519,4cyclictest2584368-21munin-run20:15:010
2564886992519,3cyclictest2566443-21latency_hist19:15:020
2564886992518,4cyclictest2599277-21unixbench_multi21:01:140
256488699251,21cyclictest2590374-21cut20:35:000
256488899248,13cyclictest2574575-21sed19:40:572
256488899242,17cyclictest744038-21cups-browsed20:26:012
256488799242,16cyclictest428-21mta-sts-daemon20:06:031
256488799241,17cyclictest665-21snmpd20:41:011
2564886992418,4cyclictest744038-21cups-browsed20:18:300
2564886992415,7cyclictest485-21in:imuxsock19:33:070
256488899237,11cyclictest1002-21mta-sts-daemon20:11:042
256488899233,15cyclictest428-21mta-sts-daemon20:31:092
2564888992317,3cyclictest0-21swapper/219:25:582
2564888992315,6cyclictest2586156-21aten_r2power_cu20:20:512
2564888992315,6cyclictest2586156-21aten_r2power_cu20:20:512
2564887992318,2cyclictest0-21swapper/119:31:121
2564887992317,3cyclictest0-21swapper/119:40:011
2564886992316,4cyclictest0-21swapper/019:10:010
2564887992216,3cyclictest1002-21mta-sts-daemon20:51:131
2564886992211,4cyclictest2587900-21fschecks_count20:25:550
256488999191,8cyclictest0-21swapper/323:41:063
2564888991913,3cyclictest0-21swapper/219:10:022
256488799192,14cyclictest1-21systemd19:10:021
256488999172,6cyclictest0-21swapper/323:21:033
256488999161,7cyclictest0-21swapper/323:06:013
256488999161,7cyclictest0-21swapper/322:36:003
256488999151,7cyclictest0-21swapper/300:22:013
256488999151,6cyclictest0-21swapper/319:21:053
256488999150,6cyclictest0-21swapper/322:31:013
256488999142,6cyclictest0-21swapper/322:26:083
256488999135,6cyclictest0-21swapper/321:50:593
256488999133,7cyclictest0-21swapper/323:57:593
256488999131,7cyclictest0-21swapper/300:06:073
256488999131,6cyclictest0-21swapper/321:20:513
256488999130,6cyclictest0-21swapper/321:36:063
256488999121,7cyclictest0-21swapper/322:55:533
256488999121,7cyclictest0-21swapper/321:25:493
256488999121,7cyclictest0-21swapper/320:11:013
256488999121,6cyclictest0-21swapper/321:56:053
256488999121,6cyclictest0-21swapper/321:41:053
256488999121,6cyclictest0-21swapper/321:41:053
256488999121,6cyclictest0-21swapper/320:36:083
256488999121,5cyclictest0-21swapper/320:45:593
256488999113,5cyclictest0-21swapper/300:26:013
256488999112,6cyclictest0-21swapper/323:31:003
256488999112,6cyclictest0-21swapper/321:06:083
256488999112,6cyclictest0-21swapper/321:01:013
256488999112,5cyclictest0-21swapper/322:16:003
256488999111,7cyclictest0-21swapper/323:36:043
256488999111,7cyclictest0-21swapper/323:36:043
256488999111,7cyclictest0-21swapper/323:01:083
256488999111,7cyclictest0-21swapper/322:21:063
256488999111,7cyclictest0-21swapper/321:46:063
256488999111,7cyclictest0-21swapper/319:11:023
256488999111,6cyclictest0-21swapper/323:15:563
256488999111,6cyclictest0-21swapper/322:45:593
256488999111,6cyclictest0-21swapper/322:45:593
256488999111,6cyclictest0-21swapper/322:41:003
256488999111,6cyclictest0-21swapper/322:10:583
256488999111,6cyclictest0-21swapper/321:16:093
256488999111,6cyclictest0-21swapper/320:26:063
256488999111,6cyclictest0-21swapper/319:51:023
256488999111,6cyclictest0-21swapper/319:51:023
256488999111,6cyclictest0-21swapper/319:26:133
256488999111,6cyclictest0-21swapper/300:30:553
256488999111,6cyclictest0-21swapper/300:00:543
256488999111,5cyclictest0-21swapper/323:10:053
256488999111,5cyclictest0-21swapper/320:51:003
256488999111,4cyclictest0-21swapper/319:45:523
256488999110,5cyclictest0-21swapper/319:41:053
256488999102,5cyclictest0-21swapper/323:53:383
256488999102,5cyclictest0-21swapper/319:31:023
256488999102,5cyclictest0-21swapper/319:16:073
256488999102,5cyclictest0-21swapper/300:10:513
256488999101,6cyclictest0-21swapper/322:06:103
256488999101,6cyclictest0-21swapper/322:00:583
256488999101,6cyclictest0-21swapper/321:31:043
256488999101,6cyclictest0-21swapper/320:01:123
256488999101,6cyclictest0-21swapper/320:01:123
256488999101,6cyclictest0-21swapper/319:56:023
256488999101,6cyclictest0-21swapper/319:56:023
256488999101,6cyclictest0-21swapper/300:20:033
256488999101,5cyclictest0-21swapper/322:50:513
256488999101,5cyclictest0-21swapper/322:50:513
256488999101,5cyclictest0-21swapper/321:10:513
256488999101,5cyclictest0-21swapper/320:40:523
256488999101,5cyclictest0-21swapper/320:16:083
256488999101,5cyclictest0-21swapper/319:36:003
256488999101,5cyclictest0-21swapper/300:35:503
256488999101,4cyclictest0-21swapper/323:25:073
25648899994,3cyclictest0-21swapper/320:21:003
25648899994,3cyclictest0-21swapper/320:21:003
25648899991,5cyclictest0-21swapper/323:50:023
25648899991,5cyclictest0-21swapper/320:55:593
25648899991,5cyclictest0-21swapper/320:30:573
25648899991,5cyclictest0-21swapper/320:05:593
25648899981,4cyclictest0-21swapper/319:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional