You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 19:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Wed Aug 19, 2026 12:42:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
372429995547,4cyclictest0-21swapper/110:00:011
372430995442,8cyclictest445084-21ssh10:10:012
372430995442,8cyclictest445084-21ssh10:10:012
37242999525,35cyclictest958-21sendmail-mta11:30:591
372428994840,5cyclictest421-21dbus-daemon10:15:010
372428994840,5cyclictest421-21dbus-daemon10:15:010
372430994639,3cyclictest0-21swapper/211:05:572
37242999462,35cyclictest425021-21ssh09:36:061
372429994537,5cyclictest431614-21grep09:46:121
372429994535,7cyclictest499966-21sh11:40:011
372428994537,5cyclictest393453-21systemd-run08:20:020
372428994535,7cyclictest499937-21idleruntime-cro11:40:010
372430994435,6cyclictest421-21dbus-daemon09:10:012
372428994437,4cyclictest12650irq/32-eth010:36:030
372428994434,3cyclictest0-21swapper/011:50:020
372430994335,5cyclictest530407-21basename12:30:002
372430994335,5cyclictest521253-21cron12:15:012
372430994333,6cyclictest486037-21proc_pri11:16:072
372430994317,19cyclictest421-21dbus-daemon09:36:032
372429994336,4cyclictest466409-21ssh10:45:011
372429994334,5cyclictest416376-21unixbench_singl09:21:111
372430994235,4cyclictest524313-21systemctl12:20:002
372430994235,4cyclictest524313-21systemctl12:20:002
372429994233,5cyclictest476918-21proc_pri11:01:081
372429994232,5cyclictest0-21swapper/112:21:021
372428994235,4cyclictest1-21systemd10:30:010
372430994121,3cyclictest171rcu_preempt07:16:042
372429994135,3cyclictest0-21swapper/109:10:011
372429994134,4cyclictest451161-21ssh10:20:001
372429994133,5cyclictest503025-21ssh11:45:021
372429994133,4cyclictest448143-21kworker/u8:10-xprtiod12:20:001
372429994133,4cyclictest448143-21kworker/u8:10-xprtiod12:20:001
372429994132,5cyclictest513874-21unixbench_multi12:01:131
372429994131,4cyclictest0-21swapper/110:09:491
372429994131,4cyclictest0-21swapper/110:09:491
372428994133,5cyclictest509860-21fschecks_time11:55:540
372430994029,7cyclictest420-21avahi-daemon09:54:592
372429994032,5cyclictest480367-21unixbench_singl11:06:121
372428994029,8cyclictest524301-21latency_hist12:20:020
372430993930,5cyclictest0-21swapper/209:26:002
372429993930,6cyclictest399396-21cron08:40:011
372429993930,4cyclictest0-21swapper/109:31:011
372429993928,9cyclictest414593-21sh09:20:011
372429993927,8cyclictest0-21swapper/109:41:001
372428993933,4cyclictest533574-21latency_hist12:35:020
37242899393,32cyclictest470589-21ssh10:50:560
372428993929,2cyclictest0-21swapper/009:00:000
372430993830,5cyclictest475536-21sh11:00:012
372430993830,5cyclictest391930-21systemd-run08:15:022
372430993829,6cyclictest429987-21latency_hist09:45:022
372430993829,5cyclictest439-21systemd-logind08:30:012
372430993828,6cyclictest535197-21unixbench_multi12:36:102
372430993828,6cyclictest420-21avahi-daemon11:24:292
372430993815,3cyclictest171rcu_preempt07:45:572
372429993830,5cyclictest458292-21missed_timers10:30:551
372429993830,5cyclictest419307-21timerwakeupswit09:26:111
372429993827,8cyclictest488417-21cpu11:20:491
372430993731,3cyclictest0-21swapper/208:20:012
372430993728,5cyclictest527393-21systemd-run12:25:012
372430993727,6cyclictest3758388-21cups-browsed11:55:312
372430993726,7cyclictest1-21systemd11:36:092
372429993730,4cyclictest0-21swapper/107:55:011
372428993731,4cyclictest426810-21munin-run09:40:010
372428993730,4cyclictest387291-21sed07:56:100
372428993730,3cyclictest0-21swapper/012:25:580
372428993727,7cyclictest466413-21cron10:45:010
37242899371,7cyclictest171rcu_preempt12:16:000
37243099364,27cyclictest531550-21ssh12:30:582
372430993629,4cyclictest0-21swapper/210:15:012
372430993629,4cyclictest0-21swapper/210:15:012
372430993629,3cyclictest0-21swapper/209:25:012
372430993629,2cyclictest0-21swapper/212:05:022
372430993628,5cyclictest265-21systemd-journal11:50:012
37242999363,29cyclictest403345-21sshd08:51:011
372429993631,2cyclictest0-21swapper/108:20:011
372429993630,3cyclictest0-21swapper/110:46:011
372429993628,4cyclictest1000-21mta-sts-daemon11:48:321
37242999362,27cyclictest440358-21grep10:01:071
37242999362,27cyclictest440358-21grep10:01:071
372428993626,8cyclictest496550-21sshd11:34:000
372428993623,10cyclictest388916-21cron08:05:010
372430993529,3cyclictest0-21swapper/208:50:012
372430993527,5cyclictest507830-21unixbench_singl11:51:122
372430993527,3cyclictest0-21swapper/209:11:002
37242999353,25cyclictest404822-21sshd08:56:001
372429993527,5cyclictest491877-21missed_timers11:25:591
372429993527,5cyclictest373518-21systemctl07:11:071
372429993526,6cyclictest1002-21mta-sts-daemon10:11:351
372429993526,6cyclictest1002-21mta-sts-daemon10:11:351
372428993529,4cyclictest394999-21latency_hist08:25:020
372428993522,9cyclictest374720-21needreboot07:15:560
37242899352,25cyclictest452401-21ssh10:21:000
37242899351,28cyclictest418962-21ssh09:26:050
372430993427,4cyclictest1000-21mta-sts-daemon10:54:372
372430993427,3cyclictest0-21swapper/210:26:012
372430993426,5cyclictest414549-21cron09:20:012
372430993424,8cyclictest694-21cron11:45:012
372428993424,7cyclictest400230-21needreboot08:40:550
37243099334,24cyclictest440317-21ssh10:01:062
37243099334,24cyclictest440317-21ssh10:01:062
372430993326,3cyclictest0-21swapper/211:31:052
372430993325,5cyclictest3758388-21cups-browsed09:59:002
372430993324,6cyclictest448762-21sh10:15:512
372429993327,3cyclictest0-21swapper/108:50:011
372429993327,3cyclictest0-21swapper/108:26:001
372429993324,5cyclictest528761-21sendmail_mailqu12:26:061
372429993321,9cyclictest421-21dbus-daemon11:55:021
372428993328,3cyclictest0-21swapper/011:50:590
372428993326,4cyclictest487704-21ssh11:20:000
372428993325,5cyclictest482203-21aten_r2power_fr11:10:480
372428993325,5cyclictest474253-21unixbench_multi10:56:120
372428993324,6cyclictest397787-21unixbench_multi08:31:090
372428993319,11cyclictest477628-21ssh11:02:000
372430993226,3cyclictest0-21swapper/207:45:002
372430993225,3cyclictest0-21swapper/211:00:552
372430993225,3cyclictest0-21swapper/210:41:012
372430993223,6cyclictest483029-21mailstats11:11:062
372429993225,5cyclictest516677-21wc12:06:091
372429993224,5cyclictest452212-21missed_timers10:20:551
372429993224,5cyclictest0-21swapper/107:20:011
372428993227,2cyclictest0-21swapper/010:31:130
372428993224,6cyclictest462387-21kworker/u8:2+events_unbound11:06:000
372428993224,5cyclictest519718-21switchtime12:11:100
372428993224,4cyclictest0-21swapper/011:41:010
372428993223,7cyclictest0-21swapper/011:21:110
372428993223,6cyclictest421-21dbus-daemon10:19:450
372428993222,6cyclictest423797-21kworker/u8:15-xprtiod09:46:010
372428993221,3cyclictest14-21ksoftirqd/009:11:010
37243099315,18cyclictest1003-21mta-sts-daemon10:46:022
37243099312,6cyclictest379260-21ntpq07:30:562
372430993119,9cyclictest373179-21missed_timers07:10:552
372429993124,4cyclictest531055-21aten_r2power_vo12:30:501
372429993124,4cyclictest1003-21mta-sts-daemon08:05:211
372429993124,4cyclictest0-21swapper/110:54:171
37242999311,22cyclictest482834-21ssh11:11:001
37242899317,19cyclictest516299-21awk12:05:560
372428993123,6cyclictest416659-21sshd09:22:010
372428993122,7cyclictest265-21systemd-journal10:05:000
372428993122,7cyclictest265-21systemd-journal10:05:000
37242899312,22cyclictest467682-21ssh10:46:030
372428993119,9cyclictest623-21sshd07:31:000
372430993023,4cyclictest406828-21grep09:01:092
372430993023,4cyclictest1001-21mta-sts-daemon08:20:592
372430993022,5cyclictest403475-21sendmail_mailqu08:51:052
372430993022,5cyclictest399407-21idleruntime-cro08:40:012
37243099302,22cyclictest421965-21ssh09:31:022
37243099302,22cyclictest377851-21sshd07:26:002
372430993019,4cyclictest0-21swapper/208:06:012
372430993018,6cyclictest0-21swapper/211:26:052
37243099301,4cyclictest171rcu_preempt10:30:572
372429993025,2cyclictest0-21swapper/108:45:011
372429993023,3cyclictest0-21swapper/112:10:551
372429993022,5cyclictest473861-21proc_pri10:56:071
372429993022,5cyclictest420-21avahi-daemon11:57:221
372429993022,5cyclictest388766-21unixbench-2d08:01:101
372429993022,5cyclictest0-21swapper/112:40:011
37242999302,19cyclictest455440-21ssh10:25:591
37242899306,3cyclictest171rcu_preempt09:00:590
37242899305,3cyclictest171rcu_preempt08:45:590
372428993022,5cyclictest421-21dbus-daemon09:44:420
372428993021,6cyclictest421-21dbus-daemon07:30:010
372428993020,5cyclictest14-21ksoftirqd/007:21:020
372430992922,4cyclictest1003-21mta-sts-daemon12:06:272
37243099292,20cyclictest452545-21ps10:21:062
372430992921,5cyclictest387404-21munin-run08:00:012
372429992923,3cyclictest0-21swapper/109:50:561
372429992922,4cyclictest487712-21idleruntime-cro11:20:001
372429992922,4cyclictest1002-21mta-sts-daemon10:39:141
372429992921,5cyclictest387394-21cron08:00:011
372429992914,4cyclictest171rcu_preempt08:21:001
37242999291,23cyclictest409588-21ssh09:10:581
37242899294,19cyclictest0-21swapper/010:09:510
37242899294,19cyclictest0-21swapper/010:09:510
372428992923,3cyclictest384430-21kworker/u8:9-xprtiod09:15:550
372428992922,4cyclictest527360-21cron12:25:000
372428992921,6cyclictest381452-21sh07:40:010
372428992921,5cyclictest533911-21/usr/sbin/munin12:36:050
372428992921,5cyclictest421-21dbus-daemon07:10:020
372428992916,8cyclictest567-21gdbus09:34:560
372430992819,6cyclictest421-21dbus-daemon09:46:322
372428992823,2cyclictest0-21swapper/011:30:010
372428992821,3cyclictest0-21swapper/012:00:550
372428992820,4cyclictest0-21swapper/009:55:210
372428992818,8cyclictest265-21systemd-journal09:55:020
372428992818,3cyclictest171rcu_preempt08:10:560
372428992817,3cyclictest171rcu_preempt08:36:030
372430992720,4cyclictest404432-21fschecks_time08:55:522
372430992719,6cyclictest1002-21mta-sts-daemon10:38:332
372429992720,4cyclictest0-21swapper/108:35:011
372429992718,6cyclictest383441-21fschecks_count07:45:511
372429992718,5cyclictest377454-21fschecks_time07:25:511
372428992719,5cyclictest3758388-21cups-browsed08:06:040
372430992618,5cyclictest3758388-21cups-browsed08:40:492
372429992620,4cyclictest379476-21sendmail_mailqu07:31:041
372429992618,5cyclictest0-21swapper/108:13:521
372428992619,4cyclictest382258-21netstat07:40:570
372430992519,3cyclictest1003-21mta-sts-daemon08:01:412
372430992518,4cyclictest1000-21mta-sts-daemon07:21:002
372430992512,6cyclictest171rcu_preempt07:51:002
37243099251,18cyclictest381412-21munin-run07:40:012
372429992517,4cyclictest4107820-21kworker/u8:4-xprtiod07:40:001
372429992516,7cyclictest406704-21timerwakeupswit09:01:081
372428992516,7cyclictest403901-21cron08:55:010
372428992514,5cyclictest171rcu_preempt09:05:590
37242899250,22cyclictest0-21swapper/007:45:570
372429992417,5cyclictest0-21swapper/107:25:011
372428992419,2cyclictest0-21swapper/007:50:510
372428992418,3cyclictest373182-21missed_timers07:10:550
372430992317,4cyclictest372427-21cyclictest08:30:492
37242899232,15cyclictest395818-21sshd08:26:000
37243099225,13cyclictest351ktimers/207:10:012
372429992213,6cyclictest381907-21ls07:40:491
372429992113,5cyclictest372433-21systemd-run07:10:011
37243199193,6cyclictest0-21swapper/312:06:003
37243199182,8cyclictest0-21swapper/311:01:003
37243199173,7cyclictest0-21swapper/311:26:043
37243199172,7cyclictest0-21swapper/310:09:473
37243199172,7cyclictest0-21swapper/310:09:473
37243199163,7cyclictest0-21swapper/311:21:013
37243199163,7cyclictest0-21swapper/309:31:003
37243199153,7cyclictest0-21swapper/310:40:573
37243199153,7cyclictest0-21swapper/309:16:043
37243199151,8cyclictest0-21swapper/312:01:083
37243199151,8cyclictest0-21swapper/310:56:013
37243199151,7cyclictest0-21swapper/311:16:013
37243199151,7cyclictest0-21swapper/310:26:013
37243199151,7cyclictest0-21swapper/309:41:053
37243199151,6cyclictest0-21swapper/309:06:023
37243199151,5cyclictest0-21swapper/308:30:583
37243199143,6cyclictest0-21swapper/311:05:573
37243199143,5cyclictest0-21swapper/312:20:583
37243199142,7cyclictest0-21swapper/312:11:063
37243199142,7cyclictest0-21swapper/311:40:583
37243199141,7cyclictest0-21swapper/312:15:593
37243199141,7cyclictest0-21swapper/312:15:593
37243199141,7cyclictest0-21swapper/310:21:053
37243199133,7cyclictest0-21swapper/310:30:593
37243199132,7cyclictest0-21swapper/309:40:013
37243199132,6cyclictest0-21swapper/311:45:593
37243199132,6cyclictest0-21swapper/310:01:063
37243199132,6cyclictest0-21swapper/310:01:063
37243199132,6cyclictest0-21swapper/307:31:013
37243199132,5cyclictest0-21swapper/310:16:023
37243199132,5cyclictest0-21swapper/307:10:593
37243199131,7cyclictest0-21swapper/310:50:513
37243199131,7cyclictest0-21swapper/309:50:553
37243199131,6cyclictest0-21swapper/309:25:533
37243199131,6cyclictest0-21swapper/307:45:573
37243199131,6cyclictest0-21swapper/307:35:593
37243199124,5cyclictest0-21swapper/311:31:013
37243199123,5cyclictest0-21swapper/311:51:043
37243199122,6cyclictest0-21swapper/312:35:553
37243199122,6cyclictest0-21swapper/311:15:013
37243199122,6cyclictest0-21swapper/310:45:583
37243199122,6cyclictest0-21swapper/309:56:003
37243199122,6cyclictest0-21swapper/307:55:013
37243199122,5cyclictest0-21swapper/308:50:583
37243199122,5cyclictest0-21swapper/308:20:013
37243199122,5cyclictest0-21swapper/307:20:013
37243199121,7cyclictest0-21swapper/312:25:543
37243199121,7cyclictest0-21swapper/311:55:503
37243199121,6cyclictest0-21swapper/309:45:553
37243199121,6cyclictest0-21swapper/308:26:003
37243199121,6cyclictest0-21swapper/308:05:013
37243199121,6cyclictest0-21swapper/307:21:043
37243199112,6cyclictest0-21swapper/310:36:043
37243199112,5cyclictest0-21swapper/309:20:473
37243199112,5cyclictest0-21swapper/309:10:493
37243199111,7cyclictest0-21swapper/311:35:573
37243199111,7cyclictest0-21swapper/310:10:493
37243199111,7cyclictest0-21swapper/310:10:493
37243199111,6cyclictest0-21swapper/312:30:483
37243199111,6cyclictest0-21swapper/309:00:513
37243199111,6cyclictest0-21swapper/308:56:003
37243199111,6cyclictest0-21swapper/308:35:573
37243199111,6cyclictest0-21swapper/308:05:563
37243199111,6cyclictest0-21swapper/307:40:573
37243199111,5cyclictest0-21swapper/308:10:573
37243199110,6cyclictest0-21swapper/307:56:053
37243199102,6cyclictest0-21swapper/308:45:573
37243199102,5cyclictest0-21swapper/308:20:583
37243199101,5cyclictest0-21swapper/308:40:523
37243199101,5cyclictest0-21swapper/307:25:583
3724319981,3cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional