You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 16:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri May 08, 2026 12:43:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3535371995239,9cyclictest0-21swapper/010:25:020
3535371995239,9cyclictest0-21swapper/010:25:020
3535371994939,8cyclictest3596572-21cut09:40:420
3535371994934,8cyclictest0-21swapper/011:00:480
3535373994839,5cyclictest3708289-21munin-run12:00:002
3535371994839,4cyclictest0-21swapper/011:35:540
3535371994832,13cyclictest3562394-21latency_hist08:40:010
353537199462,39cyclictest3593093-21ssh09:35:550
3535373994538,4cyclictest3603810-21systemd-run09:50:022
3535373994534,8cyclictest3627959-21sendmail10:20:012
3535372994537,5cyclictest3704299-21systemd-run11:55:011
3535372994537,5cyclictest3704299-21systemd-run11:55:011
3535372994535,7cyclictest3627936-21sendmail10:20:011
3535372994533,7cyclictest0-21swapper/110:05:501
3535371994529,11cyclictest12350irq/32-eth009:30:470
3535371994517,21cyclictest3609147-21kworker/u8:1509:55:490
3535373994436,5cyclictest3641031-21kernelversion10:35:442
353537399442,35cyclictest3653344-21ssh10:50:472
3535371994422,13cyclictest12350irq/32-eth012:25:540
3535373994335,5cyclictest3633537-21/usr/sbin/munin10:25:582
3535372994335,5cyclictest3676211-21ssh11:20:001
3535372994335,5cyclictest3553374-21systemd-run08:10:011
3535372994335,5cyclictest1-21systemd09:40:021
3535372994333,6cyclictest420-21avahi-daemon12:34:071
3535372994333,6cyclictest420-21avahi-daemon12:34:071
3535373994235,4cyclictest1054-21mta-sts-daemon09:10:022
3535373994234,5cyclictest3621822-21unixbench_multi10:11:042
3535372994235,4cyclictest1056-21mta-sts-daemon09:55:511
3535372994232,6cyclictest421-21dbus-daemon11:45:011
3535371994235,5cyclictest1-21systemd11:20:010
3535373994132,5cyclictest3684255-21cron11:30:012
3535373994130,8cyclictest3547364-21systemd-run07:50:012
3535372994132,6cyclictest3652127-21systemd-run10:50:011
3535371994133,5cyclictest3633118-21needreboot10:25:450
3535371994133,5cyclictest3576393-21awk09:15:440
3535371994132,6cyclictest151ktimers/012:20:470
3535371994132,5cyclictest3585394-21unixbench-2d09:26:020
3535371994132,4cyclictest0-21swapper/011:05:530
3535371994132,4cyclictest0-21swapper/011:05:530
3535371994131,7cyclictest0-21swapper/009:50:480
3535371994130,5cyclictest0-21swapper/010:45:490
353537199411,34cyclictest3713654-21ssh12:05:500
353537399403,26cyclictest3733805-21ssh12:30:542
353537399403,26cyclictest3733805-21ssh12:30:542
3535372994033,4cyclictest3607862-21latency_hist09:55:021
3535372994033,3cyclictest0-21swapper/112:00:001
3535371994034,4cyclictest3554836-21sh08:15:010
353537199401,35cyclictest3613205-21ssh10:00:500
3535373993931,5cyclictest516-21in:imuxsock09:20:002
3535373993931,4cyclictest0-21swapper/210:40:522
3535373993929,7cyclictest439-21systemd-logind12:05:012
3535373993929,5cyclictest3609444-21sh09:55:582
3535372993931,5cyclictest3660180-21munin-plugin-st11:00:011
3535372993931,4cyclictest0-21swapper/112:20:011
3535372993931,4cyclictest0-21swapper/108:00:511
3535372993930,6cyclictest3730310-21unixbench_singl12:26:021
3535372993930,6cyclictest261-21systemd-journal07:50:011
3535372993920,13cyclictest421-21dbus-daemon09:15:541
3535371993931,5cyclictest3566861-21systemd-run08:55:010
3535373993830,5cyclictest3640010-21munin-plugin-st10:35:002
3535373993829,6cyclictest420-21avahi-daemon12:36:522
3535372993830,5cyclictest3692404-21latency_hist11:40:021
3535372993830,5cyclictest3542850-21latency_hist07:35:001
3535372993830,5cyclictest3542850-21latency_hist07:35:001
3535372993827,8cyclictest3572424-21latency09:10:441
3535372993827,8cyclictest3572424-21latency09:10:441
3535371993831,4cyclictest3536868-21systemd-run07:15:010
3535371993830,5cyclictest3700969-21aten_r2power_po11:50:390
3535371993830,5cyclictest3700969-21aten_r2power_po11:50:390
3535373993731,3cyclictest0-21swapper/211:15:552
3535373993730,4cyclictest3587612-21ssh09:30:012
3535373993729,5cyclictest421-21dbus-daemon12:20:012
3535372993729,5cyclictest3736988-21aten_r2power_fr12:35:381
3535372993729,5cyclictest3591643-21cron09:35:011
3535372993729,5cyclictest3556356-21systemctl08:20:011
3535372993728,4cyclictest0-21swapper/110:20:551
3535372993728,4cyclictest0-21swapper/110:20:551
3535371993730,3cyclictest0-21swapper/011:40:420
3535371993728,4cyclictest0-21swapper/011:45:560
353537399364,27cyclictest3713620-21ssh12:05:492
353537299363,25cyclictest659-21snmpd10:50:471
3535372993630,3cyclictest0-21swapper/109:10:021
3535372993627,6cyclictest3585446-21grep09:26:021
3535372993625,8cyclictest3613528-21switchtime10:00:591
3535371993630,3cyclictest0-21swapper/012:10:490
3535371993628,5cyclictest3653977-21grep10:51:000
3535371993628,5cyclictest3559373-21systemd-run08:30:010
3535371993626,7cyclictest3542055-21latency07:30:440
3535371993626,7cyclictest3542055-21latency07:30:440
3535371993620,13cyclictest0-21swapper/007:40:000
353537399353,23cyclictest3571356-21diskmemload11:45:502
3535373993528,3cyclictest0-21swapper/211:51:002
3535373993528,3cyclictest0-21swapper/211:51:002
3535373993527,5cyclictest3717506-21sshd12:10:442
3535373993527,5cyclictest3550379-21systemd-run08:00:012
3535373993527,3cyclictest0-21swapper/210:45:512
3535373993525,6cyclictest3629667-21sh10:21:002
3535373993525,6cyclictest3629667-21sh10:21:002
3535373993525,5cyclictest3661792-21mailstats11:00:582
3535372993529,3cyclictest0-21swapper/112:05:011
3535372993528,4cyclictest3581065-21mailstats09:20:581
3535371993529,3cyclictest0-21swapper/012:20:010
3535371993526,6cyclictest3681624-21/usr/sbin/munin11:25:510
3535371993524,8cyclictest3737094-21cpu12:35:390
3535371993522,9cyclictest3600755-21kernelversion09:45:440
353537199352,27cyclictest3645432-21ssh10:40:530
353537399345,19cyclictest428-21mta-sts-daemon08:10:502
353537399344,24cyclictest421-21dbus-daemon08:20:502
3535373993427,4cyclictest1051-21mta-sts-daemon10:01:382
3535373993426,5cyclictest3589185-21mailstats09:30:572
3535373993425,6cyclictest3672233-21systemd-run11:15:012
3535373993423,7cyclictest420-21avahi-daemon11:30:162
353537399341,21cyclictest3689499-21ssh11:35:472
353537299347,21cyclictest3661508-21sh11:00:501
3535372993428,3cyclictest0-21swapper/109:45:391
3535372993427,3cyclictest0-21swapper/110:25:501
3535372993426,5cyclictest3544353-21sendmail07:40:001
3535372993425,7cyclictest3644080-21sh10:40:011
3535371993427,3cyclictest0-21swapper/012:30:530
3535371993427,3cyclictest0-21swapper/012:30:530
3535371993425,6cyclictest3680370-21latency_hist11:25:020
353537399336,17cyclictest428-21mta-sts-daemon08:55:522
3535373993324,6cyclictest548-21gdbus07:50:542
3535373993324,6cyclictest421-21dbus-daemon11:44:452
3535373993322,8cyclictest3543751-21ntp_kernel_pll_07:35:492
3535373993313,13cyclictest3605747-21/usr/sbin/munin09:51:012
353537299333,24cyclictest3697789-21awk11:45:571
3535372993327,3cyclictest0-21swapper/112:20:511
3535372993327,3cyclictest0-21swapper/111:25:381
3535372993326,4cyclictest1055-21mta-sts-daemon12:07:531
3535372993324,6cyclictest421-21dbus-daemon08:45:011
3535372993324,6cyclictest421-21dbus-daemon08:45:011
3535372993321,8cyclictest261-21systemd-journal07:45:001
3535371993325,3cyclictest0-21swapper/008:40:430
3535371993325,3cyclictest0-21swapper/008:40:430
3535373993225,4cyclictest3572042-21aten_r2power_po09:10:392
3535373993225,4cyclictest3572042-21aten_r2power_po09:10:392
3535373993225,3cyclictest0-21swapper/207:20:012
3535373993224,5cyclictest3571356-21diskmemload10:05:432
3535373993224,5cyclictest3551416-21wc08:00:552
3535373993222,5cyclictest0-21swapper/209:43:482
3535373993218,7cyclictest3592378-21cpu09:35:392
3535372993223,7cyclictest3686217-21sh11:31:031
3535371993225,4cyclictest3709175-21ssh12:00:420
3535371993224,5cyclictest3704995-21aten2.4-expect11:55:380
353537399315,22cyclictest3665469-21ssh11:05:522
353537399315,22cyclictest3665469-21ssh11:05:522
353537399313,6cyclictest1055-21mta-sts-daemon07:30:492
353537399313,6cyclictest1055-21mta-sts-daemon07:30:492
353537399313,23cyclictest3677547-21ssh11:20:502
353537399313,19cyclictest3729594-21ssh12:25:472
3535373993125,3cyclictest0-21swapper/208:35:452
3535373993122,4cyclictest0-21swapper/212:21:382
3535373993122,4cyclictest0-21swapper/210:55:402
3535373993115,11cyclictest3581116-21/usr/sbin/munin09:21:002
3535372993125,3cyclictest0-21swapper/111:10:531
3535372993124,3cyclictest0-21swapper/107:15:011
3535372993123,5cyclictest427-21polkitd11:09:311
3535372993123,5cyclictest427-21polkitd11:09:311
3535372993123,5cyclictest2750506-21cups-browsed08:30:441
3535372993122,6cyclictest3596932-21ntp_kernel_err09:40:471
353537299312,23cyclictest3637362-21ssh10:30:531
3535371993124,5cyclictest3685315-21latency11:30:440
3535371993124,5cyclictest2750506-21cups-browsed11:10:150
3535371993124,4cyclictest0-21swapper/007:55:530
3535371993123,4cyclictest0-21swapper/009:20:520
353537399305,15cyclictest428-21mta-sts-daemon08:25:502
3535373993021,7cyclictest3555131-21aten_r2power_en08:15:392
3535372993024,3cyclictest0-21swapper/112:10:491
3535372993023,4cyclictest3538284-21unixbench_singl07:15:581
3535372993023,3cyclictest0-21swapper/110:40:501
3535372993021,5cyclictest3623925-21cron10:15:011
3535372993021,5cyclictest3547805-21cpuspeed07:50:381
3535371993022,5cyclictest3565534-21latency_hist08:50:020
3535371993010,17cyclictest3620466-21/usr/sbin/munin10:11:060
3535373992922,4cyclictest3560755-21unixbench_multi08:30:592
3535373992920,4cyclictest0-21swapper/209:00:512
3535372992922,4cyclictest3557862-21munin-run08:25:011
3535372992921,5cyclictest3568326-21cron09:00:011
3535372992921,5cyclictest0-21swapper/108:40:011
3535371992925,2cyclictest0-21swapper/010:35:540
3535371992923,4cyclictest0-21swapper/010:15:430
3535371992922,5cyclictest1056-21mta-sts-daemon10:55:330
3535371992915,6cyclictest3571058-21switchtime09:05:580
3535373992820,5cyclictest421-21dbus-daemon07:20:502
3535372992822,3cyclictest0-21swapper/108:00:011
353537299282,19cyclictest3677674-21rm11:20:551
3535372992819,6cyclictest3565361-21systemd-run08:50:011
3535371992820,5cyclictest0-21swapper/010:30:390
3535371992816,4cyclictest0-21swapper/010:05:440
353537199281,20cyclictest3572692-21ssh09:10:500
353537199281,20cyclictest3572692-21ssh09:10:500
353537499273,5cyclictest0-21swapper/310:15:483
3535373992721,3cyclictest0-21swapper/208:40:442
3535373992721,3cyclictest0-21swapper/208:40:442
3535373992721,3cyclictest0-21swapper/208:10:012
3535373992720,4cyclictest3540201-21aten_r2power_fr07:25:382
3535373992719,5cyclictest3545864-21munin-plugin-st07:45:002
3535372992721,3cyclictest0-21swapper/108:55:001
3535372992719,5cyclictest3569851-21sh09:05:011
3535371992717,7cyclictest151ktimers/008:55:510
353537499261,8cyclictest0-21swapper/309:07:473
3535371992621,2cyclictest0-21swapper/008:05:480
3535371992620,4cyclictest3543076-21kworker/u8:2-rpciod07:45:010
3535373992515,8cyclictest3536096-21missed_timers07:10:432
3535372992519,3cyclictest0-21swapper/107:25:591
3535372992518,4cyclictest1055-21mta-sts-daemon07:22:191
353537199259,13cyclictest0-21swapper/009:05:010
3535371992518,5cyclictest3538233-21unixbench_multi07:15:580
3535373992414,7cyclictest548-21gdbus08:55:012
3535371992418,3cyclictest1055-21mta-sts-daemon07:55:020
3535371992418,3cyclictest1051-21mta-sts-daemon08:30:390
353537499232,7cyclictest0-21swapper/311:25:553
353537499232,6cyclictest0-21swapper/309:55:493
353537499232,6cyclictest0-21swapper/309:10:503
353537499232,6cyclictest0-21swapper/309:10:503
353537499231,8cyclictest0-21swapper/310:45:493
353537299232,17cyclictest659-21snmpd08:25:491
3535372992314,6cyclictest3554055-21latency08:10:451
353537199239,11cyclictest421-21dbus-daemon07:45:470
353537199231,14cyclictest12350irq/32-eth008:00:510
353537499221,7cyclictest0-21swapper/311:30:383
353537499221,7cyclictest0-21swapper/310:00:563
3535373992213,6cyclictest1-21systemd08:46:442
353537199222,15cyclictest3540741-21ntpq07:25:480
3535371992216,3cyclictest3525541-21kworker/u8:2-xprtiod07:10:020
353537499212,6cyclictest0-21swapper/309:16:023
353537499211,8cyclictest0-21swapper/310:55:503
353537199212,14cyclictest3557268-21ntpq08:20:490
353537499202,8cyclictest0-21swapper/311:20:473
353537499202,5cyclictest0-21swapper/312:30:373
353537499202,5cyclictest0-21swapper/312:30:373
353537199201,14cyclictest3555735-21ntpq08:15:510
353537199201,14cyclictest2750501-21cupsd07:20:490
3535372991913,3cyclictest0-21swapper/107:10:021
353537499182,7cyclictest0-21swapper/311:10:513
353537499181,9cyclictest0-21swapper/312:35:493
353537499181,8cyclictest0-21swapper/311:50:553
353537499181,8cyclictest0-21swapper/311:50:553
353537499172,7cyclictest0-21swapper/310:20:473
353537499172,7cyclictest0-21swapper/310:20:473
353537499172,6cyclictest0-21swapper/310:05:483
353537499171,9cyclictest0-21swapper/309:35:483
353537499171,8cyclictest0-21swapper/311:05:543
353537499171,8cyclictest0-21swapper/311:05:543
353537499171,8cyclictest0-21swapper/308:05:483
353537499171,8cyclictest0-21swapper/307:55:493
353537499171,8cyclictest0-21swapper/307:15:523
353537499171,3cyclictest0-21swapper/312:25:503
3535373991711,4cyclictest1-21systemd07:10:012
353537499162,8cyclictest0-21swapper/310:30:483
353537499161,8cyclictest0-21swapper/311:55:543
353537499161,7cyclictest0-21swapper/312:25:023
353537499152,8cyclictest0-21swapper/311:15:443
353537499152,7cyclictest0-21swapper/312:10:453
353537499152,7cyclictest0-21swapper/309:30:383
353537499151,7cyclictest0-21swapper/308:20:493
353537499143,7cyclictest0-21swapper/312:15:513
353537499143,6cyclictest0-21swapper/309:40:593
353537499141,6cyclictest0-21swapper/308:25:473
353537499134,6cyclictest0-21swapper/310:40:483
353537499133,6cyclictest0-21swapper/310:50:443
353537499133,6cyclictest0-21swapper/310:25:483
353537499132,7cyclictest0-21swapper/311:00:523
353537499131,6cyclictest0-21swapper/312:10:023
353537499122,6cyclictest0-21swapper/312:00:433
353537499122,6cyclictest0-21swapper/309:50:383
353537499122,5cyclictest0-21swapper/310:15:023
353537499122,5cyclictest0-21swapper/307:10:473
353537499121,8cyclictest0-21swapper/311:40:583
353537499121,7cyclictest0-21swapper/309:45:413
353537499121,7cyclictest0-21swapper/309:20:393
353537499113,6cyclictest0-21swapper/308:45:493
353537499112,7cyclictest0-21swapper/307:20:473
353537499112,6cyclictest0-21swapper/311:35:433
353537499112,6cyclictest0-21swapper/310:35:503
353537499111,6cyclictest0-21swapper/307:40:283
353537499103,5cyclictest0-21swapper/308:55:543
353537499102,6cyclictest0-21swapper/309:25:483
353537499102,6cyclictest0-21swapper/307:40:013
353537499101,6cyclictest0-21swapper/311:45:433
353537499101,6cyclictest0-21swapper/307:30:023
353537499101,4cyclictest0-21swapper/307:35:023
353537499101,4cyclictest0-21swapper/307:35:023
35353749993,5cyclictest0-21swapper/308:15:533
35353749992,5cyclictest0-21swapper/308:35:003
35353749991,6cyclictest0-21swapper/308:10:493
35353749991,5cyclictest0-21swapper/308:40:393
35353749991,5cyclictest0-21swapper/308:40:393
35353749991,4cyclictest0-21swapper/308:55:013
35353749991,4cyclictest0-21swapper/308:00:373
35353749991,4cyclictest0-21swapper/307:50:493
35353749991,4cyclictest0-21swapper/307:45:493
35353749982,5cyclictest0-21swapper/308:35:523
35353749981,6cyclictest0-21swapper/309:00:473
35353749971,3cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional