You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 20:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon Aug 03, 2026 12:43:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160299995239,9cyclictest265-21systemd-journal11:50:021
160298995218,28cyclictest12750irq/33-eth009:20:580
160298995218,28cyclictest12750irq/33-eth009:20:580
160298995143,5cyclictest202463-21systemd-run09:20:020
160299995042,5cyclictest287274-21ssh11:40:011
160299995042,5cyclictest170798-21idleruntime-cro07:45:011
160299994924,7cyclictest171rcu_preempt10:55:521
160298994936,10cyclictest322177-21unixbench_multi12:36:030
160300994839,6cyclictest217731-21cron09:45:012
160299994637,6cyclictest211639-21systemd-run09:35:011
160299994637,6cyclictest211639-21systemd-run09:35:011
16030099452,31cyclictest297472-21ssh11:55:502
160299994537,5cyclictest421-21dbus-daemon08:35:011
160300994435,6cyclictest420-21avahi-daemon11:36:262
160299994436,3cyclictest0-21swapper/108:50:011
160299994435,6cyclictest421-21dbus-daemon07:25:451
160300994335,6cyclictest1-21systemd08:20:022
160300994333,6cyclictest420-21avahi-daemon10:19:202
160299994335,5cyclictest187310-21systemd-run08:40:021
160300994233,6cyclictest420-21avahi-daemon12:00:502
160300994233,6cyclictest420-21avahi-daemon12:00:502
16029899423,4cyclictest171rcu_preempt11:50:490
160298994234,5cyclictest237979-21sshd10:16:260
160300994133,5cyclictest170795-21munin-plugin-st07:45:012
160298994127,11cyclictest182799-21munin-plugin-st08:25:010
160299994034,2cyclictest0-21swapper/111:20:011
160299994032,4cyclictest0-21swapper/110:15:521
16029899409,28cyclictest151ktimers/010:50:560
160298994032,5cyclictest320479-21cron12:35:010
160298994030,7cyclictest250881-21sshd10:39:270
160298994027,10cyclictest12650irq/32-eth009:45:550
160298994027,10cyclictest12650irq/32-eth009:45:550
16029899402,13cyclictest300570-21ssh12:00:540
16029899402,13cyclictest300570-21ssh12:00:540
160298993930,7cyclictest222263-21switchtime09:51:020
160300993830,5cyclictest231084-21ntp_kernel_err10:05:482
160300993829,6cyclictest420-21avahi-daemon11:45:582
160300993827,8cyclictest245041-21munin-plugin-st10:30:022
160299993831,4cyclictest231719-21unixbench_singl10:06:021
160298993833,3cyclictest0-21swapper/009:10:500
160298993823,10cyclictest12650irq/32-eth009:25:590
160298993823,10cyclictest12650irq/32-eth009:25:590
16029899382,29cyclictest151ktimers/012:05:560
16029899382,26cyclictest309661-21ssh12:15:560
160300993730,4cyclictest1002-21mta-sts-daemon11:00:562
160300993730,3cyclictest0-21swapper/207:35:502
160300993729,3cyclictest0-21swapper/210:00:532
160299993731,3cyclictest0-21swapper/109:20:011
160299993730,3cyclictest0-21swapper/110:25:011
160299993729,5cyclictest421-21dbus-daemon09:45:021
160299993729,5cyclictest222140-21sendmail_mailst09:50:591
160299993727,7cyclictest694-21cron12:00:011
160298993730,3cyclictest0-21swapper/011:25:510
160298993729,5cyclictest420-21avahi-daemon11:04:410
160300993628,3cyclictest0-21swapper/211:20:012
160300993627,6cyclictest311446-21grep12:20:012
160300993626,6cyclictest420-21avahi-daemon10:47:042
160300993626,6cyclictest420-21avahi-daemon10:47:042
160300993624,9cyclictest258186-21ntp_kernel_err10:50:512
160300993623,6cyclictest3575727-21cups-browsed08:00:592
160299993630,3cyclictest0-21swapper/111:05:521
160299993629,3cyclictest0-21swapper/109:10:011
160299993628,3cyclictest0-21swapper/112:00:501
160299993628,3cyclictest0-21swapper/112:00:501
160298993631,3cyclictest226869-21munin-run10:00:010
160298993628,5cyclictest260972-21if_wlan010:55:460
16029899361,31cyclictest0-21swapper/011:55:500
160300993529,3cyclictest0-21swapper/208:50:012
160300993528,4cyclictest272214-21munin-plugin-st11:15:012
160300993527,5cyclictest214686-21sendmail09:40:002
160300993527,5cyclictest199351-21latency_hist09:15:012
160300993527,3cyclictest0-21swapper/209:25:002
160300993527,3cyclictest0-21swapper/209:25:002
160300993526,6cyclictest3575727-21cups-browsed10:55:512
160300993526,6cyclictest184302-21systemd-run08:30:012
160299993529,3cyclictest308441-21kworker/u8:10-xprtiod12:36:211
160299993529,3cyclictest0-21swapper/110:40:011
160299993528,4cyclictest252498-21mailstats10:40:591
160299993528,4cyclictest252498-21mailstats10:40:591
160299993528,4cyclictest1001-21mta-sts-daemon09:26:341
160299993528,4cyclictest1001-21mta-sts-daemon09:26:341
160299993528,3cyclictest0-21swapper/107:55:011
160299993528,3cyclictest0-21swapper/107:55:011
160299993527,5cyclictest179771-21sh08:15:011
160299993525,6cyclictest281778-21aten_r2power_fr11:30:391
160298993529,3cyclictest0-21swapper/011:40:010
160298993529,3cyclictest0-21swapper/010:06:000
160298993528,4cyclictest190200-21grep08:46:040
160298993527,6cyclictest314826-21ssh12:25:280
160298993524,5cyclictest0-21swapper/009:40:540
160298993523,10cyclictest421-21dbus-daemon07:50:010
160298993523,10cyclictest421-21dbus-daemon07:50:010
160300993427,4cyclictest163283-21munin-plugin-st07:20:012
16029999343,24cyclictest309628-21ssh12:15:551
160299993427,3cyclictest0-21swapper/110:50:011
160299993427,3cyclictest0-21swapper/110:50:011
160299993426,5cyclictest161772-21cron07:15:011
160299993424,8cyclictest193272-21munin-plugin-st09:00:011
160299993424,6cyclictest1003-21mta-sts-daemon12:23:501
160298993428,4cyclictest240188-21ntp_kernel_pll_10:20:550
160298993423,8cyclictest212712-21grep09:35:500
160300993325,5cyclictest318211-21fschecks_count12:30:442
160300993325,5cyclictest296340-21cron11:55:012
160300993325,5cyclictest219041-21grep09:45:572
160300993325,5cyclictest219041-21grep09:45:572
160300993323,7cyclictest958-21sendmail-mta08:05:572
160299993326,4cyclictest167774-21cron07:35:011
160299993325,4cyclictest0-21swapper/112:05:481
160299993324,5cyclictest175313-21systemd-run08:00:011
160299993324,5cyclictest175313-21systemd-run08:00:011
160299993324,4cyclictest0-21swapper/110:10:451
160298993326,4cyclictest1002-21mta-sts-daemon12:21:300
160298993326,3cyclictest0-21swapper/010:30:580
160298993325,5cyclictest3575727-21cups-browsed11:31:070
160298993323,4cyclictest0-21swapper/007:15:510
160300993226,3cyclictest0-21swapper/211:25:012
160300993225,4cyclictest169426-21kworker/u8:2-xprtiod08:00:012
160300993225,4cyclictest169426-21kworker/u8:2-xprtiod08:00:012
160300993224,5cyclictest314460-21cron12:25:012
160300993224,5cyclictest306459-21needreboot12:10:482
160300993224,5cyclictest266938-21fschecks_time11:05:452
160300993224,5cyclictest0-21swapper/208:15:012
16030099322,21cyclictest224936-21ssh09:55:502
160299993227,2cyclictest0-21swapper/109:50:021
160299993227,2cyclictest0-21swapper/109:50:021
160299993226,3cyclictest0-21swapper/110:00:021
160299993224,4cyclictest0-21swapper/111:00:591
160299993224,4cyclictest0-21swapper/109:35:551
160299993221,8cyclictest258590-21switchtime10:51:021
160299993221,7cyclictest196286-21diskmemload11:50:531
160299993219,11cyclictest181369-21latency_hist08:20:021
160298993227,3cyclictest278238-21sh11:25:010
160300993123,5cyclictest1002-21mta-sts-daemon10:25:012
160300993123,3cyclictest0-21swapper/210:35:532
160300993123,2cyclictest0-21swapper/211:40:282
160300993122,6cyclictest172986-21latency07:50:472
160300993122,6cyclictest172986-21latency07:50:472
160300993122,4cyclictest0-21swapper/209:26:012
160300993122,4cyclictest0-21swapper/209:26:012
160300993121,7cyclictest187952-21kernelversion08:40:482
160300993110,16cyclictest322173-21sed12:36:022
160299993123,5cyclictest243691-21unixbench_multi10:26:021
160299993123,4cyclictest175412-21kworker/u8:10-nfsiod08:25:021
160299993122,5cyclictest245573-21telnet10:30:411
160299993122,5cyclictest191776-21grep08:55:011
160298993124,4cyclictest268171-21ssh11:06:420
160298993122,7cyclictest253921-21sshd10:44:280
160298993122,7cyclictest253921-21sshd10:44:280
16029899312,21cyclictest229328-21ssh10:03:030
160298993114,12cyclictest12650irq/32-eth009:00:540
16030099305,19cyclictest421-21dbus-daemon10:10:522
160300993022,5cyclictest166820-21fschecks_time07:30:452
160300993021,6cyclictest566-21gmain10:42:342
160300993021,6cyclictest566-21gmain10:42:342
160300993017,9cyclictest421-21dbus-daemon08:55:562
160299993024,3cyclictest0-21swapper/108:05:011
160299993023,4cyclictest275953-21fschecks_count11:20:441
160299993023,3cyclictest271ktimers/108:40:561
160299993022,5cyclictest421-21dbus-daemon12:35:011
160299993021,6cyclictest316202-21unixbench_singl12:26:031
16029899302,5cyclictest0-21swapper/007:10:510
160298993024,4cyclictest233774-21fschecks_count10:10:440
160298993023,5cyclictest0-21swapper/008:20:010
16029899302,17cyclictest185244-21ntpq08:30:570
16030099299,16cyclictest428-21mta-sts-daemon07:25:562
160300992922,4cyclictest439-21systemd-logind08:55:012
160300992922,4cyclictest202433-21idleruntime-cro09:20:012
160300992922,4cyclictest0-21swapper/211:30:012
160300992922,3cyclictest0-21swapper/210:30:542
160300992919,7cyclictest0-21swapper/209:30:522
160300992919,7cyclictest0-21swapper/209:30:522
160299992923,3cyclictest0-21swapper/107:40:011
160299992922,4cyclictest270859-21unixbench-2d11:11:031
160299992920,5cyclictest279988-21unixbench_singl11:26:031
16029899293,15cyclictest428-21mta-sts-daemon11:42:390
160298992924,2cyclictest0-21swapper/011:20:010
160298992921,5cyclictest420-21avahi-daemon09:00:010
160298992920,7cyclictest265-21systemd-journal10:50:010
160298992920,7cyclictest265-21systemd-journal10:50:010
160298992914,12cyclictest0-21swapper/007:25:470
160300992824,2cyclictest0-21swapper/208:35:012
160300992821,5cyclictest0-21swapper/209:55:022
160300992821,4cyclictest161638-21sed07:11:002
16029999284,13cyclictest1002-21mta-sts-daemon12:10:541
160299992822,3cyclictest0-21swapper/109:20:391
160299992822,3cyclictest0-21swapper/109:20:391
160299992821,3cyclictest0-21swapper/111:45:021
160299992820,6cyclictest229916-21sh10:04:491
160298992819,7cyclictest262345-21kworker/u8:9+nfsiod12:10:500
160298992817,8cyclictest265-21systemd-journal07:40:010
160298992815,11cyclictest265-21systemd-journal08:05:020
160300992720,4cyclictest1000-21mta-sts-daemon07:45:512
160300992720,4cyclictest1000-21mta-sts-daemon07:45:512
160300992720,4cyclictest0-21swapper/212:05:462
160299992721,4cyclictest0-21swapper/109:10:441
160299992720,4cyclictest1001-21mta-sts-daemon08:06:401
16029899279,14cyclictest151ktimers/007:30:530
16029899274,15cyclictest291422-21ssh11:45:500
16029899272,19cyclictest243170-21sh10:25:520
160298992721,4cyclictest1003-21mta-sts-daemon08:10:500
160298992720,4cyclictest188810-21systemd-run08:45:020
160298992718,6cyclictest420-21avahi-daemon09:34:370
160298992718,6cyclictest420-21avahi-daemon09:34:370
16030199264,14cyclictest0-21swapper/308:35:533
160300992621,2cyclictest0-21swapper/207:25:022
160300992620,4cyclictest160297-21cyclictest12:25:472
160300992620,4cyclictest0-21swapper/211:30:452
160300992620,3cyclictest1002-21mta-sts-daemon09:00:502
160298992619,4cyclictest0-21swapper/011:11:030
160298992617,7cyclictest186653-21ntp_kernel_pll_08:35:480
160298992616,8cyclictest195735-21ntp_offset09:05:550
160298992615,8cyclictest173302-21proc_pri07:50:570
160298992615,8cyclictest173302-21proc_pri07:50:570
160298992613,10cyclictest421-21dbus-daemon08:55:020
160300992520,2cyclictest0-21swapper/209:06:032
16030099250,4cyclictest171rcu_preempt08:20:532
160299992520,2cyclictest0-21swapper/107:20:011
160299992518,4cyclictest194639-21unixbench-2d09:01:091
160298992520,3cyclictest3674545-21munin-node07:55:460
160298992520,3cyclictest3674545-21munin-node07:55:460
160298992519,4cyclictest3575727-21cups-browsed07:23:540
16030199243,12cyclictest0-21swapper/311:55:533
160299992419,2cyclictest0-21swapper/107:25:011
160299992415,6cyclictest184278-21cron08:30:011
160298992418,4cyclictest175756-21cpuspeed08:00:430
160298992418,3cyclictest1001-21mta-sts-daemon07:40:380
160300992312,8cyclictest351ktimers/208:35:542
160298992317,4cyclictest183312-21fschecks_count08:25:440
160299992216,3cyclictest0-21swapper/107:45:571
160299992216,3cyclictest0-21swapper/107:45:571
160298992216,4cyclictest160381-21cat07:10:020
16030199213,8cyclictest0-21swapper/310:20:523
16030199213,11cyclictest0-21swapper/311:25:523
16030199213,11cyclictest0-21swapper/309:50:493
160299992113,6cyclictest265-21systemd-journal07:10:011
16030199204,8cyclictest0-21swapper/309:40:583
16030199203,10cyclictest0-21swapper/311:05:443
16030199203,10cyclictest0-21swapper/310:55:513
16030199202,8cyclictest0-21swapper/309:05:513
16030199202,12cyclictest0-21swapper/310:40:523
16030199202,12cyclictest0-21swapper/310:40:523
16030199202,11cyclictest0-21swapper/312:35:533
16030199202,11cyclictest0-21swapper/310:05:503
16030199195,9cyclictest0-21swapper/311:15:543
16030199193,10cyclictest0-21swapper/311:40:553
16030199192,11cyclictest0-21swapper/312:20:013
16030199192,11cyclictest0-21swapper/309:55:553
16030199192,10cyclictest0-21swapper/311:45:583
16030199184,9cyclictest0-21swapper/309:45:533
16030199184,9cyclictest0-21swapper/309:45:533
16030199183,9cyclictest0-21swapper/308:50:013
16030199183,8cyclictest0-21swapper/309:25:553
16030199183,8cyclictest0-21swapper/309:25:553
16030199183,8cyclictest0-21swapper/309:10:533
16030199183,7cyclictest0-21swapper/307:30:573
16030199182,9cyclictest0-21swapper/310:25:503
16030199182,11cyclictest0-21swapper/309:35:503
16030199182,10cyclictest0-21swapper/312:30:523
16030199182,10cyclictest0-21swapper/310:50:573
16030199181,9cyclictest0-21swapper/312:10:423
16030199181,10cyclictest0-21swapper/312:25:533
160300991813,2cyclictest0-21swapper/207:10:022
16030199174,8cyclictest0-21swapper/310:30:573
16030199173,9cyclictest0-21swapper/312:00:443
16030199173,9cyclictest0-21swapper/312:00:443
16030199173,8cyclictest0-21swapper/310:10:523
16030199173,7cyclictest0-21swapper/310:15:513
16030199172,9cyclictest0-21swapper/309:20:573
16030199172,9cyclictest0-21swapper/309:20:573
16030199172,8cyclictest0-21swapper/310:35:443
16030199172,8cyclictest0-21swapper/307:50:513
16030199172,8cyclictest0-21swapper/307:50:513
16030199172,7cyclictest0-21swapper/307:10:493
16030199172,10cyclictest0-21swapper/312:20:493
16030199172,10cyclictest0-21swapper/309:15:523
16030199171,8cyclictest0-21swapper/308:05:503
16030199171,10cyclictest0-21swapper/311:20:503
16030199163,8cyclictest0-21swapper/311:10:503
16030199163,7cyclictest0-21swapper/311:00:413
16030199163,7cyclictest0-21swapper/309:30:453
16030199163,7cyclictest0-21swapper/309:30:453
16030199162,9cyclictest0-21swapper/310:00:433
16030199162,8cyclictest0-21swapper/311:50:393
16030199162,8cyclictest0-21swapper/310:45:443
16030199162,8cyclictest0-21swapper/310:45:443
16030199162,7cyclictest0-21swapper/307:45:543
16030199162,7cyclictest0-21swapper/307:45:543
16030199161,8cyclictest0-21swapper/309:00:503
16030199161,8cyclictest0-21swapper/308:30:533
16030199155,8cyclictest0-21swapper/307:40:483
16030199154,5cyclictest0-21swapper/308:20:563
16030199153,7cyclictest0-21swapper/311:35:443
16030199152,8cyclictest0-21swapper/308:55:503
16030199152,7cyclictest0-21swapper/308:15:023
16030199151,8cyclictest0-21swapper/312:05:413
16030199151,8cyclictest0-21swapper/311:30:393
16030199151,7cyclictest0-21swapper/307:15:503
16030199145,6cyclictest0-21swapper/307:20:533
16030199142,7cyclictest0-21swapper/308:30:013
16030199142,6cyclictest0-21swapper/308:50:483
16030199142,6cyclictest0-21swapper/307:25:503
16030199141,7cyclictest0-21swapper/308:00:503
16030199141,7cyclictest0-21swapper/307:55:553
16030199141,7cyclictest0-21swapper/307:55:553
16030199132,6cyclictest0-21swapper/308:15:493
16030199132,6cyclictest0-21swapper/307:35:503
16030199121,6cyclictest0-21swapper/308:40:563
16030199112,7cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional