You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 00:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon May 04, 2026 12:43:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4113037996044,13cyclictest93497-21kernelversion12:05:410
4113039995545,6cyclictest4157103-21systemd-run09:20:022
4113039995545,6cyclictest4157103-21systemd-run09:20:022
4113037995344,5cyclictest8976-21cron10:20:010
4113039995243,5cyclictest4187385-21cat10:00:032
4113039995243,5cyclictest4187385-21cat10:00:032
4113039995224,25cyclictest4152676-21sh09:14:212
4113038995243,6cyclictest104433-21cron12:20:011
4113039995130,17cyclictest4162930-21unixbench_multi09:25:592
411303799499,32cyclictest58139-21ssh11:20:530
4113039994842,3cyclictest0-21swapper/211:35:542
4113039994839,6cyclictest64726-21systemd-run11:30:012
4113039994838,5cyclictest36861-21systemd-run10:55:012
4113039994837,7cyclictest4180693-21/usr/sbin/munin09:50:472
4113039994730,13cyclictest0-21swapper/211:20:522
4113039994637,6cyclictest0-21swapper/211:05:512
4113037994627,10cyclictest12350irq/32-eth009:10:480
411303999453,8cyclictest81960-21ssh11:50:542
4113039994537,5cyclictest37535-21aten_r2power_vo10:55:382
4113039994534,7cyclictest420-21avahi-daemon12:12:132
4113038994537,5cyclictest6633-21switchtime10:15:581
4113038994535,6cyclictest120324-21grep12:40:011
411303999442,13cyclictest3304446-21cups-browsed11:10:482
4113038994433,5cyclictest0-21swapper/109:25:461
4113039994328,11cyclictest0-21swapper/209:40:012
4113039994326,14cyclictest0-21swapper/210:10:562
4113038994335,5cyclictest4153027-21cron09:15:011
4113038994335,4cyclictest1051-21mta-sts-daemon11:15:281
411303899432,28cyclictest77844-21ssh11:45:481
4113037994335,5cyclictest421-21dbus-daemon07:40:010
4113037994333,6cyclictest2294-21ssh10:10:480
411303999426,14cyclictest428-21mta-sts-daemon08:55:452
4113039994229,9cyclictest54440-21switchtime11:16:012
411303999422,17cyclictest42151-21ssh11:00:492
4113038994236,3cyclictest0-21swapper/110:05:591
4113038994232,7cyclictest4149036-21sh09:10:011
4113037994216,20cyclictest74037-21ssh11:40:560
411303999414,19cyclictest3304446-21cups-browsed09:30:452
411303999413,10cyclictest4130385-21ntpq08:05:462
411303999412,8cyclictest113211-21df12:30:392
4113039994122,15cyclictest76715-21latency_hist11:45:022
4113038994134,4cyclictest84539-21cron11:55:011
4113038994131,7cyclictest261-21systemd-journal10:26:201
411303899412,31cyclictest50140-21ssh11:10:501
411303999403,8cyclictest14334-21ntpq10:25:512
411303999403,11cyclictest101772-21ssh12:15:492
411303999403,10cyclictest18220-21ssh10:30:472
4113039994024,12cyclictest4131037-21kworker/u8:0-xprtiod08:20:002
411303999402,10cyclictest89827-21ssh12:00:482
411303999402,10cyclictest89827-21ssh12:00:482
4113039994019,18cyclictest439-21systemd-logind07:50:012
4113039994018,19cyclictest0-21swapper/212:20:492
4113039994018,19cyclictest0-21swapper/212:20:492
411303999401,15cyclictest30237-21ssh10:45:502
411303999401,14cyclictest112406-21awk12:30:002
4113038994029,7cyclictest420-21avahi-daemon12:00:491
4113038994029,7cyclictest420-21avahi-daemon12:00:491
411303999398,5cyclictest4142380-21sshd08:45:472
411303999393,12cyclictest3304441-21cupsd08:40:482
411303999392,9cyclictest65960-21ssh11:30:482
4113039993929,6cyclictest0-21swapper/208:00:012
411303999392,12cyclictest439-21systemd-logind07:30:012
4113039993917,17cyclictest0-21swapper/210:25:022
4113039993914,5cyclictest0-21swapper/211:55:402
4113039993914,22cyclictest26615-21timerandwakeup10:41:002
4113038993931,3cyclictest0-21swapper/109:20:591
411303899392,27cyclictest3304446-21cups-browsed08:15:531
4113037993932,4cyclictest4189075-21head10:01:000
411303999383,10cyclictest4188454-21ssh10:00:482
4113039993829,6cyclictest4117558-21systemd-run07:25:012
4113039993829,3cyclictest0-21swapper/210:15:402
411303999382,25cyclictest4173740-21ssh09:40:482
411303999382,16cyclictest78007-21ssh11:45:542
4113039993819,16cyclictest4131037-21kworker/u8:0-xprtiod08:10:552
4113039993814,2cyclictest0-21swapper/210:05:512
411303999381,17cyclictest4158390-21ssh09:20:492
411303899384,29cyclictest105716-21ssh12:20:471
411303899384,29cyclictest105716-21ssh12:20:471
4113038993833,2cyclictest0-21swapper/109:20:011
4113038993833,2cyclictest0-21swapper/109:20:011
4113038993830,5cyclictest4180039-21sh09:50:371
4113038993829,5cyclictest97510-21kernelversion12:10:421
4113037993832,4cyclictest14358-21ssh10:25:520
4113037993831,4cyclictest261-21systemd-journal10:55:470
4113037993831,3cyclictest0-21swapper/009:50:470
4113037993827,4cyclictest4192085-21kernelversion10:05:460
4113037993817,14cyclictest151ktimers/009:20:500
411303999376,7cyclictest4125507-21/usr/sbin/munin07:50:382
411303999373,8cyclictest93730-21ntpq12:05:442
411303999372,15cyclictest4143919-21ntpq08:50:462
411303999371,16cyclictest22241-21ssh10:35:492
4113038993731,3cyclictest0-21swapper/110:10:491
4113038993729,5cyclictest1-21systemd10:45:011
4113038993729,4cyclictest0-21swapper/107:55:461
4113038993725,9cyclictest4168897-21ssh09:35:021
4113037993726,8cyclictest119188-21sshd12:37:470
4113037993723,8cyclictest85955-21sh11:55:530
411303799372,28cyclictest46214-21ssh11:05:530
411303799371,28cyclictest151ktimers/008:40:490
411303999367,8cyclictest421-21dbus-daemon07:40:022
411303999364,5cyclictest4116027-21munin-run07:20:002
411303999364,5cyclictest4116027-21munin-run07:20:002
411303999363,9cyclictest4128959-21ntpq08:00:492
4113039993627,6cyclictest4137135-21latency_hist08:30:022
4113039993627,6cyclictest4137135-21latency_hist08:30:022
411303999362,10cyclictest117173-21/usr/sbin/munin12:35:382
4113039993611,2cyclictest0-21swapper/209:45:442
4113038993628,5cyclictest420-21avahi-daemon12:28:011
4113038993628,4cyclictest4126533-21kthreadd07:55:011
4113038993627,5cyclictest42104-21ssh11:00:471
4113038993625,7cyclictest0-21swapper/109:40:511
411303899361,27cyclictest69901-21ssh11:35:471
4113037993630,3cyclictest0-21swapper/010:46:000
4113037993629,4cyclictest105911-21proc_pri12:20:530
4113037993629,4cyclictest105911-21proc_pri12:20:530
4113039993528,4cyclictest4123464-21unixbench_singl07:41:032
411303999352,11cyclictest4119890-21ntpq07:30:492
4113039993516,16cyclictest0-21swapper/208:40:012
411303899356,20cyclictest73900-21ssh11:40:501
4113038993527,5cyclictest17777-21sort10:30:391
4113037993527,5cyclictest20916-21cron10:35:010
4113037993525,7cyclictest4146009-21munin-plugin-st09:00:010
4113037993515,16cyclictest0-21swapper/009:20:030
4113037993515,16cyclictest0-21swapper/009:20:030
4113037993513,12cyclictest151ktimers/007:25:490
411303899344,24cyclictest85793-21ssh11:55:471
4113038993427,4cyclictest24897-21cron10:40:001
4113038993426,6cyclictest1055-21mta-sts-daemon08:50:481
4113038993426,5cyclictest4132540-21systemd-run08:15:011
4113038993425,6cyclictest420-21avahi-daemon12:34:491
4113038993425,3cyclictest0-21swapper/110:55:511
4113038993424,8cyclictest4114750-21/usr/sbin/munin07:15:441
4113038993424,8cyclictest4114750-21/usr/sbin/munin07:15:441
4113038993424,7cyclictest4117540-21cut07:25:011
4113038993422,9cyclictest261-21systemd-journal11:07:471
411303799349,18cyclictest12350irq/32-eth011:35:470
4113037993429,3cyclictest0-21swapper/012:05:000
4113037993429,3cyclictest0-21swapper/012:05:000
4113037993427,4cyclictest42517-21threads11:00:580
4113037993424,7cyclictest0-21swapper/010:35:400
411303799341,25cyclictest4166420-21ssh09:30:500
411303999334,10cyclictest4113982-21ntpq07:10:542
411303999334,10cyclictest4113982-21ntpq07:10:542
4113039993321,9cyclictest4135316-21timerwakeupswit08:20:582
411303999331,13cyclictest4146951-21ntpq09:00:522
411303999331,11cyclictest4149023-21cut09:10:012
4113038993324,6cyclictest4120515-21idleruntime-cro07:35:011
4113038993324,4cyclictest0-21swapper/111:25:451
4113038993323,7cyclictest34125-21ntp_kernel_pll_10:50:471
4113038993322,8cyclictest65901-21ntp_kernel_err11:30:461
4113038993322,8cyclictest60716-21cut11:25:011
4113038993310,4cyclictest0-21swapper/109:00:541
4113037993325,5cyclictest104433-21cron12:20:010
4113037993324,5cyclictest4177396-21mailstats09:45:550
4113037993323,7cyclictest4115364-21ntp_kernel_err07:15:460
4113037993323,7cyclictest4115364-21ntp_kernel_err07:15:460
411303799332,27cyclictest54108-21ssh11:15:510
4113037993321,5cyclictest114182-21cat12:30:590
4113037993317,13cyclictest4138408-21unixbench_multi08:30:570
4113038993223,6cyclictest3304446-21cups-browsed10:46:141
4113037993226,4cyclictest97691-21sh12:10:450
4113037993225,4cyclictest4165067-21systemd-run09:30:010
4113037993225,4cyclictest12350irq/32-eth012:25:510
4113037993224,4cyclictest4128545-21fschecks_count08:00:400
411303799321,26cyclictest4173686-21ssh09:40:460
411303799320,22cyclictest34141-21ssh10:50:470
411303899315,19cyclictest4169648-21ssh09:35:401
4113038993123,4cyclictest0-21swapper/109:45:471
4113038993121,7cyclictest10049-21latency10:20:431
4113038993117,11cyclictest4121331-21needreboot07:35:441
4113037993126,2cyclictest0-21swapper/009:55:460
4113037993126,2cyclictest0-21swapper/009:55:460
4113037993125,4cyclictest4113036-21cyclictest07:40:440
4113037993118,9cyclictest0-21swapper/010:41:000
4113038993024,4cyclictest4113036-21cyclictest07:40:521
4113038993022,5cyclictest4137553-21fschecks_time08:30:391
4113038993021,6cyclictest4134913-21sshd08:20:471
4113038993018,9cyclictest261-21systemd-journal10:02:471
411303799307,7cyclictest171rcu_preempt08:20:520
4113037993023,5cyclictest3304446-21cups-browsed11:27:500
4113037993023,3cyclictest0-21swapper/009:10:010
4113037993022,6cyclictest4124340-21needreboot07:45:450
4113037993022,5cyclictest80595-21ssh11:50:010
4113037993015,11cyclictest0-21swapper/011:10:470
4113037993015,10cyclictest151ktimers/011:50:510
411303799301,23cyclictest659-21snmpd11:33:480
411303899292,23cyclictest93815-21ssh12:05:471
4113038992913,12cyclictest261-21systemd-journal08:40:471
4113037992923,4cyclictest4172538-21munin-plugin-st09:40:010
4113037992910,16cyclictest420-21avahi-daemon08:15:530
4113039992820,5cyclictest4137247-21/usr/sbin/munin08:30:412
4113038992820,5cyclictest3304446-21cups-browsed08:01:131
4113038992820,4cyclictest0-21swapper/107:45:491
4113037992822,3cyclictest0-21swapper/008:35:530
4113037992821,5cyclictest10168-21needreboot10:20:450
4113037992820,5cyclictest4128000-21cron08:00:010
4113038992722,2cyclictest0-21swapper/109:00:011
4113038992721,3cyclictest0-21swapper/110:00:011
4113038992721,3cyclictest0-21swapper/110:00:011
4113038992721,3cyclictest0-21swapper/107:15:011
4113038992721,3cyclictest0-21swapper/107:15:011
411303899270,2cyclictest171rcu_preempt08:45:521
4113037992720,4cyclictest4126468-21unixbench_singl07:50:570
4113038992620,3cyclictest1-21systemd08:40:021
4113038992620,3cyclictest0-21swapper/108:25:361
4113038992620,3cyclictest0-21swapper/108:25:361
411303799264,14cyclictest428-21mta-sts-daemon08:45:490
4113037992619,4cyclictest4129823-21aten_r2power_en08:05:370
4113037992612,3cyclictest4132039-21proc_pri08:10:530
411303799260,21cyclictest659-21snmpd08:50:450
4113039992517,5cyclictest1055-21mta-sts-daemon07:10:012
4113038992519,4cyclictest4113036-21cyclictest07:30:031
4113037992516,6cyclictest0-21swapper/008:30:000
4113037992516,6cyclictest0-21swapper/008:30:000
4113037992417,4cyclictest1055-21mta-sts-daemon09:05:020
411303899234,3cyclictest0-21swapper/108:05:471
4113038992318,2cyclictest0-21swapper/107:10:011
4113037992316,5cyclictest548-21gdbus07:30:580
4113037992312,9cyclictest151ktimers/007:20:460
4113037992217,3cyclictest151ktimers/007:11:020
4113037992217,3cyclictest151ktimers/007:11:020
411304099190,16cyclictest0-21swapper/307:10:003
4113037991811,5cyclictest4103394-21kworker/u8:7+rpciod07:10:010
411304099173,10cyclictest0-21swapper/311:10:483
411304099171,12cyclictest0-21swapper/310:20:523
411304099171,11cyclictest0-21swapper/311:20:513
411304099171,11cyclictest0-21swapper/310:40:473
411304099171,11cyclictest0-21swapper/310:30:473
411304099171,11cyclictest0-21swapper/309:55:483
411304099171,11cyclictest0-21swapper/309:55:483
411304099171,11cyclictest0-21swapper/308:20:483
411304099171,11cyclictest0-21swapper/307:50:493
411304099171,11cyclictest0-21swapper/307:20:503
4113040991710,5cyclictest0-21swapper/308:40:493
411304099170,11cyclictest0-21swapper/309:05:513
411304099162,10cyclictest0-21swapper/311:00:473
411304099162,10cyclictest0-21swapper/310:35:493
411304099161,11cyclictest0-21swapper/312:25:463
411304099161,11cyclictest0-21swapper/312:10:483
411304099161,11cyclictest0-21swapper/311:35:503
411304099161,11cyclictest0-21swapper/311:25:453
411304099161,11cyclictest0-21swapper/311:15:493
411304099161,11cyclictest0-21swapper/310:55:493
411304099161,11cyclictest0-21swapper/310:15:483
411304099161,11cyclictest0-21swapper/309:30:513
411304099161,11cyclictest0-21swapper/309:25:463
411304099161,11cyclictest0-21swapper/309:10:483
411304099161,11cyclictest0-21swapper/309:00:533
411304099161,11cyclictest0-21swapper/308:45:493
411304099161,11cyclictest0-21swapper/308:30:453
411304099161,11cyclictest0-21swapper/308:15:453
411304099161,11cyclictest0-21swapper/308:10:473
411304099161,11cyclictest0-21swapper/308:00:463
411304099161,11cyclictest0-21swapper/307:55:453
411304099161,11cyclictest0-21swapper/307:45:523
411304099161,11cyclictest0-21swapper/307:25:493
411304099161,11cyclictest0-21swapper/307:15:493
411304099161,11cyclictest0-21swapper/307:15:493
411304099161,10cyclictest0-21swapper/308:50:423
411304099160,12cyclictest0-21swapper/311:40:493
411304099160,12cyclictest0-21swapper/308:25:513
411304099160,12cyclictest0-21swapper/308:25:513
411304099154,8cyclictest0-21swapper/310:50:463
411304099151,11cyclictest0-21swapper/312:15:533
411304099151,11cyclictest0-21swapper/311:45:473
411304099151,11cyclictest0-21swapper/311:30:463
411304099151,11cyclictest0-21swapper/310:45:533
411304099151,11cyclictest0-21swapper/310:06:033
411304099151,11cyclictest0-21swapper/309:45:473
411304099151,11cyclictest0-21swapper/309:35:463
411304099151,11cyclictest0-21swapper/309:15:513
411304099151,11cyclictest0-21swapper/309:15:513
411304099151,11cyclictest0-21swapper/307:40:443
411304099151,10cyclictest0-21swapper/312:35:453
411304099151,10cyclictest0-21swapper/312:30:473
411304099151,10cyclictest0-21swapper/312:20:463
411304099151,10cyclictest0-21swapper/312:20:463
411304099151,10cyclictest0-21swapper/310:00:463
411304099151,10cyclictest0-21swapper/307:35:473
411304099151,10cyclictest0-21swapper/307:30:533
411304099150,11cyclictest0-21swapper/312:05:503
411304099150,11cyclictest0-21swapper/311:50:483
411304099150,11cyclictest0-21swapper/310:25:463
411304099150,11cyclictest0-21swapper/310:10:503
411304099150,11cyclictest0-21swapper/309:50:493
411304099150,11cyclictest0-21swapper/307:10:503
411304099150,11cyclictest0-21swapper/307:10:503
411304099141,10cyclictest0-21swapper/311:55:423
411304099141,10cyclictest0-21swapper/311:05:373
411304099141,10cyclictest0-21swapper/309:40:453
411304099141,10cyclictest0-21swapper/309:20:033
411304099141,10cyclictest0-21swapper/308:35:453
411304099141,10cyclictest0-21swapper/308:05:463
411304099140,11cyclictest0-21swapper/312:00:393
411304099140,11cyclictest0-21swapper/312:00:393
411304099140,10cyclictest0-21swapper/308:55:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional