You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 09:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Sun May 10, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70779912381229,6cyclictest0-21swapper/119:25:101
70769912381213,6cyclictest0-21swapper/019:25:060
70779912091178,24cyclictest0-21swapper/120:00:151
7076997411,735cyclictest21471-21fschecks_time20:00:150
69442578532,31sleep00-21swapper/019:24:100
66052566522,30sleep10-21swapper/119:20:371
141092880,8sleep0707699cyclictest19:40:200
707699572,5cyclictest13612-21ntp_states22:30:240
707699568,5cyclictest3579-21/usr/sbin/munin20:40:010
707699564,9cyclictest32633-21memory21:55:210
707699551,24cyclictest16051-21ls19:45:210
707699542,14cyclictest15255-21iostat22:35:180
7076995412,5cyclictest29953-21iostat00:40:180
707699541,16cyclictest2114-21taskset00:51:470
707699539,5cyclictest0-21swapper/021:05:170
707699532,13cyclictest7380-21iostat23:40:180
7076995312,5cyclictest0-21swapper/019:52:520
707699529,7cyclictest13083-21wc23:55:200
707699528,5cyclictest23865-21mailstats20:05:250
707699522,14cyclictest15380-21grep00:00:290
7076995213,4cyclictest0-21swapper/019:36:150
7076995211,5cyclictest0-21swapper/023:20:120
707699516,4cyclictest0-21swapper/021:25:210
707699514,8cyclictest19627-21ntp_states21:20:250
707699512,10cyclictest0-21swapper/000:45:310
707699511,6cyclictest4621-21grep22:05:290
7076995116,5cyclictest26001-21unixbench_singl20:10:290
707699511,18cyclictest2401-21NetworkManager21:42:210
707699511,18cyclictest2401-21NetworkManager21:42:210
707699511,15cyclictest18732-21/usr/sbin/munin22:45:150
707699511,15cyclictest16862-21/usr/sbin/munin22:40:140
707699511,12cyclictest19612-21runrttasks00:13:160
7076995110,5cyclictest3303-21df_inode23:30:150
707699507,6cyclictest3286-21runrttasks23:14:510
707699505,9cyclictest9860-21ntp_states22:20:250
707699503,16cyclictest6851-21grep20:45:300
707699502,16cyclictest9895-21/usr/sbin/munin20:55:180
707699502,16cyclictest30067-21munin-node21:50:090
7076995016,6cyclictest15742-21sort21:10:220
7076995014,6cyclictest9388-21sort23:45:220
7076995012,5cyclictest1674-21grep23:25:220
707699501,16cyclictest32417-21cut20:30:110
707699494,16cyclictest11558-21python23:50:270
707699492,15cyclictest22780-21/usr/sbin/munin21:30:130
707699492,15cyclictest2225-21dbus-daemon22:25:550
707699492,14cyclictest3286-21runrttasks00:15:260
707699492,14cyclictest27526-21/usr/sbin/munin00:35:120
7076994915,6cyclictest3-21ksoftirqd/000:26:150
707699491,16cyclictest8432-21gzip20:50:270
707699491,16cyclictest4893-21munin-node23:35:100
707699484,8cyclictest5850-21iostat_ios22:10:200
707699482,15cyclictest26191-21/usr/sbin/munin00:30:190
707699482,15cyclictest24711-21/usr/sbin/munin21:35:130
707699482,15cyclictest22645-21/usr/sbin/munin00:20:250
7076994814,5cyclictest4424-21memory20:40:220
7076994812,6cyclictest29699-21runrttasks23:15:070
707699481,16cyclictest16588-21/usr/sbin/munin00:05:160
7076994811,6cyclictest0-21swapper/022:55:120
707699481,15cyclictest12289-21/usr/sbin/munin21:00:280
707699474,8cyclictest9348-21memory19:30:030
707699474,8cyclictest31264-21ntp_states20:25:250
707699474,8cyclictest28489-21diskstats21:45:150
707699474,7cyclictest26950-21diskstats20:15:140
707699474,7cyclictest26950-21diskstats20:15:140
707699472,14cyclictest1426-21/usr/sbin/munin22:00:110
707699463,8cyclictest17911-21python21:15:290
707699462,7cyclictest0-21swapper/020:20:070
707699462,15cyclictest26612-21/usr/sbin/munin23:05:210
707699454,9cyclictest24676-21iostat_ios23:00:190
707699451,14cyclictest19961-21sshd19:55:240
707699422,14cyclictest7726-21/usr/sbin/munin22:15:200
140032400,27sleep10-21swapper/119:40:171
7077993425,5cyclictest17033-21awk00:05:251
264202341,5sleep126424-21ntp_states00:30:241
107382341,29sleep110739-21cron22:25:001
35322331,28sleep13657-21df22:05:131
707799324,4cyclictest81rcu_preempt00:53:321
707799321,19cyclictest12574-21seq22:29:301
707799313,15cyclictest0-21swapper/121:20:311
7077993117,11cyclictest22-21ksoftirqd/122:50:241
303002311,26sleep130305-21irqstats23:15:211
707799301,15cyclictest3201-21cron22:05:001
253862301,5sleep10-21swapper/123:00:491
707799295,4cyclictest81rcu_preempt20:05:151
707799295,4cyclictest81rcu_preempt19:49:201
707799295,4cyclictest40250irq/92-i91520:20:171
707799294,16cyclictest0-21swapper/119:33:101
707799293,5cyclictest40250irq/92-i91523:25:131
7077992914,10cyclictest986-21grep23:25:011
707799291,3cyclictest81rcu_preempt22:13:001
7077992910,6cyclictest40250irq/92-i91500:10:241
239292291,5sleep10-21swapper/121:31:361
195152291,5sleep10-21swapper/122:45:301
180252291,5sleep10-21swapper/122:42:271
138922291,5sleep10-21swapper/123:57:291
76232281,23sleep17672-21ps23:40:251
73112281,5sleep10-21swapper/120:49:511
707799287,5cyclictest81rcu_preempt00:40:241
707799286,4cyclictest81rcu_preempt21:41:111
707799286,4cyclictest81rcu_preempt21:41:111
707799284,8cyclictest31030-21iostat_ios20:25:201
707799284,8cyclictest25075-21diskstats20:10:131
707799284,4cyclictest40250irq/92-i91521:15:501
707799283,19cyclictest14616-21diskstats00:00:151
7077992815,7cyclictest30363-21diskstats21:50:121
707799281,4cyclictest81rcu_preempt22:58:401
7077992812,11cyclictest31750-21fschecks_time00:45:161
61892281,5sleep10-21swapper/123:35:431
44692281,5sleep10-21swapper/123:32:201
30922281,5sleep10-21swapper/120:35:291
291722281,5sleep10-21swapper/100:39:571
257622281,5sleep10-21swapper/121:36:101
214432281,5sleep10-21swapper/100:17:481
205902281,5sleep10-21swapper/119:57:201
163152281,5sleep10-21swapper/121:10:401
141652281,5sleep10-21swapper/122:31:331
12952281,5sleep10-21swapper/120:32:161
7077992718,5cyclictest12843-21grep19:35:291
707799271,4cyclictest81rcu_preempt21:25:201
707799271,12cyclictest13607-21fschecks_time21:05:171
707799270,4cyclictest81rcu_preempt23:14:011
707799269,5cyclictest40250irq/92-i91523:50:301
707799266,8cyclictest11565-21gdbus20:41:051
707799265,4cyclictest81rcu_preempt00:20:221
707799264,4cyclictest81rcu_preempt22:19:551
707799263,9cyclictest2695-21snmpd20:51:071
7077992617,5cyclictest10391-21cron23:50:001
7077992616,6cyclictest27274-21uname20:15:221
7077992616,6cyclictest27274-21uname20:15:211
707799261,11cyclictest29022-21ntp_states21:45:251
707799261,11cyclictest15550-21grep22:35:261
273942261,5sleep10-21swapper/123:07:121
254042261,5sleep10-21swapper/100:29:471
186302261,5sleep10-21swapper/119:51:281
106882261,5sleep10-21swapper/120:55:591
7077992516,5cyclictest12486-21grep21:00:281
707799251,10cyclictest513-21swap21:55:271
7076992517,5cyclictest3-21ksoftirqd/022:51:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional