You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 14:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Thu Sep 18, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
371977899686,28cyclictest22-21rcuc/119:50:011
3719776996323,7cyclictest0-21swapper/020:30:130
3719776996323,7cyclictest0-21swapper/020:30:130
3719781996016,19cyclictest3737205-21/usr/sbin/munin20:50:232
3719776995849,5cyclictest3735319-21munin-plugin-st20:39:590
371978199548,19cyclictest3727914-21/usr/sbin/munin19:55:192
371977699542,23cyclictest3719771-21cyclictest22:45:010
3719781995332,13cyclictest311ktimers/200:00:102
371978199521,29cyclictest0-21swapper/219:50:012
3719778995242,5cyclictest3759600-21munin-plugin-st23:09:591
3719778995235,9cyclictest0-21swapper/123:15:011
3719781995141,6cyclictest3738582-21grep20:55:292
371977699512,14cyclictest3739662-21gpgv21:05:020
3719778994941,4cyclictest3775081-21latency_hist00:39:591
371977899491,8cyclictest0-21swapper/119:35:011
3719781994830,13cyclictest311ktimers/223:45:142
371977699487,34cyclictest3732676-21grep20:20:290
3719781994727,15cyclictest311ktimers/223:40:142
371977899479,8cyclictest24-21ksoftirqd/120:15:011
3719778994714,16cyclictest22-21rcuc/123:45:011
3719776994736,6cyclictest3754374-21grep22:35:310
3719776994732,10cyclictest0-21swapper/022:10:010
3719776994729,9cyclictest0-21swapper/023:00:200
3719781994634,8cyclictest3774960-21grep00:35:282
3719776994640,4cyclictest0-21swapper/020:55:120
371977699461,5cyclictest0-21swapper/022:25:140
371977699461,11cyclictest0-21swapper/000:15:020
3719778994533,4cyclictest0-21swapper/119:40:211
371977699452,26cyclictest15-21rcuc/019:35:020
3719778994431,6cyclictest0-21swapper/100:15:321
3719778994416,17cyclictest231ktimers/123:35:011
3719776994434,6cyclictest0-21swapper/023:55:120
3719781994329,10cyclictest3735313-21sendmail20:40:002
3719781994325,13cyclictest311ktimers/219:15:142
3719778994324,11cyclictest0-21swapper/123:20:281
3719776994337,4cyclictest3761290-21sendmail23:19:590
3719776994332,8cyclictest1-21systemd23:30:010
3719776994332,8cyclictest1-21systemd23:30:010
3719776994329,8cyclictest0-21swapper/021:55:250
3719776994329,8cyclictest0-21swapper/021:35:000
371978199424,27cyclictest32-21ksoftirqd/220:15:012
3719781994218,18cyclictest32-21ksoftirqd/200:20:192
3719778994229,7cyclictest0-21swapper/123:20:001
3719778994228,8cyclictest3751921-21munin-plugin-st22:25:001
3719778994211,25cyclictest231ktimers/120:35:271
371977699424,35cyclictest0-21swapper/023:45:220
3719776994235,4cyclictest20750irq/251-8000000.ethernet00:25:140
3719776994229,8cyclictest0-21swapper/019:30:000
3719781994130,5cyclictest0-21swapper/223:15:292
3719781994129,9cyclictest3733419-21ptp4l-jitter20:25:272
3719781994128,7cyclictest3771522-21sendmail00:19:592
3719781994119,14cyclictest311ktimers/222:15:152
3719781994114,13cyclictest311ktimers/219:30:152
3719778994132,4cyclictest0-21swapper/120:50:331
3719778994125,9cyclictest0-21swapper/121:40:271
3719778994125,10cyclictest0-21swapper/121:20:191
371977899411,2cyclictest0-21swapper/121:30:001
371977699415,2cyclictest0-21swapper/021:55:020
3719776994135,3cyclictest20750irq/251-8000000.ethernet22:20:160
3719776994127,9cyclictest0-21swapper/023:30:240
371978199406,21cyclictest3754654-21/usr/sbin/munin22:40:192
3719781994031,4cyclictest0-21swapper/222:20:322
3719781994025,12cyclictest311ktimers/222:25:152
3719781994024,11cyclictest311ktimers/220:20:112
3719781994019,15cyclictest311ktimers/220:05:142
3719781994014,13cyclictest311ktimers/221:35:172
3719778994032,5cyclictest231ktimers/121:35:271
3719778994032,4cyclictest0-21swapper/123:55:221
3719778994030,5cyclictest0-21swapper/122:05:301
3719778994024,10cyclictest0-21swapper/120:30:271
3719778994024,10cyclictest0-21swapper/120:30:271
3719778994022,9cyclictest0-21swapper/120:45:001
3719776994029,8cyclictest3774192-21/usr/sbin/munin00:30:310
371977699402,8cyclictest0-21swapper/021:45:000
371977699401,35cyclictest3726039-21grep19:45:000
3719781993931,5cyclictest168450irq/135-8000000.ethernet-tx221:55:212
3719781993926,8cyclictest0-21swapper/219:35:282
3719781993925,6cyclictest0-21swapper/220:45:292
3719781993912,13cyclictest311ktimers/219:10:132
371977899399,2cyclictest0-21swapper/121:20:001
3719778993931,3cyclictest0-21swapper/100:15:021
3719778993922,9cyclictest0-21swapper/122:00:281
3719778993922,6cyclictest0-21swapper/119:15:231
371977899391,4cyclictest0-21swapper/122:45:011
371977899391,2cyclictest0-21swapper/100:10:011
3719776993931,5cyclictest293-21systemd-journal23:40:000
3719776993919,4cyclictest27250irq/343-wl18xx20:15:210
3719776993919,4cyclictest27250irq/343-wl18xx20:15:200
3719781993828,5cyclictest0-21swapper/219:50:242
3719781993827,5cyclictest168450irq/135-8000000.ethernet-tx200:33:152
3719781993822,8cyclictest0-21swapper/222:45:272
3719781993821,11cyclictest311ktimers/221:40:142
3719781993820,10cyclictest0-21swapper/221:00:262
3719778993831,4cyclictest231ktimers/100:35:001
3719778993828,7cyclictest231ktimers/122:45:211
3719778993828,5cyclictest0-21swapper/123:00:001
3719778993827,8cyclictest3751071-21munin-plugin-st22:20:001
3719778993823,5cyclictest0-21swapper/119:20:201
3719776993832,4cyclictest20950irq/209-8000000.ethernet19:20:250
3719776993828,6cyclictest3750180-21grep22:10:300
3719776993824,9cyclictest0-21swapper/022:30:300
3719776993824,9cyclictest0-21swapper/022:30:290
3719776993823,10cyclictest0-21swapper/022:20:000
371977699381,2cyclictest0-21swapper/023:25:010
3719781993729,3cyclictest0-21swapper/200:30:022
3719781993728,4cyclictest0-21swapper/221:17:002
3719781993727,4cyclictest0-21swapper/222:55:302
3719781993721,8cyclictest0-21swapper/223:35:302
371978199371,28cyclictest3756683-21irqstats22:50:232
3719778993729,5cyclictest231ktimers/121:55:241
3719778993729,5cyclictest22-21rcuc/121:30:191
3719778993727,5cyclictest0-21swapper/120:00:271
3719778993725,8cyclictest0-21swapper/123:00:291
371977899371,3cyclictest0-21swapper/123:55:011
371977699376,5cyclictest3760508-21sed23:15:000
3719776993731,3cyclictest0-21swapper/020:05:120
3719776993726,7cyclictest3744825-21grep21:35:300
3719776993726,7cyclictest3740641-21grep21:10:260
371977699372,5cyclictest3748502-21grep22:00:290
3719776993717,4cyclictest0-21swapper/020:55:000
3719776993716,19cyclictest0-21swapper/000:05:160
371977699371,4cyclictest0-21swapper/023:55:000
3719781993629,4cyclictest168450irq/135-8000000.ethernet-tx223:05:152
3719781993626,5cyclictest0-21swapper/221:10:182
3719781993625,7cyclictest311ktimers/219:20:122
3719781993624,8cyclictest0-21swapper/220:00:272
3719781993624,7cyclictest0-21swapper/222:10:302
3719781993622,9cyclictest0-21swapper/221:20:262
3719781993620,8cyclictest0-21swapper/221:45:242
3719781993620,12cyclictest0-21swapper/219:40:192
3719781993616,13cyclictest311ktimers/223:00:172
3719778993629,5cyclictest231ktimers/120:15:131
3719778993629,5cyclictest231ktimers/120:15:131
3719778993625,7cyclictest231ktimers/100:05:011
3719778993621,7cyclictest0-21swapper/100:20:301
371977699364,6cyclictest3771420-21grep00:15:320
371977699362,4cyclictest0-21swapper/021:45:210
371977699362,31cyclictest3742785-21fschecks_time21:25:210
371977699362,30cyclictest3756598-21sh22:50:220
371977699361,4cyclictest0-21swapper/000:25:010
3719776993614,6cyclictest0-21swapper/019:47:200
3719781993525,4cyclictest0-21swapper/220:45:012
3719781993514,14cyclictest311ktimers/200:10:152
371977899354,25cyclictest0-21swapper/121:45:271
3719778993523,6cyclictest22-21rcuc/120:05:291
3719778993522,8cyclictest0-21swapper/119:55:251
3719776993529,4cyclictest0-21swapper/019:15:250
3719776993525,6cyclictest3741451-21grep21:15:300
3719776993519,10cyclictest0-21swapper/020:00:260
371977699351,4cyclictest0-21swapper/022:50:020
371977699351,4cyclictest0-21swapper/019:40:020
371977699351,31cyclictest3728580-21latency_hist20:00:000
3719781993426,4cyclictest168450irq/135-8000000.ethernet-tx200:05:212
3719781993422,8cyclictest0-21swapper/222:35:302
371978199341,27cyclictest0-21swapper/222:05:412
3719778993428,4cyclictest231ktimers/122:50:211
3719778993426,5cyclictest231ktimers/122:30:131
3719778993426,5cyclictest231ktimers/122:30:131
3719778993426,4cyclictest0-21swapper/120:55:181
3719778993424,6cyclictest22-21rcuc/122:25:271
3719778993424,5cyclictest231ktimers/121:00:231
3719778993423,8cyclictest231ktimers/121:10:111
3719778993422,6cyclictest22-21rcuc/122:35:241
371977899341,27cyclictest3772655-21/usr/sbin/munin00:25:201
3719778993411,3cyclictest0-21swapper/119:10:001
3719776993428,4cyclictest20950irq/209-8000000.ethernet20:40:270
3719776993422,8cyclictest3706479-1kworker/0:0H+mmc_complete19:15:000
3719776993416,3cyclictest3759596-21latency_hist23:10:000
3719781993325,5cyclictest3747956-21ssh22:00:162
3719781993323,6cyclictest0-21swapper/223:25:302
3719781993323,6cyclictest0-21swapper/223:25:292
3719781993319,7cyclictest3760096-21meminfo23:10:272
3719781993318,7cyclictest0-21swapper/221:10:012
3719781993318,7cyclictest0-21swapper/221:10:012
371978199331,27cyclictest0-21swapper/221:25:132
371978199331,26cyclictest3767392-21/usr/sbin/munin23:55:192
3719781993312,14cyclictest311ktimers/220:15:152
3719781993312,14cyclictest311ktimers/220:15:152
3719778993324,5cyclictest22-21rcuc/120:25:261
3719778993324,5cyclictest22-21rcuc/120:20:121
3719778993323,6cyclictest3762509-21sh23:25:221
3719778993323,6cyclictest3762509-21sh23:25:221
3719778993323,6cyclictest22-21rcuc/119:10:271
3719778993321,8cyclictest3724819-21cut19:35:241
3719778993319,7cyclictest231ktimers/122:10:191
3719776993327,3cyclictest20950irq/209-8000000.ethernet20:10:120
3719776993326,4cyclictest20950irq/209-8000000.ethernet21:05:040
3719776993326,4cyclictest20950irq/209-8000000.ethernet21:05:040
3719776993325,4cyclictest3768785-21unixbench_multi00:00:250
3719776993320,9cyclictest0-21swapper/020:25:280
3719781993220,8cyclictest0-21swapper/223:30:262
3719778993223,6cyclictest22-21rcuc/119:50:301
3719778993223,5cyclictest22-21rcuc/123:45:281
3719778993222,7cyclictest22-21rcuc/123:35:191
3719776993226,4cyclictest0-21swapper/000:35:290
3719776993225,5cyclictest20950irq/209-8000000.ethernet23:40:270
3719776993222,5cyclictest0-21swapper/021:20:180
371977699321,4cyclictest0-21swapper/019:10:000
371978199312,3cyclictest3766742-21tune2fs23:50:222
371978199311,25cyclictest0-21swapper/223:20:322
3719778993125,4cyclictest3719771-21cyclictest19:25:141
371977699311,7cyclictest3736532-21tune2fs20:45:200
371977699311,25cyclictest3727078-21dpkg19:50:130
3719781993022,4cyclictest168450irq/135-8000000.ethernet-tx221:30:262
3719781993021,5cyclictest3734470-21apt20:35:002
3719781993021,5cyclictest3734470-21apt20:35:002
3719781993013,11cyclictest311ktimers/219:25:112
3719778993014,10cyclictest0-21swapper/120:45:201
371978199291,22cyclictest0-21swapper/222:30:132
371978199291,22cyclictest0-21swapper/222:30:132
3719778992918,6cyclictest231ktimers/121:55:011
371978199281,15cyclictest0-21swapper/221:53:382
3719778992816,6cyclictest22-21rcuc/121:10:021
3719778992816,6cyclictest22-21rcuc/121:10:021
371977699271,2cyclictest3757266-21apt-get22:55:180
3719781992113,3cyclictest3719739-21latency_hist19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional