You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 03:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Sun Jun 16, 2024 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
377791499132120,5cyclictest0-21swapper/019:12:320
37779179911891,21cyclictest231ktimers/119:12:311
3777918998249,20cyclictest836-21crond23:25:002
3777918998146,28cyclictest311ktimers/219:12:292
3777918997356,13cyclictest0-21swapper/221:25:012
377791899661,7cyclictest0-21swapper/220:15:172
377791499571,39cyclictest0-21swapper/019:50:010
3777917995644,8cyclictest3806215-21apt-key21:50:011
3777914995520,29cyclictest14-21rcu_preempt22:10:020
377791799538,20cyclictest3826783-21/usr/sbin/munin23:50:191
3777918995138,9cyclictest3803589-21munin-plugin-st21:35:002
3777917995141,6cyclictest3831647-21munin-plugin-st00:19:591
3777914995138,9cyclictest0-21swapper/022:20:010
3777914995138,9cyclictest0-21swapper/022:20:000
3777914995044,4cyclictest131ktimers/020:15:020
3777914995034,11cyclictest0-21swapper/021:40:330
3777917994942,4cyclictest3824049-21munin-plugin-st23:35:001
3777914994942,5cyclictest0-21swapper/019:40:110
3777914994939,5cyclictest21150irq/209-8000000.ethernet22:55:230
3777914994939,5cyclictest21150irq/209-8000000.ethernet22:55:220
3777914994836,7cyclictest3793458-21latency_hist20:35:000
3777914994834,9cyclictest0-21swapper/021:35:320
377791499482,43cyclictest3834187-21grep00:30:320
377791499481,42cyclictest0-21swapper/022:15:010
3777918994734,9cyclictest0-21swapper/221:35:322
377791499471,3cyclictest0-21swapper/019:25:350
3777918994626,11cyclictest0-21swapper/222:15:292
3777918994626,11cyclictest0-21swapper/222:15:292
3777917994629,14cyclictest231ktimers/123:45:131
377791499461,6cyclictest3807264-21cpu21:55:160
3777914994613,25cyclictest0-21swapper/022:35:010
3777918994536,6cyclictest3795152-21munin-plugin-st20:45:002
3777918994526,12cyclictest292-21systemd-journal23:39:592
3777918994511,5cyclictest3791670-21apt-get20:25:022
3777917994532,9cyclictest3781411-21munin-plugin-st19:24:591
3777917994530,9cyclictest0-21swapper/120:10:011
3777917994529,9cyclictest0-21swapper/123:00:331
3777917994529,9cyclictest0-21swapper/100:30:321
377791499452,36cyclictest3805531-21/usr/sbin/munin21:45:150
377791499451,4cyclictest3824407-21sh23:35:240
3777918994428,11cyclictest0-21swapper/222:55:332
3777918994428,11cyclictest0-21swapper/222:55:332
3777917994432,7cyclictest0-21swapper/121:35:001
3777917994424,12cyclictest0-21swapper/100:30:011
377791499443,38cyclictest0-21swapper/021:20:220
3777914994431,10cyclictest0-21swapper/023:15:360
377791499441,2cyclictest0-21swapper/020:50:010
3777918994331,8cyclictest0-21swapper/222:35:352
3777918994330,8cyclictest0-21swapper/222:00:342
3777918994329,9cyclictest0-21swapper/200:00:332
3777917994330,9cyclictest231ktimers/120:00:101
3777914994329,9cyclictest0-21swapper/021:25:320
377791499431,3cyclictest3798572-21cat21:05:000
3777918994230,8cyclictest0-21swapper/223:25:312
3777918994230,8cyclictest0-21swapper/221:40:332
3777917994234,5cyclictest3818137-21sendmail23:00:001
3777917994234,5cyclictest3818137-21sendmail23:00:001
377791499426,6cyclictest12-21ksoftirqd/020:40:010
3777914994233,6cyclictest3832420-21grep00:20:350
3777914994233,4cyclictest0-21swapper/021:10:370
3777914994231,7cyclictest0-21swapper/023:10:290
377791499421,5cyclictest3792551-21sed20:25:300
377791499421,5cyclictest3792551-21sed20:25:300
377791499421,4cyclictest0-21swapper/023:50:150
3777917994129,8cyclictest0-21swapper/121:35:321
3777917994125,10cyclictest0-21swapper/120:10:231
377791499419,26cyclictest0-21swapper/019:10:010
3777914994136,3cyclictest20950irq/251-8000000.ethernet20:00:200
3777914994125,13cyclictest131ktimers/022:50:160
377791499412,4cyclictest3821797-21diskstats23:20:180
377791499411,4cyclictest3834687-21fw_packets00:35:250
377791499411,4cyclictest3834687-21fw_packets00:35:250
377791499411,4cyclictest3795148-21apt20:45:010
377791499411,38cyclictest0-21swapper/000:05:350
377791499411,22cyclictest0-21swapper/020:50:340
3777918994029,8cyclictest0-21swapper/221:50:022
3777918994026,9cyclictest0-21swapper/219:55:262
3777917994029,8cyclictest0-21swapper/123:30:011
3777917994026,8cyclictest0-21swapper/122:45:331
377791799401,32cyclictest231ktimers/119:35:091
3777914994027,9cyclictest0-21swapper/023:40:300
3777914994027,9cyclictest0-21swapper/023:40:290
377791499401,5cyclictest3788810-21/usr/sbin/munin20:05:350
377791499401,4cyclictest3827923-21meminfo23:55:250
377791499401,3cyclictest3826004-21df23:45:180
377791499401,3cyclictest3818594-21/usr/sbin/munin23:00:250
3777918993929,8cyclictest3824048-21munin-plugin-st23:35:002
3777918993929,7cyclictest0-21swapper/200:35:002
3777918993926,8cyclictest0-21swapper/221:00:332
377791899391,3cyclictest0-21swapper/219:50:182
3777917993928,7cyclictest0-21swapper/122:35:361
3777917993928,7cyclictest0-21swapper/100:00:351
3777917993925,8cyclictest0-21swapper/123:15:341
3777917993925,7cyclictest0-21swapper/122:14:591
377791799391,7cyclictest0-21swapper/122:35:011
3777914993928,7cyclictest0-21swapper/020:55:350
377791499392,4cyclictest3798797-21diskstats21:05:210
377791499392,4cyclictest3798797-21diskstats21:05:210
377791499391,4cyclictest3830460-21meminfo00:10:330
377791499391,4cyclictest3807056-21munin-run21:55:000
377791499391,4cyclictest3786434-21uptime19:50:320
377791499391,4cyclictest0-21swapper/000:25:190
377791499391,3cyclictest3819283-21ssh23:05:430
377791499391,3cyclictest3812654-21/usr/sbin/munin22:25:260
377791499391,3cyclictest3802945-21/usr/sbin/munin21:30:300
377791499391,3cyclictest3783059-21/usr/sbin/munin19:30:300
377791499391,3cyclictest3783059-21/usr/sbin/munin19:30:300
377791499391,3cyclictest0-21swapper/022:00:290
3777918993831,4cyclictest167550irq/135-8000000.ethernet-tx200:15:152
3777918993829,3cyclictest3785595-21unixbench_singl19:45:362
3777918993827,7cyclictest0-21swapper/200:05:332
3777917993827,8cyclictest231ktimers/122:25:161
3777917993827,8cyclictest0-21swapper/120:35:301
3777917993826,9cyclictest231ktimers/123:20:131
3777917993825,6cyclictest0-21swapper/120:45:201
3777917993823,8cyclictest0-21swapper/119:25:351
3777914993825,8cyclictest0-21swapper/019:15:330
3777914993825,8cyclictest0-21swapper/019:15:330
377791499381,4cyclictest0-21swapper/000:15:180
377791499381,3cyclictest3814412-21memory22:35:280
377791499381,3cyclictest3787040-21uname19:55:270
377791499381,3cyclictest3780896-21fschecks_time19:20:200
377791499381,2cyclictest3823407-21apt-get23:30:130
3777918993731,4cyclictest167550irq/135-8000000.ethernet-tx223:40:202
3777918993731,4cyclictest167550irq/135-8000000.ethernet-tx223:40:192
3777918993728,7cyclictest0-21swapper/219:30:282
3777918993728,7cyclictest0-21swapper/219:30:282
3777918993725,8cyclictest0-21swapper/222:20:362
3777917993730,4cyclictest3832502-21munin-plugin-st00:25:001
3777917993729,5cyclictest0-21swapper/100:35:351
3777917993729,5cyclictest0-21swapper/100:35:341
3777917993725,8cyclictest0-21swapper/122:15:311
3777917993725,8cyclictest0-21swapper/122:15:311
3777917993725,8cyclictest0-21swapper/120:55:351
377791799371,6cyclictest0-21swapper/120:55:011
3777914993724,8cyclictest0-21swapper/022:45:330
377791499371,4cyclictest0-21swapper/020:25:000
377791499371,3cyclictest3828639-21dropbear00:00:220
377791499371,3cyclictest0-21swapper/022:20:140
377791499371,3cyclictest0-21swapper/021:15:250
377791499371,2cyclictest3822568-21apt-get23:25:120
377791499371,2cyclictest3783292-21apt-get19:35:130
3777918993630,3cyclictest3835124-21sh00:40:012
3777918993630,3cyclictest3835124-21sh00:40:012
3777918993629,4cyclictest167550irq/135-8000000.ethernet-tx200:10:272
3777918993624,9cyclictest0-21swapper/219:35:322
3777918993622,9cyclictest0-21swapper/222:10:272
377791899361,8cyclictest3795966-21sshd20:46:272
377791899361,12cyclictest0-21swapper/220:55:012
3777917993630,4cyclictest14-21rcu_preempt22:24:591
3777914993623,8cyclictest0-21swapper/020:15:190
377791499361,3cyclictest0-21swapper/022:40:120
3777918993525,6cyclictest0-21swapper/222:50:322
3777918993524,7cyclictest0-21swapper/200:00:012
3777918993523,8cyclictest0-21swapper/222:30:302
3777918993517,12cyclictest311ktimers/220:05:152
377791799355,11cyclictest3815582-21kworker/u8:0+ext4-rsv-conversion22:55:011
3777917993530,3cyclictest231ktimers/120:30:131
3777917993528,4cyclictest22-21rcuc/119:20:021
3777917993528,4cyclictest22-21rcuc/119:20:021
3777917993527,4cyclictest0-21swapper/119:30:291
3777917993527,4cyclictest0-21swapper/119:30:291
3777917993526,4cyclictest0-21swapper/121:15:321
3777917993524,8cyclictest0-21swapper/121:20:351
3777917993524,7cyclictest0-21swapper/120:20:321
3777918993421,7cyclictest14-21rcu_preempt21:50:272
3777918993410,15cyclictest3780767-21/usr/sbin/munin19:20:172
3777917993421,10cyclictest231ktimers/120:15:121
377791899339,16cyclictest3812428-21/usr/sbin/munin22:25:222
3777918993327,3cyclictest0-21swapper/223:45:332
3777918993324,6cyclictest0-21swapper/220:10:352
3777918993324,4cyclictest0-21swapper/220:00:272
3777918993322,8cyclictest0-21swapper/200:30:022
377791899332,25cyclictest0-21swapper/220:30:182
3777917993327,4cyclictest231ktimers/121:50:131
3777917993323,6cyclictest3824817-21grep23:35:361
3777917993319,10cyclictest0-21swapper/123:10:311
377791799331,19cyclictest3785825-21/usr/sbin/munin19:50:191
3777918993224,5cyclictest3800092-21unixbench_multi21:10:372
3777918993221,8cyclictest3800404-21/usr/sbin/munin21:15:102
3777918993219,8cyclictest0-21swapper/222:40:332
3777917993223,4cyclictest0-21swapper/100:05:221
3777917993222,7cyclictest0-21swapper/122:00:351
377791799321,4cyclictest0-21swapper/123:45:011
377791799321,4cyclictest0-21swapper/123:45:011
3777917993211,4cyclictest26950irq/343-s-wl18xx21:29:251
3777918993126,4cyclictest0-21swapper/223:00:192
3777918993123,6cyclictest3820862-21/usr/sbin/munin23:15:342
377791899311,4cyclictest3799338-21users21:05:392
377791899311,4cyclictest3799338-21users21:05:382
3777918993110,3cyclictest26950irq/343-s-wl18xx20:25:122
3777918993110,3cyclictest26950irq/343-s-wl18xx20:25:122
3777917993124,4cyclictest14-21rcu_preempt23:05:551
3777917993118,7cyclictest0-21swapper/121:55:351
3777917993116,8cyclictest0-21swapper/119:45:231
377791799311,25cyclictest0-21swapper/119:40:221
3777918993023,5cyclictest3807254-21/usr/sbin/munin21:55:322
3777918993023,4cyclictest3820021-21/usr/sbin/munin23:10:312
3777918993022,6cyclictest311ktimers/219:15:222
3777918993022,6cyclictest311ktimers/219:15:222
3777918993021,5cyclictest0-21swapper/219:40:342
3777918993017,9cyclictest0-21swapper/223:50:192
3777918993016,9cyclictest0-21swapper/223:05:562
3777917993021,7cyclictest231ktimers/120:25:101
3777917993021,7cyclictest231ktimers/120:25:101
3777917993021,6cyclictest3830756-21grep00:10:401
3777918992923,4cyclictest0-21swapper/222:45:112
3777918992920,5cyclictest0-21swapper/220:55:342
3777917992922,5cyclictest292-21systemd-journal21:40:221
3777917992918,8cyclictest0-21swapper/122:05:201
377791799291,14cyclictest0-21swapper/120:44:231
3777918992820,5cyclictest0-21swapper/222:05:152
377791799281,4cyclictest3828256-21cron00:00:011
377791799281,4cyclictest1017146-1kworker/1:2H+kblockd21:08:251
377791799281,4cyclictest1017146-1kworker/1:2H+kblockd21:08:241
377791799281,13cyclictest0-21swapper/121:14:521
377791799281,13cyclictest0-21swapper/121:02:541
3777918992720,4cyclictest0-21swapper/220:40:002
3777918992719,5cyclictest0-21swapper/221:25:192
377791899271,24cyclictest0-21swapper/200:21:572
377791799272,17cyclictest24-21ksoftirqd/119:55:111
3777917992718,7cyclictest231ktimers/122:40:251
3777917992516,6cyclictest0-21swapper/119:10:011
3777918992417,4cyclictest167550irq/135-8000000.ethernet-tx219:25:282
3777918991910,3cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional