You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 14:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon Jul 15, 2024 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62988599143128,8cyclictest0-21swapper/009:16:010
62988599112108,2cyclictest14-21rcu_preempt09:05:000
6298899910569,30cyclictest0-21swapper/209:16:062
629888999657,33cyclictest231ktimers/109:15:531
62988599901,2cyclictest0-21swapper/012:00:010
629885997874,2cyclictest0-21swapper/010:30:010
629885997772,3cyclictest0-21swapper/009:50:000
629889995613,21cyclictest662476-21/usr/sbin/munin10:15:282
629888995622,24cyclictest650561-21apt-config09:10:011
629889995430,17cyclictest0-21swapper/212:05:012
629889995413,36cyclictest906-21avahi-daemon07:55:002
62988999541,18cyclictest0-21swapper/212:25:012
629885995446,4cyclictest20950irq/251-8000000.ethernet10:50:280
629885995430,18cyclictest15-21rcuc/012:20:020
629888995241,8cyclictest669912-21sendmail11:00:001
629888995232,15cyclictest231ktimers/107:10:141
629885995244,3cyclictest638090-21kworker/u8:1+flush-179:9608:25:150
629885995240,8cyclictest651734-21getprofile09:14:550
629885995240,8cyclictest651734-21getprofile09:14:550
629885995238,7cyclictest663115-21cron10:20:000
629889995145,4cyclictest0-21swapper/208:30:012
629889995121,15cyclictest0-21swapper/212:30:122
629885995140,4cyclictest0-21swapper/007:55:350
629888995022,6cyclictest0-21swapper/108:30:021
629888995022,6cyclictest0-21swapper/108:30:021
629885995025,23cyclictest20950irq/251-8000000.ethernet07:50:270
629889994933,10cyclictest0-21swapper/209:00:002
629889994933,10cyclictest0-21swapper/209:00:002
629889994923,13cyclictest0-21swapper/210:55:152
629885994943,3cyclictest0-21swapper/008:15:330
629889994840,4cyclictest662279-21munin-plugin-st10:14:592
629889994832,10cyclictest0-21swapper/207:35:012
629885994837,4cyclictest20950irq/251-8000000.ethernet11:15:010
629885994833,8cyclictest0-21swapper/010:35:330
629885994833,8cyclictest0-21swapper/010:35:330
629889994740,5cyclictest0-21swapper/207:20:002
629889994720,18cyclictest654365-21/usr/sbin/munin09:25:322
629888994737,6cyclictest651734-21getprofile09:14:551
629888994737,6cyclictest651734-21getprofile09:14:551
629888994735,6cyclictest674204-21grep11:20:341
629888994728,13cyclictest231ktimers/110:35:151
629888994728,13cyclictest231ktimers/110:35:151
629885994740,4cyclictest20950irq/251-8000000.ethernet08:45:010
629885994740,3cyclictest20950irq/251-8000000.ethernet10:05:380
629885994739,4cyclictest20950irq/251-8000000.ethernet10:55:170
629885994739,4cyclictest20950irq/251-8000000.ethernet09:30:230
629885994739,4cyclictest20950irq/251-8000000.ethernet09:25:190
629885994739,4cyclictest20950irq/251-8000000.ethernet07:35:260
629885994738,7cyclictest650504-21munin-plugin-st09:10:000
629889994633,9cyclictest0-21swapper/208:45:332
629889994628,11cyclictest632037-21apt-get07:20:162
629889994626,12cyclictest640560-21apt-get08:10:162
629889994626,12cyclictest640560-21apt-get08:10:152
629889994620,14cyclictest0-21swapper/209:10:152
629889994620,14cyclictest0-21swapper/209:10:152
62988599466,5cyclictest14-21rcu_preempt08:35:010
62988599466,5cyclictest14-21rcu_preempt08:35:010
629885994639,4cyclictest20950irq/251-8000000.ethernet11:35:260
629885994639,4cyclictest20950irq/251-8000000.ethernet11:20:240
629885994639,4cyclictest20950irq/251-8000000.ethernet10:45:310
629885994639,4cyclictest20950irq/251-8000000.ethernet09:55:170
629885994639,4cyclictest20950irq/251-8000000.ethernet07:30:170
629885994639,4cyclictest20950irq/251-8000000.ethernet07:15:180
629885994638,4cyclictest20950irq/251-8000000.ethernet12:35:110
629885994638,4cyclictest20950irq/251-8000000.ethernet12:10:100
629885994638,4cyclictest20950irq/251-8000000.ethernet11:10:180
62988599461,4cyclictest0-21swapper/009:40:190
629889994530,10cyclictest0-21swapper/212:15:012
629885994538,4cyclictest20950irq/251-8000000.ethernet11:50:270
629885994538,4cyclictest20950irq/251-8000000.ethernet11:45:250
629885994538,4cyclictest20950irq/251-8000000.ethernet08:35:240
629885994538,4cyclictest20950irq/251-8000000.ethernet07:20:280
62988599451,25cyclictest0-21swapper/010:10:310
629889994431,9cyclictest0-21swapper/211:30:282
629889994421,15cyclictest0-21swapper/210:40:212
629889994419,13cyclictest0-21swapper/210:45:162
629888994437,4cyclictest638667-21run-parts08:00:011
629885994437,4cyclictest20950irq/251-8000000.ethernet11:30:250
629885994437,4cyclictest20950irq/251-8000000.ethernet09:20:250
629885994437,4cyclictest20950irq/251-8000000.ethernet08:05:150
629885994432,8cyclictest0-21swapper/008:55:310
629885994432,8cyclictest0-21swapper/008:55:310
629889994331,7cyclictest679500-21unixbench_multi11:50:322
629889994328,10cyclictest0-21swapper/211:20:342
629889994327,9cyclictest0-21swapper/210:25:322
629889994327,9cyclictest0-21swapper/210:25:322
629889994326,10cyclictest630051-21apt-get07:10:172
629889994319,12cyclictest0-21swapper/211:25:152
629889994314,16cyclictest0-21swapper/208:05:132
629888994336,4cyclictest0-21swapper/110:40:331
629888994331,6cyclictest0-21swapper/109:00:021
629888994331,6cyclictest0-21swapper/109:00:011
629888994324,5cyclictest658039-21kworker/u8:0-events_power_efficient11:40:321
629885994338,3cyclictest20950irq/251-8000000.ethernet11:45:000
629885994337,3cyclictest20950irq/251-8000000.ethernet08:45:110
629885994337,3cyclictest20950irq/251-8000000.ethernet07:40:220
629889994228,6cyclictest682077-21unixbench_singl12:05:342
629889994225,11cyclictest0-21swapper/207:40:022
629889994224,9cyclictest686673-21/usr/sbin/munin12:35:222
629889994222,10cyclictest0-21swapper/209:30:322
629889994221,12cyclictest685475-21/usr/sbin/munin12:25:362
629889994221,12cyclictest685475-21/usr/sbin/munin12:25:362
629889994218,13cyclictest0-21swapper/208:15:102
629885994235,3cyclictest685505-21munin-plugin-st12:30:000
629885994235,3cyclictest685505-21munin-plugin-st12:30:000
629889994132,4cyclictest0-21swapper/211:35:312
629889994131,5cyclictest0-21swapper/209:45:312
629889994129,6cyclictest666411-21grep10:35:342
629889994129,6cyclictest666411-21grep10:35:342
629889994126,8cyclictest665023-21apt-get10:30:162
629889994125,10cyclictest671583-21sshd11:05:522
629889994125,10cyclictest0-21swapper/210:55:002
629889994122,11cyclictest659958-21apt-get10:00:122
629889994119,13cyclictest649458-21/usr/sbin/munin09:00:312
629889994118,13cyclictest0-21swapper/210:05:152
629888994125,11cyclictest0-21swapper/110:15:011
629888994119,16cyclictest231ktimers/110:50:101
629885994135,3cyclictest20950irq/251-8000000.ethernet11:05:220
629885994134,4cyclictest0-21swapper/009:50:220
629885994129,8cyclictest0-21swapper/009:35:370
62988599411,28cyclictest0-21swapper/012:22:580
629889994029,6cyclictest678643-21grep11:45:312
629889994027,8cyclictest653499-21/usr/sbin/munin09:20:262
629889994027,5cyclictest670125-21apt-get11:00:152
629889994022,11cyclictest672815-21diskstats11:15:222
629889994021,12cyclictest655791-21/usr/sbin/munin09:35:232
629889994020,13cyclictest650215-21/usr/sbin/munin09:05:342
629889994016,16cyclictest636487-21sh07:45:222
629888994032,5cyclictest0-21swapper/109:25:361
629888994030,5cyclictest0-21swapper/108:25:341
629888994012,11cyclictest14-21rcu_preempt12:20:021
629885994030,7cyclictest0-21swapper/008:00:370
629885994028,8cyclictest0-21swapper/010:40:350
629885994027,8cyclictest0-21swapper/010:00:340
62988599402,3cyclictest0-21swapper/011:30:010
62988599401,4cyclictest0-21swapper/007:10:010
629889993924,9cyclictest656828-21/usr/sbin/munin09:40:272
629889993924,10cyclictest0-21swapper/208:00:202
62988999392,31cyclictest663640-21meminfo10:20:302
629889993919,13cyclictest680214-21/usr/sbin/munin11:55:322
629889993918,13cyclictest658629-21/usr/sbin/munin09:50:292
62988899396,8cyclictest0-21swapper/107:25:311
629888993924,10cyclictest231ktimers/112:30:091
629888993924,10cyclictest0-21swapper/111:15:361
62988899391,4cyclictest0-21swapper/107:25:011
629885993933,3cyclictest0-21swapper/010:20:370
629885993933,2cyclictest0-21swapper/012:05:160
629885993932,4cyclictest636598-21irqstats07:45:240
629885993932,4cyclictest0-21swapper/008:20:110
629885993932,4cyclictest0-21swapper/007:25:160
629885993925,10cyclictest670261-21tune2fs11:00:240
629885993924,11cyclictest0-21swapper/008:10:350
629885993924,11cyclictest0-21swapper/008:10:350
629889993828,4cyclictest646218-21grep08:40:302
629889993826,8cyclictest642263-21apt-get08:20:122
629889993822,11cyclictest645397-21sshd08:35:452
629889993822,10cyclictest633507-21sshd07:29:462
62988899381,7cyclictest0-21swapper/110:30:001
62988899381,7cyclictest0-21swapper/110:30:001
62988899381,2cyclictest0-21swapper/109:55:011
629889993729,4cyclictest635502-21apt-get07:40:182
629889993720,11cyclictest647640-21/usr/sbin/munin08:50:262
629888993728,5cyclictest0-21swapper/108:10:341
629888993728,5cyclictest0-21swapper/108:10:341
629888993727,5cyclictest641930-21grep08:15:351
629888993725,8cyclictest0-21swapper/110:24:591
629888993722,10cyclictest0-21swapper/110:00:231
629885993732,2cyclictest630049-21/usr/sbin/munin07:10:130
629885993731,3cyclictest686069-21ps12:30:270
629889993630,3cyclictest659098-21apt-get09:55:102
629888993627,5cyclictest0-21swapper/107:40:011
629888993626,6cyclictest0-21swapper/108:50:291
629885993629,4cyclictest20950irq/251-8000000.ethernet10:25:240
629885993629,4cyclictest20950irq/251-8000000.ethernet10:25:230
629885993627,5cyclictest20950irq/251-8000000.ethernet12:00:220
62988999358,14cyclictest526727-1kworker/2:2H+kblockd12:20:022
629889993528,4cyclictest638023-21apt-get07:55:152
629889993523,8cyclictest677314-21/usr/sbin/munin11:40:152
629888993528,4cyclictest14-21rcu_preempt08:00:331
629888993527,4cyclictest14-21rcu_preempt07:30:271
629888993522,7cyclictest665020-21/usr/sbin/munin10:30:291
629888993521,9cyclictest231ktimers/112:35:111
629888993521,9cyclictest231ktimers/112:00:101
62988899351,6cyclictest0-21swapper/110:10:011
62988899351,2cyclictest0-21swapper/110:20:011
629888993511,4cyclictest1651-21lldpd11:33:011
629885993529,4cyclictest0-21swapper/008:50:100
62988999346,16cyclictest0-21swapper/208:30:172
62988999346,16cyclictest0-21swapper/208:30:162
62988999343,19cyclictest672386-21unixbench_singl11:10:392
629888993424,6cyclictest685421-21grep12:25:361
629888993424,6cyclictest685421-21grep12:25:361
629888993422,6cyclictest635499-21/usr/sbin/munin07:40:211
629888993421,6cyclictest637181-21/usr/sbin/munin07:50:191
629888993420,8cyclictest231ktimers/108:45:091
62988899341,27cyclictest0-21swapper/111:40:011
629888993325,5cyclictest22-21rcuc/112:25:011
629888993323,7cyclictest0-21swapper/108:40:301
629888993321,9cyclictest231ktimers/108:05:131
629888993321,7cyclictest659728-21sshd09:59:461
629888993225,4cyclictest0-21swapper/109:40:351
629888993223,5cyclictest0-21swapper/108:35:391
62988899321,2cyclictest0-21swapper/107:50:021
629888993119,7cyclictest0-21swapper/111:55:211
62988899311,3cyclictest642626-21ps08:20:311
629888993112,4cyclictest26950irq/343-s-wl18xx11:48:031
629888993022,5cyclictest667581-21/usr/sbin/munin10:45:341
629888993021,5cyclictest0-21swapper/109:45:231
629888993021,5cyclictest0-21swapper/107:15:311
629888993020,6cyclictest0-21swapper/109:35:371
62988899301,5cyclictest292-21systemd-journal09:30:571
62988899301,2cyclictest0-21swapper/111:05:011
62988899292,4cyclictest681609-21fschecks_time12:05:221
629888992921,6cyclictest0-21swapper/111:15:001
629888992824,2cyclictest6490211/usr/sbin/munin09:00:181
629888992719,5cyclictest670960-21/usr/sbin/munin11:05:321
62988899271,24cyclictest0-21swapper/112:10:201
62988899271,12cyclictest0-21swapper/111:25:421
62988899267,3cyclictest270-21jbd2/mmcblk1p2-811:54:311
629888992615,8cyclictest0-21swapper/109:20:341
629889992514,7cyclictest629974-21latency_hist07:10:002
629888992210,6cyclictest0-21swapper/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional