You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-16 - 22:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Pentium(R) CPU G4400 @ 3.30GHz, Linux 4.19.37-rt19 (Profile)

Latency plot of shadow in rack #8, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot7s.osadl.org (updated Wed Jun 16, 2021 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
58232300,0sleep05830-21wc12:35:150
1516299240,23cyclictest17227-21meminfo07:15:010
15162992020,0cyclictest0-21swapper/008:17:500
1516399190,8cyclictest0-21swapper/108:30:131
1516299190,15cyclictest27310-21diskmemload09:59:260
1516399180,16cyclictest0-21swapper/109:40:171
1516399180,12cyclictest0-21swapper/111:52:391
1516299184,7cyclictest15735-21apt-get11:35:220
15162991817,1cyclictest27310-21diskmemload09:16:380
1516299180,16cyclictest1595-21/usr/sbin/munin12:25:120
1516299172,8cyclictest17548-21apt-get11:40:120
1516299170,4cyclictest27310-21diskmemload11:01:540
1516399165,9cyclictest0-21swapper/110:00:391
1516399162,4cyclictest0-21swapper/108:20:161
1516399160,5cyclictest0-21swapper/109:55:141
1516399160,15cyclictest0-21swapper/109:39:311
1516399160,0cyclictest0-21swapper/111:19:491
1516299164,5cyclictest6575-21apt-get11:10:100
1516299163,8cyclictest5539-21apt-get08:10:160
1516299163,6cyclictest1111-21ls09:25:170
15162991613,1cyclictest24182-21latency_hist10:30:010
1516299160,0cyclictest27310-21diskmemload11:49:010
1516399157,8cyclictest0-21swapper/107:44:291
1516399156,8cyclictest0-21swapper/109:06:051
1516399156,8cyclictest0-21swapper/107:10:011
1516399151,8cyclictest0-21swapper/110:45:141
1516399150,6cyclictest0-21swapper/110:35:131
1516299155,5cyclictest21258-21ls10:20:150
1516299153,6cyclictest21994-21apt-get08:55:180
1516299152,7cyclictest24347-21apt-get10:30:190
1516299152,4cyclictest1053-21apt-get10:55:120
1516299151,6cyclictest1702-21apt-get08:00:130
15162991513,1cyclictest31644-21/usr/sbin/munin10:50:190
15162991512,2cyclictest27310-21diskmemload11:50:280
1516299150,12cyclictest19443-21meminfo10:15:190
1516299150,11cyclictest19438-21apt-get07:20:170
1516399148,6cyclictest0-21swapper/109:45:111
1516399146,8cyclictest0-21swapper/108:53:451
1516399143,6cyclictest0-21swapper/112:35:101
1516399142,7cyclictest0-21swapper/110:20:111
1516399142,5cyclictest0-21swapper/110:25:111
1516399141,4cyclictest0-21swapper/107:50:201
15163991414,0cyclictest0-21swapper/112:32:301
15163991414,0cyclictest0-21swapper/109:00:411
1516399140,6cyclictest0-21swapper/111:05:111
1516399140,5cyclictest0-21swapper/108:45:131
1516399140,14cyclictest0-21swapper/110:32:531
1516399140,12cyclictest0-21swapper/111:39:471
1516299144,5cyclictest2399-21apt-get09:30:120
1516299143,9cyclictest28514-21apt-get12:10:150
1516299143,6cyclictest9383-21ls11:15:230
1516299142,4cyclictest24967-21apt-get07:35:180
1516299141,8cyclictest16507-21apt-get08:40:140
1516299140,8cyclictest9721-21apt-get09:50:170
1516299140,8cyclictest28617-21apt-get07:45:130
1516299140,5cyclictest23098-21apt-get07:30:160
1516299140,13cyclictest8476-21meminfo09:45:180
135372142,2sleep00-21swapper/007:05:160
1516399132,7cyclictest0-21swapper/108:59:551
1516399131,5cyclictest0-21swapper/111:45:121
1516399130,5cyclictest0-21swapper/109:50:171
1516399130,4cyclictest0-21swapper/108:00:121
1516399130,13cyclictest0-21swapper/107:28:371
1516399130,0cyclictest0-21swapper/112:15:121
1516399130,0cyclictest0-21swapper/108:40:371
1516399130,0cyclictest0-21swapper/108:15:171
1516299133,9cyclictest23027-21apt-get11:55:120
1516299133,6cyclictest31127-21apt-get09:20:110
1516299132,5cyclictest26791-21apt-get07:40:150
1516299132,5cyclictest13889-21apt-get11:30:130
1516299131,8cyclictest9197-21apt-get08:20:150
1516299131,6cyclictest30441-21apt-get07:50:130
1516299131,6cyclictest24855-21apt-get12:00:120
1516299131,5cyclictest3704-21apt-get08:05:120
1516299130,8cyclictest20158-21apt-get08:50:120
298132120,1sleep00-21swapper/010:45:090
1516399123,9cyclictest0-21swapper/109:10:031
1516399123,5cyclictest0-21swapper/109:25:131
1516399123,4cyclictest2965-21taskset12:26:491
1516399123,4cyclictest0-21swapper/107:45:141
1516399122,3cyclictest0-21swapper/111:00:161
1516399121,2cyclictest0-21swapper/109:20:011
1516399121,1cyclictest0-21swapper/111:30:001
1516399120,6cyclictest0-21swapper/107:20:161
1516399120,2cyclictest0-21swapper/107:30:161
1516299124,7cyclictest13423-21ls08:30:170
1516299124,4cyclictest2148-21runrttasks10:43:020
1516299124,4cyclictest15764-21ls07:10:180
1516299123,5cyclictest14678-21apt-get08:35:150
1516299123,4cyclictest30339-21apt-get12:15:110
1516299122,6cyclictest10241-21apt-get11:20:160
1516299120,6cyclictest6060-21apt-get09:40:130
1516299120,6cyclictest4742-21apt-get11:05:110
1516299120,6cyclictest26682-21apt-get12:05:110
1516299120,4cyclictest21265-21apt-get07:25:180
1516299120,4cyclictest11020-21apt-get08:25:130
1516399114,2cyclictest0-21swapper/108:10:161
1516399113,8cyclictest0-21swapper/107:16:091
1516399112,5cyclictest0-21swapper/111:22:031
1516399112,3cyclictest0-21swapper/110:15:121
1516399111,4cyclictest0-21swapper/112:20:121
1516399110,3cyclictest0-21swapper/110:50:121
1516399110,2cyclictest0-21swapper/110:10:111
1516299117,2cyclictest3579-21df_inode12:30:180
1516299114,5cyclictest13373-21apt-get10:00:160
1516299114,2cyclictest18334-21apt-get08:45:130
1516299113,4cyclictest4228-21apt-get09:35:140
1516299111,7cyclictest12060-21apt-get11:25:120
15162991111,0cyclictest101ktimersoftd/009:05:010
1516299110,3cyclictest32276-21apt-get07:55:170
138262112,2sleep10-21swapper/107:05:181
1516399102,4cyclictest0-21swapper/111:40:151
1516399101,5cyclictest0-21swapper/108:25:131
1516399101,4cyclictest0-21swapper/108:35:141
1516399101,1cyclictest0-21swapper/112:05:121
1516399100,7cyclictest0-21swapper/109:20:191
1516399100,5cyclictest0-21swapper/110:40:121
1516399100,4cyclictest0-21swapper/109:30:111
1516399100,2cyclictest0-21swapper/111:10:101
1516399100,1cyclictest0-21swapper/111:30:131
1516299109,1cyclictest1568-21cron09:10:010
1516299104,1cyclictest17025-21apt-get10:10:110
1516299102,5cyclictest0-21swapper/009:14:190
1516299101,3cyclictest15201-21apt-get10:05:130
151639992,3cyclictest0-21swapper/108:05:121
151639991,4cyclictest0-21swapper/111:55:201
151639991,3cyclictest0-21swapper/107:35:241
151639990,4cyclictest0-21swapper/107:55:171
151639990,3cyclictest0-21swapper/112:10:151
151639990,3cyclictest0-21swapper/111:00:001
151639990,2cyclictest0-21swapper/112:00:121
151639990,1cyclictest0-21swapper/110:05:121
151629993,3cyclictest26166-21apt-get10:35:130
151629991,4cyclictest32169-21apt-get12:20:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional