You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-29 - 19:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s.osadl.org (updated Thu Feb 29, 2024 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138849912171191,23cyclictest0-21swapper/007:25:100
138849912171191,23cyclictest0-21swapper/007:25:090
138859911121103,6cyclictest0-21swapper/107:25:091
138859911121103,6cyclictest0-21swapper/107:25:081
138859911041078,20cyclictest24859-21memory07:50:501
137332568522,32sleep00-21swapper/007:24:010
137562562516,31sleep10-21swapper/107:24:131
2394321480,2sleep023944-21cat10:40:250
1621321330,5sleep013882-21cyclictest11:45:280
1594421050,34sleep115928-21munin-run10:20:001
2675221010,3sleep026751-21unixbench_singl10:45:450
13884999068,19cyclictest0-21swapper/007:50:500
86542790,5sleep041ktimersoftd/010:00:390
323932440,5sleep01388499cyclictest12:29:010
8192420,5sleep013882-21cyclictest12:30:310
13884993922,6cyclictest6379-21wget11:20:210
13884993921,5cyclictest2701-21snmpd11:50:370
206802387,4sleep120396-21/usr/sbin/munin07:40:241
13884993816,7cyclictest3-21ksoftirqd/011:55:430
13884993723,10cyclictest5535-21gdbus08:13:470
13884993722,5cyclictest30089-21wget08:05:230
13884993722,5cyclictest29587-21latency12:20:330
13884993722,5cyclictest11341-21unixbench_singl11:30:450
13884993721,4cyclictest1154-21tr09:40:210
13884993718,11cyclictest0-21swapper/009:50:230
13884993622,4cyclictest3600-21latency09:45:340
13884993621,5cyclictest26536-21apt-get07:55:420
13884993621,5cyclictest26332-21grep12:10:420
13884993620,5cyclictest16319-21latency_hist08:55:010
13884993617,3cyclictest0-21swapper/008:05:010
13884993615,7cyclictest3-21ksoftirqd/012:36:330
13884993615,7cyclictest3-21ksoftirqd/009:18:090
13884993615,10cyclictest0-21swapper/011:18:440
13884993614,7cyclictest3-21ksoftirqd/011:06:560
13884993614,7cyclictest3-21ksoftirqd/008:46:520
1388599357,13cyclictest40750irq/92-i91511:20:311
1388599352,16cyclictest31092-21diskstats12:25:241
13884993520,5cyclictest5535-21gdbus12:54:040
13884993519,6cyclictest5681-21/usr/sbin/munin08:25:260
13884993516,7cyclictest11499-21memory08:40:310
13884993516,6cyclictest14705-21ntp_states11:40:360
13884993515,6cyclictest20101-21chrt10:30:210
13884993515,5cyclictest23209-21gzip07:45:400
13884993513,7cyclictest3-21ksoftirqd/009:29:290
1388599342,6cyclictest6612-21iostat12:45:291
1388599342,12cyclictest0-21swapper/110:00:141
1388499342,19cyclictest27877-21perl10:50:250
13884993421,5cyclictest0-21swapper/009:05:340
13884993421,4cyclictest0-21swapper/010:10:380
13884993420,5cyclictest0-21swapper/008:34:470
13884993418,13cyclictest0-21swapper/012:43:510
13884993417,6cyclictest7046-21fschecks_count09:55:240
13884993416,6cyclictest16741-21diskstats08:55:220
13884993412,8cyclictest13882-21cyclictest11:01:090
13884993410,8cyclictest29795-21kworker/0:412:47:260
1388599332,13cyclictest0-21swapper/108:08:471
1388599332,10cyclictest1550-21irqstats09:40:321
1388599331,8cyclictest20222-21/usr/sbin/munin09:05:251
13884993320,5cyclictest0-21swapper/008:35:390
13884993320,5cyclictest0-21swapper/007:30:370
13884993319,4cyclictest1612-21fschecks_count08:15:250
13884993317,5cyclictest2214-21dbus-daemon11:36:490
13884993315,7cyclictest0-21swapper/011:25:530
13884993315,7cyclictest0-21swapper/011:13:000
13884993315,7cyclictest0-21swapper/011:13:000
13884993313,6cyclictest3-21ksoftirqd/010:38:240
13884993312,7cyclictest3-21ksoftirqd/009:14:330
13884993312,7cyclictest13882-21cyclictest10:15:510
13884993311,7cyclictest3-21ksoftirqd/009:04:040
13884993310,8cyclictest13882-21cyclictest10:55:400
125052331,5sleep112553-21cut08:45:011
1388599322,8cyclictest9156-21users12:50:401
13885993225,4cyclictest40750irq/92-i91508:28:511
13885993216,13cyclictest22-21ksoftirqd/111:11:481
13885993216,13cyclictest22-21ksoftirqd/111:11:481
13884993219,9cyclictest18133-21cpu10:25:200
13884993219,3cyclictest0-21swapper/012:06:450
13884993219,3cyclictest0-21swapper/008:20:360
13884993218,4cyclictest22030-21latency12:00:290
13884993216,5cyclictest27711-21memory12:15:320
13884993212,6cyclictest3-21ksoftirqd/009:20:330
125112321,27sleep112616-21df10:10:221
8692311,26sleep1908-21fschecks_count11:05:241
240902311,5sleep10-21swapper/109:15:271
184812311,5sleep00-21swapper/007:35:100
1388599319,5cyclictest40750irq/92-i91510:45:251
1388599313,8cyclictest7084-21fschecks_time09:55:241
13884993120,3cyclictest0-21swapper/010:05:370
13884993118,5cyclictest0-21swapper/010:20:300
13884993117,4cyclictest29860-21wc09:30:180
13884993117,12cyclictest0-21swapper/009:38:450
198012301,25sleep119811-21forks11:55:261
178592301,5sleep10-21swapper/108:57:051
1388599302,8cyclictest8833-21kernelversion11:25:331
289352291,5sleep10-21swapper/110:53:271
284042291,5sleep10-21swapper/108:00:261
263072291,5sleep10-21swapper/107:55:261
231992291,5sleep10-21swapper/110:37:331
13885992913,13cyclictest11961-21pidof10:08:001
1388499296,14cyclictest0-21swapper/007:42:050
115442291,5sleep10-21swapper/111:32:241
53072281,24sleep15363-21cat09:50:281
42942281,5sleep10-21swapper/111:15:011
275582281,5sleep10-21swapper/109:24:551
249362281,4sleep10-21swapper/112:09:441
235702281,5sleep10-21swapper/109:12:441
198892281,5sleep10-21swapper/107:36:551
16532281,5sleep10-21swapper/112:32:161
158732281,5sleep10-21swapper/108:50:581
1388599281,22cyclictest8915-21/usr/sbin/munin08:35:411
86012271,5sleep10-21swapper/108:33:391
54972271,5sleep10-21swapper/112:41:521
49312271,5sleep10-21swapper/108:24:281
305692271,5sleep10-21swapper/112:24:321
305662271,5sleep10-21swapper/110:55:541
254562271,4sleep125618-21perl12:10:291
252102271,5sleep10-21swapper/110:43:461
198862271,5sleep10-21swapper/109:03:271
194412271,5sleep10-21swapper/110:27:271
190792271,5sleep10-21swapper/111:52:281
175282271,5sleep10-21swapper/110:22:031
140352271,5sleep10-21swapper/108:46:201
13885992718,5cyclictest22591-21unixbench_multi12:00:381
13885992711,12cyclictest22-21ksoftirqd/107:31:081
13885992711,12cyclictest0-21swapper/109:25:371
6732261,5sleep10-21swapper/108:10:431
43062261,5sleep10-21swapper/109:46:391
325842261,4sleep10-21swapper/111:02:101
312682261,5sleep10-21swapper/109:34:271
236992261,5sleep10-21swapper/107:47:161
13885992617,5cyclictest16221-21cut11:45:281
1388599261,21cyclictest1270-21/usr/sbin/munin08:15:301
1388599259,12cyclictest0-21swapper/110:30:351
13885992516,5cyclictest22-21ksoftirqd/111:44:051
1388599251,4cyclictest81rcu_preempt12:37:561
13885992513,8cyclictest2214-21dbus-daemon09:35:161
284812241,5sleep10-21swapper/112:17:321
13885992312,7cyclictest0-21swapper/111:35:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional