You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-09 - 04:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron G5905 @3500 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #9, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack9slot5s.osadl.org (updated Thu Feb 09, 2023 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2187199130,2rtkit-daemon21870-21rtkit-daemon19:45:490
17026991312,1cyclictest68350irq/133-lan21:46:521
17026991312,1cyclictest68350irq/133-lan19:10:091
2187199120,5rtkit-daemon24179-20systemd-journal19:09:270
2187199120,2rtkit-daemon21870-21rtkit-daemon22:22:350
2187199120,1rtkit-daemon21870-21rtkit-daemon20:39:431
2187199120,1rtkit-daemon21870-21rtkit-daemon20:18:570
2187199120,1rtkit-daemon21870-21rtkit-daemon20:14:160
2187199120,1rtkit-daemon21870-21rtkit-daemon20:05:051
17026991212,0cyclictest68350irq/133-lan22:38:381
17026991212,0cyclictest68350irq/133-lan21:58:571
17026991211,1cyclictest68350irq/133-lan23:03:141
17026991211,1cyclictest68350irq/133-lan20:40:341
17026991211,1cyclictest68350irq/133-lan19:57:591
17026991211,1cyclictest68350irq/133-lan00:19:541
2187199110,1rtkit-daemon21870-21rtkit-daemon00:35:101
17026991111,0cyclictest68350irq/133-lan23:11:261
17026991111,0cyclictest68350irq/133-lan22:25:161
17026991111,0cyclictest68350irq/133-lan22:08:121
17026991111,0cyclictest68350irq/133-lan21:20:551
17026991111,0cyclictest68350irq/133-lan20:49:191
17026991111,0cyclictest68350irq/133-lan00:25:301
17026991110,1cyclictest68350irq/133-lan22:50:211
17026991110,1cyclictest68350irq/133-lan22:42:531
17026991110,1cyclictest68350irq/133-lan22:14:161
17026991110,1cyclictest68350irq/133-lan19:26:491
1702699109,1cyclictest68350irq/133-lan23:40:001
1702699109,1cyclictest68350irq/133-lan21:50:211
17026991010,0cyclictest68350irq/133-lan23:53:481
17026991010,0cyclictest68350irq/133-lan23:43:071
17026991010,0cyclictest68350irq/133-lan23:05:331
17026991010,0cyclictest68350irq/133-lan22:02:331
17026991010,0cyclictest68350irq/133-lan21:10:151
17026991010,0cyclictest68350irq/133-lan21:05:191
17026991010,0cyclictest68350irq/133-lan20:50:271
17026991010,0cyclictest68350irq/133-lan20:30:171
17026991010,0cyclictest68350irq/133-lan19:50:211
17026991010,0cyclictest68350irq/133-lan00:30:211
17026991010,0cyclictest68350irq/133-lan00:20:131
17026991010,0cyclictest68350irq/133-lan00:05:191
17026991010,0cyclictest68350irq/133-lan00:00:281
1702599109,1cyclictest12-21ksoftirqd/019:55:010
1702599109,1cyclictest12-21ksoftirqd/019:40:180
1702599109,1cyclictest12-21ksoftirqd/000:35:420
218719990,1rtkit-daemon21870-21rtkit-daemon20:32:080
218719990,1rtkit-daemon21870-21rtkit-daemon19:36:250
170269999,0cyclictest68350irq/133-lan23:30:081
170269999,0cyclictest68350irq/133-lan23:16:181
170269999,0cyclictest68350irq/133-lan22:30:161
170269999,0cyclictest68350irq/133-lan22:20:261
170269999,0cyclictest68350irq/133-lan22:15:071
170269999,0cyclictest68350irq/133-lan21:35:261
170269999,0cyclictest68350irq/133-lan21:34:201
170269999,0cyclictest68350irq/133-lan21:18:541
170269999,0cyclictest68350irq/133-lan20:15:241
170269999,0cyclictest68350irq/133-lan19:45:321
170269998,1cyclictest68350irq/133-lan19:20:201
170269998,1cyclictest68350irq/133-lan19:17:361
170259998,1cyclictest12-21ksoftirqd/023:25:210
170259998,1cyclictest12-21ksoftirqd/023:18:070
170259998,1cyclictest12-21ksoftirqd/020:36:470
218719980,1rtkit-daemon21870-21rtkit-daemon20:52:140
218719980,1rtkit-daemon21870-21rtkit-daemon00:29:090
170269988,0cyclictest68350irq/133-lan23:47:481
170269988,0cyclictest68350irq/133-lan23:25:021
170269988,0cyclictest68350irq/133-lan23:23:461
170269988,0cyclictest68350irq/133-lan22:55:011
170269988,0cyclictest68350irq/133-lan22:48:041
170269988,0cyclictest68350irq/133-lan21:27:571
170269988,0cyclictest68350irq/133-lan20:20:181
170269987,1cyclictest68350irq/133-lan21:41:121
170269987,1cyclictest68350irq/133-lan20:26:291
170269987,1cyclictest68350irq/133-lan19:40:001
170269987,1cyclictest68350irq/133-lan19:30:201
170269987,1cyclictest68350irq/133-lan00:10:151
170259988,0cyclictest12-21ksoftirqd/023:11:290
170259988,0cyclictest12-21ksoftirqd/021:06:450
170259988,0cyclictest12-21ksoftirqd/019:25:170
170259987,1cyclictest12-21ksoftirqd/022:15:290
218719970,1rtkit-daemon21870-21rtkit-daemon21:12:180
218719970,1rtkit-daemon21870-21rtkit-daemon00:12:150
170269977,0cyclictest68350irq/133-lan20:55:441
170269976,1cyclictest68350irq/133-lan23:58:061
170259977,0cyclictest12-21ksoftirqd/022:08:050
170259977,0cyclictest12-21ksoftirqd/020:45:280
170259977,0cyclictest12-21ksoftirqd/020:20:220
170259976,1cyclictest12-21ksoftirqd/023:30:220
170259976,1cyclictest12-21ksoftirqd/023:00:210
170259976,1cyclictest12-21ksoftirqd/022:40:190
170259976,1cyclictest12-21ksoftirqd/021:55:250
170259976,1cyclictest12-21ksoftirqd/021:25:160
170259975,1cyclictest12-21ksoftirqd/020:25:220
218719960,1rtkit-daemon6075-21munin-node22:50:240
218719960,1rtkit-daemon5974-21snmpd19:15:230
170269964,2cyclictest5974-21snmpd21:03:181
170259966,0cyclictest5974-21snmpd22:55:150
170259966,0cyclictest5974-21snmpd22:33:360
170259966,0cyclictest5974-21snmpd22:25:550
170259966,0cyclictest5974-21snmpd21:39:070
170259966,0cyclictest5974-21snmpd21:16:160
170259966,0cyclictest5974-21snmpd19:11:170
170259966,0cyclictest19525-21cat21:00:170
170259966,0cyclictest12-21ksoftirqd/000:00:220
170259965,1cyclictest5974-21snmpd23:53:000
170259965,1cyclictest5974-21snmpd21:34:430
170259965,1cyclictest5974-21snmpd20:41:380
170259965,1cyclictest12-21ksoftirqd/023:35:180
170259965,1cyclictest12-21ksoftirqd/022:35:170
170259965,1cyclictest12-21ksoftirqd/020:00:000
170259965,1cyclictest12-21ksoftirqd/019:25:000
170259964,2cyclictest5974-21snmpd23:44:020
170259964,2cyclictest5974-21snmpd22:10:080
170259964,2cyclictest5974-21snmpd22:02:020
170259964,2cyclictest5974-21snmpd20:59:450
170259964,2cyclictest5974-21snmpd20:05:340
170259964,2cyclictest5974-21snmpd00:32:180
170259964,2cyclictest5974-21snmpd00:15:350
218719950,0rtkit-daemon21870-21rtkit-daemon23:56:540
218719950,0rtkit-daemon0-21swapper/020:13:401
170269954,1cyclictest5974-21snmpd19:41:301
170259955,0cyclictest12-21ksoftirqd/023:45:280
170259955,0cyclictest12-21ksoftirqd/022:45:000
170259954,1cyclictest5974-21snmpd21:44:250
170259954,1cyclictest5974-21snmpd00:07:170
170259954,1cyclictest12-21ksoftirqd/023:05:270
170259954,1cyclictest12-21ksoftirqd/021:55:010
170259954,1cyclictest12-21ksoftirqd/021:50:000
170259954,1cyclictest12-21ksoftirqd/021:20:240
170269943,1cyclictest22-21ksoftirqd/120:00:011
170259944,0cyclictest12-21ksoftirqd/000:20:240
170259943,1cyclictest31063-21kworker/0:223:20:150
170259943,1cyclictest12-21ksoftirqd/020:00:010
170259942,2cyclictest24871-21awk19:30:220
170269920,2cyclictest17021-21munin-plugin-st19:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional