You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-22 - 06:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot5s.osadl.org (updated Fri Sep 22, 2023 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2187199310,9rtkit-daemon5974-21snmpd19:07:551
2187199140,2rtkit-daemon21870-21rtkit-daemon22:46:271
2187199140,2rtkit-daemon21870-21rtkit-daemon00:12:241
2187199130,1rtkit-daemon21870-21rtkit-daemon19:37:061
2187199130,1rtkit-daemon21870-21rtkit-daemon19:11:100
11598991312,1cyclictest68350irq/133-lan22:37:141
11598991312,1cyclictest68350irq/133-lan22:19:371
11598991312,1cyclictest68350irq/133-lan20:08:251
2187199120,2rtkit-daemon21870-21rtkit-daemon22:12:350
2187199120,2rtkit-daemon21870-21rtkit-daemon19:16:180
11598991212,0cyclictest68350irq/133-lan23:10:311
11598991212,0cyclictest68350irq/133-lan22:33:281
11598991211,1cyclictest68350irq/133-lan22:23:131
11598991211,1cyclictest68350irq/133-lan21:57:331
11598991211,1cyclictest68350irq/133-lan21:52:171
11598991211,1cyclictest68350irq/133-lan21:29:151
11598991211,1cyclictest68350irq/133-lan21:06:441
11598991211,1cyclictest68350irq/133-lan20:31:361
11598991211,1cyclictest68350irq/133-lan20:21:391
11598991211,1cyclictest68350irq/133-lan19:46:081
11598991211,1cyclictest68350irq/133-lan00:39:191
11598991211,1cyclictest68350irq/133-lan00:28:011
2187199110,2rtkit-daemon21870-21rtkit-daemon22:12:131
2187199110,1rtkit-daemon21870-21rtkit-daemon23:44:510
2187199110,1rtkit-daemon21870-21rtkit-daemon23:09:051
2187199110,1rtkit-daemon21870-21rtkit-daemon21:22:131
2187199110,1rtkit-daemon21870-21rtkit-daemon19:32:340
2187199110,1rtkit-daemon21870-21rtkit-daemon19:24:570
11598991111,0cyclictest68350irq/133-lan23:51:051
11598991111,0cyclictest68350irq/133-lan23:43:131
11598991111,0cyclictest68350irq/133-lan23:28:351
11598991111,0cyclictest68350irq/133-lan22:42:001
11598991111,0cyclictest68350irq/133-lan22:00:261
11598991111,0cyclictest68350irq/133-lan21:46:151
11598991111,0cyclictest68350irq/133-lan20:10:201
11598991110,1cyclictest68350irq/133-lan23:45:591
11598991110,1cyclictest68350irq/133-lan23:00:181
11598991110,1cyclictest68350irq/133-lan21:44:331
11598991110,1cyclictest68350irq/133-lan21:16:291
11598991110,1cyclictest68350irq/133-lan21:01:501
11598991110,1cyclictest68350irq/133-lan20:50:231
11598991110,1cyclictest68350irq/133-lan20:00:231
11598991110,1cyclictest68350irq/133-lan19:55:011
11598991110,1cyclictest68350irq/133-lan19:17:151
2187199100,2rtkit-daemon21870-21rtkit-daemon23:19:101
2187199100,1rtkit-daemon21870-21rtkit-daemon21:58:030
1159899109,1cyclictest68350irq/133-lan21:35:261
1159899109,1cyclictest68350irq/133-lan20:49:191
1159899109,1cyclictest68350irq/133-lan20:25:201
1159899109,1cyclictest68350irq/133-lan20:15:201
1159899109,1cyclictest68350irq/133-lan00:22:461
1159899109,1cyclictest68350irq/133-lan00:19:361
1159899109,1cyclictest68350irq/133-lan00:05:021
11598991010,0cyclictest68350irq/133-lan23:55:281
11598991010,0cyclictest68350irq/133-lan23:30:091
11598991010,0cyclictest68350irq/133-lan23:23:361
11598991010,0cyclictest68350irq/133-lan22:55:281
11598991010,0cyclictest68350irq/133-lan22:52:071
11598991010,0cyclictest68350irq/133-lan22:25:231
11598991010,0cyclictest68350irq/133-lan19:45:001
11598991010,0cyclictest68350irq/133-lan19:33:101
11598991010,0cyclictest68350irq/133-lan00:30:281
218719990,1rtkit-daemon21870-21rtkit-daemon21:51:470
115989999,0cyclictest68350irq/133-lan22:05:231
115989999,0cyclictest68350irq/133-lan21:31:501
115989999,0cyclictest68350irq/133-lan19:25:241
115989999,0cyclictest68350irq/133-lan19:20:271
115989999,0cyclictest68350irq/133-lan00:00:151
115989998,1cyclictest68350irq/133-lan20:40:201
218719980,1rtkit-daemon22984-21kworker/u4:023:19:020
218719980,1rtkit-daemon21870-21rtkit-daemon21:11:291
218719980,1rtkit-daemon21870-21rtkit-daemon20:44:340
218719980,1rtkit-daemon21870-21rtkit-daemon20:26:420
218719980,1rtkit-daemon21870-21rtkit-daemon19:40:070
115989988,0cyclictest68350irq/133-lan23:35:291
115989987,1cyclictest68350irq/133-lan19:10:221
115989987,1cyclictest5239-21kworker/1:219:53:541
115979984,3cyclictest5974-21snmpd00:17:150
218719970,1rtkit-daemon30983-21munin-node23:13:380
218719970,1rtkit-daemon21870-21rtkit-daemon23:02:570
218719970,1rtkit-daemon1120-21gpm22:49:060
115989976,1cyclictest68350irq/133-lan20:35:551
115979974,3cyclictest5974-21snmpd19:59:110
218719960,1rtkit-daemon5974-21snmpd21:17:520
218719960,1rtkit-daemon21628-21gmain20:47:040
218719960,0rtkit-daemon21870-21rtkit-daemon22:28:420
218719960,0rtkit-daemon21870-21rtkit-daemon20:51:520
115989965,1cyclictest68350irq/133-lan21:00:001
115979965,1cyclictest5974-21snmpd23:05:340
115979965,1cyclictest5974-21snmpd21:22:140
115979965,1cyclictest5974-21snmpd00:27:090
115979964,2cyclictest5974-21snmpd23:24:010
115979964,2cyclictest5974-21snmpd22:59:100
115979964,2cyclictest5974-21snmpd21:30:120
115979964,2cyclictest5974-21snmpd21:04:250
115979964,2cyclictest5974-21snmpd20:34:210
115979964,2cyclictest5974-21snmpd20:12:210
115979963,3cyclictest5974-21snmpd23:45:230
115979954,1cyclictest5974-21snmpd22:50:160
115979954,1cyclictest5974-21snmpd22:44:430
115979954,1cyclictest5974-21snmpd22:18:210
115979954,1cyclictest5974-21snmpd20:55:520
115979954,1cyclictest5974-21snmpd19:47:440
115979954,1cyclictest5974-21snmpd00:02:530
115979953,2cyclictest5974-21snmpd23:31:120
115979953,2cyclictest5974-21snmpd21:06:220
115979953,2cyclictest5974-21snmpd20:05:330
115979953,2cyclictest5974-21snmpd19:52:410
115979952,2cyclictest5015-21lldpd00:09:450
218719940,3rtkit-daemon21870-21rtkit-daemon23:27:320
115979943,1cyclictest5974-21snmpd00:21:240
115979942,2cyclictest9382-21diskstats22:35:210
115979942,2cyclictest5974-21snmpd19:25:430
115979942,2cyclictest25889-21cat21:40:220
115979942,2cyclictest20382-21in:imuxsock23:35:000
115979942,2cyclictest1826-21ntpq20:20:220
115979941,3cyclictest5974-21snmpd00:37:300
115979941,2cyclictest5974-21snmpd22:04:030
115979941,2cyclictest5974-21snmpd21:36:470
115979941,2cyclictest5974-21snmpd21:28:560
115979941,2cyclictest5974-21snmpd20:01:110
115979941,2cyclictest5974-21snmpd00:32:090
115979941,2cyclictest5656-20systemd-journal21:50:000
115979941,2cyclictest32603-21apt-get23:50:180
115979941,2cyclictest16418-21apt-get21:10:190
115979940,3cyclictest5656-20systemd-journal20:36:290
115979940,3cyclictest5656-20systemd-journal20:16:290
115979940,0cyclictest0-21swapper/000:10:240
115979932,1cyclictest5974-21snmpd22:05:130
115979932,1cyclictest19325-21tune2fs19:35:230
115979931,2cyclictest8170-21basename22:30:240
115979931,2cyclictest1735-21cmp23:55:010
115979931,2cyclictest12-21ksoftirqd/022:20:200
115979930,3cyclictest11673-21cat19:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional