You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-04 - 06:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot6s.osadl.org (updated Mon Dec 04, 2023 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1081421020,9sleep13241499cyclictest04:34:201
3272591990,4ptp4l241ktimersoftd/123:26:341
321962980,6sleep13241499cyclictest03:26:171
243812970,2sleep00-21swapper/002:27:250
3272591910,1ptp4l241ktimersoftd/102:57:351
318442900,3sleep00-21swapper/000:39:310
3272591880,1ptp4l241ktimersoftd/101:31:021
3241499720,5cyclictest0-21swapper/104:22:181
32414997111,33cyclictest949-21ssh01:49:241
3241499710,6cyclictest8530-21ssh02:52:091
3241499680,7cyclictest26999-21ssh04:06:021
3241499680,6cyclictest4734-21/usr/sbin/munin03:34:341
32414996610,31cyclictest22839-21ssh04:53:501
3241499652,38cyclictest2228-21apt-get02:44:241
3241499651,7cyclictest20796-21ssh03:10:041
3241499650,6cyclictest13416-21ssh02:08:491
3241499642,39cyclictest17593-21snmp_o5powerctl04:44:461
32414996410,30cyclictest31174-21ssh04:12:331
32414996214,27cyclictest32409-21cyclictest03:54:201
3241499612,39cyclictest9987-21ssh04:32:401
3241499610,6cyclictest27529-21snmp_o5powerctl03:19:461
3241499602,35cyclictest23379-21hddtemp_smartct03:59:361
3241499601,39cyclictest26796-21ssh01:37:511
32414996013,29cyclictest25632-21ssh03:18:231
32414996013,29cyclictest25632-21ssh03:18:231
3241499598,30cyclictest1309-21ssh04:15:031
3241199595,10cyclictest29762-21apt-get01:44:180
3241499583,33cyclictest15071-21ssh03:00:301
3241499581,37cyclictest10957-21ssh23:49:421
3241499578,29cyclictest0-21swapper/101:59:111
3241499572,34cyclictest6392-21snmp_o5powerctl00:54:411
3241499571,7cyclictest1400-21ssh02:42:481
3241499571,7cyclictest1400-21ssh02:42:481
3241499571,35cyclictest24137-21rm02:26:481
3241499570,7cyclictest2779-21apt-config00:49:031
3241199576,12cyclictest2182-21snmp_o5powerctl01:49:460
3241199573,19cyclictest23949-21timerwakeupswit00:19:470
3241199572,16cyclictest14696-21cat02:59:560
3241499561,35cyclictest16839-21ssh02:13:191
3241499560,7cyclictest32332-21expr00:39:431
3241499560,6cyclictest13670-21gpgconf01:14:041
3241199565,11cyclictest2470-21snmp_o5powerctl03:29:460
32411995621,31cyclictest20651-21grep03:09:460
3241499550,8cyclictest19690-21cat02:19:211
3241199555,12cyclictest4585-21users00:49:520
3241199555,11cyclictest12074-21snmp_o5powerctl04:34:430
3241199554,13cyclictest2228-21apt-get02:44:230
32411995516,8cyclictest17105-21snmp_o5powerctl03:49:590
3241199544,12cyclictest21117-21snmp_o5powerctl04:49:580
3241199542,19cyclictest0-21swapper/002:34:590
32411995417,5cyclictest19958-21fschecks_time02:19:250
32411995414,7cyclictest8918-21sh04:29:480
32411995414,6cyclictest19587-21latency_hist04:49:060
32411995410,14cyclictest27488-21taskset00:29:320
3270691530,5getstats3241499cyclictest23:47:541
3241199535,11cyclictest15071-21snmp_o5powerctl01:14:400
3241199535,10cyclictest6115-21snmp_o5powerctl03:34:570
3241199535,10cyclictest4094-21snmp_o5powerctl23:34:390
3241199533,10cyclictest32643-21apt-get23:29:210
3241199532,14cyclictest19295-21apt-get03:54:200
32411995316,5cyclictest9929-21sh03:39:520
32411995315,5cyclictest12330-21cstates03:44:250
32411995314,6cyclictest998-21cut03:29:050
32411995314,6cyclictest27134-21sh04:06:220
32411995313,6cyclictest10255-21interrupts02:54:380
3241199531,20cyclictest22336-21ssh01:30:430
3241199531,20cyclictest14165-21entropy23:59:260
3241199531,19cyclictest25813-21chrt01:35:240
3241199531,19cyclictest17195-21/usr/sbin/munin01:19:410
3241499525,38cyclictest4095-21snmp_o5powerctl23:34:401
3241499524,38cyclictest16056-21apt-get01:19:241
3241499520,9cyclictest5076-21cat23:39:021
3241499520,5cyclictest13878-21runrttasks23:59:111
3241199524,9cyclictest5260-21apt-get04:24:210
3241199524,9cyclictest1007-21snmp_o5powerctl04:14:530
3241199523,16cyclictest23378-21ssh03:59:360
3241199522,17cyclictest0-21swapper/001:09:290
3241199521,8cyclictest11708-21ssh02:04:330
32411995214,4cyclictest0-21swapper/004:22:400
32411995213,6cyclictest7220-21latency_hist23:44:020
32411995212,6cyclictest20027-21diskmemload02:49:460
3241499515,38cyclictest30125-21snmp_o5powerctl00:34:401
3241499515,37cyclictest13006-21snmp_o5powerctl23:54:471
3241499514,39cyclictest5789-21snmp_o5powerctl01:54:491
3241499514,38cyclictest8642-21apt-get03:39:271
3241499514,37cyclictest12189-21apt-get03:44:221
3241499513,39cyclictest16076-21apt-get00:04:211
3241499510,7cyclictest19314-21chrt01:24:401
3241499510,7cyclictest18361-21cat00:09:271
3241499510,7cyclictest17270-21taskset03:05:451
3241199518,9cyclictest16432-21gltestperf00:04:270
3241199515,13cyclictest10292-21memory01:04:330
3241199514,10cyclictest25914-21snmp_o5powerctl00:24:440
3241199513,11cyclictest8561-21snmp_o5powerctl23:44:420
32411995118,29cyclictest9-21ksoftirqd/000:15:540
3241199511,7cyclictest12766-21/usr/sbin/munin23:54:380
32411995114,6cyclictest24665-21ssh04:58:220
32411995113,7cyclictest18267-21ssh03:08:200
32411995113,5cyclictest8984-21seq01:01:220
3241199511,19cyclictest32602-21awk02:39:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional