You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 04:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Fri Nov 28, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1623991030,90rtkit-daemon0-21swapper/219:07:132
136307521030,8sleep02197014-21PK-Backend21:35:160
13633042980,8sleep234-21ksoftirqd/221:35:232
162399860,58rtkit-daemon2197014-21PK-Backend22:32:300
13580352810,7sleep02197014-21PK-Backend21:20:140
13923262780,7sleep21753-21gnome-shell22:55:312
162399760,62rtkit-daemon0-21swapper/319:05:103
162399760,5rtkit-daemon0-21swapper/219:10:492
1310381997310,37cyclictest1800-21upowerd23:09:192
131003227340,9sleep00-21swapper/019:07:180
13687652720,17sleep1251rcuc/121:50:221
131038199703,36cyclictest860997-21snmpd00:21:142
162399690,5rtkit-daemon0-21swapper/223:54:242
131038199696,35cyclictest1376425-21awk22:10:332
1310381996925,39cyclictest438-20systemd-journal23:03:072
131038199682,41cyclictest1753-21gnome-shell23:25:172
131038199682,41cyclictest1753-21gnome-shell23:25:172
1310381996816,28cyclictest1069-21runrttasks22:21:062
131008826840,22sleep10-21swapper/119:07:591
13733042660,14chrt26-21ksoftirqd/122:04:561
13733042660,14chrt26-21ksoftirqd/122:04:551
131038199663,37cyclictest1753-21gnome-shell21:20:222
162399650,39rtkit-daemon881143-21gmain23:09:560
131038199658,33cyclictest1069-21runrttasks19:50:522
131038199652,38cyclictest1368439-21/usr/sbin/munin21:50:152
1310381996419,27cyclictest1069-21runrttasks20:43:512
131038199632,37cyclictest1753-21gnome-shell22:41:022
131038199632,36cyclictest1753-21gnome-shell22:54:542
131038199632,34cyclictest1753-21gnome-shell22:31:092
131038199622,37cyclictest1753-21gnome-shell20:52:552
131038199622,36cyclictest1753-21gnome-shell23:56:242
131038199622,36cyclictest1753-21gnome-shell23:30:362
131038199622,36cyclictest1753-21gnome-shell22:39:052
131038199622,13cyclictest1328677-21apt20:00:132
131038199612,36cyclictest1753-21gnome-shell22:09:282
131038199612,36cyclictest1753-21gnome-shell21:14:272
131038199612,36cyclictest1753-21gnome-shell00:08:192
131038199612,35cyclictest1753-21gnome-shell23:42:302
131038199612,35cyclictest1753-21gnome-shell19:44:282
131038199612,35cyclictest1753-21gnome-shell00:32:132
131038199611,9cyclictest860997-21snmpd00:15:532
131038199611,11cyclictest1315746-21taskset19:21:522
162399600,8rtkit-daemon1622-21rtkit-daemon22:35:101
131038199609,47cyclictest1418911-21cat00:15:012
131038199602,35cyclictest1753-21gnome-shell22:03:342
131038199602,35cyclictest1753-21gnome-shell22:03:332
131038199602,35cyclictest1753-21gnome-shell00:36:112
131038199602,34cyclictest1753-21gnome-shell20:19:402
131038199602,34cyclictest1753-21gnome-shell19:56:162
131038199602,34cyclictest1753-21gnome-shell19:48:242
162399590,8rtkit-daemon1622-21rtkit-daemon00:03:391
131038199592,7cyclictest1753-21gnome-shell21:59:032
1310381995925,29cyclictest438-20systemd-journal23:17:192
131038199592,34cyclictest1753-21gnome-shell21:28:102
131038199591,7cyclictest1337673-21taskset20:25:072
131038199591,52cyclictest1320155-21which19:35:202
131038199582,33cyclictest0-21swapper/222:45:332
162399550,9rtkit-daemon1622-21rtkit-daemon23:16:521
162399550,6rtkit-daemon1622-21rtkit-daemon00:14:571
131038199553,48cyclictest1069-21runrttasks23:14:062
1310381995518,32cyclictest1423942-21sort00:25:352
131038199551,7cyclictest1346228-21taskset20:47:542
1310381995516,34cyclictest1409296-21cat23:45:242
162399540,9rtkit-daemon1622-21rtkit-daemon22:48:461
162399540,9rtkit-daemon1622-21rtkit-daemon22:09:371
162399540,9rtkit-daemon1622-21rtkit-daemon19:31:011
162399540,9rtkit-daemon1622-21rtkit-daemon19:25:131
162399540,9rtkit-daemon1622-21rtkit-daemon00:33:211
131038199549,41cyclictest1753-21gnome-shell20:24:572
131038199541,10cyclictest1378857-21date22:20:032
162399530,8rtkit-daemon1622-21rtkit-daemon20:16:171
1310381995318,31cyclictest1753-21gnome-shell21:30:152
131038199531,47cyclictest1753-21gnome-shell23:20:042
1310381995314,34cyclictest1349356-21needreboot20:55:242
162399520,8rtkit-daemon1622-21rtkit-daemon22:41:421
162399520,8rtkit-daemon1622-21rtkit-daemon21:06:361
162399520,8rtkit-daemon1622-21rtkit-daemon20:25:371
162399520,8rtkit-daemon1622-21rtkit-daemon19:41:131
162399520,6rtkit-daemon1622-21rtkit-daemon00:37:051
1310386995214,33cyclictest1358-1kworker/u9:120:00:123
1310381995219,29cyclictest1353162-21sed21:05:322
1310381995218,29cyclictest1414483-21cat00:00:252
131038199521,6cyclictest1319306-21taskset19:32:592
131038199521,47cyclictest1753-21gnome-shell21:49:182
1310381995212,35cyclictest3242255-21gdbus20:35:032
1310381995210,37cyclictest1753-21gnome-shell20:07:262
131038199512,9cyclictest1753-21gnome-shell19:15:062
162399500,25rtkit-daemon2197014-21PK-Backend19:35:491
131038699508,15cyclictest1321012-21taskset19:37:363
1310386995010,12cyclictest1310942-21expr19:10:153
131038199508,38cyclictest1753-21gnome-shell19:28:102
131038199504,41cyclictest1365070-21iwlist21:40:202
1310381995018,27cyclictest1355982-21cpu21:15:132
1310381995012,33cyclictest1340440-21cat20:30:312
1310381995012,33cyclictest1340440-21cat20:30:312
162399490,39rtkit-daemon2197014-21PK-Backend20:37:330
1310386994920,25cyclictest1317877-21sed19:30:023
131038199497,37cyclictest1753-21gnome-shell23:35:282
1310381994917,27cyclictest1332406-21cstates20:10:152
131038699489,10cyclictest1366170-21ls21:45:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional