You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-07 - 01:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Thu Nov 06, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160603021110,17sleep013-21ksoftirqd/007:05:240
160603021110,17sleep013-21ksoftirqd/007:05:230
167002421020,7sleep22197014-21PK-Backend10:05:322
161378521010,6sleep30-21swapper/307:25:223
161378521010,6sleep30-21swapper/307:25:213
16795092950,8sleep22197014-21PK-Backend10:35:022
16945382900,5sleep00-21swapper/011:15:250
160662028263,13sleep30-21swapper/307:08:133
160662028263,13sleep30-21swapper/307:08:123
16981712770,4chrt1698170-21/usr/sbin/munin11:25:292
160653127658,13sleep20-21swapper/207:07:032
160653127658,13sleep20-21swapper/207:07:022
160696499732,9cyclictest1753-21gnome-shell08:00:512
160696499720,17cyclictest1753-21gnome-shell09:00:152
160695799721,41cyclictest16543012cat09:20:310
160529027246,16sleep10-21swapper/107:05:121
160529027246,16sleep10-21swapper/107:05:121
160696499692,10cyclictest1753-21gnome-shell11:03:342
1606964996917,32cyclictest1753-21gnome-shell10:51:552
160696499662,9cyclictest1753-21gnome-shell11:18:252
160696499662,15cyclictest1753-21gnome-shell12:08:002
1606957996511,28cyclictest1626949-21wc08:05:030
160696499629,17cyclictest1753-21gnome-shell10:16:232
160695799622,31cyclictest1753-21gnome-shell10:58:380
160695799611,35cyclictest1667159-21runrttasks09:59:060
1606964996017,37cyclictest855-21dbus-daemon07:12:282
160695799602,30cyclictest1753-21gnome-shell08:45:140
160695799602,30cyclictest1753-21gnome-shell08:39:060
160695799601,32cyclictest1715654-21/usr/sbin/munin12:15:250
160695799601,32cyclictest1628701-21sed08:10:020
160695799592,30cyclictest1753-21gnome-shell12:30:020
160695799592,29cyclictest1753-21gnome-shell08:44:380
160695799582,31cyclictest1753-21gnome-shell09:00:310
160695799582,29cyclictest1753-21gnome-shell11:12:260
160695799581,33cyclictest1691471-40apt-check11:06:260
160696499579,17cyclictest1753-21gnome-shell10:40:502
160695799571,34cyclictest1716753-21awk12:20:120
160695799571,31cyclictest1677787-21cat10:30:030
160696499569,17cyclictest1753-21gnome-shell08:20:222
160695799562,32cyclictest1753-21gnome-shell09:33:170
160696499558,18cyclictest1753-21gnome-shell08:43:252
1606962995532,16cyclictest855-21dbus-daemon11:41:561
160696499548,17cyclictest1753-21gnome-shell07:47:332
160696499542,47cyclictest1704095-21chrt11:42:232
1606964995418,31cyclictest1638447-21wc08:35:332
1606964995413,12cyclictest1663334-21wc09:45:332
160696499541,25cyclictest1753-21gnome-shell07:37:452
1606964995410,16cyclictest1753-21gnome-shell11:32:502
160695799542,22cyclictest1753-21gnome-shell08:19:570
160695799541,48cyclictest1659832-21seq09:37:570
1606957995413,36cyclictest1675944-21pool-org.gnome.10:25:000
160696499538,16cyclictest1753-21gnome-shell11:56:342
160696499537,18cyclictest1753-21gnome-shell12:17:562
160696499537,17cyclictest1753-21gnome-shell10:39:512
160696499537,16cyclictest1753-21gnome-shell07:20:482
160696499536,16cyclictest1753-21gnome-shell07:55:202
1606964995321,28cyclictest1069-21runrttasks09:41:232
1606964995310,18cyclictest1753-21gnome-shell11:39:092
160695799532,47cyclictest1753-21gnome-shell07:58:060
1606957995317,31cyclictest1-21systemd09:30:000
17216092520,5chrt0-21swapper/112:34:121
16098232520,14sleep2341ksoftirqd/207:15:142
160696499529,16cyclictest1753-21gnome-shell09:50:382
160696499528,18cyclictest1753-21gnome-shell09:22:332
160696499527,16cyclictest1753-21gnome-shell10:25:592
1606964995217,30cyclictest2197014-21PK-Backend11:49:402
160696499521,22cyclictest1753-21gnome-shell11:23:202
1606964995211,10cyclictest1649280-21sshd09:06:072
1606964995210,18cyclictest1753-21gnome-shell08:08:312
1606964995210,17cyclictest1753-21gnome-shell11:07:332
1606964995210,17cyclictest1753-21gnome-shell07:30:302
1606964995210,16cyclictest1753-21gnome-shell10:14:142
1606957995218,29cyclictest438-20systemd-journal10:45:000
160695799521,28cyclictest1069-21runrttasks08:56:500
160695799521,27cyclictest1753-21gnome-shell07:20:140
1606964995124,22cyclictest1753-21gnome-shell08:45:382
1606964995119,28cyclictest1069-21runrttasks07:41:402
1606964995118,29cyclictest1667247-21latency_hist10:00:012
1606964995115,31cyclictest859-21NetworkManager10:00:262
1606957995116,30cyclictest438-20systemd-journal09:09:550
1606957995116,30cyclictest1661774-21pool-org.gnome.09:45:010
160695799511,45cyclictest438-20systemd-journal07:34:550
160696499509,16cyclictest1753-21gnome-shell10:45:562
160696499508,17cyclictest1753-21gnome-shell12:00:252
160696499505,16cyclictest1753-21gnome-shell09:15:292
1606964995019,26cyclictest1687398-21processes10:55:292
1606964995018,28cyclictest2197014-21PK-Backend08:31:132
1606964995016,30cyclictest2197014-21PK-Backend08:14:562
1606964995016,30cyclictest2197014-21PK-Backend08:14:562
160696499501,21cyclictest1753-21gnome-shell12:35:182
1606964995010,14cyclictest1753-21gnome-shell08:59:232
160696499498,16cyclictest1753-21gnome-shell09:14:362
160696499498,16cyclictest1753-21gnome-shell09:14:362
160696499492,17cyclictest1753-21gnome-shell12:20:212
160696499492,16cyclictest1753-21gnome-shell12:30:282
160696499492,15cyclictest1753-21gnome-shell09:33:222
160696499491,23cyclictest1753-21gnome-shell08:16:232
1606962994927,18cyclictest1624446-21awk07:55:281
160695799491,43cyclictest1708259-21grep11:55:130
160695799491,42cyclictest1718663-21cut12:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional