You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 15:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack0slot8s.osadl.org (updated Thu Dec 04, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241621250,2sleep30-21swapper/307:05:175
275991980,89ptp4l0-21swapper/107:07:201
437828170,9sleep40-21swapper/407:08:206
429526655,9sleep50-21swapper/507:07:087
438726453,9sleep110-21swapper/1107:08:273
432226446,9sleep00-21swapper/007:07:280
440826251,9sleep60-21swapper/607:08:468
102926250,9sleep100-21swapper/1007:05:132
438325951,6sleep70-21swapper/707:08:249
44712560,0sleep50-21swapper/507:50:007
94980450,4rtkit-daemon0-21swapper/807:09:0410
490199310,1cyclictest0-21swapper/1008:15:172
275991190,0ptp4l0-21swapper/109:55:001
229542190,0sleep10-21swapper/111:00:171
488799183,9cyclictest0-21swapper/712:20:009
488799174,8cyclictest0-21swapper/708:45:009
488799162,9cyclictest0-21swapper/710:55:279
486099163,8cyclictest0-21swapper/110:50:001
486099162,8cyclictest0-21swapper/107:35:001
486099161,9cyclictest0-21swapper/108:40:011
275991160,1ptp4l21-21ksoftirqd/111:05:131
275991160,1ptp4l21-21ksoftirqd/110:00:101
22452160,0sleep969-21ksoftirqd/907:45:1711
488799153,7cyclictest0-21swapper/711:30:259
488799153,7cyclictest0-21swapper/707:10:259
488799152,7cyclictest0-21swapper/708:35:019
486099153,7cyclictest0-21swapper/111:55:241
275991150,1ptp4l21-21ksoftirqd/108:05:151
275991150,0ptp4l0-21swapper/110:20:001
275991150,0ptp4l0-21swapper/109:25:181
275991150,0ptp4l0-21swapper/107:25:201
65162140,0sleep0121rcuc/012:05:010
488799142,8cyclictest12310-21kworker/u24:108:50:009
488799141,7cyclictest0-21swapper/710:09:599
486099142,7cyclictest0-21swapper/112:10:001
486099142,7cyclictest0-21swapper/111:25:241
486099142,7cyclictest0-21swapper/108:55:011
275991140,0ptp4l0-21swapper/112:35:001
275991140,0ptp4l0-21swapper/108:20:151
191591140,0getstats0-21swapper/207:45:374
490199133,6cyclictest0-21swapper/1011:05:002
490199132,7cyclictest0-21swapper/1008:30:252
490199132,6cyclictest0-21swapper/1010:05:242
488799133,6cyclictest0-21swapper/707:30:249
488799132,7cyclictest0-21swapper/710:45:019
488799132,7cyclictest0-21swapper/707:20:009
275991130,4ptp4l0-21swapper/111:45:221
275991130,1ptp4l21-21ksoftirqd/108:51:261
275991130,1ptp4l21-21ksoftirqd/107:35:201
23882130,0sleep20-21swapper/211:15:204
191591130,0getstats0-21swapper/207:30:374
490199122,6cyclictest0-21swapper/1009:20:232
490199122,5cyclictest0-21swapper/1010:15:252
488799121,7cyclictest12310-21kworker/u24:107:55:019
487399121,7cyclictest0-21swapper/409:35:276
486099120,8cyclictest0-21swapper/109:21:291
275991120,4ptp4l0-21swapper/108:25:161
275991120,1ptp4l21-21ksoftirqd/110:53:061
275991120,0ptp4l0-21swapper/111:20:181
275991120,0ptp4l0-21swapper/109:35:291
275991120,0ptp4l0-21swapper/108:30:131
275991120,0ptp4l0-21swapper/108:16:241
275991120,0ptp4l0-21swapper/107:15:261
490699110,10cyclictest0-21swapper/1110:49:543
490199112,6cyclictest0-21swapper/1009:00:012
489199110,10cyclictest0-21swapper/811:00:0010
488799112,5cyclictest0-21swapper/711:55:009
488799110,5cyclictest0-21swapper/709:25:009
487399117,3cyclictest27453-21latency_hist08:20:016
487399111,7cyclictest0-21swapper/411:05:256
486099114,3cyclictest2178-21irqrtprio07:45:171
486099113,2cyclictest20401-21timerandwakeup110:55:281
486099113,2cyclictest17077-21irqrtprio10:10:181
486099112,4cyclictest16754-21expr11:35:141
486099112,2cyclictest9835-21idleruntime07:55:151
486099112,2cyclictest25228-21unixbench_multi12:25:261
486099111,2cyclictest0-21swapper/109:55:261
486099110,4cyclictest6978-21grep09:15:181
486099110,4cyclictest2690-21tr10:35:161
486099110,3cyclictest7027-21gzip07:50:211
486099110,3cyclictest336-21unixbench-2d12:35:261
486099110,3cyclictest28474-21sensors09:00:211
486099110,3cyclictest20578-21cstates08:10:141
486099110,3cyclictest15933-21sh08:45:151
486099110,3cyclictest15184-21hddtemp_smartct07:20:171
275991110,0ptp4l0-21swapper/111:10:221
490199101,6cyclictest0-21swapper/1011:40:242
489799109,1cyclictest0-21swapper/911:40:1411
489799100,9cyclictest24316-21grep08:15:1311
489199100,9cyclictest0-21swapper/807:50:1310
488799107,2cyclictest21597-21df_inode09:35:179
488799107,2cyclictest0-21swapper/709:20:029
488799100,9cyclictest5970-21sed10:40:009
487399100,2cyclictest25982-21if_enp4s009:40:176
486999108,1cyclictest0-21swapper/308:30:155
486999106,3cyclictest1009-21snmpd08:54:545
486999100,9cyclictest0-21swapper/309:05:325
486999100,9cyclictest0-21swapper/307:20:185
486999100,2cyclictest21556-21/usr/sbin/munin11:00:195
486499107,2cyclictest31945-21sed11:10:254
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional