You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-17 - 09:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Fri Oct 17, 2025 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137312240162,24sleep10-21swapper/119:07:131
138052236162,24sleep00-21swapper/019:08:080
136392235162,25sleep20-21swapper/219:06:012
137932234164,57sleep30-21swapper/319:07:593
1253321660,5sleep21405099cyclictest21:40:242
33602600,2sleep10-21swapper/123:50:211
172702570,2sleep20-21swapper/223:10:122
189802520,4sleep230-21rcuc/220:35:212
1405599426,3cyclictest0-21swapper/322:36:073
14038993611,12cyclictest16229-21munin-run21:55:020
1404399350,24cyclictest0-21swapper/100:35:561
14055993420,3cyclictest17105-21/usr/sbin/munin23:10:123
1405599341,5cyclictest0-21swapper/300:13:333
1405599341,13cyclictest0-21swapper/323:35:273
1403899341,26cyclictest0-21swapper/023:39:320
14055993316,3cyclictest9176-21cat22:50:203
1405599331,15cyclictest4231-21sensors_temp20:00:243
14055993310,2cyclictest24119-21awk19:35:013
1403899339,11cyclictest15345-21perf00:20:010
1403899331,26cyclictest0-21swapper/023:16:390
1403899321,23cyclictest0-21swapper/023:59:020
1405599312,13cyclictest21227-21cat22:05:183
14055993117,9cyclictest0-21swapper/323:21:293
1405599303,4cyclictest22156-21/usr/sbin/munin00:35:163
1405599303,11cyclictest0-21swapper/300:25:193
1405599300,9cyclictest0-21swapper/320:11:303
1405599300,3cyclictest0-21swapper/323:31:233
1403899305,12cyclictest23486-21perf23:25:010
228532290,4sleep11404399cyclictest23:20:271
167812290,8sleep230-21rcuc/221:55:132
1405599298,3cyclictest0-21swapper/321:45:163
1405599291,9cyclictest19636-21df23:15:153
1405599290,8cyclictest0-21swapper/319:40:163
1405599290,16cyclictest0-21swapper/321:15:363
1405599290,16cyclictest0-21swapper/321:15:363
199352280,4sleep011-21rcuc/019:25:020
1405599287,3cyclictest0-21swapper/320:16:003
1405599287,3cyclictest0-21swapper/320:16:003
1405599281,12cyclictest0-21swapper/322:44:353
178462271,3sleep218096-21df00:25:162
1405599271,8cyclictest0-21swapper/321:39:443
14055992717,3cyclictest0-21swapper/319:18:263
1405599270,15cyclictest0-21swapper/300:16:353
14043992720,4cyclictest16987-21irqstats20:30:151
1404399270,17cyclictest0-21swapper/100:05:471
1403899271,17cyclictest0-21swapper/021:40:080
1405599266,3cyclictest0-21swapper/323:07:553
14055992613,9cyclictest0-21swapper/321:09:443
14055992611,3cyclictest0-21swapper/323:00:153
1403899261,18cyclictest0-21swapper/023:05:420
1403899261,17cyclictest0-21swapper/023:46:440
1403899261,17cyclictest0-21swapper/000:12:170
1403899261,16cyclictest0-21swapper/023:42:230
1403899261,16cyclictest0-21swapper/023:11:130
1403899261,16cyclictest0-21swapper/022:45:350
1403899261,12cyclictest27239-21munin-run22:20:000
162732250,6sleep339-21rcuc/319:15:013
162732250,6sleep339-21rcuc/319:15:013
1405599258,3cyclictest0-21swapper/300:07:313
14055992513,8cyclictest0-21swapper/321:41:403
1405599251,11cyclictest24673-21kworker/u8:122:20:083
1405599251,11cyclictest24673-21kworker/u8:122:20:083
14055992510,3cyclictest32257-21latency_hist23:45:023
1405599250,8cyclictest0-21swapper/300:24:573
1405599250,7cyclictest0-21swapper/322:04:023
14043992519,3cyclictest14921-21hddtemp_smartct19:10:171
14043992519,3cyclictest14921-21hddtemp_smartct19:10:161
1404399251,4cyclictest4894-21needreboot22:40:241
1404399250,23cyclictest0-21swapper/121:25:531
14038992519,3cyclictest14634-21snmpd20:45:130
1403899251,17cyclictest0-21swapper/023:30:200
1403899251,17cyclictest0-21swapper/022:54:020
1403899251,16cyclictest0-21swapper/023:29:170
1403899251,16cyclictest0-21swapper/023:29:170
1403899251,16cyclictest0-21swapper/022:55:500
1403899251,16cyclictest0-21swapper/022:33:560
1403899251,16cyclictest0-21swapper/022:13:430
1403899251,16cyclictest0-21swapper/021:57:270
1403899251,16cyclictest0-21swapper/021:37:410
1403899251,16cyclictest0-21swapper/000:09:480
26372241,2sleep32680-21smart_sda21:10:233
1405599249,3cyclictest0-21swapper/321:58:323
1405599242,9cyclictest0-21swapper/320:41:203
1405599241,3cyclictest0-21swapper/323:00:013
14055992413,3cyclictest0-21swapper/320:58:363
1405599240,8cyclictest0-21swapper/322:27:383
1405599240,8cyclictest0-21swapper/321:54:023
1405599240,8cyclictest0-21swapper/320:53:483
1405599240,12cyclictest5392-21kworker/u8:021:01:323
1405599240,11cyclictest0-21swapper/319:35:043
1405099246,9cyclictest22231-21cat19:30:162
1404399241,16cyclictest0-21swapper/119:55:241
1404399241,15cyclictest0-21swapper/121:55:271
1403899242,12cyclictest16177-21/usr/sbin/munin20:30:220
14038992418,3cyclictest31582-21/usr/sbin/munin21:05:230
1403899241,6cyclictest0-21swapper/022:20:530
1403899241,6cyclictest0-21swapper/022:20:530
1403899241,6cyclictest0-21swapper/000:03:450
1403899241,17cyclictest0-21swapper/021:18:170
1403899241,17cyclictest0-21swapper/021:18:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional