You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 15:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Tue Jul 15, 2025 12:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2169529582,9sleep30-21swapper/307:06:203
2196929480,10sleep10-21swapper/107:09:531
2169727966,9sleep00-21swapper/007:06:220
2191327666,6sleep20-21swapper/207:09:102
246192640,2sleep124626-21turbostat.cron07:15:001
206242570,0sleep00-21swapper/009:40:560
2207899270,27cyclictest0-21swapper/212:24:112
2207299271,25cyclictest20877-21ssh10:10:150
2207299260,3cyclictest0-21swapper/011:00:160
2208199250,24cyclictest0-21swapper/312:10:173
2207899250,23cyclictest0-21swapper/210:41:122
2207899241,23cyclictest0-21swapper/211:23:162
2207299240,3cyclictest0-21swapper/011:22:100
2207899230,22cyclictest0-21swapper/210:48:232
2207899230,22cyclictest0-21swapper/210:48:222
22081992219,2cyclictest94-21kswapd009:59:393
2207899220,20cyclictest0-21swapper/211:55:242
2207299221,2cyclictest14825-21diskmemload12:15:400
2207899210,21cyclictest0-21swapper/210:35:182
2207299214,1cyclictest0-21swapper/011:50:330
2207299212,1cyclictest12580-21ssh09:35:180
22072992121,0cyclictest0-21swapper/010:54:370
2207299211,2cyclictest14186-21grep12:35:160
2207299210,0cyclictest0-21swapper/011:34:100
2207899200,18cyclictest0-21swapper/212:30:122
2207299202,1cyclictest3345-21aten2_r7power_p09:55:170
2207299201,4cyclictest9944-21apt-get12:10:180
2207299200,1cyclictest0-21swapper/011:35:380
2207899192,14cyclictest32-21ksoftirqd/211:30:142
2207899190,17cyclictest0-21swapper/210:29:232
22075991916,1cyclictest0-21swapper/111:50:191
2207299195,1cyclictest14382-21perf11:50:000
2207299192,3cyclictest26641-21latency_hist09:20:000
2207299192,3cyclictest14825-21diskmemload10:21:190
2207299191,4cyclictest20331-21grep10:35:290
2207299191,2cyclictest10975-21grep09:00:200
2207299190,8cyclictest0-21swapper/010:19:510
2207299190,4cyclictest15920-21fschecks_count09:10:170
2207299190,2cyclictest0-21swapper/009:48:500
2207299190,16cyclictest0-21swapper/007:25:160
310212180,0chrt0-21swapper/209:50:202
22081991817,1cyclictest0-21swapper/310:08:293
2208199180,18cyclictest0-21swapper/312:17:103
2208199180,18cyclictest0-21swapper/311:54:493
2208199180,18cyclictest0-21swapper/311:40:293
2208199180,18cyclictest0-21swapper/310:42:493
2208199180,18cyclictest0-21swapper/309:18:303
2207899184,8cyclictest224-21systemd-journal09:13:352
2207599180,18cyclictest0-21swapper/111:20:561
2207299182,2cyclictest0-21swapper/010:27:220
2207299181,17cyclictest0-21swapper/011:25:230
2208199172,14cyclictest14997-21sensors12:35:223
22081991717,0cyclictest0-21swapper/310:52:303
22081991716,1cyclictest0-21swapper/312:24:293
2208199170,13cyclictest0-21swapper/311:13:483
2207899171,15cyclictest0-21swapper/209:22:342
2207899170,1cyclictest0-21swapper/212:05:562
2207899170,17cyclictest0-21swapper/211:48:372
2207899170,17cyclictest0-21swapper/210:58:112
2207899170,15cyclictest0-21swapper/210:24:182
2207299176,10cyclictest0-21swapper/010:00:190
2207299173,13cyclictest14825-21diskmemload11:55:260
2207299172,3cyclictest27969-21cron08:30:010
2207299171,3cyclictest0-21swapper/012:08:460
2207299170,3cyclictest0-21swapper/010:45:240
2207299170,3cyclictest0-21swapper/010:45:230
22081991615,1cyclictest0-21swapper/312:33:293
22081991615,1cyclictest0-21swapper/312:04:293
22081991615,1cyclictest0-21swapper/311:57:303
22081991615,1cyclictest0-21swapper/311:25:103
22081991615,1cyclictest0-21swapper/310:22:293
22081991615,1cyclictest0-21swapper/309:27:103
2207899160,16cyclictest0-21swapper/210:32:112
2207899160,16cyclictest0-21swapper/209:38:042
2207899160,16cyclictest0-21swapper/209:19:532
2207299168,6cyclictest7646-21ntp_states09:30:210
2207299160,15cyclictest0-21swapper/011:44:040
22081991515,0cyclictest0-21swapper/311:46:303
22081991514,1cyclictest0-21swapper/309:46:293
22081991514,1cyclictest0-21swapper/309:24:493
22081991511,3cyclictest39-21ksoftirqd/307:20:163
2208199150,13cyclictest0-21swapper/310:19:253
22078991512,2cyclictest9881-21/usr/sbin/munin12:10:162
2207899151,13cyclictest7817-21latency_hist11:45:002
2207899150,15cyclictest0-21swapper/212:35:222
2207899150,15cyclictest0-21swapper/212:16:112
2207899150,15cyclictest0-21swapper/212:02:352
2207299154,1cyclictest0-21swapper/011:06:570
2207299152,5cyclictest15624-21grep08:00:270
2207299151,3cyclictest14825-21diskmemload10:40:150
2207299150,1cyclictest0-21swapper/009:51:150
2208199149,3cyclictest18597-21grep10:35:173
22081991411,2cyclictest7215-21head09:30:183
22081991411,2cyclictest29691-21wc08:30:273
22081991410,3cyclictest2965-21ssh12:05:143
22081991410,3cyclictest20312-21tail08:10:263
22078991414,0cyclictest0-21swapper/209:27:372
2207899141,1cyclictest14299-21munin-run10:05:002
22078991410,3cyclictest24812-21cat07:15:002
22078991410,2cyclictest23237-21awk08:20:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional