You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-29 - 12:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Fri Aug 29, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12715210476,9sleep10-21swapper/119:07:311
1279429785,8sleep30-21swapper/319:08:333
1280328359,19sleep20-21swapper/219:08:402
310512770,0sleep10-21swapper/121:27:061
1206627557,13sleep00-21swapper/019:05:250
1299799290,28cyclictest0-21swapper/222:31:592
1299799263,22cyclictest9502-21grep20:10:002
1299799260,26cyclictest0-21swapper/221:49:072
1299799240,24cyclictest0-21swapper/223:36:452
1299799240,21cyclictest6265-21diskmemload22:45:112
1300099232,1cyclictest14141-21cron22:25:003
1299799230,23cyclictest0-21swapper/222:03:122
1299599220,2cyclictest0-21swapper/123:29:451
1299099220,17cyclictest0-21swapper/000:29:390
1299799200,2cyclictest0-21swapper/223:22:342
1299799200,20cyclictest0-21swapper/221:23:482
1299799200,1cyclictest0-21swapper/200:23:162
1299099200,19cyclictest0-21swapper/022:23:280
1299099200,16cyclictest0-21swapper/022:56:230
1300099191,1cyclictest141rcu_preempt23:39:163
1300099190,4cyclictest0-21swapper/321:20:193
1299099190,18cyclictest0-21swapper/000:02:140
1299099190,15cyclictest0-21swapper/022:31:590
1299799181,2cyclictest0-21swapper/222:52:212
1299799180,2cyclictest0-21swapper/200:29:392
1299799180,1cyclictest0-21swapper/222:56:232
1299799180,1cyclictest0-21swapper/221:29:232
1299799180,18cyclictest0-21swapper/221:43:592
1299599182,13cyclictest22409-21df_abs22:30:201
1299099180,1cyclictest0-21swapper/023:36:310
1299799170,9cyclictest0-21swapper/222:39:092
1299799170,1cyclictest0-21swapper/223:18:402
1299799170,12cyclictest0-21swapper/219:20:162
1299799170,0cyclictest0-21swapper/221:16:442
1299599172,10cyclictest8004-21ntp_kernel_pll_21:10:231
12995991715,1cyclictest6265-21diskmemload22:42:281
12995991715,1cyclictest2858-21apache223:16:131
1299099170,17cyclictest0-21swapper/021:12:030
1300099160,1cyclictest0-21swapper/321:26:353
1300099160,16cyclictest0-21swapper/322:34:503
12997991616,0cyclictest0-21swapper/200:30:022
1299799160,3cyclictest0-21swapper/223:04:062
1299799160,2cyclictest0-21swapper/223:41:402
1299799160,2cyclictest0-21swapper/223:41:402
1299799160,16cyclictest0-21swapper/221:33:462
1299799160,13cyclictest0-21swapper/223:27:482
1299099164,5cyclictest0-21swapper/000:05:160
1299099161,13cyclictest4754-21/usr/sbin/munin00:15:210
1300099152,12cyclictest6265-21diskmemload23:25:023
1300099151,12cyclictest32497-21apache_volume19:50:163
1299799150,15cyclictest0-21swapper/222:22:492
1299599150,1cyclictest0-21swapper/100:12:021
1299599150,0cyclictest0-21swapper/121:41:411
1299099158,6cyclictest16734-21perf22:50:000
12990991513,1cyclictest0-21swapper/021:41:450
1299099150,4cyclictest0-21swapper/021:35:050
1299099150,15cyclictest0-21swapper/023:05:380
1299099150,12cyclictest0-21swapper/022:00:040
13000991411,2cyclictest19138-21tr19:20:233
13000991410,3cyclictest16357-21tail19:15:173
1300099140,1cyclictest0-21swapper/323:22:313
1299799147,3cyclictest5415-21apt-get23:05:032
12997991412,1cyclictest32-21ksoftirqd/223:57:402
1299799140,14cyclictest0-21swapper/223:32:092
1299799140,10cyclictest0-21swapper/221:50:472
1299799140,0cyclictest0-21swapper/220:50:412
12995991413,1cyclictest2841-21apache222:24:391
12995991410,3cyclictest9485-21wc00:20:001
12995991410,3cyclictest31853-21apache200:32:081
1299099145,5cyclictest28614-21apt-get22:35:160
1299099142,5cyclictest0-21swapper/000:30:220
1299099141,11cyclictest21460-21sh21:20:220
1299099140,7cyclictest0-21swapper/021:46:030
1299099140,1cyclictest0-21swapper/023:33:200
1299099140,14cyclictest0-21swapper/023:25:000
1300099139,3cyclictest17655-21cut20:25:203
1300099139,2cyclictest24287-21grep21:45:233
1300099135,7cyclictest30279-21apt-get21:50:193
1300099131,5cyclictest224-21systemd-journal00:10:293
13000991310,2cyclictest22631-21grep23:40:173
13000991310,2cyclictest22631-21grep23:40:173
13000991310,2cyclictest13942-21grep19:10:213
13000991310,2cyclictest13612-21cut23:10:203
1300099130,4cyclictest0-21swapper/323:05:373
1299799139,3cyclictest2737-21tr19:55:162
1299799137,5cyclictest5020-21wc00:15:252
1299799136,2cyclictest0-21swapper/222:15:172
1299799135,5cyclictest224-21systemd-journal19:45:012
12997991310,2cyclictest28696-21wc20:50:002
1299799130,12cyclictest0-21swapper/222:05:352
1299599139,3cyclictest27625-21cat19:40:001
1299599139,3cyclictest22399-21tune2fs20:35:181
1299599139,2cyclictest11287-21cron22:00:001
1299599138,4cyclictest27194-21cut23:20:201
1299599131,10cyclictest32410-21cron22:15:001
12995991310,2cyclictest8702-21head23:30:181
12995991310,2cyclictest5176-21cat21:05:231
12995991310,2cyclictest31826-21grep19:45:261
12995991310,2cyclictest29060-21tr23:45:161
12995991310,2cyclictest29060-21tr23:45:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional