You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 23:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Thu Nov 27, 2025 12:44:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10260210489,10sleep30-21swapper/307:06:573
10196210087,9sleep10-21swapper/107:06:071
1018728464,15sleep20-21swapper/207:06:002
1048428167,9sleep00-21swapper/007:09:500
61792550,0sleep30-21swapper/311:51:513
159132520,0sleep10-21swapper/110:13:391
1059399310,28cyclictest0-21swapper/308:30:003
1059399280,2cyclictest0-21swapper/312:30:143
1059399272,22cyclictest0-21swapper/309:35:123
1059399270,26cyclictest0-21swapper/311:56:173
1059399251,1cyclictest3880-21apt-get09:10:143
1059399250,24cyclictest3426-21diskmemload10:17:033
1059399250,1cyclictest0-21swapper/310:00:373
1059399242,17cyclictest27358-21fschecks_count10:50:173
1059399241,2cyclictest0-21swapper/309:25:473
1059399241,1cyclictest3426-21diskmemload09:54:403
1059399241,1cyclictest0-21swapper/311:41:203
1059399240,23cyclictest0-21swapper/312:29:163
1059399236,16cyclictest3426-21diskmemload11:05:143
1059399233,19cyclictest3426-21diskmemload12:17:043
1059399230,2cyclictest0-21swapper/312:13:283
1059399230,1cyclictest0-21swapper/311:10:013
1059399230,1cyclictest0-21swapper/308:15:143
1059399222,19cyclictest21349-21awk08:40:003
1059399220,1cyclictest0-21swapper/312:24:573
1059399211,1cyclictest3426-21diskmemload12:04:073
1059399211,19cyclictest3426-21diskmemload09:46:343
1059399210,1cyclictest0-21swapper/311:23:063
1059399210,17cyclictest0-21swapper/310:23:433
1058899210,2cyclictest37850irq/131-snd_hda11:15:582
1058599210,4cyclictest0-21swapper/111:18:421
1059399202,17cyclictest12924-21idleruntime-cro07:15:003
1059399201,2cyclictest3426-21diskmemload09:57:173
1059399201,1cyclictest29711-21sh10:25:143
1059399200,1cyclictest0-21swapper/311:45:373
1059399193,15cyclictest30273-21ssh09:31:243
1059399191,2cyclictest23959-21/usr/sbin/munin12:05:213
1059399190,3cyclictest20673-21tr07:30:143
10588991911,6cyclictest17380-21apache209:34:232
1058899190,19cyclictest0-21swapper/212:13:532
1058899190,14cyclictest0-21swapper/210:07:332
1059399188,7cyclictest13667-21ssh09:17:563
1059399181,14cyclictest2915-21aten2_r7power_p10:30:133
1059399180,2cyclictest0-21swapper/308:30:223
1059399180,1cyclictest0-21swapper/310:13:213
1059399180,17cyclictest0-21swapper/312:37:243
1059399180,17cyclictest0-21swapper/311:33:363
1059399180,15cyclictest0-21swapper/308:00:013
10588991815,3cyclictest12484-21kworker/2:209:20:042
10588991814,4cyclictest0-21swapper/211:28:172
1058899180,18cyclictest0-21swapper/212:02:042
1059399172,14cyclictest3426-21diskmemload10:41:043
1059399172,10cyclictest3426-21diskmemload11:35:013
1059399171,1cyclictest1252-21latency_hist09:04:593
1059399170,2cyclictest2621-21sh10:56:003
1059399170,17cyclictest0-21swapper/310:09:153
1059399170,16cyclictest0-21swapper/308:40:133
1059399170,16cyclictest0-21swapper/308:00:123
1058899170,2cyclictest0-21swapper/209:39:252
1058899170,17cyclictest0-21swapper/211:59:472
1059399162,13cyclictest16133-21cut09:20:163
1059399161,14cyclictest0-21swapper/307:20:143
10593991610,5cyclictest62050irq/128-enp2s0-10:37:183
10593991610,4cyclictest13545-21ls09:45:013
1059399160,3cyclictest224-21systemd-journal08:07:123
1059399160,1cyclictest3426-21diskmemload11:17:563
1059399160,1cyclictest0-21swapper/308:10:253
1059399160,1cyclictest0-21swapper/307:45:133
1059399160,16cyclictest0-21swapper/311:25:153
10588991614,1cyclictest32-21ksoftirqd/210:53:242
10588991611,2cyclictest311rcuc/207:55:282
1058899160,0cyclictest0-21swapper/210:40:102
10585991613,2cyclictest25-21ksoftirqd/109:18:381
10583991614,1cyclictest25369-21ntp_states11:15:220
1059399151,1cyclictest0-21swapper/309:05:183
1059399151,12cyclictest0-21swapper/310:49:183
1058899153,8cyclictest0-21swapper/211:05:132
1058899151,8cyclictest224-21systemd-journal09:00:002
10588991514,1cyclictest4317-21kworker/u8:208:25:432
10588991512,2cyclictest27717-21grep09:55:272
1058899150,1cyclictest0-21swapper/212:19:152
10585991512,3cyclictest10550irq/122-ahci[0008:14:591
1058399157,7cyclictest13556-21perf09:45:010
10583991511,3cyclictest11784-21tr08:20:000
1058399150,14cyclictest0-21swapper/011:55:440
1059399148,5cyclictest30775-21taskset08:56:203
1059399148,5cyclictest30345-21ls07:50:183
1059399148,5cyclictest28913-21cat08:55:003
1059399148,5cyclictest24171-21chrt08:45:103
1059399147,6cyclictest7519-21sensors_fan11:00:243
1059399142,11cyclictest14556-21which07:15:233
1059399142,10cyclictest17984-21taskset07:25:013
1059399141,4cyclictest224-21systemd-journal07:40:003
1059399140,0cyclictest0-21swapper/307:40:243
1058899149,2cyclictest2405-21sh10:30:002
1058899141,6cyclictest224-21systemd-journal12:40:002
10588991411,3cyclictest37850irq/131-snd_hda11:11:152
1058899140,1cyclictest0-21swapper/209:11:222
1058899140,14cyclictest0-21swapper/212:33:302
1058899140,14cyclictest0-21swapper/212:05:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional