You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 01:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Mon Nov 24, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244412463011,4607sleep25654-21kworker/2:007:26:522
2945421632114,1501sleep329453-21ntp_states09:23:563
165632100312,973sleep324545-21kworker/u8:212:09:483
27714280423,766sleep227727-21irqstats09:18:552
18729276916,735sleep018742-21/usr/sbin/munin08:49:040
18729276916,735sleep018742-21/usr/sbin/munin08:49:040
32240272141,662sleep132314-21fschecks_time09:33:521
10459263312,606sleep210465-21ntpq11:48:592
1638124770,64sleep116454-21cyclictest10:24:031
1638124770,64sleep116454-21cyclictest10:24:031
17270231112,248sleep117423-21unixbench_multi12:10:191
20682230310,213sleep120745-21processes07:13:581
14308228193,95sleep10-21swapper/110:18:551
16076227023,202sleep116105-21apt-key12:08:331
31785226510,242sleep231796-21ntpq07:49:012
31785226510,242sleep231796-21ntpq07:49:012
5033225715,226sleep25068-21ps09:49:002
5033225715,226sleep25068-21ps09:49:002
27666224414,163sleep127669-21cron11:03:301
17592222645,87sleep10-21swapper/108:48:321
17592222645,87sleep10-21swapper/108:48:321
19726222014,152sleep119820-21cut12:19:071
19726222014,152sleep119820-21cut12:19:071
20261218850,76sleep10-21swapper/110:38:511
976218120,142sleep01001-21dpkg09:38:310
5244217921,98sleep10-21swapper/108:08:551
28541217841,54sleep10-21swapper/107:39:021
14827217016,66sleep114840-21fschecks_count08:39:031
5144216939,86sleep10-21swapper/111:33:561
31803216619,58sleep10-21swapper/107:49:041
31803216619,58sleep10-21swapper/107:49:041
27216216534,74sleep127299-21latency_hist09:18:331
17883216337,109sleep118029-21latency_hist12:13:341
31497216111,113sleep131543-21ntpq11:13:561
31497216111,113sleep131543-21ntpq11:13:561
21170216046,27sleep10-21swapper/112:23:481
21170216046,27sleep10-21swapper/112:23:481
844215936,81sleep1883-21ntp_kernel_err07:54:051
17977215818,56sleep10-21swapper/107:08:331
24123215629,101sleep00-21swapper/010:49:030
23028215637,47sleep10-21swapper/110:48:321
3319215411,129sleep33307-21latency_hist08:03:323
2698621548,133sleep127051-21swap07:34:021
4258215313,63sleep10-21swapper/108:04:231
24860215323,16sleep10-21swapper/107:28:441
4651215146,92sleep14541-21/usr/sbin/munin09:48:501
4651215146,92sleep14541-21/usr/sbin/munin09:48:501
29263215016,110sleep229302-21latency_hist11:08:322
2565421507,131sleep125674-21latency_hist09:13:321
11118214610,121sleep111261-21latency_hist08:28:331
309521418,74sleep10-21swapper/109:43:501
309521418,74sleep10-21swapper/109:43:501
17500214013,109sleep016446-21/usr/sbin/munin12:10:220
8607213910,94sleep18621-21vmstat09:59:081
22426213828,91sleep322436-21modprobe12:28:303
22426213828,91sleep322436-21modprobe12:28:303
15231213818,59sleep30-21swapper/308:39:173
30529213120,12sleep10-21swapper/109:28:431
30529213120,12sleep10-21swapper/109:28:431
29417213120,95sleep029397-21apt-key07:43:340
2779213137,78sleep10-21swapper/109:43:331
2779213137,78sleep10-21swapper/109:43:331
29305212920,82sleep30-21swapper/311:08:333
23134212823,80sleep30-21swapper/312:29:113
23134212823,80sleep30-21swapper/312:29:113
13613212411,72sleep113673-21grep11:59:001
6419212221,58sleep10-21swapper/109:53:551
725921219,15sleep10-21swapper/111:39:211
3464212039,64sleep10-21swapper/111:28:511
8491211623,45sleep10-21swapper/111:44:181
24611211519,54sleep124744-21latency_hist10:53:331
23579211316,11sleep10-21swapper/109:05:491
22375211210,53sleep10-21swapper/107:19:031
28035211037,14sleep10-21swapper/111:03:511
18353211015,78sleep218370-21cpu07:08:382
7225210923,68sleep10-21swapper/108:14:081
26709210913,79sleep226775-21wc07:33:542
2785221089,83sleep127889-21sed09:18:581
579210614,77sleep0582-21sshd07:53:520
8449210411,78sleep28439-21apt-get11:43:462
23705210441,39sleep10-21swapper/107:23:561
11629210420,61sleep211330-21/usr/sbin/munin08:28:552
32590210213,26sleep00-21swapper/007:53:310
32590210213,26sleep00-21swapper/007:53:310
29468210223,64sleep10-21swapper/109:23:581
9256210121,42sleep10-21swapper/110:03:491
19482210121,15sleep10-21swapper/108:53:491
1963521009,17sleep00-21swapper/012:18:580
1963521009,17sleep00-21swapper/012:18:580
11967210014,72sleep012004-21ntp_kernel_pll_11:53:540
658429913,73sleep26629-21latency_hist08:13:362
2976729920,51sleep20-21swapper/207:43:442
2976729920,51sleep20-21swapper/207:43:442
2467329916,66sleep324817-21date07:28:343
1183129921,16sleep10-21swapper/111:53:511
3106629812,69sleep031159-21mailstats09:29:020
3106629812,69sleep031159-21mailstats09:29:020
3127529616,65sleep031068-21/usr/sbin/munin11:13:510
3127529616,65sleep031068-21/usr/sbin/munin11:13:510
2979829641,14sleep10-21swapper/107:43:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional