You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 01:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Wed Sep 17, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11662210490,10sleep10-21swapper/107:09:381
1135129783,10sleep30-21swapper/307:05:383
1140228568,13sleep20-21swapper/207:06:172
1154428270,8sleep00-21swapper/007:08:080
33282520,0sleep20-21swapper/212:13:192
11786993029,1cyclictest0-21swapper/312:28:373
11786993029,1cyclictest0-21swapper/311:26:383
11786992928,1cyclictest0-21swapper/312:08:373
11786992928,1cyclictest0-21swapper/309:13:583
1177599290,2cyclictest224-21systemd-journal12:40:000
11786992827,1cyclictest0-21swapper/311:12:583
11786992827,1cyclictest0-21swapper/310:05:183
11786992726,1cyclictest0-21swapper/311:33:383
11786992625,1cyclictest0-21swapper/311:38:383
11786992625,1cyclictest0-21swapper/310:31:373
11786992625,1cyclictest0-21swapper/309:38:383
1178499260,26cyclictest0-21swapper/210:28:352
11786992524,1cyclictest0-21swapper/309:55:583
1177599251,3cyclictest1291-21runrttasks10:42:160
1177599230,1cyclictest0-21swapper/009:47:230
1178699214,8cyclictest0-21swapper/311:50:163
1178499210,0cyclictest0-21swapper/212:22:182
1177599213,5cyclictest6773-21fschecks_time11:25:220
1177599211,8cyclictest0-21swapper/008:50:140
1178699208,10cyclictest979-21grep12:35:243
1178499201,19cyclictest0-21swapper/210:45:182
1178099203,15cyclictest0-21swapper/112:24:541
1177599207,1cyclictest13589-21ssh09:16:380
1177599206,4cyclictest7744-21snmpd10:14:010
11775992019,1cyclictest0-21swapper/012:29:440
1178499190,19cyclictest0-21swapper/212:25:132
11780991917,1cyclictest14615-21python11:05:281
1178099191,14cyclictest0-21swapper/107:50:151
1177599191,5cyclictest31287-21ssh12:10:140
11775991911,5cyclictest21645-21apache211:56:220
11786991818,0cyclictest0-21swapper/309:45:143
1178499186,8cyclictest496-21dbus-daemon10:00:002
1178499183,10cyclictest11963-21grep09:15:262
1177599182,4cyclictest0-21swapper/008:25:150
1177599180,10cyclictest0-21swapper/011:53:370
11786991715,1cyclictest0-21swapper/309:24:183
1178499170,17cyclictest0-21swapper/210:04:212
1178099170,2cyclictest0-21swapper/110:18:531
1178099170,12cyclictest0-21swapper/110:14:071
1177599179,7cyclictest20141-21grep10:15:210
1177599173,4cyclictest0-21swapper/009:14:500
1178699160,1cyclictest0-21swapper/310:40:563
1178699160,1cyclictest0-21swapper/309:15:133
11784991615,1cyclictest0-21swapper/209:34:392
11784991613,2cyclictest32-21ksoftirqd/210:10:002
1178499160,0cyclictest141rcu_preempt09:35:022
11780991611,2cyclictest7439-21wc10:05:201
1177599169,6cyclictest32688-21tr07:50:220
1177599169,6cyclictest31836-21head08:55:270
1177599169,6cyclictest18800-21wc12:00:200
1177599168,7cyclictest30854-21tail07:45:270
1177599168,7cyclictest28920-21sh07:45:000
1177599168,3cyclictest13-21ksoftirqd/008:35:150
11775991610,5cyclictest3532-21grep10:55:310
1177599160,15cyclictest13791-21wc11:30:240
113942160,0sleep10-21swapper/108:15:161
1178699159,5cyclictest20468-21taskset12:01:153
11784991514,1cyclictest0-21swapper/208:16:302
11784991512,2cyclictest32-21ksoftirqd/209:25:272
1178499150,15cyclictest0-21swapper/209:50:472
11780991511,3cyclictest6829-21df08:05:161
11780991511,3cyclictest6829-21df08:05:161
11780991511,2cyclictest20479-21wc11:10:221
1178099150,10cyclictest0-21swapper/111:49:541
1177599159,5cyclictest6360-21uname12:15:190
1177599159,5cyclictest5715-21basename10:05:000
1177599159,5cyclictest16761-21basename07:20:000
1177599158,6cyclictest12667-21sed08:15:280
1177599158,2cyclictest29285-21ssh12:08:330
1177599158,2cyclictest23741-21ssh09:25:230
1177599157,3cyclictest3248-21grep09:35:190
1177599156,8cyclictest29138-21munin-run10:50:000
1177599155,2cyclictest12778-21cut07:10:180
1177599154,6cyclictest30575-21munin-run11:44:590
1177599153,5cyclictest21596-21sh11:36:340
1177599150,14cyclictest9921-21ssh10:07:190
1177599150,14cyclictest21777-21ls07:30:000
1177599150,14cyclictest0-21swapper/011:18:180
1177599150,0cyclictest0-21swapper/011:12:590
19992141,1sleep32019-21ssh11:47:213
11786991411,2cyclictest31589-21taskset10:50:393
11786991411,2cyclictest14194-21sed07:15:003
11786991410,3cyclictest23063-21cat07:30:233
1178499143,8cyclictest21855-21kworker/2:111:40:142
11784991411,2cyclictest767-21cat11:20:192
1178499140,14cyclictest0-21swapper/211:33:142
1178099144,5cyclictest224-21systemd-journal10:00:001
1178099143,2cyclictest224-21systemd-journal12:15:001
11780991411,2cyclictest25-21ksoftirqd/111:32:501
1178099141,11cyclictest26960-21sensors12:30:251
11780991410,3cyclictest2776-21tune2fs09:35:161
11780991410,3cyclictest17386-21cat12:00:001
1178099140,13cyclictest0-21swapper/112:02:411
1177599149,4cyclictest31436-21cat11:45:150
1177599149,3cyclictest10720-21rm10:35:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional