You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 21:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Aug 02, 2026 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202219912471221,19cyclictest21418-21smartctl08:50:181
202219911571147,7cyclictest0-21swapper/107:25:101
199442573528,30sleep10-21swapper/107:22:411
198362531484,32sleep00-21swapper/007:21:340
2022099205183,19cyclictest0-21swapper/008:50:170
2022099143110,18cyclictest0-21swapper/007:25:100
249412660,2sleep024942-21uname10:25:220
314182530,8sleep12022199cyclictest07:50:241
256312490,3sleep0111rcuc/009:00:260
20220994020,7cyclictest4985-21cron11:00:010
2022099387,5cyclictest15609-21switchtime11:25:280
2022099379,14cyclictest11565-21gdbus08:46:000
20220993715,7cyclictest17456-21diskstats08:40:140
2022099371,23cyclictest14294-21/usr/sbin/munin09:55:300
20220993614,7cyclictest13707-21python11:20:270
20220993610,13cyclictest8708-21cpuspeed_turbos12:35:110
301342351,4sleep12695-21snmpd07:48:181
20221993412,7cyclictest11565-21gdbus10:24:111
2022099343,4cyclictest81rcu_preempt09:50:180
20221993313,7cyclictest11086-21sh11:15:151
2022099333,16cyclictest9744-21ntp_states11:10:250
2022099331,8cyclictest0-21swapper/012:29:160
202082331,28sleep12695-21snmpd10:13:071
268062321,5sleep126810-21irqstats10:30:211
2022199325,4cyclictest81rcu_preempt08:11:461
2022099321,8cyclictest30200-21iostat12:05:200
2022099321,4cyclictest81rcu_preempt08:14:130
2022099321,27cyclictest28534-21grep12:00:240
20220993212,5cyclictest10293-21python09:45:290
20220993212,5cyclictest10293-21python09:45:280
20220993211,5cyclictest3114-21munin-run10:55:000
2022199315,4cyclictest81rcu_preempt10:28:431
2022199314,4cyclictest81rcu_preempt12:04:201
2022199311,5cyclictest81rcu_preempt08:39:261
2022199311,26cyclictest0-21swapper/112:44:201
2022099317,20cyclictest2221-21cron09:25:000
2022099312,12cyclictest3927-21df_inode09:30:150
20220993115,5cyclictest3-21ksoftirqd/007:49:150
83822301,5sleep10-21swapper/111:06:091
51672301,25sleep05190-21cut11:00:110
254182301,5sleep00-21swapper/011:52:200
216922301,5sleep10-21swapper/111:42:351
2022199301,5cyclictest81rcu_preempt09:40:161
2022199301,4cyclictest81rcu_preempt10:00:291
2022199301,25cyclictest29038-21iostat09:10:201
2022199301,16cyclictest2319-21diskstats08:00:171
2022099302,15cyclictest29100-21python10:35:280
20220993021,5cyclictest2221-21cron12:45:000
2022099302,14cyclictest8418-21python09:40:280
20220993014,5cyclictest3-21ksoftirqd/008:57:320
20220993012,5cyclictest30965-21df07:50:150
20220993011,6cyclictest1934-21df_inode09:25:140
155482301,5sleep10-21swapper/112:50:581
12272301,5sleep10-21swapper/109:22:281
6222291,5sleep00-21swapper/012:13:500
313192291,5sleep00-21swapper/010:41:080
301452291,5sleep00-21swapper/009:14:540
279712291,5sleep00-21swapper/009:06:510
264572291,5sleep00-21swapper/007:39:170
240122291,5sleep00-21swapper/010:23:240
2022199294,19cyclictest6972-21diskstats12:30:151
2022199293,19cyclictest698-21iostat_ios07:55:231
20221992922,4cyclictest22-21ksoftirqd/112:20:001
20221992919,6cyclictest25188-21grep11:50:321
2022199291,4cyclictest81rcu_preempt11:02:581
2022199291,4cyclictest81rcu_preempt10:40:111
2022199291,4cyclictest81rcu_preempt09:56:001
20220992914,5cyclictest3-21ksoftirqd/009:37:310
20220992911,5cyclictest18904-21cstates10:10:130
2022099291,14cyclictest27222-21/usr/sbin/munin10:30:270
2022099291,14cyclictest1255-21fschecks_count12:15:170
20220992910,6cyclictest26638-21ntp_kernel_err11:55:240
20220992910,6cyclictest26638-21ntp_kernel_err11:55:230
177932291,5sleep10-21swapper/111:31:171
167302291,5sleep00-21swapper/008:37:300
15522291,5sleep00-21swapper/007:57:160
128982291,5sleep00-21swapper/008:26:350
8302281,5sleep00-21swapper/010:47:080
6112281,5sleep10-21swapper/112:13:441
55992281,5sleep00-21swapper/008:08:580
44572281,5sleep00-21swapper/012:23:100
32232281,5sleep10-21swapper/109:27:341
297612281,5sleep10-21swapper/110:39:401
280202281,5sleep10-21swapper/107:40:511
280182281,5sleep10-21swapper/109:07:201
244072281,5sleep10-21swapper/107:32:531
242792281,5sleep10-21swapper/108:57:411
206242281,5sleep10-21swapper/108:48:421
2022199286,4cyclictest81rcu_preempt09:31:571
2022199285,3cyclictest81rcu_preempt11:58:251
2022199285,3cyclictest81rcu_preempt11:58:241
2022199284,18cyclictest12652-21diskstats12:45:161
2022199283,4cyclictest81rcu_preempt10:48:321
2022199281,8cyclictest13708-21python11:20:271
2022099287,5cyclictest0-21swapper/011:48:570
2022099283,4cyclictest81rcu_preempt12:31:230
2022099283,18cyclictest23728-21ntp_states07:30:240
2022099281,13cyclictest16672-21latency_hist10:05:000
20220992810,5cyclictest9493-21tr08:19:590
20220992810,5cyclictest14082-21missed_timers08:30:240
188202281,5sleep10-21swapper/108:44:301
145562281,5sleep10-21swapper/111:25:041
137922281,5sleep00-21swapper/012:47:100
103172281,5sleep10-21swapper/111:11:491
98512271,5sleep10-21swapper/112:35:451
68232271,5sleep10-21swapper/109:35:551
319092271,4sleep10-21swapper/109:18:421
2022199274,4cyclictest81rcu_preempt08:17:091
2022199274,4cyclictest81rcu_preempt07:37:591
2022199273,5cyclictest0-21swapper/111:45:101
2022199273,4cyclictest81rcu_preempt09:47:011
2022199273,4cyclictest81rcu_preempt09:47:001
2022199273,4cyclictest81rcu_preempt08:28:031
2022199273,18cyclictest3195-21df12:20:141
2022199273,18cyclictest18613-21diskstats11:35:161
2022199272,10cyclictest4823-21ntp_states08:05:291
20221992716,6cyclictest21756-21tail10:15:291
2022099279,6cyclictest8497-21seq11:07:230
2022099279,6cyclictest20842-21df10:15:130
2022099278,7cyclictest18901-21interrupts11:35:200
2022099272,13cyclictest21615-21runrttasks11:41:470
2022099272,13cyclictest15569-21chrt12:51:080
20220992711,5cyclictest3-21ksoftirqd/011:34:370
2022099271,13cyclictest11084-21df_inode11:15:150
182172271,5sleep10-21swapper/110:06:581
111992271,4sleep00-21swapper/008:23:280
317522261,5sleep00-21swapper/009:17:030
2022199268,14cyclictest14646-21seq08:30:301
2022199263,4cyclictest81rcu_preempt10:51:081
2022199263,4cyclictest81rcu_preempt09:54:071
2022099268,6cyclictest3443-21pidof08:01:000
20220992612,4cyclictest3-21ksoftirqd/010:07:070
2022099261,17cyclictest0-21swapper/007:42:000
109402261,5sleep10-21swapper/108:20:461
2022199243,4cyclictest81rcu_preempt09:00:081
20221992415,5cyclictest22-21ksoftirqd/112:07:471
2022199241,4cyclictest81rcu_preempt10:55:481
2022199231,8cyclictest4797-21taskset12:25:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional