You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 05:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Jun 13, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62209911971174,19cyclictest6360-21/usr/sbin/munin19:25:131
62199911351102,22cyclictest0-21swapper/019:25:140
60582565518,32sleep00-21swapper/019:23:540
58632510418,29sleep10-21swapper/119:21:511
622099594,21cyclictest4996-21iostat_ios22:10:201
622099563,18cyclictest22342-21diskstats20:05:161
622099553,17cyclictest27988-21diskstats20:20:131
622099544,9cyclictest19388-21diskstats00:15:161
6220995416,7cyclictest10652-21iostat_ios22:25:201
6220995318,5cyclictest22-21ksoftirqd/121:20:021
6220995316,6cyclictest24516-21iostat_ios20:10:181
17382430,5sleep041ktimersoftd/023:28:290
622099429,8cyclictest14504-21missed_timers22:35:201
621999411,4cyclictest81rcu_preempt22:01:290
9102380,2sleep11046-21cpuspeed_turbos20:35:111
106282381,32sleep010700-21python23:50:260
6220993626,6cyclictest31457-21/usr/sbin/munin23:20:211
297092361,31sleep029737-21cat21:50:180
621999358,12cyclictest29483-21kernelversion23:15:190
234522351,3sleep123508-21df23:00:131
234522351,3sleep123508-21df23:00:121
621999331,20cyclictest27583-21cstates21:45:120
621999331,11cyclictest81rcu_preempt21:01:280
60182331,9sleep00-21swapper/022:14:020
6220993218,8cyclictest25035-21diskstats00:30:141
621999324,4cyclictest81rcu_preempt23:40:160
621999323,14cyclictest21779-21cut22:55:160
6219993222,6cyclictest28380-21memory20:20:200
174082321,4sleep011565-21gdbus21:16:240
98022311,27sleep19886-21sensors_temp19:30:271
621999314,20cyclictest16533-21ntp_states22:40:230
6219993113,5cyclictest11243-21hddtemp_smartct19:35:170
621999311,25cyclictest19989-21cron20:00:000
309042311,4sleep031028-21df23:20:130
622099304,19cyclictest21588-21iostat_ios00:20:191
621999302,14cyclictest27625-21python00:35:270
621999301,4cyclictest81rcu_preempt21:05:380
621999301,14cyclictest25302-21awk21:39:590
170292304,4sleep00-21swapper/000:09:480
148092301,5sleep00-21swapper/000:01:120
8552291,5sleep00-21swapper/020:35:080
80292291,5sleep00-21swapper/020:51:400
621999291,4cyclictest81rcu_preempt23:47:510
621999291,4cyclictest81rcu_preempt23:47:510
6219992911,6cyclictest26393-21chrt23:05:390
621999291,15cyclictest26164-21fschecks_count20:15:150
36992291,5sleep00-21swapper/023:33:150
324312291,5sleep00-21swapper/021:56:090
271122291,5sleep00-21swapper/021:44:210
247252291,5sleep00-21swapper/023:02:490
247252291,5sleep00-21swapper/023:02:490
214632291,5sleep00-21swapper/021:29:190
194712291,5sleep00-21swapper/021:23:050
158132291,5sleep00-21swapper/021:14:190
622099284,18cyclictest15641-21diskstats00:05:191
622099283,8cyclictest29447-21iostat_ios23:15:191
622099283,18cyclictest12530-21iostat_ios22:30:171
622099281,14cyclictest17613-21tr22:45:111
6220992811,13cyclictest3646-21cat22:05:271
621999288,5cyclictest21794-21ntpdc00:20:230
621999285,17cyclictest15215-21memory19:45:220
621999284,16cyclictest0-21swapper/019:31:520
621999283,19cyclictest21175-21munin-run22:55:010
621999283,16cyclictest0-21swapper/022:33:340
621999283,16cyclictest0-21swapper/000:11:040
621999282,14cyclictest4321-21df_inode23:35:140
621999282,13cyclictest23693-21ntp_states00:25:240
621999282,13cyclictest18409-21ntp_states22:45:240
621999281,4cyclictest81rcu_preempt20:57:400
6219992812,5cyclictest24750-21ntp_states20:10:240
621999281,23cyclictest22293-21irqstats21:30:190
5622281,4sleep00-21swapper/020:33:370
41582281,5sleep00-21swapper/020:40:300
320852281,5sleep00-21swapper/000:49:300
301432281,5sleep00-21swapper/000:44:130
234282281,5sleep00-21swapper/020:06:340
215722281,5sleep00-21swapper/020:01:470
206202281,5sleep00-21swapper/000:18:040
177252281,5sleep00-21swapper/019:50:590
14542281,4sleep00-21swapper/000:54:000
141582281,5sleep00-21swapper/019:42:530
128882281,5sleep00-21swapper/023:55:590
114942281,5sleep00-21swapper/022:27:070
622099276,8cyclictest0-21swapper/123:41:001
622099273,18cyclictest27269-21diskstats23:10:141
622099272,18cyclictest16699-21diskstats19:50:151
622099271,6cyclictest16463-21cut21:15:161
6220992715,7cyclictest21234-21ls20:00:271
6220992715,6cyclictest2674-21iostat_ios23:30:181
6220992713,8cyclictest4329-21diskstats23:35:141
6219992719,5cyclictest2944-21fschecks_time22:05:150
621999271,4cyclictest81rcu_preempt00:31:200
6219992710,5cyclictest5441-21taskset20:45:210
310692271,5sleep00-21swapper/020:27:480
622099263,17cyclictest21929-21iostat_ios22:55:201
622099263,17cyclictest20412-21iostat_ios21:25:181
622099263,16cyclictest10513-21ntp_states23:50:231
622099262,11cyclictest0-21swapper/100:45:251
6220992617,6cyclictest22-21ksoftirqd/100:25:171
6220992617,5cyclictest22-21ksoftirqd/122:00:581
6220992616,6cyclictest28611-21cut00:40:131
6220992616,6cyclictest22-21ksoftirqd/100:12:071
6220992616,6cyclictest14920-21strings21:10:211
622099261,21cyclictest29217-21/usr/sbin/munin21:50:181
621999261,4cyclictest81rcu_preempt22:38:440
621999261,17cyclictest0-21swapper/022:16:330
621999261,11cyclictest28250-21vmstat23:10:300
622099259,12cyclictest0-21swapper/121:35:231
622099253,7cyclictest25396-21diskstats23:05:141
622099252,20cyclictest0-21swapper/120:55:191
622099252,19cyclictest11565-21gdbus20:15:441
6220992516,5cyclictest22-21ksoftirqd/122:21:401
6220992515,6cyclictest14927-21seq00:02:261
6220992513,8cyclictest2225-21dbus-daemon21:48:041
6220992512,8cyclictest3286-21runrttasks22:50:191
6220992512,8cyclictest16002-21diskstats22:40:141
622099251,20cyclictest11235-21tune2fs19:35:161
621999251,16cyclictest0-21swapper/022:24:590
88192240,9sleep1622099cyclictest23:45:251
88192240,9sleep1622099cyclictest23:45:251
622099249,11cyclictest0-21swapper/120:41:541
622099249,11cyclictest0-21swapper/100:35:261
622099243,6cyclictest15125-21iostat_ios19:45:191
6220992416,5cyclictest22-21ksoftirqd/121:59:451
6220992415,5cyclictest22-21ksoftirqd/122:18:511
6220992415,5cyclictest22-21ksoftirqd/120:31:271
6220992415,5cyclictest21888-21tr21:30:111
6220992414,6cyclictest5584-21ntp_states20:45:241
6220992414,6cyclictest22-21ksoftirqd/123:55:411
6220992413,6cyclictest32625-21/usr/sbin/munin23:25:191
622099241,21cyclictest0-21swapper/119:55:581
622099233,16cyclictest0-21swapper/120:50:171
622099232,17cyclictest26730-21users21:40:301
622099232,17cyclictest12576-21df_inode21:05:141
6220992315,5cyclictest22-21ksoftirqd/119:43:311
6220992314,5cyclictest22-21ksoftirqd/120:26:001
6220992313,6cyclictest2695-21snmpd00:52:271
6220992211,6cyclictest105652chrt21:00:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional