You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 17:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Apr 24, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222569912401218,18cyclictest23650-21smartctl09:35:281
222559911861176,7cyclictest0-21swapper/007:25:140
222559911861176,7cyclictest0-21swapper/007:25:130
222569911401096,32cyclictest22644-21ls07:25:121
222569911401096,32cyclictest22644-21ls07:25:121
217762746701,30sleep00-21swapper/007:20:380
220712567520,31sleep10-21swapper/107:23:431
27622940,8sleep12225699cyclictest07:55:211
260512890,7sleep10-21swapper/111:19:391
101402840,5sleep12225699cyclictest11:02:271
200772800,4sleep02225599cyclictest12:20:140
58532630,3sleep00-21swapper/011:31:210
108222560,5sleep010821-21sh11:03:250
22256994713,24cyclictest22-21ksoftirqd/112:38:101
22256994613,21cyclictest22-21ksoftirqd/112:10:131
151562440,4sleep12225699cyclictest11:07:451
126422440,22sleep03-21ksoftirqd/010:31:000
22256994216,15cyclictest22-21ksoftirqd/110:02:201
22256994210,21cyclictest22-21ksoftirqd/109:45:321
2225699417,14cyclictest22-21ksoftirqd/111:44:391
2225599412,21cyclictest27351-21chrt10:13:230
22255994113,7cyclictest28614-21iostat_ios11:55:190
2225699408,22cyclictest22-21ksoftirqd/109:34:471
22256994015,15cyclictest22-21ksoftirqd/110:28:511
22256994015,14cyclictest22-21ksoftirqd/111:14:221
22256994015,14cyclictest22-21ksoftirqd/109:51:071
22256994014,6cyclictest22-21ksoftirqd/111:51:281
22256994014,15cyclictest22-21ksoftirqd/112:08:041
22256994014,15cyclictest22-21ksoftirqd/112:08:031
2225599409,12cyclictest3286-21runrttasks09:21:450
2225599401,22cyclictest4478-21ssh10:56:120
2225599401,22cyclictest1051-21/usr/sbin/munin07:50:230
327492391,7sleep124380-21munin-node12:00:081
242202390,4sleep02225599cyclictest09:35:550
22256993919,9cyclictest22-21ksoftirqd/112:51:131
22256993915,6cyclictest22-21ksoftirqd/112:25:191
22256993915,14cyclictest22-21ksoftirqd/111:36:321
22256993915,14cyclictest22-21ksoftirqd/110:40:321
22256993914,15cyclictest22-21ksoftirqd/111:27:071
22256993914,14cyclictest22-21ksoftirqd/112:34:241
22256993914,14cyclictest22-21ksoftirqd/109:15:531
22256993914,14cyclictest22-21ksoftirqd/109:12:391
22256993914,10cyclictest22-21ksoftirqd/110:20:291
22256993913,15cyclictest22-21ksoftirqd/110:56:001
22256993913,15cyclictest22-21ksoftirqd/109:20:481
22256993913,14cyclictest22-21ksoftirqd/110:07:451
2225599399,13cyclictest2349-21cut07:55:120
2225599391,22cyclictest26248-21taskset07:30:490
155692391,34sleep115587-21ssh12:15:201
22256993816,8cyclictest22-21ksoftirqd/109:07:341
22256993816,7cyclictest22-21ksoftirqd/109:00:001
22256993814,14cyclictest22-21ksoftirqd/111:34:071
22256993813,15cyclictest22-21ksoftirqd/112:40:421
22256993813,14cyclictest22-21ksoftirqd/110:37:491
22256993811,6cyclictest22-21ksoftirqd/111:21:101
22256993811,17cyclictest22-21ksoftirqd/110:54:391
22255993825,9cyclictest11716-21ssh12:10:440
2225599382,13cyclictest1408-21ssh11:27:010
2225699379,18cyclictest22-21ksoftirqd/110:33:371
2225699372,24cyclictest0-21swapper/107:43:521
22256993716,6cyclictest22-21ksoftirqd/111:55:511
22256993715,8cyclictest22-21ksoftirqd/107:37:161
22256993714,6cyclictest22-21ksoftirqd/109:41:001
22256993714,5cyclictest22-21ksoftirqd/112:45:161
22256993714,14cyclictest22-21ksoftirqd/109:55:031
22256993713,14cyclictest22-21ksoftirqd/112:21:351
22256993712,14cyclictest22-21ksoftirqd/109:29:261
22256993711,15cyclictest22-21ksoftirqd/111:45:191
22256993711,10cyclictest22-21ksoftirqd/110:45:241
2225599373,15cyclictest16495-21memory12:50:200
2225599371,16cyclictest23246-21ssh10:42:240
22256993615,7cyclictest22-21ksoftirqd/110:15:161
22256993615,6cyclictest22-21ksoftirqd/110:13:091
2225599362,6cyclictest6947-21/usr/sbin/munin10:25:220
22255993623,9cyclictest15155-21ssh11:07:450
22255993522,8cyclictest31136-21sh10:16:520
2225599351,29cyclictest12023-21iostat12:45:200
2225599351,29cyclictest10883-21ssh11:36:420
2225699342,19cyclictest6846-21ntp_states08:05:251
22256993412,7cyclictest22-21ksoftirqd/108:23:101
22255993422,8cyclictest30322-21diskmemload12:39:560
257442331,25sleep025854-21sed12:25:280
2225699339,12cyclictest27663-21fgrep09:00:261
2225699338,12cyclictest22-21ksoftirqd/108:10:121
22256993311,6cyclictest22-21ksoftirqd/108:50:241
22255993318,8cyclictest4434-21diskstats08:00:150
2225599331,14cyclictest29922-21hddtemp_smartct12:30:160
294902320,9sleep02225599cyclictest09:41:320
2225699322,16cyclictest24878-21hddtemp_smartct07:30:061
2225599323,26cyclictest28322-21apt-get07:37:380
22255993222,6cyclictest16391-21ssh09:28:340
2225699319,5cyclictest0-21swapper/108:19:021
2225699319,12cyclictest22-21ksoftirqd/108:49:001
2225699318,8cyclictest1974-21lldpad07:46:311
2225699316,12cyclictest0-21swapper/107:50:111
2225599314,4cyclictest0-21swapper/011:13:240
2225599314,10cyclictest14802-21users08:25:290
2225599312,12cyclictest81rcu_preempt09:54:200
22255993116,11cyclictest30322-21diskmemload11:45:130
179172310,4sleep041ktimersoftd/010:36:400
2225699308,12cyclictest22-21ksoftirqd/108:38:451
2225699302,13cyclictest14129-21iostat08:25:191
22255993019,7cyclictest3447-21ssh12:02:440
22255993015,10cyclictest18124-21sh08:35:250
2225599301,4cyclictest81rcu_preempt10:45:230
2225599301,4cyclictest81rcu_preempt09:07:340
40432291,5sleep00-21swapper/009:49:340
271802291,5sleep00-21swapper/011:54:190
2225699292,8cyclictest4965-21ntp_states08:00:241
2225699292,14cyclictest19874-21memory08:40:221
2225599295,4cyclictest81rcu_preempt12:15:270
2225599293,4cyclictest81rcu_preempt10:06:490
22255992918,8cyclictest20970-21kworker/0:011:19:240
2225599291,4cyclictest81rcu_preempt12:40:270
2225599291,4cyclictest81rcu_preempt10:50:460
2225599291,4cyclictest81rcu_preempt10:02:190
2225599291,4cyclictest81rcu_preempt09:55:060
2225599291,4cyclictest81rcu_preempt09:32:420
2225599291,4cyclictest81rcu_preempt09:00:000
112872291,5sleep00-21swapper/008:18:020
92572281,5sleep00-21swapper/008:11:270
67802281,5sleep00-21swapper/012:05:350
67802281,5sleep00-21swapper/012:05:340
5902281,5sleep00-21swapper/009:11:590
22255992817,7cyclictest23228-21df_inode08:50:110
2225599281,4cyclictest81rcu_preempt11:44:550
2225599281,4cyclictest81rcu_preempt11:21:370
2225599281,4cyclictest81rcu_preempt10:20:180
22255992811,12cyclictest17874-21kworker/0:009:16:010
154102281,5sleep10-21swapper/108:30:081
73722271,5sleep00-21swapper/008:06:220
283972271,5sleep00-21swapper/009:04:430
22255992717,6cyclictest30723-21wc07:45:000
22255992716,7cyclictest12612-21sendmail_mailqu08:20:250
2225599264,16cyclictest19482-21diskstats08:40:150
2225599262,6cyclictest32558-21munin-run07:50:000
167252261,5sleep00-21swapper/008:30:500
22255992516,5cyclictest21288-21ls08:45:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional