You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 17:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Wed Dec 31, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320739912281199,19cyclictest0-21swapper/007:25:130
320749912251202,19cyclictest32243-21aten_r4power_cu07:25:121
320749911051082,19cyclictest0-21swapper/107:45:131
317682733687,30sleep10-21swapper/107:22:261
319642462418,29sleep00-21swapper/007:24:290
3207399194146,44cyclictest0-21swapper/007:45:120
1873321590,2sleep018731-21ntp_kernel_err09:20:240
169772860,7sleep13207499cyclictest12:38:551
277722800,4sleep1211ktimersoftd/112:50:251
69692740,10sleep03207399cyclictest11:55:130
3207499742,38cyclictest7789-21diskmemload09:14:101
3207499731,40cyclictest7838-21chrt07:43:571
3207499731,36cyclictest4562-21sendmail_mailqu10:45:261
3207499722,34cyclictest29357-21ssh09:31:021
3207499721,38cyclictest11523-21aten_r4power_en10:20:111
3207499712,36cyclictest31863-21/usr/sbin/munin10:40:231
3207499712,35cyclictest28735-21chrt08:39:071
3207499711,39cyclictest14289-21ssh12:02:151
3207499711,37cyclictest9685-21unixbench_multi10:50:301
3207499711,36cyclictest12058-21chrt07:55:071
3207499711,35cyclictest4624-21chrt11:52:171
3207499711,35cyclictest23057-21chrt08:23:371
3207499711,34cyclictest24509-21chrt09:26:021
3207499711,33cyclictest15118-21fschecks_time09:50:151
3207499702,32cyclictest4482-21df_inode09:00:151
3207499701,37cyclictest26964-21grep12:15:231
3207499701,37cyclictest12151-21ssh11:26:271
3207499701,36cyclictest2125-21ssh11:16:101
3207499701,36cyclictest14433-21switchtime10:55:321
3207499701,34cyclictest9646-21taskset11:24:511
3207499701,34cyclictest3920-21chrt07:32:491
3207499701,34cyclictest24638-21chrt08:25:311
3207499701,33cyclictest29461-21taskset11:10:491
3207499692,36cyclictest16396-21if_eth008:05:181
3207499692,33cyclictest12673-21taskset12:34:411
3207499691,37cyclictest772-21sh12:21:421
3207499691,36cyclictest25531-21ntp_kernel_pll_11:40:261
3207499691,35cyclictest5064-21sh10:13:111
3207499691,35cyclictest32506-21chrt08:49:011
3207499691,35cyclictest22837-21cpuspeed_turbos12:45:131
3207499691,35cyclictest13775-21chrt09:49:091
3207499691,34cyclictest22584-21chrt09:57:521
3207499691,34cyclictest15249-21chrt08:00:411
3207499691,32cyclictest20964-21wc11:35:291
3207499691,32cyclictest19880-21diskstats08:15:151
3207499682,32cyclictest5213-21/usr/sbin/munin07:35:251
3207499681,37cyclictest8063-21ssh09:42:541
3207499681,37cyclictest8063-21ssh09:42:541
3207499681,36cyclictest19589-21sh10:28:031
3207499681,34cyclictest6203-21chrt12:27:231
3207499681,34cyclictest22092-21memory12:10:241
3207499681,33cyclictest28949-21taskset10:37:321
3207499681,33cyclictest11844-21chrt07:54:261
3207499681,32cyclictest1377-21users09:35:301
3207499672,34cyclictest29881-21iostat10:05:191
3207499672,31cyclictest15481-21taskset09:17:051
3207499671,32cyclictest30675-21taskset08:44:351
3207499671,31cyclictest6616-21basename10:15:111
3207499671,31cyclictest21914-21taskset12:44:101
3207499664,45cyclictest6667-21iostat_ios09:05:201
3207499662,41cyclictest0-21swapper/112:05:201
3207499661,32cyclictest8636-21ssh11:56:051
3207499661,32cyclictest18564-21ssh11:33:441
3207499661,32cyclictest18564-21ssh11:33:431
3207499661,31cyclictest18170-21awk09:20:161
3207499642,48cyclictest21530-21df10:30:141
3207499642,30cyclictest3983-21seq08:59:451
32074996410,28cyclictest2329-21NetworkManager11:00:401
32074996313,31cyclictest3302-21runrttasks08:52:521
3207499631,32cyclictest31477-21taskset11:46:201
3207499621,38cyclictest7789-21diskmemload10:00:091
3207499601,42cyclictest19274-21chrt08:13:311
3207499601,42cyclictest19274-21chrt08:13:311
3207499591,38cyclictest27088-21latency_hist08:35:011
3207499591,30cyclictest22958-21basename11:05:121
281232580,5sleep0111rcuc/009:30:190
271662500,3sleep00-21swapper/009:29:540
3207399461,13cyclictest0-21swapper/010:45:300
227682401,35sleep022779-21sh11:37:500
120802400,5sleep0111rcuc/009:14:100
32073993927,8cyclictest0-21swapper/010:55:150
3207399391,18cyclictest23035-21tune2fs12:45:170
3207399391,13cyclictest0-21swapper/010:02:300
259352390,8sleep03207399cyclictest12:15:010
3207399381,12cyclictest0-21swapper/009:15:320
3207399373,5cyclictest81rcu_preempt10:10:320
3207399372,20cyclictest0-21swapper/012:29:030
3207399371,21cyclictest18797-21ssh09:54:240
32073993710,14cyclictest7789-21diskmemload11:12:310
3207399368,17cyclictest19077-21ssh12:07:110
3207399364,5cyclictest81rcu_preempt09:43:260
3207399364,5cyclictest81rcu_preempt09:43:260
3207399362,21cyclictest7330-21users09:05:280
3207399361,21cyclictest9689-21sed10:50:300
3207399361,14cyclictest19966-21fschecks_time09:55:180
3207399359,12cyclictest22739-21latency_hist11:05:010
3207399351,5cyclictest2403-21irqbalance11:23:550
3207399351,5cyclictest18110-21ssh10:25:550
3207399351,5cyclictest11139-21ssh10:19:550
3207399351,22cyclictest3624-21awk07:30:290
3207399351,22cyclictest32686-21ssh10:08:230
32073993511,12cyclictest7033-21awk07:40:220
32073993510,4cyclictest0-21swapper/010:38:180
3207399342,16cyclictest0-21swapper/009:39:320
3207399341,30cyclictest0-21swapper/011:07:560
3207399341,28cyclictest11787-21ssh11:25:570
3207399334,5cyclictest81rcu_preempt11:30:150
3207399334,5cyclictest81rcu_preempt11:30:150
3207399334,4cyclictest81rcu_preempt12:22:080
3207399334,4cyclictest81rcu_preempt11:44:470
3207399334,13cyclictest11905-21df12:00:120
3207399331,29cyclictest19430-21ssh12:40:350
3207399331,19cyclictest16856-21ssh12:38:430
3207399331,14cyclictest6066-21munin-run07:40:000
32073993310,19cyclictest15736-21ssh10:24:310
3207399325,4cyclictest111-21usb-storage11:55:000
3207399322,10cyclictest32009-21ssh11:47:070
3207399321,29cyclictest0-21swapper/007:53:560
96792315,3sleep00-21swapper/009:45:030
3207399314,5cyclictest81rcu_preempt08:15:010
3207399314,5cyclictest81rcu_preempt08:15:000
3207399313,4cyclictest81rcu_preempt12:19:270
3207399312,15cyclictest31496-21hddtemp_smartct10:40:170
3207399311,27cyclictest0-21swapper/008:45:160
3207399311,27cyclictest0-21swapper/008:05:150
32073993022,6cyclictest0-21swapper/009:01:560
3207399302,14cyclictest11749-21ssh12:33:220
32073993013,5cyclictest30496-21packagekitd08:24:050
3207399301,17cyclictest27687-21netstat12:50:220
18592301,5sleep00-21swapper/008:53:210
3207399296,5cyclictest0-21swapper/008:36:270
32073992919,6cyclictest26959-21watchsnmpd08:35:000
32073992919,6cyclictest20790-21grep08:15:300
3207399291,15cyclictest22168-21ntpq10:30:260
3207399291,15cyclictest1704-21ssh11:15:350
3207399291,14cyclictest15624-21runrttasks08:04:330
3207399283,12cyclictest0-21swapper/007:55:250
3207399279,5cyclictest29828-21ntp_states08:40:230
32073992717,6cyclictest2753-21grep08:55:170
246402271,5sleep00-21swapper/008:25:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional