You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 12:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s (updated Thu Dec 04, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
176469912621215,43cyclictest0-21swapper/019:25:120
176479911231105,13cyclictest81rcu_preempt20:30:161
171962599554,30sleep00-21swapper/019:21:100
173292530487,29sleep10-21swapper/119:22:361
1764799186180,3cyclictest0-21swapper/119:25:111
1764699168144,21cyclictest0-21swapper/020:30:160
216582980,8sleep11764799cyclictest23:20:011
109202970,8sleep01764699cyclictest22:00:380
7362890,4sleep03-21ksoftirqd/023:30:520
318562840,3sleep031857-21ssh22:55:580
1764799801,45cyclictest16358-21ssh23:47:221
1764799791,44cyclictest4953-21ntp_states23:35:291
1764799771,6cyclictest26214-21chrt23:24:441
1764799741,6cyclictest23834-21chrt22:48:201
1764799741,6cyclictest23834-21chrt22:48:191
17647997412,30cyclictest30562-21ssh00:35:321
17647997412,30cyclictest30562-21ssh00:35:321
1764799731,7cyclictest18817-21sh21:35:301
102402730,5sleep110235-21strings22:00:221
17647997210,44cyclictest28678-21ssh22:20:111
1764799711,36cyclictest14747-21tune2fs22:05:201
1764799702,4cyclictest0-21swapper/123:02:351
1764799702,47cyclictest19126-21iostat_ios23:50:211
1764799701,5cyclictest12226-21kworker/1:200:31:211
1764799691,6cyclictest29300-21rm23:27:121
17647996911,34cyclictest0-21swapper/122:32:081
1764799682,6cyclictest16620-21chrt23:14:501
1764799681,7cyclictest31571-21chrt22:55:331
1764799681,6cyclictest21069-21taskset22:11:231
1764799669,36cyclictest2220-21dbus-daemon23:09:001
1764799661,44cyclictest3066-21/usr/sbin/munin20:10:281
1764799661,35cyclictest22361-21fschecks_time21:00:171
1764799655,39cyclictest0-21swapper/120:45:201
1764799651,43cyclictest1335-21ssh23:31:441
1764799649,34cyclictest12817-21sh22:36:201
1764799642,49cyclictest2220-21dbus-daemon21:32:261
1764799639,35cyclictest7694-21ntpdc00:45:251
1764799639,30cyclictest0-21swapper/122:15:541
1764799631,6cyclictest25519-21diskmemload00:02:011
1764799631,39cyclictest23580-21df_inode23:55:141
1764799631,32cyclictest3020-21runrttasks19:38:121
1764799622,4cyclictest0-21swapper/100:51:141
1764799621,6cyclictest10658-21sh21:27:191
1764799621,39cyclictest4686-21ssh21:20:401
1764799621,39cyclictest30304-21ssh21:14:571
17647996210,37cyclictest0-21swapper/122:50:091
1764799619,24cyclictest0-21swapper/100:40:291
1764799612,29cyclictest2604-21taskset00:06:281
1764799611,6cyclictest17448-21taskset22:41:021
1764799611,40cyclictest5405-21/usr/sbin/munin00:10:181
1764799611,39cyclictest19289-21taskset00:24:341
1764799611,38cyclictest3430-21ssh22:26:421
1764799603,4cyclictest0-21swapper/121:15:121
1764799601,5cyclictest14058-21sshd20:38:371
1764799592,35cyclictest28469-21iostat19:50:191
17647995910,31cyclictest0-21swapper/100:28:111
1764799587,33cyclictest0-21swapper/121:05:281
1764799585,33cyclictest40950irq/93-i91500:15:041
1764799582,4cyclictest0-21swapper/121:55:521
1764799582,43cyclictest23397-21ntp_states21:40:251
1764799572,37cyclictest0-21swapper/119:45:171
1764799572,36cyclictest0-21swapper/123:42:331
1764799572,36cyclictest0-21swapper/121:51:141
1764799571,5cyclictest19688-21sed19:30:011
1764799571,37cyclictest25519-21diskmemload21:46:481
1764799561,39cyclictest14424-21hostname20:40:121
245232550,2sleep024521-21wc00:30:010
1764799551,9cyclictest30944-21snmpd19:40:431
1764799543,37cyclictest18971-21ntp_states20:50:261
1764799531,7cyclictest9507-21nfs4_client20:25:221
1764799531,5cyclictest3020-21runrttasks20:24:451
1764799531,5cyclictest20843-21cat20:55:241
1764799531,4cyclictest1637-21if_eth020:05:201
1764799531,34cyclictest3020-21runrttasks20:01:091
42772520,9sleep01764699cyclictest22:27:570
1764799522,43cyclictest5220-21df20:15:121
1764799512,42cyclictest30035-21df19:55:141
1764699383,6cyclictest127532hddtemp_smartct23:10:170
17646993720,4cyclictest40950irq/93-i91523:29:230
1764699369,15cyclictest15318-21ssh23:45:520
1764699365,5cyclictest81rcu_preempt00:10:300
1764699361,14cyclictest8726-21aten_r4power_cu20:25:090
17646993610,5cyclictest81rcu_preempt23:36:450
1764699359,12cyclictest0-21swapper/021:20:320
1764699357,12cyclictest9877-21processes23:40:280
1764699352,7cyclictest0-21swapper/021:40:140
17646993517,4cyclictest7145-21munin-run23:05:000
1764699347,12cyclictest81rcu_preempt21:49:220
1764699343,4cyclictest81rcu_preempt00:35:080
1764699343,4cyclictest81rcu_preempt00:35:070
1764699342,13cyclictest0-21swapper/000:15:150
1764699341,6cyclictest8212-21runrttasks20:21:240
1764699341,6cyclictest15066-21memory20:40:230
17646993411,4cyclictest81rcu_preempt22:23:090
1764699336,5cyclictest81rcu_preempt21:38:360
1764699336,5cyclictest81rcu_preempt00:31:470
1764699336,4cyclictest81rcu_preempt22:51:110
1764699334,4cyclictest81rcu_preempt22:08:580
1764699334,4cyclictest81rcu_preempt00:54:050
1764699333,15cyclictest24807-21python21:05:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional