You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 04:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Mon Jul 06, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157069912021170,28cyclictest17589-21basename19:30:011
156202496453,29sleep10-21swapper/119:24:401
155502478418,44sleep00-21swapper/019:23:570
1570599231170,42cyclictest17577-21munin-run19:30:010
289612980,3sleep128962-21fschecks_time00:15:151
125132850,7sleep00-21swapper/022:05:210
291802560,7sleep00-21swapper/000:15:200
107212460,4sleep1201rcuc/122:00:211
256372430,4sleep041ktimersoftd/021:15:120
15705994013,9cyclictest31086-21df22:55:140
15705994013,8cyclictest23930-21df21:10:120
15705994010,11cyclictest0-21swapper/020:20:130
15705993916,7cyclictest0-21swapper/022:19:550
15705993915,14cyclictest0-21swapper/000:28:020
15705993914,8cyclictest7542-21ntp_states20:25:250
15705993914,8cyclictest27712-21df_inode21:20:150
15705993814,8cyclictest17576-21df23:45:130
15705993814,7cyclictest30244-21iostat20:00:190
15705993813,8cyclictest12241-21irqstats23:30:200
1570599374,23cyclictest0-21swapper/000:11:230
1570599372,14cyclictest32137-21uname20:05:200
1570599371,6cyclictest28975-21grep19:55:290
1570599371,6cyclictest1923-21cpuspeed_turbos00:30:110
15705993713,8cyclictest26376-21hddtemp_smartct19:50:170
15705993713,7cyclictest6951-21iostat_ios21:50:210
15705993713,7cyclictest23432-21hddtemp_smartct00:00:150
15705993713,7cyclictest22421-21df19:40:140
15705993713,7cyclictest19463-21diskstats23:50:140
15705993713,14cyclictest0-21swapper/023:05:050
15706993624,9cyclictest3083-21smartctl21:40:181
1570599362,7cyclictest0-21swapper/023:10:270
15705993614,13cyclictest0-21swapper/023:18:410
15705993614,12cyclictest0-21swapper/000:24:070
15705993613,7cyclictest20497-21irqstats21:00:210
15705993613,7cyclictest20484-21expr19:35:140
15705993613,6cyclictest1075-21ntp_states23:00:240
15705993612,8cyclictest13570-21aten_r4power_po23:35:110
1570599361,13cyclictest3286-21runrttasks20:35:590
212652351,10sleep00-21swapper/022:30:010
212652351,10sleep00-21swapper/022:30:010
1570699358,5cyclictest1706-21latency_hist00:30:021
1570699351,8cyclictest0-21swapper/122:13:491
15706993514,6cyclictest22-21ksoftirqd/100:50:151
1570599351,6cyclictest30183-21grep21:25:260
15705993514,5cyclictest0-21swapper/022:45:110
1570599351,12cyclictest2660-21runrttasks20:14:390
15706993416,5cyclictest8193-21latency00:45:211
15706993414,6cyclictest22-21ksoftirqd/123:51:061
15706993411,7cyclictest1552-21runrttasks23:00:471
1570599342,14cyclictest16108-21memory23:40:230
15705993414,11cyclictest0-21swapper/021:38:090
1570599341,14cyclictest19181-21grep19:30:230
15705993410,7cyclictest19950-21tune2fs22:25:180
81952331,9sleep10-21swapper/120:27:371
247702331,4sleep124912-21users21:10:291
1570599331,5cyclictest29031-21basename22:50:110
15705993314,6cyclictest0-21swapper/000:51:530
15705993314,5cyclictest0-21swapper/021:45:080
15705993314,5cyclictest0-21swapper/021:08:140
15705993314,5cyclictest0-21swapper/020:46:230
1570599331,14cyclictest8872-21/usr/sbin/munin23:20:290
1570599331,12cyclictest3286-21runrttasks22:36:120
15705993310,7cyclictest21921-21proc_pri23:55:260
15705993310,7cyclictest21921-21proc_pri23:55:250
15705993310,5cyclictest6476-21sh00:40:240
165472321,27sleep116581-21ntp_states22:15:241
1570699329,5cyclictest18654-21latency20:55:201
1570699328,6cyclictest27104-21cut22:45:111
1570699328,5cyclictest40250irq/92-i91523:35:001
1570699328,5cyclictest40250irq/92-i91500:30:111
1570699325,6cyclictest11565-21gdbus19:54:031
1570699321,19cyclictest0-21swapper/120:04:481
15705993214,5cyclictest0-21swapper/023:28:010
15705993214,5cyclictest0-21swapper/022:41:150
15705993214,5cyclictest0-21swapper/022:24:130
15705993214,5cyclictest0-21swapper/022:03:360
15705993214,5cyclictest0-21swapper/021:40:080
15705993214,5cyclictest0-21swapper/020:56:030
15705993214,5cyclictest0-21swapper/020:51:020
15705993214,5cyclictest0-21swapper/019:46:200
15705993214,5cyclictest0-21swapper/000:46:080
15705993214,5cyclictest0-21swapper/000:07:470
15705993213,5cyclictest0-21swapper/020:30:150
1570599321,14cyclictest8315-21seq21:55:110
15705993210,5cyclictest3146-21cut20:15:120
43872311,5sleep10-21swapper/120:17:131
325102311,5sleep10-21swapper/122:59:591
15705993114,5cyclictest0-21swapper/022:11:290
15705993114,5cyclictest0-21swapper/020:40:590
15705993114,5cyclictest0-21swapper/000:37:110
15705993113,5cyclictest0-21swapper/021:31:430
112532311,5sleep10-21swapper/123:27:451
69582301,5sleep10-21swapper/100:40:541
318132301,5sleep10-21swapper/100:21:161
268862301,25sleep126907-21pidof22:44:591
15706993020,5cyclictest21370-21cat22:30:001
1570699301,8cyclictest22992-21chrt22:33:431
1570699301,8cyclictest22992-21chrt22:33:431
1570699301,26cyclictest111-21usb-storage20:54:561
287632291,5sleep10-21swapper/121:21:091
279982291,5sleep10-21swapper/100:10:511
236122291,5sleep10-21swapper/119:42:351
231552291,5sleep10-21swapper/121:06:371
22112291,5sleep10-21swapper/121:38:571
216412291,5sleep10-21swapper/119:36:471
213992291,5sleep10-21swapper/121:02:541
183092291,5sleep10-21swapper/123:45:291
1570699299,5cyclictest40250irq/92-i91520:40:271
1570699297,4cyclictest81rcu_preempt21:50:001
1570699296,5cyclictest40250irq/92-i91523:35:221
1570699296,5cyclictest40250irq/92-i91520:20:131
1570699296,4cyclictest40250irq/92-i91522:06:281
1570699291,9cyclictest6509-21sed23:15:171
1570699291,8cyclictest29328-21chrt19:58:321
15706992918,6cyclictest29127-21cpuspeed_turbos22:50:121
50862281,5sleep10-21swapper/100:36:081
324932281,4sleep10-21swapper/121:30:591
269132281,5sleep10-21swapper/121:16:391
264462281,5sleep10-21swapper/100:09:111
199022281,5sleep10-21swapper/119:33:111
170122281,5sleep10-21swapper/123:43:501
158572281,5sleep10-21swapper/120:48:591
1570699289,5cyclictest40250irq/92-i91521:55:551
1570699288,5cyclictest40250irq/92-i91520:30:251
1570699287,17cyclictest0-21swapper/120:10:291
1570699286,5cyclictest40250irq/92-i91523:10:171
1570699282,7cyclictest2695-21snmpd23:05:361
1570699282,22cyclictest25271-21users19:45:281
15706992819,5cyclictest24157-21grep00:00:291
1570699281,8cyclictest11397-21ps20:35:271
245802271,5sleep10-21swapper/122:35:451
1570699277,5cyclictest40250irq/92-i91523:20:181
1570699274,19cyclictest3286-21runrttasks22:20:261
1570699272,6cyclictest8065-21latency_hist21:55:001
1570699272,21cyclictest21635-21iostat23:55:191
1570699272,21cyclictest21635-21iostat23:55:181
1570699271,8cyclictest522-21chrt20:07:181
1570699271,7cyclictest29611-21/usr/sbin/munin21:25:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional