You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 03:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Wed Apr 22, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
66519912001167,23cyclictest0-21swapper/019:25:070
66529911981173,21cyclictest13915-21ntp_states19:40:251
66529911961181,12cyclictest0-21swapper/119:25:101
61922616571,29sleep10-21swapper/119:20:451
64482605556,33sleep00-21swapper/019:23:240
66519910192,6cyclictest0-21swapper/019:40:250
110712990,3sleep041ktimersoftd/022:12:300
292532940,3sleep00-21swapper/021:58:040
250062880,8sleep0665199cyclictest21:20:180
665199751,40cyclictest9381-21ssh21:37:190
665199741,40cyclictest4226-21ssh22:39:240
665199731,40cyclictest19404-21ssh23:28:020
665199712,55cyclictest22781-21/usr/sbin/munin20:05:160
665199711,5cyclictest16638-21taskset19:49:410
665199711,5cyclictest10282-21taskset20:56:100
665199711,40cyclictest14446-21ssh23:22:510
665199705,34cyclictest15009-21grep22:50:140
665199701,6cyclictest24968-21taskset22:26:350
665199701,42cyclictest28313-21taskset23:36:550
665199681,7cyclictest29615-21chrt20:22:400
665199671,6cyclictest6030-21sh22:07:130
665199661,5cyclictest14012-21ntp_states22:15:240
665199661,41cyclictest27921-21/usr/sbin/munin22:30:140
665199653,41cyclictest15139-21iostat00:30:190
665199651,5cyclictest25940-21taskset20:13:420
665199651,50cyclictest2630-21ssh00:51:090
665199648,35cyclictest32031-21rm00:48:250
665199647,37cyclictest25098-21sh21:54:020
665199647,27cyclictest40250irq/92-i91522:45:490
665199646,37cyclictest3286-21runrttasks21:42:310
665199639,24cyclictest17415-21chrt21:12:170
665199631,7cyclictest4302-21ssh21:31:590
6651996311,35cyclictest6797-21runrttasks20:48:570
665199627,32cyclictest11202-21ssh00:25:390
665199621,5cyclictest30361-21fschecks_count20:25:160
6651996211,33cyclictest31736-21sed22:00:230
665199613,37cyclictest21714-21iostat_ios23:30:200
665199611,47cyclictest26382-21ssh00:41:360
665199611,39cyclictest15886-21sh23:57:410
665199601,5cyclictest24292-21ssh00:05:490
665199601,42cyclictest842-21/usr/sbin/munin00:15:270
665199601,41cyclictest19312-21taskset00:35:110
665199601,40cyclictest3144-21ssh23:45:050
665199601,38cyclictest10743-21taskset19:32:050
665199601,36cyclictest22136-21seq20:03:070
665199599,30cyclictest0-21swapper/023:02:230
665199591,37cyclictest23455-21rm22:59:100
6651995911,43cyclictest4274-21ssh23:12:100
665199581,8cyclictest9795-21ssh23:50:530
665199581,7cyclictest14442-21diskmemload23:18:080
665199581,5cyclictest29571-21ssh00:11:270
6651995815,37cyclictest7664-21iostat_ios20:50:200
665199581,36cyclictest17034-21iostat21:45:200
6651995811,32cyclictest7834-21ssh00:22:470
6651995810,29cyclictest5476-21perl22:40:170
665199572,33cyclictest21040-21users21:15:320
665199571,40cyclictest21773-21ssh22:23:580
665199571,40cyclictest21773-21ssh22:23:580
665199571,36cyclictest32672-21ssh21:28:140
665199571,34cyclictest32559-21ssh23:41:020
665199571,34cyclictest17872-21/usr/sbin/munin00:00:120
6651995710,29cyclictest12724-21cut21:05:110
665199562,6cyclictest19583-21proc_pri19:55:260
665199551,6cyclictest27503-21vmstat20:15:290
665199551,49cyclictest29861-21irqstats23:05:210
665199541,6cyclictest12949-21grep19:40:000
665199532,5cyclictest32049-21grep20:30:120
665199531,5cyclictest17528-21wc19:50:230
665199521,6cyclictest3777-21fschecks_time20:40:150
665199511,7cyclictest12325-21taskset21:02:390
665199511,5cyclictest2469-21wc20:35:300
665299376,4cyclictest81rcu_preempt23:36:361
665299371,17cyclictest14736-21kworker/1:221:16:171
302862351,4sleep130296-21ssh21:59:351
665299347,23cyclictest0-21swapper/100:47:581
665299344,26cyclictest3286-21runrttasks23:34:171
665299341,7cyclictest23893-21pidof00:40:001
6652993415,15cyclictest22-21ksoftirqd/122:05:531
279692341,29sleep127981-21rm23:03:421
251472340,8sleep1665299cyclictest21:20:211
238762341,30sleep114736-21kworker/1:222:59:491
665299339,8cyclictest81rcu_preempt23:42:491
665299335,15cyclictest0-21swapper/100:29:571
6652993321,7cyclictest7809-21ssh21:35:281
54982331,4sleep15589-21ssh00:20:231
42512331,29sleep14262-21sh00:19:391
285382331,4sleep127448-21/usr/sbin/munin00:10:281
272982331,4sleep10-21swapper/122:30:001
200592331,28sleep120061-21ssh22:21:291
200592331,28sleep120061-21ssh22:21:291
109622331,28sleep110975-21sh22:12:221
665299326,22cyclictest0-21swapper/122:50:331
665299321,17cyclictest7361-21diskstats20:50:151
6652993210,8cyclictest13699-21sh22:49:031
29122321,27sleep12923-21ssh22:04:461
250472321,27sleep124172-21/usr/sbin/munin00:40:251
142802321,4sleep114293-21ssh23:22:391
665299317,20cyclictest3129-21ssh23:10:321
665299317,15cyclictest201rcuc/100:00:241
6652993114,14cyclictest22-21ksoftirqd/123:06:241
665299311,26cyclictest0-21swapper/122:42:471
665299311,18cyclictest22725-21ssh00:05:141
665299311,16cyclictest20904-21diskstats20:00:151
308622311,5sleep10-21swapper/121:25:391
232762311,26sleep114736-21kworker/1:221:51:251
665299307,12cyclictest40250irq/92-i91523:51:361
665299306,12cyclictest40250irq/92-i91520:45:131
665299301,8cyclictest0-21swapper/119:50:241
665299301,4cyclictest81rcu_preempt23:25:501
665299301,17cyclictest25387-21swap20:10:281
665299301,15cyclictest4136-21ntp_states20:40:241
665299301,15cyclictest20172-21taskset19:57:231
665299301,15cyclictest12740-21chrt19:38:201
6652993010,16cyclictest0-21swapper/122:38:051
665299296,12cyclictest22-21ksoftirqd/100:50:121
665299294,9cyclictest1600-21diskstats20:35:161
665299292,14cyclictest14024-21ntp_states22:15:251
6652992912,13cyclictest14041-21mailstats23:55:271
665299291,16cyclictest16012-21ssh21:44:541
665299291,15cyclictest13549-21ntp_states21:05:261
110082291,5sleep10-21swapper/119:34:541
665299289,16cyclictest0-21swapper/123:47:551
665299289,15cyclictest0-21swapper/121:30:021
665299286,7cyclictest11565-21gdbus20:34:171
6652992819,5cyclictest14586-21cpu00:30:111
6652992815,10cyclictest22-21ksoftirqd/121:45:431
665299281,23cyclictest30087-21ssh22:32:001
665299281,14cyclictest7222-21ssh23:15:221
665299280,15cyclictest17037-21runrttasks21:11:451
106242281,5sleep10-21swapper/120:59:451
665299272,20cyclictest26522-21df_inode20:15:141
241032271,5sleep10-21swapper/120:09:041
665299261,4cyclictest81rcu_preempt21:02:321
310192261,5sleep10-21swapper/120:25:291
665299259,5cyclictest40250irq/92-i91519:45:221
665299242,8cyclictest28707-21if_eth020:20:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional