You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 23:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Apr 07, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
162809912111189,18cyclictest17439-21smartctl07:25:281
162799912061179,6cyclictest0-21swapper/007:25:310
159282660613,32sleep00-21swapper/007:21:540
159142562518,29sleep10-21swapper/107:21:461
1075021200,2sleep010751-21cat10:35:230
151652760,8sleep01627999cyclictest08:45:130
1627999493,26cyclictest4204-21iostat_ios09:55:200
191072480,2sleep019108-21cat08:55:120
211222450,3sleep0111rcuc/011:20:050
218522440,4sleep121851-21fschecks_time09:40:151
268582431,25sleep126869-21ssh10:19:091
1627999431,20cyclictest20247-21taskset10:45:190
16280994218,8cyclictest22-21ksoftirqd/110:20:181
112482420,4sleep111205-21ssh10:35:311
16280994118,8cyclictest22-21ksoftirqd/107:37:061
16280994117,8cyclictest22-21ksoftirqd/108:37:161
16280994117,8cyclictest22-21ksoftirqd/108:37:151
16280994110,27cyclictest0-21swapper/112:44:551
16280994110,20cyclictest2403-21irqbalance10:47:261
16279994110,15cyclictest0-21swapper/010:07:520
16280994017,8cyclictest22-21ksoftirqd/107:49:191
16280994014,7cyclictest22-21ksoftirqd/111:27:291
16280994014,7cyclictest22-21ksoftirqd/111:22:051
1627999408,13cyclictest7869-21ssh10:32:250
1627999402,15cyclictest29990-21iostat_ios10:55:220
162912391,34sleep116302-21ssh10:07:501
1628099396,21cyclictest0-21swapper/109:45:291
16280993913,6cyclictest22-21ksoftirqd/109:32:411
16279993911,11cyclictest0-21swapper/010:53:120
16280993815,7cyclictest22-21ksoftirqd/111:35:241
16280993813,7cyclictest22-21ksoftirqd/109:16:101
1627999388,11cyclictest3274-21ssh12:08:060
69432372,3sleep00-21swapper/011:38:380
1628099375,4cyclictest81rcu_preempt11:40:131
1628099374,16cyclictest12448-21ntp_states11:10:241
16280993716,7cyclictest22-21ksoftirqd/112:25:151
16280993716,7cyclictest22-21ksoftirqd/109:26:111
16280993716,6cyclictest22-21ksoftirqd/110:40:391
16280993716,10cyclictest13705-21iostat_ios11:45:221
16280993715,7cyclictest22-21ksoftirqd/112:48:161
16280993715,7cyclictest22-21ksoftirqd/112:02:101
16280993715,7cyclictest22-21ksoftirqd/111:54:391
16280993715,7cyclictest22-21ksoftirqd/109:55:171
16280993715,7cyclictest22-21ksoftirqd/107:34:491
16280993715,6cyclictest22-21ksoftirqd/111:58:491
16280993713,9cyclictest3184-21swap09:20:291
16280993712,7cyclictest22-21ksoftirqd/110:31:351
16280993711,7cyclictest22-21ksoftirqd/112:07:191
1627999371,6cyclictest22663-21wget09:05:090
16279993711,5cyclictest29674-21ssh12:01:290
1628099362,30cyclictest0-21swapper/109:13:361
16280993615,7cyclictest22-21ksoftirqd/110:52:441
16280993615,6cyclictest22-21ksoftirqd/112:36:121
16280993614,7cyclictest22-21ksoftirqd/112:23:261
16280993614,7cyclictest22-21ksoftirqd/111:19:181
1628099361,21cyclictest1511-21ssh09:52:381
16280993612,14cyclictest22-21ksoftirqd/112:32:081
1627999369,9cyclictest29449-21/usr/sbin/munin09:15:110
1627999365,12cyclictest28442-21sh09:13:560
1627999362,6cyclictest3325-21chrt08:12:070
1627999362,18cyclictest0-21swapper/009:42:260
1627999362,14cyclictest5051-21/usr/sbin/munin08:15:310
1627999361,6cyclictest19201-21runrttasks10:44:470
1627999361,15cyclictest22888-21expr11:55:130
16279993610,7cyclictest19957-21ssh11:51:260
8462351,5sleep10-21swapper/110:59:141
83682351,31sleep18382-21ssh11:05:541
83682351,31sleep18382-21ssh11:05:531
16280993514,6cyclictest22-21ksoftirqd/111:00:011
16280993513,7cyclictest22-21ksoftirqd/108:32:561
1627999353,5cyclictest12140-21ntp_states08:35:250
1627999353,5cyclictest12140-21ntp_states08:35:240
16279993524,7cyclictest29530-21ssh09:48:130
1627999352,29cyclictest918-21python08:05:280
1627999352,14cyclictest9862-21ssh09:27:440
1627999351,29cyclictest11409-21ssh11:10:030
16279993512,5cyclictest17452-21perl08:50:160
16279993511,6cyclictest18308-21cstates10:10:120
1627999351,15cyclictest28766-21ssh12:35:000
1627999351,14cyclictest14494-21ssh11:45:320
1627999351,13cyclictest2324-21ssh11:34:040
1627999351,13cyclictest2067-21grep09:20:120
1627999351,13cyclictest13896-21ssh12:53:370
180412341,29sleep018053-21ssh12:23:270
16280993426,6cyclictest0-21swapper/108:58:361
1628099341,6cyclictest0-21swapper/109:02:371
16280993413,7cyclictest22-21ksoftirqd/112:14:441
16280993413,7cyclictest22-21ksoftirqd/110:27:211
16280993413,6cyclictest22-21ksoftirqd/110:10:481
1628099341,20cyclictest1437-21ssh11:32:481
16280993411,8cyclictest19848-21ssh09:38:131
16279993425,6cyclictest17071-21cut09:35:170
1627999341,15cyclictest26142-21ssh10:18:050
1627999341,14cyclictest8308-21cat08:25:220
1627999341,13cyclictest16175-21ssh09:34:540
24332331,28sleep02518-21memory11:00:220
1628099331,9cyclictest3302-21runrttasks09:06:031
16280993312,6cyclictest22-21ksoftirqd/110:02:221
16280993311,7cyclictest22-21ksoftirqd/112:16:541
1627999331,7cyclictest1235-21ssh12:40:010
1627999331,6cyclictest22195-21ssh12:27:280
1627999331,30cyclictest0-21swapper/007:41:150
1627999331,14cyclictest27043-21tune2fs07:50:150
1627999331,14cyclictest2247-21/usr/sbin/munin12:40:220
1627999331,13cyclictest7570-21ssh11:05:240
1627999331,13cyclictest7570-21ssh11:05:230
1627999331,13cyclictest21682-21/usr/sbin/munin07:35:230
306132321,5sleep00-21swapper/010:22:340
1628099329,8cyclictest16277-21cyclictest08:26:221
1628099321,6cyclictest3789-21/usr/sbin/munin08:15:311
16280993211,7cyclictest16277-21cyclictest08:41:351
16280993210,8cyclictest5533-21kworker/1:508:46:201
16280993210,7cyclictest11735-21ssh12:50:271
16279993222,7cyclictest3589-21ssh10:28:140
1627999321,13cyclictest25103-21expr07:45:130
33082310,5sleep0111rcuc/009:55:010
1628099312,10cyclictest3302-21runrttasks07:40:231
1627999315,22cyclictest0-21swapper/011:41:020
16279993116,8cyclictest20690-21munin-run07:35:010
1627999311,5cyclictest0-21swapper/012:49:560
1627999311,28cyclictest0-21swapper/007:59:160
16279993112,15cyclictest3-21ksoftirqd/011:16:210
1628099307,8cyclictest22-21ksoftirqd/108:09:261
1628099304,15cyclictest0-21swapper/107:56:311
16279993020,6cyclictest12140-21ssh12:16:550
1627999301,27cyclictest0-21swapper/009:01:560
72472291,5sleep00-21swapper/008:23:280
1628099292,9cyclictest6286-21iostat_ios08:20:201
1628099291,15cyclictest0-21swapper/108:02:001
1627999291,26cyclictest0-21swapper/008:33:150
1628099286,8cyclictest16277-21cyclictest08:51:281
1628099281,7cyclictest27060-21tune2fs07:50:141
1628099281,17cyclictest0-21swapper/108:10:411
1627999288,16cyclictest0-21swapper/012:12:280
1627999282,22cyclictest0-21swapper/010:01:140
1627999281,5cyclictest15321-21kworker/0:111:25:390
1627999281,23cyclictest13765-21if_eth008:40:170
16279992718,5cyclictest312972sleep008:00:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional