You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 20:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Sun Aug 09, 2026 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
545899672,9cyclictest21-21ksoftirqd/110:00:141
5467995830,7cyclictest131rcu_preempt10:00:152
546799543,29cyclictest7970-21ssh09:55:122
544399534,10cyclictest12-21ksoftirqd/010:35:130
546799481,33cyclictest9056-21ssh12:20:132
5478994738,6cyclictest35966irq/58-eth009:35:133
5478994729,10cyclictest35966irq/58-eth009:50:133
546799474,34cyclictest18527-21ssh10:55:142
544399473,11cyclictest12-21ksoftirqd/007:25:110
545899464,7cyclictest21-21ksoftirqd/110:50:141
545899464,3cyclictest131rcu_preempt12:20:121
544399462,25cyclictest20033-21ssh11:50:140
5467994419,10cyclictest131rcu_preempt11:45:112
544399447,3cyclictest131rcu_preempt12:35:130
5467994228,9cyclictest16139-21ssh11:30:002
5467994224,11cyclictest27-21ksoftirqd/210:35:132
5467994025,8cyclictest261rcuc/210:23:342
546799402,21cyclictest18036-21ssh10:54:562
5478993920,11cyclictest35966irq/58-eth011:50:133
5478993823,11cyclictest0-21swapper/311:35:143
545899374,3cyclictest131rcu_preempt11:45:121
544399371,4cyclictest131rcu_preempt12:30:120
547899363,20cyclictest35966irq/58-eth009:55:133
546799362,28cyclictest25908-21ssh09:28:272
546799362,17cyclictest27602-21/usr/sbin/munin09:30:282
546799362,17cyclictest1937-21ssh10:09:422
5467993612,13cyclictest27-21ksoftirqd/211:15:122
545899369,4cyclictest131rcu_preempt10:20:111
544399364,2cyclictest131rcu_preempt08:10:140
547899358,22cyclictest35966irq/58-eth010:35:153
547899355,22cyclictest35966irq/58-eth011:45:123
547899352,25cyclictest35966irq/58-eth007:50:133
5478993517,12cyclictest35966irq/58-eth010:00:153
545899351,28cyclictest14561-21ssh12:05:131
546799342,16cyclictest930-21snmpd11:20:132
547899333,25cyclictest35966irq/58-eth010:25:123
547899331,21cyclictest35966irq/58-eth007:35:123
547899331,18cyclictest35966irq/58-eth010:20:123
545899336,19cyclictest31404-21ssh09:50:131
544399333,18cyclictest20517-21ssh10:20:130
544399332,7cyclictest131rcu_preempt08:30:130
547899322,21cyclictest35966irq/58-eth008:55:123
5478993219,9cyclictest0-21swapper/309:05:123
547899321,21cyclictest35966irq/58-eth011:25:143
546799324,4cyclictest131rcu_preempt09:00:142
546799323,12cyclictest11565-21ssh10:15:142
545899321,23cyclictest23549-21diskmemload09:30:131
545899321,22cyclictest22363-21ssh09:45:131
547899315,20cyclictest35966irq/58-eth009:15:143
547899313,17cyclictest35966irq/58-eth010:10:113
547899312,17cyclictest35966irq/58-eth012:25:143
546799314,8cyclictest5431-21cyclictest09:15:132
546799312,23cyclictest29483-21ssh10:25:122
544399312,22cyclictest13348-21ssh09:40:170
5443993117,10cyclictest0-21swapper/008:45:150
544399311,22cyclictest9595-21ssh10:50:130
547899304,21cyclictest35966irq/58-eth009:20:143
5478993010,14cyclictest0-21swapper/310:55:143
545899300,25cyclictest0-21swapper/112:25:131
544399305,3cyclictest131rcu_preempt08:05:140
544399305,15cyclictest23968-21ssh09:10:150
544399303,23cyclictest27537-21ssh11:00:130
544399303,23cyclictest27537-21ssh11:00:120
5478992919,6cyclictest0-21swapper/312:20:123
5478992917,7cyclictest0-21swapper/311:05:143
5478992916,9cyclictest0-21swapper/310:05:143
5478992916,7cyclictest35966irq/58-eth011:30:133
546799292,20cyclictest0-21swapper/207:35:142
545899291,4cyclictest131rcu_preempt08:50:141
5458992913,4cyclictest21-21ksoftirqd/112:35:191
544399291,18cyclictest73-21kswapd012:05:120
547899283,15cyclictest35966irq/58-eth010:15:153
546799283,14cyclictest27346irq/40-dwc2_hso11:10:142
546799282,19cyclictest27346irq/40-dwc2_hso09:45:132
545899288,3cyclictest21-21ksoftirqd/107:40:261
545899284,6cyclictest21-21ksoftirqd/110:05:141
545899282,20cyclictest16300-21ssh09:59:411
5458992817,8cyclictest21-21ksoftirqd/111:00:121
5458992817,8cyclictest21-21ksoftirqd/111:00:111
5458992810,15cyclictest21-21ksoftirqd/110:30:131
544399284,20cyclictest2610-21ssh10:10:140
5443992811,11cyclictest0-21swapper/011:22:560
5478992720,2cyclictest0-21swapper/312:10:133
5478992711,11cyclictest0-21swapper/309:40:173
546799273,19cyclictest0-21swapper/211:34:342
546799272,19cyclictest0-21swapper/209:05:152
546799272,15cyclictest27346irq/40-dwc2_hso08:40:132
546799271,11cyclictest12531-21ssh09:39:362
545899279,3cyclictest21-21ksoftirqd/108:45:311
545899273,7cyclictest21-21ksoftirqd/107:50:121
545899272,19cyclictest595-21ssh10:45:121
544399278,3cyclictest131rcu_preempt07:15:180
544399272,19cyclictest26111-21open_inodes09:45:270
5443992714,7cyclictest9577-21ssh09:20:140
5443992714,3cyclictest12-21ksoftirqd/012:29:240
5443992710,11cyclictest0-21swapper/010:56:570
547899264,15cyclictest0-21swapper/311:55:123
547899263,17cyclictest0-21swapper/311:43:323
547899263,16cyclictest0-21swapper/310:54:563
547899263,16cyclictest0-21swapper/310:45:133
547899262,15cyclictest35966irq/58-eth010:30:133
5478992619,4cyclictest0-21swapper/312:35:133
5478992617,4cyclictest0-21swapper/309:00:153
5478992614,9cyclictest0-21swapper/311:10:133
546799264,14cyclictest27346irq/40-dwc2_hso07:15:142
546799263,4cyclictest131rcu_preempt12:30:122
546799262,19cyclictest27-21ksoftirqd/209:42:272
546799262,19cyclictest0-21swapper/210:14:332
545899261,3cyclictest131rcu_preempt08:40:131
5458992613,4cyclictest21-21ksoftirqd/111:35:481
5458992610,10cyclictest0-21swapper/109:00:321
544399264,3cyclictest131rcu_preempt09:15:120
544399261,4cyclictest12-21ksoftirqd/010:40:120
5443992614,3cyclictest12-21ksoftirqd/010:05:200
5443992613,4cyclictest12-21ksoftirqd/011:59:390
547899258,12cyclictest0-21swapper/309:49:393
5478992520,2cyclictest0-21swapper/308:40:133
5478992518,4cyclictest0-21swapper/307:55:133
5478992518,3cyclictest0-21swapper/308:50:133
547899250,19cyclictest0-21swapper/307:40:143
546799251,9cyclictest1275-21ssh11:39:322
546799250,21cyclictest24997-21cut07:30:192
546799250,21cyclictest24997-21cut07:30:182
545899259,3cyclictest21-21ksoftirqd/110:25:261
545899259,2cyclictest21-21ksoftirqd/107:15:211
545899258,3cyclictest21-21ksoftirqd/107:35:271
545899257,4cyclictest131rcu_preempt09:40:161
5458992514,3cyclictest21-21ksoftirqd/112:17:261
544399257,4cyclictest131rcu_preempt09:50:250
544399257,12cyclictest0-21swapper/012:15:140
5443992514,4cyclictest12-21ksoftirqd/011:15:210
5443992514,3cyclictest12-21ksoftirqd/010:33:480
5443992511,4cyclictest12-21ksoftirqd/009:35:150
5443992511,4cyclictest12-21ksoftirqd/007:40:180
547899249,10cyclictest0-21swapper/312:30:143
5478992416,2cyclictest0-21swapper/308:30:143
546799242,7cyclictest0-21swapper/211:40:042
546799242,15cyclictest0-21swapper/209:10:162
546799241,20cyclictest5634-21cpuspeed07:10:152
546799241,14cyclictest1544066ssh09:21:452
545899248,3cyclictest21-21ksoftirqd/110:56:271
545899248,2cyclictest21-21ksoftirqd/110:35:141
545899248,2cyclictest21-21ksoftirqd/109:26:191
545899248,14cyclictest21-21ksoftirqd/109:23:271
545899246,10cyclictest21-21ksoftirqd/111:25:141
5458992412,6cyclictest0-21swapper/112:00:091
5458992412,3cyclictest21-21ksoftirqd/109:05:271
544399242,19cyclictest24842-21apt-get07:30:160
544399242,19cyclictest24842-21apt-get07:30:160
5443992413,3cyclictest12-21ksoftirqd/012:13:340
5443992413,3cyclictest12-21ksoftirqd/011:35:240
5443992412,3cyclictest12-21ksoftirqd/011:08:310
5443992412,3cyclictest12-21ksoftirqd/009:00:160
5443992412,3cyclictest12-21ksoftirqd/007:50:010
547899233,16cyclictest0-21swapper/312:00:143
5478992317,3cyclictest0-21swapper/308:45:133
5478992317,3cyclictest0-21swapper/307:30:163
5478992317,3cyclictest0-21swapper/307:30:163
5478992314,4cyclictest0-21swapper/307:20:143
5478992313,7cyclictest0-21swapper/309:10:243
5478992312,7cyclictest0-21swapper/309:25:233
546799239,5cyclictest7526-21sh10:30:212
546799237,10cyclictest0-21swapper/207:50:142
546799233,13cyclictest27-21ksoftirqd/212:35:142
546799232,6cyclictest0-21swapper/209:53:282
546799232,16cyclictest0-21swapper/212:04:332
546799231,17cyclictest3902-21mailstats12:15:292
546799231,12cyclictest4149-21ssh11:05:142
5467992310,10cyclictest32550-21sshd10:44:542
545899239,8cyclictest0-21swapper/112:11:211
545899239,4cyclictest21-21ksoftirqd/111:42:551
545899237,8cyclictest21-21ksoftirqd/111:50:081
545899233,2cyclictest131rcu_preempt11:11:101
5458992311,3cyclictest21-21ksoftirqd/110:40:211
5458992311,3cyclictest21-21ksoftirqd/108:55:231
544399239,8cyclictest0-21swapper/012:22:340
544399239,3cyclictest131rcu_preempt10:25:290
544399238,5cyclictest12-21ksoftirqd/008:25:230
544399233,14cyclictest18594-21ssh09:25:130
5443992313,3cyclictest12-21ksoftirqd/007:50:310
5443992313,3cyclictest12-21ksoftirqd/007:10:320
5443992312,4cyclictest12-21ksoftirqd/008:50:150
5443992312,3cyclictest12-21ksoftirqd/010:47:230
5443992312,3cyclictest12-21ksoftirqd/010:15:310
5443992312,3cyclictest12-21ksoftirqd/008:00:220
5443992312,2cyclictest12-21ksoftirqd/011:13:490
5443992311,3cyclictest12-21ksoftirqd/009:05:240
5443992311,3cyclictest12-21ksoftirqd/007:20:150
5443992310,4cyclictest12-21ksoftirqd/011:45:180
5443992310,3cyclictest12-21ksoftirqd/011:41:440
5478992217,2cyclictest0-21swapper/310:40:123
5478992217,2cyclictest0-21swapper/309:30:143
5478992216,3cyclictest0-21swapper/311:15:143
5478992215,4cyclictest0-21swapper/312:15:153
5478992215,4cyclictest0-21swapper/308:35:143
5478992215,4cyclictest0-21swapper/307:10:143
5478992214,6cyclictest0-21swapper/307:15:223
5478992212,6cyclictest0-21swapper/311:00:123
5478992212,6cyclictest0-21swapper/311:00:123
5478992211,8cyclictest0-21swapper/307:45:123
546799228,7cyclictest4664-21df_inode08:50:152
546799228,7cyclictest22660-21df08:35:162
546799222,6cyclictest0-21swapper/212:28:342
546799222,15cyclictest0-21swapper/208:15:142
546799222,15cyclictest0-21swapper/208:15:132
546799221,6cyclictest32758-21kthreadcore08:10:232
5467992214,5cyclictest4700-21ssh10:45:302
5467992211,8cyclictest29207-21fschecks_time11:55:142
5467992210,9cyclictest20659-21ssh12:07:032
5467992210,10cyclictest21073-21idleruntime-cro08:00:012
545899228,3cyclictest21-21ksoftirqd/111:15:041
545899226,2cyclictest21-21ksoftirqd/111:22:161
545899224,3cyclictest131rcu_preempt07:10:161
545899222,3cyclictest131rcu_preempt07:45:211
545899222,14cyclictest16567-21ssh11:30:151
5458992210,4cyclictest21-21ksoftirqd/110:15:291
5458992210,4cyclictest21-21ksoftirqd/107:55:301
5458992210,3cyclictest21-21ksoftirqd/112:30:291
5458992210,3cyclictest21-21ksoftirqd/111:55:141
5458992210,3cyclictest21-21ksoftirqd/111:05:271
5458992210,3cyclictest21-21ksoftirqd/110:10:331
5458992210,3cyclictest21-21ksoftirqd/109:35:131
544399229,3cyclictest12-21ksoftirqd/011:25:270
544399223,16cyclictest7180-21kthreadcore12:00:220
5443992212,2cyclictest12-21ksoftirqd/011:32:490
5443992211,3cyclictest12-21ksoftirqd/010:01:060
5443992211,3cyclictest12-21ksoftirqd/009:55:130
5443992211,3cyclictest12-21ksoftirqd/008:40:280
544399220,4cyclictest31030-21kthreadcore09:30:230
5478992116,2cyclictest0-21swapper/311:20:113
5478992112,6cyclictest0-21swapper/312:05:123
5478992112,6cyclictest0-21swapper/308:00:183
546799217,5cyclictest17800-21kthreadcore07:20:212
546799212,16cyclictest28902-21kthreadcore11:00:202
546799212,16cyclictest28902-21kthreadcore11:00:192
546799211,11cyclictest32173-21grep12:15:022
5467992110,7cyclictest27-21ksoftirqd/211:50:142
545899219,4cyclictest21-21ksoftirqd/108:35:261
545899219,3cyclictest21-21ksoftirqd/108:25:151
545899219,3cyclictest21-21ksoftirqd/107:20:301
545899219,2cyclictest21-21ksoftirqd/109:13:581
545899219,2cyclictest21-21ksoftirqd/108:19:231
545899219,2cyclictest21-21ksoftirqd/108:19:221
545899218,4cyclictest21-21ksoftirqd/107:30:261
545899218,4cyclictest21-21ksoftirqd/107:30:251
5458992110,6cyclictest483-21ssh09:15:141
5458992110,3cyclictest21-21ksoftirqd/108:05:171
544399219,3cyclictest12-21ksoftirqd/008:15:150
544399219,3cyclictest12-21ksoftirqd/008:15:150
5443992110,3cyclictest12-21ksoftirqd/008:35:140
5478992013,5cyclictest0-21swapper/308:20:233
5478992011,6cyclictest0-21swapper/308:10:233
5478992010,7cyclictest0-21swapper/308:25:143
546799206,4cyclictest8847-21kthreadcore07:45:212
546799203,8cyclictest20714-21irqrtprio07:25:172
546799203,11cyclictest0-21swapper/208:20:122
546799201,9cyclictest3612-21kthreadcore07:40:212
546799201,16cyclictest27050-21kthreadcore08:05:212
546799201,14cyclictest0-21swapper/208:55:232
545899209,2cyclictest21-21ksoftirqd/108:00:231
545899208,3cyclictest21-21ksoftirqd/107:25:151
545899201,16cyclictest31022-21fschecks_count08:10:151
545899201,16cyclictest19883-21kthreadcore08:30:221
544399209,3cyclictest12-21ksoftirqd/007:35:120
544399209,2cyclictest12-21ksoftirqd/008:55:250
544399209,2cyclictest12-21ksoftirqd/007:55:160
5443992010,2cyclictest12-21ksoftirqd/008:20:230
5478991915,2cyclictest0-21swapper/307:25:113
5478991914,3cyclictest0-21swapper/308:05:163
5478991911,6cyclictest0-21swapper/308:15:123
5478991911,6cyclictest0-21swapper/308:15:123
546799196,10cyclictest32188-21apt-get08:45:132
546799193,7cyclictest23153-21kthreadcore08:00:222
546799191,9cyclictest16130-21kthreadcore08:25:242
546799191,15cyclictest17847-21cpuspeed08:30:162
545899199,3cyclictest21-21ksoftirqd/108:20:131
546799182,8cyclictest5431-21cyclictest07:10:022
545899151,9cyclictest5529-21latency_hist07:10:021
544399141,10cyclictest5449-21grep07:10:020
547899139,2cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional