You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 19:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Thu Apr 16, 2026 12:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8150996743,16cyclictest35966irq/58-eth010:30:153
812699648,11cyclictest131rcu_preempt09:05:131
811699574,7cyclictest131rcu_preempt08:40:120
811699521,43cyclictest19349-21ssh10:00:110
8126994910,27cyclictest22677-21ssh11:50:141
8116994835,5cyclictest26118-21diskmemload11:45:130
811699481,35cyclictest24733-21ssh09:45:120
815099463,30cyclictest35966irq/58-eth012:25:113
813599462,36cyclictest1355-21wc09:30:252
812699455,34cyclictest6666-21ssh11:05:131
815099434,25cyclictest35966irq/58-eth009:45:133
811699432,29cyclictest8362-21ssh12:00:130
811699431,33cyclictest28413-21ssh10:05:130
815099425,23cyclictest35966irq/58-eth009:40:123
815099421,37cyclictest0-21swapper/310:05:143
813599423,21cyclictest24605-21ssh11:15:122
813599421,37cyclictest20977-21ssh09:25:122
811699423,26cyclictest15689-21ssh09:40:120
811699421,28cyclictest13409-21ssh12:37:560
811699413,30cyclictest26529-21ssh09:10:130
811699411,35cyclictest22708-21apt-get07:25:110
811699411,31cyclictest30016-21ssh12:30:120
815099402,25cyclictest35966irq/58-eth009:35:133
812699401,31cyclictest2971-21ssh10:45:141
811699401,33cyclictest8280-21apt-get07:10:110
812699391,31cyclictest11942-21ssh09:20:131
811699391,35cyclictest0-21swapper/010:50:140
811699391,34cyclictest0-21swapper/008:25:120
811699391,34cyclictest0-21swapper/007:20:120
811699391,29cyclictest16732-21ssh10:34:400
811699391,22cyclictest21129-21ssh12:05:280
813599389,21cyclictest27-21ksoftirqd/212:00:132
811699381,21cyclictest28297-21ntpq11:15:250
811699380,28cyclictest26118-21diskmemload10:26:580
811699380,25cyclictest8514-21ssh12:16:190
811699380,25cyclictest8514-21ssh12:16:190
811699380,24cyclictest26118-21diskmemload11:57:080
815099371,34cyclictest0-21swapper/311:20:143
811699378,21cyclictest12-21ksoftirqd/009:25:110
811699372,30cyclictest0-21swapper/009:30:110
8116993714,18cyclictest0-21swapper/007:40:120
811699371,33cyclictest5853-21apt-get08:15:120
811699371,33cyclictest0-21swapper/009:00:100
811699371,31cyclictest0-21swapper/009:35:150
811699371,20cyclictest5255-21cat08:10:300
811699371,19cyclictest4907-21apt-get10:10:120
811699370,25cyclictest10197-21ssh11:41:210
815099361,32cyclictest0-21swapper/310:50:143
813599363,23cyclictest261rcuc/209:00:102
812699364,28cyclictest26362-21ssh12:10:121
811699361,31cyclictest21532-21apt-get09:05:130
811699361,31cyclictest0-21swapper/011:25:140
811699361,21cyclictest17092-21ssh12:20:480
811699360,25cyclictest24926-21ssh10:38:420
815099352,22cyclictest35966irq/58-eth008:05:133
812699356,25cyclictest131rcu_preempt12:20:141
812699353,23cyclictest30031-21ssh12:30:131
811699352,28cyclictest0-21swapper/010:20:120
811699351,31cyclictest0-21swapper/009:50:100
811699351,30cyclictest15665-21ssh11:10:130
811699351,22cyclictest11305-21rm10:49:450
811699351,17cyclictest23654-21ntp_192.168.11408:30:240
811699350,21cyclictest26118-21diskmemload11:09:560
815099347,14cyclictest35966irq/58-eth010:25:133
815099341,27cyclictest0-21swapper/312:30:123
813599342,17cyclictest9259-21cut09:35:212
811699346,15cyclictest0-21swapper/009:55:380
8116993416,14cyclictest0-21swapper/009:15:130
811699341,30cyclictest0-21swapper/010:55:140
811699341,29cyclictest4861-21/usr/sbin/munin11:20:270
811699341,28cyclictest0-21swapper/008:00:110
811699341,19cyclictest2247-21ssh11:37:330
811699341,18cyclictest19583-21ssh10:16:310
815099330,31cyclictest35966irq/58-eth010:55:153
812699334,20cyclictest21-21ksoftirqd/107:10:131
8126993325,4cyclictest0-21swapper/109:10:121
811699335,25cyclictest30061-21ssh11:00:140
8116993317,11cyclictest0-21swapper/010:40:140
811699331,29cyclictest18225-21ssh09:22:110
811699331,28cyclictest0-21swapper/007:45:130
811699331,21cyclictest14931-21kthreadcore07:15:200
815099322,16cyclictest35966irq/58-eth011:35:143
815099321,27cyclictest0-21swapper/309:20:133
8135993221,7cyclictest261rcuc/210:50:152
813599321,23cyclictest628-21tcf-agent08:15:122
811699321,27cyclictest3286-21grep08:45:190
811699321,26cyclictest2435-21ssh12:14:490
815099313,17cyclictest35966irq/58-eth009:15:133
813599313,21cyclictest0-21swapper/208:40:132
8126993124,4cyclictest630-21Async09:36:311
812699312,26cyclictest30059-21rm11:00:141
812699312,22cyclictest1198-21ssh11:20:141
811699311,28cyclictest27073-21ssh11:34:120
811699311,27cyclictest10661-21sendmail_mailqu08:50:270
811699311,27cyclictest0-21swapper/008:55:120
811699311,27cyclictest0-21swapper/007:35:130
811699311,26cyclictest19849-21grep07:55:200
811699311,25cyclictest22665-21apt-get11:50:120
811699310,20cyclictest25724-21kthreadcore08:35:190
813599304,17cyclictest27346irq/40-dwc2_hso10:30:142
813599303,20cyclictest0-21swapper/207:30:132
813599303,11cyclictest29091-21ssh10:59:232
813599302,21cyclictest20766-21kworker/u8:211:30:142
813599302,18cyclictest27346irq/40-dwc2_hso08:35:132
813599302,13cyclictest2977-21ssh10:45:142
813599302,11cyclictest19158-21memory09:40:222
812699305,16cyclictest19159-21ssh11:30:131
8126993020,7cyclictest201rcuc/110:05:141
811699301,26cyclictest27700-21fw_packets07:30:150
811699301,25cyclictest18360-21getconf07:50:290
811699301,25cyclictest13267-21kthreadcore08:20:210
811699301,18cyclictest25845-21ssh12:25:310
815099292,22cyclictest0-21swapper/311:55:133
8150992917,9cyclictest0-21swapper/307:10:113
815099291,23cyclictest0-21swapper/311:45:123
815099291,22cyclictest0-21swapper/312:35:143
813599293,20cyclictest27346irq/40-dwc2_hso07:45:122
813599292,20cyclictest0-21swapper/207:35:142
813599292,19cyclictest27346irq/40-dwc2_hso07:55:142
813599292,16cyclictest27346irq/40-dwc2_hso11:50:132
812699294,21cyclictest28055-21kworker/u8:110:40:131
812699291,15cyclictest26118-21diskmemload10:35:141
811699291,25cyclictest8122-21sed07:10:010
811699291,24cyclictest29002-21if_eth008:05:180
815099283,18cyclictest0-21swapper/309:25:123
815099283,16cyclictest0-21swapper/311:52:233
815099282,22cyclictest0-21swapper/309:50:103
815099281,22cyclictest0-21swapper/309:10:133
812699283,22cyclictest6678-21ssh09:35:131
812699282,20cyclictest26642-21ssh10:03:221
8150992719,5cyclictest0-21swapper/311:40:143
8150992716,6cyclictest0-21swapper/310:20:133
8150992716,5cyclictest0-21swapper/308:40:123
815099271,22cyclictest0-21swapper/309:00:103
813599272,21cyclictest0-21swapper/207:25:122
813599272,20cyclictest1294-21kthreadcore11:55:222
813599272,19cyclictest0-21swapper/208:25:132
813599272,19cyclictest0-21swapper/208:05:152
813599271,14cyclictest13917-21ssh10:15:142
812699272,19cyclictest4389-21rm11:55:461
815099262,20cyclictest0-21swapper/307:35:133
815099262,18cyclictest0-21swapper/312:05:123
8150992618,4cyclictest0-21swapper/312:15:123
8150992618,4cyclictest0-21swapper/312:15:123
8150992618,4cyclictest0-21swapper/311:05:153
815099261,21cyclictest0-21swapper/311:10:133
815099260,23cyclictest0-21swapper/311:30:123
813599269,15cyclictest0-21swapper/211:35:142
813599267,9cyclictest27-21ksoftirqd/207:40:122
813599262,20cyclictest0-21swapper/211:05:152
813599262,13cyclictest27346irq/40-dwc2_hso12:35:132
812699262,19cyclictest19983-21sh10:54:231
815099255,18cyclictest35966irq/58-eth011:15:123
815099253,16cyclictest35966irq/58-eth007:40:123
815099251,21cyclictest0-21swapper/312:20:133
815099251,19cyclictest0-21swapper/308:25:123
813599259,2cyclictest131rcu_preempt12:05:182
813599253,16cyclictest0-21swapper/210:04:222
813599252,15cyclictest27346irq/40-dwc2_hso10:20:112
813599251,9cyclictest17447-21sh10:35:142
8135992513,5cyclictest17309-21ssh12:21:032
812699252,15cyclictest4939-21ssh10:10:141
812699251,21cyclictest21024-21ssh10:55:141
815099242,18cyclictest0-21swapper/309:30:113
815099242,16cyclictest0-21swapper/310:40:143
8150992416,4cyclictest0-21swapper/310:00:123
815099241,20cyclictest0-21swapper/311:00:133
815099241,20cyclictest0-21swapper/310:45:143
813599242,5cyclictest0-21swapper/209:50:102
813599241,4cyclictest0-21swapper/211:45:132
813599240,21cyclictest3127-21ls09:15:142
813599240,16cyclictest10645-21find08:20:122
812699248,10cyclictest3019-21rm09:15:121
812699243,3cyclictest131rcu_preempt11:41:331
815099239,11cyclictest35966irq/58-eth010:10:133
815099232,18cyclictest0-21swapper/312:10:203
815099231,19cyclictest0-21swapper/309:55:193
815099231,19cyclictest0-21swapper/307:15:123
815099230,18cyclictest0-21swapper/310:35:153
813599234,13cyclictest27346irq/40-dwc2_hso12:15:132
813599234,13cyclictest27346irq/40-dwc2_hso12:15:132
813599232,5cyclictest0-21swapper/210:10:122
813599232,16cyclictest27346irq/40-dwc2_hso08:50:132
813599232,16cyclictest0-21swapper/211:04:232
8135992316,4cyclictest2094-21ssh11:20:202
8135992312,8cyclictest29723-21tr09:10:222
813599231,14cyclictest4696-21ssh11:40:142
812699232,16cyclictest20949-21ssh12:25:121
812699232,16cyclictest10249-21ssh11:25:151
812699231,17cyclictest73-21kswapd012:15:131
812699231,17cyclictest73-21kswapd012:15:131
8126992311,10cyclictest0-21swapper/108:35:301
8126992310,10cyclictest24222-21cron11:15:011
815099222,18cyclictest0-21swapper/307:55:133
815099221,18cyclictest0-21swapper/312:00:123
815099221,17cyclictest0-21swapper/310:15:143
815099221,17cyclictest0-21swapper/307:25:113
815099221,15cyclictest0-21swapper/308:20:123
815099220,20cyclictest0-21swapper/311:25:143
813599222,16cyclictest27346irq/40-dwc2_hso09:55:122
813599221,11cyclictest12330-21ssh11:25:222
8135992210,5cyclictest2552-21cron10:45:012
812699223,15cyclictest31889-21ssh10:25:131
812699222,14cyclictest21-21ksoftirqd/108:15:121
8126992212,6cyclictest0-21swapper/109:25:151
815099211,17cyclictest0-21swapper/308:45:143
815099211,12cyclictest35966irq/58-eth007:45:113
815099210,18cyclictest0-21swapper/308:35:123
813599218,9cyclictest2548-21kthreadcore08:10:192
813599213,9cyclictest21163-21fschecks_time12:25:142
813599212,4cyclictest30022-21ssh12:30:132
8135992111,8cyclictest0-21swapper/209:45:112
813599211,17cyclictest0-21swapper/207:10:122
813599211,15cyclictest3421-21ssh10:25:292
813599211,13cyclictest27346irq/40-dwc2_hso09:20:132
813599211,11cyclictest28776-21/usr/sbin/munin10:05:192
812699219,4cyclictest131rcu_preempt08:30:251
812699211,17cyclictest11918-21ls12:00:221
812699211,16cyclictest30036-21cut08:40:151
8150992014,4cyclictest0-21swapper/307:50:123
815099201,17cyclictest0-21swapper/308:30:133
815099201,16cyclictest0-21swapper/308:50:133
815099201,16cyclictest0-21swapper/308:10:153
815099201,16cyclictest0-21swapper/307:30:223
815099201,16cyclictest0-21swapper/307:20:113
815099201,15cyclictest0-21swapper/308:55:123
815099200,17cyclictest0-21swapper/309:05:243
813599209,9cyclictest0-21swapper/212:14:212
813599208,5cyclictest17808-21grep07:20:012
813599203,8cyclictest25069-21kthreadcore08:00:182
813599202,15cyclictest3153-21kthreadcore08:45:192
813599201,11cyclictest18657-21kthreadcore11:10:222
813599201,10cyclictest25104-21cat09:05:272
812699209,7cyclictest21-21ksoftirqd/109:45:121
8126992012,4cyclictest131rcu_preempt09:50:101
8126992011,6cyclictest18666-21kthreadcore09:40:221
8150991913,4cyclictest0-21swapper/308:15:123
815099191,16cyclictest0-21swapper/308:00:123
813599197,10cyclictest21279-21kthreadcore08:30:202
813599194,3cyclictest131rcu_preempt07:20:132
813599191,9cyclictest14471-21tune2fs07:50:152
813599191,9cyclictest14189-21kthreadcore08:55:202
812699198,9cyclictest0-21swapper/109:57:321
812699197,10cyclictest0-21swapper/108:25:221
812699196,4cyclictest131rcu_preempt11:35:221
812699193,13cyclictest22879-21ssh10:20:111
812699192,2cyclictest131rcu_preempt08:45:121
812699191,9cyclictest2575-21kthreadcore08:10:191
8126991913,4cyclictest21-21ksoftirqd/108:05:311
8126991913,3cyclictest0-21swapper/112:05:141
812699190,2cyclictest131rcu_preempt10:32:321
812699190,17cyclictest13671-21apt-get11:45:121
812699189,5cyclictest21-21ksoftirqd/111:15:121
812699186,3cyclictest131rcu_preempt07:30:251
812699181,2cyclictest131rcu_preempt07:15:201
812699181,13cyclictest26507-21sed07:25:271
812699177,8cyclictest10660-21apt-get08:20:121
812699174,11cyclictest0-21swapper/107:35:211
812699173,11cyclictest9664-21fschecks_time07:45:151
812699171,4cyclictest17425-21ssh10:15:231
812699171,4cyclictest131rcu_preempt12:39:151
8126991712,3cyclictest0-21swapper/109:00:161
8126991711,4cyclictest18682-21usage_EthcTask07:50:291
812699171,12cyclictest27324-21ntp_192.168.11408:00:231
812699168,5cyclictest12870-21kthreadcore08:55:181
812699163,10cyclictest20449-21kthreadcore07:55:201
812699161,8cyclictest4655-21/usr/sbin/munin07:40:101
812699161,12cyclictest6782-21apt-get08:50:031
812699161,12cyclictest19639-21tr07:20:191
815099151,12cyclictest0-21swapper/307:10:013
812699151,10cyclictest8228-21grep07:10:011
813599131,9cyclictest8104-21cyclictest07:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional