You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 07:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Aug 11, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117937999881,60cyclictest0-21swapper/020:20:020
117937999864,50cyclictest1233461-21gpgv00:25:010
1179379998051,23cyclictest0-21swapper/019:20:120
117937999781,47cyclictest0-21swapper/023:00:010
117937999711,43cyclictest0-21swapper/023:55:010
117937999702,4cyclictest1180301-21latency_hist19:15:000
1179379996926,36cyclictest0-21swapper/021:10:020
117937999691,11cyclictest1200627-21irqstats21:10:230
1179379996635,27cyclictest20650irq/252-8000000.ethernet20:25:230
117937999663,3cyclictest0-21swapper/020:45:200
1179379996633,27cyclictest1236084-21munin-plugin-st00:40:000
117937999663,2cyclictest0-21swapper/019:50:010
117937999663,2cyclictest0-21swapper/019:50:010
1179379996631,29cyclictest0-21swapper/022:00:170
1179379996544,16cyclictest20650irq/252-8000000.ethernet19:15:010
117937999642,6cyclictest1227452-21munin-run23:50:000
117937999633,31cyclictest1186389-21munin-run19:50:000
1179379996249,7cyclictest1210725-21grep22:10:200
1179379996238,20cyclictest20650irq/252-8000000.ethernet22:35:260
117937999621,5cyclictest1229348-21sed00:00:020
1179379996132,24cyclictest1198341-21grep20:55:280
117937999611,4cyclictest1221934-21perl23:15:240
1179379996045,9cyclictest0-21swapper/000:05:010
117937999602,54cyclictest1660-21snmpd20:50:220
117937999602,54cyclictest1660-21snmpd20:50:220
1179379996018,37cyclictest0-21swapper/023:30:280
117937999601,56cyclictest0-21swapper/019:25:280
117937999601,3cyclictest0-21swapper/020:00:000
117937999592,3cyclictest1234044-21memory00:25:240
1179379995916,35cyclictest0-21swapper/019:40:180
1179379995835,20cyclictest20850irq/208-8000000.ethernet23:35:260
117937999581,54cyclictest1220967-21diskstats23:10:180
117937999581,4cyclictest1222655-21df23:20:180
1179382995748,6cyclictest1183852-21munin-plugin-st19:35:001
117938299574,18cyclictest0-21swapper/123:30:011
117937999571,4cyclictest0-21swapper/021:30:220
117937999571,2cyclictest0-21swapper/021:55:000
1179379995626,22cyclictest0-21swapper/020:10:270
117937999561,3cyclictest1184121-21diskstats19:35:170
1179379995524,25cyclictest20850irq/208-8000000.ethernet21:40:120
117937999551,5cyclictest1232395-21rt-features00:15:300
117937999551,5cyclictest1232395-21rt-features00:15:300
117937999551,4cyclictest0-21swapper/020:05:200
117937999551,3cyclictest1205043-21grep21:35:270
117937999542,10cyclictest1195517-21/usr/sbin/munin20:40:240
117937999541,5cyclictest1231484-21grep00:10:260
117937999541,4cyclictest1212375-21/usr/sbin/munin22:20:120
1179379995413,35cyclictest0-21swapper/022:30:260
1179383995340,9cyclictest0-21swapper/222:25:002
1179382995326,12cyclictest22-21rcuc/119:25:011
1179379995315,35cyclictest1190694-21apt-get20:15:050
117937999531,3cyclictest1206440-21df_inode21:45:190
117937999521,4cyclictest1216138-21meminfo22:40:250
117937999521,3cyclictest1209749-21/usr/sbin/munin22:05:110
1179379995141,6cyclictest1194996-21cron20:40:000
1179379995141,6cyclictest1194996-21cron20:40:000
1179379995122,26cyclictest0-21swapper/021:00:290
117937999512,10cyclictest1203761-21latency_hist21:30:020
117937999511,8cyclictest1234869-21/usr/sbin/munin00:30:240
117937999511,2cyclictest0-21swapper/019:30:300
117938299501,4cyclictest0-21swapper/100:30:021
117937999504,42cyclictest0-21swapper/022:50:200
117937999503,41cyclictest1230863-21grep00:05:320
117937999503,40cyclictest1213953-21latency_hist22:30:010
117937999501,7cyclictest1208289-21/usr/sbin/munin21:55:200
117937999501,7cyclictest1208289-21/usr/sbin/munin21:55:200
117937999501,13cyclictest1223631-21sh23:25:220
1179382994942,4cyclictest1227454-21munin-plugin-st23:50:001
117937999494,32cyclictest1212341-21latency_hist22:20:020
117937999491,6cyclictest1217187-21/usr/sbin/munin22:45:310
117937999491,4cyclictest1226271-21memory23:40:260
117937999491,4cyclictest1226271-21memory23:40:260
117937999491,3cyclictest0-21swapper/023:10:010
1179383994823,10cyclictest0-21swapper/220:40:222
1179382994840,4cyclictest0-21swapper/120:00:001
1179382994834,8cyclictest0-21swapper/100:05:331
1179379994826,17cyclictest1201764-21unixbench_multi21:15:310
1179379994826,17cyclictest1201764-21unixbench_multi21:15:310
117937999481,3cyclictest1202141-21diskstats21:20:200
117938299472,41cyclictest0-21swapper/121:30:011
117937999472,9cyclictest1219981-21cat23:05:020
117937999472,8cyclictest1188381-21/usr/sbin/munin20:00:150
117937999471,8cyclictest1193527-21apt-get20:30:140
1179382994639,4cyclictest1201857-21munin-plugin-st21:20:011
1179382994639,4cyclictest1201857-21munin-plugin-st21:20:011
1179382994632,8cyclictest0-21swapper/121:55:271
1179382994632,8cyclictest0-21swapper/121:55:271
1179383994536,5cyclictest1186416-21latency_hist19:50:012
1179383994535,6cyclictest311ktimers/220:35:202
1179383994535,6cyclictest311ktimers/220:35:202
1179383994436,5cyclictest1188166-21sendmail20:00:002
1179382994437,4cyclictest1225745-21cron23:40:001
117938299433,9cyclictest0-21swapper/119:50:001
1179382994336,4cyclictest1229139-21sendmail00:00:001
1179383994235,3cyclictest1217319-21munin-plugin-st22:50:012
1179383994231,8cyclictest0-21swapper/221:15:002
1179383994228,8cyclictest0-21swapper/219:10:462
1179382994229,8cyclictest0-21swapper/100:35:301
117937999421,6cyclictest1179491-21latency_hist19:10:000
1179383994110,14cyclictest1230274-21/usr/sbin/munin00:05:232
1179382994130,6cyclictest0-21swapper/123:20:011
1179382994126,10cyclictest0-21swapper/121:05:301
1179383994032,4cyclictest0-21swapper/200:30:292
1179383994026,10cyclictest0-21swapper/219:55:022
1179383994026,10cyclictest0-21swapper/219:55:022
1179382994031,5cyclictest0-21swapper/121:10:281
1179382994026,9cyclictest1207769-21grep21:50:281
117938299402,11cyclictest0-21swapper/119:10:361
1179383993930,5cyclictest1225689-21grep23:35:282
1179383993930,5cyclictest1209550-21munin-plugin-st22:05:002
1179383993930,5cyclictest1208683-21cron22:00:012
1179383993930,5cyclictest1208683-21cron22:00:012
1179383993928,5cyclictest0-21swapper/221:40:262
1179383993925,9cyclictest0-21swapper/219:45:012
1179383993922,9cyclictest0-21swapper/223:10:202
1179382993930,5cyclictest1212084-21grep22:15:301
1179382993927,8cyclictest0-21swapper/123:55:001
117938299392,6cyclictest0-21swapper/120:35:021
117938299392,6cyclictest0-21swapper/120:35:011
1179383993830,4cyclictest0-21swapper/220:10:282
1179383993829,5cyclictest0-21swapper/221:50:292
1179383993828,6cyclictest1213796-21grep22:25:282
1179383993826,8cyclictest0-21swapper/222:05:212
1179383993823,5cyclictest0-21swapper/221:25:192
1179382993828,5cyclictest0-21swapper/120:50:291
1179382993828,5cyclictest0-21swapper/120:50:291
1179382993827,6cyclictest0-21swapper/122:45:331
1179382993826,9cyclictest1190983-21/usr/sbin/munin20:15:271
1179382993826,9cyclictest0-21swapper/121:30:301
1179382993825,8cyclictest0-21swapper/120:10:291
117938399373,21cyclictest14-21rcu_preempt20:55:012
117938399373,21cyclictest14-21rcu_preempt20:55:012
1179383993721,9cyclictest0-21swapper/222:35:302
1179383993714,16cyclictest311ktimers/223:15:132
1179382993727,5cyclictest0-21swapper/121:35:291
1179382993726,7cyclictest1188962-21grep20:00:381
1179382993723,9cyclictest0-21swapper/120:05:281
1179383993629,4cyclictest0-21swapper/221:35:282
1179383993617,15cyclictest311ktimers/220:20:122
117938399361,29cyclictest0-21swapper/223:25:182
117938399361,29cyclictest0-21swapper/222:10:222
1179382993628,4cyclictest0-21swapper/123:00:001
1179382993627,5cyclictest0-21swapper/122:35:001
1179382993625,7cyclictest1184643-21grep19:35:261
1179382993619,10cyclictest0-21swapper/119:25:221
117938299361,4cyclictest0-21swapper/122:25:011
1179383993528,4cyclictest1200165-21cron21:10:012
1179383993527,4cyclictest1193272-21grep20:25:272
1179383993527,4cyclictest0-21swapper/220:55:272
1179383993525,5cyclictest0-21swapper/220:30:282
1179383993522,7cyclictest1182106-21grep19:20:292
117938399351,27cyclictest1201207-21/usr/sbin/munin21:15:192
117938399351,27cyclictest1201207-21/usr/sbin/munin21:15:192
1179382993526,5cyclictest1209446-21grep22:00:301
1179382993524,8cyclictest0-21swapper/122:15:011
1179382993523,9cyclictest0-21swapper/122:05:261
1179382993523,8cyclictest0-21swapper/123:40:271
1179382993523,8cyclictest0-21swapper/123:40:271
1179382993521,7cyclictest0-21swapper/121:40:281
117938399343,25cyclictest0-21swapper/200:05:012
1179383993426,5cyclictest14-21rcu_preempt00:20:322
1179383993424,4cyclictest1218888-21grep22:55:292
1179383993423,7cyclictest1184579-21grep19:35:262
1179383993422,8cyclictest1231951-21/usr/sbin/munin00:15:202
1179383993422,8cyclictest1231951-21/usr/sbin/munin00:15:202
1179383993415,6cyclictest167550irq/134-8000000.ethernet-tx221:20:182
1179382993426,4cyclictest0-21swapper/123:10:001
1179382993424,7cyclictest0-21swapper/121:45:281
1179382993424,6cyclictest0-21swapper/122:40:211
1179382993424,6cyclictest0-21swapper/121:00:261
1179382993423,8cyclictest0-21swapper/100:30:011
117938299341,28cyclictest0-21swapper/123:20:181
117938299341,27cyclictest0-21swapper/120:20:301
117938299341,22cyclictest0-21swapper/122:35:091
1179383993328,2cyclictest0-21swapper/221:45:232
1179383993326,4cyclictest1214619-21unixbench_singl22:30:282
1179383993326,3cyclictest0-21swapper/222:55:012
1179383993325,5cyclictest1236006-21grep00:35:312
1179383993325,4cyclictest0-21swapper/219:15:312
1179383993324,6cyclictest1211514-21/usr/sbin/munin22:15:152
1179383993316,4cyclictest1197529-21kworker/u8:4+flush-179:9621:00:042
1179382993323,5cyclictest0-21swapper/120:30:271
1179383993225,3cyclictest0-21swapper/223:05:022
1179383993220,6cyclictest0-21swapper/223:55:272
1179383993218,7cyclictest0-21swapper/223:40:292
1179383993218,7cyclictest0-21swapper/223:40:292
1179383993217,8cyclictest0-21swapper/220:15:272
1179382993223,6cyclictest1660-21snmpd00:10:141
1179382993222,5cyclictest0-21swapper/100:00:211
1179382993222,4cyclictest1224273-21/usr/sbin/munin23:30:291
117938299322,17cyclictest0-21swapper/122:50:211
1179382993219,6cyclictest1660-21snmpd20:45:111
1179383993123,4cyclictest0-21swapper/219:25:212
1179383993118,7cyclictest0-21swapper/223:54:592
1179383993117,6cyclictest0-21swapper/222:40:202
1179382993124,4cyclictest1219858-21munin-plugin-st23:05:011
1179382993122,5cyclictest0-21swapper/123:15:001
1179382993121,7cyclictest0-21swapper/100:20:231
1179382993120,6cyclictest0-21swapper/100:15:221
1179382993120,6cyclictest0-21swapper/100:15:221
117938299311,7cyclictest0-21swapper/121:25:011
117938299311,25cyclictest0-21swapper/122:20:251
117938399302,14cyclictest1222595-21/usr/sbin/munin23:20:202
1179383993013,5cyclictest167550irq/134-8000000.ethernet-tx220:01:222
1179382993021,5cyclictest0-21swapper/120:25:171
1179382993020,6cyclictest1-21systemd20:56:331
1179383992921,4cyclictest0-21swapper/221:30:302
1179383992920,6cyclictest1220597-21grep23:05:282
117938299296,10cyclictest1660-21snmpd19:55:021
117938299296,10cyclictest1660-21snmpd19:55:011
1179382992916,8cyclictest0-21swapper/119:40:271
117938399289,4cyclictest832-21systemd-network20:09:282
1179383992820,5cyclictest311ktimers/219:30:272
1179383992812,4cyclictest167550irq/134-8000000.ethernet-tx223:30:452
1179382992822,3cyclictest1180520-21cpu19:15:041
1179383992717,5cyclictest311ktimers/200:25:092
117938399271,24cyclictest1196062-21/usr/sbin/munin20:45:312
117938399261,23cyclictest0-21swapper/223:48:502
117938299261,22cyclictest1195379-21ssh20:40:221
117938399251,22cyclictest0-21swapper/200:14:242
1179383991913,3cyclictest0-21swapper/219:10:012
117938299197,5cyclictest0-21swapper/119:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional