You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 22:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Tue Jul 15, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1170807997527,40cyclictest1172676-21grep07:15:322
1170807996716,23cyclictest1220535-21/usr/sbin/munin12:00:192
1170807996622,36cyclictest1191274-21grep09:05:302
1170807996622,36cyclictest1191274-21grep09:05:302
1170803996648,13cyclictest131ktimers/011:15:140
1170807996321,33cyclictest0-21swapper/208:45:302
1170805996253,4cyclictest231ktimers/110:10:011
117080799611,6cyclictest1222372-21df_inode12:10:222
1170805996151,5cyclictest1187121-21munin-plugin-st08:45:011
1170807996021,30cyclictest0-21swapper/210:20:292
1170807996012,6cyclictest0-21swapper/208:30:272
1170803996024,23cyclictest12-21ksoftirqd/009:40:020
117080799592,16cyclictest1177179-21apt-get07:45:182
117080799592,16cyclictest1177179-21apt-get07:45:182
1170807995822,27cyclictest0-21swapper/210:30:292
117080799573,17cyclictest1188967-21latency_hist08:55:002
1170807995722,7cyclictest1218837-21/usr/sbin/munin11:50:352
117080799572,21cyclictest0-21swapper/211:40:292
1170807995718,6cyclictest1666-21snmpd12:35:362
1170807995718,4cyclictest0-21swapper/210:55:312
1170807995715,6cyclictest0-21swapper/208:35:272
1170803995739,11cyclictest131ktimers/007:45:140
1170803995739,11cyclictest131ktimers/007:45:140
1170807995620,29cyclictest0-21swapper/207:55:322
1170807995614,4cyclictest0-21swapper/211:30:212
1170807995523,28cyclictest168450irq/135-8000000.ethernet-tx212:20:192
117080799552,17cyclictest1183704-21sed08:20:302
1170807995517,3cyclictest0-21swapper/210:45:272
1170805995516,20cyclictest1191626-21/usr/sbin/munin09:10:191
117080799545,13cyclictest0-21swapper/208:55:292
1170807995423,6cyclictest0-21swapper/209:10:282
1170807995420,29cyclictest0-21swapper/209:15:232
1170807995417,4cyclictest0-21swapper/208:10:002
1170807995414,7cyclictest0-21swapper/209:55:292
117080399546,23cyclictest0-21swapper/007:25:010
117080399543,30cyclictest12-21ksoftirqd/008:30:010
117080399543,30cyclictest12-21ksoftirqd/008:30:010
1170807995315,4cyclictest0-21swapper/211:20:012
1170807995314,9cyclictest0-21swapper/210:00:222
1170807995217,4cyclictest0-21swapper/210:40:302
1170807995217,4cyclictest0-21swapper/207:35:262
1170807995216,30cyclictest1182033-21latency_hist08:15:002
1170807995215,4cyclictest0-21swapper/207:25:312
1170807995214,6cyclictest0-21swapper/209:45:292
1170807995214,6cyclictest0-21swapper/209:45:292
1170807995211,9cyclictest0-21swapper/207:20:212
1170805995242,6cyclictest1210017-21tr11:00:011
117080799517,12cyclictest1217998-21/usr/sbin/munin11:45:172
1170807995118,4cyclictest1226273-21head12:30:292
1170807995118,4cyclictest1226273-21head12:30:292
1170805995141,5cyclictest1176978-21munin-plugin-st07:45:001
1170807995021,23cyclictest0-21swapper/208:40:232
1170807995020,25cyclictest0-21swapper/212:15:312
1170807995019,5cyclictest1197345-21cron09:44:592
1170807995013,4cyclictest0-21swapper/212:10:022
117080799501,23cyclictest0-21swapper/211:00:012
1170803995031,13cyclictest131ktimers/009:05:130
1170803995031,13cyclictest131ktimers/009:05:130
117080799499,9cyclictest0-21swapper/210:10:212
1170807994917,7cyclictest1202608-21/usr/sbin/munin10:15:302
117080799491,20cyclictest1666-21snmpd10:28:392
117080799491,20cyclictest1666-21snmpd10:28:382
1170803994942,4cyclictest0-21swapper/012:00:150
1170803994921,5cyclictest15-21rcuc/012:10:010
1170807994825,20cyclictest0-21swapper/207:40:242
1170807994816,3cyclictest1175446-21latency_hist07:35:012
117080399481,38cyclictest0-21swapper/008:05:160
1170803994733,10cyclictest1192214-21grep09:10:290
1170803994719,6cyclictest12-21ksoftirqd/012:35:010
1170803994719,6cyclictest12-21ksoftirqd/012:35:010
1170803994714,3cyclictest0-21swapper/010:45:000
117080399471,2cyclictest0-21swapper/009:35:010
1170807994622,20cyclictest1219677-21/usr/sbin/munin11:55:192
1170807994617,5cyclictest0-21swapper/208:00:292
1170807994616,6cyclictest1212593-21sed11:15:002
1170803994626,14cyclictest0-21swapper/011:25:010
117080799455,15cyclictest0-21swapper/210:50:292
1170807994535,5cyclictest1206631-21sendmail10:40:002
1170807994515,6cyclictest0-21swapper/211:05:282
1170807994515,6cyclictest0-21swapper/211:05:272
117080599457,14cyclictest0-21swapper/109:00:011
117080399455,21cyclictest12-21ksoftirqd/008:45:020
117080399454,16cyclictest12-21ksoftirqd/008:05:010
1170803994511,11cyclictest15-21rcuc/007:15:000
1170805994435,5cyclictest1182038-21munin-plugin-st08:15:001
1170805994427,8cyclictest0-21swapper/112:10:331
1170803994426,14cyclictest0-21swapper/007:15:310
117080399441,34cyclictest0-21swapper/010:55:130
1170803994410,30cyclictest0-21swapper/011:35:000
1170807994324,15cyclictest0-21swapper/209:50:212
1170807994319,6cyclictest1193958-21sshd09:24:262
1170807994315,4cyclictest1178439-21/usr/sbin/munin07:50:282
117080799431,24cyclictest0-21swapper/212:25:242
117080599433,31cyclictest0-21swapper/109:40:291
1170805994331,9cyclictest1191369-21gpgv09:10:011
1170805994331,9cyclictest1191369-21gpgv09:10:011
1170805994330,8cyclictest0-21swapper/112:10:021
117080399439,8cyclictest0-21swapper/008:15:010
117080399435,7cyclictest0-21swapper/007:55:000
1170803994335,5cyclictest0-21swapper/010:05:000
1170805994232,5cyclictest0-21swapper/111:55:301
1170805994229,8cyclictest0-21swapper/108:15:291
1170803994227,10cyclictest0-21swapper/011:05:300
1170803994227,10cyclictest0-21swapper/011:05:300
117080399421,3cyclictest0-21swapper/007:10:020
117080399421,3cyclictest0-21swapper/007:10:020
1170803994122,5cyclictest15-21rcuc/008:15:280
1170803994120,13cyclictest0-21swapper/007:40:280
117080399411,13cyclictest0-21swapper/009:20:000
1170807994017,17cyclictest0-21swapper/209:00:242
1170805994032,5cyclictest1199025-21cron09:54:591
1170805994030,7cyclictest0-21swapper/109:20:001
1170803994031,5cyclictest1208328-21munin-plugin-st10:49:590
1170803994028,9cyclictest0-21swapper/009:00:010
1170803994028,8cyclictest1176124-21sendmail07:40:010
1170805993930,5cyclictest1170799-21cyclictest09:55:301
1170805993930,4cyclictest0-21swapper/112:20:001
1170805993925,10cyclictest0-21swapper/108:55:301
117080599391,2cyclictest0-21swapper/108:35:011
117080399393,7cyclictest0-21swapper/007:35:010
117080399393,5cyclictest1183629-21grep08:20:300
1170803993926,10cyclictest0-21swapper/009:25:280
1170803993915,22cyclictest0-21swapper/009:35:200
1170803993912,6cyclictest131ktimers/009:00:280
1170805993831,4cyclictest1218640-21munin-plugin-st11:50:001
1170805993826,7cyclictest0-21swapper/110:20:301
1170805993826,5cyclictest0-21swapper/108:25:311
1170805993826,5cyclictest0-21swapper/108:25:311
117080599381,30cyclictest0-21swapper/110:50:261
117080599381,29cyclictest0-21swapper/111:25:251
1170803993832,4cyclictest0-21swapper/009:20:160
1170803993826,8cyclictest0-21swapper/012:15:000
1170803993823,10cyclictest0-21swapper/011:50:260
117080399381,4cyclictest0-21swapper/010:20:020
1170807993723,9cyclictest1194757-21grep09:25:302
1170805993728,6cyclictest0-21swapper/108:55:001
1170805993728,5cyclictest0-21swapper/110:35:311
1170805993716,13cyclictest1179715-21/usr/sbin/munin08:00:201
117080399375,4cyclictest0-21swapper/011:40:010
117080399375,4cyclictest0-21swapper/011:40:010
117080399374,5cyclictest1206263-21uname10:35:260
1170803993731,3cyclictest203-21pr/ttyS212:40:000
1170803993726,6cyclictest0-21swapper/008:50:010
1170803993723,8cyclictest131ktimers/007:25:310
117080399371,4cyclictest0-21swapper/010:10:010
1170807993628,4cyclictest0-21swapper/211:40:002
1170807993628,4cyclictest0-21swapper/211:39:592
1170805993629,4cyclictest168350irq/127-8000000.ethernet-tx108:45:291
1170805993625,8cyclictest0-21swapper/109:50:001
1170805993625,8cyclictest0-21swapper/109:49:591
1170805993625,7cyclictest1212500-21grep11:10:291
1170805993622,4cyclictest27250irq/343-wl18xx09:20:241
1170805993619,12cyclictest0-21swapper/111:40:021
1170805993619,12cyclictest0-21swapper/111:40:021
1170805993616,15cyclictest231ktimers/111:05:251
1170805993616,15cyclictest231ktimers/111:05:251
117080399367,27cyclictest0-21swapper/010:25:250
117080399367,27cyclictest0-21swapper/010:25:250
1170803993630,2cyclictest0-21swapper/008:40:000
1170803993626,6cyclictest0-21swapper/010:20:300
1170803993626,4cyclictest20950irq/209-8000000.ethernet07:55:150
117080399361,33cyclictest0-21swapper/009:50:230
117080399361,2cyclictest0-21swapper/010:15:010
1170807993511,9cyclictest27350irq/343-s-wl18xx10:09:142
1170805993526,5cyclictest0-21swapper/110:25:301
1170805993526,5cyclictest0-21swapper/110:25:301
1170805993526,5cyclictest0-21swapper/110:05:011
117080599352,4cyclictest0-21swapper/112:35:011
117080599352,4cyclictest0-21swapper/112:35:001
117080599351,13cyclictest0-21swapper/111:55:001
1170803993528,4cyclictest20950irq/209-8000000.ethernet10:30:160
1170803993525,6cyclictest131ktimers/012:15:280
1170803993524,6cyclictest15-21rcuc/009:45:310
1170803993524,6cyclictest15-21rcuc/009:45:310
1170803993520,11cyclictest0-21swapper/008:50:270
1170803993516,15cyclictest131ktimers/008:30:130
1170803993515,18cyclictest0-21swapper/011:03:390
1170807993421,9cyclictest0-21swapper/209:35:242
1170805993429,2cyclictest0-21swapper/109:25:251
117080399349,23cyclictest0-21swapper/012:20:270
117080399341,5cyclictest1212313-21tail11:10:280
117080399341,5cyclictest0-21swapper/010:55:010
1170803993413,8cyclictest1207986-1kworker/0:0H+mmc_complete11:30:020
117080399340,13cyclictest1666-21snmpd09:55:280
1170805993326,4cyclictest1216105-21munin-plugin-st11:35:001
1170805993326,4cyclictest0-21swapper/111:15:291
1170805993326,4cyclictest0-21swapper/108:40:001
1170805993324,7cyclictest231ktimers/109:30:111
1170805993324,5cyclictest0-21swapper/112:20:291
1170805993323,6cyclictest0-21swapper/107:15:291
1170805993321,9cyclictest0-21swapper/107:45:301
1170805993321,9cyclictest0-21swapper/107:45:301
117080599331,29cyclictest22-21rcuc/107:10:291
117080599331,29cyclictest0-21swapper/108:05:341
117080599331,26cyclictest0-21swapper/111:00:191
1170803993320,9cyclictest0-21swapper/011:45:260
117080399331,30cyclictest0-21swapper/011:45:010
1170805993226,3cyclictest1179502-21munin-plugin-st08:00:001
1170805993223,5cyclictest0-21swapper/110:30:191
1170805993223,5cyclictest0-21swapper/107:20:301
1170805993222,6cyclictest1225387-21grep12:25:301
1170805993123,5cyclictest0-21swapper/110:40:231
1170805993121,6cyclictest1203190-21grep10:15:331
1170805993121,6cyclictest1202306-21grep10:10:291
1170805993121,6cyclictest0-21swapper/112:00:281
117080599311,9cyclictest0-21swapper/111:25:011
1170803993123,5cyclictest131ktimers/012:25:150
1170807993022,6cyclictest0-21swapper/211:20:202
1170807993021,5cyclictest0-21swapper/208:15:212
1170807993019,8cyclictest0-21swapper/208:30:012
1170807993019,8cyclictest0-21swapper/208:30:012
117080799301,4cyclictest0-21swapper/207:15:012
1170805993017,9cyclictest0-21swapper/111:40:281
117080599301,2cyclictest0-21swapper/107:35:011
1170805993010,4cyclictest27350irq/343-s-wl18xx08:24:471
117080399302,26cyclictest0-21swapper/011:55:260
117080799292,25cyclictest1195010-21/usr/sbin/munin09:30:282
1170805992916,6cyclictest0-21swapper/107:50:121
117080599291,4cyclictest0-21swapper/107:30:011
1170805992820,5cyclictest0-21swapper/110:45:311
117080599272,4cyclictest27250irq/343-wl18xx09:35:251
1170805992619,4cyclictest0-21swapper/107:35:241
1170805992616,6cyclictest0-21swapper/112:35:191
1170807992520,3cyclictest0-21swapper/211:25:312
1170805992212,5cyclictest1170887-21date07:10:011
1170805992212,5cyclictest1170887-21date07:10:011
1170807992116,3cyclictest1170813-21latency_hist07:10:012
1170807992116,3cyclictest1170813-21latency_hist07:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional