You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-13 - 22:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Oct 13, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1089427998854,11cyclictest0-21swapper/109:00:011
1089429997813,17cyclictest1131323-21/usr/sbin/munin11:10:212
108942599784,48cyclictest0-21swapper/008:40:010
1089425997625,43cyclictest0-21swapper/009:50:310
1089425997625,43cyclictest0-21swapper/009:50:310
108942999699,11cyclictest1137969-21apt-get11:50:012
1089425996928,33cyclictest0-21swapper/007:59:590
1089425996533,27cyclictest1119218-21latency_hist10:00:000
1089425996331,28cyclictest20950irq/209-8000000.ethernet09:20:010
108942599632,4cyclictest1099441-21munin-node08:05:110
108942599632,4cyclictest1093836-21grep07:30:300
108942599631,5cyclictest1105720-21sh08:40:200
1089425996315,38cyclictest0-21swapper/008:05:000
108942799627,20cyclictest1132162-21/usr/sbin/munin11:15:241
1089425996254,4cyclictest0-21swapper/010:30:110
1089425996250,6cyclictest20750irq/251-8000000.ethernet10:35:300
108942599623,49cyclictest1109674-21unixbench_singl09:00:310
1089425996229,26cyclictest20950irq/209-8000000.ethernet09:05:260
108942599621,7cyclictest1097362-21latency_hist07:55:010
108942599621,54cyclictest1128726-21latency_hist10:55:010
1089425996215,40cyclictest19950irq/27-20000000.i2c11:05:110
1089425996215,40cyclictest19950irq/27-20000000.i2c11:05:110
1089427996111,16cyclictest1100373-21/usr/sbin/munin08:10:211
108942599613,7cyclictest1090834-21cut07:15:200
1089425996119,32cyclictest0-21swapper/009:35:240
1089425996119,32cyclictest0-21swapper/009:35:240
1089425996116,38cyclictest1145616-21grep12:30:290
1089425995932,22cyclictest1121648-21grep10:10:290
108942599591,5cyclictest1131969-21wc11:15:000
108942599591,52cyclictest1101429-21/usr/sbin/munin08:15:260
108942599583,8cyclictest1119607-21tune2fs10:00:230
108942599583,8cyclictest1119607-21tune2fs10:00:230
108942599583,7cyclictest1114746-21grep09:30:290
108942599583,49cyclictest1138861-21grep11:50:320
108942599581,4cyclictest1116855-21df_inode09:45:190
108942599572,9cyclictest1095494-21sed07:40:300
1089425995725,25cyclictest1130185-21grep11:00:280
108942599572,42cyclictest1135293-21head11:30:300
108942599571,2cyclictest0-21swapper/010:30:010
1089425995710,39cyclictest0-21swapper/007:35:300
1089425995630,21cyclictest0-21swapper/008:10:280
1089425995629,19cyclictest0-21swapper/012:10:290
108942599562,45cyclictest1096391-21unixbench_singl07:45:270
108942599562,11cyclictest1141486-21wc12:10:010
108942599553,6cyclictest1093024-21grep07:25:320
108942599553,6cyclictest1093024-21grep07:25:320
1089425995532,16cyclictest20950irq/209-8000000.ethernet10:40:250
1089425995530,18cyclictest0-21swapper/009:10:310
108942599552,43cyclictest1133832-21latency_hist11:25:020
1089425995524,23cyclictest0-21swapper/007:15:020
108942599551,4cyclictest1129364-21unixbench_singl10:55:300
108942799542,20cyclictest0-21swapper/108:35:001
108942599548,37cyclictest0-21swapper/011:50:010
108942599545,36cyclictest20950irq/209-8000000.ethernet08:55:130
1089425995420,26cyclictest0-21swapper/012:35:190
1089425995420,26cyclictest0-21swapper/012:35:190
108942599541,4cyclictest1143640-21meminfo12:20:240
108942599541,14cyclictest1107229-21apt-get08:50:180
1089425995344,5cyclictest1113961-21munin-plugin-st09:30:000
108942599533,5cyclictest1140479-21grep12:00:290
108942599533,10cyclictest1091633-21dropbear07:20:170
1089429995241,6cyclictest1095502-21grep07:40:312
108942599523,5cyclictest1113081-21grep09:20:300
108942599522,39cyclictest1139160-21dropbear11:55:140
108942599522,39cyclictest1139160-21dropbear11:55:140
108942599522,11cyclictest1116471-21unixbench_multi09:40:300
1089425995219,25cyclictest131ktimers/012:25:230
1089429995142,5cyclictest1108803-21sendmail09:00:002
108942599514,5cyclictest1142651-21lsblk12:15:230
1089425995134,11cyclictest0-21swapper/008:30:280
108942599513,38cyclictest0-21swapper/010:25:010
108942599511,4cyclictest1137041-21latency_hist11:45:010
1089425995039,6cyclictest0-21swapper/010:05:230
108942599503,8cyclictest1133869-21apt-get11:25:150
108942599501,7cyclictest1106840-21/usr/sbin/munin08:45:320
108942999494,23cyclictest30-21rcuc/209:00:012
1089429994941,5cyclictest1105256-21dpkg08:40:002
108942799498,14cyclictest1115637-21apt-get09:40:011
108942799498,14cyclictest1115637-21apt-get09:40:011
108942599492,10cyclictest1132423-21irqstats11:15:280
108942599491,40cyclictest0-21swapper/010:20:010
108942599491,11cyclictest1135638-21fschecks_count11:35:220
108942599486,34cyclictest0-21swapper/008:25:220
108942599481,5cyclictest1127224-21/usr/sbin/munin10:45:230
1089427994633,8cyclictest0-21swapper/111:15:001
1089429994532,9cyclictest0-21swapper/208:05:012
1089429994524,12cyclictest0-21swapper/207:10:302
1089427994532,10cyclictest1263-21cron10:50:011
108942599454,36cyclictest1102612-21grep08:20:330
1089425994537,4cyclictest20750irq/251-8000000.ethernet07:10:010
1089429994430,9cyclictest0-21swapper/207:45:272
1089429994429,9cyclictest0-21swapper/208:45:342
1089429994429,10cyclictest0-21swapper/208:40:292
108942799444,10cyclictest1107873-21gpgv08:55:011
1089427994431,9cyclictest1119125-21sendmail09:59:591
1089429994331,9cyclictest0-21swapper/209:50:312
1089429994331,9cyclictest0-21swapper/209:50:312
1089429994329,10cyclictest0-21swapper/208:15:312
108942999431,2cyclictest0-21swapper/209:15:222
108942999431,12cyclictest0-21swapper/211:25:222
1089427994328,11cyclictest231ktimers/110:40:141
108942799428,2cyclictest0-21swapper/109:50:011
1089427994230,8cyclictest1101772-21grep08:15:321
1089429994133,5cyclictest1128377-21unixbench_multi10:50:312
1089429994133,4cyclictest1130286-21munin-plugin-st11:05:002
1089429994128,9cyclictest0-21swapper/209:10:312
108942999411,2cyclictest0-21swapper/212:35:222
108942999411,2cyclictest0-21swapper/212:35:212
1089427994133,5cyclictest1138836-21grep11:50:321
1089429994028,5cyclictest0-21swapper/207:25:302
1089429994028,5cyclictest0-21swapper/207:25:302
1089429994024,7cyclictest0-21swapper/212:15:282
1089429994023,9cyclictest0-21swapper/208:10:302
1089429994018,13cyclictest311ktimers/209:25:122
1089427994029,7cyclictest1096461-21cat07:49:591
1089427994025,10cyclictest0-21swapper/111:05:271
1089427994025,10cyclictest0-21swapper/111:05:271
1089429993931,4cyclictest14-21rcu_preempt07:20:302
1089429993927,8cyclictest0-21swapper/210:10:292
1089429993927,8cyclictest0-21swapper/209:55:292
1089429993927,8cyclictest0-21swapper/209:49:592
1089429993926,9cyclictest0-21swapper/208:10:012
1089429993925,8cyclictest0-21swapper/210:35:302
108942799397,26cyclictest0-21swapper/110:52:241
1089427993927,7cyclictest0-21swapper/111:50:011
1089427993925,9cyclictest231ktimers/110:25:131
1089427993925,7cyclictest0-21swapper/110:25:001
1089429993823,9cyclictest0-21swapper/211:35:012
1089429993822,8cyclictest0-21swapper/212:20:282
1089427993828,5cyclictest0-21swapper/112:15:301
1089427993826,8cyclictest231ktimers/112:25:141
108942799381,4cyclictest0-21swapper/108:30:011
1089429993731,3cyclictest168450irq/135-8000000.ethernet-tx212:25:272
1089429993729,4cyclictest168450irq/135-8000000.ethernet-tx210:05:212
1089429993728,5cyclictest168450irq/135-8000000.ethernet-tx208:25:312
108942999372,6cyclictest1107416-21grep08:50:232
1089429993726,7cyclictest0-21swapper/209:30:302
1089429993726,6cyclictest0-21swapper/210:00:312
1089429993726,6cyclictest0-21swapper/210:00:312
1089429993722,10cyclictest0-21swapper/211:45:012
1089429993721,9cyclictest311ktimers/210:25:262
1089427993727,7cyclictest0-21swapper/108:50:001
1089427993725,8cyclictest0-21swapper/109:30:281
1089427993725,7cyclictest0-21swapper/111:00:281
1089427993722,8cyclictest0-21swapper/110:05:311
108942799371,8cyclictest0-21swapper/107:25:011
1089429993623,9cyclictest0-21swapper/207:55:272
1089429993621,10cyclictest311ktimers/209:40:152
1089429993621,10cyclictest0-21swapper/207:50:302
108942799363,22cyclictest1133866-21/usr/sbin/munin11:25:221
1089427993628,4cyclictest0-21swapper/108:05:291
1089427993627,5cyclictest1105239-21apt-get08:40:011
1089427993627,4cyclictest0-21swapper/111:30:231
1089427993626,5cyclictest0-21swapper/109:10:311
1089427993625,6cyclictest0-21swapper/107:35:221
1089427993624,8cyclictest231ktimers/111:40:131
1089427993624,7cyclictest0-21swapper/107:40:311
1089427993623,9cyclictest0-21swapper/109:20:291
1089429993527,5cyclictest0-21swapper/211:15:342
1089429993525,5cyclictest0-21swapper/209:40:012
1089429993525,5cyclictest0-21swapper/209:40:012
1089429993517,15cyclictest1094745-21run-parts07:39:592
108942799354,7cyclictest1097363-21apt-get07:55:011
1089427993527,5cyclictest0-21swapper/109:40:301
1089427993527,4cyclictest0-21swapper/112:20:281
1089427993525,6cyclictest0-21swapper/111:35:311
108942999348,23cyclictest1124879-21ptp4l10:30:272
1089429993426,5cyclictest0-21swapper/210:20:282
108942999341,27cyclictest0-21swapper/210:15:302
108942799341,2cyclictest0-21swapper/107:09:591
1089429993322,7cyclictest0-21swapper/211:35:232
1089429993321,7cyclictest0-21swapper/212:00:282
1089429993320,8cyclictest0-21swapper/208:20:302
1089427993325,4cyclictest0-21swapper/112:35:311
1089427993325,4cyclictest0-21swapper/112:35:311
1089427993321,8cyclictest0-21swapper/108:00:301
108942799331,27cyclictest0-21swapper/112:30:151
1089429993225,4cyclictest168450irq/135-8000000.ethernet-tx211:50:022
1089429993225,4cyclictest0-21swapper/212:05:232
1089429993224,5cyclictest865-21systemd-network10:45:022
108942999322,24cyclictest14-21rcu_preempt11:55:202
108942999322,24cyclictest14-21rcu_preempt11:55:202
1089429993221,7cyclictest0-21swapper/209:05:262
1089429993220,9cyclictest0-21swapper/207:30:292
1089429993218,10cyclictest0-21swapper/208:30:192
108942999321,26cyclictest0-21swapper/210:40:202
108942799326,16cyclictest22-21rcuc/109:30:011
1089427993224,4cyclictest0-21swapper/110:55:281
1089427993222,4cyclictest0-21swapper/108:20:241
1089427993217,8cyclictest0-21swapper/107:15:241
108942799321,26cyclictest0-21swapper/110:35:181
108942799321,11cyclictest206-21ptp011:20:251
108942799321,10cyclictest0-21swapper/112:10:011
1089429993125,4cyclictest168450irq/135-8000000.ethernet-tx212:30:132
1089429993125,4cyclictest168450irq/135-8000000.ethernet-tx207:10:012
108942799317,14cyclictest0-21swapper/112:15:011
1089427993119,6cyclictest22-21rcuc/112:00:221
1089427993113,10cyclictest231ktimers/110:00:141
1089427993113,10cyclictest231ktimers/110:00:141
1089427993022,5cyclictest1122511-21sed10:15:301
1089427993022,4cyclictest0-21swapper/111:55:231
1089427993022,4cyclictest0-21swapper/111:55:231
1089427993015,8cyclictest0-21swapper/108:00:021
1089429992922,4cyclictest168450irq/135-8000000.ethernet-tx211:05:222
1089429992922,4cyclictest168450irq/135-8000000.ethernet-tx211:05:222
1089429992919,7cyclictest0-21swapper/212:10:272
1089429992916,6cyclictest311ktimers/210:55:162
108942999291,4cyclictest1133637-21users11:20:312
108942999291,26cyclictest1090947-21if_eth007:15:232
1089427992919,6cyclictest0-21swapper/110:35:011
1089427992916,8cyclictest0-21swapper/110:10:291
1089429992814,10cyclictest0-21swapper/209:20:232
1089427992824,2cyclictest0-21swapper/109:50:281
1089427992824,2cyclictest0-21swapper/109:50:281
1089427992721,4cyclictest0-21swapper/107:25:201
1089427992721,4cyclictest0-21swapper/107:25:201
1089427992719,5cyclictest0-21swapper/109:05:291
108942799271,8cyclictest0-21swapper/107:35:011
1089427992718,6cyclictest22-21rcuc/108:40:231
1089427992717,6cyclictest22-21rcuc/109:00:311
1089427992710,4cyclictest27250irq/343-wl18xx07:10:251
1089427992618,6cyclictest22-21rcuc/109:15:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional