You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-12 - 09:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6s.osadl.org (updated Thu Sep 12, 2024 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1118020991039,39cyclictest1120015-21apt-config19:20:012
1118015998781,4cyclictest231ktimers/122:35:151
1118015998611,44cyclictest22-21rcuc/100:35:191
1118020996913,11cyclictest1133731-21apt-get20:40:022
1118020996913,11cyclictest1133731-21apt-get20:40:012
111801599689,27cyclictest1167072-21/usr/sbin/munin23:55:181
1118014996761,3cyclictest0-21swapper/022:05:120
1118014996761,3cyclictest0-21swapper/022:05:120
1118015995810,15cyclictest22-21rcuc/121:50:011
1118014995733,13cyclictest15-21rcuc/021:20:010
1118015995650,4cyclictest0-21swapper/121:10:011
1118015995618,11cyclictest0-21swapper/119:45:011
1118014995514,35cyclictest131ktimers/020:25:120
1118014995446,3cyclictest0-21swapper/021:10:120
1118014995446,3cyclictest0-21swapper/021:10:120
1118020995345,5cyclictest1156732-21munin-plugin-st22:55:002
1118015995340,7cyclictest0-21swapper/100:10:011
1118020995216,27cyclictest0-21swapper/200:10:282
1118015995214,13cyclictest24-21ksoftirqd/120:55:171
1118015995214,13cyclictest24-21ksoftirqd/120:55:171
1118015995142,5cyclictest1157579-21munin-plugin-st22:59:591
1118015995134,11cyclictest0-21swapper/119:59:591
1118014995141,6cyclictest1121734-21munin-plugin-st19:29:590
1118014995126,4cyclictest27250irq/343-wl18xx20:20:150
1118020995038,8cyclictest1166873-21munin-plugin-st23:55:002
1118020995038,8cyclictest1166873-21munin-plugin-st23:55:002
1118014994941,4cyclictest20750irq/251-8000000.ethernet00:10:200
1118020994841,4cyclictest1164337-21sh23:40:002
1118020994841,4cyclictest1164337-21sh23:39:592
1118015994838,5cyclictest1125115-21munin-plugin-st19:50:001
1118014994839,5cyclictest20750irq/251-8000000.ethernet23:45:000
1118015994740,4cyclictest1141442-21munin-plugin-st21:24:591
1118014994742,2cyclictest0-21swapper/021:25:120
1118014994724,17cyclictest131ktimers/020:05:020
111802099464,17cyclictest1133092-21/usr/sbin/munin20:35:182
1118020994633,7cyclictest1154963-21munin-plugin-st22:45:002
1118020994633,7cyclictest0-21swapper/219:35:292
1118015994637,5cyclictest1160111-21munin-plugin-st23:15:001
1118015994636,6cyclictest1149043-21munin-plugin-st22:10:001
1118015994636,6cyclictest1149043-21munin-plugin-st22:10:001
1118015994634,8cyclictest0-21swapper/119:30:001
1118014994637,5cyclictest20750irq/251-8000000.ethernet00:20:000
1118014994635,6cyclictest1134455-21ptp4l20:40:270
1118014994635,6cyclictest1134455-21ptp4l20:40:270
1118015994530,10cyclictest1160961-21cut23:20:011
1118015994526,11cyclictest0-21swapper/120:15:281
1118015994526,11cyclictest0-21swapper/120:15:281
1118014994538,4cyclictest0-21swapper/021:05:000
1118014994537,4cyclictest20750irq/251-8000000.ethernet23:15:140
1118014994530,9cyclictest1143088-21grep21:30:290
1118014994529,11cyclictest0-21swapper/022:55:270
1118014994513,5cyclictest1120062-21apt-config19:20:010
1118020994432,8cyclictest0-21swapper/222:00:292
111802099441,28cyclictest0-21swapper/219:30:012
1118015994411,27cyclictest22-21rcuc/120:00:221
111801499442,38cyclictest1135385-21mailstats20:45:280
1118020994334,5cyclictest168450irq/135-8000000.ethernet-tx221:05:282
111802099433,20cyclictest14-21rcu_preempt21:25:022
1118015994334,4cyclictest1166874-21munin-plugin-st23:55:001
1118015994334,4cyclictest1166874-21munin-plugin-st23:55:001
111801499434,4cyclictest0-21swapper/000:30:010
111801499434,18cyclictest15-21rcuc/020:05:010
1118014994336,5cyclictest1133736-21munin-plugin-st20:40:000
1118014994336,4cyclictest20750irq/251-8000000.ethernet20:20:000
1118014994336,4cyclictest20750irq/251-8000000.ethernet20:20:000
1118014994332,7cyclictest20750irq/251-8000000.ethernet22:25:230
111801499431,40cyclictest0-21swapper/023:25:140
1118020994224,13cyclictest0-21swapper/220:10:022
1118020994219,9cyclictest1134881-21/usr/sbin/munin20:45:192
1118020994218,15cyclictest1131138-21gpgv20:25:012
1118020994210,10cyclictest1155249-21/usr/sbin/munin22:45:182
1118020994210,10cyclictest1155249-21/usr/sbin/munin22:45:182
1118015994230,7cyclictest1119956-21sendmail19:19:591
1118015994230,7cyclictest0-21swapper/120:50:291
1118014994233,5cyclictest1167630-21grep23:55:280
1118014994232,6cyclictest20750irq/251-8000000.ethernet19:20:010
1118014994232,6cyclictest20750irq/251-8000000.ethernet00:35:240
1118020994130,5cyclictest0-21swapper/200:15:272
1118015994127,9cyclictest0-21swapper/121:00:271
1118015994127,8cyclictest0-21swapper/121:55:211
1118015994125,9cyclictest0-21swapper/100:10:281
1118015994123,11cyclictest0-21swapper/122:25:281
111801599411,5cyclictest0-21swapper/121:40:011
111801499415,23cyclictest1120556-21kworker/0:0+events20:10:040
1118014994135,3cyclictest20950irq/209-8000000.ethernet00:30:180
1118014994131,6cyclictest20750irq/251-8000000.ethernet22:10:300
1118014994124,12cyclictest131ktimers/020:55:120
1118014994124,12cyclictest131ktimers/020:55:120
111801499411,35cyclictest0-21swapper/022:35:010
1118020994023,9cyclictest0-21swapper/220:00:292
111802099401,4cyclictest1143016-21unixbench_multi21:30:292
1118015994026,8cyclictest0-21swapper/121:30:281
111801599401,11cyclictest0-21swapper/122:50:011
111801599401,11cyclictest0-21swapper/122:50:011
1118014994033,4cyclictest20750irq/251-8000000.ethernet21:20:120
1118014994033,4cyclictest1136021-21meminfo20:50:250
1118014994032,4cyclictest20750irq/251-8000000.ethernet21:45:230
1118014994030,5cyclictest1154961-21munin-run22:45:000
111801499402,36cyclictest0-21swapper/023:50:110
111801499402,36cyclictest0-21swapper/023:50:100
111801499402,35cyclictest1155418-21fschecks_time22:45:210
111801499402,35cyclictest1155418-21fschecks_time22:45:210
111801499401,22cyclictest1146058-21lsblk21:50:220
1118020993931,4cyclictest1169585-21apt-key00:10:012
1118020993926,8cyclictest0-21swapper/200:30:282
1118020993924,6cyclictest0-21swapper/220:30:282
1118015993929,4cyclictest0-21swapper/122:15:251
1118015993928,5cyclictest0-21swapper/120:40:011
1118015993928,4cyclictest0-21swapper/123:05:281
1118014993931,5cyclictest20750irq/251-8000000.ethernet19:40:250
1118014993930,6cyclictest1118071-21latency_hist19:10:010
1118014993930,6cyclictest1118071-21latency_hist19:10:010
1118014993928,7cyclictest0-21swapper/023:20:280
1118014993927,5cyclictest0-21swapper/000:10:020
1118014993917,17cyclictest0-21swapper/019:30:150
111801499391,2cyclictest0-21swapper/021:45:000
1118020993831,5cyclictest1158431-21munin-plugin-st23:05:002
1118020993831,5cyclictest1158431-21munin-plugin-st23:05:002
1118020993831,4cyclictest168450irq/135-8000000.ethernet-tx219:40:272
1118020993829,5cyclictest0-21swapper/222:10:292
1118020993814,15cyclictest1145023-21/usr/sbin/munin21:45:182
1118015993829,6cyclictest0-21swapper/121:50:001
1118015993827,6cyclictest1131041-21grep20:20:301
1118015993824,9cyclictest0-21swapper/123:30:301
1118015993822,10cyclictest0-21swapper/119:20:211
111801499388,28cyclictest0-21swapper/022:00:270
1118014993831,4cyclictest20750irq/251-8000000.ethernet23:35:220
1118014993831,4cyclictest20750irq/251-8000000.ethernet23:35:220
1118014993831,4cyclictest20750irq/251-8000000.ethernet23:30:190
1118014993831,4cyclictest20750irq/251-8000000.ethernet19:45:240
1118014993828,4cyclictest20750irq/251-8000000.ethernet21:05:170
1118014993827,7cyclictest1150741-21sendmail22:20:000
1118014993821,12cyclictest0-21swapper/019:35:200
111801499381,5cyclictest1132821-21unixbench_singl20:30:290
111801499381,33cyclictest1143963-21latency_hist21:40:000
111802099377,3cyclictest1174205-21kernelversion00:35:242
1118020993729,4cyclictest168450irq/135-8000000.ethernet-tx219:10:222
1118020993728,6cyclictest0-21swapper/220:10:292
1118020993725,5cyclictest0-21swapper/220:15:202
1118020993725,5cyclictest0-21swapper/220:15:202
111802099371,30cyclictest0-21swapper/219:30:282
1118015993730,4cyclictest231ktimers/122:50:281
1118015993729,5cyclictest231ktimers/123:00:251
1118015993729,5cyclictest231ktimers/123:00:241
1118015993727,7cyclictest231ktimers/121:15:121
1118015993726,8cyclictest0-21swapper/100:15:281
1118015993726,6cyclictest1173665-21grep00:30:271
1118015993725,4cyclictest0-21swapper/120:30:171
111801599371,6cyclictest0-21swapper/100:05:011
111801599371,30cyclictest0-21swapper/121:10:171
111801599371,30cyclictest0-21swapper/121:10:171
1118014993731,3cyclictest20750irq/251-8000000.ethernet19:50:200
1118020993626,5cyclictest1136318-21sed20:50:302
1118020993621,10cyclictest0-21swapper/221:40:292
1118015993627,5cyclictest231ktimers/122:45:011
1118015993626,7cyclictest231ktimers/119:10:111
1118015993626,5cyclictest231ktimers/120:40:161
1118015993626,5cyclictest231ktimers/120:40:151
1118015993625,7cyclictest0-21swapper/120:25:291
1118015993625,7cyclictest0-21swapper/119:35:291
1118015993624,4cyclictest0-21swapper/120:05:231
1118015993621,8cyclictest0-21swapper/122:30:221
1118014993629,4cyclictest20750irq/251-8000000.ethernet22:50:160
1118014993629,4cyclictest20750irq/251-8000000.ethernet00:20:160
1118014993625,8cyclictest1165922-21unixbench_multi23:45:290
1118014993625,7cyclictest0-21swapper/023:10:300
111802099354,22cyclictest30-21rcuc/220:00:002
1118020993529,4cyclictest168450irq/135-8000000.ethernet-tx221:35:272
1118020993526,6cyclictest1666-21snmpd23:15:102
1118020993525,7cyclictest1131406-21sshd20:25:042
1118020993525,6cyclictest0-21swapper/223:25:282
111802099351,28cyclictest1153709-21if_eth122:35:222
1118015993527,5cyclictest231ktimers/120:14:591
1118015993526,6cyclictest231ktimers/123:40:141
1118015993525,6cyclictest0-21swapper/123:20:281
1118015993522,6cyclictest0-21swapper/123:45:291
1118015993521,8cyclictest231ktimers/100:20:101
111801599351,4cyclictest0-21swapper/121:30:011
1118014993527,5cyclictest1126727-21grep19:55:280
1118014993527,4cyclictest20950irq/209-8000000.ethernet23:05:250
1118014993526,4cyclictest0-21swapper/021:55:200
111802099349,17cyclictest1152626-21/usr/sbin/munin22:30:202
1118020993425,6cyclictest0-21swapper/200:00:182
1118015993427,5cyclictest231ktimers/119:55:021
1118015993424,7cyclictest231ktimers/100:25:131
1118014993427,4cyclictest19950irq/27-20000000.i2c22:20:230
1118014993427,4cyclictest0-21swapper/022:35:170
1118014993423,8cyclictest0-21swapper/000:00:120
1118014993418,12cyclictest1118952-21latency_hist19:15:010
1118020993323,7cyclictest1146404-21grep21:50:292
1118020993321,9cyclictest0-21swapper/223:30:282
1118020993319,9cyclictest0-21swapper/222:55:272
111802099331,27cyclictest0-21swapper/223:55:252
111802099331,27cyclictest0-21swapper/221:00:132
111802099331,26cyclictest0-21swapper/219:45:272
1118020993311,13cyclictest14-21rcu_preempt00:20:172
1118015993324,6cyclictest231ktimers/122:20:161
111801599331,2cyclictest0-21swapper/122:15:001
111801599331,15cyclictest0-21swapper/123:40:011
111801599331,15cyclictest0-21swapper/123:40:011
1118020993225,4cyclictest168450irq/135-8000000.ethernet-tx219:20:252
1118020993222,7cyclictest0-21swapper/220:55:272
1118020993222,7cyclictest0-21swapper/220:55:272
1118020993221,8cyclictest0-21swapper/222:15:272
111802099322,11cyclictest91150avahi-daemon00:27:142
1118015993225,4cyclictest231ktimers/120:45:231
1118015993225,4cyclictest231ktimers/119:30:181
1118015993221,6cyclictest231ktimers/123:25:211
1118015993219,8cyclictest1118009-21cyclictest22:00:281
1118014993226,4cyclictest20950irq/209-8000000.ethernet23:00:260
1118014993226,4cyclictest20950irq/209-8000000.ethernet23:00:260
111802099312,5cyclictest1148524-21lsblk22:05:202
111802099312,5cyclictest1148524-21lsblk22:05:192
1118020993119,8cyclictest0-21swapper/223:45:292
1118020993118,8cyclictest0-21swapper/223:05:302
111802099311,28cyclictest0-21swapper/223:40:262
111802099302,4cyclictest293-21systemd-journal23:10:232
1118020993024,3cyclictest168450irq/135-8000000.ethernet-tx223:20:122
1118020993021,4cyclictest0-21swapper/221:20:292
111802099301,4cyclictest0-21swapper/221:55:272
111802099301,25cyclictest0-21swapper/219:50:272
1118015993021,7cyclictest231ktimers/121:40:151
1118015992919,4cyclictest0-21swapper/119:10:011
1118015992919,4cyclictest0-21swapper/119:10:001
111802099281,25cyclictest0-21swapper/222:20:132
111802099272,4cyclictest1151785-21/usr/sbin/munin22:25:302
1118020992718,6cyclictest0-21swapper/221:15:282
1118020992519,4cyclictest0-21swapper/221:10:122
1118020992519,4cyclictest0-21swapper/221:10:112
1118020991911,5cyclictest311ktimers/219:10:012
1118020991911,5cyclictest311ktimers/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional