You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 12:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Nov 26, 2025 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1313367998240,37cyclictest1329677-21munin-plugin-st20:45:001
1313368997664,10cyclictest0-21swapper/223:05:012
131336899765,26cyclictest30-21rcuc/221:05:022
1313367997424,41cyclictest0-21swapper/123:35:001
1313364997413,24cyclictest21250irq/208-8000000.ethernet21:30:010
131336899724,24cyclictest1347034-21/usr/sbin/munin22:25:182
1313367997225,38cyclictest0-21swapper/122:55:291
131336899706,31cyclictest1329877-21/usr/sbin/munin20:45:202
131336499691,3cyclictest1358741-21latency_hist23:35:000
1313367996831,31cyclictest0-21swapper/121:35:001
1313367996826,34cyclictest0-21swapper/121:00:001
131336799671,2cyclictest0-21swapper/122:10:011
1313367996422,34cyclictest0-21swapper/122:40:301
131336499634,52cyclictest0-21swapper/023:45:190
131336499632,53cyclictest0-21swapper/023:00:220
1313367996225,31cyclictest0-21swapper/121:05:011
1313367996222,32cyclictest0-21swapper/100:10:291
1313367996115,7cyclictest0-21swapper/123:05:301
1313367996031,15cyclictest0-21swapper/119:20:191
1313367996026,28cyclictest0-21swapper/121:55:011
1313367996026,28cyclictest0-21swapper/121:55:011
1313367996024,5cyclictest0-21swapper/122:50:271
1313367995828,25cyclictest0-21swapper/123:50:281
1313367995820,6cyclictest0-21swapper/123:20:301
1313367995718,10cyclictest0-21swapper/119:55:011
131336499571,47cyclictest0-21swapper/021:00:140
1313367995620,6cyclictest1346779-21grep22:20:301
1313367995618,5cyclictest0-21swapper/123:45:301
1313367995540,8cyclictest1342500-21unixbench_multi21:55:281
1313367995540,8cyclictest1342500-21unixbench_multi21:55:281
1313367995525,25cyclictest0-21swapper/120:05:281
1313367995516,8cyclictest0-21swapper/122:15:281
131336799551,47cyclictest1359596-21sendmail23:40:001
131336499557,44cyclictest0-21swapper/000:25:150
131336499557,41cyclictest0-21swapper/020:25:280
131336499542,44cyclictest1316543-21fschecks_time19:25:230
131336899537,18cyclictest30-21rcuc/223:45:022
1313368995310,13cyclictest30-21rcuc/220:55:022
1313367995326,7cyclictest1333338-21/usr/sbin/munin21:05:251
1313367995326,24cyclictest1349462-21sendmail22:40:001
1313367995316,8cyclictest0-21swapper/100:35:301
1313367995315,9cyclictest0-21swapper/119:45:191
1313367995222,5cyclictest168350irq/126-8000000.ethernet-tx119:35:261
1313367995124,21cyclictest0-21swapper/121:15:271
1313367995121,23cyclictest0-21swapper/122:10:301
1313367995121,23cyclictest0-21swapper/122:10:291
131336499511,46cyclictest1357111-21latency_hist23:25:010
1313368995041,5cyclictest1345134-21munin-plugin-st22:15:002
1313368995041,5cyclictest1345134-21munin-plugin-st22:15:002
131336499501,43cyclictest0-21swapper/022:00:280
1313367994920,4cyclictest0-21swapper/121:40:261
1313367994918,4cyclictest0-21swapper/122:45:261
1313367994915,7cyclictest0-21swapper/123:45:001
1313364994942,4cyclictest0-21swapper/019:35:170
131336499492,39cyclictest0-21swapper/021:50:220
131336499492,39cyclictest0-21swapper/021:50:220
131336499491,43cyclictest1361506-21cpu23:50:150
131336499491,41cyclictest0-21swapper/022:45:100
131336499491,41cyclictest0-21swapper/019:20:010
131336499491,35cyclictest0-21swapper/021:40:120
1313368994833,9cyclictest0-21swapper/222:59:592
1313368994827,17cyclictest311ktimers/222:20:132
1313367994818,7cyclictest0-21swapper/100:10:021
1313364994835,8cyclictest1356204-21apt23:20:010
131336499481,42cyclictest0-21swapper/021:30:290
131336499481,41cyclictest0-21swapper/021:20:300
131336499481,41cyclictest0-21swapper/021:20:300
1313368994725,12cyclictest1337525-21gpg-connect-age21:30:002
1313367994715,8cyclictest0-21swapper/120:55:001
1313364994737,7cyclictest0-21swapper/000:35:000
1313364994735,8cyclictest0-21swapper/019:50:280
131336499472,41cyclictest1354416-21tail23:05:320
131336499472,39cyclictest1325825-21fschecks_time20:20:200
1313364994716,27cyclictest0-21swapper/000:10:300
131336499471,39cyclictest0-21swapper/000:35:040
1313368994631,8cyclictest1348498-21grep22:30:292
1313368994626,12cyclictest0-21swapper/223:15:002
1313368994626,10cyclictest0-21swapper/200:10:292
131336499461,32cyclictest0-21swapper/020:40:120
1313368994529,11cyclictest0-21swapper/223:40:292
1313367994522,6cyclictest1347963-21/usr/sbin/munin22:30:261
1313364994535,6cyclictest1339016-21grep21:35:330
1313364994531,9cyclictest0-21swapper/019:45:280
131336499451,5cyclictest0-21swapper/021:50:000
131336499451,38cyclictest0-21swapper/019:10:160
1313368994432,7cyclictest1356103-21grep23:15:292
1313368994427,10cyclictest0-21swapper/221:50:222
1313368994427,10cyclictest0-21swapper/221:50:212
1313367994436,4cyclictest0-21swapper/123:14:591
1313367994425,12cyclictest0-21swapper/119:45:001
131336499441,38cyclictest0-21swapper/019:30:190
131336499441,37cyclictest0-21swapper/000:20:280
131336499441,36cyclictest897-21dropbear22:30:160
1313368994325,12cyclictest311ktimers/220:15:152
131336499432,4cyclictest1322714-21grep20:00:280
131336499431,40cyclictest1364154-21fschecks_time00:05:200
131336499431,40cyclictest0-21swapper/019:55:200
131336499431,36cyclictest0-21swapper/022:05:160
131336499431,36cyclictest0-21swapper/020:10:150
131336499431,33cyclictest0-21swapper/022:55:010
1313368994230,6cyclictest0-21swapper/219:50:292
1313368994229,7cyclictest1364580-21grep00:05:282
1313368994221,14cyclictest311ktimers/219:30:132
1313368994217,12cyclictest311ktimers/200:35:142
1313367994223,6cyclictest1347034-21/usr/sbin/munin22:25:241
1313364994235,3cyclictest0-21swapper/021:55:110
1313364994235,3cyclictest0-21swapper/021:55:110
131336499421,38cyclictest0-21swapper/021:05:180
131336499421,36cyclictest0-21swapper/020:35:010
131336499421,35cyclictest0-21swapper/021:10:130
131336499421,35cyclictest0-21swapper/020:55:010
131336499421,12cyclictest0-21swapper/023:30:000
1313368994126,11cyclictest0-21swapper/219:40:282
1313368994122,15cyclictest311ktimers/219:35:132
1313368994122,14cyclictest311ktimers/221:20:152
1313368994122,14cyclictest311ktimers/221:20:152
1313368994115,13cyclictest311ktimers/222:05:132
1313367994131,5cyclictest0-21swapper/119:30:281
1313367994128,8cyclictest1353614-21grep23:00:301
1313367994127,8cyclictest0-21swapper/121:30:001
1313364994130,4cyclictest0-21swapper/023:35:280
131336499411,4cyclictest0-21swapper/019:45:000
131336499411,38cyclictest0-21swapper/023:55:200
131336499411,38cyclictest0-21swapper/023:10:220
131336499411,35cyclictest1313326-21latency_hist19:10:010
131336499411,35cyclictest0-21swapper/023:40:100
131336499411,34cyclictest1323112-21latency_hist20:05:010
131336499411,34cyclictest0-21swapper/022:55:150
131336499411,33cyclictest0-21swapper/022:15:130
1313368994030,4cyclictest0-21swapper/200:25:292
1313368994025,6cyclictest0-21swapper/221:55:262
1313368994025,6cyclictest0-21swapper/221:55:252
1313368994021,10cyclictest0-21swapper/220:00:212
1313367994032,5cyclictest1358030-21latency_hist23:30:001
1313364994034,4cyclictest0-21swapper/021:15:210
1313364994029,7cyclictest0-21swapper/019:20:280
1313364994027,7cyclictest131ktimers/022:10:320
1313364994027,7cyclictest131ktimers/022:10:310
131336499401,37cyclictest0-21swapper/022:40:010
131336499401,37cyclictest0-21swapper/020:15:220
131336499401,33cyclictest0-21swapper/022:25:110
1313368993923,10cyclictest0-21swapper/221:45:292
1313368993914,14cyclictest311ktimers/220:25:152
1313367993930,5cyclictest1324553-21grep20:10:321
1313367993926,8cyclictest0-21swapper/121:35:321
1313364993932,5cyclictest275-21systemd-journal22:25:000
131336499391,36cyclictest0-21swapper/000:15:230
1313368993829,6cyclictest1366297-21grep00:15:292
1313368993826,7cyclictest0-21swapper/221:35:242
1313368993826,7cyclictest0-21swapper/200:20:282
1313368993825,9cyclictest0-21swapper/222:40:282
1313368993825,7cyclictest1334730-21grep21:10:292
1313368993823,9cyclictest0-21swapper/223:55:212
1313368993818,8cyclictest0-21swapper/222:00:282
1313368993812,13cyclictest311ktimers/223:35:132
1313364993832,2cyclictest0-21swapper/000:00:260
131336499381,35cyclictest0-21swapper/022:40:180
131336499381,35cyclictest0-21swapper/020:55:180
131336499381,35cyclictest0-21swapper/020:30:190
1313368993730,4cyclictest168450irq/134-8000000.ethernet-tx222:40:012
131336899372,24cyclictest3260412-1kworker/2:2H+kblockd20:40:472
131336899372,19cyclictest30-21rcuc/220:15:012
1313368993718,11cyclictest311ktimers/222:15:112
1313368993718,10cyclictest0-21swapper/219:15:022
131336499371,31cyclictest0-21swapper/020:45:020
1313368993624,6cyclictest30-21rcuc/220:30:292
131336899361,4cyclictest0-21swapper/220:00:002
1313367993627,6cyclictest1363824-21munin-plugin-st00:05:011
131336799361,28cyclictest1340188-21/usr/sbin/munin21:45:261
1313368993525,4cyclictest1316897-21grep19:25:302
1313368993523,4cyclictest0-21swapper/223:05:282
1313368993522,9cyclictest0-21swapper/223:50:162
1313368993516,12cyclictest311ktimers/222:50:092
131336899351,27cyclictest1363183-21/usr/sbin/munin00:00:222
1313367993528,4cyclictest0-21swapper/120:45:291
1313367993527,4cyclictest0-21swapper/100:15:291
1313367993525,5cyclictest0-21swapper/123:55:291
1313367993524,6cyclictest1315193-21grep19:15:271
1313367993520,8cyclictest1325381-21unixbench_singl20:15:301
1313368993425,4cyclictest0-21swapper/219:20:012
1313368993424,4cyclictest0-21swapper/223:25:202
1313368993422,8cyclictest0-21swapper/223:20:232
1313368993420,7cyclictest30-21rcuc/220:50:292
1313367993423,7cyclictest0-21swapper/100:35:001
131336799341,27cyclictest0-21swapper/121:20:271
131336799341,27cyclictest0-21swapper/121:20:271
131336799341,27cyclictest0-21swapper/120:35:221
131336799341,26cyclictest0-21swapper/120:25:151
1313368993321,5cyclictest47-21kauditd00:35:002
131336899331,26cyclictest0-21swapper/222:45:112
1313368993310,12cyclictest311ktimers/219:20:112
1313367993323,5cyclictest0-21swapper/123:15:291
131336799332,25cyclictest1668-21snmpd19:26:031
1313367993317,9cyclictest0-21swapper/119:55:281
131336799331,26cyclictest0-21swapper/120:20:111
131336899326,9cyclictest1333338-21/usr/sbin/munin21:05:192
1313368993226,3cyclictest1335668-21latency_hist21:20:002
1313367993226,3cyclictest168350irq/126-8000000.ethernet-tx119:10:131
131336899311,25cyclictest0-21swapper/221:32:542
131336899311,25cyclictest0-21swapper/220:35:272
1313367993123,4cyclictest0-21swapper/121:15:001
1313367993122,6cyclictest1367403-21/usr/sbin/munin00:25:281
1313368993026,2cyclictest0-21swapper/223:30:202
1313368993018,6cyclictest311ktimers/219:45:242
1313367993023,4cyclictest0-21swapper/120:30:271
131336899293,10cyclictest1339349-21/usr/sbin/munin21:40:192
1313368992922,3cyclictest1323792-21latency_hist20:10:012
1313368992912,13cyclictest311ktimers/220:20:142
131336799291,22cyclictest0-21swapper/100:20:171
131336799272,4cyclictest1343219-21ptp4l22:00:271
1313367992720,5cyclictest0-21swapper/120:00:201
1313368992214,5cyclictest0-21swapper/219:10:012
131336799216,8cyclictest1313368-21cyclictest19:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional