You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 23:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Dec 08, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3932822998415,62cyclictest3977351-21munin-plugin-st11:30:000
3932822997520,47cyclictest3986631-21/usr/sbin/munin12:20:310
3932822997520,47cyclictest3986631-21/usr/sbin/munin12:20:300
3932822997423,43cyclictest3962597-21ptp4l-jitter10:00:280
393282699737,31cyclictest30-21rcuc/209:40:202
3932822996820,44cyclictest3939779-21grep07:45:290
3932822996625,35cyclictest3940340-21/usr/sbin/munin07:50:270
3932822996616,42cyclictest3960079-21/usr/sbin/munin09:45:280
393282299646,29cyclictest0-21swapper/010:55:010
3932822996426,3cyclictest3975329-21/usr/sbin/munin11:15:250
3932826996312,16cyclictest3964780-21/usr/sbin/munin10:15:222
3932822996330,27cyclictest3978833-21/usr/sbin/munin11:35:270
3932822996322,5cyclictest3971063-21/usr/sbin/munin10:50:240
3932822996220,38cyclictest0-21swapper/007:25:190
3932822996122,4cyclictest3948642-21diskstats08:40:190
3932822996017,4cyclictest3989346-21munin-run12:40:000
3932826995924,17cyclictest30-21rcuc/211:35:012
3932822995921,3cyclictest3966537-21df10:25:180
393282699585,20cyclictest30-21rcuc/210:20:012
3932822995824,28cyclictest3957423-21/usr/sbin/munin09:30:260
3932822995819,4cyclictest3933939-21entropy07:15:040
3932822995722,5cyclictest3970285-21tail10:45:280
3932822995717,33cyclictest3943238-21sed08:05:290
393282499567,19cyclictest0-21swapper/111:15:191
3932822995612,36cyclictest3972553-21dropbear11:00:210
3932822995422,28cyclictest3938885-21sed07:40:280
3932822995333,14cyclictest0-21swapper/010:05:150
3932822995326,13cyclictest0-21swapper/010:30:140
393282299531,38cyclictest0-21swapper/009:20:020
393282499524,24cyclictest231ktimers/109:25:001
3932824995118,23cyclictest24-21ksoftirqd/111:55:221
393282499511,19cyclictest0-21swapper/107:25:201
3932822995129,3cyclictest3987867-21/usr/sbin/munin12:30:120
3932822995123,19cyclictest0-21swapper/008:45:160
3932822995118,30cyclictest3933539-21unixbench_multi07:10:290
3932822995118,26cyclictest0-21swapper/008:00:010
3932822995117,9cyclictest3964200-21/usr/sbin/munin10:10:240
3932822995112,33cyclictest0-21swapper/010:35:250
3932822995110,28cyclictest3595125-1kworker/0:1H+kblockd07:40:010
3932826995026,16cyclictest3974811-21munin-plugin-st11:15:002
3932824995044,4cyclictest0-21swapper/108:20:201
3932824995041,7cyclictest0-21swapper/107:40:011
3932822995032,11cyclictest3955333-21apt-get09:20:170
3932822995028,16cyclictest21250irq/208-8000000.ethernet11:30:160
3932824994927,13cyclictest3970793-21apt-get10:50:171
3932822994918,10cyclictest3948232-21grep08:35:280
3932822994840,3cyclictest3945195-21apt-get08:20:130
3932822994731,11cyclictest0-21swapper/007:30:140
3932822994720,3cyclictest3975874-21apt-get11:20:120
3932822994716,28cyclictest3943610-21sh08:10:180
3932822994714,26cyclictest3987660-21latency_hist12:30:010
393282299471,3cyclictest0-21swapper/009:00:010
3932822994712,28cyclictest3951081-21latency_hist08:55:010
3932826994633,9cyclictest3938129-21sendmail07:40:002
393282299467,4cyclictest0-21swapper/012:10:010
3932822994611,31cyclictest3973472-21dropbear11:05:210
3932822994537,4cyclictest3947029-21ssh08:30:230
3932822994537,4cyclictest3947029-21ssh08:30:230
3932822994536,4cyclictest3980181-21apt-get11:45:160
3932822994526,14cyclictest3942416-21sed08:00:280
3932822994526,14cyclictest3942416-21sed08:00:270
3932822994518,8cyclictest3979910-21sed11:40:300
3932822994518,3cyclictest3956897-21munin-run09:30:010
3932822994515,11cyclictest3961411-21dropbear09:55:200
3932826994432,9cyclictest3989349-21sendmail12:40:012
3932826994430,8cyclictest0-21swapper/208:40:282
3932824994429,8cyclictest0-21swapper/109:40:231
3932824994426,13cyclictest0-21swapper/107:35:291
393282299448,7cyclictest3960906-21cut09:50:270
3932822994429,11cyclictest0-21swapper/009:40:150
3932822994426,3cyclictest3982786-21/usr/sbin/munin12:00:180
3932822994423,4cyclictest3981103-21fschecks_count11:50:200
3932822994422,15cyclictest0-21swapper/010:20:130
3932826994327,10cyclictest0-21swapper/211:50:212
393282499436,16cyclictest22-21rcuc/108:05:021
393282499436,16cyclictest22-21rcuc/108:05:021
3932824994331,5cyclictest0-21swapper/108:10:261
3932824994328,8cyclictest0-21swapper/112:25:001
3932824994328,8cyclictest0-21swapper/112:25:001
3932822994337,3cyclictest3953631-21apt-get09:10:130
3932822994336,4cyclictest3981978-21ssh11:55:230
3932822994335,5cyclictest3953312-21grep09:05:290
3932822994335,4cyclictest3946034-21apt-get08:25:140
3932822994334,5cyclictest3934973-21apt-get07:20:140
3932822994314,7cyclictest0-21swapper/010:40:280
3932826994234,4cyclictest3944984-21sendmail08:20:002
3932826994234,4cyclictest3944984-21sendmail08:20:002
3932826994231,6cyclictest3983356-21munin-plugin-st12:05:002
3932826994228,9cyclictest0-21swapper/211:45:282
3932826994226,10cyclictest0-21swapper/209:35:012
3932824994233,4cyclictest168350irq/126-8000000.ethernet-tx107:30:251
3932824994228,7cyclictest3934768-21sendmail07:20:011
3932824994228,10cyclictest0-21swapper/110:40:001
3932824994225,11cyclictest3952792-21apt-get09:05:161
3932824994223,13cyclictest3972492-21apt-get11:00:191
3932824994223,11cyclictest3979340-21apt-get11:40:181
3932824994222,10cyclictest0-21swapper/109:25:281
3932824994220,13cyclictest0-21swapper/108:55:301
3932822994233,7cyclictest3944958-21sshd08:18:100
3932822994233,7cyclictest3944958-21sshd08:18:100
3932822994233,6cyclictest3985421-21ssh12:15:190
3932822994224,13cyclictest3964936-21fschecks_time10:15:230
3932822994220,7cyclictest3958070-21fschecks_time09:35:200
3932822994211,25cyclictest0-21swapper/009:00:140
3932826994128,8cyclictest0-21swapper/207:25:292
393282499416,29cyclictest0-21swapper/110:15:221
3932824994131,6cyclictest0-21swapper/110:45:311
3932824994127,9cyclictest3941395-21grep07:55:301
3932824994126,9cyclictest0-21swapper/108:35:191
3932824994124,11cyclictest3985327-21apt-get12:15:161
3932822994122,15cyclictest3974818-21latency_hist11:15:010
3932826994028,8cyclictest0-21swapper/210:04:592
393282499409,19cyclictest3987865-21/usr/sbin/munin12:30:201
3932824994031,5cyclictest3947407-21grep08:30:301
3932824994031,5cyclictest3947407-21grep08:30:291
3932824994028,8cyclictest3953628-21munin-node09:10:111
3932824994028,8cyclictest0-21swapper/111:30:291
3932824994027,7cyclictest3979060-21grep11:35:291
3932824994024,8cyclictest3976030-21ssh11:20:211
393282499401,20cyclictest3962899-21cat10:05:011
393282299406,31cyclictest0-21swapper/012:10:160
3932826993930,4cyclictest0-21swapper/208:29:592
3932826993927,8cyclictest0-21swapper/210:50:292
3932826993925,8cyclictest0-21swapper/212:10:272
3932826993925,12cyclictest311ktimers/208:45:172
3932826993919,15cyclictest0-21swapper/208:10:012
393282499394,28cyclictest0-21swapper/108:25:171
3932824993930,4cyclictest0-21swapper/111:50:291
393282499392,8cyclictest24-21ksoftirqd/112:40:021
3932826993826,8cyclictest0-21swapper/209:00:312
3932826993825,9cyclictest0-21swapper/212:15:292
3932826993819,9cyclictest0-21swapper/208:50:222
393282499387,26cyclictest0-21swapper/110:30:251
393282499385,27cyclictest0-21swapper/109:15:281
3932824993828,6cyclictest3966221-21grep10:20:291
3932824993822,11cyclictest3983353-21apt-get12:05:061
3932824993818,12cyclictest0-21swapper/110:05:311
3932824993814,13cyclictest0-21swapper/109:30:151
3932826993727,7cyclictest0-21swapper/210:25:302
3932826993720,13cyclictest3938883-21grep07:40:272
393282499378,20cyclictest0-21swapper/110:55:291
3932824993729,4cyclictest168350irq/126-8000000.ethernet-tx109:35:261
3932824993725,6cyclictest3949410-21/usr/sbin/munin08:45:201
3932824993723,8cyclictest0-21swapper/112:25:191
3932824993721,12cyclictest3974615-21/usr/sbin/munin11:10:271
393282499371,29cyclictest3943232-21head08:05:301
3932826993627,6cyclictest0-21swapper/209:20:222
3932826993626,5cyclictest0-21swapper/211:10:012
3932826993624,8cyclictest0-21swapper/208:10:262
3932826993624,6cyclictest3973067-21grep11:00:322
393282699361,5cyclictest3260412-1kworker/2:2H+kblockd07:24:252
3932824993622,9cyclictest3980793-21sshd11:46:111
3932824993618,10cyclictest3964375-21/usr/sbin/munin10:10:281
3932824993614,13cyclictest3952022-21/usr/sbin/munin09:00:211
3932824993611,18cyclictest3939787-21grep07:45:291
393282299365,27cyclictest3932883-21cat07:10:000
3932826993527,4cyclictest0-21swapper/207:15:012
3932826993524,6cyclictest0-21swapper/208:30:192
3932826993524,6cyclictest0-21swapper/208:30:192
3932826993523,7cyclictest311ktimers/210:10:172
3932826993521,11cyclictest0-21swapper/209:10:262
3932826993513,7cyclictest3951715-21kworker/u8:2+events_power_efficient10:45:022
3932824993523,8cyclictest0-21swapper/109:55:291
3932824993523,5cyclictest3949093-21grep08:40:281
393282499351,27cyclictest0-21swapper/112:00:241
3932826993425,4cyclictest3953372-21grep09:05:282
3932826993424,7cyclictest0-21swapper/208:20:282
3932826993424,6cyclictest3976441-21grep11:20:292
3932826993420,7cyclictest0-21swapper/207:50:302
3932824993423,8cyclictest0-21swapper/111:30:001
3932824993422,5cyclictest0-21swapper/107:10:261
393282499341,27cyclictest0-21swapper/112:10:231
393282499341,26cyclictest0-21swapper/110:25:261
3932826993326,5cyclictest0-21swapper/209:20:012
3932826993320,9cyclictest311ktimers/207:45:122
3932826993319,9cyclictest0-21swapper/207:30:272
3932826993315,13cyclictest0-21swapper/209:50:282
3932824993327,4cyclictest0-21swapper/109:50:011
3932824993322,3cyclictest0-21swapper/107:20:201
3932824993321,6cyclictest3959633-21/usr/sbin/munin09:45:241
393282499331,2cyclictest0-21swapper/108:50:021
393282499331,26cyclictest0-21swapper/111:05:231
3932826993225,4cyclictest0-21swapper/207:15:272
3932826993222,6cyclictest0-21swapper/212:20:312
3932826993222,6cyclictest0-21swapper/212:20:312
3932826993222,6cyclictest0-21swapper/207:55:312
393282699321,4cyclictest3982499-21munin-run12:00:002
3932824993221,7cyclictest3944413-21/usr/sbin/munin08:15:191
3932824993221,7cyclictest3944413-21/usr/sbin/munin08:15:191
3932826993125,4cyclictest3987022-21/usr/sbin/munin12:25:252
3932826993125,4cyclictest0-21swapper/208:55:182
3932826993123,5cyclictest3976709-21/usr/sbin/munin11:25:282
3932826993123,5cyclictest0-21swapper/211:30:292
3932826993122,4cyclictest3942398-21grep08:00:282
3932826993122,4cyclictest3942398-21grep08:00:282
3932826993121,7cyclictest30-21rcuc/208:35:232
3932826993120,8cyclictest0-21swapper/209:45:292
3932826993120,5cyclictest0-21swapper/209:35:222
3932826993119,9cyclictest311ktimers/212:30:122
3932826993119,8cyclictest0-21swapper/209:55:202
3932826993113,4cyclictest837-21systemd-network10:45:242
393282699310,14cyclictest3963101-21/usr/sbin/munin10:05:212
3932824993124,4cyclictest3940022-21apt-get07:50:151
3932826993020,6cyclictest0-21swapper/211:15:282
3932824993021,4cyclictest231ktimers/110:40:231
3932826992922,5cyclictest3968782-21sshd10:36:092
3932826992920,6cyclictest0-21swapper/211:40:302
3932826992920,5cyclictest0-21swapper/209:25:212
3932826992719,6cyclictest0-21swapper/210:55:212
3932826992715,6cyclictest0-21swapper/210:30:292
3932826992620,4cyclictest0-21swapper/212:08:112
3932824992617,7cyclictest3932783-21latency_hist07:09:591
393282699191,10cyclictest3932873-21grep07:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional