You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 13:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Jul 20, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2789718991228,18cyclictest2821439-21kworker/u8:1+ext4-rsv-conversion22:30:012
2789718999486,5cyclictest311ktimers/200:05:012
278971499882,79cyclictest2813130-21/usr/sbin/munin21:25:181
278971399751,59cyclictest0-21swapper/019:30:130
278971499682,30cyclictest0-21swapper/123:05:001
278971499651,52cyclictest0-21swapper/100:20:151
278971499651,50cyclictest0-21swapper/122:20:141
278971499641,54cyclictest0-21swapper/120:45:101
278971499641,50cyclictest0-21swapper/120:30:131
278971499641,48cyclictest0-21swapper/121:10:141
278971499621,52cyclictest0-21swapper/122:50:151
278971499621,49cyclictest0-21swapper/121:00:171
278971499621,47cyclictest0-21swapper/122:15:151
278971399625,24cyclictest15-21rcuc/022:35:000
2789714996121,32cyclictest0-21swapper/120:55:221
278971499611,52cyclictest0-21swapper/121:30:131
278971499611,52cyclictest0-21swapper/120:05:201
278971499611,52cyclictest0-21swapper/100:30:121
278971499611,48cyclictest0-21swapper/123:30:121
278971499611,45cyclictest0-21swapper/100:25:121
278971499611,45cyclictest0-21swapper/100:25:121
2789714996033,22cyclictest2839456-21sendmail00:00:001
278971499602,40cyclictest0-21swapper/120:15:011
2789714996022,30cyclictest0-21swapper/123:20:291
278971499601,50cyclictest0-21swapper/123:35:131
278971499600,41cyclictest2831213-21/usr/sbin/munin23:10:181
2789714995935,19cyclictest2829229-21latency_hist23:00:001
278971499591,53cyclictest0-21swapper/121:45:001
278971499591,44cyclictest0-21swapper/119:35:161
278971499591,42cyclictest0-21swapper/121:05:121
2789718995816,27cyclictest30-21rcuc/223:50:012
2789718995816,27cyclictest30-21rcuc/223:50:012
278971499584,45cyclictest2790520-21unixbench_singl19:10:301
278971499584,45cyclictest2790520-21unixbench_singl19:10:291
2789714995827,26cyclictest0-21swapper/119:20:301
2789714995819,36cyclictest1660-21snmpd21:47:291
278971499581,47cyclictest0-21swapper/121:55:161
2789714995730,22cyclictest0-21swapper/121:50:281
278971499572,47cyclictest2803000-21apt-get20:25:161
278971499572,47cyclictest2803000-21apt-get20:25:151
278971499571,44cyclictest0-21swapper/120:40:121
2789714995630,23cyclictest167450irq/126-8000000.ethernet-tx100:13:391
2789714995615,33cyclictest0-21swapper/122:45:291
278971499561,47cyclictest2839766-21ssh00:00:201
278971499561,47cyclictest2832056-21apt-get23:15:151
278971499561,43cyclictest0-21swapper/119:45:101
278971399569,9cyclictest2829228-21apt-get23:00:020
278971499551,46cyclictest2815183-21/usr/sbin/munin21:35:281
278971499551,45cyclictest2798754-21/usr/sbin/munin20:00:161
278971499551,44cyclictest2821113-21/usr/sbin/munin22:10:231
278971499551,44cyclictest0-21swapper/123:45:131
278971499551,44cyclictest0-21swapper/123:45:121
2789714995514,32cyclictest0-21swapper/120:10:291
278971499551,39cyclictest0-21swapper/119:15:131
278971499541,45cyclictest2830375-21/usr/sbin/munin23:05:121
278971499541,45cyclictest2830375-21/usr/sbin/munin23:05:121
278971499541,45cyclictest2804762-21/usr/sbin/munin20:35:191
278971499541,45cyclictest2802158-21munin-node20:20:111
278971499541,43cyclictest0-21swapper/122:00:121
278971499541,43cyclictest0-21swapper/119:55:141
2789718995348,2cyclictest0-21swapper/219:35:222
278971499533,42cyclictest2796991-21/usr/sbin/munin19:50:121
278971499533,42cyclictest2796991-21/usr/sbin/munin19:50:111
278971499532,44cyclictest2795713-21/usr/sbin/munin19:40:281
278971499532,43cyclictest2794186-21unixbench_singl19:30:311
2789714995315,31cyclictest2842350-21dropbear00:15:201
278971499531,45cyclictest2826158-21/usr/sbin/munin22:40:221
278971499531,45cyclictest2823441-21munin-node22:25:101
278971499531,45cyclictest2820214-21/usr/sbin/munin22:05:251
278971499531,45cyclictest2812556-21/usr/sbin/munin21:20:271
278971499531,44cyclictest2807417-21/usr/sbin/munin20:50:221
278971899525,38cyclictest0-21swapper/200:25:012
278971499522,43cyclictest2792983-21/usr/sbin/munin19:25:231
278971499522,42cyclictest2845640-21ssh00:35:151
278971499521,44cyclictest2833982-21/usr/sbin/munin23:25:231
278971499521,43cyclictest2838201-21/usr/sbin/munin23:50:211
2789718995141,6cyclictest0-21swapper/221:00:002
278971499512,42cyclictest2811992-21/usr/sbin/munin21:15:301
278971499512,41cyclictest2836650-21/usr/sbin/munin23:40:271
278971499512,41cyclictest2825203-21/usr/sbin/munin22:35:191
278971499511,42cyclictest2840578-21/usr/sbin/munin00:05:231
278971499511,37cyclictest0-21swapper/122:30:121
278971399511,47cyclictest2836419-21grep23:40:200
278971399511,27cyclictest0-21swapper/021:45:180
278971399501,4cyclictest0-21swapper/021:05:200
2789713994838,7cyclictest2831857-21munin-plugin-st23:14:590
2789713994835,8cyclictest0-21swapper/023:20:290
278971399483,4cyclictest2817695-21phc2sys-jitter21:50:260
278971399481,45cyclictest0-21swapper/021:00:330
2789713994739,4cyclictest167350irq/118-8000000.ethernet-tx000:15:270
2789718994633,9cyclictest2841994-21munin-plugin-st00:15:012
2789714994520,19cyclictest0-21swapper/119:10:001
2789713994538,4cyclictest167350irq/118-8000000.ethernet-tx021:10:240
2789713994538,4cyclictest167350irq/118-8000000.ethernet-tx020:35:000
2789713994531,9cyclictest0-21swapper/021:25:200
278971399451,4cyclictest0-21swapper/022:20:020
2789718994437,4cyclictest2832701-21run-parts23:20:012
2789718994435,5cyclictest0-21swapper/222:05:272
2789718994426,10cyclictest0-21swapper/222:35:272
2789718994424,6cyclictest311ktimers/220:05:012
2789713994434,5cyclictest0-21swapper/022:10:290
278971399443,18cyclictest15-21rcuc/023:50:020
278971399443,18cyclictest15-21rcuc/023:50:020
2789713994428,9cyclictest0-21swapper/019:10:010
2789713994428,10cyclictest0-21swapper/019:15:010
2789713994428,10cyclictest0-21swapper/019:15:010
278971399442,11cyclictest2823162-21gpgv22:25:020
2789713994338,4cyclictest0-21swapper/020:45:230
2789713994336,4cyclictest167350irq/118-8000000.ethernet-tx022:40:150
278971399433,5cyclictest2839457-21munin-run00:00:010
278971399433,5cyclictest2808474-21ptp4l-jitter20:55:280
2789713994333,7cyclictest20850irq/208-8000000.ethernet23:20:000
2789713994328,11cyclictest0-21swapper/020:20:210
278971399432,5cyclictest2791372-21meminfo19:15:260
2789718994235,4cyclictest2845385-21munin-plugin-st00:34:592
2789718994231,6cyclictest0-21swapper/220:10:172
2789718994229,9cyclictest0-21swapper/221:35:302
2789718994225,9cyclictest0-21swapper/220:30:292
2789718994212,10cyclictest2816507-21/usr/sbin/munin21:45:192
2789713994236,4cyclictest0-21swapper/020:05:010
2789713994234,4cyclictest2801008-21apt-get20:15:040
278971399423,29cyclictest2828401-21apt-key22:55:010
2789713994230,8cyclictest0-21swapper/019:59:590
2789713994228,9cyclictest0-21swapper/021:20:230
2789713994227,9cyclictest0-21swapper/000:30:300
2789713994227,12cyclictest0-21swapper/000:20:260
2789713994217,11cyclictest2845583-21/usr/sbin/munin00:35:190
278971399421,36cyclictest2806121-21sed20:40:290
2789713994134,4cyclictest167350irq/118-8000000.ethernet-tx023:30:260
2789713994129,9cyclictest0-21swapper/019:35:300
2789713994129,8cyclictest0-21swapper/023:00:310
2789713994129,8cyclictest0-21swapper/022:35:280
278971399412,4cyclictest2800669-21memory20:10:250
278971399412,4cyclictest0-21swapper/021:35:020
278971399411,5cyclictest2796763-21users19:45:270
278971399411,38cyclictest0-21swapper/022:05:000
2789718994032,5cyclictest0-21swapper/220:40:002
2789718994025,9cyclictest0-21swapper/200:30:012
2789718994025,9cyclictest0-21swapper/200:30:012
2789718994016,11cyclictest0-21swapper/223:35:022
2789713994034,3cyclictest2818257-21df_inode21:55:190
2789713994033,4cyclictest0-21swapper/021:40:200
2789713994031,6cyclictest0-21swapper/023:29:590
278971399401,5cyclictest2839829-21sh00:00:220
278971399401,4cyclictest2844068-21perl00:25:200
278971399401,4cyclictest2844068-21perl00:25:190
278971899396,23cyclictest30-21rcuc/222:10:102
2789718993924,11cyclictest2829250-21http23:00:002
2789713993934,3cyclictest0-21swapper/022:25:210
2789713993933,3cyclictest0-21swapper/000:05:170
278971399391,4cyclictest2799590-21ssh20:05:220
278971399391,3cyclictest2841916-21unixbench_singl00:10:290
278971399391,3cyclictest2795377-21df_inode19:40:180
278971899388,16cyclictest2840509-21/usr/sbin/munin00:05:252
2789718993830,4cyclictest14-21rcu_preempt21:50:282
278971899381,3cyclictest0-21swapper/220:30:012
278971899381,3cyclictest0-21swapper/220:30:012
2789713993832,4cyclictest2797625-21cron19:55:000
2789713993832,4cyclictest2797625-21cron19:55:000
2789713993832,3cyclictest0-21swapper/022:45:220
2789713993831,3cyclictest2812250-21cat21:20:010
2789713993826,8cyclictest0-21swapper/020:35:310
278971399381,35cyclictest0-21swapper/023:35:290
278971399381,2cyclictest0-21swapper/023:10:020
278971399381,2cyclictest0-21swapper/023:10:020
2789718993729,4cyclictest0-21swapper/219:10:292
2789718993729,4cyclictest0-21swapper/219:10:292
2789718993727,7cyclictest2801825-21grep20:15:302
2789718993726,8cyclictest0-21swapper/223:50:282
2789718993722,8cyclictest0-21swapper/223:55:262
2789718993722,7cyclictest0-21swapper/222:00:272
2789713993729,6cyclictest131ktimers/023:50:290
278971399371,32cyclictest2807812-21unixbench_singl20:50:290
278971899366,27cyclictest2836736-21gzip23:40:272
2789718993627,7cyclictest311ktimers/222:40:122
2789718993627,5cyclictest0-21swapper/223:40:002
2789718993626,4cyclictest0-21swapper/223:10:262
2789718993625,7cyclictest0-21swapper/222:15:302
278971899362,28cyclictest14-21rcu_preempt19:45:262
2789713993622,12cyclictest0-21swapper/021:35:210
278971399361,33cyclictest0-21swapper/022:06:060
2789718993526,5cyclictest0-21swapper/200:35:152
2789718993523,8cyclictest0-21swapper/219:30:312
278971899352,28cyclictest2833756-21/usr/sbin/munin23:25:262
278971899351,10cyclictest0-21swapper/220:10:012
2789713993528,4cyclictest0-21swapper/019:25:190
2789718993426,5cyclictest2833484-21unixbench_singl23:20:302
2789718993422,8cyclictest2813725-21grep21:25:282
278971899341,27cyclictest0-21swapper/221:10:172
2789713993426,5cyclictest131ktimers/019:20:270
2789718993325,4cyclictest0-21swapper/219:15:272
2789718993322,6cyclictest0-21swapper/221:30:172
2789718993318,9cyclictest2809751-21/usr/sbin/munin21:05:202
2789718993312,16cyclictest311ktimers/221:55:132
2789713993328,3cyclictest0-21swapper/020:27:540
2789713993328,3cyclictest0-21swapper/020:27:540
2789718993222,7cyclictest0-21swapper/221:00:332
2789718993220,8cyclictest0-21swapper/219:25:202
278971899321,25cyclictest0-21swapper/219:50:112
278971899321,25cyclictest0-21swapper/219:50:112
2789718993211,15cyclictest311ktimers/220:45:092
2789718993120,8cyclictest0-21swapper/222:35:002
278971899311,25cyclictest0-21swapper/220:20:122
2789718993023,5cyclictest2827453-21cron22:49:592
2789718993018,4cyclictest0-21swapper/222:55:012
278971899301,27cyclictest0-21swapper/219:41:572
278971899294,20cyclictest30-21rcuc/223:00:162
2789718992922,4cyclictest2842775-21grep00:15:302
2789718992921,5cyclictest0-21swapper/221:20:012
2789718992921,4cyclictest0-21swapper/219:20:222
2789718992920,5cyclictest2830964-21grep23:05:302
2789718992920,5cyclictest2830964-21grep23:05:302
2789718992918,3cyclictest2789938-21latency_hist19:10:012
278971899291,3cyclictest0-21swapper/220:40:162
2789718992820,6cyclictest311ktimers/221:40:272
2789718992817,8cyclictest0-21swapper/219:55:302
278971899267,15cyclictest30-21rcuc/221:20:172
2789718992619,4cyclictest0-21swapper/220:50:282
2789718992614,8cyclictest0-21swapper/222:20:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional