You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 02:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Dec 30, 2025 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
732103997771,4cyclictest231ktimers/109:00:191
73210599765,4cyclictest783403-21apt-get12:10:012
732105997432,35cyclictest0-21swapper/209:00:282
732105997024,37cyclictest0-21swapper/209:35:012
732105997024,37cyclictest0-21swapper/209:35:012
732105996819,38cyclictest0-21swapper/210:45:302
732105996818,41cyclictest0-21swapper/207:25:202
73210099636,36cyclictest15-21rcuc/007:30:010
732105996221,32cyclictest0-21swapper/207:15:012
73210599612,14cyclictest754613-21latency_hist09:20:012
732105995916,4cyclictest0-21swapper/207:40:292
73210599584,15cyclictest782512-21head12:00:292
73210599584,15cyclictest782512-21head12:00:292
73210599583,9cyclictest747587-21grep08:35:312
732105995815,32cyclictest0-21swapper/209:40:272
732105995813,7cyclictest774810-21unixbench_singl11:15:312
73210599581,15cyclictest764072-21apt-get10:15:142
732105995723,28cyclictest0-21swapper/209:40:012
73210599571,15cyclictest752078-21apt-get09:05:172
73210399577,20cyclictest22-21rcuc/109:00:011
73210099575,43cyclictest0-21swapper/007:15:020
73210599555,12cyclictest0-21swapper/207:30:272
732105995515,5cyclictest0-21swapper/212:25:202
73210599547,11cyclictest732097-21cyclictest11:30:012
73210599544,12cyclictest784292-21sed12:10:292
73210599543,10cyclictest785997-21grep12:20:302
732105995416,5cyclictest753437-21unixbench_multi09:10:282
732105995414,3cyclictest0-21swapper/208:10:222
732105995412,6cyclictest0-21swapper/208:05:252
732105995412,4cyclictest0-21swapper/207:35:292
73210599536,14cyclictest0-21swapper/208:55:252
73210599534,13cyclictest745842-21grep08:25:282
73210599533,13cyclictest780807-21grep11:50:292
732105995321,26cyclictest0-21swapper/210:30:282
732105995318,27cyclictest0-21swapper/210:55:292
732105995315,4cyclictest0-21swapper/208:45:292
732105995314,6cyclictest778315-21cron11:40:002
732105995312,5cyclictest0-21swapper/209:25:282
732105995311,6cyclictest0-21swapper/210:40:272
732100995345,5cyclictest762083-21grep10:00:290
73210599524,10cyclictest777422-21unixbench_singl11:30:292
73210599524,10cyclictest777422-21unixbench_singl11:30:292
73210599523,12cyclictest760458-21grep09:50:302
732105995219,2cyclictest0-21swapper/210:10:292
73210599521,44cyclictest0-21swapper/211:10:252
732105995213,5cyclictest0-21swapper/210:50:232
732105995211,7cyclictest0-21swapper/211:20:262
732105995211,5cyclictest0-21swapper/209:55:292
732103995210,16cyclictest231ktimers/110:05:011
732100995243,4cyclictest20650irq/252-8000000.ethernet11:45:010
73210099521,6cyclictest788612-21latency_hist12:40:010
73210599513,9cyclictest740823-21grep07:55:282
73210599512,12cyclictest749950-21ptp4l08:50:292
732105995114,28cyclictest0-21swapper/210:25:012
732105995112,7cyclictest0-21swapper/212:15:262
73210599511,15cyclictest755135-21ptp4l-jitter09:20:282
732103995142,5cyclictest0-21swapper/107:30:291
73210099516,32cyclictest754781-1kworker/0:0H+mmc_complete10:00:000
732100995136,12cyclictest15-21rcuc/011:00:130
732100995132,12cyclictest131ktimers/011:55:160
73210099513,12cyclictest749424-21wc08:50:010
73210599508,6cyclictest766404-21cron10:30:002
73210599503,8cyclictest772102-21ptp4l11:00:272
73210599503,12cyclictest734919-21head07:20:262
732105995014,5cyclictest0-21swapper/211:55:282
73210599501,43cyclictest0-21swapper/208:20:172
732100995043,4cyclictest0-21swapper/007:35:110
73210099501,6cyclictest759812-21latency_hist09:50:010
73210099501,5cyclictest780870-21cat11:54:590
73210599493,8cyclictest787607-21sed12:30:282
73210599492,12cyclictest746571-21ptp4l08:30:262
732103994933,9cyclictest24-21ksoftirqd/107:55:011
732100994941,5cyclictest20850irq/208-8000000.ethernet09:15:270
732100994921,25cyclictest0-21swapper/012:25:220
73210599484,8cyclictest778908-21wc11:40:272
732105994816,6cyclictest311ktimers/207:50:192
732105994813,9cyclictest0-21swapper/207:15:052
732103994835,9cyclictest0-21swapper/107:15:021
73210599475,9cyclictest0-21swapper/209:45:282
732105994711,5cyclictest0-21swapper/212:35:282
73210099471,44cyclictest0-21swapper/010:53:280
73210099471,40cyclictest774006-21latency_hist11:15:010
73210599469,9cyclictest0-21swapper/208:00:272
73210599462,13cyclictest748381-21tail08:40:292
732105994621,22cyclictest762388-21/usr/sbin/munin10:05:282
732103994636,6cyclictest0-21swapper/109:25:291
732103994632,9cyclictest0-21swapper/111:15:311
73210099461,4cyclictest775486-21tail11:20:260
732105994511,6cyclictest47-21kauditd10:40:012
73210399451,18cyclictest22-21rcuc/109:25:011
732100994533,9cyclictest0-21swapper/010:05:240
73210099452,5cyclictest739929-21unixbench_multi07:50:270
73210099451,7cyclictest734412-21diskstats07:20:170
73210099451,42cyclictest0-21swapper/010:25:220
73210599444,8cyclictest762141-21grep10:00:292
73210599443,8cyclictest739119-21grep07:45:302
732105994434,6cyclictest779903-21grep11:45:282
732105994434,6cyclictest779903-21grep11:45:282
732105994417,6cyclictest773069-21unixbench_multi11:05:292
73210099448,33cyclictest0-21swapper/010:20:130
732100994437,4cyclictest167350irq/118-8000000.ethernet-tx012:10:180
732100994437,4cyclictest167350irq/118-8000000.ethernet-tx008:14:380
732100994436,4cyclictest167350irq/118-8000000.ethernet-tx008:30:280
732100994430,10cyclictest0-21swapper/009:05:290
73210099442,5cyclictest787145-21diskstats12:30:180
73210099442,5cyclictest750636-21irqstats08:55:210
732103994329,5cyclictest0-21swapper/107:15:061
732103994321,16cyclictest231ktimers/109:55:141
73210099437,23cyclictest754781-1kworker/0:0H+mmc_complete10:50:020
732100994336,4cyclictest167350irq/118-8000000.ethernet-tx009:00:240
73210099433,4cyclictest767127-21/usr/sbin/munin10:30:290
73210099433,3cyclictest757859-21cron09:40:000
73210399422,22cyclictest22-21rcuc/111:30:011
732100994235,4cyclictest0-21swapper/010:15:270
732100994234,4cyclictest742309-21ps08:05:300
73210099422,4cyclictest760430-21unixbench_singl09:50:290
73210099421,39cyclictest0-21swapper/009:10:280
732103994129,9cyclictest778337-21sendmail11:39:591
732103994129,8cyclictest0-21swapper/111:05:291
732103994128,8cyclictest0-21swapper/109:15:001
732103994127,8cyclictest0-21swapper/110:40:291
732103994125,9cyclictest0-21swapper/110:15:271
732103994124,13cyclictest0-21swapper/111:45:281
732103994124,13cyclictest0-21swapper/111:45:281
732103994123,9cyclictest0-21swapper/112:30:281
732103994120,12cyclictest0-21swapper/110:10:301
732100994134,4cyclictest167350irq/118-8000000.ethernet-tx011:35:240
732100994131,7cyclictest745035-21grep08:20:290
732100994128,7cyclictest785735-21tail12:20:270
732100994123,10cyclictest780844-21kworker/u8:3+events_power_efficient12:05:210
732100994117,22cyclictest14-21rcu_preempt12:15:210
73210099411,4cyclictest758698-21users09:40:300
73210099411,34cyclictest0-21swapper/008:00:010
73210399405,27cyclictest22-21rcuc/111:30:201
73210399405,27cyclictest22-21rcuc/111:30:201
732103994032,5cyclictest0-21swapper/108:20:281
732103994026,9cyclictest0-21swapper/108:15:301
732103994026,10cyclictest0-21swapper/110:45:301
732103994025,12cyclictest0-21swapper/112:25:281
732100994033,4cyclictest0-21swapper/009:30:160
732100994033,4cyclictest0-21swapper/009:30:160
732100994031,4cyclictest0-21swapper/007:20:010
73210099401,4cyclictest777351-21find11:30:290
73210099401,4cyclictest777351-21find11:30:290
73210099401,37cyclictest0-21swapper/008:15:310
73210099401,35cyclictest781704-21latency_hist12:00:010
73210099401,35cyclictest781704-21latency_hist12:00:010
732103993929,5cyclictest0-21swapper/110:25:311
732103993927,8cyclictest0-21swapper/108:50:311
732103993924,9cyclictest785135-21grep12:15:291
732103993921,14cyclictest231ktimers/110:20:121
732100993932,4cyclictest768091-21sendmail10:40:010
732100993921,16cyclictest0-21swapper/008:50:200
732100993914,18cyclictest0-21swapper/008:05:020
73210099391,3cyclictest747546-21awk08:35:310
73210099391,35cyclictest0-21swapper/008:40:140
732103993829,5cyclictest167450irq/126-8000000.ethernet-tx109:35:241
732103993823,9cyclictest0-21swapper/109:30:301
732103993823,9cyclictest0-21swapper/109:30:291
732100993831,4cyclictest15-21rcuc/010:55:170
73210099381,4cyclictest0-21swapper/011:25:200
73210099381,3cyclictest763853-21sshd10:12:290
73210099381,3cyclictest755616-21df_inode09:25:190
73210099381,35cyclictest0-21swapper/009:20:290
73210099381,34cyclictest0-21swapper/011:05:120
732103993724,7cyclictest0-21swapper/110:35:281
732103993723,8cyclictest784272-21grep12:10:301
732103993723,10cyclictest22-21rcuc/107:30:001
732103993718,14cyclictest231ktimers/112:20:131
732100993729,5cyclictest0-21swapper/008:25:150
732100993724,9cyclictest0-21swapper/007:30:300
73210099371,34cyclictest0-21swapper/011:45:200
73210099371,34cyclictest0-21swapper/011:45:190
732103993628,5cyclictest771465-21sh11:00:001
732103993624,9cyclictest0-21swapper/108:00:291
732103993620,13cyclictest0-21swapper/109:50:011
732103993615,12cyclictest231ktimers/108:05:171
732100993620,14cyclictest0-21swapper/007:41:450
732103993525,5cyclictest0-21swapper/112:05:191
732103993517,12cyclictest231ktimers/110:50:121
73210399351,14cyclictest0-21swapper/107:40:011
732100993528,4cyclictest0-21swapper/010:43:020
732100993527,6cyclictest0-21swapper/007:10:010
73210099351,4cyclictest0-21swapper/007:45:330
732105993424,5cyclictest0-21swapper/208:17:002
732103993427,3cyclictest774003-21cron11:15:001
732103993425,4cyclictest0-21swapper/109:40:271
732103993425,4cyclictest0-21swapper/107:50:021
732103993423,6cyclictest745859-21grep08:25:271
732103993420,9cyclictest0-21swapper/108:50:011
732103993417,10cyclictest231ktimers/107:20:101
732103993412,13cyclictest766609-21/usr/sbin/munin10:30:191
732103993327,3cyclictest0-21swapper/108:10:211
732103993320,7cyclictest0-21swapper/112:00:281
732103993320,7cyclictest0-21swapper/112:00:281
73210399331,26cyclictest0-21swapper/107:55:161
73210099331,30cyclictest774557-21phc2sys-jitter11:15:290
732103993224,5cyclictest753755-21/usr/sbin/munin09:15:241
732103993219,8cyclictest0-21swapper/109:05:291
732103993114,11cyclictest0-21swapper/111:50:211
732103993023,4cyclictest788562-21munin-plugin-st12:40:001
732103993021,4cyclictest0-21swapper/111:55:291
732103993020,6cyclictest0-21swapper/108:35:301
732103993020,4cyclictest0-21swapper/111:25:011
732103992923,4cyclictest0-21swapper/111:00:221
73210399292,14cyclictest746156-21/usr/sbin/munin08:30:171
732103992817,8cyclictest0-21swapper/108:45:011
732103992718,6cyclictest738060-21phc2sys-jitter07:40:261
732103992612,12cyclictest167450irq/126-8000000.ethernet-tx109:52:521
732103992416,6cyclictest0-21swapper/111:40:291
732103992412,6cyclictest763155-21wc10:10:021
73210599193,9cyclictest732191-21latency_hist07:10:002
73210399198,8cyclictest0-21swapper/107:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional