You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 07:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu May 07, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
353202997432,26cyclictest0-21swapper/100:30:001
353203996122,34cyclictest311ktimers/222:10:022
353202996127,17cyclictest387871-21/usr/sbin/munin22:30:191
353199996014,3cyclictest363940-21munin-plugin-st20:09:590
353199995851,4cyclictest12-21ksoftirqd/022:00:020
353199995848,5cyclictest167350irq/118-8000000.ethernet-tx022:40:000
35320299575,18cyclictest22-21rcuc/100:05:021
353199995753,2cyclictest0-21swapper/020:00:020
353203995342,6cyclictest382444-21grep21:55:282
353199995345,4cyclictest369854-21munin-plugin-st20:45:010
353199995345,4cyclictest369854-21munin-plugin-st20:45:010
353202995236,13cyclictest365628-21sendmail20:20:001
353199995247,3cyclictest131ktimers/021:25:020
353199995247,3cyclictest131ktimers/021:25:020
353199995242,6cyclictest401365-21munin-plugin-st23:50:000
353199995133,15cyclictest167350irq/118-8000000.ethernet-tx000:00:220
353199995116,32cyclictest0-21swapper/000:30:250
353199995112,37cyclictest14-21rcu_preempt00:10:010
353203995043,4cyclictest400414-21unixbench_multi23:40:282
353202995039,7cyclictest1283-21cron23:05:011
353202995038,8cyclictest382518-21sendmail22:00:001
353199995043,3cyclictest355691-21tail19:20:250
353199995041,6cyclictest0-21swapper/022:55:010
353199995041,6cyclictest0-21swapper/022:55:000
353203994839,5cyclictest403061-21apt-get00:00:012
35320399481,23cyclictest0-21swapper/223:05:022
353199994840,5cyclictest167350irq/118-8000000.ethernet-tx019:15:140
353199994840,4cyclictest368158-21munin-plugin-st20:35:010
35319999473,7cyclictest394227-21irqstats23:05:230
353199994735,8cyclictest0-21swapper/023:40:270
353199994716,27cyclictest15-21rcuc/000:10:190
353203994637,3cyclictest0-21swapper/200:15:002
35319999464,10cyclictest0-21swapper/021:05:000
353199994640,4cyclictest0-21swapper/023:55:150
353199994639,4cyclictest167350irq/118-8000000.ethernet-tx021:50:160
353199994637,5cyclictest0-21swapper/021:50:000
353199994637,4cyclictest361119-21find19:50:250
35319999462,42cyclictest0-21swapper/022:05:210
353203994534,5cyclictest0-21swapper/219:50:002
353199994533,9cyclictest372384-21sendmail21:00:000
35319999452,6cyclictest407827-21diskstats00:25:170
353199994525,13cyclictest131ktimers/022:40:150
353199994525,13cyclictest131ktimers/022:40:150
353203994437,4cyclictest354004-21munin-plugin-st19:15:002
353203994431,9cyclictest0-21swapper/222:30:012
353203994431,8cyclictest0-21swapper/223:05:292
35319999443,8cyclictest1653-21lldpd20:15:280
353199994435,5cyclictest0-21swapper/022:20:190
353199994434,7cyclictest407469-21unixbench_multi00:20:280
35319999442,3cyclictest0-21swapper/023:10:170
35319999442,39cyclictest0-21swapper/000:35:150
353203994331,7cyclictest0-21swapper/222:55:292
353203994330,7cyclictest408324-21grep00:25:282
353203994329,9cyclictest0-21swapper/223:50:022
353203994329,10cyclictest311ktimers/220:05:142
353202994337,3cyclictest375761-21sendmail21:20:011
35320299431,9cyclictest0-21swapper/122:45:021
35320299431,9cyclictest0-21swapper/122:45:011
353199994335,4cyclictest167350irq/118-8000000.ethernet-tx021:35:230
353199994335,4cyclictest167350irq/118-8000000.ethernet-tx021:25:280
353199994334,5cyclictest20850irq/208-8000000.ethernet20:25:190
353199994333,7cyclictest391081-21grep22:45:280
353199994333,7cyclictest0-21swapper/000:20:010
353199994333,7cyclictest0-21swapper/000:20:010
35319999432,14cyclictest359863-21fschecks_count19:45:190
353203994236,4cyclictest355130-21sh19:20:012
353203994229,8cyclictest0-21swapper/223:20:272
353203994226,10cyclictest0-21swapper/222:45:272
35319999423,36cyclictest0-21swapper/023:25:210
353199994229,10cyclictest20850irq/208-8000000.ethernet22:00:160
353199994229,10cyclictest20850irq/208-8000000.ethernet22:00:160
353203994129,8cyclictest311ktimers/220:30:112
353203994129,8cyclictest0-21swapper/220:45:002
353203994129,8cyclictest0-21swapper/220:45:002
353203994129,7cyclictest0-21swapper/219:30:282
353203994127,8cyclictest0-21swapper/222:40:002
35320299413,6cyclictest0-21swapper/120:55:291
353202994134,4cyclictest410171-21sendmail00:40:011
353202994118,14cyclictest363105-21cmp20:05:011
353202994110,19cyclictest353196-21cyclictest22:10:011
353199994134,5cyclictest0-21swapper/023:50:280
353199994134,5cyclictest0-21swapper/020:50:110
353199994124,12cyclictest0-21swapper/020:35:290
353203994028,8cyclictest0-21swapper/219:25:282
353203994028,5cyclictest0-21swapper/223:55:002
353203994027,9cyclictest0-21swapper/200:30:262
353203994023,11cyclictest311ktimers/221:20:112
353203994023,11cyclictest311ktimers/221:20:112
353202994027,9cyclictest0-21swapper/120:00:001
35319999402,36cyclictest0-21swapper/019:40:230
353203993930,5cyclictest0-21swapper/223:35:282
353203993928,7cyclictest0-21swapper/221:45:282
353203993928,7cyclictest0-21swapper/221:35:292
353203993922,8cyclictest0-21swapper/220:15:292
353202993921,13cyclictest0-21swapper/119:20:271
35320299391,4cyclictest0-21swapper/120:40:001
353199993933,3cyclictest167350irq/118-8000000.ethernet-tx023:35:200
353199993933,2cyclictest0-21swapper/019:40:010
353199993930,6cyclictest362909-21grep20:00:270
353199993929,7cyclictest396175-21grep23:15:300
35319999392,5cyclictest392910-21cat22:59:590
35319999391,9cyclictest0-21swapper/020:50:000
35319999391,36cyclictest0-21swapper/023:30:190
353203993831,4cyclictest385968-21cron22:20:012
353202993830,5cyclictest0-21swapper/122:05:011
353202993830,5cyclictest0-21swapper/122:05:001
353202993827,8cyclictest389376-21apt-get22:40:011
353202993821,14cyclictest14-21rcu_preempt23:35:131
353199993828,7cyclictest385927-21grep22:15:280
353199993827,5cyclictest0-21swapper/022:30:270
35319999381,4cyclictest0-21swapper/021:05:230
35319999381,35cyclictest0-21swapper/022:25:190
35319999381,35cyclictest0-21swapper/021:30:230
35319999381,35cyclictest0-21swapper/020:21:320
353203993729,4cyclictest0-21swapper/223:30:282
353203993728,4cyclictest0-21swapper/221:10:282
353203993725,8cyclictest370621-21grep20:45:282
353203993724,8cyclictest0-21swapper/223:10:262
353203993724,8cyclictest0-21swapper/222:45:012
353203993724,8cyclictest0-21swapper/222:45:012
353203993722,9cyclictest0-21swapper/220:10:192
353203993721,8cyclictest0-21swapper/219:40:182
353203993718,13cyclictest311ktimers/200:15:142
353203993718,13cyclictest311ktimers/200:15:132
353202993727,5cyclictest0-21swapper/121:05:291
353202993726,6cyclictest0-21swapper/120:05:291
353202993725,8cyclictest0-21swapper/122:05:241
353202993721,9cyclictest0-21swapper/119:40:021
353199993730,4cyclictest0-21swapper/021:15:120
353199993728,6cyclictest15-21rcuc/021:10:110
35319999371,34cyclictest12-21ksoftirqd/022:10:200
35319999371,34cyclictest0-21swapper/023:20:170
35319999371,34cyclictest0-21swapper/019:10:230
353203993628,4cyclictest0-21swapper/219:39:592
353203993627,5cyclictest384146-21grep22:05:272
353203993624,8cyclictest404151-21latency_hist00:05:012
353202993629,5cyclictest231ktimers/119:45:101
353202993623,8cyclictest0-21swapper/122:25:221
35319999363,29cyclictest356562-21/usr/sbin/munin19:25:270
353199993630,4cyclictest364780-21grep20:15:000
353199993629,5cyclictest131ktimers/023:00:210
353199993627,7cyclictest131ktimers/021:40:230
35320399353,5cyclictest355774-21grep19:20:272
353203993524,7cyclictest0-21swapper/223:25:292
353203993523,6cyclictest0-21swapper/222:55:022
353203993523,6cyclictest0-21swapper/222:55:012
353203993522,7cyclictest366677-21/usr/sbin/munin20:25:272
353202993528,4cyclictest167450irq/126-8000000.ethernet-tx119:10:241
353202993527,4cyclictest0-21swapper/121:35:151
353202993525,5cyclictest0-21swapper/119:50:251
353202993518,11cyclictest0-21swapper/120:30:201
35320299351,4cyclictest0-21swapper/121:30:001
35320299351,32cyclictest0-21swapper/100:10:011
353202993512,13cyclictest374270-21/usr/sbin/munin21:10:191
35319999351,32cyclictest0-21swapper/019:31:400
353203993424,7cyclictest0-21swapper/221:00:302
353202993424,6cyclictest0-21swapper/119:40:251
353202993424,5cyclictest0-21swapper/119:30:201
353202993423,8cyclictest0-21swapper/123:25:291
353202993423,7cyclictest0-21swapper/121:30:261
353199993426,4cyclictest0-21swapper/019:10:010
353203993325,4cyclictest0-21swapper/220:00:162
353203993321,9cyclictest0-21swapper/221:25:252
35320399331,5cyclictest274-21systemd-journal00:20:512
353203993315,13cyclictest311ktimers/219:55:142
35320299331,26cyclictest0-21swapper/123:45:141
35320299331,26cyclictest0-21swapper/121:00:161
35320299331,12cyclictest14-21rcu_preempt23:45:011
353203993224,4cyclictest14-21rcu_preempt23:20:002
353203993224,4cyclictest0-21swapper/220:25:012
353203993221,7cyclictest404724-21grep00:05:262
353203993220,8cyclictest0-21swapper/220:35:292
35320399321,29cyclictest0-21swapper/219:50:162
35320399321,25cyclictest0-21swapper/221:05:162
353202993222,5cyclictest14-21rcu_preempt19:15:021
353203993123,4cyclictest0-21swapper/220:50:212
353203993121,7cyclictest30-21rcuc/221:50:172
353203993119,8cyclictest0-21swapper/220:55:262
353203993114,10cyclictest377650-21apt-get21:30:112
35320399311,27cyclictest385953-21kworker/u8:4+rpciod22:23:222
35320299315,17cyclictest386192-21/usr/sbin/munin22:20:161
353202993123,4cyclictest0-21swapper/100:15:261
353202993123,4cyclictest0-21swapper/100:15:261
353202993120,7cyclictest0-21swapper/121:40:191
35320299311,5cyclictest369576-21ps20:40:241
35320299311,5cyclictest369576-21ps20:40:241
353203993023,5cyclictest409718-21sh00:35:212
353203993020,6cyclictest0-21swapper/222:30:172
35320299302,4cyclictest391980-21munin-run22:55:001
35320299302,4cyclictest391980-21munin-run22:55:001
353202993020,7cyclictest0-21swapper/120:45:211
353202993015,11cyclictest0-21swapper/100:15:011
35320299301,4cyclictest392691-21ptp4l-jitter22:55:271
35320299301,3cyclictest407208-21meminfo00:20:241
35320299301,27cyclictest0-21swapper/100:30:281
35320299301,26cyclictest0-21swapper/119:25:261
353203992925,2cyclictest0-21swapper/222:05:002
353203992925,2cyclictest0-21swapper/222:05:002
353203992921,6cyclictest30-21rcuc/221:40:112
353202992924,3cyclictest398301-21fschecks_count23:30:201
353202992922,5cyclictest0-21swapper/122:17:001
353202992922,4cyclictest0-21swapper/123:55:221
353202992920,6cyclictest396240-21grep23:15:301
35320299291,3cyclictest376268-21meminfo21:20:231
35320299291,3cyclictest376268-21meminfo21:20:231
353203992815,9cyclictest30-21rcuc/221:15:122
353202992820,6cyclictest364512-21processes20:10:261
353202992819,6cyclictest0-21swapper/122:45:271
353202992819,5cyclictest0-21swapper/123:10:251
353202992815,10cyclictest0-21swapper/121:50:261
353202992718,6cyclictest0-21swapper/123:20:161
35320299271,4cyclictest0-21swapper/121:49:521
35320299266,15cyclictest401562-21/usr/sbin/munin23:50:191
353202992615,7cyclictest0-21swapper/120:25:281
353203992517,5cyclictest0-21swapper/219:10:012
35320299251,7cyclictest0-21swapper/119:10:011
353202992516,7cyclictest1660-21snmpd20:20:401
353202992514,8cyclictest0-21swapper/120:50:231
35320299241,4cyclictest0-21swapper/123:09:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional