You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 06:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Fri Apr 10, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166132099758,21cyclictest1673953-21/usr/sbin/munin20:20:181
166132099758,21cyclictest1673953-21/usr/sbin/munin20:20:181
166131799686,15cyclictest1705075-21apt-get23:25:010
1661320996611,46cyclictest24-21ksoftirqd/121:50:171
1661321996256,4cyclictest311ktimers/221:50:002
1661320995937,10cyclictest231ktimers/123:45:021
166132199583,28cyclictest0-21swapper/219:55:012
166131799581,45cyclictest0-21swapper/022:15:120
166132199563,30cyclictest0-21swapper/221:45:022
166132199563,30cyclictest0-21swapper/221:45:022
166131799532,14cyclictest1708632-21munin-plugin-st23:45:000
1661317995234,15cyclictest167350irq/118-8000000.ethernet-tx022:20:180
1661321995138,8cyclictest1694010-21sendmail22:20:002
1661320995115,15cyclictest22-21rcuc/100:25:011
166132199502,16cyclictest30-21rcuc/220:30:022
1661320995033,11cyclictest231ktimers/122:00:141
1661317994941,4cyclictest167350irq/118-8000000.ethernet-tx000:24:590
1661317994931,15cyclictest167350irq/118-8000000.ethernet-tx019:45:230
1661321994835,9cyclictest0-21swapper/222:50:292
1661320994838,5cyclictest1678750-21unixbench_singl20:45:291
1661320994835,8cyclictest22-21rcuc/121:15:011
166132099482,12cyclictest24-21ksoftirqd/121:05:011
166132099482,12cyclictest24-21ksoftirqd/121:05:011
166131799487,3cyclictest0-21swapper/022:05:190
1661321994739,5cyclictest1685563-21munin-plugin-st21:30:012
1661320994727,14cyclictest231ktimers/100:15:121
1661317994736,6cyclictest0-21swapper/019:10:180
166131799473,31cyclictest0-21swapper/020:35:000
166132199461,6cyclictest0-21swapper/220:55:012
166132199461,25cyclictest0-21swapper/220:55:012
166132099466,17cyclictest24-21ksoftirqd/123:40:001
1661317994639,4cyclictest1682895-21threads21:10:290
166131799462,5cyclictest274-21systemd-journal20:35:160
1661320994537,5cyclictest1677116-21munin-plugin-st20:40:001
1661317994531,11cyclictest0-21swapper/023:57:140
166131799452,9cyclictest0-21swapper/022:40:020
1661317994529,14cyclictest167350irq/118-8000000.ethernet-tx021:35:280
166132199446,5cyclictest0-21swapper/222:05:022
1661321994435,5cyclictest0-21swapper/220:29:592
1661321994433,6cyclictest1710397-21cat23:55:002
1661320994432,7cyclictest1686349-21grep21:30:301
1661320994429,9cyclictest0-21swapper/123:25:211
166131799441,6cyclictest0-21swapper/019:30:000
1661317994414,19cyclictest12-21ksoftirqd/019:40:010
1661320994331,8cyclictest0-21swapper/119:25:281
1661320994327,10cyclictest0-21swapper/122:55:191
166132099432,15cyclictest24-21ksoftirqd/120:45:001
1661317994335,4cyclictest167350irq/118-8000000.ethernet-tx021:50:160
166131799432,38cyclictest0-21swapper/023:10:210
1661321994234,4cyclictest1673667-21apt-get20:20:002
1661321994226,12cyclictest0-21swapper/200:35:232
166132199421,10cyclictest30-21rcuc/221:15:022
1661320994229,9cyclictest0-21swapper/123:55:281
1661320994227,10cyclictest0-21swapper/121:15:271
166132099421,4cyclictest0-21swapper/122:55:011
1661317994237,4cyclictest0-21swapper/022:55:140
1661317994236,3cyclictest167350irq/118-8000000.ethernet-tx000:15:150
1661317994234,4cyclictest0-21swapper/020:25:210
1661317994232,5cyclictest20850irq/208-8000000.ethernet22:25:300
166131799421,3cyclictest0-21swapper/000:25:110
166132099417,6cyclictest1671036-21apt-get20:05:011
1661320994133,5cyclictest1710310-21munin-plugin-st23:55:001
1661320994129,7cyclictest0-21swapper/121:20:291
1661320994124,10cyclictest0-21swapper/122:35:011
166132099411,4cyclictest0-21swapper/120:55:021
166131799414,31cyclictest1702482-21sed23:05:280
1661317994133,5cyclictest1712925-21cron00:10:000
1661317994132,6cyclictest0-21swapper/021:55:130
1661317994125,14cyclictest0-21swapper/020:05:040
166131799412,4cyclictest1687533-21diskstats21:40:190
166131799412,4cyclictest1687533-21diskstats21:40:180
166131799412,4cyclictest1674004-21cpu20:20:160
166131799412,4cyclictest1674004-21cpu20:20:160
166131799411,4cyclictest1677383-21grep20:40:140
166131799411,4cyclictest1664046-21grep19:20:280
166131799411,38cyclictest0-21swapper/023:25:220
1661321994030,5cyclictest0-21swapper/223:14:592
1661321994024,10cyclictest0-21swapper/219:15:202
1661321994023,8cyclictest0-21swapper/222:05:292
1661320994028,7cyclictest1695745-21grep22:25:301
1661320994028,6cyclictest0-21swapper/121:55:271
1661320994026,9cyclictest231ktimers/122:45:131
1661320994026,7cyclictest0-21swapper/119:20:291
1661317994033,4cyclictest1699154-21cron22:50:000
1661317994033,4cyclictest0-21swapper/023:45:210
166131799402,3cyclictest1688606-21memory21:45:270
166131799401,5cyclictest1667007-21diskstats19:40:180
166131799401,4cyclictest1693157-21munin-run22:15:000
166131799401,36cyclictest0-21swapper/023:54:150
166132199396,15cyclictest30-21rcuc/221:05:012
166132199396,15cyclictest30-21rcuc/221:05:012
166132199395,18cyclictest1668483-21find19:50:002
1661321993924,10cyclictest0-21swapper/223:35:022
166132099393,2cyclictest0-21swapper/120:00:001
1661320993929,5cyclictest0-21swapper/119:15:011
1661320993928,6cyclictest0-21swapper/123:40:211
1661320993924,8cyclictest1717898-21unixbench_multi00:35:271
166132099391,32cyclictest1706205-21/usr/sbin/munin23:30:231
1661317993932,4cyclictest0-21swapper/019:20:000
166131799391,2cyclictest0-21swapper/021:00:280
166131799391,2cyclictest0-21swapper/021:00:280
1661321993830,4cyclictest0-21swapper/219:30:292
166132199382,9cyclictest0-21swapper/222:40:012
166132199381,19cyclictest0-21swapper/220:40:022
166132099385,20cyclictest24-21ksoftirqd/121:35:021
1661320993831,4cyclictest14-21rcu_preempt19:50:001
1661320993826,6cyclictest1703308-21sed23:10:291
1661320993825,5cyclictest0-21swapper/123:00:281
1661320993822,10cyclictest1653-21lldpd20:30:151
1661320993820,10cyclictest1653-21lldpd20:25:151
166131799384,5cyclictest0-21swapper/021:20:010
166131799383,5cyclictest1660-21snmpd19:52:350
1661317993831,4cyclictest0-21swapper/021:20:300
1661317993829,6cyclictest0-21swapper/023:40:000
166131799382,4cyclictest0-21swapper/000:15:000
166131799381,35cyclictest0-21swapper/021:30:270
166131799381,18cyclictest0-21swapper/022:45:010
1661321993728,4cyclictest0-21swapper/223:15:292
1661321993728,4cyclictest0-21swapper/223:15:292
1661321993726,7cyclictest0-21swapper/220:05:282
1661320993731,4cyclictest14-21rcu_preempt19:40:241
1661320993729,4cyclictest1673792-21sed20:20:021
1661320993728,5cyclictest0-21swapper/122:40:001
1661320993723,9cyclictest0-21swapper/119:30:201
1661317993732,2cyclictest1681624-21/usr/sbin/munin21:05:180
1661317993731,4cyclictest20850irq/208-8000000.ethernet19:59:590
166131799371,4cyclictest0-21swapper/020:10:210
166131799371,4cyclictest0-21swapper/019:30:220
166131799371,34cyclictest0-21swapper/000:00:140
166131799371,34cyclictest0-21swapper/000:00:140
166131799371,2cyclictest1673621-21cron20:17:000
166131799371,27cyclictest1660-21snmpd22:35:010
1661321993631,3cyclictest0-21swapper/219:35:242
1661321993630,4cyclictest1702528-21cron23:10:002
1661321993630,4cyclictest0-21swapper/220:00:012
1661321993627,6cyclictest1682962-21grep21:10:302
1661321993627,5cyclictest0-21swapper/222:40:282
1661320993628,5cyclictest231ktimers/122:10:221
1661320993626,7cyclictest231ktimers/120:05:281
1661320993625,8cyclictest231ktimers/119:50:071
1661320993622,8cyclictest0-21swapper/121:25:271
1661317993630,4cyclictest0-21swapper/023:15:160
1661317993630,4cyclictest0-21swapper/023:15:160
1661317993629,4cyclictest167350irq/118-8000000.ethernet-tx000:35:170
1661317993626,3cyclictest0-21swapper/023:05:000
166131799361,3cyclictest0-21swapper/020:00:200
166132199355,20cyclictest1666934-21/usr/sbin/munin19:40:182
1661321993527,6cyclictest1706843-21apt-get23:35:052
1661321993526,5cyclictest0-21swapper/220:45:282
1661321993524,6cyclictest1710597-21/usr/sbin/munin23:55:272
166132199351,5cyclictest0-21swapper/222:20:012
166132199351,31cyclictest1708572-21unixbench_singl23:40:302
1661320993528,4cyclictest14-21rcu_preempt21:05:251
1661320993525,7cyclictest231ktimers/123:05:151
1661320993523,8cyclictest0-21swapper/122:15:301
1661317993529,4cyclictest0-21swapper/022:50:260
1661317993528,4cyclictest167350irq/118-8000000.ethernet-tx021:25:180
1661317993518,4cyclictest1647095-1kworker/0:0H+mmc_complete20:50:010
166131799351,4cyclictest0-21swapper/023:30:120
166131799351,32cyclictest0-21swapper/022:00:140
1661321993427,4cyclictest1664102-21cron19:25:002
1661321993425,5cyclictest1672767-21unixbench_singl20:10:302
1661320993428,3cyclictest14-21rcu_preempt22:40:261
1661320993427,4cyclictest1711214-21kworker/u8:3-events_power_efficient00:05:191
1661320993426,5cyclictest231ktimers/120:10:301
1661320993426,4cyclictest0-21swapper/123:24:591
1661320993426,3cyclictest1717332-21latency_hist00:35:021
166132099342,21cyclictest22-21rcuc/121:45:201
1661317993418,14cyclictest0-21swapper/020:50:560
1661321993324,4cyclictest0-21swapper/222:55:252
1661321993324,4cyclictest0-21swapper/220:05:012
1661321993323,5cyclictest0-21swapper/200:00:202
1661321993323,5cyclictest0-21swapper/200:00:202
166132199331,25cyclictest0-21swapper/200:05:132
166132099334,2cyclictest0-21swapper/122:25:021
1661320993327,4cyclictest14-21rcu_preempt00:00:201
1661320993327,4cyclictest14-21rcu_preempt00:00:201
1661320993325,5cyclictest231ktimers/100:15:001
1661320993322,8cyclictest1716234-21grep00:25:291
1661320993321,8cyclictest1661314-21cyclictest21:40:131
1661320993321,8cyclictest1661314-21cyclictest21:40:131
1661317993326,5cyclictest20850irq/208-8000000.ethernet20:55:240
1661321993223,7cyclictest1701687-21sshd23:04:142
1661321993223,5cyclictest0-21swapper/221:35:282
1661321993218,9cyclictest0-21swapper/221:20:222
1661320993223,6cyclictest231ktimers/120:55:171
166132099321,2cyclictest1662610-21apt-get19:15:141
1661317993223,5cyclictest0-21swapper/000:30:160
166132199313,17cyclictest1713130-21/usr/sbin/munin00:10:192
1661321993125,4cyclictest167550irq/134-8000000.ethernet-tx221:50:122
1661321993124,4cyclictest0-21swapper/223:25:282
1661321993120,7cyclictest1674542-21grep20:20:282
1661321993120,7cyclictest1674542-21grep20:20:282
166132199311,25cyclictest0-21swapper/221:05:102
1661320993122,7cyclictest231ktimers/119:35:191
1661320993113,13cyclictest0-21swapper/122:10:001
1661317993125,2cyclictest0-21swapper/019:10:010
1661317993125,2cyclictest0-21swapper/019:10:010
1661321993025,4cyclictest0-21swapper/200:20:272
1661321993018,8cyclictest0-21swapper/219:25:262
1661321993015,8cyclictest311ktimers/222:30:112
1661321992923,4cyclictest167550irq/134-8000000.ethernet-tx223:20:272
1661321992920,6cyclictest0-21swapper/222:10:292
1661321992919,8cyclictest1716517-21sshd00:30:122
166132199291,22cyclictest311ktimers/219:15:012
1661321992821,4cyclictest1690553-21grep21:55:302
1661321992821,4cyclictest167550irq/134-8000000.ethernet-tx223:45:172
1661321992818,7cyclictest1714515-21grep00:15:292
1661320992813,7cyclictest0-21swapper/119:10:011
1661320992813,7cyclictest0-21swapper/119:10:011
1661321992719,4cyclictest0-21swapper/222:45:312
1661321992718,6cyclictest0-21swapper/220:40:262
1661321992715,8cyclictest0-21swapper/222:25:212
1661321992617,5cyclictest0-21swapper/221:30:302
166132199261,23cyclictest0-21swapper/200:25:202
1661320992617,4cyclictest0-21swapper/123:15:211
1661320992617,4cyclictest0-21swapper/123:15:201
1661321992316,3cyclictest1661447-21wc19:10:022
1661321992316,3cyclictest1661447-21wc19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional