You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-05 - 15:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Thu Nov 05, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15404279911097,10cyclictest0-21swapper/020:50:010
154043599604,9cyclictest1549325-21/usr/sbin/munin20:00:172
154043599602,34cyclictest0-21swapper/219:55:002
1540430995841,11cyclictest1593475-21grep00:15:291
154043599571,33cyclictest0-21swapper/223:00:012
154043599571,33cyclictest0-21swapper/223:00:012
154043599571,27cyclictest0-21swapper/221:20:012
154043599561,32cyclictest0-21swapper/200:40:012
154043599521,26cyclictest1580164-21/usr/sbin/munin23:00:192
1540427995143,4cyclictest167350irq/118-8000000.ethernet-tx019:35:200
154043599501,27cyclictest0-21swapper/220:10:012
154043599501,22cyclictest0-21swapper/221:40:022
1540430995041,5cyclictest0-21swapper/121:00:201
154042799501,44cyclictest0-21swapper/022:05:130
154042799501,10cyclictest0-21swapper/020:55:010
1540430994945,2cyclictest0-21swapper/120:15:191
1540430994941,5cyclictest1585023-21munin-plugin-st23:30:011
1540430994938,7cyclictest0-21swapper/121:35:291
154042799491,45cyclictest1584685-21memory23:25:250
1540430994839,5cyclictest0-21swapper/119:40:161
1540430994839,5cyclictest0-21swapper/119:40:161
1540435994735,8cyclictest0-21swapper/222:15:002
1540435994735,8cyclictest0-21swapper/222:14:592
1540430994738,7cyclictest22-21rcuc/120:35:011
1540427994741,4cyclictest1587588-21latency_hist23:45:000
1540430994635,5cyclictest0-21swapper/121:20:291
1540430994634,8cyclictest1590985-21grep00:00:291
1540427994639,4cyclictest167350irq/118-8000000.ethernet-tx023:00:130
154042799452,41cyclictest0-21swapper/021:55:160
1540427994524,19cyclictest20650irq/252-8000000.ethernet19:55:230
1540435994427,9cyclictest0-21swapper/222:20:272
1540430994437,4cyclictest1559331-21sendmail20:59:591
1540435994332,6cyclictest0-21swapper/222:50:262
1540430994335,6cyclictest1555864-21grep20:35:281
1540430994335,6cyclictest1555864-21grep20:35:281
1540430994329,7cyclictest0-21swapper/120:40:291
1540430994328,11cyclictest0-21swapper/122:25:291
1540427994335,5cyclictest1583214-21grep23:15:280
1540427994335,5cyclictest0-21swapper/022:55:200
1540427994335,5cyclictest0-21swapper/022:55:200
1540427994335,4cyclictest1526805-1kworker/0:0H+kblockd23:45:050
1540427994331,5cyclictest1543177-21grep19:20:290
1540435994236,4cyclictest30-21rcuc/200:00:012
1540435994236,4cyclictest30-21rcuc/200:00:012
1540435994227,11cyclictest0-21swapper/222:25:222
154043099426,29cyclictest1581003-21/usr/sbin/munin23:05:201
1540430994227,12cyclictest231ktimers/123:10:111
154043099422,32cyclictest0-21swapper/120:20:191
154043099422,32cyclictest0-21swapper/120:20:191
1540427994237,3cyclictest167350irq/118-8000000.ethernet-tx022:15:190
154042799422,4cyclictest1590582-21perl00:00:210
1540435994126,11cyclictest0-21swapper/200:25:312
154043599411,2cyclictest0-21swapper/223:55:012
154043599411,22cyclictest0-21swapper/223:20:012
1540430994131,6cyclictest0-21swapper/100:20:291
1540430994131,6cyclictest0-21swapper/100:20:291
1540430994130,7cyclictest1578160-21grep22:45:281
1540430994128,9cyclictest0-21swapper/119:15:281
154042799415,15cyclictest14-21rcu_preempt21:40:020
1540427994133,3cyclictest0-21swapper/000:30:010
1540427994132,6cyclictest1564502-21grep21:25:300
1540427994132,5cyclictest0-21swapper/020:59:590
1540427994130,8cyclictest0-21swapper/000:15:280
1540427994129,8cyclictest0-21swapper/019:50:000
154042799412,4cyclictest1591293-21diskstats00:05:180
154042799412,4cyclictest1563176-21diskstats21:20:190
154042799411,4cyclictest0-21swapper/000:40:000
154042799411,38cyclictest0-21swapper/020:30:220
1540435994034,4cyclictest0-21swapper/221:10:002
154043599403,23cyclictest30-21rcuc/222:00:022
154043599403,23cyclictest30-21rcuc/222:00:022
1540435994029,6cyclictest0-21swapper/219:30:302
154043099406,8cyclictest1561280-21rm21:10:011
1540430994031,5cyclictest0-21swapper/122:55:261
1540430994031,5cyclictest0-21swapper/122:55:261
1540430994029,7cyclictest1591752-21grep00:05:281
1540430994026,10cyclictest0-21swapper/122:20:261
1540430994014,12cyclictest22-21rcuc/123:40:011
1540430994014,12cyclictest22-21rcuc/123:40:011
154043099401,3cyclictest0-21swapper/121:55:011
1540427994035,2cyclictest0-21swapper/022:40:010
1540427994034,2cyclictest0-21swapper/019:50:290
1540427994033,4cyclictest0-21swapper/019:40:270
1540427994033,4cyclictest0-21swapper/019:40:270
154042799402,8cyclictest1261-21rs:main0
1540427994023,15cyclictest0-21swapper/000:10:140
154042799401,4cyclictest1577627-21sshd22:45:070
154042799401,37cyclictest0-21swapper/023:35:110
154042799401,37cyclictest0-21swapper/023:35:110
1540435993930,5cyclictest0-21swapper/223:30:342
1540435993929,5cyclictest0-21swapper/221:10:202
1540435993926,8cyclictest0-21swapper/222:40:202
154043599391,30cyclictest1660-21snmpd19:45:192
1540430993928,5cyclictest0-21swapper/122:15:151
1540430993927,6cyclictest0-21swapper/122:00:221
1540430993927,6cyclictest0-21swapper/122:00:221
1540430993925,10cyclictest0-21swapper/120:10:271
154043099392,29cyclictest1660-21snmpd19:55:211
1540430993921,10cyclictest0-21swapper/120:50:301
1540427993933,4cyclictest0-21swapper/021:50:490
1540427993933,3cyclictest167350irq/118-8000000.ethernet-tx023:30:160
1540427993932,4cyclictest20650irq/252-8000000.ethernet19:15:170
1540427993932,4cyclictest0-21swapper/022:25:250
1540427993928,8cyclictest1561122-21gpgv21:09:590
154042799391,4cyclictest1560184-21apt21:04:590
154042799391,36cyclictest0-21swapper/023:50:270
1540435993829,5cyclictest0-21swapper/223:45:002
1540435993827,6cyclictest0-21swapper/222:20:012
154043599381,26cyclictest0-21swapper/220:00:012
1540430993829,6cyclictest167450irq/126-8000000.ethernet-tx119:50:201
1540430993828,5cyclictest0-21swapper/100:25:221
1540430993827,7cyclictest1567923-21grep21:45:321
1540430993824,9cyclictest0-21swapper/122:30:281
1540430993824,9cyclictest0-21swapper/122:30:281
1540430993820,12cyclictest0-21swapper/122:10:011
154043099381,6cyclictest0-21swapper/100:15:011
1540430993812,14cyclictest22-21rcuc/122:40:181
1540427993832,3cyclictest167350irq/118-8000000.ethernet-tx023:10:190
154042799381,4cyclictest0-21swapper/022:40:160
154042799381,3cyclictest1578540-21diskstats22:50:170
154042799381,3cyclictest1566780-21meminfo21:40:250
154042799381,35cyclictest0-21swapper/022:35:000
154042799381,35cyclictest0-21swapper/022:35:000
154042799381,35cyclictest0-21swapper/021:15:180
154042799381,35cyclictest0-21swapper/020:40:210
154042799381,2cyclictest1561407-21apt-get21:10:130
1540435993727,5cyclictest0-21swapper/220:15:292
1540430993729,4cyclictest0-21swapper/120:00:271
1540430993727,7cyclictest1596977-21grep00:35:331
154043099372,6cyclictest1557523-21awk20:45:301
1540430993723,8cyclictest0-21swapper/120:25:211
1540430993718,16cyclictest1571625-21/usr/sbin/munin22:10:191
1540430993718,16cyclictest1571625-21/usr/sbin/munin22:10:181
1540427993733,2cyclictest0-21swapper/023:10:010
1540427993732,2cyclictest0-21swapper/019:10:180
1540427993731,4cyclictest0-21swapper/020:35:160
1540427993731,4cyclictest0-21swapper/020:35:160
1540427993731,4cyclictest0-21swapper/020:18:560
1540427993731,3cyclictest167350irq/118-8000000.ethernet-tx000:30:170
1540427993731,3cyclictest167350irq/118-8000000.ethernet-tx000:30:170
1540427993729,5cyclictest131ktimers/022:20:270
1540427993726,7cyclictest0-21swapper/020:00:280
154042799372,5cyclictest1553957-21ptp4l20:25:280
154042799371,34cyclictest0-21swapper/020:10:130
154043599363,25cyclictest30-21rcuc/219:30:012
154043599361,16cyclictest0-21swapper/221:25:002
1540430993628,5cyclictest1583260-21grep23:15:291
1540430993624,8cyclictest0-21swapper/121:55:301
1540430993623,8cyclictest0-21swapper/122:50:231
1540430993622,6cyclictest0-21swapper/119:15:011
154042799362,4cyclictest1544369-21fschecks_count19:30:200
154042799361,33cyclictest0-21swapper/020:05:240
1540435993526,5cyclictest0-21swapper/223:05:212
1540435993524,7cyclictest0-21swapper/200:05:282
1540435993521,8cyclictest1660-21snmpd19:35:172
154043599351,3cyclictest0-21swapper/219:45:022
154043599351,3cyclictest0-21swapper/219:45:022
154043599351,2cyclictest0-21swapper/221:40:022
154043099354,22cyclictest1588370-21unixbench_multi23:45:251
1540427993530,3cyclictest0-21swapper/019:29:580
1540427993529,4cyclictest20850irq/208-8000000.ethernet00:20:120
1540427993529,4cyclictest20850irq/208-8000000.ethernet00:20:120
1540427993529,3cyclictest0-21swapper/023:22:200
154042799352,4cyclictest1569996-21fschecks_time22:00:210
154042799352,4cyclictest1569996-21fschecks_time22:00:210
154042799351,32cyclictest0-21swapper/022:13:010
154042799351,32cyclictest0-21swapper/022:13:010
1540435993427,4cyclictest167550irq/134-8000000.ethernet-tx223:10:132
1540435993427,4cyclictest167550irq/134-8000000.ethernet-tx200:20:242
1540435993427,4cyclictest167550irq/134-8000000.ethernet-tx200:20:232
1540435993422,8cyclictest0-21swapper/221:25:292
1540435993420,9cyclictest1551002-21/usr/sbin/munin20:10:192
1540430993424,7cyclictest1660-21snmpd21:30:131
1540430993419,11cyclictest0-21swapper/100:30:301
1540430993419,11cyclictest0-21swapper/100:30:301
154043099341,27cyclictest0-21swapper/119:20:241
1540427993426,4cyclictest131ktimers/021:45:310
154042799342,4cyclictest1590158-21sh23:59:590
154042799342,4cyclictest1590158-21sh23:59:590
1540435993326,4cyclictest0-21swapper/200:00:282
1540435993323,7cyclictest1660-21snmpd19:15:122
1540435993323,6cyclictest0-21swapper/221:00:312
1540435993321,8cyclictest0-21swapper/220:30:002
1540435993314,16cyclictest167550irq/134-8000000.ethernet-tx219:10:112
154043599331,29cyclictest1571340-21http22:09:592
1540430993328,2cyclictest0-21swapper/123:25:011
154043099331,2cyclictest0-21swapper/119:40:001
1540435993226,4cyclictest1555051-21latency_hist20:35:002
1540435993220,8cyclictest0-21swapper/200:10:212
1540435993218,8cyclictest0-21swapper/219:20:282
154043099325,18cyclictest1590048-21grep23:55:291
154043099325,18cyclictest1590048-21grep23:55:291
1540430993223,6cyclictest1566481-21/usr/sbin/munin21:40:221
1540430993222,6cyclictest1543970-21grep19:25:291
1540430993221,6cyclictest0-21swapper/123:50:291
1540430993221,6cyclictest0-21swapper/121:15:291
1540430993219,9cyclictest1562040-21cron21:15:001
154043099321,2cyclictest0-21swapper/122:40:011
1540435993126,3cyclictest1593129-21if_eth000:15:212
1540430993122,7cyclictest0-21swapper/119:10:011
1540430993120,7cyclictest0-21swapper/123:40:171
1540430993119,7cyclictest1544789-21grep19:30:291
1540427993121,6cyclictest131ktimers/020:20:220
1540427993121,6cyclictest131ktimers/020:20:220
1540435993023,4cyclictest0-21swapper/222:35:012
1540435993023,4cyclictest0-21swapper/222:35:012
1540435993021,7cyclictest1596161-21sshd00:32:072
1540435993021,7cyclictest1596161-21sshd00:32:072
1540435993021,6cyclictest1557580-21grep20:45:322
1540435993012,16cyclictest167550irq/134-8000000.ethernet-tx222:45:252
154043099303,20cyclictest24-21ksoftirqd/123:30:121
1540430993022,4cyclictest0-21swapper/120:05:221
1540435992925,2cyclictest0-21swapper/221:50:242
1540435992922,4cyclictest1588477-21cron23:50:012
1540435992922,3cyclictest0-21swapper/220:35:232
1540435992922,3cyclictest0-21swapper/220:35:232
1540435992921,5cyclictest1584384-21/usr/sbin/munin23:25:182
1540435992921,4cyclictest0-21swapper/220:55:262
1540435992919,7cyclictest0-21swapper/222:00:002
1540435992913,13cyclictest167550irq/134-8000000.ethernet-tx220:50:322
1540430992921,6cyclictest1564470-21unixbench_multi21:25:301
1540430992918,8cyclictest231ktimers/119:45:131
154043099291,25cyclictest0-21swapper/123:00:301
1540435992821,5cyclictest0-21swapper/221:30:162
1540435992821,4cyclictest0-21swapper/223:35:232
1540435992821,4cyclictest0-21swapper/223:35:232
1540435992820,4cyclictest0-21swapper/221:45:322
1540435992711,13cyclictest167550irq/134-8000000.ethernet-tx223:21:032
1540435992618,4cyclictest0-21swapper/222:35:292
1540435992615,7cyclictest0-21swapper/220:45:002
1540435992517,6cyclictest311ktimers/220:20:232
1540435992517,6cyclictest311ktimers/220:20:232
1540427992418,3cyclictest1540385-21latency_hist19:10:010
1540435992314,6cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional