You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 06:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Wed May 13, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14567299910677,16cyclictest391ktimers/322:05:003
145672399791,47cyclictest0-21swapper/019:55:020
145672399772,42cyclictest0-21swapper/023:50:010
1456726997513,22cyclictest1474146-21/usr/sbin/munin20:50:191
145672399741,45cyclictest1492587-21/usr/sbin/munin22:35:270
145672399741,45cyclictest1492587-21/usr/sbin/munin22:35:270
145672799738,22cyclictest0-21swapper/220:15:002
1456723997033,30cyclictest20650irq/252-8000000.ethernet23:50:280
1456723996924,39cyclictest20650irq/252-8000000.ethernet22:30:230
145672399691,65cyclictest1511245-21if_eth100:25:250
145672399681,2cyclictest0-21swapper/020:45:010
145672399681,2cyclictest0-21swapper/020:45:010
145672699671,32cyclictest22-21rcuc/121:35:181
145672399671,58cyclictest1496019-21ptp4l22:55:280
145672399661,36cyclictest0-21swapper/021:00:020
145672399653,57cyclictest1500380-21grep23:20:280
145672399653,26cyclictest1462514-21perl19:40:180
145672399651,61cyclictest0-21swapper/023:30:110
145672399651,60cyclictest1459865-21df_inode19:25:180
145672399651,57cyclictest1509205-21apt-get00:15:130
145672399651,52cyclictest0-21swapper/020:15:120
145672399641,61cyclictest0-21swapper/021:20:000
1456723996324,33cyclictest0-21swapper/019:35:020
145672399631,25cyclictest1493259-21irqstats22:40:240
1456723996237,21cyclictest20650irq/252-8000000.ethernet22:15:160
1456723996232,27cyclictest20850irq/208-8000000.ethernet21:40:240
145672399621,28cyclictest1261-21rs:main0
145672399612,55cyclictest1471281-21/usr/sbin/munin20:30:260
145672399604,25cyclictest1498297-21fschecks_time23:10:220
145672399601,56cyclictest1486641-21/usr/sbin/munin22:00:270
145672399601,54cyclictest1497746-21gunzip23:05:260
1456723995929,26cyclictest1464491-21mailstats19:50:270
1456723995916,39cyclictest1467129-21grep20:05:280
145672799584,31cyclictest0-21swapper/223:30:012
145672799584,31cyclictest0-21swapper/223:30:012
1456726995851,4cyclictest0-21swapper/123:20:161
145672399582,51cyclictest1463179-21apt-get19:45:140
145672399582,28cyclictest1478023-21tail21:10:300
1456723995818,26cyclictest1439886-1kworker/0:0H+mmc_complete20:40:010
145672399581,53cyclictest0-21swapper/019:20:140
145672399581,50cyclictest1509158-21latency_hist00:15:020
145672399581,22cyclictest1457499-21users19:10:290
1456723995735,18cyclictest0-21swapper/022:25:010
1456723995717,6cyclictest1501323-21apt-get23:30:020
1456723995717,6cyclictest1501323-21apt-get23:30:020
1456723995717,37cyclictest20650irq/252-8000000.ethernet21:30:230
145672399571,52cyclictest0-21swapper/023:15:280
145672399571,32cyclictest0-21swapper/020:50:010
145672799567,23cyclictest32-21ksoftirqd/221:15:022
1456726995628,11cyclictest231ktimers/119:30:001
1456726995612,10cyclictest1477322-21apt-get21:10:011
145672399562,45cyclictest1496517-21/usr/sbin/munin23:00:170
145672399561,52cyclictest1503630-21/usr/sbin/munin23:40:260
145672399561,52cyclictest1482170-21/usr/sbin/munin21:35:230
145672399561,51cyclictest1506748-21/usr/sbin/munin00:00:180
145672399561,51cyclictest1506748-21/usr/sbin/munin00:00:170
145672399561,49cyclictest0-21swapper/023:55:100
1456727995521,15cyclictest30-21rcuc/223:30:182
1456726995530,18cyclictest231ktimers/120:15:011
145672399552,29cyclictest1465785-21diskstats20:00:170
145672399552,29cyclictest1465785-21diskstats20:00:170
145672399551,51cyclictest1507633-21/usr/sbin/munin00:05:200
145672399543,22cyclictest1479831-21unixbench_multi21:20:260
145672399543,22cyclictest1479831-21unixbench_multi21:20:260
1456723995423,28cyclictest20850irq/208-8000000.ethernet22:05:190
1456723995419,30cyclictest0-21swapper/020:30:000
1456723995418,31cyclictest20650irq/252-8000000.ethernet22:10:230
1456723995418,31cyclictest20650irq/252-8000000.ethernet22:10:230
145672399541,50cyclictest1491152-21latency_hist22:30:010
145672399541,48cyclictest1485692-21/usr/sbin/munin21:55:250
145672399541,48cyclictest1485692-21/usr/sbin/munin21:55:250
1456727995342,8cyclictest1472254-21munin-plugin-st20:40:012
1456727995333,16cyclictest1483419-21apt-get21:45:012
145672399532,47cyclictest1474382-21/usr/sbin/munin20:50:230
145672399531,48cyclictest1511936-21apt-get00:30:160
145672399531,48cyclictest1477198-21/usr/sbin/munin21:05:270
145672399531,48cyclictest1477198-21/usr/sbin/munin21:05:270
145672399531,46cyclictest1512782-21/usr/sbin/munin00:35:110
145672399531,46cyclictest1512782-21/usr/sbin/munin00:35:110
145672399531,2cyclictest0-21swapper/019:35:130
145672399531,29cyclictest0-21swapper/021:45:190
1456727995238,9cyclictest1513430-21munin-plugin-st00:40:012
1456727995238,9cyclictest1513430-21munin-plugin-st00:40:012
145672399521,48cyclictest1503061-21/usr/sbin/munin23:35:290
145672399521,47cyclictest1484620-21diskstats21:50:170
1456726995128,12cyclictest14-21rcu_preempt21:25:021
145672699511,10cyclictest0-21swapper/119:50:011
1456723995144,4cyclictest167350irq/118-8000000.ethernet-tx021:00:190
145672399512,46cyclictest1510512-21/usr/sbin/munin00:20:280
145672399511,2cyclictest0-21swapper/021:25:300
145672399503,44cyclictest1494832-21/usr/sbin/munin22:50:180
1456723995032,14cyclictest0-21swapper/022:50:020
1456723995032,14cyclictest0-21swapper/022:50:020
145672399502,45cyclictest1458328-21/usr/sbin/munin19:15:260
145672399501,46cyclictest1467470-21/usr/sbin/munin20:10:210
1456726994925,17cyclictest231ktimers/123:10:171
1456727994830,12cyclictest0-21swapper/223:20:012
1456726994826,16cyclictest0-21swapper/121:20:271
1456726994826,16cyclictest0-21swapper/121:20:271
1456727994729,11cyclictest0-21swapper/221:10:312
1456726994736,8cyclictest1496254-21sendmail22:59:591
145672699467,4cyclictest1510706-21apt-get00:25:001
1456727994532,9cyclictest1484312-21grep21:45:302
145672799451,31cyclictest0-21swapper/200:30:022
1456727994428,9cyclictest0-21swapper/200:09:592
145672699441,7cyclictest0-21swapper/100:15:011
145672399441,36cyclictest1456774-21latency_hist19:10:010
1456727994334,5cyclictest0-21swapper/219:40:002
1456727994333,6cyclictest1465444-21grep19:55:292
1456727994323,9cyclictest0-21swapper/222:05:272
1456727994315,15cyclictest0-21swapper/222:20:122
145672699436,4cyclictest0-21swapper/123:55:001
1456726994331,8cyclictest0-21swapper/119:10:281
145672699431,8cyclictest0-21swapper/122:30:011
145672799427,22cyclictest1488763-21/usr/sbin/munin22:15:182
1456727994234,3cyclictest0-21swapper/220:50:002
1456727994228,9cyclictest0-21swapper/220:30:192
145672699421,2cyclictest0-21swapper/121:35:011
1456726994210,12cyclictest1464855-21/usr/sbin/munin19:55:181
1456727994130,7cyclictest0-21swapper/220:05:272
1456727994026,9cyclictest0-21swapper/219:50:292
1456727994013,11cyclictest0-21swapper/222:35:122
1456727994013,11cyclictest0-21swapper/222:35:122
145672699405,5cyclictest0-21swapper/120:40:011
1456726994028,6cyclictest0-21swapper/122:20:281
1456726994026,8cyclictest0-21swapper/119:15:221
1456727993931,4cyclictest0-21swapper/221:10:022
1456727993931,4cyclictest0-21swapper/221:10:012
1456727993929,5cyclictest1475629-21munin-plugin-st21:00:002
1456727993928,8cyclictest0-21swapper/221:35:282
1456727993928,5cyclictest14-21rcu_preempt00:25:002
1456727993926,9cyclictest0-21swapper/221:30:292
1456727993925,9cyclictest0-21swapper/219:10:292
1456727993924,8cyclictest0-21swapper/219:20:002
1456727993923,12cyclictest0-21swapper/220:40:302
1456727993923,12cyclictest0-21swapper/220:40:302
1456726993928,4cyclictest167450irq/126-8000000.ethernet-tx119:30:281
1456726993925,7cyclictest0-21swapper/121:50:281
1456726993924,9cyclictest0-21swapper/119:50:211
1456727993831,4cyclictest1491943-21munin-plugin-st22:35:002
1456727993828,7cyclictest1494541-21latency_hist22:50:002
1456727993828,7cyclictest1494541-21latency_hist22:50:002
1456727993827,5cyclictest0-21swapper/222:00:212
1456727993826,8cyclictest1507268-21unixbench_singl00:00:322
1456727993826,8cyclictest1507268-21unixbench_singl00:00:312
1456727993824,7cyclictest0-21swapper/221:00:292
1456727993823,8cyclictest0-21swapper/223:50:282
1456727993820,10cyclictest0-21swapper/222:00:012
1456727993820,10cyclictest0-21swapper/222:00:012
1456726993829,4cyclictest0-21swapper/123:00:211
1456726993828,6cyclictest1477333-21apt-key21:10:001
1456726993828,6cyclictest1477333-21apt-key21:10:001
145672699382,30cyclictest0-21swapper/100:25:251
1456727993727,4cyclictest0-21swapper/220:05:002
1456727993727,4cyclictest0-21swapper/220:05:002
1456727993726,5cyclictest311ktimers/200:30:202
1456727993724,9cyclictest0-21swapper/223:20:112
1456727993724,6cyclictest1495316-21grep22:50:282
1456727993722,7cyclictest0-21swapper/221:25:302
1456727993722,7cyclictest0-21swapper/200:15:292
1456727993712,20cyclictest0-21swapper/220:15:242
145672699373,20cyclictest231ktimers/120:25:131
145672699371,7cyclictest0-21swapper/122:20:001
145672699371,2cyclictest0-21swapper/100:00:011
1456727993628,5cyclictest311ktimers/222:25:202
1456727993628,4cyclictest311ktimers/220:50:192
145672699363,27cyclictest0-21swapper/100:30:231
1456726993629,4cyclictest0-21swapper/123:18:381
1456726993626,4cyclictest0-21swapper/123:30:011
1456726993626,4cyclictest0-21swapper/123:30:011
1456726993625,5cyclictest0-21swapper/122:00:301
145672699361,2cyclictest0-21swapper/121:45:011
1456727993526,6cyclictest1458870-21/usr/sbin/munin19:20:192
1456727993519,9cyclictest0-21swapper/223:55:202
1456727993519,8cyclictest0-21swapper/223:45:292
1456727993518,11cyclictest0-21swapper/222:40:152
145672799351,25cyclictest1491079-21kworker/u8:1+rpciod23:07:212
1456726993526,5cyclictest1467194-21munin-plugin-st20:09:591
1456726993522,10cyclictest1468877-21sendmail20:20:001
145672699351,2cyclictest0-21swapper/123:40:001
1456727993427,5cyclictest311ktimers/223:10:312
1456727993427,4cyclictest311ktimers/219:40:262
1456727993426,6cyclictest311ktimers/219:30:292
1456727993425,5cyclictest0-21swapper/220:25:302
1456727993420,7cyclictest0-21swapper/223:00:312
1456726993424,5cyclictest0-21swapper/121:15:221
1456726993423,5cyclictest0-21swapper/100:15:211
145672699341,4cyclictest0-21swapper/120:40:211
145672699341,4cyclictest0-21swapper/120:40:211
1456727993325,5cyclictest311ktimers/223:35:112
1456727993325,4cyclictest0-21swapper/222:10:252
1456727993325,4cyclictest0-21swapper/222:10:252
1456726993325,5cyclictest0-21swapper/123:40:281
1456726993323,6cyclictest0-21swapper/100:00:321
1456726993323,6cyclictest0-21swapper/100:00:321
1456726993323,5cyclictest0-21swapper/120:55:191
1456726993322,5cyclictest0-21swapper/121:50:001
145672699331,6cyclictest0-21swapper/121:55:231
145672699331,6cyclictest0-21swapper/121:55:231
1456726993316,12cyclictest0-21swapper/123:45:281
1456727993223,6cyclictest311ktimers/219:30:002
1456727993215,8cyclictest0-21swapper/219:45:212
145672799321,25cyclictest0-21swapper/200:10:272
1456726993223,6cyclictest0-21swapper/119:20:291
145672699321,26cyclictest0-21swapper/122:30:091
145672799311,5cyclictest32-21ksoftirqd/221:50:202
1456727993110,12cyclictest1469294-21/usr/sbin/munin20:20:212
1456726993118,9cyclictest14-21rcu_preempt22:35:121
1456726993118,9cyclictest14-21rcu_preempt22:35:111
145672699311,5cyclictest0-21swapper/121:05:001
145672699311,3cyclictest1469454-21ps20:20:261
145672699311,28cyclictest0-21swapper/119:40:241
1456727993023,4cyclictest1495605-21/usr/sbin/munin22:55:182
1456727993018,8cyclictest0-21swapper/221:20:092
1456727993018,8cyclictest0-21swapper/221:20:092
1456726993024,4cyclictest0-21swapper/100:35:291
1456726993024,4cyclictest0-21swapper/100:35:281
1456726993022,6cyclictest1473306-21/usr/sbin/munin20:45:191
1456726993012,12cyclictest231ktimers/120:30:101
1456727992921,5cyclictest311ktimers/223:40:172
1456726992917,8cyclictest0-21swapper/122:05:251
1456726992914,11cyclictest231ktimers/122:45:281
1456726992914,11cyclictest231ktimers/122:45:271
1456726992822,4cyclictest1488456-21grep22:10:291
1456726992822,4cyclictest1488456-21grep22:10:281
1456726992818,7cyclictest0-21swapper/122:40:221
1456726992817,7cyclictest0-21swapper/122:55:001
145672699281,2cyclictest0-21swapper/123:10:011
1456726992716,7cyclictest0-21swapper/123:30:271
1456726992614,8cyclictest0-21swapper/120:00:281
1456726992614,8cyclictest0-21swapper/120:00:281
145672699261,23cyclictest0-21swapper/100:09:531
145672699231,2cyclictest0-21swapper/119:40:011
145672799211,6cyclictest0-21swapper/219:10:022
1456726991912,5cyclictest0-21swapper/119:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional