You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 19:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat May 16, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36516999711,34cyclictest366112-21munin-node07:15:012
365167996645,9cyclictest14-21rcu_preempt07:10:191
365167996456,4cyclictest231ktimers/108:55:201
365167996240,15cyclictest231ktimers/109:20:121
365169996136,16cyclictest311ktimers/210:30:012
365169996136,16cyclictest311ktimers/210:30:012
36516999603,40cyclictest0-21swapper/207:35:012
36516999603,40cyclictest0-21swapper/207:35:012
365165996021,3cyclictest392185-21/usr/sbin/munin09:45:250
36516599596,43cyclictest0-21swapper/012:20:010
36516599596,43cyclictest0-21swapper/012:20:010
365165995952,4cyclictest0-21swapper/012:05:170
36516999578,22cyclictest32-21ksoftirqd/210:20:192
36516599577,9cyclictest406969-21awk11:10:250
365165995749,4cyclictest167350irq/118-8000000.ethernet-tx012:25:270
365167995616,17cyclictest416697-21gpgconf12:10:011
365165995522,3cyclictest381083-21tune2fs08:40:200
365165995517,35cyclictest415354-21memory12:00:230
365169995445,6cyclictest373103-21grep07:55:002
365169995445,6cyclictest373103-21grep07:55:002
36516599532,45cyclictest0-21swapper/010:15:010
36516799528,19cyclictest399754-21/usr/sbin/munin10:30:191
365167995239,8cyclictest411376-21sendmail11:40:001
365165995246,4cyclictest0-21swapper/010:35:120
365167995121,24cyclictest231ktimers/109:25:121
365165995144,2cyclictest0-21swapper/008:05:010
365165995122,3cyclictest419133-21users12:20:300
365165995112,34cyclictest413990-21latency_hist11:55:010
365165995110,36cyclictest0-21swapper/009:15:270
365165995012,32cyclictest0-21swapper/011:50:020
365167994936,9cyclictest0-21swapper/108:05:001
36516599497,38cyclictest372904-21gunzip07:50:280
36516599497,38cyclictest372904-21gunzip07:50:280
36516599492,44cyclictest379013-21cron08:30:000
36516999487,35cyclictest0-21swapper/209:45:012
365169994841,4cyclictest388313-21munin-plugin-st09:25:002
365169994837,5cyclictest0-21swapper/207:45:072
365169994835,9cyclictest0-21swapper/209:45:292
365167994832,10cyclictest231ktimers/108:05:131
365165994813,31cyclictest0-21swapper/010:05:210
365167994738,5cyclictest369632-21apt07:35:001
365167994738,5cyclictest369632-21apt07:35:001
365167994731,10cyclictest0-21swapper/108:15:001
36516599479,3cyclictest379286-21df_inode08:30:180
36516599479,3cyclictest379286-21df_inode08:30:180
36516599478,37cyclictest0-21swapper/010:30:220
365165994728,16cyclictest0-21swapper/012:35:140
36516599472,43cyclictest0-21swapper/011:50:230
365165994718,26cyclictest368226-21df_inode07:25:170
36516599462,7cyclictest393358-21sed09:50:290
365165994627,14cyclictest375921-21/usr/sbin/munin08:10:200
365165994616,4cyclictest383438-21apt-get08:55:120
365165994612,29cyclictest382094-21/usr/sbin/munin08:45:250
365169994536,4cyclictest0-21swapper/208:15:302
365165994539,4cyclictest389990-21munin-plugin-st09:35:000
365165994529,14cyclictest167350irq/118-8000000.ethernet-tx009:00:290
365165994529,14cyclictest0-21swapper/007:10:240
365165994525,15cyclictest0-21swapper/011:05:140
365165994525,15cyclictest0-21swapper/011:05:140
365165994517,3cyclictest401506-21df10:40:160
365165994517,3cyclictest385436-21memory09:05:260
365165994515,4cyclictest373602-21meminfo07:55:260
365165994513,25cyclictest0-21swapper/011:45:010
365169994433,7cyclictest0-21swapper/207:55:302
365169994432,8cyclictest0-21swapper/209:00:292
365169994431,8cyclictest0-21swapper/210:35:292
365169994428,8cyclictest0-21swapper/207:25:282
365167994435,5cyclictest0-21swapper/109:40:291
365165994434,5cyclictest0-21swapper/009:25:250
365165994433,8cyclictest0-21swapper/010:55:000
36516599442,5cyclictest409960-21diskstats11:30:180
365165994412,29cyclictest371332-21apt-get07:45:050
365165994411,31cyclictest0-21swapper/011:20:230
365169994333,4cyclictest0-21swapper/211:45:012
365169994331,8cyclictest0-21swapper/210:00:292
365169994330,6cyclictest30-21rcuc/208:00:302
365169994329,9cyclictest0-21swapper/211:50:292
365169994328,9cyclictest0-21swapper/210:15:282
365169994326,8cyclictest0-21swapper/210:55:292
365169994325,9cyclictest0-21swapper/212:30:292
365167994332,7cyclictest395986-21unixbench_multi10:05:301
365167994324,16cyclictest231ktimers/108:15:131
365167994323,14cyclictest231ktimers/112:30:141
365167994318,12cyclictest0-21swapper/109:35:301
365165994335,3cyclictest390830-21sh09:40:000
365165994327,12cyclictest409227-21/usr/sbin/munin11:25:210
36516599432,3cyclictest0-21swapper/009:45:010
36516599431,36cyclictest0-21swapper/011:00:020
365169994229,8cyclictest0-21swapper/207:45:012
365169994229,8cyclictest0-21swapper/207:45:002
365169994228,9cyclictest0-21swapper/210:15:002
365169994226,8cyclictest0-21swapper/212:35:282
365167994227,10cyclictest0-21swapper/107:50:201
365167994227,10cyclictest0-21swapper/107:50:191
36516799421,5cyclictest0-21swapper/111:25:191
36516599428,5cyclictest417423-21grep12:10:280
36516599426,32cyclictest0-21swapper/011:15:280
36516599422,5cyclictest371308-21users07:40:280
36516599422,5cyclictest371308-21users07:40:280
365165994219,20cyclictest390815-21kworker/u8:1+flush-179:9610:15:050
36516599421,5cyclictest370136-21memory07:35:260
365169994130,7cyclictest0-21swapper/209:20:002
365169994128,8cyclictest0-21swapper/211:35:292
365169994128,6cyclictest0-21swapper/212:00:262
365169994126,7cyclictest0-21swapper/209:35:302
365169994124,9cyclictest0-21swapper/209:55:182
365167994126,12cyclictest231ktimers/110:40:111
365167994123,13cyclictest231ktimers/110:15:141
36516599414,3cyclictest398373-21memory10:20:250
365165994124,14cyclictest394940-21/usr/sbin/munin10:00:270
365165994123,14cyclictest386327-21/usr/sbin/munin09:10:270
36516599411,38cyclictest0-21swapper/009:20:210
365169994031,4cyclictest400398-21munin-plugin-st10:35:002
365169994029,7cyclictest0-21swapper/211:10:262
365169994028,8cyclictest0-21swapper/211:05:292
365169994028,8cyclictest0-21swapper/211:05:292
365169994028,7cyclictest0-21swapper/210:40:282
365167994031,5cyclictest14-21rcu_preempt12:25:261
365167994030,5cyclictest390815-21kworker/u8:1-ext4-rsv-conversion10:15:011
365167994029,7cyclictest0-21swapper/112:10:281
365167994028,8cyclictest0-21swapper/112:15:291
365167994028,8cyclictest0-21swapper/112:15:281
365167994022,12cyclictest231ktimers/110:45:121
365167994021,14cyclictest231ktimers/108:50:121
365165994035,2cyclictest0-21swapper/011:00:210
365165994027,8cyclictest0-21swapper/008:50:190
365169993930,4cyclictest419154-21cron12:25:002
365169993929,7cyclictest311ktimers/208:05:212
365169993924,8cyclictest0-21swapper/209:05:302
365167993926,8cyclictest0-21swapper/111:00:201
365167993924,10cyclictest0-21swapper/110:00:301
365167993922,12cyclictest231ktimers/109:55:101
365167993917,17cyclictest231ktimers/110:25:111
365167993917,17cyclictest231ktimers/110:25:111
365167993912,19cyclictest231ktimers/107:55:131
365165993932,4cyclictest167350irq/118-8000000.ethernet-tx011:35:200
365165993929,5cyclictest0-21swapper/008:20:250
365165993926,9cyclictest380130-21diskstats08:35:200
365165993926,10cyclictest376730-21/usr/sbin/munin08:15:180
36516599392,32cyclictest367507-21grep07:20:210
365165993922,13cyclictest394293-21grep09:55:270
365169993830,5cyclictest418309-21munin-plugin-st12:20:002
365169993830,5cyclictest418309-21munin-plugin-st12:20:002
365169993829,5cyclictest167550irq/134-8000000.ethernet-tx209:55:012
365169993827,8cyclictest0-21swapper/211:25:282
365169993825,8cyclictest0-21swapper/212:10:272
365169993825,8cyclictest0-21swapper/208:10:292
365169993824,9cyclictest0-21swapper/209:30:282
36516799386,3cyclictest0-21swapper/111:35:011
365167993828,7cyclictest0-21swapper/109:50:291
365167993827,7cyclictest0-21swapper/107:15:291
365167993827,7cyclictest0-21swapper/107:15:281
365167993822,8cyclictest0-21swapper/111:55:271
365167993817,12cyclictest231ktimers/112:20:161
365165993828,7cyclictest0-21swapper/010:25:140
365165993828,7cyclictest0-21swapper/010:25:140
365165993827,9cyclictest0-21swapper/008:00:140
365169993725,6cyclictest0-21swapper/209:10:282
365167993725,7cyclictest0-21swapper/110:40:001
365167993722,11cyclictest0-21swapper/108:40:281
365167993721,9cyclictest0-21swapper/111:20:291
365167993720,14cyclictest231ktimers/109:15:151
365167993718,11cyclictest0-21swapper/112:35:281
365167993713,17cyclictest231ktimers/110:20:121
36516599379,3cyclictest366529-21diskstats07:15:190
36516599379,3cyclictest366529-21diskstats07:15:190
365165993727,8cyclictest420811-21sshd12:30:580
365169993625,7cyclictest0-21swapper/211:00:282
365169993624,8cyclictest0-21swapper/212:05:302
365169993624,8cyclictest0-21swapper/209:30:002
365169993622,9cyclictest0-21swapper/210:05:232
365167993626,6cyclictest0-21swapper/111:50:291
365165993623,10cyclictest402529-21if_eth010:45:230
365169993527,5cyclictest0-21swapper/207:20:012
365169993527,5cyclictest0-21swapper/207:20:012
365169993526,5cyclictest0-21swapper/211:20:212
365169993525,7cyclictest0-21swapper/207:20:292
365169993525,6cyclictest0-21swapper/208:30:282
365169993525,6cyclictest0-21swapper/208:30:282
36516999352,29cyclictest407137-21kworker/u8:3+rpciod11:19:252
365169993522,8cyclictest0-21swapper/208:45:162
365167993525,7cyclictest0-21swapper/112:00:271
365167993522,8cyclictest378082-21unixbench_multi08:20:271
365167993520,10cyclictest0-21swapper/108:50:001
365167993519,11cyclictest231ktimers/111:15:121
365165993522,8cyclictest0-21swapper/007:30:160
365165993522,8cyclictest0-21swapper/007:30:150
365169993429,3cyclictest365159-21cyclictest08:25:182
365169993427,4cyclictest311ktimers/208:50:262
365169993426,5cyclictest0-21swapper/208:20:272
365169993422,7cyclictest0-21swapper/208:35:312
365167993426,5cyclictest0-21swapper/107:40:271
365167993426,5cyclictest0-21swapper/107:40:271
365167993418,12cyclictest231ktimers/110:50:111
365167993417,13cyclictest231ktimers/109:10:151
365167993415,14cyclictest231ktimers/110:55:131
365165993412,14cyclictest365258-21latency_hist07:10:010
365169993322,8cyclictest0-21swapper/208:55:292
365167993322,8cyclictest365159-21cyclictest07:50:001
365167993321,8cyclictest0-21swapper/109:00:291
365169993225,4cyclictest0-21swapper/212:25:292
365169993223,5cyclictest402437-21sh10:45:212
365169993220,8cyclictest30-21rcuc/211:55:272
365169993217,8cyclictest30-21rcuc/210:50:152
365167993225,4cyclictest406210-21unixbench_multi11:05:291
365167993225,4cyclictest406210-21unixbench_multi11:05:291
365167993224,5cyclictest0-21swapper/109:45:291
365167993220,8cyclictest0-21swapper/108:25:291
365167993220,7cyclictest389347-21/usr/sbin/munin09:30:241
36516799321,26cyclictest368157-21/usr/sbin/munin07:25:231
365169993126,3cyclictest14-21rcu_preempt07:35:282
365169993121,7cyclictest0-21swapper/207:10:002
365169993119,8cyclictest0-21swapper/208:45:012
365167993123,4cyclictest0-21swapper/108:30:211
365167993123,4cyclictest0-21swapper/108:30:211
365167993122,6cyclictest22-21rcuc/111:45:171
365167993121,8cyclictest380699-21cat08:39:591
365167993120,7cyclictest0-21swapper/107:10:021
365167993021,6cyclictest0-21swapper/109:10:011
365167993018,9cyclictest231ktimers/111:40:271
365169992917,9cyclictest30-21rcuc/211:30:272
365167992919,6cyclictest0-21swapper/111:10:181
365167992821,4cyclictest367900-21grep07:20:291
365169992722,3cyclictest412927-21ptp4l11:45:272
365167992717,7cyclictest0-21swapper/107:35:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional