You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 00:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Jun 30, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2351286998249,29cyclictest2377229-21munin-plugin-st09:40:000
2351289997922,17cyclictest2390180-21/usr/sbin/munin10:55:181
2351289997922,17cyclictest2390180-21/usr/sbin/munin10:55:181
235129299781,40cyclictest0-21swapper/310:55:013
235128699733,8cyclictest2363411-21grep08:15:290
235128699721,4cyclictest2387139-21grep10:35:260
235128699701,6cyclictest2395507-21diskstats11:25:200
235128699701,6cyclictest2395507-21diskstats11:25:190
235128699691,8cyclictest2374000-21date09:20:020
235128699682,3cyclictest2352110-21munin-node07:15:010
235128699681,4cyclictest2388760-21irqstats10:45:250
235128699681,4cyclictest2388760-21irqstats10:45:240
2351286996740,25cyclictest274-21systemd-journal10:34:590
2351286996728,4cyclictest20850irq/208-8000000.ethernet08:45:170
235128699662,4cyclictest2354913-21munin-run07:30:000
235128699652,3cyclictest2405336-21/usr/sbin/munin12:20:290
235128699652,3cyclictest2389824-21/usr/sbin/munin10:50:270
235128699651,5cyclictest2382107-21wc10:05:260
2351286996430,30cyclictest0-21swapper/008:05:290
2351286996425,33cyclictest0-21swapper/008:40:190
2351286996423,15cyclictest0-21swapper/010:20:240
235128699641,4cyclictest2372201-21latency_hist09:10:010
235128699633,4cyclictest2381397-21head10:00:280
2351286996328,4cyclictest0-21swapper/008:10:180
235128699631,36cyclictest0-21swapper/007:35:220
235128699622,6cyclictest2393446-21munin-run11:15:000
2351286996222,4cyclictest0-21swapper/011:00:010
2351286996222,4cyclictest0-21swapper/011:00:010
2351286996217,11cyclictest0-21swapper/008:00:000
235128699621,5cyclictest2400885-21/usr/sbin/munin11:55:280
2351286996132,25cyclictest2378035-21grep09:40:290
2351286996115,15cyclictest2405564-21/usr/sbin/munin12:25:190
235128699611,37cyclictest0-21swapper/011:05:150
2351289996042,11cyclictest0-21swapper/107:45:001
2351286996029,4cyclictest20850irq/208-8000000.ethernet10:40:260
2351286996027,6cyclictest20850irq/208-8000000.ethernet12:30:200
2351286996024,8cyclictest2399487-21latency_hist11:50:000
235128699593,50cyclictest2360956-21sed08:00:300
235128699591,5cyclictest2355255-21df07:30:160
235128699591,4cyclictest2397754-21latency_hist11:40:000
2351286995830,4cyclictest20850irq/208-8000000.ethernet09:10:220
235128999569,27cyclictest22-21rcuc/109:05:221
235128699561,3cyclictest2366567-21meminfo08:35:240
235128699532,4cyclictest2365888-21run-parts08:30:280
235128699531,5cyclictest2394662-21df_inode11:20:180
235128699531,36cyclictest0-21swapper/012:00:200
2351289995242,5cyclictest167450irq/126-8000000.ethernet-tx110:10:271
2351289995232,11cyclictest0-21swapper/109:50:021
2351289995232,11cyclictest0-21swapper/109:50:011
2351289995230,9cyclictest0-21swapper/110:50:011
2351286995244,4cyclictest0-21swapper/011:15:110
2351286995228,4cyclictest19750irq/27-20000000.i2c07:25:000
2351286995221,14cyclictest0-21swapper/008:50:200
235128699521,34cyclictest0-21swapper/009:25:140
2351289995111,19cyclictest2367126-21/usr/sbin/munin08:40:181
2351290995023,16cyclictest311ktimers/212:00:132
2351290994935,9cyclictest2380497-21grep09:55:302
2351290994911,28cyclictest2385653-21kworker/u8:0-events_power_efficient12:06:162
2351290994911,28cyclictest2385653-21kworker/u8:0-events_power_efficient12:06:162
2351289994912,15cyclictest2362888-21/usr/sbin/munin08:15:191
2351286994938,8cyclictest2376385-21munin-plugin-st09:35:000
235129099489,18cyclictest32-21ksoftirqd/210:50:022
235128999483,28cyclictest24-21ksoftirqd/107:55:181
2351289994832,4cyclictest22-21rcuc/108:35:001
2351289994712,12cyclictest2352224-21users07:15:021
2351289994639,4cyclictest231ktimers/112:20:181
2351289994637,5cyclictest2384833-21apt10:25:001
2351289994636,7cyclictest0-21swapper/107:55:011
2351286994638,5cyclictest2383978-21sendmail10:20:000
2351286994634,8cyclictest0-21swapper/012:35:300
235129099456,31cyclictest2393423-21kworker/u8:1+rpciod11:31:202
2351290994531,10cyclictest2403657-21sh12:15:002
2351289994533,9cyclictest231ktimers/109:00:001
235128699451,42cyclictest0-21swapper/007:45:130
2351290994427,11cyclictest0-21swapper/210:35:002
2351289994424,11cyclictest0-21swapper/110:50:001
2351289994424,11cyclictest0-21swapper/110:50:001
235128699441,37cyclictest0-21swapper/007:15:040
235128699441,36cyclictest0-21swapper/007:10:010
2351290994327,12cyclictest2373906-21apt-key09:20:012
2351290994325,10cyclictest0-21swapper/209:25:002
2351290994322,11cyclictest30-21rcuc/212:25:012
2351289994333,5cyclictest14-21rcu_preempt08:55:001
2351289994318,3cyclictest0-21swapper/112:35:011
2351286994333,7cyclictest2385565-21grep10:25:300
2351286994333,7cyclictest2385565-21grep10:25:300
235129099429,21cyclictest30-21rcuc/208:50:022
2351289994230,7cyclictest0-21swapper/112:05:271
2351289994230,7cyclictest0-21swapper/112:05:271
2351286994232,6cyclictest2398522-21grep11:40:300
2351290994129,6cyclictest0-21swapper/208:25:272
2351290994129,6cyclictest0-21swapper/208:25:272
2351290994121,15cyclictest311ktimers/210:15:152
2351289994134,3cyclictest2388303-21munin-plugin-st10:45:001
2351289994128,7cyclictest0-21swapper/110:00:271
2351286994135,4cyclictest0-21swapper/007:50:230
2351286994134,3cyclictest2404504-21latency_hist12:20:010
235128699412,5cyclictest2365176-21grep08:25:280
235128699412,5cyclictest2365176-21grep08:25:280
235128699412,5cyclictest2363815-21df_inode08:20:170
2351290994033,4cyclictest2357540-21munin-plugin-st07:45:002
2351290994031,4cyclictest0-21swapper/209:30:272
2351290994030,6cyclictest2382249-21grep10:05:282
235128999406,12cyclictest2393733-21/usr/sbin/munin11:15:181
2351289994028,7cyclictest0-21swapper/111:45:291
235128699401,36cyclictest0-21swapper/012:05:140
235128699401,36cyclictest0-21swapper/012:05:140
235128699401,36cyclictest0-21swapper/009:55:190
2351290993928,6cyclictest0-21swapper/211:20:282
2351290993925,9cyclictest0-21swapper/208:45:202
2351289993930,4cyclictest0-21swapper/107:30:001
2351289993929,6cyclictest2371129-21grep09:00:291
2351289993928,7cyclictest2385677-21munin-plugin-st10:30:011
2351289993928,7cyclictest2385677-21munin-plugin-st10:30:001
2351289993928,6cyclictest231ktimers/111:00:241
2351289993921,12cyclictest0-21swapper/111:55:021
2351286993933,4cyclictest0-21swapper/009:00:000
2351286993928,8cyclictest0-21swapper/011:30:300
235128699391,36cyclictest0-21swapper/009:00:160
2351290993829,4cyclictest0-21swapper/212:35:002
2351290993827,8cyclictest2397761-21sendmail11:40:012
2351290993825,8cyclictest0-21swapper/207:30:222
2351290993823,7cyclictest0-21swapper/209:05:232
235129099382,21cyclictest30-21rcuc/209:40:122
2351290993822,13cyclictest311ktimers/211:25:122
2351290993822,13cyclictest311ktimers/211:25:122
2351290993822,12cyclictest0-21swapper/212:20:022
2351290993820,12cyclictest311ktimers/208:40:112
235129099381,4cyclictest2400067-21grep11:50:272
2351289993826,5cyclictest0-21swapper/112:00:281
2351289993821,8cyclictest0-21swapper/108:35:291
235128699386,16cyclictest14-21rcu_preempt12:15:000
2351286993831,4cyclictest0-21swapper/009:50:150
2351290993725,7cyclictest0-21swapper/209:25:282
2351290993724,9cyclictest0-21swapper/209:10:262
2351289993730,4cyclictest2368591-21unixbench_multi08:45:281
2351289993727,7cyclictest231ktimers/109:20:271
2351289993727,5cyclictest0-21swapper/107:20:201
2351289993724,10cyclictest2352350-21sh07:15:031
2351289993723,8cyclictest0-21swapper/110:20:001
235128699371,34cyclictest0-21swapper/009:20:110
2351290993630,4cyclictest311ktimers/212:00:012
2351290993625,6cyclictest2378820-21grep09:45:282
2351290993625,6cyclictest2378820-21grep09:45:282
2351290993624,6cyclictest0-21swapper/210:40:272
235129099361,28cyclictest0-21swapper/207:15:042
235128999367,23cyclictest0-21swapper/112:10:221
2351289993628,5cyclictest231ktimers/108:10:001
2351289993625,5cyclictest231ktimers/109:50:281
2351289993623,6cyclictest0-21swapper/111:35:161
2351289993622,9cyclictest231ktimers/111:20:121
235128699361,33cyclictest0-21swapper/011:53:590
235129099357,20cyclictest30-21rcuc/208:25:012
235129099351,4cyclictest0-21swapper/207:10:012
235129099351,29cyclictest0-21swapper/207:55:182
2351289993526,6cyclictest231ktimers/109:35:001
2351289993523,7cyclictest231ktimers/107:45:141
2351289993523,5cyclictest0-21swapper/109:35:241
2351289993522,7cyclictest0-21swapper/108:00:301
2351289993518,8cyclictest0-21swapper/110:35:181
2351286993529,4cyclictest20850irq/208-8000000.ethernet07:40:190
235129099348,17cyclictest32-21ksoftirqd/211:15:052
2351290993425,6cyclictest0-21swapper/210:25:312
2351290993425,6cyclictest0-21swapper/210:25:302
2351290993425,4cyclictest0-21swapper/210:55:272
2351290993425,4cyclictest0-21swapper/210:55:272
2351290993424,4cyclictest2351982-21grep07:10:282
2351290993423,6cyclictest2360954-21grep08:00:302
235129099342,19cyclictest0-21swapper/208:40:012
2351290993419,8cyclictest0-21swapper/207:35:282
235129099341,27cyclictest0-21swapper/208:05:182
2351289993424,8cyclictest231ktimers/107:30:301
2351289993422,6cyclictest0-21swapper/108:20:291
2351289993421,8cyclictest0-21swapper/111:55:261
2351289993420,8cyclictest0-21swapper/109:55:301
2351286993428,4cyclictest20850irq/208-8000000.ethernet09:45:170
2351286993428,4cyclictest20850irq/208-8000000.ethernet09:45:170
2351290993324,6cyclictest2382491-21/usr/sbin/munin10:10:202
2351290993323,5cyclictest0-21swapper/207:30:012
2351290993321,7cyclictest2391730-21grep11:00:292
2351290993319,9cyclictest0-21swapper/210:45:202
2351290993319,9cyclictest0-21swapper/210:45:202
235129099331,2cyclictest0-21swapper/209:55:002
235129099331,27cyclictest30-21rcuc/207:50:272
235129099331,27cyclictest0-21swapper/212:20:182
235128999337,2cyclictest0-21swapper/110:10:011
2351289993326,4cyclictest24-21ksoftirqd/112:30:211
2351289993325,4cyclictest2378078-21latency_hist09:45:001
235128999331,26cyclictest0-21swapper/109:25:161
235128999331,26cyclictest0-21swapper/107:39:041
2351286993324,5cyclictest0-21swapper/011:00:210
2351290993223,5cyclictest0-21swapper/207:45:292
2351290993222,5cyclictest2372062-21kworker/u8:3+rpciod10:01:162
235129099321,27cyclictest0-21swapper/211:45:162
2351289993224,5cyclictest231ktimers/112:25:181
2351289993224,4cyclictest2373700-21head09:15:291
2351289993221,7cyclictest0-21swapper/111:30:291
235128999321,8cyclictest0-21swapper/111:15:021
2351286993226,4cyclictest0-21swapper/010:10:180
2351290993122,5cyclictest0-21swapper/210:35:202
235129099311,24cyclictest0-21swapper/211:10:122
2351289993122,6cyclictest0-21swapper/108:10:261
235128999311,5cyclictest22-21rcuc/111:05:291
235128999311,25cyclictest22-21rcuc/108:25:191
235128999311,25cyclictest22-21rcuc/108:25:191
2351290993022,5cyclictest2370597-21/usr/sbin/munin09:00:232
2351290993021,4cyclictest0-21swapper/208:15:302
2351290993020,5cyclictest0-21swapper/212:40:012
2351290993019,7cyclictest0-21swapper/208:10:172
2351290993018,8cyclictest0-21swapper/211:05:272
235129099300,24cyclictest0-21swapper/210:20:112
2351289993023,5cyclictest231ktimers/111:40:261
2351289993020,7cyclictest231ktimers/110:30:171
2351289993020,5cyclictest231ktimers/111:25:211
2351289993020,5cyclictest231ktimers/111:25:211
235128999301,3cyclictest0-21swapper/109:15:011
235128999301,23cyclictest0-21swapper/112:15:131
2351290992919,6cyclictest0-21swapper/211:40:312
2351290992912,13cyclictest311ktimers/207:20:152
235128999297,18cyclictest22-21rcuc/107:10:011
2351290992816,9cyclictest2370385-21sendmail09:00:002
2351290992816,8cyclictest0-21swapper/208:30:252
2351290992215,6cyclictest311ktimers/209:35:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional