You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 02:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Tue Dec 09, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62302999967,15cyclictest637780-21kworker/u8:2+ext4-rsv-conversion08:35:013
62302599675,39cyclictest22-21rcuc/112:35:011
62302699645,10cyclictest657222-21apt-get10:30:022
623026996443,10cyclictest311ktimers/208:10:012
623022996355,4cyclictest0-21swapper/007:55:120
623022996355,4cyclictest0-21swapper/007:55:120
623022995842,11cyclictest677876-21latency_hist12:30:000
62302699561,13cyclictest0-21swapper/208:45:202
623026995140,7cyclictest0-21swapper/211:45:272
62302599517,28cyclictest674587-21/usr/sbin/munin12:10:251
62302299518,40cyclictest0-21swapper/012:30:290
623026995035,9cyclictest0-21swapper/211:50:302
62302699503,33cyclictest32-21ksoftirqd/211:20:002
62302599509,13cyclictest24-21ksoftirqd/111:20:001
623022995039,8cyclictest653849-21munin-plugin-st10:10:000
623026994827,15cyclictest311ktimers/208:30:142
623025994830,12cyclictest231ktimers/108:30:121
623022994840,5cyclictest661623-21munin-plugin-st10:55:000
623026994739,5cyclictest653760-21unixbench_multi10:05:292
623025994728,12cyclictest231ktimers/109:00:141
623025994715,17cyclictest659852-21apt-get10:45:031
623022994732,10cyclictest0-21swapper/010:45:010
62302299471,25cyclictest637816-21latency_hist08:35:000
623026994634,7cyclictest676078-21munin-plugin-st12:20:012
623026994631,11cyclictest0-21swapper/208:50:292
62302599467,2cyclictest0-21swapper/108:55:011
62302299461,4cyclictest0-21swapper/011:10:120
62302299461,4cyclictest0-21swapper/011:10:110
623026994533,9cyclictest0-21swapper/210:20:292
623026994533,9cyclictest0-21swapper/210:20:292
623026994531,9cyclictest0-21swapper/210:55:312
623026994529,11cyclictest0-21swapper/210:10:292
623026994524,14cyclictest311ktimers/212:00:122
623026994524,10cyclictest30-21rcuc/212:35:002
623025994534,6cyclictest652102-21grep09:55:301
623026994432,8cyclictest0-21swapper/211:30:292
623026994430,9cyclictest0-21swapper/210:50:292
623026994426,13cyclictest311ktimers/209:15:112
623026994422,16cyclictest311ktimers/209:20:122
623025994432,7cyclictest651262-21grep09:50:271
62302299443,6cyclictest0-21swapper/010:20:010
623022994436,4cyclictest21050irq/252-8000000.ethernet08:40:170
623022994436,4cyclictest21050irq/252-8000000.ethernet08:40:160
623022994412,25cyclictest21250irq/208-8000000.ethernet12:40:010
623026994332,7cyclictest679550-21sendmail12:40:002
623026994331,7cyclictest0-21swapper/209:10:292
623026994331,7cyclictest0-21swapper/209:10:292
623025994325,13cyclictest0-21swapper/111:40:021
623022994335,5cyclictest0-21swapper/008:49:590
623022994332,8cyclictest131ktimers/010:45:280
623026994232,5cyclictest0-21swapper/210:45:282
623026994228,9cyclictest0-21swapper/208:15:282
62302599426,4cyclictest0-21swapper/107:25:011
623025994232,5cyclictest0-21swapper/111:25:191
623025994228,9cyclictest0-21swapper/110:40:281
623025994228,10cyclictest47-21kauditd09:40:001
623025994227,7cyclictest662367-21grep10:55:321
623025994226,9cyclictest231ktimers/107:45:151
623025994222,12cyclictest22-21rcuc/107:15:011
623022994233,7cyclictest643722-21munin-run09:10:000
623022994232,6cyclictest0-21swapper/008:25:270
623022994232,6cyclictest0-21swapper/008:25:270
623022994229,8cyclictest0-21swapper/007:40:000
623026994132,6cyclictest672696-21sendmail12:00:002
623026994130,7cyclictest0-21swapper/210:35:312
623026994126,12cyclictest311ktimers/208:00:142
623026994124,12cyclictest0-21swapper/209:35:272
623025994133,4cyclictest674389-21munin-plugin-st12:10:001
623025994124,9cyclictest0-21swapper/107:35:291
623022994127,10cyclictest0-21swapper/011:50:240
62302299412,35cyclictest642430-21tune2fs09:00:200
62302299411,37cyclictest0-21swapper/011:05:140
623022994110,11cyclictest662465-21apt-get11:00:010
623026994030,5cyclictest0-21swapper/207:15:292
623026994029,7cyclictest628319-21grep07:35:292
623026994027,8cyclictest0-21swapper/212:20:282
623026994026,8cyclictest0-21swapper/207:10:292
623026994026,7cyclictest0-21swapper/211:05:292
623025994032,4cyclictest0-21swapper/107:55:001
623025994027,9cyclictest0-21swapper/107:25:291
623022994031,6cyclictest651210-21grep09:50:270
62302299401,7cyclictest0-21swapper/009:35:000
623026993928,8cyclictest0-21swapper/207:25:312
623026993910,5cyclictest311ktimers/208:40:292
623026993910,5cyclictest311ktimers/208:40:292
623025993931,4cyclictest0-21swapper/108:05:281
623025993929,5cyclictest0-21swapper/111:05:291
623025993928,6cyclictest22-21rcuc/109:30:281
623025993925,8cyclictest0-21swapper/112:15:281
623025993923,9cyclictest0-21swapper/110:25:211
623025993923,10cyclictest231ktimers/109:15:141
62302599391,7cyclictest0-21swapper/110:20:011
623022993928,8cyclictest0-21swapper/010:10:240
623022993925,9cyclictest0-21swapper/009:15:200
62302299392,33cyclictest624586-21uname07:15:240
62302299391,3cyclictest0-21swapper/009:50:000
623026993827,7cyclictest311ktimers/212:25:132
623026993827,7cyclictest0-21swapper/207:45:292
623026993824,8cyclictest0-21swapper/207:30:272
623026993821,9cyclictest0-21swapper/210:40:292
623026993820,14cyclictest311ktimers/209:30:162
623025993828,6cyclictest632574-21grep08:00:311
623025993828,6cyclictest0-21swapper/111:35:011
62302599382,30cyclictest646460-21apt-get09:25:151
62302299386,3cyclictest0-21swapper/009:45:010
623022993833,3cyclictest21250irq/208-8000000.ethernet12:10:260
623022993829,6cyclictest0-21swapper/011:35:280
623022993824,10cyclictest0-21swapper/009:20:190
62302299381,4cyclictest0-21swapper/011:05:010
623022993814,21cyclictest131ktimers/011:45:200
623026993729,5cyclictest642827-21grep09:00:292
623026993725,8cyclictest0-21swapper/212:10:362
623026993723,9cyclictest0-21swapper/212:05:262
623026993721,10cyclictest311ktimers/208:20:122
623026993721,10cyclictest311ktimers/208:20:112
623025993730,4cyclictest661572-21unixbench_singl10:50:301
623025993729,5cyclictest0-21swapper/108:25:271
623025993729,5cyclictest0-21swapper/108:25:271
623025993712,14cyclictest636202-21rm08:25:011
623025993712,14cyclictest636202-21rm08:25:011
62302299377,4cyclictest636035-21apt-get08:25:010
62302299377,4cyclictest636035-21apt-get08:25:010
623022993728,5cyclictest0-21swapper/009:10:290
623022993728,5cyclictest0-21swapper/009:10:290
623022993728,4cyclictest0-21swapper/007:35:030
62302299372,4cyclictest0-21swapper/009:30:020
62302299371,2cyclictest0-21swapper/008:40:010
62302299371,2cyclictest0-21swapper/008:15:020
62302299371,2cyclictest0-21swapper/008:15:010
62302299371,29cyclictest0-21swapper/011:20:000
623026993623,9cyclictest0-21swapper/211:20:232
623026993622,8cyclictest0-21swapper/208:25:282
623026993622,8cyclictest0-21swapper/208:25:272
623026993620,7cyclictest0-21swapper/211:00:302
623025993624,6cyclictest644478-21grep09:10:301
623025993624,6cyclictest644478-21grep09:10:301
623025993623,7cyclictest629235-21grep07:40:311
623025993623,7cyclictest629235-21grep07:40:311
62302599361,29cyclictest0-21swapper/108:45:301
62302299362,5cyclictest672240-21tune2fs11:55:220
62302299362,28cyclictest657471-21latency_hist10:30:010
62302299361,32cyclictest131ktimers/008:05:280
62302299361,2cyclictest0-21swapper/007:15:000
623026993526,5cyclictest0-21swapper/209:25:292
623026993526,5cyclictest0-21swapper/207:55:282
623026993526,5cyclictest0-21swapper/207:55:282
623026993525,7cyclictest0-21swapper/211:35:282
623026993524,6cyclictest0-21swapper/209:10:002
623026993523,9cyclictest0-21swapper/210:00:282
623026993522,8cyclictest0-21swapper/207:50:282
623025993529,3cyclictest642024-21sh09:00:001
623025993529,3cyclictest642024-21sh09:00:001
623025993528,4cyclictest168350irq/126-8000000.ethernet-tx107:10:251
623025993526,6cyclictest679486-21grep12:35:281
623025993526,6cyclictest0-21swapper/111:57:211
623025993525,7cyclictest639439-21grep08:40:281
623025993525,7cyclictest639439-21grep08:40:281
623025993524,5cyclictest0-21swapper/112:30:011
623025993523,8cyclictest638581-21grep08:35:291
623025993514,14cyclictest0-21swapper/108:15:281
623022993529,4cyclictest21250irq/208-8000000.ethernet08:50:300
623022993526,5cyclictest0-21swapper/009:55:290
623022993525,5cyclictest0-21swapper/010:30:170
62302299351,5cyclictest1265-21rs:main0
62302299351,5cyclictest1265-21rs:main0
623026993423,7cyclictest0-21swapper/210:15:282
623026993423,6cyclictest0-21swapper/209:50:272
623025993427,4cyclictest168350irq/126-8000000.ethernet-tx108:10:291
623025993427,4cyclictest168350irq/126-8000000.ethernet-tx108:10:291
623025993426,4cyclictest168350irq/126-8000000.ethernet-tx109:40:171
623025993422,10cyclictest623019-21cyclictest11:20:141
623022993428,4cyclictest21250irq/208-8000000.ethernet07:50:000
623022993427,4cyclictest21250irq/208-8000000.ethernet10:20:250
623022993427,4cyclictest21250irq/208-8000000.ethernet10:20:250
623022993423,5cyclictest0-21swapper/011:40:300
623026993320,9cyclictest0-21swapper/211:40:302
623026993320,8cyclictest311ktimers/207:20:122
623025993326,4cyclictest0-21swapper/109:45:271
623025993322,7cyclictest0-21swapper/107:30:271
623025993320,8cyclictest0-21swapper/110:05:211
623022993327,4cyclictest21250irq/208-8000000.ethernet07:50:220
623022993327,4cyclictest0-21swapper/009:40:000
623022993326,4cyclictest21250irq/208-8000000.ethernet12:15:230
623022993324,4cyclictest625798-21grep07:20:290
62302299331,30cyclictest626808-21latency_hist07:30:010
62302299331,2cyclictest0-21swapper/010:05:000
62302299331,28cyclictest658986-21cron10:40:000
62302699323,4cyclictest641914-21unixbench_multi08:55:332
62302699323,4cyclictest641914-21unixbench_multi08:55:322
623026993218,11cyclictest311ktimers/211:25:152
62302699321,5cyclictest658130-21users10:30:302
62302699321,3cyclictest664452-21apt-get11:10:102
62302699321,3cyclictest664452-21apt-get11:10:102
623026993212,17cyclictest628636-21/usr/sbin/munin07:40:212
623026993212,17cyclictest628636-21/usr/sbin/munin07:40:212
623025993223,7cyclictest0-21swapper/111:50:291
623025993223,6cyclictest672905-21/usr/sbin/munin12:00:241
623025993222,6cyclictest0-21swapper/111:10:201
623025993222,6cyclictest0-21swapper/111:10:201
623025993222,5cyclictest676291-21/usr/sbin/munin12:20:191
623022993226,4cyclictest21250irq/208-8000000.ethernet08:00:130
623022993226,3cyclictest0-21swapper/011:20:180
623022993223,5cyclictest0-21swapper/012:10:000
62302299322,27cyclictest0-21swapper/012:00:150
623022993214,4cyclictest668469-21latency_hist11:35:000
62302299321,2cyclictest0-21swapper/012:25:010
62302699312,3cyclictest648996-21apt-get09:40:122
623026993122,6cyclictest0-21swapper/209:45:242
62302599316,18cyclictest22-21rcuc/110:30:181
623025993122,6cyclictest0-21swapper/110:00:291
62302599311,28cyclictest0-21swapper/110:10:201
62302599311,28cyclictest0-21swapper/109:20:221
623025993112,4cyclictest8371systemd-network07:57:471
623025993112,4cyclictest8371systemd-network07:57:471
623022993122,6cyclictest0-21swapper/008:15:270
623026993019,6cyclictest0-21swapper/207:10:022
623026993019,6cyclictest0-21swapper/207:10:012
62302699301,3cyclictest638615-21users08:35:282
62302599301,27cyclictest0-21swapper/111:45:221
62302599301,27cyclictest0-21swapper/110:20:271
62302599301,27cyclictest0-21swapper/110:20:271
623025992924,4cyclictest14-21rcu_preempt11:40:241
623025992921,4cyclictest0-21swapper/111:00:301
623025992920,5cyclictest0-21swapper/109:05:281
623022992924,3cyclictest21250irq/208-8000000.ethernet11:29:300
62302299291,4cyclictest0-21swapper/007:10:010
62302299291,4cyclictest0-21swapper/007:10:010
623026992818,7cyclictest0-21swapper/209:55:262
623025992818,7cyclictest0-21swapper/107:10:011
623025992818,7cyclictest0-21swapper/107:10:011
623022992824,2cyclictest0-21swapper/007:40:290
623022992824,2cyclictest0-21swapper/007:40:290
623026992716,8cyclictest0-21swapper/208:10:292
623026992716,8cyclictest0-21swapper/208:10:292
62302599278,14cyclictest231ktimers/110:35:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional