You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 00:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed May 20, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3896957998063,4cyclictest311ktimers/212:10:022
3896955997910,24cyclictest1660-21snmpd10:45:021
3896957995730,14cyclictest14-21rcu_preempt07:55:002
389695799552,36cyclictest32-21ksoftirqd/211:25:022
3896957995227,15cyclictest311ktimers/207:30:112
389695599524,37cyclictest3921759-21unixbench_multi09:30:291
389695599524,37cyclictest3921759-21unixbench_multi09:30:281
3896953995245,5cyclictest3932989-21unixbench_singl10:35:260
3896953995244,5cyclictest167350irq/118-8000000.ethernet-tx007:45:240
3896953995214,8cyclictest0-21swapper/008:55:020
3896953995214,8cyclictest0-21swapper/008:55:010
3896957995130,15cyclictest311ktimers/208:25:132
3896953995133,15cyclictest167350irq/118-8000000.ethernet-tx010:10:180
3896953995133,15cyclictest167350irq/118-8000000.ethernet-tx010:10:180
3896953995110,39cyclictest0-21swapper/009:15:000
3896955995041,5cyclictest3937259-21munin-plugin-st11:04:591
389695399500,45cyclictest3948280-21find12:05:270
389695599494,25cyclictest22-21rcuc/107:40:011
3896953994940,4cyclictest0-21swapper/008:35:020
3896953994938,6cyclictest3953427-21unixbench_singl12:35:290
3896953994925,21cyclictest20650irq/252-8000000.ethernet10:20:170
3896957994825,15cyclictest311ktimers/211:55:132
389695599481,44cyclictest0-21swapper/107:25:001
3896953994841,4cyclictest167350irq/118-8000000.ethernet-tx007:30:160
3896953994836,8cyclictest0-21swapper/010:30:270
3896955994738,4cyclictest167450irq/126-8000000.ethernet-tx109:50:281
3896955994737,6cyclictest3903207-21munin-plugin-st07:45:001
389695599471,37cyclictest3939714-21unixbench_singl11:15:281
3896957994636,4cyclictest0-21swapper/209:50:002
389695599465,35cyclictest0-21swapper/112:25:291
3896955994638,5cyclictest3900579-21munin-plugin-st07:30:001
3896955994638,5cyclictest3900579-21munin-plugin-st07:30:001
3896953994638,4cyclictest167350irq/118-8000000.ethernet-tx010:00:260
3896953994637,5cyclictest0-21swapper/009:20:270
3896953994635,5cyclictest0-21swapper/008:15:280
3896953994634,8cyclictest0-21swapper/009:45:280
3896953994632,9cyclictest3907771-21grep08:10:230
3896957994527,11cyclictest311ktimers/207:15:132
3896957994523,15cyclictest311ktimers/209:50:122
3896957994425,12cyclictest311ktimers/209:35:122
389695599444,19cyclictest14-21rcu_preempt09:40:001
3896953994435,5cyclictest0-21swapper/008:40:170
389695399443,37cyclictest15-21rcuc/011:00:280
3896953994425,16cyclictest15-21rcuc/007:55:010
389695399441,8cyclictest0-21swapper/009:55:010
3896957994328,11cyclictest311ktimers/211:30:142
3896957994326,12cyclictest311ktimers/207:55:132
3896957994326,12cyclictest311ktimers/207:55:132
3896955994338,3cyclictest14-21rcu_preempt09:20:011
3896955994331,8cyclictest3942403-21munin-plugin-st11:35:011
3896953994335,5cyclictest20850irq/208-8000000.ethernet09:10:000
389695399432,16cyclictest12-21ksoftirqd/008:30:010
3896955994232,6cyclictest0-21swapper/111:45:011
3896955994226,10cyclictest0-21swapper/107:55:221
3896955994226,10cyclictest0-21swapper/107:55:211
3896955994223,10cyclictest0-21swapper/108:15:271
389695399423,8cyclictest3911815-21grep08:35:010
3896953994226,12cyclictest0-21swapper/009:25:240
389695399421,39cyclictest0-21swapper/011:30:100
389695399421,35cyclictest0-21swapper/007:15:020
389695399421,23cyclictest0-21swapper/010:40:010
3896957994130,6cyclictest0-21swapper/212:30:162
3896957994124,12cyclictest311ktimers/210:30:112
3896957994122,12cyclictest0-21swapper/211:35:282
3896955994129,6cyclictest0-21swapper/112:10:291
3896955994129,6cyclictest0-21swapper/107:45:281
389695399416,6cyclictest3914063-21tail08:45:260
389695399414,34cyclictest3905724-21latency_hist08:00:010
389695399414,34cyclictest3905724-21latency_hist08:00:010
389695399414,13cyclictest12-21ksoftirqd/011:20:010
3896953994135,3cyclictest0-21swapper/011:55:010
3896953994134,4cyclictest3940825-21apt-get11:25:010
3896953994134,4cyclictest20850irq/208-8000000.ethernet08:25:000
3896953994134,4cyclictest0-21swapper/011:55:170
3896953994134,4cyclictest0-21swapper/007:35:140
3896953994131,7cyclictest3907361-21grep08:05:280
3896953994130,7cyclictest3926152-21latency_hist10:00:010
3896953994130,7cyclictest3926152-21latency_hist10:00:010
3896953994128,8cyclictest0-21swapper/008:00:190
389695399412,4cyclictest3903206-21munin-run07:45:000
389695399411,3cyclictest3944457-21df_inode11:45:160
3896953994113,9cyclictest12-21ksoftirqd/009:35:020
3896953994113,9cyclictest12-21ksoftirqd/009:35:010
3896957994028,6cyclictest0-21swapper/208:45:202
3896957994023,12cyclictest311ktimers/210:45:102
3896957994023,11cyclictest311ktimers/208:30:132
3896957994023,11cyclictest311ktimers/208:20:132
3896957994022,10cyclictest0-21swapper/211:45:272
3896957994018,15cyclictest311ktimers/209:15:122
3896955994026,7cyclictest0-21swapper/110:45:291
389695599401,4cyclictest0-21swapper/108:40:011
389695599401,2cyclictest0-21swapper/111:15:011
389695399403,33cyclictest3935016-21grep10:50:200
3896953994032,5cyclictest3916811-21munin-plugin-st09:05:000
3896953994032,5cyclictest0-21swapper/008:55:210
3896953994032,4cyclictest15-21rcuc/011:40:200
389695399401,9cyclictest3929257-21tail10:15:250
389695399401,5cyclictest3946997-21df_inode12:00:180
3896957993926,9cyclictest311ktimers/209:55:142
3896957993926,9cyclictest311ktimers/209:55:142
3896957993911,21cyclictest0-21swapper/207:25:012
389695599394,14cyclictest22-21rcuc/109:25:011
389695599391,4cyclictest0-21swapper/109:10:011
389695399393,3cyclictest12-21ksoftirqd/009:35:260
3896953993933,4cyclictest0-21swapper/010:25:250
3896953993930,7cyclictest131ktimers/010:55:200
3896953993928,6cyclictest3949187-21grep12:10:280
3896953993928,6cyclictest3938356-21/usr/sbin/munin11:10:170
389695399392,7cyclictest3927778-21cron10:10:010
389695399392,7cyclictest3927778-21cron10:10:000
3896953993923,14cyclictest0-21swapper/012:15:260
3896953993913,6cyclictest12-21ksoftirqd/007:30:020
3896953993913,6cyclictest12-21ksoftirqd/007:30:010
3896957993830,4cyclictest0-21swapper/210:30:012
3896957993828,6cyclictest3921798-21grep09:30:282
3896957993828,6cyclictest3921798-21grep09:30:282
3896957993827,7cyclictest3918443-21grep09:10:282
389695599385,19cyclictest3911738-21cmp08:35:001
3896955993827,7cyclictest3941503-21grep11:25:291
3896955993827,5cyclictest0-21swapper/111:05:261
3896955993826,8cyclictest3904775-21grep07:50:281
3896955993825,6cyclictest3901366-21grep07:30:281
389695399385,7cyclictest3950488-21perl12:20:200
3896953993832,4cyclictest20850irq/208-8000000.ethernet12:25:120
3896953993820,7cyclictest3934640-21grep10:45:280
389695399381,3cyclictest3952699-21cat12:35:010
389695399380,36cyclictest3899102-21/usr/sbin/munin07:20:110
3896955993729,5cyclictest0-21swapper/108:04:591
3896955993725,8cyclictest3950004-21unixbench_multi12:15:281
389695599371,2cyclictest0-21swapper/109:30:021
389695399375,30cyclictest0-21swapper/011:29:590
3896953993732,2cyclictest0-21swapper/009:15:270
3896953993730,4cyclictest167350irq/118-8000000.ethernet-tx011:05:230
3896953993720,15cyclictest0-21swapper/009:40:150
3896957993620,11cyclictest311ktimers/212:00:122
3896957993619,13cyclictest311ktimers/210:20:132
389695799361,29cyclictest0-21swapper/212:35:212
389695599369,11cyclictest3926305-21/usr/sbin/munin10:00:191
3896955993627,5cyclictest0-21swapper/112:00:281
3896955993626,6cyclictest167450irq/126-8000000.ethernet-tx107:15:021
389695599361,2cyclictest0-21swapper/112:40:011
389695399362,11cyclictest3897184-21/usr/sbin/munin07:10:190
3896957993525,4cyclictest0-21swapper/208:50:292
3896957993525,4cyclictest0-21swapper/208:50:292
3896957993524,8cyclictest0-21swapper/211:50:272
3896957993522,8cyclictest0-21swapper/211:10:292
3896957993520,12cyclictest311ktimers/209:25:122
389695799351,29cyclictest3908464-21/usr/sbin/munin08:15:282
389695599354,4cyclictest0-21swapper/108:30:011
3896955993530,3cyclictest167450irq/126-8000000.ethernet-tx110:10:261
3896955993530,3cyclictest167450irq/126-8000000.ethernet-tx110:10:261
3896955993529,5cyclictest231ktimers/111:55:001
3896957993425,4cyclictest0-21swapper/208:40:292
389695799341,28cyclictest0-21swapper/211:05:172
389695799341,28cyclictest0-21swapper/211:00:182
3896955993427,4cyclictest3950947-21apt12:25:011
3896955993425,5cyclictest0-21swapper/108:05:191
3896955993423,7cyclictest0-21swapper/107:10:221
3896955993423,6cyclictest0-21swapper/108:45:001
3896953993429,4cyclictest0-21swapper/011:35:170
3896957993317,10cyclictest0-21swapper/207:25:212
3896957993317,10cyclictest0-21swapper/207:25:212
3896957993316,12cyclictest311ktimers/207:40:122
3896955993326,5cyclictest3918404-21grep09:10:271
3896955993324,5cyclictest0-21swapper/112:30:251
3896955993324,5cyclictest0-21swapper/108:20:191
3896955993323,7cyclictest0-21swapper/112:05:281
389695599331,4cyclictest0-21swapper/111:00:011
389695799324,3cyclictest0-21swapper/212:20:012
3896957993225,4cyclictest47-21kauditd09:10:002
3896957993225,4cyclictest3896948-21cyclictest10:05:242
3896957993225,4cyclictest3896948-21cyclictest10:05:242
3896957993215,9cyclictest0-21swapper/211:45:012
3896955993225,3cyclictest0-21swapper/111:55:221
389695599322,2cyclictest0-21swapper/111:40:031
389695799319,12cyclictest3911930-21/usr/sbin/munin08:35:172
3896957993123,5cyclictest0-21swapper/210:55:282
3896957993123,4cyclictest0-21swapper/209:20:182
3896957993122,6cyclictest3916773-21grep09:00:302
389695799311,28cyclictest0-21swapper/208:55:172
3896955993117,10cyclictest0-21swapper/110:35:071
3896955993117,10cyclictest0-21swapper/110:10:021
3896955993117,10cyclictest0-21swapper/110:10:011
389695599311,2cyclictest0-21swapper/111:50:001
389695799305,16cyclictest0-21swapper/207:45:282
3896957993020,5cyclictest0-21swapper/210:15:282
3896957993019,7cyclictest0-21swapper/212:05:292
389695799301,24cyclictest0-21swapper/209:42:212
3896955993022,4cyclictest0-21swapper/108:55:211
389695799293,4cyclictest3939782-21munin-run11:20:012
3896957992921,6cyclictest3906559-21sshd08:01:102
3896957992920,7cyclictest1660-21snmpd08:07:592
3896957992919,7cyclictest0-21swapper/212:30:002
3896957992919,6cyclictest0-21swapper/211:25:202
3896957992919,5cyclictest0-21swapper/208:10:222
3896957992915,10cyclictest0-21swapper/210:00:192
389695799291,26cyclictest1660-21snmpd10:38:292
3896955992923,4cyclictest3914472-21/usr/sbin/munin08:50:221
3896955992923,4cyclictest3914472-21/usr/sbin/munin08:50:221
3896955992920,6cyclictest0-21swapper/110:15:261
3896955992919,7cyclictest3940808-21cat11:25:011
3896957992820,6cyclictest0-21swapper/210:10:272
3896957992820,6cyclictest0-21swapper/210:10:272
3896957992820,5cyclictest3935481-21unixbench_multi10:50:282
3896957992813,10cyclictest0-21swapper/207:15:012
3896955992817,8cyclictest0-21swapper/109:40:261
389695599281,5cyclictest0-21swapper/110:25:011
389695599281,2cyclictest0-21swapper/110:00:011
389695599281,2cyclictest0-21swapper/110:00:011
389695599281,21cyclictest0-21swapper/108:10:101
3896957992718,6cyclictest0-21swapper/212:20:252
3896957992717,7cyclictest0-21swapper/207:35:182
389695799271,24cyclictest0-21swapper/210:40:242
3896955992719,5cyclictest0-21swapper/110:32:331
3896955992717,7cyclictest0-21swapper/110:55:001
3896955992714,8cyclictest0-21swapper/109:00:211
3896955992618,4cyclictest0-21swapper/110:25:271
389695599251,2cyclictest0-21swapper/109:50:011
3896953992519,4cyclictest0-21swapper/007:10:000
3896955992416,5cyclictest0-21swapper/108:45:201
3896957991914,3cyclictest3897033-21latency_hist07:10:002
389695599191,4cyclictest0-21swapper/107:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional