You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 00:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Dec 02, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285576999861,48cyclictest0-21swapper/111:35:011
285576999681,54cyclictest0-21swapper/108:05:151
285576999661,52cyclictest0-21swapper/107:55:191
285576999651,51cyclictest0-21swapper/107:30:141
285576999641,52cyclictest0-21swapper/108:10:151
285576999641,49cyclictest0-21swapper/108:00:141
285576999631,49cyclictest0-21swapper/110:35:171
285576999631,48cyclictest0-21swapper/107:40:121
285576999621,50cyclictest0-21swapper/110:30:141
285576999621,49cyclictest0-21swapper/107:25:111
285576999616,40cyclictest0-21swapper/109:45:161
285576999611,48cyclictest0-21swapper/112:20:161
285576999611,47cyclictest0-21swapper/110:05:131
285576999611,47cyclictest0-21swapper/107:10:101
285576999611,47cyclictest0-21swapper/107:10:101
285576999601,47cyclictest0-21swapper/110:55:131
285576999601,46cyclictest0-21swapper/111:00:161
285576999601,45cyclictest0-21swapper/110:00:141
2855769995925,28cyclictest0-21swapper/107:45:251
2855769995919,32cyclictest0-21swapper/108:35:181
285576999591,45cyclictest0-21swapper/109:30:111
285576999582,47cyclictest2860432-21apt-get07:35:181
285576999581,47cyclictest0-21swapper/109:55:131
285576999581,47cyclictest0-21swapper/109:55:131
285576999581,47cyclictest0-21swapper/108:55:141
285576999581,45cyclictest0-21swapper/112:10:151
285576999581,45cyclictest0-21swapper/109:20:121
285576999581,43cyclictest0-21swapper/109:35:131
285576999571,47cyclictest2883826-21/usr/sbin/munin09:50:271
285576999571,47cyclictest2875218-21/usr/sbin/munin09:00:261
285576999571,44cyclictest0-21swapper/111:30:131
285576999571,43cyclictest0-21swapper/111:25:141
285576999562,46cyclictest2887889-21/usr/sbin/munin10:15:201
2855769995617,30cyclictest0-21swapper/110:20:281
285576999561,48cyclictest2887173-21/usr/sbin/munin10:10:221
285576999553,44cyclictest2906588-21apt-get12:05:191
285576999552,46cyclictest2899225-21/usr/sbin/munin11:20:261
285576999552,44cyclictest2869795-21/usr/sbin/munin08:30:171
285576999551,47cyclictest2910406-21/usr/sbin/munin12:25:281
285576999551,47cyclictest2893903-21/usr/sbin/munin10:50:191
285576999551,47cyclictest2879488-21/usr/sbin/munin09:25:261
285576999551,46cyclictest2868351-21/usr/sbin/munin08:20:231
285576999551,46cyclictest2868351-21/usr/sbin/munin08:20:231
285576999551,45cyclictest2867623-21ptp4l-jitter08:15:251
285576999551,42cyclictest0-21swapper/111:50:131
285576999543,43cyclictest2873416-21/usr/sbin/munin08:50:241
285576999541,46cyclictest2871970-21/usr/sbin/munin08:40:291
285576999541,42cyclictest0-21swapper/107:15:131
2855765995441,7cyclictest0-21swapper/012:05:180
285576999532,44cyclictest2892322-21/usr/sbin/munin10:40:251
285576999531,46cyclictest2858174-21/usr/sbin/munin07:20:231
285576999531,45cyclictest2903281-21dropbear11:45:201
285576999531,45cyclictest2902637-21/usr/sbin/munin11:40:291
285576999531,45cyclictest2889769-21/usr/sbin/munin10:25:251
285576999531,45cyclictest2872967-21/usr/sbin/munin08:45:321
285576999531,45cyclictest2872967-21/usr/sbin/munin08:45:321
285576999523,42cyclictest2912180-21grep12:35:301
285576999522,43cyclictest2910807-21munin-node12:30:111
285576999522,43cyclictest2897262-21/usr/sbin/munin11:10:191
285576999522,43cyclictest2896440-21/usr/sbin/munin11:05:201
285576999522,43cyclictest2876036-21/usr/sbin/munin09:05:251
285576999522,43cyclictest2863043-21diskstats07:50:161
285576999521,44cyclictest2908338-21/usr/sbin/munin12:15:191
285576999521,44cyclictest2906362-21/usr/sbin/munin12:00:271
285576999521,44cyclictest2906362-21/usr/sbin/munin12:00:271
285576999521,44cyclictest2893195-21/usr/sbin/munin10:45:221
285576999521,44cyclictest2882123-21/usr/sbin/munin09:40:251
285576999521,44cyclictest2877055-21/usr/sbin/munin09:10:291
285576999521,25cyclictest0-21swapper/108:25:151
2855774995133,11cyclictest0-21swapper/209:55:272
2855774995133,11cyclictest0-21swapper/209:55:272
285576999511,43cyclictest2904879-21/usr/sbin/munin11:55:191
285576999511,43cyclictest2898414-21/usr/sbin/munin11:15:281
285576999511,43cyclictest2877848-21/usr/sbin/munin09:15:271
2855765994920,20cyclictest2871459-21latency_hist08:40:010
2855774994839,5cyclictest2863611-21munin-plugin-st07:55:002
2855774994833,10cyclictest0-21swapper/209:40:292
2855774994832,10cyclictest0-21swapper/208:50:292
2855774994827,16cyclictest311ktimers/212:35:162
2855774994740,4cyclictest2889311-21munin-plugin-st10:25:002
2855774994740,3cyclictest2876374-21munin-plugin-st09:09:592
2855774994735,7cyclictest0-21swapper/211:45:282
2855765994737,7cyclictest2902077-21sendmail11:40:000
2855774994634,8cyclictest0-21swapper/212:00:272
2855774994634,8cyclictest0-21swapper/212:00:272
2855774994633,8cyclictest0-21swapper/208:35:022
2855774994632,9cyclictest0-21swapper/208:05:012
2855774994432,8cyclictest0-21swapper/208:15:272
2855774994431,8cyclictest0-21swapper/207:15:282
2855774994429,10cyclictest0-21swapper/209:50:282
2855765994438,3cyclictest21050irq/252-8000000.ethernet10:15:480
2855765994437,5cyclictest2876315-21unixbench_singl09:05:300
2855765994436,4cyclictest21050irq/252-8000000.ethernet08:20:100
2855765994436,4cyclictest21050irq/252-8000000.ethernet08:20:100
285576599442,9cyclictest2906197-21sendmail_mailqu12:00:250
285576599442,9cyclictest2906197-21sendmail_mailqu12:00:250
2855774994331,8cyclictest0-21swapper/209:15:292
2855774994330,8cyclictest0-21swapper/208:45:302
2855774994330,8cyclictest0-21swapper/208:45:302
2855774994328,8cyclictest0-21swapper/210:45:282
2855774994328,10cyclictest0-21swapper/208:10:012
2855774994327,9cyclictest0-21swapper/209:35:012
2855774994235,4cyclictest2897001-21munin-plugin-st11:10:002
2855774994230,8cyclictest0-21swapper/211:00:002
2855774994226,8cyclictest0-21swapper/212:10:312
2855765994235,4cyclictest21050irq/252-8000000.ethernet12:30:290
2855765994233,4cyclictest0-21swapper/011:10:220
2855765994232,7cyclictest131ktimers/009:20:270
2855765994232,6cyclictest2905331-21grep11:55:290
2855765994231,8cyclictest0-21swapper/009:50:290
2855774994132,7cyclictest2874686-21munin-plugin-st09:00:002
2855774994127,9cyclictest0-21swapper/210:05:292
2855774994127,9cyclictest0-21swapper/208:40:302
2855774994127,8cyclictest0-21swapper/207:20:292
285576599412,9cyclictest2889481-21latency_hist10:25:010
2855774994031,5cyclictest0-21swapper/210:45:012
2855774994030,6cyclictest2890884-21unixbench_multi10:30:272
2855774994027,8cyclictest0-21swapper/210:15:302
2855774994027,8cyclictest0-21swapper/208:20:272
2855774994027,8cyclictest0-21swapper/208:20:272
2855774994024,8cyclictest0-21swapper/208:35:302
2855774994024,11cyclictest0-21swapper/208:25:282
2855774994021,11cyclictest0-21swapper/210:35:272
2855765994033,4cyclictest0-21swapper/010:05:290
2855765994032,5cyclictest2857688-21cron07:20:000
2855765994030,7cyclictest0-21swapper/009:30:310
2855765994027,9cyclictest0-21swapper/009:10:300
2855765994026,11cyclictest131ktimers/012:15:270
2855774993930,5cyclictest0-21swapper/210:10:302
2855774993927,6cyclictest0-21swapper/211:15:302
2855774993926,9cyclictest0-21swapper/209:20:292
2855774993925,8cyclictest0-21swapper/212:00:012
2855774993925,10cyclictest0-21swapper/207:25:282
285577499391,10cyclictest14-21rcu_preempt11:40:002
2855765993934,2cyclictest0-21swapper/009:00:220
2855765993932,4cyclictest0-21swapper/011:15:290
2855765993930,5cyclictest0-21swapper/008:40:300
2855765993918,16cyclictest0-21swapper/008:10:130
2855774993826,7cyclictest0-21swapper/208:10:292
2855774993826,7cyclictest0-21swapper/207:45:012
2855774993825,9cyclictest0-21swapper/207:45:272
2855774993824,9cyclictest0-21swapper/211:40:312
285576999381,31cyclictest2855812-21cat07:10:011
2855765993830,5cyclictest168250irq/118-8000000.ethernet-tx010:25:190
2855765993830,3cyclictest2872894-21sed08:45:300
2855765993830,3cyclictest2872894-21sed08:45:300
2855765993827,7cyclictest0-21swapper/007:45:280
2855765993826,10cyclictest131ktimers/007:10:280
2855765993826,10cyclictest131ktimers/007:10:270
2855765993823,10cyclictest0-21swapper/011:50:310
285576599381,7cyclictest2882515-21latency_hist09:45:000
285576599381,33cyclictest131ktimers/007:20:290
2855774993724,8cyclictest0-21swapper/207:35:312
2855774993723,8cyclictest0-21swapper/212:20:292
2855765993730,4cyclictest2879485-21ps09:25:260
2855765993730,4cyclictest21250irq/208-8000000.ethernet07:35:180
2855765993729,4cyclictest0-21swapper/010:00:290
285576599371,30cyclictest0-21swapper/008:00:110
285576599371,10cyclictest0-21swapper/010:50:020
2855774993627,4cyclictest2856513-21unixbench_singl07:10:272
2855774993627,4cyclictest2856513-21unixbench_singl07:10:272
2855774993626,6cyclictest0-21swapper/210:00:282
2855774993625,6cyclictest0-21swapper/210:25:312
2855774993622,8cyclictest0-21swapper/209:10:302
2855774993622,7cyclictest0-21swapper/211:00:312
2855765993628,5cyclictest2863499-21grep07:50:250
2855765993627,6cyclictest131ktimers/012:25:250
2855765993626,7cyclictest0-21swapper/009:45:280
285576599361,33cyclictest0-21swapper/010:55:150
2855774993527,4cyclictest0-21swapper/212:35:002
2855774993523,8cyclictest0-21swapper/209:35:302
2855774993522,9cyclictest0-21swapper/212:25:292
2855765993529,4cyclictest21250irq/208-8000000.ethernet10:00:010
2855765993529,4cyclictest21250irq/208-8000000.ethernet10:00:010
2855765993527,5cyclictest2866041-21unixbench_multi08:05:310
2855765993524,8cyclictest0-21swapper/011:40:250
285576599352,31cyclictest0-21swapper/011:25:110
285576599351,32cyclictest0-21swapper/011:00:280
2855774993424,7cyclictest2882666-21/usr/sbin/munin09:45:212
2855765993426,6cyclictest131ktimers/007:40:250
2855765993426,5cyclictest131ktimers/007:25:240
2855765993423,6cyclictest0-21swapper/010:10:290
285576599341,30cyclictest1660-21lldpd09:20:000
2855774993321,8cyclictest0-21swapper/207:30:262
2855774993320,9cyclictest0-21swapper/211:25:272
2855765993327,4cyclictest21250irq/208-8000000.ethernet10:40:140
2855765993327,4cyclictest21250irq/208-8000000.ethernet07:30:170
2855765993326,5cyclictest131ktimers/008:30:270
2855765993326,4cyclictest20050irq/27-20000000.i2c09:35:210
2855765993325,6cyclictest131ktimers/012:20:290
2855765993322,7cyclictest0-21swapper/011:45:290
285576599331,30cyclictest131ktimers/008:55:300
285576599330,28cyclictest0-21swapper/008:15:120
2855774993224,4cyclictest0-21swapper/207:55:272
2855774993223,6cyclictest0-21swapper/211:20:282
2855765993226,4cyclictest21050irq/252-8000000.ethernet10:30:230
2855765993224,6cyclictest131ktimers/012:35:300
2855765993224,5cyclictest2864383-21grep07:55:340
2855765993224,4cyclictest2899243-21tail11:20:250
285576599321,25cyclictest0-21swapper/012:15:010
2855765993124,4cyclictest2873342-21lsblk08:50:210
285576599311,4cyclictest2893897-21/usr/sbin/munin10:50:200
285576599311,4cyclictest2869502-21users08:25:290
2855774993017,9cyclictest0-21swapper/209:30:012
2855774993015,10cyclictest0-21swapper/211:30:192
285576599301,25cyclictest2891245-21ssh10:35:180
2855765993012,12cyclictest168250irq/118-8000000.ethernet-tx011:05:020
2855774992919,7cyclictest2907170-21grep12:05:322
285576599291,4cyclictest2900649-21df_inode11:30:180
2855774992816,6cyclictest311ktimers/209:00:152
2855774992718,5cyclictest0-21swapper/212:15:282
2855774992716,8cyclictest2897760-21grep11:10:322
2855774992715,7cyclictest2904081-21ssh11:50:212
285577499271,2cyclictest0-21swapper/207:10:012
285576599261,20cyclictest2855723-21latency_hist07:10:010
2855774992519,3cyclictest0-21swapper/210:50:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional