You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Nov 20, 2025 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
192035991061,67cyclictest0-21swapper/119:50:001
19203399823,52cyclictest0-21swapper/020:50:010
192035997666,6cyclictest22-21rcuc/121:35:021
192037997365,5cyclictest0-21swapper/222:35:012
192037997365,5cyclictest0-21swapper/222:35:012
192037996452,8cyclictest240823-21sh00:25:002
19203799592,28cyclictest30-21rcuc/223:40:162
192035995617,33cyclictest0-21swapper/120:25:271
192035995617,33cyclictest0-21swapper/120:25:271
192037995545,6cyclictest203958-21munin-plugin-st20:50:002
192037995313,20cyclictest30-21rcuc/200:05:022
192037995238,9cyclictest202262-21sendmail20:40:002
192037995137,9cyclictest1287-21cron23:10:002
192035995142,5cyclictest215309-21apt-key21:55:011
19203599501,33cyclictest236793-21fschecks_count00:00:191
192033995042,4cyclictest210005-21unixbench_singl21:20:270
192033995016,31cyclictest0-21swapper/020:10:290
192033995016,31cyclictest0-21swapper/020:10:290
192035994934,11cyclictest0-21swapper/100:00:011
192033994943,4cyclictest0-21swapper/023:35:110
19203599487,32cyclictest0-21swapper/100:15:241
19203599487,32cyclictest0-21swapper/100:15:241
192035994833,11cyclictest198886-21munin-plugin-st20:20:001
19203399481,4cyclictest0-21swapper/021:50:200
19203599478,4cyclictest192447-21meminfo19:15:021
192033994734,8cyclictest0-21swapper/021:45:250
192033994713,3cyclictest0-21swapper/000:00:010
192037994640,4cyclictest311ktimers/222:45:012
192037994637,5cyclictest239966-21munin-plugin-st00:20:002
192037994637,5cyclictest239966-21munin-plugin-st00:20:002
192035994636,5cyclictest168350irq/126-8000000.ethernet-tx123:35:251
192035994632,9cyclictest0-21swapper/100:25:261
192037994531,11cyclictest0-21swapper/222:50:002
192037994531,11cyclictest0-21swapper/222:49:592
192035994525,11cyclictest0-21swapper/122:00:001
192037994424,13cyclictest311ktimers/223:20:102
192035994430,8cyclictest203063-21grep20:40:301
192037994331,8cyclictest0-21swapper/222:50:272
192035994332,7cyclictest230401-21grep23:20:271
192035994324,10cyclictest0-21swapper/122:25:271
19203399438,27cyclictest15-21rcuc/019:15:020
192033994330,8cyclictest0-21swapper/021:25:320
192033994330,8cyclictest0-21swapper/019:35:010
192033994326,14cyclictest233259-21cpu23:40:130
192037994233,5cyclictest168450irq/134-8000000.ethernet-tx222:10:212
192037994231,9cyclictest311ktimers/219:40:012
192035994233,6cyclictest0-21swapper/122:10:001
192033994235,4cyclictest243349-21latency_hist00:40:000
192033994234,5cyclictest21250irq/208-8000000.ethernet23:30:280
192033994234,5cyclictest21250irq/208-8000000.ethernet23:30:280
192033994234,4cyclictest21250irq/208-8000000.ethernet00:15:270
192033994234,4cyclictest21250irq/208-8000000.ethernet00:15:270
192033994228,10cyclictest0-21swapper/021:40:260
19203399421,8cyclictest0-21swapper/023:30:010
19203399421,6cyclictest205664-21sed20:55:260
192037994132,5cyclictest210005-21unixbench_singl21:20:272
192037994121,14cyclictest311ktimers/222:55:172
192035994124,9cyclictest0-21swapper/120:00:361
192033994129,8cyclictest0-21swapper/022:15:290
192033994129,8cyclictest0-21swapper/022:15:290
192033994128,9cyclictest0-21swapper/023:05:280
192033994127,9cyclictest0-21swapper/000:05:290
19203799403,5cyclictest275-21systemd-journal22:25:262
192037994030,7cyclictest232064-21grep23:30:292
192037994030,7cyclictest232064-21grep23:30:282
192037994029,7cyclictest232929-21grep23:35:262
192037994028,8cyclictest0-21swapper/223:15:202
192037994028,8cyclictest0-21swapper/223:15:202
19203799401,9cyclictest0-21swapper/220:55:012
19203799401,28cyclictest197185-21kworker/u8:1+events_power_efficient21:11:202
19203599406,15cyclictest22-21rcuc/121:15:011
192035994031,5cyclictest168350irq/126-8000000.ethernet-tx120:50:241
192035994030,5cyclictest168350irq/126-8000000.ethernet-tx123:15:181
192035994030,5cyclictest168350irq/126-8000000.ethernet-tx123:15:181
192035994028,8cyclictest0-21swapper/121:15:271
192035994023,8cyclictest0-21swapper/123:45:311
192035994023,8cyclictest0-21swapper/123:45:301
192033994018,19cyclictest192208-21latency_hist19:15:010
19203399401,34cyclictest0-21swapper/021:20:020
19203399401,2cyclictest0-21swapper/020:40:000
192037993935,2cyclictest0-21swapper/221:05:192
192037993930,4cyclictest0-21swapper/219:56:442
192037993923,12cyclictest311ktimers/200:10:152
192035993932,4cyclictest168350irq/126-8000000.ethernet-tx123:50:151
192035993926,8cyclictest0-21swapper/122:15:281
192035993926,8cyclictest0-21swapper/122:15:281
192035993923,8cyclictest0-21swapper/121:05:291
192033993932,4cyclictest21250irq/208-8000000.ethernet22:55:210
192033993931,5cyclictest200463-21grep20:25:290
192033993931,5cyclictest200463-21grep20:25:290
192033993930,6cyclictest0-21swapper/021:05:150
192033993925,9cyclictest0-21swapper/022:05:210
19203399391,7cyclictest0-21swapper/022:50:010
19203399391,7cyclictest0-21swapper/022:50:010
19203399391,4cyclictest0-21swapper/020:05:210
192037993827,8cyclictest0-21swapper/220:44:272
192035993831,4cyclictest168350irq/126-8000000.ethernet-tx123:40:221
192035993831,4cyclictest168350irq/126-8000000.ethernet-tx120:35:291
192035993830,4cyclictest168350irq/126-8000000.ethernet-tx120:20:261
192035993827,7cyclictest0-21swapper/120:55:251
192035993827,6cyclictest0-21swapper/121:20:261
192035993825,9cyclictest0-21swapper/100:05:271
19203599382,4cyclictest0-21swapper/119:15:021
192033993832,4cyclictest168250irq/118-8000000.ethernet-tx020:30:210
192033993829,6cyclictest131ktimers/020:15:290
192033993828,7cyclictest0-21swapper/021:30:200
192033993826,9cyclictest0-21swapper/021:10:300
192033993826,8cyclictest0-21swapper/020:45:270
192033993826,8cyclictest0-21swapper/000:00:280
192033993826,7cyclictest0-21swapper/023:00:290
192033993826,7cyclictest0-21swapper/023:00:290
192033993825,8cyclictest0-21swapper/021:00:290
192033993825,8cyclictest0-21swapper/020:40:290
192033993824,9cyclictest0-21swapper/022:20:280
192037993730,3cyclictest209015-21unixbench_multi21:15:262
192037993729,5cyclictest212618-21unixbench_singl21:35:282
192037993726,6cyclictest206479-21unixbench_multi21:00:292
192037993724,7cyclictest0-21swapper/221:35:012
192037993720,9cyclictest0-21swapper/220:15:002
192037993720,9cyclictest0-21swapper/220:15:002
192035993730,4cyclictest222898-21sendmail22:40:001
192035993729,5cyclictest231ktimers/100:40:001
192035993728,5cyclictest0-21swapper/123:05:001
192035993728,5cyclictest0-21swapper/123:04:591
192035993723,9cyclictest0-21swapper/122:00:221
192035993723,9cyclictest0-21swapper/122:00:221
19203599371,29cyclictest0-21swapper/123:05:241
192033993724,8cyclictest0-21swapper/022:00:310
192033993724,8cyclictest0-21swapper/022:00:310
192033993724,10cyclictest131ktimers/022:40:190
192033993723,9cyclictest0-21swapper/022:30:290
192033993723,9cyclictest0-21swapper/022:30:280
192033993723,9cyclictest0-21swapper/019:56:390
192033993722,9cyclictest0-21swapper/023:15:280
192033993722,9cyclictest0-21swapper/023:15:280
19203799363,5cyclictest193375-21apt-get19:35:002
192037993623,9cyclictest0-21swapper/220:00:242
192037993622,7cyclictest0-21swapper/221:40:272
192037993621,7cyclictest199633-21grep20:20:302
19203799361,27cyclictest275-21systemd-journal22:05:232
192035993629,4cyclictest168350irq/126-8000000.ethernet-tx100:10:221
192035993628,4cyclictest168350irq/126-8000000.ethernet-tx122:55:271
192035993620,9cyclictest0-21swapper/123:10:281
192035993620,8cyclictest0-21swapper/100:20:281
19203399362,8cyclictest241030-21apt-get00:25:120
192033993626,7cyclictest0-21swapper/023:20:270
192033993626,7cyclictest0-21swapper/022:29:590
192033993626,6cyclictest0-21swapper/000:20:280
192033993624,8cyclictest0-21swapper/022:50:280
19203399361,3cyclictest0-21swapper/000:10:160
19203399361,28cyclictest131ktimers/019:50:080
192037993527,4cyclictest219507-21latency_hist22:20:002
192037993527,4cyclictest219507-21latency_hist22:20:002
192037993527,4cyclictest0-21swapper/221:45:262
192037993523,8cyclictest0-21swapper/221:55:292
192037993522,6cyclictest0-21swapper/220:15:292
192037993517,8cyclictest0-21swapper/223:55:192
192035993528,4cyclictest168350irq/126-8000000.ethernet-tx123:30:271
192035993528,4cyclictest168350irq/126-8000000.ethernet-tx123:30:271
192035993528,4cyclictest168350irq/126-8000000.ethernet-tx119:58:201
192035993519,8cyclictest0-21swapper/121:35:011
192033993527,4cyclictest20050irq/27-20000000.i2c00:30:310
192033993527,4cyclictest20050irq/27-20000000.i2c00:30:310
19203399351,7cyclictest218751-21latency_hist22:15:010
192037993424,5cyclictest0-21swapper/220:30:242
192037993421,6cyclictest0-21swapper/223:05:002
192037993421,6cyclictest0-21swapper/223:05:002
192037993418,6cyclictest0-21swapper/222:00:302
192037993418,6cyclictest0-21swapper/222:00:292
192035993425,5cyclictest0-21swapper/120:05:301
192035993424,7cyclictest231ktimers/120:10:161
192035993424,7cyclictest231ktimers/120:10:161
192035993422,8cyclictest0-21swapper/120:50:011
192033993427,4cyclictest21250irq/208-8000000.ethernet23:10:150
192033993423,7cyclictest0-21swapper/022:35:280
192033993423,6cyclictest0-21swapper/023:45:330
192033993423,6cyclictest0-21swapper/023:45:330
192033993422,8cyclictest0-21swapper/021:35:280
192033993421,8cyclictest0-21swapper/020:20:310
192037993322,6cyclictest0-21swapper/223:15:012
192037993321,6cyclictest0-21swapper/223:30:012
19203799331,3cyclictest0-21swapper/219:25:002
192037993313,13cyclictest311ktimers/221:50:152
192035993320,7cyclictest168350irq/126-8000000.ethernet-tx123:25:201
19203599331,26cyclictest0-21swapper/122:40:301
19203599331,26cyclictest0-21swapper/121:00:161
19203799325,21cyclictest30-21rcuc/219:25:462
192037993223,6cyclictest205082-21/usr/sbin/munin20:55:152
19203799322,25cyclictest0-21swapper/219:45:462
192037993220,7cyclictest1668-21snmpd23:51:252
192037993220,6cyclictest0-21swapper/200:25:212
192035993225,4cyclictest168350irq/126-8000000.ethernet-tx120:30:151
192035993221,7cyclictest0-21swapper/121:25:301
19203599321,2cyclictest0-21swapper/122:15:011
192033993227,4cyclictest0-21swapper/019:40:010
19203399321,28cyclictest15-21rcuc/021:55:260
19203799312,7cyclictest30-21rcuc/219:10:012
192037993123,4cyclictest0-21swapper/222:20:282
19203799311,27cyclictest242707-21/usr/sbin/munin00:35:252
192035993122,6cyclictest214341-21sshd21:47:201
192035993117,8cyclictest0-21swapper/122:50:271
19203599311,24cyclictest0-21swapper/122:45:251
19203599311,24cyclictest0-21swapper/122:45:251
19203399311,25cyclictest234916-21apt23:50:140
192037993020,7cyclictest0-21swapper/200:35:012
192037993020,7cyclictest0-21swapper/200:35:012
19203799301,24cyclictest311ktimers/222:36:502
192035993022,4cyclictest0-21swapper/119:51:591
19203599301,24cyclictest0-21swapper/119:25:101
19203599301,24cyclictest0-21swapper/119:20:021
19203399301,2cyclictest0-21swapper/019:30:020
19203399301,24cyclictest0-21swapper/020:00:020
192037992921,5cyclictest0-21swapper/219:15:012
192035992920,5cyclictest0-21swapper/119:35:001
192035992918,7cyclictest0-21swapper/122:20:281
192035992917,7cyclictest1668-21snmpd21:41:201
19203399291,4cyclictest192947-21munin-run19:25:010
192037992824,2cyclictest0-21swapper/223:45:272
192037992824,2cyclictest0-21swapper/223:45:272
192037992819,5cyclictest30-21rcuc/219:20:002
19203799281,25cyclictest0-21swapper/200:05:212
192035992823,3cyclictest0-21swapper/100:30:191
192035992823,3cyclictest0-21swapper/100:30:191
19203599281,4cyclictest0-21swapper/122:35:011
19203599281,4cyclictest0-21swapper/122:35:011
192033992822,4cyclictest21250irq/208-8000000.ethernet19:49:590
192037992716,9cyclictest0-21swapper/220:30:012
192037992716,9cyclictest0-21swapper/220:30:012
192035992720,5cyclictest845-21systemd-logind19:43:511
192035992720,5cyclictest845-21systemd-logind19:43:511
19203399271,24cyclictest0-21swapper/019:41:330
19203399271,24cyclictest0-21swapper/019:41:330
19203799263,17cyclictest196893-21phc2sys20:05:272
192037992620,4cyclictest0-21swapper/221:28:242
192037992519,4cyclictest14-21rcu_preempt19:45:012
192037992519,4cyclictest14-21rcu_preempt19:45:012
192037992511,11cyclictest311ktimers/219:50:122
192035992518,5cyclictest275-21systemd-journal19:36:511
19203399252,6cyclictest191994-21latency_hist19:10:000
192035992116,3cyclictest191994-21latency_hist19:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional