You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 22:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Nov 20, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63123299856,62cyclictest631169-21apt-get07:10:012
63122699807,45cyclictest21250irq/208-8000000.ethernet11:50:050
631232997533,35cyclictest0-21swapper/211:15:272
631232997533,35cyclictest0-21swapper/211:15:272
631232996861,4cyclictest311ktimers/211:40:022
631232996861,4cyclictest311ktimers/211:40:022
63123299661,59cyclictest1668-21snmpd09:35:442
63122699666,13cyclictest15-21rcuc/010:20:020
631232996528,32cyclictest0-21swapper/211:20:292
631232996115,34cyclictest0-21swapper/209:15:272
631232996115,34cyclictest0-21swapper/209:15:272
63122999611,31cyclictest0-21swapper/111:30:001
63123299594,43cyclictest672065-21tail11:05:262
631232995936,18cyclictest0-21swapper/211:45:002
631232995923,30cyclictest0-21swapper/212:40:012
631232995923,30cyclictest0-21swapper/212:40:012
631232995919,36cyclictest0-21swapper/207:15:002
63123299588,39cyclictest0-21swapper/210:20:282
631232995817,33cyclictest0-21swapper/207:30:282
631232995815,34cyclictest0-21swapper/209:40:312
631226995847,6cyclictest131ktimers/011:10:140
63123299579,27cyclictest0-21swapper/211:55:012
631232995734,15cyclictest0-21swapper/212:05:202
63123299573,10cyclictest667002-21unixbench_multi10:35:292
631232995726,23cyclictest0-21swapper/211:55:272
631232995613,36cyclictest654748-21fschecks_count09:25:182
63123299556,37cyclictest0-21swapper/209:05:262
63123299555,9cyclictest685797-21grep12:25:252
63123299552,13cyclictest650337-21apt-get09:00:162
631232995520,30cyclictest0-21swapper/210:45:262
631232995514,32cyclictest0-21swapper/211:30:322
631232995411,33cyclictest0-21swapper/207:50:292
63123299538,4cyclictest0-21swapper/212:30:262
63123299531,9cyclictest648175-21/usr/sbin/munin08:45:262
631232995313,33cyclictest311ktimers/208:10:282
631226995342,8cyclictest1287-21cron08:50:000
63123299527,35cyclictest0-21swapper/212:10:282
63123299526,37cyclictest0-21swapper/212:20:262
63123299524,11cyclictest653804-21/usr/sbin/munin09:20:182
63123299523,6cyclictest634290-21apt-get07:25:152
63123299521,9cyclictest661713-21/usr/sbin/munin10:05:242
63123299521,43cyclictest664776-21/usr/sbin/munin10:25:252
631232995212,32cyclictest0-21swapper/210:40:192
631232995211,34cyclictest671275-21unixbench_singl11:00:302
63123299518,35cyclictest0-21swapper/211:00:022
63123299512,9cyclictest663583-21/usr/sbin/munin10:15:282
63123299512,9cyclictest649185-21tail08:50:302
63123299512,9cyclictest633453-21apt-get07:20:152
63123299512,42cyclictest0-21swapper/207:55:212
63123299511,9cyclictest658073-21/usr/sbin/munin09:45:202
63123299511,8cyclictest662654-21cut10:10:292
63123299511,44cyclictest0-21swapper/209:55:202
631232995111,31cyclictest0-21swapper/208:30:192
63123299511,10cyclictest675613-21/usr/sbin/munin11:25:312
63122699512,21cyclictest15-21rcuc/009:50:010
63123299506,36cyclictest0-21swapper/211:10:252
63123299503,7cyclictest637398-21head07:40:292
63123299502,10cyclictest669534-21tail10:50:302
63123299501,6cyclictest647565-21grep08:40:252
631232995014,30cyclictest0-21swapper/209:15:012
631232995014,30cyclictest0-21swapper/209:15:012
63123299501,42cyclictest0-21swapper/210:00:162
63123299501,13cyclictest683524-21apt-get12:15:162
631232995010,32cyclictest0-21swapper/207:35:262
63123299492,4cyclictest665767-21fschecks_time10:30:202
63123299492,4cyclictest640466-21irqstats08:00:222
63123299492,10cyclictest681422-21grep12:00:272
63123299491,14cyclictest656081-21sed09:30:282
63123299491,10cyclictest646432-21cut08:35:282
631229994936,9cyclictest0-21swapper/107:10:011
631226994939,5cyclictest661973-21grep10:05:270
63123299483,5cyclictest650111-21cron09:00:012
63123299483,5cyclictest637834-21fschecks_time07:45:232
63123299482,8cyclictest678904-21sed11:45:322
631232994821,24cyclictest642723-21/usr/sbin/munin08:15:242
63123299482,11cyclictest643632-21/usr/sbin/munin08:20:182
631229994835,8cyclictest231ktimers/111:00:171
63122699481,3cyclictest0-21swapper/009:05:090
63123299476,4cyclictest0-21swapper/207:15:132
631226994736,7cyclictest680712-21grep11:55:260
631226994731,11cyclictest0-21swapper/012:20:280
63123299463,7cyclictest0-21swapper/209:50:282
631232994615,25cyclictest0-21swapper/208:25:182
63123299461,10cyclictest641124-21/usr/sbin/munin08:05:182
631229994636,6cyclictest0-21swapper/111:35:271
631229994636,6cyclictest0-21swapper/111:35:271
631229994632,9cyclictest231ktimers/107:50:141
63122699466,10cyclictest640747-21grep08:00:270
631229994537,5cyclictest681644-21munin-plugin-st12:05:001
631229994534,8cyclictest684970-21grep12:20:271
631229994534,7cyclictest231ktimers/109:55:151
631226994537,5cyclictest650124-21sendmail09:00:000
63122699452,36cyclictest0-21swapper/012:00:110
63122699451,3cyclictest0-21swapper/011:35:010
631229994429,9cyclictest0-21swapper/112:20:001
631229994333,4cyclictest0-21swapper/108:15:321
631229994332,7cyclictest656844-21grep09:35:251
631229994331,8cyclictest649183-21grep08:50:291
631226994331,9cyclictest1287-21cron08:54:590
631226994327,10cyclictest0-21swapper/011:30:000
631229994233,5cyclictest168350irq/126-8000000.ethernet-tx110:25:001
631229994230,7cyclictest231ktimers/109:50:151
631229994229,8cyclictest0-21swapper/110:25:281
631229994228,8cyclictest231ktimers/109:15:121
631229994228,8cyclictest231ktimers/109:15:111
631229994227,9cyclictest231ktimers/112:35:141
631229994227,9cyclictest231ktimers/112:35:141
631229994226,10cyclictest0-21swapper/112:30:201
631226994235,4cyclictest21250irq/208-8000000.ethernet07:55:260
631226994233,6cyclictest645841-21grep08:30:270
631226994134,4cyclictest21250irq/208-8000000.ethernet09:15:270
631226994134,4cyclictest21250irq/208-8000000.ethernet09:15:270
631226994134,3cyclictest21050irq/252-8000000.ethernet10:00:110
631226994128,9cyclictest0-21swapper/007:25:010
631226994127,8cyclictest0-21swapper/009:30:290
631229994033,4cyclictest168350irq/126-8000000.ethernet-tx109:00:281
631229994032,4cyclictest669634-21munin-plugin-st10:55:011
631229994026,9cyclictest231ktimers/107:20:111
631226994016,12cyclictest131ktimers/009:25:120
63122699401,37cyclictest0-21swapper/008:35:220
63122699401,30cyclictest660537-21latency_hist10:00:010
63122699401,26cyclictest665916-1kworker/0:2H+kblockd10:45:010
631229993930,5cyclictest0-21swapper/108:05:281
631229993929,7cyclictest231ktimers/111:10:111
631229993927,7cyclictest679025-21gpgv11:50:021
63122999391,31cyclictest0-21swapper/108:30:251
631226993932,4cyclictest0-21swapper/010:50:210
631226993927,8cyclictest0-21swapper/009:15:000
631226993927,8cyclictest0-21swapper/009:15:000
631226993927,8cyclictest0-21swapper/007:25:280
631226993925,10cyclictest0-21swapper/011:15:210
631226993925,10cyclictest0-21swapper/011:15:210
63122699391,2cyclictest204-21pr/ttyS209:25:000
631229993831,4cyclictest645063-21munin-plugin-st08:30:001
631229993829,5cyclictest0-21swapper/109:05:241
631229993828,6cyclictest666158-21grep10:30:281
631229993828,5cyclictest650067-21grep08:55:291
631229993827,7cyclictest0-21swapper/110:44:591
631229993825,7cyclictest662830-21grep10:10:321
631229993816,11cyclictest658019-21/usr/sbin/munin09:45:221
63122999381,30cyclictest682382-21unixbench_multi12:05:281
631226993828,6cyclictest0-21swapper/007:50:270
63122699382,24cyclictest628783-21kworker/u8:4+events_power_efficient07:30:140
631226993817,15cyclictest131ktimers/012:35:140
631226993817,15cyclictest131ktimers/012:35:130
631229993727,7cyclictest231ktimers/107:15:151
631229993725,7cyclictest634838-21grep07:25:271
631229993723,9cyclictest0-21swapper/110:05:281
63122999371,11cyclictest0-21swapper/112:30:011
63122699379,26cyclictest15-21rcuc/011:45:310
63122699373,6cyclictest0-21swapper/011:05:000
631226993727,6cyclictest677204-21grep11:35:270
631226993727,6cyclictest677204-21grep11:35:270
631226993726,8cyclictest0-21swapper/010:30:280
631226993725,7cyclictest647539-21grep08:40:250
631226993723,10cyclictest0-21swapper/007:50:010
631226993721,12cyclictest0-21swapper/012:10:210
631226993718,9cyclictest131ktimers/007:10:050
63122699371,32cyclictest685768-21unixbench_multi12:25:260
631229993625,6cyclictest231ktimers/109:40:151
631229993621,8cyclictest0-21swapper/111:55:271
631229993620,11cyclictest231ktimers/111:30:141
63122699363,5cyclictest650974-21munin-run09:05:000
631226993630,4cyclictest21250irq/208-8000000.ethernet07:40:290
631226993629,4cyclictest0-21swapper/010:35:240
631226993627,6cyclictest15-21rcuc/009:40:150
631226993626,7cyclictest644116-21grep08:20:310
631226993619,10cyclictest0-21swapper/012:35:010
63122699361,33cyclictest0-21swapper/010:55:240
631229993523,9cyclictest0-21swapper/112:15:011
63122999351,28cyclictest0-21swapper/110:55:191
63122999351,28cyclictest0-21swapper/107:40:141
63122999351,27cyclictest0-21swapper/107:30:181
63122699359,24cyclictest0-21swapper/010:45:190
631226993526,5cyclictest0-21swapper/012:15:180
63122699351,8cyclictest642788-21ssh08:15:210
63122699351,4cyclictest0-21swapper/007:40:000
63122699351,2cyclictest0-21swapper/009:40:000
631229993428,3cyclictest168350irq/126-8000000.ethernet-tx108:10:161
631229993427,4cyclictest0-21swapper/111:55:011
631229993426,4cyclictest668728-21unixbench_singl10:45:271
631229993418,8cyclictest0-21swapper/111:20:021
631229993418,8cyclictest0-21swapper/111:20:011
63122999341,27cyclictest652015-21/usr/sbin/munin09:10:261
63122999341,27cyclictest652015-21/usr/sbin/munin09:10:261
63122999341,27cyclictest0-21swapper/107:55:101
631226993429,3cyclictest21250irq/208-8000000.ethernet11:05:200
631226993428,4cyclictest21250irq/208-8000000.ethernet08:10:270
631226993427,4cyclictest0-21swapper/011:20:160
631226993424,6cyclictest662767-21grep10:10:310
63122699342,26cyclictest0-21swapper/010:25:020
631229993326,4cyclictest0-21swapper/111:40:221
631229993324,5cyclictest0-21swapper/107:45:271
631229993324,5cyclictest0-21swapper/107:10:221
631229993323,6cyclictest231ktimers/110:35:111
631229993320,7cyclictest643583-21/usr/sbin/munin08:20:281
63122699334,5cyclictest15-21rcuc/008:10:000
631226993327,4cyclictest20050irq/27-20000000.i2c09:50:290
631226993326,4cyclictest20050irq/27-20000000.i2c08:25:210
631229993226,4cyclictest646960-21/usr/sbin/munin08:40:251
631229993224,5cyclictest0-21swapper/109:25:251
631229993221,7cyclictest0-21swapper/108:39:591
63122999321,25cyclictest0-21swapper/109:20:171
631226993225,4cyclictest682385-21tail12:05:280
631226993225,4cyclictest20050irq/27-20000000.i2c11:40:170
63122999312,5cyclictest655784-21meminfo09:30:241
63122999311,25cyclictest0-21swapper/110:00:161
631229993111,14cyclictest168350irq/126-8000000.ethernet-tx110:15:161
631226993125,4cyclictest21250irq/208-8000000.ethernet10:25:240
63122699312,21cyclictest631258-21latency_hist07:10:000
63122699311,4cyclictest275-21systemd-journal07:15:020
631229993020,7cyclictest0-21swapper/108:45:241
631229993016,9cyclictest0-21swapper/108:00:201
631229992923,4cyclictest0-21swapper/111:05:241
63122999281,3cyclictest674382-21/usr/sbin/munin11:20:231
631229992719,4cyclictest0-21swapper/107:35:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional