You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 05:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Tue Sep 15, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2677320998310,54cyclictest0-21swapper/020:15:000
2677327998023,53cyclictest0-21swapper/320:15:013
2677325997311,30cyclictest30-21rcuc/220:45:192
267732099721,62cyclictest0-21swapper/023:00:160
2677320996620,42cyclictest2680059-21grep19:20:270
267732099661,32cyclictest0-21swapper/022:45:010
2677320996524,36cyclictest0-21swapper/020:20:260
267732099651,51cyclictest0-21swapper/019:25:130
2677320996423,36cyclictest0-21swapper/021:50:260
267732099641,35cyclictest0-21swapper/020:55:010
267732099641,35cyclictest0-21swapper/020:55:000
267732099631,56cyclictest0-21swapper/019:45:140
267732599619,18cyclictest2684768-21/usr/sbin/munin19:50:192
2677320996125,32cyclictest0-21swapper/023:40:280
267732099611,57cyclictest2716802-21sshd22:56:360
267732099611,55cyclictest0-21swapper/022:35:140
267732099611,55cyclictest0-21swapper/020:05:140
267732099611,23cyclictest2681604-21memory19:30:240
267732099603,42cyclictest20850irq/208-8000000.ethernet20:00:140
267732099602,55cyclictest0-21swapper/022:10:190
267732099602,28cyclictest2732133-21apt-get00:30:010
267732099601,19cyclictest0-21swapper/022:35:010
267732099593,50cyclictest0-21swapper/019:40:240
267732099593,50cyclictest0-21swapper/019:40:240
2677320995926,28cyclictest0-21swapper/020:30:290
267732099592,54cyclictest2727845-21head00:00:290
267732099592,54cyclictest2727845-21head00:00:290
267732099591,56cyclictest0-21swapper/019:35:170
267732099591,54cyclictest0-21swapper/023:30:130
267732099591,54cyclictest0-21swapper/021:30:010
267732099591,31cyclictest2692367-21apt-get20:35:140
267732099591,31cyclictest2692367-21apt-get20:35:140
2677325995850,5cyclictest2732137-21munin-plugin-st00:30:002
2677325995850,5cyclictest2732137-21munin-plugin-st00:30:002
267732499577,43cyclictest0-21swapper/121:40:011
267732099572,52cyclictest2732431-21cpu00:30:170
267732099562,31cyclictest2732211-21latency_hist00:30:010
267732099561,50cyclictest0-21swapper/023:05:130
267732099561,48cyclictest0-21swapper/019:15:150
267732099561,48cyclictest0-21swapper/019:15:150
267732099561,29cyclictest2704449-21diskstats21:45:180
2677320995612,14cyclictest0-21swapper/021:25:010
267732099553,48cyclictest2694672-21/usr/sbin/munin20:45:280
2677320995532,19cyclictest20650irq/252-8000000.ethernet21:05:220
2677320995523,28cyclictest0-21swapper/020:40:300
267732099551,50cyclictest2723574-21cron23:40:000
267732099551,49cyclictest0-21swapper/022:05:010
2677320995429,20cyclictest0-21swapper/023:15:250
2677320995424,27cyclictest0-21swapper/023:10:150
267732099541,51cyclictest2701970-21if_err_eth121:30:230
267732099541,28cyclictest2730723-21fschecks_count00:20:200
2677324995343,6cyclictest2705818-21grep21:50:281
2677320995331,18cyclictest20850irq/208-8000000.ethernet19:10:020
2677320995325,26cyclictest2726882-21mailstats23:55:260
267732099532,46cyclictest0-21swapper/021:55:130
267732099531,49cyclictest0-21swapper/021:10:250
267732099523,44cyclictest2724725-21apt-get23:45:050
2677320995228,20cyclictest0-21swapper/000:35:280
267732099522,47cyclictest2703659-21lsblk21:40:200
267732099522,46cyclictest2702792-21/usr/sbin/munin21:35:210
267732099522,46cyclictest2678129-21unixbench_singl19:10:290
267732099521,28cyclictest2710346-21df22:20:160
267732099521,12cyclictest2715956-21users22:50:290
2677325995137,9cyclictest1283-21cron00:09:592
267732499511,24cyclictest0-21swapper/121:05:011
267732099514,36cyclictest2689621-21cron20:20:000
267732099512,47cyclictest0-21swapper/020:00:010
267732099512,42cyclictest2726301-21latency_hist23:55:010
2677320995120,26cyclictest0-21swapper/019:55:010
267732099511,25cyclictest2690754-21df_inode20:25:170
267732599507,34cyclictest2700433-21find21:20:272
2677325995028,16cyclictest311ktimers/219:20:142
2677324995025,9cyclictest0-21swapper/123:50:151
2677320995034,13cyclictest20650irq/252-8000000.ethernet22:25:150
267732099503,40cyclictest20850irq/208-8000000.ethernet00:05:130
267732099501,46cyclictest0-21swapper/021:15:150
2677324994915,13cyclictest2718719-21/usr/sbin/munin23:10:171
2677324994915,11cyclictest2701458-21apt-get21:30:011
267732499491,33cyclictest0-21swapper/122:45:011
2677320994928,18cyclictest20850irq/208-8000000.ethernet23:25:140
267732099491,24cyclictest2720721-21meminfo23:20:270
267732099491,24cyclictest2720721-21meminfo23:20:270
267732099491,24cyclictest0-21swapper/000:15:010
267732099484,40cyclictest2696063-21/usr/sbin/munin20:55:250
267732099483,41cyclictest2730315-21grep00:15:280
267732099481,44cyclictest2696804-21/usr/sbin/munin21:00:230
2677324994728,14cyclictest0-21swapper/122:50:281
267732099472,41cyclictest2709826-21/usr/sbin/munin22:15:240
267732099472,41cyclictest2708023-21/usr/sbin/munin22:05:240
2677324994616,20cyclictest0-21swapper/120:40:011
2677324994616,20cyclictest0-21swapper/120:40:001
2677324994531,9cyclictest0-21swapper/123:45:001
267732099451,20cyclictest2714572-21df_inode22:45:160
2677325994424,15cyclictest311ktimers/223:00:122
2677324994437,4cyclictest2681945-21munin-plugin-st19:35:011
2677324994432,8cyclictest0-21swapper/122:10:281
2677324994426,10cyclictest0-21swapper/119:25:291
2677324994414,19cyclictest2698282-21/usr/sbin/munin21:10:201
2677325994324,14cyclictest311ktimers/220:30:142
2677324994335,5cyclictest231ktimers/119:55:211
2677325994228,9cyclictest0-21swapper/221:55:002
2677324994228,8cyclictest0-21swapper/121:55:291
2677324994228,8cyclictest0-21swapper/121:45:251
267732499414,12cyclictest22-21rcuc/123:30:001
2677324994133,5cyclictest231ktimers/122:35:251
2677325994022,9cyclictest0-21swapper/222:25:252
2677324994028,8cyclictest0-21swapper/120:30:291
2677324994028,8cyclictest0-21swapper/120:15:291
267732499401,29cyclictest0-21swapper/121:25:011
2677325993931,4cyclictest0-21swapper/200:40:012
2677325993925,8cyclictest0-21swapper/221:20:002
2677324993926,8cyclictest0-21swapper/123:55:191
2677324993923,9cyclictest0-21swapper/123:15:271
2677324993923,10cyclictest0-21swapper/100:05:021
2677324993923,10cyclictest0-21swapper/100:05:011
2677324993921,10cyclictest0-21swapper/120:55:261
2677324993826,6cyclictest0-21swapper/119:10:241
2677324993825,5cyclictest0-21swapper/119:40:231
2677324993825,5cyclictest0-21swapper/119:40:231
2677324993823,9cyclictest0-21swapper/123:35:281
2677325993730,4cyclictest167550irq/134-8000000.ethernet-tx222:40:002
2677325993725,7cyclictest2720220-21sendmail23:20:002
2677324993723,9cyclictest0-21swapper/120:40:311
2677324993721,10cyclictest0-21swapper/120:45:281
267732599365,4cyclictest2660796-21kworker/u8:1-events_freezable_power_19:11:182
2677325993627,4cyclictest0-21swapper/223:30:292
2677325993626,6cyclictest0-21swapper/222:05:282
2677325993626,5cyclictest0-21swapper/219:40:012
2677325993625,7cyclictest0-21swapper/223:55:272
2677325993617,15cyclictest311ktimers/220:15:122
267732599360,8cyclictest0-21swapper/200:05:012
267732599360,8cyclictest0-21swapper/200:05:012
2677324993627,6cyclictest231ktimers/120:10:201
2677324993625,7cyclictest2722690-21unixbench_singl23:30:291
2677324993621,8cyclictest0-21swapper/119:25:011
2677325993526,5cyclictest2706700-21grep22:00:002
2677325993525,5cyclictest2707449-21grep22:00:292
2677325993524,6cyclictest0-21swapper/221:30:302
2677325993518,13cyclictest311ktimers/200:20:132
2677324993526,4cyclictest0-21swapper/100:25:201
2677324993526,4cyclictest0-21swapper/100:25:201
2677324993524,6cyclictest231ktimers/100:10:261
2677324993520,8cyclictest0-21swapper/100:20:291
267732499351,29cyclictest0-21swapper/122:00:181
267732499351,28cyclictest2710292-21/usr/sbin/munin22:20:251
267732499351,28cyclictest2689845-21/usr/sbin/munin20:20:251
2677325993427,5cyclictest2703223-21cron21:40:002
2677325993421,9cyclictest0-21swapper/222:50:002
2677325993419,11cyclictest0-21swapper/219:15:272
2677325993419,11cyclictest0-21swapper/219:15:272
2677325993413,15cyclictest311ktimers/222:10:112
2677324993426,6cyclictest231ktimers/123:20:151
2677324993426,6cyclictest231ktimers/123:20:151
2677324993426,5cyclictest231ktimers/122:35:011
2677324993426,5cyclictest231ktimers/119:40:011
2677324993426,5cyclictest231ktimers/100:05:281
2677324993425,5cyclictest231ktimers/123:05:001
2677324993425,4cyclictest0-21swapper/120:00:221
2677324993423,7cyclictest231ktimers/121:30:061
2677324993423,4cyclictest0-21swapper/120:25:201
2677324993419,7cyclictest0-21swapper/100:15:271
2677324993413,13cyclictest22-21rcuc/119:50:001
2677325993326,4cyclictest14-21rcu_preempt20:00:222
2677325993317,12cyclictest311ktimers/223:40:142
267732599331,27cyclictest0-21swapper/220:25:172
2677324993327,4cyclictest231ktimers/122:45:191
2677324993326,4cyclictest231ktimers/122:55:211
2677324993324,6cyclictest231ktimers/123:10:001
2677324993324,4cyclictest231ktimers/121:40:271
2677324993323,6cyclictest231ktimers/119:15:051
2677324993323,6cyclictest231ktimers/119:15:041
2677324993322,7cyclictest0-21swapper/122:15:261
2677324993321,7cyclictest22-21rcuc/121:00:221
2677324993317,11cyclictest231ktimers/100:35:291
2677325993215,8cyclictest0-21swapper/221:25:212
267732599321,25cyclictest0-21swapper/220:10:242
2677325993211,6cyclictest8321systemd-network23:10:062
2677324993224,6cyclictest231ktimers/121:15:231
2677324993223,5cyclictest0-21swapper/123:45:211
2677324993220,6cyclictest231ktimers/122:05:241
267732499321,25cyclictest0-21swapper/120:07:551
267732599319,4cyclictest832-21systemd-network22:52:252
2677325993121,6cyclictest0-21swapper/221:00:282
2677325993119,7cyclictest0-21swapper/220:05:212
2677324993124,5cyclictest231ktimers/122:25:231
2677324993123,6cyclictest231ktimers/100:30:231
2677325993021,6cyclictest2711969-21/usr/sbin/munin22:30:292
2677325993021,6cyclictest0-21swapper/222:25:002
2677325993018,8cyclictest0-21swapper/200:15:002
2677325993016,5cyclictest2725363-21apt23:50:002
2677324993023,5cyclictest231ktimers/120:50:261
2677324993023,5cyclictest231ktimers/120:50:261
2677324993020,7cyclictest231ktimers/119:55:001
267732599295,11cyclictest30-21rcuc/222:45:022
267732599292,6cyclictest832-21systemd-network00:18:222
2677325992922,4cyclictest2684454-21tail19:45:272
2677325992920,4cyclictest0-21swapper/223:50:292
2677325992918,7cyclictest0-21swapper/222:55:222
2677325992918,6cyclictest0-21swapper/220:50:202
2677325992918,6cyclictest0-21swapper/220:50:202
2677325992917,8cyclictest0-21swapper/221:45:212
2677325992914,10cyclictest311ktimers/219:30:142
2677324992915,9cyclictest0-21swapper/119:10:011
267732599288,16cyclictest30-21rcuc/220:55:112
2677325992822,4cyclictest0-21swapper/200:30:492
2677325992821,3cyclictest0-21swapper/223:35:202
2677325992820,6cyclictest2690488-21cut20:25:012
2677325992820,5cyclictest0-21swapper/220:40:232
2677325992819,7cyclictest2721892-21sshd23:29:362
2677325992816,8cyclictest0-21swapper/222:20:012
2677325992816,4cyclictest0-21swapper/223:20:232
2677325992816,4cyclictest0-21swapper/223:20:232
267732599281,25cyclictest0-21swapper/221:07:512
267732599281,25cyclictest0-21swapper/220:35:272
267732599281,25cyclictest0-21swapper/220:35:272
2677325992719,4cyclictest0-21swapper/219:25:222
2677325992714,8cyclictest0-21swapper/219:55:302
2677325992713,10cyclictest0-21swapper/221:40:202
267732599271,24cyclictest0-21swapper/223:08:222
2677325992617,4cyclictest0-21swapper/219:40:292
2677325992617,4cyclictest0-21swapper/219:40:292
2677325992610,11cyclictest311ktimers/221:10:142
2677325992115,4cyclictest311ktimers/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional