You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 17:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 04, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
435367995951,5cyclictest515623-21munin-plugin-st11:00:000
435371995545,6cyclictest457884-21grep08:10:251
435371995137,10cyclictest231ktimers/112:20:121
435371994835,10cyclictest231ktimers/111:20:101
435380994736,7cyclictest391ktimers/310:55:123
43536799464,11cyclictest11-21ksoftirqd/012:20:120
435367994623,5cyclictest131rcu_preempt07:30:130
435371994535,6cyclictest506415-21unixbench_multi10:30:241
435376994437,4cyclictest444626-21cron07:35:002
435380994336,4cyclictest439455-21latency_hist07:20:013
435376994330,10cyclictest311ktimers/208:15:142
435367994337,3cyclictest501569-21sendmail10:20:010
435367994336,5cyclictest482354-21kworker/u8:2+events_unbound09:30:400
435367994335,4cyclictest539917-21sh12:10:010
435367994236,4cyclictest487477-21cron09:40:000
43536799423,10cyclictest11-21ksoftirqd/007:35:130
435367994224,6cyclictest498013-21kworker/u8:2+events_unbound10:10:130
435380994133,4cyclictest0-21swapper/307:40:003
435376994132,6cyclictest491122-21munin-plugin-st09:50:002
435371994133,5cyclictest442939-21ls07:30:001
435367994134,4cyclictest491119-21latency_hist09:50:000
435367994133,6cyclictest492760-21kworker/u8:1+events_unbound10:05:430
43538099408,15cyclictest40-21ksoftirqd/310:15:153
435380994032,4cyclictest539921-21sh12:10:003
435380994031,6cyclictest391ktimers/310:05:123
435380994018,12cyclictest131rcu_preempt10:40:113
435380994013,7cyclictest131rcu_preempt08:00:133
435380994013,7cyclictest131rcu_preempt08:00:133
435376994034,4cyclictest439279-21kworker/u8:3+events_unbound07:20:052
435376994031,6cyclictest464636-21unixbench_multi08:30:242
435380993933,4cyclictest524053-21kworker/u8:0+events_unbound12:01:083
435380993933,4cyclictest477207-21kworker/u8:3+events_unbound09:50:423
435380993931,6cyclictest503324-21kworker/u8:0+events_unbound10:30:473
435376993930,6cyclictest514338-21fschecks_time10:55:182
435371993929,7cyclictest501828-21latency_hist10:20:011
435371993928,7cyclictest0-21swapper/108:55:011
43536799394,10cyclictest11-21ksoftirqd/008:40:130
435367993932,4cyclictest480691-21sendmail09:20:010
435380993826,5cyclictest131rcu_preempt12:30:263
435376993828,6cyclictest0-21swapper/209:05:362
435371993831,4cyclictest473825-21cron09:00:011
435371993831,4cyclictest473825-21cron09:00:001
435371993829,4cyclictest0-21swapper/111:10:011
435371993828,5cyclictest0-21swapper/110:00:001
435367993831,4cyclictest483630-21unixbench_multi09:25:280
435367993830,5cyclictest0-21swapper/009:45:000
435380993729,4cyclictest0-21swapper/311:15:003
435380993729,4cyclictest0-21swapper/309:20:243
435380993727,7cyclictest546280-21grep12:25:263
435376993731,4cyclictest492760-21kworker/u8:1+events_unbound10:15:442
435376993728,6cyclictest503900-21fschecks_time10:25:152
435376993727,6cyclictest0-21swapper/209:25:012
435371993729,4cyclictest0-21swapper/112:05:151
435367993727,6cyclictest0-21swapper/011:15:250
435367993727,6cyclictest0-21swapper/011:15:240
435367993721,9cyclictest131rcu_preempt10:29:290
435380993629,3cyclictest0-21swapper/309:55:173
435380993615,12cyclictest480636-21kworker/u8:1-events_freezable_power_09:37:353
43538099360,15cyclictest505177-21cron10:30:003
435376993630,4cyclictest496044-21kworker/u8:0+events_unbound10:10:442
435376993627,6cyclictest487051-21unixbench_singl09:35:272
435376993625,5cyclictest477207-21kworker/u8:3+events_unbound09:32:412
435371993628,5cyclictest0-21swapper/111:05:001
435371993627,5cyclictest0-21swapper/110:10:141
435371993626,6cyclictest0-21swapper/109:45:011
435371993625,7cyclictest0-21swapper/107:20:001
435367993626,6cyclictest0-21swapper/007:40:250
435380993526,4cyclictest0-21swapper/309:20:013
435380993525,6cyclictest0-21swapper/312:40:003
435380993515,5cyclictest444538-21kworker/u8:3+events_unbound07:40:133
435376993524,6cyclictest0-21swapper/207:55:272
435371993526,5cyclictest459995-21sendmail08:20:001
435367993528,4cyclictest439321-21sendmail07:20:000
435367993527,6cyclictest520477-21unixbench_multi11:10:240
435367993525,6cyclictest546267-21grep12:25:260
435367993522,4cyclictest131rcu_preempt07:15:010
435367993520,11cyclictest121ktimers/008:05:140
435367993520,11cyclictest121ktimers/008:05:130
435367993519,9cyclictest131rcu_preempt08:10:140
435380993423,7cyclictest523076-21tune2fs11:20:143
435380993416,5cyclictest131rcu_preempt11:40:123
435380993415,13cyclictest131rcu_preempt11:36:123
435380993413,13cyclictest40-21ksoftirqd/307:50:113
435380993413,13cyclictest40-21ksoftirqd/307:50:113
435376993425,5cyclictest0-21swapper/210:20:162
435371993424,5cyclictest0-21swapper/108:20:171
435367993428,4cyclictest470230-21cut08:50:000
435367993427,4cyclictest503011-21unixbench_multi10:20:250
435367993427,4cyclictest449300-21grep07:45:260
435367993427,4cyclictest449300-21grep07:45:260
435367993419,6cyclictest449893-21kworker/u8:0+events_unbound07:59:120
43536799341,5cyclictest11-21ksoftirqd/008:50:130
435380993327,4cyclictest428162-21kworker/u8:3+events_unbound07:10:033
435380993326,3cyclictest0-21swapper/310:05:003
435380993314,11cyclictest477207-21kworker/u8:3+events_unbound10:35:563
435380993313,13cyclictest131rcu_preempt07:25:173
435380993310,11cyclictest40-21ksoftirqd/308:35:253
435376993325,4cyclictest0-21swapper/212:15:272
435376993325,4cyclictest0-21swapper/207:45:262
435376993325,4cyclictest0-21swapper/207:45:262
435376993322,6cyclictest0-21swapper/208:05:252
435376993322,6cyclictest0-21swapper/208:05:252
435367993321,6cyclictest131rcu_preempt11:05:120
43538099325,14cyclictest40-21ksoftirqd/309:10:213
435380993223,4cyclictest0-21swapper/311:45:153
435380993221,7cyclictest0-21swapper/310:50:263
435380993219,5cyclictest131rcu_preempt12:15:163
435380993213,12cyclictest40-21ksoftirqd/307:20:263
435380993212,12cyclictest458170-21kworker/u8:0-flush-179:9608:17:323
435376993225,5cyclictest524053-21kworker/u8:0+events_unbound11:36:032
435376993224,5cyclictest536029-21unixbench_multi11:55:242
435376993223,5cyclictest0-21swapper/207:40:252
435371993223,5cyclictest0-21swapper/107:40:161
435367993225,3cyclictest0-21swapper/012:15:160
435367993223,5cyclictest0-21swapper/012:00:240
435367993220,5cyclictest453760-21/usr/sbin/munin08:00:200
435367993220,5cyclictest453760-21/usr/sbin/munin08:00:200
435367993210,14cyclictest131rcu_preempt09:00:010
435367993210,14cyclictest131rcu_preempt09:00:000
43538099319,12cyclictest0-21swapper/311:01:523
43538099318,12cyclictest131rcu_preempt07:55:263
43538099317,13cyclictest131rcu_preempt11:05:203
435380993124,5cyclictest485423-21kworker/u8:0+events_unbound09:34:423
435380993123,5cyclictest391ktimers/308:05:133
435380993123,5cyclictest391ktimers/308:05:123
435380993121,7cyclictest541150-21grep12:10:253
435380993121,7cyclictest541150-21grep12:10:243
435380993117,4cyclictest131rcu_preempt07:30:213
435380993110,13cyclictest131rcu_preempt09:05:013
43538099310,11cyclictest0-21swapper/310:10:093
435376993125,4cyclictest477207-21kworker/u8:3+events_unbound10:08:412
43537699312,4cyclictest0-21swapper/211:45:112
435376993122,5cyclictest0-21swapper/207:30:002
435376993120,8cyclictest0-21swapper/210:40:002
43537699311,5cyclictest131rcu_preempt11:20:122
435371993122,5cyclictest531320-21latency_hist11:45:011
435371993121,7cyclictest542402-21ntp_kernel_pll_12:15:211
435367993124,5cyclictest463094-21kworker/u8:3+events_unbound08:30:170
435367993118,4cyclictest131rcu_preempt08:25:250
435367993118,4cyclictest131rcu_preempt07:25:140
435367993110,12cyclictest11-21ksoftirqd/009:25:020
43538099307,5cyclictest131rcu_preempt11:30:223
435380993015,3cyclictest131rcu_preempt09:43:023
435380993014,5cyclictest131rcu_preempt08:30:193
435380993014,3cyclictest131rcu_preempt10:20:033
435380993013,5cyclictest131rcu_preempt08:25:013
435380993013,3cyclictest131rcu_preempt12:00:003
435380993010,12cyclictest40-21ksoftirqd/309:05:183
435376993023,4cyclictest0-21swapper/212:25:262
435376993022,4cyclictest0-21swapper/212:05:152
435376993021,6cyclictest0-21swapper/209:00:002
435376993021,6cyclictest0-21swapper/209:00:002
435371993020,6cyclictest0-21swapper/112:05:011
435371993020,6cyclictest0-21swapper/109:50:011
435371993019,8cyclictest231ktimers/111:25:141
43536799308,4cyclictest131rcu_preempt09:10:000
435367993022,4cyclictest505552-21fschecks_count10:30:150
435367993021,4cyclictest0-21swapper/011:50:250
435367993020,4cyclictest131rcu_preempt09:11:550
435367993019,9cyclictest151rcuc/008:20:130
435367993014,9cyclictest131rcu_preempt10:00:110
43538099299,13cyclictest40-21ksoftirqd/307:45:253
43538099299,13cyclictest40-21ksoftirqd/307:45:253
43538099299,11cyclictest40-21ksoftirqd/308:55:003
43538099298,14cyclictest40-21ksoftirqd/308:40:203
43538099297,5cyclictest40-21ksoftirqd/311:50:223
43538099297,13cyclictest40-21ksoftirqd/309:45:173
435380992923,4cyclictest511838-21kworker/u8:1+events_unbound10:45:483
435380992923,4cyclictest477207-21kworker/u8:3+events_unbound09:25:403
435380992923,4cyclictest456386-21kworker/u8:2+events_unbound08:11:423
435380992912,4cyclictest522290-21kworker/u8:3-events_freezable_power_11:25:023
43537699293,5cyclictest131rcu_preempt11:10:122
435376992919,6cyclictest0-21swapper/212:40:002
43537199297,5cyclictest503324-21kworker/u8:0+events_unbound10:40:151
435371992923,3cyclictest0-21swapper/111:40:001
435371992921,4cyclictest0-21swapper/111:30:151
435371992919,6cyclictest0-21swapper/110:20:251
43536799298,3cyclictest131rcu_preempt12:35:150
43536799292,9cyclictest11-21ksoftirqd/011:55:120
435367992922,5cyclictest487270-21kworker/u8:2+events_unbound09:55:430
435367992921,6cyclictest477207-21kworker/u8:3+events_unbound10:39:040
435367992919,6cyclictest0-21swapper/010:45:000
435367992919,5cyclictest516912-21grep11:00:250
435367992917,6cyclictest513552-21kworker/u8:3+events_unbound10:54:470
435367992917,4cyclictest131rcu_preempt11:43:030
435367992917,4cyclictest131rcu_preempt11:28:140
435367992916,6cyclictest524053-21kworker/u8:0+events_unbound11:38:470
435367992915,4cyclictest131rcu_preempt10:46:590
435367992913,10cyclictest530888-21kworker/u8:2+events_unbound12:30:030
435367992913,10cyclictest131rcu_preempt12:12:240
435367992913,10cyclictest131rcu_preempt12:12:240
43538099288,12cyclictest40-21ksoftirqd/311:15:253
43538099288,12cyclictest40-21ksoftirqd/311:15:243
43538099287,11cyclictest40-21ksoftirqd/309:00:003
43538099287,11cyclictest40-21ksoftirqd/309:00:003
43538099286,4cyclictest131rcu_preempt12:20:153
435376992822,4cyclictest472134-21sh08:55:002
435376992821,5cyclictest464939-21kworker/u8:1+events_unbound08:45:292
435376992821,3cyclictest0-21swapper/212:31:112
435376992820,5cyclictest0-21swapper/211:10:002
435376992818,6cyclictest0-21swapper/208:00:272
435376992818,6cyclictest0-21swapper/208:00:272
435376992817,7cyclictest0-21swapper/211:30:232
435376992817,6cyclictest0-21swapper/209:10:262
435371992821,4cyclictest0-21swapper/107:30:251
435371992820,4cyclictest0-21swapper/109:25:171
435367992819,3cyclictest131rcu_preempt11:31:560
435367992818,6cyclictest523902-21grep11:20:230
435367992815,4cyclictest131rcu_preempt09:04:470
435367992814,8cyclictest131rcu_preempt08:35:130
435380992714,4cyclictest131rcu_preempt08:49:593
435376992721,4cyclictest530888-21kworker/u8:2+events_unbound12:11:102
435376992721,4cyclictest530888-21kworker/u8:2+events_unbound12:11:092
435376992721,4cyclictest480636-21kworker/u8:1+events_unbound09:40:412
435376992721,3cyclictest0-21swapper/210:30:252
435376992721,3cyclictest0-21swapper/208:35:242
435376992720,4cyclictest0-21swapper/210:00:262
435376992720,4cyclictest0-21swapper/207:35:262
435376992720,3cyclictest0-21swapper/211:00:262
435376992719,5cyclictest0-21swapper/208:15:002
435376992718,5cyclictest0-21swapper/207:10:262
435376992717,6cyclictest0-21swapper/210:50:252
435371992720,4cyclictest0-21swapper/109:20:231
435371992719,5cyclictest480636-21kworker/u8:1+events_unbound09:30:381
435367992719,4cyclictest0-21swapper/007:50:280
435367992719,4cyclictest0-21swapper/007:50:270
435367992719,4cyclictest0-21swapper/007:20:170
435367992718,6cyclictest458743-21tune2fs08:15:170
435376992620,3cyclictest0-21swapper/211:25:182
435376992618,4cyclictest0-21swapper/211:40:252
43537199265,3cyclictest131rcu_preempt11:55:111
435371992619,4cyclictest0-21swapper/111:15:241
435371992619,4cyclictest0-21swapper/111:15:241
435371992619,4cyclictest0-21swapper/109:05:241
435371992617,6cyclictest0-21swapper/111:50:151
435371992615,7cyclictest0-21swapper/108:35:241
43536799260,7cyclictest532641-21tail11:45:300
43537699259,3cyclictest131rcu_preempt08:45:002
43537699258,3cyclictest131rcu_preempt09:55:122
435376992518,5cyclictest464939-21kworker/u8:1+events_unbound09:02:072
435376992517,5cyclictest0-21swapper/208:20:232
435376992511,4cyclictest503324-21kworker/u8:0+events_unbound10:45:012
435371992520,3cyclictest0-21swapper/108:30:241
435371992519,4cyclictest442626-21kworker/u8:1+events_unbound08:05:161
435371992519,4cyclictest442626-21kworker/u8:1+events_unbound08:05:161
435371992518,4cyclictest0-21swapper/109:00:241
435371992517,4cyclictest0-21swapper/112:30:151
435367992518,5cyclictest477207-21kworker/u8:3+events_unbound09:50:150
435376992418,4cyclictest539817-21kworker/u8:3+events_unbound12:20:542
435376992418,4cyclictest536266-21kworker/u8:1+events_unbound12:00:162
435376992418,4cyclictest524053-21kworker/u8:0+events_unbound11:52:272
435376992416,4cyclictest0-21swapper/207:15:182
435376992415,5cyclictest0-21swapper/209:25:272
435376992414,7cyclictest32-21ksoftirqd/208:30:012
435376992414,6cyclictest0-21swapper/209:55:002
435371992416,4cyclictest0-21swapper/109:35:261
435371992413,7cyclictest0-21swapper/111:10:241
435376992316,5cyclictest506730-21kworker/u8:2+events_unbound11:15:252
435376992316,5cyclictest506730-21kworker/u8:2+events_unbound11:15:252
435376992313,6cyclictest0-21swapper/210:45:002
43537699231,12cyclictest0-21swapper/209:15:082
435371992317,3cyclictest0-21swapper/112:35:211
435371992316,4cyclictest540691-21ntpq12:10:191
435371992316,4cyclictest540691-21ntpq12:10:191
435371992216,4cyclictest0-21swapper/110:05:001
435371992216,3cyclictest0-21swapper/108:45:181
435371992214,5cyclictest231ktimers/108:00:231
435371992214,5cyclictest231ktimers/108:00:221
435376992115,3cyclictest311ktimers/207:55:002
435376992115,3cyclictest311ktimers/207:55:002
435371992115,4cyclictest513552-21kworker/u8:3+events_unbound10:50:481
435371992115,3cyclictest449754-21sh07:50:011
435371992115,3cyclictest449754-21sh07:50:001
435371992115,3cyclictest0-21swapper/110:25:121
435371992115,3cyclictest0-21swapper/109:50:231
435371992115,3cyclictest0-21swapper/107:35:201
435371992113,5cyclictest0-21swapper/110:45:151
435371992012,5cyclictest0-21swapper/107:11:071
435371992011,6cyclictest0-21swapper/110:05:221
435371991913,4cyclictest507111-21/usr/sbin/munin10:35:201
435371991913,3cyclictest545277-21/usr/sbin/munin12:25:171
435371991913,3cyclictest514315-21fschecks_count10:55:171
435371991913,3cyclictest0-21swapper/107:55:001
435371991913,3cyclictest0-21swapper/107:55:001
435371991912,5cyclictest231ktimers/107:20:231
435371991912,3cyclictest0-21swapper/111:45:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional