You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 16:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Jun 23, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3848986995344,5cyclictest3869999-21idleruntime-cro08:10:010
3848999995243,5cyclictest3902622-21munin-plugin-st09:45:013
384899099520,41cyclictest0-21swapper/110:30:121
3848990994935,9cyclictest3859773-21sendmail07:40:011
384899099491,43cyclictest3905535-21grep09:50:261
3848990994911,22cyclictest3906541-21cstates09:55:131
3848986994837,6cyclictest0-21swapper/009:35:010
3848990994736,8cyclictest3884049-21fschecks_time08:50:151
3848986994713,5cyclictest131rcu_preempt10:00:120
3848986994713,5cyclictest131rcu_preempt10:00:120
384899099461,39cyclictest3953334-21apt-get12:10:121
384899099461,26cyclictest3875117-21latency_hist08:25:011
3848986994620,17cyclictest2727008-21kworker/u8:2+events_unbound07:45:180
3848986994533,7cyclictest3923434-21grep10:40:230
3848995994433,8cyclictest311ktimers/207:35:112
384899099442,35cyclictest3894322-21apt-get09:20:121
384899099441,40cyclictest3961281-21cron12:31:001
384899099441,38cyclictest3853439-21/usr/sbin/munin07:20:171
384899099440,40cyclictest0-21swapper/109:45:131
3848986994437,4cyclictest3864861-21cron07:55:010
3848986994419,12cyclictest3940885-21kworker/u8:0+events_unbound12:33:270
384899999435,5cyclictest131rcu_preempt12:15:113
3848995994336,4cyclictest3864861-21cron07:55:012
3848990994334,5cyclictest0-21swapper/109:40:011
384899099433,37cyclictest3939285-21cron11:28:011
3848990994331,9cyclictest231ktimers/108:30:121
3848990994331,9cyclictest231ktimers/108:30:121
384899099431,39cyclictest3925843-21apt-get10:50:131
384899099431,39cyclictest3867266-21/usr/sbin/munin08:00:191
384899099431,36cyclictest3936083-21apt-get11:20:101
3848990994231,8cyclictest3862701-21grep07:45:251
384899099422,34cyclictest3948213-21apt-get11:55:101
384899099421,37cyclictest3945267-21/usr/sbin/munin11:45:201
384899099421,36cyclictest3865438-21/usr/sbin/munin07:55:181
384899099421,35cyclictest3934362-21apt-get11:15:111
384899099421,35cyclictest3927543-21apt-get10:55:121
3848995994134,4cyclictest0-21swapper/209:40:012
3848995994132,6cyclictest3962908-21unixbench_singl12:35:252
384899099413,35cyclictest3931360-21/usr/sbin/munin11:05:161
3848990994124,13cyclictest3963331-21sendmail12:40:001
384899099412,34cyclictest3956874-21df_inode12:20:171
384899099411,37cyclictest53-21kcompactd008:46:041
384899099411,36cyclictest3920720-21munin-node10:35:111
384899099411,35cyclictest3924144-21munin-node10:45:121
384899099411,35cyclictest3912223-21/usr/sbin/munin10:10:191
384899099411,35cyclictest3860577-21/usr/sbin/munin07:40:221
384899099410,35cyclictest0-21swapper/108:40:121
3848986994129,9cyclictest121ktimers/011:40:120
3848986994119,7cyclictest3932048-21kworker/u8:2+events_unbound11:24:280
3848995994033,5cyclictest3904290-21kworker/u8:1+events_unbound10:09:352
3848995994033,5cyclictest3904290-21kworker/u8:1+events_unbound10:09:352
384899099402,35cyclictest3942604-21cron11:37:001
384899099401,36cyclictest3949939-21/usr/sbin/munin12:00:131
384899099401,36cyclictest3897983-21/usr/sbin/munin09:30:161
384899099401,36cyclictest3896697-21/usr/sbin/munin09:25:241
384899099401,35cyclictest3946953-21/usr/sbin/munin11:50:181
384899099401,34cyclictest3955310-21/usr/sbin/munin12:15:151
384899099401,34cyclictest3951758-21diskstats12:05:171
384899099401,34cyclictest3939743-21/usr/sbin/munin11:30:121
384899099401,34cyclictest3854997-21diskstats07:25:151
384899099401,33cyclictest3910198-21/usr/sbin/munin10:05:141
384899099401,33cyclictest3910198-21/usr/sbin/munin10:05:141
384899999394,4cyclictest131rcu_preempt11:15:113
384899099393,32cyclictest3891020-21diskstats09:10:151
384899099393,32cyclictest3891020-21diskstats09:10:151
3848990993927,8cyclictest0-21swapper/108:05:251
384899099391,35cyclictest3913612-21/usr/sbin/munin10:15:171
384899099391,35cyclictest3908503-21diskstats10:00:151
384899099391,35cyclictest3908503-21diskstats10:00:151
384899099391,35cyclictest3890566-21cron09:09:001
384899099391,35cyclictest3890566-21cron09:09:001
384899099390,34cyclictest3943116-21apt-get11:40:111
3848986993919,6cyclictest3843757-21kworker/u8:1+events_unbound07:18:160
3848999993827,7cyclictest0-21swapper/308:00:263
3848995993827,6cyclictest0-21swapper/210:05:002
3848995993827,6cyclictest0-21swapper/210:05:002
384899099382,34cyclictest3850436-21cron07:13:011
384899099382,33cyclictest3872258-21irqstats08:15:181
3848990993814,20cyclictest0-21swapper/108:55:241
384899099381,35cyclictest53-21kcompactd010:23:511
384899099381,34cyclictest3875590-21/usr/sbin/munin08:25:181
384899099381,34cyclictest3863517-21/usr/sbin/munin07:50:151
384899099381,34cyclictest3856883-21/usr/sbin/munin07:30:171
384899099381,31cyclictest3870222-21apt-get08:10:131
384899099380,33cyclictest3887280-21apt-get09:00:101
384899099380,30cyclictest0-21swapper/108:35:131
3848986993831,4cyclictest3935856-21sendmail11:20:010
3848986993821,6cyclictest3928679-21kworker/u8:3+events_unbound11:56:270
3848999993725,9cyclictest391ktimers/308:20:133
3848995993729,5cyclictest0-21swapper/208:45:002
3848995993726,7cyclictest0-21swapper/211:00:002
3848990993726,6cyclictest0-21swapper/109:45:001
384899099371,33cyclictest3959368-21/usr/sbin/munin12:25:251
384899099371,33cyclictest3959368-21/usr/sbin/munin12:25:251
384899099371,33cyclictest3932970-21if_eth111:10:181
3848995993626,6cyclictest0-21swapper/211:05:232
3848995993626,6cyclictest0-21swapper/209:00:012
3848995993625,7cyclictest3855863-21grep07:25:252
384899099361,32cyclictest3922558-21diskstats10:40:121
384899099361,32cyclictest3851279-21munin-node07:15:041
384899099360,34cyclictest3929381-21/usr/sbin/munin11:00:151
384899099360,34cyclictest3929381-21/usr/sbin/munin11:00:151
3848999993526,4cyclictest0-21swapper/310:10:163
3848999993524,6cyclictest0-21swapper/310:55:003
3848986993517,6cyclictest3928679-21kworker/u8:3+events_unbound12:11:420
3848999993423,6cyclictest0-21swapper/311:30:243
3848999993421,10cyclictest391ktimers/307:10:133
3848999993416,3cyclictest131rcu_preempt09:25:123
3848995993427,4cyclictest0-21swapper/207:45:262
3848995993424,6cyclictest0-21swapper/212:05:002
3848995993424,6cyclictest0-21swapper/211:30:242
3848995993423,7cyclictest0-21swapper/210:00:002
3848986993427,4cyclictest0-21swapper/012:10:000
3848986993425,7cyclictest3928679-21kworker/u8:3+events_unbound11:26:400
3848986993425,6cyclictest0-21swapper/010:35:010
3848986993424,7cyclictest3897483-21cron09:30:010
3848986993410,19cyclictest3898837-1kworker/0:1H+mmc_complete10:00:000
384898699340,32cyclictest0-21swapper/008:15:130
3848999993323,6cyclictest0-21swapper/307:35:163
3848995993326,3cyclictest0-21swapper/210:15:272
3848995993325,4cyclictest0-21swapper/211:50:152
3848986993326,5cyclictest3913667-21kworker/u8:2+events_unbound10:26:420
3848986993324,6cyclictest0-21swapper/007:10:260
3848999993225,5cyclictest3904290-21kworker/u8:1+events_unbound10:34:453
3848999993225,4cyclictest3907925-21cron10:00:003
3848999993222,6cyclictest0-21swapper/312:10:253
3848999993222,6cyclictest0-21swapper/309:50:163
3848995993224,4cyclictest0-21swapper/209:00:242
3848995993222,7cyclictest3899203-21cut09:35:012
3848995993222,6cyclictest0-21swapper/212:20:272
3848986993225,3cyclictest0-21swapper/007:25:250
3848986993224,6cyclictest121ktimers/012:35:120
384898699321,16cyclictest0-21swapper/007:55:120
3848999993122,5cyclictest3942440-21unixbench_singl11:35:253
3848999993121,6cyclictest0-21swapper/308:40:253
3848999993121,6cyclictest0-21swapper/307:40:253
3848999993111,6cyclictest3904290-21kworker/u8:1+events_unbound10:15:583
3848995993124,4cyclictest0-21swapper/212:30:122
3848995993123,5cyclictest0-21swapper/208:50:252
3848995993123,4cyclictest0-21swapper/207:40:252
3848995993122,6cyclictest0-21swapper/207:15:012
3848995993121,6cyclictest0-21swapper/212:10:252
3848995993121,6cyclictest0-21swapper/207:30:162
3848995993120,7cyclictest0-21swapper/208:30:242
3848995993120,7cyclictest0-21swapper/208:30:242
3848986993122,6cyclictest3957762-21grep12:20:270
384899999308,15cyclictest0-21swapper/310:05:203
384899999308,15cyclictest0-21swapper/310:05:203
3848999993024,3cyclictest0-21swapper/312:05:263
3848999993023,5cyclictest3928679-21kworker/u8:3+events_unbound11:04:503
3848999993023,5cyclictest3928679-21kworker/u8:3+events_unbound11:04:503
3848999993023,3cyclictest0-21swapper/309:45:253
3848999993021,5cyclictest0-21swapper/311:05:233
3848999993021,5cyclictest0-21swapper/308:30:153
3848999993021,5cyclictest0-21swapper/308:30:153
384899999301,4cyclictest131rcu_preempt10:55:123
3848999993013,5cyclictest3940885-21kworker/u8:0+events_unbound11:42:313
3848999993012,7cyclictest131rcu_preempt07:50:013
384899599302,6cyclictest131rcu_preempt09:05:092
384899599302,6cyclictest131rcu_preempt09:05:092
3848995993023,4cyclictest0-21swapper/209:45:252
3848995993022,5cyclictest3932048-21kworker/u8:2+events_unbound11:39:542
3848995993021,6cyclictest0-21swapper/209:55:012
3848986993022,4cyclictest0-21swapper/009:05:230
3848986993022,4cyclictest0-21swapper/009:05:230
3848986993021,6cyclictest3930726-21sh11:05:000
3848986993021,6cyclictest3930726-21sh11:05:000
3848986993014,6cyclictest3913667-21kworker/u8:2+events_unbound10:17:200
384898699301,14cyclictest0-21swapper/008:39:460
3848986993010,12cyclictest11-21ksoftirqd/008:50:250
3848999992921,4cyclictest0-21swapper/310:45:173
3848999992921,4cyclictest0-21swapper/309:20:253
3848999992920,5cyclictest0-21swapper/308:45:173
3848995992923,3cyclictest3934131-21kthreadd11:15:002
3848995992922,4cyclictest3873395-21latency_hist08:20:002
3848995992919,7cyclictest3897488-21sh09:30:012
3848995992919,6cyclictest0-21swapper/212:15:242
3848986992922,5cyclictest3932048-21kworker/u8:2+events_unbound11:47:370
3848986992921,4cyclictest0-21swapper/008:10:160
3848986992917,5cyclictest3924134-21kworker/u8:0-events_power_efficient11:05:280
3848986992910,11cyclictest11-21ksoftirqd/012:20:000
3848999992822,4cyclictest3881711-21kworker/u8:3+events_unbound08:59:223
3848999992821,5cyclictest3961541-21kworker/u8:1+events_unbound12:38:583
3848999992819,6cyclictest0-21swapper/309:05:233
3848999992819,6cyclictest0-21swapper/309:05:233
3848999992819,5cyclictest0-21swapper/311:55:003
3848999992810,5cyclictest3904290-21kworker/u8:1+events_unbound10:25:003
384899599283,4cyclictest131rcu_preempt10:45:142
3848995992821,5cyclictest3873420-21kworker/u8:0+events_unbound08:46:042
3848995992820,5cyclictest0-21swapper/211:15:252
3848995992819,6cyclictest0-21swapper/210:40:232
3848995992819,5cyclictest131rcu_preempt09:20:122
3848995992814,12cyclictest32-21ksoftirqd/212:05:132
384898699284,11cyclictest0-21swapper/009:48:180
3848986992822,4cyclictest3873420-21kworker/u8:0+events_unbound10:14:360
3848986992820,3cyclictest0-21swapper/008:20:150
384898699281,9cyclictest11-21ksoftirqd/011:35:130
384898699281,9cyclictest11-21ksoftirqd/007:20:120
3848999992720,5cyclictest2727008-21kworker/u8:2+events_unbound07:21:513
3848999992719,4cyclictest0-21swapper/307:20:003
3848995992720,5cyclictest0-21swapper/208:25:002
3848995992717,6cyclictest0-21swapper/208:00:262
384899599271,14cyclictest0-21swapper/211:40:112
384899599271,11cyclictest0-21swapper/210:55:012
3848986992721,4cyclictest0-21swapper/008:45:130
3848986992720,4cyclictest3922195-21sendmail10:40:000
3848986992720,3cyclictest0-21swapper/007:40:010
3848986992715,8cyclictest3857587-21grep07:30:260
3848986992711,3cyclictest131rcu_preempt10:55:220
384898699271,13cyclictest0-21swapper/009:37:050
384898699271,12cyclictest0-21swapper/008:55:240
3848999992619,3cyclictest0-21swapper/312:30:253
3848999992619,3cyclictest0-21swapper/307:30:153
3848999992618,5cyclictest0-21swapper/308:15:163
3848999992618,5cyclictest0-21swapper/307:55:013
3848999992618,4cyclictest0-21swapper/311:50:013
3848999992618,4cyclictest0-21swapper/311:20:143
3848999992618,4cyclictest0-21swapper/309:00:133
3848999992617,5cyclictest0-21swapper/310:40:013
3848999992617,4cyclictest0-21swapper/309:30:153
3848999992617,4cyclictest0-21swapper/309:15:263
3848999992616,6cyclictest0-21swapper/308:00:013
3848995992620,4cyclictest3940885-21kworker/u8:0+events_unbound11:49:562
3848995992618,5cyclictest0-21swapper/210:40:002
3848986992620,4cyclictest3864734-21kworker/u8:3+events_unbound08:03:350
3848986992619,5cyclictest3928679-21kworker/u8:3+events_unbound11:31:250
3848986992619,5cyclictest3896140-21kworker/u8:2+events_unbound09:40:410
3848986992619,3cyclictest0-21swapper/009:55:010
3848986992617,7cyclictest3873420-21kworker/u8:0+events_unbound10:06:410
3848986992617,7cyclictest3873420-21kworker/u8:0+events_unbound10:06:410
3848986992617,6cyclictest0-21swapper/009:05:010
3848986992616,6cyclictest3894064-21cron09:20:000
384898699261,13cyclictest0-21swapper/012:26:580
384898699261,13cyclictest0-21swapper/012:26:580
384898699261,13cyclictest0-21swapper/008:44:180
384898699261,12cyclictest0-21swapper/010:53:030
384898699261,12cyclictest0-21swapper/009:23:040
384899999259,4cyclictest3904290-21kworker/u8:1+events_unbound10:02:063
384899999259,4cyclictest3904290-21kworker/u8:1+events_unbound10:02:063
384899999257,10cyclictest40-21ksoftirqd/310:40:113
384899999257,10cyclictest40-21ksoftirqd/308:35:133
3848999992518,5cyclictest2727008-21kworker/u8:2+events_unbound07:29:353
3848999992515,6cyclictest391ktimers/308:25:133
3848999992515,6cyclictest0-21swapper/309:10:163
3848999992515,6cyclictest0-21swapper/309:10:163
384899999250,12cyclictest0-21swapper/308:53:013
3848995992519,4cyclictest3864734-21kworker/u8:3+events_unbound08:29:332
3848995992518,3cyclictest0-21swapper/210:20:252
3848995992518,3cyclictest0-21swapper/210:10:172
3848995992517,4cyclictest0-21swapper/208:10:012
3848995992515,6cyclictest0-21swapper/207:15:222
384899599251,3cyclictest3901142-21apt-get09:40:112
3848995992512,11cyclictest32-21ksoftirqd/210:25:132
3848995992511,5cyclictest3928679-21kworker/u8:3+events_unbound11:24:532
384898699257,10cyclictest131rcu_preempt07:45:020
3848986992519,4cyclictest3873420-21kworker/u8:0+events_unbound09:10:170
3848986992519,4cyclictest3873420-21kworker/u8:0+events_unbound09:10:170
3848986992518,5cyclictest3904290-21kworker/u8:1+events_unbound11:10:450
3848986992517,5cyclictest0-21swapper/010:25:010
384898699251,20cyclictest0-21swapper/010:47:150
384898699251,13cyclictest0-21swapper/011:52:010
384898699251,12cyclictest0-21swapper/008:25:170
384898699250,13cyclictest0-21swapper/012:01:030
384899999245,10cyclictest131rcu_preempt08:12:003
384899999244,12cyclictest0-21swapper/308:05:233
3848995992418,3cyclictest0-21swapper/210:30:232
3848995992418,3cyclictest0-21swapper/208:10:172
3848995992417,5cyclictest3843757-21kworker/u8:1+events_unbound07:20:422
3848995992416,5cyclictest3932048-21kworker/u8:2+events_unbound11:27:422
3848995992416,5cyclictest0-21swapper/211:05:002
3848995992416,5cyclictest0-21swapper/211:05:002
3848995992416,5cyclictest0-21swapper/208:35:172
3848999992316,5cyclictest391ktimers/310:25:153
3848999992316,5cyclictest3904290-21kworker/u8:1+events_unbound11:12:363
384899999231,14cyclictest0-21swapper/311:55:193
384899999231,12cyclictest0-21swapper/309:39:423
3848995992310,7cyclictest131rcu_preempt09:14:312
3848995992310,7cyclictest131rcu_preempt09:14:312
384898699231,20cyclictest0-21swapper/008:34:580
384898699231,20cyclictest0-21swapper/008:34:580
384899999226,3cyclictest131rcu_preempt12:25:153
384899999226,3cyclictest131rcu_preempt12:25:153
3848999992215,3cyclictest0-21swapper/311:25:133
3848999992214,5cyclictest0-21swapper/312:00:153
3848995992216,3cyclictest0-21swapper/211:55:142
3848995992215,5cyclictest3881711-21kworker/u8:3+events_unbound09:15:562
3848995992214,6cyclictest3865236-21fschecks_count07:55:152
3848995992214,5cyclictest164-21systemd-journal12:25:012
3848995992214,5cyclictest164-21systemd-journal12:25:012
384899999203,9cyclictest3958232-21munin-run12:25:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional