You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 17:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue Mar 24, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
586975995344,6cyclictest662107-21cron10:45:013
586975995224,24cyclictest630763-21cron09:15:003
586975994927,19cyclictest0-21swapper/309:05:253
586966994940,5cyclictest694714-21munin-plugin-st12:20:001
586975994840,5cyclictest687877-21sh12:00:013
586975994829,15cyclictest0-21swapper/311:10:283
586975994829,15cyclictest0-21swapper/311:10:283
586966994632,11cyclictest231ktimers/110:20:121
586975994517,24cyclictest0-21swapper/309:40:003
58697599450,10cyclictest623965-21apt-get08:55:143
58697599450,10cyclictest623965-21apt-get08:55:143
58697599432,36cyclictest693228-21sshd12:15:103
58697599432,35cyclictest204-21dbus-daemon11:20:003
58697599431,7cyclictest596123-21latency_hist07:35:013
58696699438,11cyclictest644732-21latency_hist09:55:001
586961994337,4cyclictest618535-21kworker/u8:1+events_unbound09:04:350
58697599423,35cyclictest641216-21cron09:45:013
58697599421,9cyclictest696656-21/usr/sbin/munin12:25:283
58697599421,3cyclictest0-21swapper/309:45:123
58697599420,10cyclictest632723-21apt-get09:20:143
586975994125,13cyclictest391ktimers/312:00:123
58697599412,35cyclictest637322-21grep09:30:243
586975994120,17cyclictest0-21swapper/308:15:283
58697599411,8cyclictest681369-21/usr/sbin/munin11:40:113
58697599411,8cyclictest658024-21/usr/sbin/munin10:30:243
58697599411,8cyclictest652238-21/usr/sbin/munin10:15:203
58697599411,8cyclictest608749-21/usr/sbin/munin08:10:193
58697599411,5cyclictest592957-21df07:25:143
586975994114,24cyclictest589423-21/usr/sbin/munin07:15:263
58697599411,33cyclictest684706-21sshd11:50:073
58697599411,10cyclictest604903-21df08:00:153
586966994134,4cyclictest684487-21munin-plugin-st11:50:011
58697599409,27cyclictest612028-21cut08:20:153
58697599402,34cyclictest651198-21grep10:10:253
58697599402,34cyclictest204-21dbus-daemon11:30:023
58697599402,32cyclictest662533-21fschecks_time10:45:203
58697599401,9cyclictest615438-21apt-get08:30:113
58697599401,8cyclictest659598-21/usr/sbin/munin10:35:243
58697599401,7cyclictest668234-21/usr/sbin/munin11:00:243
58697599401,4cyclictest691943-21cat12:10:193
58697599401,4cyclictest6183952chrt08:37:333
58697599401,36cyclictest700235-21fschecks_time12:35:153
58697599401,10cyclictest618966-21df08:40:143
58697599400,4cyclictest677112-21/usr/sbin/munin11:25:273
586970994034,3cyclictest699824-21kthreadd12:34:592
586966994026,10cyclictest231ktimers/111:15:131
586966994025,11cyclictest231ktimers/110:50:141
586961994031,6cyclictest121ktimers/009:35:130
586975993931,5cyclictest646329-21munin-plugin-st10:00:013
58697599392,33cyclictest683228-21grep11:45:153
58697599392,33cyclictest598506-21grep07:40:203
58697599392,32cyclictest623723-21cron08:54:593
58697599391,9cyclictest601456-21/usr/sbin/munin07:50:133
58697599391,7cyclictest680364-21/usr/sbin/munin11:35:253
58697599391,7cyclictest613650-21diskstats08:25:173
58697599391,5cyclictest653911-21/usr/sbin/munin10:20:153
58697599391,3cyclictest0-21swapper/310:05:113
58697599391,11cyclictest597329-21users07:35:253
58697599391,10cyclictest587228-21df07:10:143
58697599390,6cyclictest694958-21apt-get12:20:133
586966993928,6cyclictest0-21swapper/112:15:001
586961993933,4cyclictest601128-21kworker/u8:0+events_unbound07:56:420
586961993932,4cyclictest698572-21fschecks_time12:30:160
586961993924,5cyclictest601128-21kworker/u8:0+events_unbound08:18:400
586961993921,12cyclictest131rcu_preempt10:34:040
586961993918,5cyclictest0-21swapper/010:25:220
58697599383,12cyclictest647078-21sed10:00:193
586975993827,7cyclictest0-21swapper/312:30:163
58697599382,32cyclictest606919-21grep08:05:173
58697599381,9cyclictest670198-21unixbench_singl11:05:273
58697599381,9cyclictest600681-21unixbench_multi07:45:253
58697599381,6cyclictest665851-21df10:55:143
58697599381,5cyclictest591503-21sed07:20:173
58697599381,4cyclictest664636-21/usr/sbin/munin10:50:223
58697599381,32cyclictest626537-21wc09:00:263
58697599381,10cyclictest603523-21meminfo07:55:203
58697099381,15cyclictest0-21swapper/207:50:132
586966993831,4cyclictest651663-21munin-plugin-st10:15:001
586961993830,5cyclictest596030-21munin-plugin-st07:35:010
586961993820,10cyclictest131rcu_preempt11:55:140
58697599372,31cyclictest634821-21cut09:25:173
58697599372,31cyclictest634821-21cut09:25:173
58697599371,7cyclictest655820-21if_eth010:25:173
58697599371,6cyclictest643293-21fschecks_count09:50:163
58697599371,3cyclictest620562-21apt-get08:45:113
58697599371,32cyclictest674233-21cron11:20:003
58697599371,10cyclictest631206-21fschecks_time09:15:153
586970993720,6cyclictest656834-21kworker/u8:2+events_unbound10:30:232
586966993730,4cyclictest642927-21sh09:50:011
586966993729,5cyclictest0-21swapper/112:00:011
586966993714,6cyclictest633776-21sed09:20:261
586961993715,9cyclictest131rcu_preempt07:17:370
58697599361,31cyclictest689973-21fschecks_count12:05:153
586970993627,4cyclictest0-21swapper/208:30:222
586966993629,4cyclictest682771-21cron11:45:001
586966993628,4cyclictest625456-21sendmail09:00:001
586966993628,4cyclictest625456-21sendmail09:00:001
586966993627,6cyclictest678933-21unixbench_singl11:30:261
586966993625,7cyclictest0-21swapper/110:35:261
586961993628,4cyclictest0-21swapper/012:25:000
586961993626,7cyclictest0-21swapper/010:10:000
586961993621,4cyclictest131rcu_preempt07:54:140
586961993619,4cyclictest131rcu_preempt10:41:000
586961993617,9cyclictest131rcu_preempt10:53:360
586961993617,4cyclictest131rcu_preempt09:59:010
586961993616,9cyclictest131rcu_preempt08:07:360
586961993615,11cyclictest131rcu_preempt08:23:440
586961993614,9cyclictest131rcu_preempt09:49:570
586961993612,13cyclictest131rcu_preempt09:29:310
586961993612,13cyclictest131rcu_preempt09:29:310
586970993528,4cyclictest692997-21auditctl12:15:002
586970993527,6cyclictest639478-21kworker/u8:0+events_unbound09:49:462
586970993527,4cyclictest0-21swapper/210:45:202
586970993518,6cyclictest693870-21kworker/u8:0+events_unbound12:26:112
586961993526,4cyclictest0-21swapper/008:54:340
586961993525,6cyclictest0-21swapper/008:10:270
586961993522,5cyclictest131rcu_preempt07:45:220
586961993522,4cyclictest131rcu_preempt07:44:130
586961993521,4cyclictest131rcu_preempt08:35:120
586961993515,9cyclictest131rcu_preempt12:11:510
586961993515,5cyclictest131rcu_preempt07:25:250
586961993514,9cyclictest131rcu_preempt10:24:160
586961993514,10cyclictest131rcu_preempt11:46:150
586970993427,4cyclictest639507-21cron09:40:002
58697099341,4cyclictest131rcu_preempt09:20:122
58697099341,4cyclictest131rcu_preempt08:20:132
586961993423,7cyclictest0-21swapper/011:05:270
586961993422,4cyclictest131rcu_preempt12:15:220
586961993421,4cyclictest131rcu_preempt10:45:170
586961993420,4cyclictest131rcu_preempt11:00:180
586961993420,4cyclictest131rcu_preempt09:18:070
586961993420,4cyclictest131rcu_preempt08:55:100
586961993420,4cyclictest131rcu_preempt08:55:100
586961993416,10cyclictest131rcu_preempt08:40:160
586961993415,9cyclictest131rcu_preempt07:10:500
586961993415,4cyclictest131rcu_preempt11:23:510
586970993318,6cyclictest675936-21kworker/u8:0+events_unbound11:29:592
58696699338,5cyclictest24-21ksoftirqd/108:50:011
58696699337,12cyclictest24-21ksoftirqd/108:05:211
586966993325,5cyclictest628383-21unixbench_multi09:05:251
586966993325,4cyclictest0-21swapper/110:29:491
586966993325,4cyclictest0-21swapper/108:20:011
58696199337,5cyclictest121ktimers/007:35:220
586961993327,4cyclictest603071-21kworker/u8:3+events_unbound08:04:310
586961993325,4cyclictest0-21swapper/011:40:220
586961993325,3cyclictest0-21swapper/010:20:010
586961993324,5cyclictest0-21swapper/009:25:010
586961993323,6cyclictest0-21swapper/011:25:270
586961993319,4cyclictest131rcu_preempt11:52:500
586961993317,4cyclictest131rcu_preempt07:23:440
586961993315,4cyclictest131rcu_preempt12:26:280
586961993315,4cyclictest131rcu_preempt08:30:270
586961993313,5cyclictest131rcu_preempt09:52:470
58696199330,17cyclictest650268-21/usr/sbin/munin10:10:140
586970993225,4cyclictest0-21swapper/211:05:272
586970993224,4cyclictest0-21swapper/211:20:252
586970993222,6cyclictest0-21swapper/207:29:282
586970993216,6cyclictest642538-21kworker/u8:1+events_unbound10:42:392
58697099321,28cyclictest614997-21apt08:30:002
58697099321,18cyclictest0-21swapper/209:15:122
58696699327,6cyclictest24-21ksoftirqd/112:05:191
58696699324,9cyclictest613934-21sed08:25:211
586966993224,4cyclictest0-21swapper/110:40:141
586966993222,6cyclictest630367-21unixbench_singl09:10:281
586966993222,6cyclictest0-21swapper/108:30:231
586966993222,5cyclictest0-21swapper/111:30:001
586966993220,9cyclictest231ktimers/112:25:141
586961993217,5cyclictest131rcu_preempt12:38:230
586961993215,9cyclictest131rcu_preempt11:10:230
586961993215,9cyclictest131rcu_preempt11:10:230
586961993215,4cyclictest131rcu_preempt11:19:000
586961993212,4cyclictest131rcu_preempt10:55:460
586961993210,4cyclictest131rcu_preempt08:45:210
58697099312,5cyclictest131rcu_preempt09:00:142
586970993124,5cyclictest592855-21kworker/u8:2+events_unbound07:49:302
586970993124,4cyclictest679357-21auditctl11:35:002
586970993123,4cyclictest0-21swapper/208:10:262
586970993123,4cyclictest0-21swapper/207:35:252
586970993116,6cyclictest618535-21kworker/u8:1+events_unbound08:48:322
58696699319,6cyclictest24-21ksoftirqd/110:05:221
58696699319,6cyclictest24-21ksoftirqd/108:25:011
58696699319,6cyclictest24-21ksoftirqd/107:20:011
58696699318,5cyclictest24-21ksoftirqd/109:35:161
58696699317,5cyclictest24-21ksoftirqd/112:30:201
58696699316,6cyclictest24-21ksoftirqd/110:00:161
58696699314,9cyclictest609484-21uptime08:10:261
586966993124,4cyclictest0-21swapper/111:00:261
586966993123,4cyclictest0-21swapper/109:25:271
586966993123,4cyclictest0-21swapper/109:25:261
586966993123,4cyclictest0-21swapper/109:00:261
586966993110,6cyclictest24-21ksoftirqd/109:40:251
58696199315,4cyclictest131rcu_preempt10:00:100
586961993117,5cyclictest131rcu_preempt09:40:170
586961993117,4cyclictest131rcu_preempt09:13:450
586961993116,4cyclictest131rcu_preempt09:34:500
586961993113,10cyclictest131rcu_preempt12:05:130
586970993026,2cyclictest668859-21kworker/u8:0+events_unbound11:15:022
58697099302,4cyclictest0-21swapper/210:10:122
586970993024,4cyclictest636027-21kworker/u8:3+events_unbound09:29:442
586970993024,4cyclictest636027-21kworker/u8:3+events_unbound09:29:442
586970993024,3cyclictest0-21swapper/208:05:262
586970993024,3cyclictest0-21swapper/207:20:012
586970993023,3cyclictest0-21swapper/210:15:302
586970993023,3cyclictest0-21swapper/210:05:252
586970993018,5cyclictest601128-21kworker/u8:0+events_unbound08:43:532
586970993016,7cyclictest666845-21kworker/u8:2+events_unbound11:43:192
58696699309,6cyclictest0-21swapper/111:20:251
58696699306,7cyclictest601225-21latency_hist07:50:011
58696699306,7cyclictest0-21swapper/110:19:221
586966993021,6cyclictest0-21swapper/109:15:261
586966993018,3cyclictest131rcu_preempt08:01:201
58696199308,14cyclictest11-21ksoftirqd/009:05:180
586961993024,4cyclictest677900-21kworker/u8:1+events_unbound11:31:440
586961993018,7cyclictest681070-21ls11:40:010
586961993014,5cyclictest131rcu_preempt10:35:240
58697099293,4cyclictest131rcu_preempt09:40:132
586970992923,4cyclictest592855-21kworker/u8:2+events_unbound07:58:412
586970992921,4cyclictest0-21swapper/207:40:252
58696699296,6cyclictest24-21ksoftirqd/108:35:171
58696699294,6cyclictest689425-21cron12:03:001
586966992920,7cyclictest231ktimers/107:55:131
586966992920,5cyclictest0-21swapper/107:35:221
586966992910,10cyclictest131rcu_preempt10:30:141
586961992918,4cyclictest131rcu_preempt12:00:140
586970992820,4cyclictest0-21swapper/211:10:272
586970992820,4cyclictest0-21swapper/211:10:272
586970992819,6cyclictest690828-21unixbench_multi12:05:252
586970992819,6cyclictest0-21swapper/207:20:252
586970992819,4cyclictest0-21swapper/209:50:252
586970992818,7cyclictest659965-21head10:35:252
586970992818,5cyclictest618535-21kworker/u8:1+events_unbound08:50:012
586970992815,5cyclictest647772-21kworker/u8:0+events_unbound10:26:242
58696699289,5cyclictest131rcu_preempt07:31:181
58696699284,4cyclictest24-21ksoftirqd/111:50:151
58696699283,7cyclictest24-21ksoftirqd/111:10:271
58696699283,7cyclictest24-21ksoftirqd/111:10:261
586966992820,4cyclictest0-21swapper/111:00:011
586961992820,5cyclictest151rcuc/008:25:230
586970992720,4cyclictest687642-21kworker/u8:1+events_unbound12:03:392
586970992719,5cyclictest0-21swapper/211:50:232
586970992717,7cyclictest648161-21apt-config10:05:012
586970992712,13cyclictest586956-21cyclictest10:20:132
58696699278,7cyclictest0-21swapper/111:35:241
58696699273,8cyclictest0-21swapper/112:20:121
586966992720,3cyclictest0-21swapper/111:10:011
58697099262,3cyclictest0-21swapper/209:55:122
586970992620,4cyclictest590547-21kworker/u8:3+events_unbound07:31:292
586970992619,5cyclictest691026-21kworker/u8:3+events_unbound12:15:142
586970992619,3cyclictest0-21swapper/211:00:012
586970992617,7cyclictest666845-21kworker/u8:2+events_unbound11:57:352
586970992615,9cyclictest32-21ksoftirqd/208:35:162
586970992611,6cyclictest32-21ksoftirqd/212:35:192
58696699267,6cyclictest0-21swapper/109:30:221
58696699267,5cyclictest0-21swapper/107:50:171
58696699267,4cyclictest131rcu_preempt12:35:101
586966992610,6cyclictest24-21ksoftirqd/107:20:191
586966992610,5cyclictest131rcu_preempt08:52:211
586970992519,4cyclictest653190-21kworker/u8:3+events_unbound10:52:422
586970992518,4cyclictest0-21swapper/209:10:002
586970992516,6cyclictest0-21swapper/212:20:222
586970992515,7cyclictest32-21ksoftirqd/209:10:232
586970992515,6cyclictest0-21swapper/209:30:252
58697099251,13cyclictest0-21swapper/208:15:152
58696699253,6cyclictest0-21swapper/108:40:201
586970992418,4cyclictest666845-21kworker/u8:2+events_unbound11:00:292
586970992414,3cyclictest32-21ksoftirqd/208:55:212
586970992414,3cyclictest32-21ksoftirqd/208:55:212
586970992414,3cyclictest32-21ksoftirqd/207:13:282
58696699246,6cyclictest24-21ksoftirqd/107:40:181
58696699243,7cyclictest0-21swapper/107:10:151
58696699243,5cyclictest24-21ksoftirqd/109:55:221
586966992414,6cyclictest0-21swapper/107:25:261
58697099236,7cyclictest131rcu_preempt11:35:162
58696699234,6cyclictest0-21swapper/110:45:221
58697099224,3cyclictest131rcu_preempt08:00:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional