You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sun Apr 26, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
323301994818,26cyclictest433798-21cron12:30:000
323301994715,6cyclictest0-21swapper/009:00:000
323301994618,25cyclictest434673-21grep12:30:220
323301994615,5cyclictest330752-1kworker/0:0H+kblockd08:20:010
32330199460,8cyclictest398246-21cpu10:45:140
323305994521,6cyclictest131rcu_preempt07:10:131
323301994413,8cyclictest121ktimers/010:40:120
323301994413,3cyclictest0-21swapper/011:30:210
323309994332,7cyclictest414625-21grep11:30:262
323301994315,24cyclictest0-21swapper/007:55:010
323314994232,6cyclictest388609-21grep10:15:263
323301994230,8cyclictest353026-21sh08:35:010
323301994213,3cyclictest0-21swapper/007:20:010
323309994132,4cyclictest0-21swapper/209:10:012
323309994130,9cyclictest311ktimers/207:25:132
32330199411,3cyclictest365060-21latency_hist09:10:020
323309994029,8cyclictest406519-21idleruntime-cro11:10:002
323309994028,8cyclictest412878-21grep11:25:242
323309994028,8cyclictest412878-21grep11:25:242
323305994029,8cyclictest404814-21cron11:05:001
323301994033,4cyclictest409944-21sendmail11:19:590
323301994014,3cyclictest392894-21fschecks_time10:30:170
323309993932,3cyclictest351337-21idleruntime-cro08:30:012
323301993927,7cyclictest386933-21grep10:10:250
32330199391,17cyclictest359990-21wc08:55:010
32330199391,17cyclictest359990-21wc08:55:010
32330599384,5cyclictest131rcu_preempt10:10:131
323305993830,4cyclictest0-21swapper/109:45:171
323305993830,4cyclictest0-21swapper/107:49:161
323305993829,6cyclictest0-21swapper/108:00:011
323305993827,8cyclictest418464-21audit_send_reply11:45:011
323301993828,7cyclictest413333-21cron11:30:000
323301993828,7cyclictest413333-21cron11:30:000
323301993828,7cyclictest376449-21grep09:40:260
323301993818,16cyclictest13550irq/42-30be0000.ethernet10:20:110
323314993729,5cyclictest0-21swapper/311:40:003
323314993725,8cyclictest400997-21grep10:50:263
323309993728,4cyclictest0-21swapper/210:40:012
323309993728,4cyclictest0-21swapper/210:40:002
323309993726,7cyclictest326768-21grep07:15:272
323305993727,7cyclictest424858-21grep12:00:271
323301993729,4cyclictest0-21swapper/008:00:010
323301993715,4cyclictest0-21swapper/012:20:260
323314993629,5cyclictest387106-21kworker/u8:2+events_unbound10:58:413
323314993620,11cyclictest391ktimers/312:15:133
323301993627,6cyclictest383493-21grep10:00:230
323301993627,5cyclictest356031-21unixbench_singl08:40:260
323301993624,7cyclictest0-21swapper/009:35:260
323314993523,4cyclictest308628-21kworker/u8:0+events_unbound08:09:223
323309993527,4cyclictest0-21swapper/210:05:172
323309993526,4cyclictest0-21swapper/207:50:262
323305993527,4cyclictest0-21swapper/109:35:171
323305993526,6cyclictest0-21swapper/110:00:001
323301993528,4cyclictest0-21swapper/010:40:000
323301993528,4cyclictest0-21swapper/010:40:000
323314993426,4cyclictest0-21swapper/309:40:003
323314993423,7cyclictest0-21swapper/311:45:003
323314993423,7cyclictest0-21swapper/311:05:003
323314993421,8cyclictest371349-21tail09:25:253
323309993426,4cyclictest0-21swapper/207:10:262
323309993424,7cyclictest0-21swapper/211:40:002
323309993424,6cyclictest0-21swapper/209:40:252
323305993427,4cyclictest0-21swapper/107:40:001
323305993426,4cyclictest0-21swapper/111:10:241
323305993421,9cyclictest349564-21sshd08:24:231
323314993327,3cyclictest361576-21sendmail09:00:003
323314993326,5cyclictest382190-21kworker/u8:0+events_unbound10:04:443
323314993324,5cyclictest382219-21cron10:00:003
323309993326,3cyclictest0-21swapper/211:10:162
323309993326,3cyclictest0-21swapper/211:00:012
323309993325,4cyclictest331904-21grep07:30:252
323309993325,4cyclictest0-21swapper/209:20:002
323309993312,5cyclictest32-21ksoftirqd/210:45:212
323305993327,4cyclictest409606-21kworker/u8:3+events_unbound12:35:161
323305993326,4cyclictest0-21swapper/112:20:001
323305993326,4cyclictest0-21swapper/107:15:181
323305993324,5cyclictest0-21swapper/111:20:051
323305993323,6cyclictest0-21swapper/109:25:241
323314993223,6cyclictest0-21swapper/307:20:003
323314993223,5cyclictest0-21swapper/309:15:263
323314993222,7cyclictest387341-21sh10:15:013
323309993223,6cyclictest346651-21fschecks_time08:15:182
323305993223,4cyclictest0-21swapper/109:00:141
32330199321,18cyclictest0-21swapper/008:36:480
323314993124,4cyclictest0-21swapper/310:25:173
323314993120,8cyclictest398005-21auditctl10:45:013
323314993120,7cyclictest373021-21grep09:30:243
323314993120,6cyclictest0-21swapper/311:50:253
32330999316,5cyclictest32-21ksoftirqd/210:05:012
323305993123,5cyclictest0-21swapper/110:59:561
323301993113,14cyclictest0-21swapper/012:39:590
32330199310,18cyclictest0-21swapper/008:28:010
32330999309,7cyclictest32-21ksoftirqd/208:05:232
32330999309,6cyclictest32-21ksoftirqd/210:50:162
323309993022,4cyclictest0-21swapper/209:45:262
323309993021,6cyclictest0-21swapper/212:10:282
323309993021,4cyclictest0-21swapper/211:00:252
323309993011,6cyclictest32-21ksoftirqd/207:45:142
323309993010,11cyclictest32-21ksoftirqd/209:30:192
323301993023,3cyclictest0-21swapper/008:10:250
323301993022,5cyclictest0-21swapper/007:30:010
323301993021,4cyclictest0-21swapper/009:29:360
323301993018,8cyclictest335789-21idleruntime-cro07:45:000
323301993018,8cyclictest335789-21idleruntime-cro07:45:000
323301993013,3cyclictest0-21swapper/010:29:100
323314992925,2cyclictest308628-21kworker/u8:0+events_unbound07:34:153
323314992923,4cyclictest399325-21kworker/u8:0+events_unbound11:45:093
32331499291,4cyclictest131rcu_preempt11:15:133
32330999299,7cyclictest32-21ksoftirqd/211:50:172
32330999298,11cyclictest32-21ksoftirqd/208:40:272
32330999295,5cyclictest32-21ksoftirqd/208:05:022
32330599297,3cyclictest131rcu_preempt11:50:131
323305992922,4cyclictest0-21swapper/112:20:261
323305992921,4cyclictest0-21swapper/109:19:351
323305992915,11cyclictest231ktimers/109:10:121
32330599291,3cyclictest382476-21apt-get10:00:121
323305992911,5cyclictest345975-21kworker/u8:1+events_unbound08:15:431
323301992921,5cyclictest349642-21munin-plugin-st08:25:010
323301992917,8cyclictest384320-21fschecks_count10:05:170
323314992821,4cyclictest433939-21runrttasks12:30:013
323314992821,3cyclictest0-21swapper/310:35:003
323314992821,3cyclictest0-21swapper/308:30:263
323314992820,5cyclictest0-21swapper/307:20:253
323314992817,8cyclictest384284-21df10:05:153
32330999287,6cyclictest0-21swapper/210:20:222
323309992821,3cyclictest0-21swapper/208:40:012
323309992820,5cyclictest0-21swapper/212:30:002
323309992820,4cyclictest0-21swapper/208:25:002
323309992810,3cyclictest131rcu_preempt11:21:272
323309992810,11cyclictest131rcu_preempt08:45:162
323305992822,3cyclictest0-21swapper/110:20:201
323305992821,4cyclictest351329-21auditctl08:30:001
323305992821,4cyclictest0-21swapper/109:05:251
323305992818,7cyclictest344076-21grep08:05:271
323301992820,4cyclictest0-21swapper/007:30:160
323314992720,4cyclictest364977-21grep09:10:003
323314992720,3cyclictest0-21swapper/308:40:003
323314992719,5cyclictest308628-21kworker/u8:0+events_unbound07:39:163
323314992719,4cyclictest0-21swapper/308:15:273
323314992719,4cyclictest0-21swapper/307:40:273
323314992719,4cyclictest0-21swapper/307:40:263
323314992718,6cyclictest0-21swapper/307:55:263
32330999279,7cyclictest32-21ksoftirqd/212:30:102
32330999278,5cyclictest32-21ksoftirqd/211:45:212
32330999278,5cyclictest32-21ksoftirqd/210:25:252
32330999277,4cyclictest301rcuc/209:35:262
323309992721,3cyclictest0-21swapper/212:40:002
323309992719,4cyclictest0-21swapper/212:10:012
323309992717,7cyclictest340117-21sed07:55:192
323309992716,6cyclictest0-21swapper/208:55:262
323305992720,5cyclictest330597-21kworker/u8:1+events_unbound07:29:331
323305992720,4cyclictest0-21swapper/112:05:251
323305992717,7cyclictest373024-21unixbench_multi09:30:251
323305992715,9cyclictest231ktimers/110:15:111
323301992719,5cyclictest0-21swapper/009:10:160
323301992718,5cyclictest406526-21idleruntime-cro11:10:000
323301992717,7cyclictest417230-21tune2fs11:40:150
323314992620,4cyclictest345975-21kworker/u8:1+events_unbound08:21:383
323314992619,5cyclictest396000-21kworker/u8:3+events_unbound11:10:023
323314992619,4cyclictest0-21swapper/312:10:273
323314992619,4cyclictest0-21swapper/308:45:273
323314992618,5cyclictest0-21swapper/307:25:183
323314992618,4cyclictest0-21swapper/307:50:273
32330999269,8cyclictest0-21swapper/209:50:182
32330999265,4cyclictest3451662latency08:10:182
323309992620,3cyclictest0-21swapper/211:15:282
323309992618,4cyclictest366238-21grep09:10:252
323309992614,7cyclictest131rcu_preempt11:57:132
323309992614,3cyclictest131rcu_preempt11:43:382
323309992612,4cyclictest131rcu_preempt12:20:112
323305992620,4cyclictest350418-21kworker/u8:3+events_unbound08:51:451
323305992620,4cyclictest350418-21kworker/u8:3+events_unbound08:51:441
323305992620,3cyclictest0-21swapper/110:40:201
323305992619,5cyclictest409606-21kworker/u8:3+events_unbound11:25:111
323305992619,5cyclictest409606-21kworker/u8:3+events_unbound11:25:111
323305992618,4cyclictest0-21swapper/108:10:251
323305992613,4cyclictest384183-21kworker/u8:1+events_unbound10:30:541
32330599261,12cyclictest0-21swapper/110:54:541
32330199266,5cyclictest407362-21/usr/sbin/munin11:10:220
323301992619,4cyclictest0-21swapper/009:50:260
323314992519,4cyclictest399325-21kworker/u8:0+events_unbound12:04:133
323314992519,3cyclictest0-21swapper/311:25:003
323314992519,3cyclictest0-21swapper/309:10:243
323314992518,4cyclictest337218-21grep07:45:253
323314992517,4cyclictest0-21swapper/309:20:273
32330999251,8cyclictest32-21ksoftirqd/210:10:202
323309992512,5cyclictest131rcu_preempt07:40:142
323309992512,5cyclictest131rcu_preempt07:40:142
323309992512,4cyclictest131rcu_preempt10:15:462
32330599257,5cyclictest324758-21kworker/u8:2+events_unbound07:21:281
323305992519,4cyclictest409606-21kworker/u8:3+events_unbound12:26:401
323305992519,4cyclictest330597-21kworker/u8:1+events_unbound07:51:421
323305992519,4cyclictest330597-21kworker/u8:1+events_unbound07:30:411
323305992518,5cyclictest409606-21kworker/u8:3+events_unbound12:10:211
323305992518,4cyclictest0-21swapper/109:50:251
323305992517,5cyclictest0-21swapper/110:45:271
323305992517,4cyclictest396086-21sendmail10:40:001
323305992517,4cyclictest396086-21sendmail10:40:001
323305992516,7cyclictest406508-21cron11:09:591
323305992514,7cyclictest409935-21seq11:20:001
32330599251,12cyclictest0-21swapper/111:30:591
323301992519,3cyclictest0-21swapper/009:50:010
323301992517,4cyclictest438-21cron09:35:000
323301992516,6cyclictest370206-21sort09:25:010
323301992516,5cyclictest428677-21cron12:15:000
323301992515,7cyclictest336309-21awk07:45:140
323301992515,6cyclictest344500-21sh08:10:000
323314992418,4cyclictest399325-21kworker/u8:0+events_unbound12:05:103
323314992418,4cyclictest350418-21kworker/u8:3+events_unbound08:52:213
323314992418,4cyclictest350418-21kworker/u8:3+events_unbound08:52:213
323314992418,3cyclictest0-21swapper/312:30:233
323314992417,3cyclictest0-21swapper/311:05:163
323314992416,5cyclictest415033-21cron11:35:003
323314992414,7cyclictest345245-21cat08:10:193
323314992410,9cyclictest391ktimers/307:10:133
32331499240,4cyclictest131rcu_preempt09:55:003
32330999249,4cyclictest131rcu_preempt09:55:152
32330999248,4cyclictest131rcu_preempt10:30:482
32330999246,11cyclictest0-21swapper/208:30:152
32330999245,4cyclictest0-21swapper/209:25:172
32330999244,5cyclictest32-21ksoftirqd/210:40:012
323309992418,3cyclictest0-21swapper/212:15:152
323309992412,4cyclictest0-21swapper/208:50:222
323309992412,4cyclictest0-21swapper/208:50:212
323309992410,11cyclictest362139-21/usr/sbin/munin09:00:162
323305992417,4cyclictest0-21swapper/111:45:261
32330599241,11cyclictest0-21swapper/108:59:431
323301992416,5cyclictest0-21swapper/007:20:260
32330199241,20cyclictest428937-21grep12:15:130
32330199241,19cyclictest0-21swapper/011:57:140
32330199241,19cyclictest0-21swapper/010:59:540
323314992316,5cyclictest399325-21kworker/u8:0+events_unbound11:58:413
323314992316,5cyclictest399325-21kworker/u8:0+events_unbound11:26:413
323314992316,5cyclictest399325-21kworker/u8:0+events_unbound11:26:413
323314992316,4cyclictest0-21swapper/310:20:243
323314992315,4cyclictest0-21swapper/312:20:263
32331499231,4cyclictest362243-21meminfo09:00:163
323314992313,7cyclictest377963-21cat09:45:263
32331499231,11cyclictest350487-21ps08:25:243
32330999233,8cyclictest32-21ksoftirqd/207:35:142
32330999232,12cyclictest0-21swapper/207:21:412
323305992317,4cyclictest350418-21kworker/u8:3+events_unbound08:40:161
323305992317,3cyclictest0-21swapper/109:20:181
323305992316,5cyclictest409606-21kworker/u8:3+events_unbound12:34:451
323305992316,4cyclictest0-21swapper/110:25:261
323301992316,5cyclictest323295-21cyclictest11:35:110
323301992316,3cyclictest0-21swapper/012:08:100
32330199231,19cyclictest0-21swapper/011:54:000
32330199231,18cyclictest0-21swapper/011:04:180
32330199230,19cyclictest0-21swapper/010:17:140
323314992213,6cyclictest391ktimers/312:35:123
323305992215,4cyclictest342376-21grep08:00:251
323305992214,5cyclictest231ktimers/108:30:161
323301992217,3cyclictest0-21swapper/011:20:200
323301992215,4cyclictest0-21swapper/009:15:170
323301992215,3cyclictest0-21swapper/009:59:090
323301992214,5cyclictest420169-21idleruntime-cro11:50:010
32330199221,17cyclictest0-21swapper/008:46:050
32330199220,18cyclictest0-21swapper/012:01:530
32330199220,18cyclictest0-21swapper/009:03:420
32330199220,18cyclictest0-21swapper/007:35:290
323314992112,5cyclictest0-21swapper/308:40:163
323314992111,6cyclictest342800-21cron08:05:013
32331499211,12cyclictest0-21swapper/310:45:243
323305992114,5cyclictest308628-21kworker/u8:0+events_unbound08:35:151
323305992113,5cyclictest0-21swapper/108:45:261
323314992010,7cyclictest375803-21sed09:40:193
32330599209,8cyclictest334812-21cat07:40:221
32330599209,8cyclictest334812-21cat07:40:221
323305992013,4cyclictest0-21swapper/111:55:161
323305992011,6cyclictest376923-21basename09:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional