You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 14:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri Jul 31, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3064266995929,10cyclictest231ktimers/120:10:111
3064262995344,7cyclictest121ktimers/023:00:170
3064262995339,10cyclictest121ktimers/020:05:120
3064275995239,9cyclictest391ktimers/322:25:113
3064275994738,4cyclictest3088686-21idleruntime-cro20:20:013
3064275994537,6cyclictest3164501-21kworker/u8:1+events_unbound00:17:323
3064275994537,6cyclictest3164501-21kworker/u8:1+events_unbound00:17:323
3064275994438,4cyclictest3164501-21kworker/u8:1+events_unbound00:07:293
3064266994434,6cyclictest3157340-21grep23:35:261
3064275994331,7cyclictest0-21swapper/319:15:003
3064266994329,11cyclictest231ktimers/119:15:141
3064262994332,7cyclictest3150296-21grep23:15:260
3064275994229,9cyclictest391ktimers/320:05:133
3064275994224,4cyclictest145-21jbd2/mmcblk1p2-800:25:283
3064266994232,7cyclictest3150232-21grep23:15:261
3064262994233,4cyclictest0-21swapper/020:20:010
3064262994219,6cyclictest121ktimers/019:41:260
3064262994211,24cyclictest131rcu_preempt19:35:170
3064275994135,4cyclictest3162758-21kworker/u8:2+events_unbound23:57:273
3064262994135,4cyclictest3126345-21kworker/u8:0+events_unbound22:22:060
3064262994129,5cyclictest131rcu_preempt21:21:560
3064262994123,14cyclictest0-21swapper/021:00:020
3064275994034,4cyclictest3162758-21kworker/u8:2+events_unbound00:12:313
3064275994034,4cyclictest3071516-21kworker/u8:2+events_unbound19:41:353
3064275994030,7cyclictest3131751-21sed22:25:013
3064275994028,8cyclictest3116187-21idleruntime-cro21:40:003
3064271994034,4cyclictest3133690-21sshd22:30:122
3064266994032,4cyclictest0-21swapper/121:10:001
3064262994030,7cyclictest3117442-21grep21:40:260
3064262993932,4cyclictest3068211-21sendmail19:20:000
3064262993929,6cyclictest0-21swapper/022:00:000
3064262993929,6cyclictest0-21swapper/022:00:000
3064275993832,4cyclictest3090268-21kworker/u8:2+events_unbound20:31:443
3064271993829,5cyclictest0-21swapper/222:01:592
3064262993831,3cyclictest3109373-21sendmail21:20:000
3064262993827,8cyclictest121ktimers/022:25:120
3064262993819,5cyclictest131rcu_preempt22:10:180
3064275993729,4cyclictest0-21swapper/321:20:003
3064275993727,7cyclictest3098709-21grep20:45:243
3064275993726,7cyclictest0-21swapper/323:15:263
3064275993725,5cyclictest131rcu_preempt19:25:233
3064275993725,5cyclictest131rcu_preempt19:25:233
3064275993723,7cyclictest131rcu_preempt00:32:443
3064275993722,9cyclictest131rcu_preempt22:42:153
3064275993719,11cyclictest131rcu_preempt20:59:043
3064275993715,19cyclictest391ktimers/323:12:363
3064271993725,9cyclictest311ktimers/222:20:122
3064262993731,4cyclictest3147294-21kworker/u8:0+events_unbound23:12:140
3064262993731,4cyclictest3062135-21kworker/u8:2+events_unbound19:21:350
3064262993731,4cyclictest3062135-21kworker/u8:2+events_unbound19:21:340
3064262993730,4cyclictest0-21swapper/020:55:010
3064262993728,4cyclictest0-21swapper/022:45:260
3064262993724,10cyclictest121ktimers/020:10:120
3064262993717,17cyclictest121ktimers/023:30:000
3064262993717,17cyclictest121ktimers/023:30:000
3064262993717,10cyclictest131rcu_preempt23:55:150
3064262993717,10cyclictest131rcu_preempt23:05:200
3064275993620,13cyclictest391ktimers/323:52:503
3064266993624,8cyclictest3071194-21grep19:25:261
3064266993624,8cyclictest3071194-21grep19:25:261
3064262993630,4cyclictest3135136-21kworker/u8:1+events_unbound22:37:100
3064262993629,4cyclictest0-21swapper/021:40:000
3064262993626,6cyclictest3120900-21grep21:50:280
3064275993526,6cyclictest3120846-21grep21:50:283
3064275993515,9cyclictest131rcu_preempt21:42:053
3064275993514,5cyclictest131rcu_preempt00:38:153
3064275993513,11cyclictest131rcu_preempt23:20:523
3064271993527,4cyclictest0-21swapper/223:45:252
3064271993527,4cyclictest0-21swapper/220:40:152
3064271993525,7cyclictest3178690-21sendmail00:40:002
306426699357,15cyclictest0-21swapper/100:22:301
3064266993527,4cyclictest0-21swapper/121:40:281
3064266993521,10cyclictest231ktimers/120:30:121
3064262993529,4cyclictest3152140-21kworker/u8:1+events_unbound23:22:180
3064262993523,5cyclictest3135136-21kworker/u8:1-events_freezable_power_22:44:230
3064262993520,8cyclictest131rcu_preempt23:45:130
3064262993520,5cyclictest131rcu_preempt22:55:570
3064262993519,7cyclictest131rcu_preempt20:45:160
3064262993519,5cyclictest131rcu_preempt20:30:240
3064262993517,15cyclictest121ktimers/000:35:220
3064262993513,10cyclictest131rcu_preempt20:24:140
3064262993513,10cyclictest131rcu_preempt20:24:140
3064275993425,5cyclictest0-21swapper/323:42:203
3064275993425,5cyclictest0-21swapper/323:25:283
3064275993425,5cyclictest0-21swapper/323:25:283
3064275993420,4cyclictest131rcu_preempt19:48:253
3064275993419,4cyclictest131rcu_preempt20:40:283
3064275993419,4cyclictest131rcu_preempt19:51:453
3064275993417,10cyclictest3115810-21kworker/u8:0+events_unbound21:56:253
3064275993417,10cyclictest3115810-21kworker/u8:0+events_unbound21:56:253
3064275993417,10cyclictest3081606-21kworker/u8:1+events_unbound20:03:453
3064275993415,4cyclictest131rcu_preempt20:52:563
3064275993414,10cyclictest131rcu_preempt23:02:473
3064271993425,4cyclictest0-21swapper/221:55:282
3064271993425,4cyclictest0-21swapper/221:55:272
3064271993424,6cyclictest0-21swapper/222:45:262
3064266993425,6cyclictest0-21swapper/123:05:001
3064266993423,8cyclictest3153950-21grep23:25:291
3064266993423,8cyclictest3153950-21grep23:25:281
3064262993426,3cyclictest0-21swapper/022:35:000
306426299342,10cyclictest3114473-21debian-sa121:35:000
3064262993416,4cyclictest131rcu_preempt22:16:510
3064262993416,11cyclictest131rcu_preempt23:40:190
3064262993416,10cyclictest131rcu_preempt23:32:250
3064262993414,9cyclictest131rcu_preempt00:29:130
306427599338,7cyclictest40-21ksoftirqd/323:35:013
3064275993326,4cyclictest0-21swapper/300:05:003
3064275993322,7cyclictest391ktimers/319:20:003
3064275993319,4cyclictest131rcu_preempt20:14:023
3064275993316,9cyclictest131rcu_preempt21:00:193
3064275993316,5cyclictest131rcu_preempt22:10:263
3064275993316,10cyclictest131rcu_preempt19:35:223
3064275993315,9cyclictest131rcu_preempt22:57:003
3064275993315,10cyclictest131rcu_preempt22:45:133
3064275993310,12cyclictest40-21ksoftirqd/319:30:183
3064275993310,12cyclictest40-21ksoftirqd/319:30:183
306427199335,5cyclictest131rcu_preempt20:45:112
3064271993326,4cyclictest3151956-21unixbench_multi23:20:262
3064266993326,4cyclictest0-21swapper/100:35:281
3064266993323,7cyclictest3102041-21grep20:55:271
3064262993326,4cyclictest3065901-21idleruntime-cro19:15:000
3064262993325,4cyclictest0-21swapper/022:05:260
3064262993325,4cyclictest0-21swapper/000:10:300
3064262993321,5cyclictest131rcu_preempt20:40:000
3064262993318,5cyclictest131rcu_preempt00:10:000
3064262993314,10cyclictest131rcu_preempt21:02:310
3064262993313,5cyclictest131rcu_preempt20:00:170
3064262993311,10cyclictest131rcu_preempt21:49:430
306427599329,15cyclictest40-21ksoftirqd/322:00:203
3064275993219,5cyclictest131rcu_preempt20:35:163
3064275993219,4cyclictest131rcu_preempt21:45:203
3064275993216,9cyclictest131rcu_preempt22:31:533
3064275993213,9cyclictest131rcu_preempt22:37:553
3064275993213,11cyclictest131rcu_preempt22:19:483
3064275993213,11cyclictest131rcu_preempt19:20:133
3064275993213,11cyclictest131rcu_preempt19:20:123
3064275993212,9cyclictest131rcu_preempt20:28:193
3064275993212,11cyclictest40-21ksoftirqd/322:05:233
3064275993211,13cyclictest131rcu_preempt21:27:163
3064271993225,4cyclictest0-21swapper/220:25:162
3064266993224,4cyclictest0-21swapper/100:30:161
3064266993221,7cyclictest0-21swapper/122:35:251
3064262993218,5cyclictest131rcu_preempt20:40:150
3064262993215,9cyclictest131rcu_preempt21:08:520
3064262993215,4cyclictest0-21swapper/000:22:430
3064262993212,5cyclictest131rcu_preempt00:00:240
3064275993123,5cyclictest0-21swapper/322:50:153
3064275993121,7cyclictest3089290-21fschecks_count20:20:163
3064275993121,7cyclictest3089290-21fschecks_count20:20:163
3064275993117,4cyclictest131rcu_preempt21:06:203
3064275993116,4cyclictest131rcu_preempt00:21:183
3064275993114,4cyclictest131rcu_preempt21:12:063
3064275993114,12cyclictest3112754-21kworker/u8:1-events_freezable_power_21:30:393
3064275993112,9cyclictest131rcu_preempt23:45:203
3064275993111,11cyclictest131rcu_preempt19:58:223
3064271993124,4cyclictest0-21swapper/220:20:022
3064266993123,4cyclictest0-21swapper/121:50:271
3064262993124,4cyclictest0-21swapper/019:30:270
3064262993124,4cyclictest0-21swapper/019:30:270
3064262993121,7cyclictest121ktimers/022:00:200
3064262993118,5cyclictest131rcu_preempt19:50:150
3064262993117,4cyclictest131rcu_preempt00:15:240
3064262993117,4cyclictest131rcu_preempt00:15:240
3064262993115,9cyclictest131rcu_preempt22:52:190
3064262993114,9cyclictest131rcu_preempt21:10:160
3064262993114,4cyclictest131rcu_preempt23:51:360
3064262993114,11cyclictest131rcu_preempt19:45:240
3064262993112,11cyclictest131rcu_preempt19:55:230
3064262993111,9cyclictest131rcu_preempt19:25:410
3064262993111,9cyclictest131rcu_preempt19:25:410
3064275993014,9cyclictest131rcu_preempt21:20:183
3064271993024,4cyclictest3093735-21kworker/u8:0+events_unbound20:56:512
3064271993023,3cyclictest0-21swapper/200:25:172
3064271993020,7cyclictest3064256-21cyclictest00:20:002
3064271993020,7cyclictest3064256-21cyclictest00:20:002
306427199301,6cyclictest131rcu_preempt00:00:132
3064266993022,5cyclictest3162663-21unixbench_singl23:50:251
3064266993022,5cyclictest3147304-21cron23:10:001
3064262993016,4cyclictest131rcu_preempt23:37:420
3064262993012,4cyclictest131rcu_preempt20:27:180
3064275992910,10cyclictest131rcu_preempt23:05:253
3064271992922,4cyclictest3093735-21kworker/u8:0+events_unbound21:04:432
3064271992922,4cyclictest0-21swapper/200:30:262
3064271992921,5cyclictest0-21swapper/222:35:252
3064271992920,5cyclictest0-21swapper/221:05:152
306427199291,5cyclictest131rcu_preempt23:05:152
3064266992923,4cyclictest3097289-21kworker/u8:2+events_unbound20:51:471
3064266992921,4cyclictest0-21swapper/122:25:011
3064266992921,4cyclictest0-21swapper/100:30:001
3064262992917,4cyclictest131rcu_preempt21:25:160
3064262992913,4cyclictest131rcu_preempt00:31:470
3064271992821,4cyclictest0-21swapper/221:30:162
3064266992821,4cyclictest0-21swapper/122:15:151
3064266992820,5cyclictest3156055-21idleruntime-cro23:35:001
3064266992819,6cyclictest3152443-21munin-plugin-st23:25:001
3064266992817,7cyclictest3103825-21grep21:00:261
3064271992721,3cyclictest0-21swapper/222:10:252
3064271992721,3cyclictest0-21swapper/200:10:012
3064271992720,5cyclictest0-21swapper/220:05:132
3064271992720,4cyclictest311ktimers/222:50:122
3064266992717,6cyclictest0-21swapper/119:45:001
3064271992620,4cyclictest3062135-21kworker/u8:2+events_unbound19:11:352
3064271992619,5cyclictest3107480-21kworker/u8:0+events_unbound21:16:532
3064271992618,5cyclictest0-21swapper/221:50:002
3064271992618,5cyclictest0-21swapper/220:50:252
3064271992617,6cyclictest3071186-21grep19:25:262
3064271992617,6cyclictest3071186-21grep19:25:252
306426699262,20cyclictest629-21snmpd19:35:121
3064266992618,4cyclictest0-21swapper/122:25:261
3064266992618,4cyclictest0-21swapper/120:15:241
3064266992617,6cyclictest0-21swapper/100:10:001
3064266992616,7cyclictest3095698-21sh20:40:001
3064266992616,7cyclictest204-21dbus-daemon00:12:291
3064266992616,6cyclictest3066091-21latency_hist19:15:011
306427199259,3cyclictest3094228-21/usr/sbin/munin20:35:162
306427199256,7cyclictest131rcu_preempt23:40:002
306427199254,3cyclictest131rcu_preempt23:55:272
3064271992518,4cyclictest311ktimers/200:12:462
3064271992518,3cyclictest0-21swapper/221:40:262
3064271992517,5cyclictest3081866-21sendmail20:00:012
306427199251,13cyclictest0-21swapper/223:15:192
3064266992519,3cyclictest3081837-21cron20:00:011
3064266992518,4cyclictest0-21swapper/123:00:021
3064266992518,4cyclictest0-21swapper/120:25:251
3064266992516,6cyclictest0-21swapper/122:00:001
3064266992516,6cyclictest0-21swapper/122:00:001
3064271992418,4cyclictest3161021-21kworker/u8:0+events_unbound23:52:542
3064271992418,3cyclictest0-21swapper/223:10:112
3064271992418,3cyclictest0-21swapper/222:05:172
3064271992418,3cyclictest0-21swapper/219:40:242
3064271992418,3cyclictest0-21swapper/200:20:182
3064271992416,6cyclictest145-21jbd2/mmcblk1p2-821:29:052
3064271992416,5cyclictest0-21swapper/223:00:302
3064271992415,6cyclictest3068195-21sh19:20:002
3064266992417,4cyclictest3166502-21sh00:05:001
3064266992417,3cyclictest0-21swapper/122:30:241
3064266992416,5cyclictest3112774-21latency_hist21:30:001
3064266992415,5cyclictest0-21swapper/122:50:151
306427199239,12cyclictest3064256-21cyclictest22:25:112
306427199232,9cyclictest131rcu_preempt20:00:252
306427199231,8cyclictest3086956-21cron20:15:012
3064271992317,3cyclictest0-21swapper/223:40:192
3064271992317,3cyclictest0-21swapper/221:35:172
3064271992317,3cyclictest0-21swapper/220:30:242
3064271992316,5cyclictest0-21swapper/223:30:262
3064271992316,3cyclictest0-21swapper/222:15:242
3064271992315,6cyclictest3102213-21kworker/u8:1+events_unbound21:11:532
3064271992315,4cyclictest0-21swapper/219:25:002
3064271992315,4cyclictest0-21swapper/219:25:002
3064266992315,5cyclictest0-21swapper/120:05:161
3064266992313,7cyclictest3077122-21cut19:45:151
3064266992313,7cyclictest231ktimers/121:35:141
3064266992312,8cyclictest3108080-21cut21:15:191
3064271992216,3cyclictest0-21swapper/220:20:202
3064271992216,3cyclictest0-21swapper/220:20:202
3064271992216,3cyclictest0-21swapper/219:35:012
3064271992216,3cyclictest0-21swapper/219:35:012
3064271992215,4cyclictest3135136-21kworker/u8:1+events_unbound22:55:272
3064271992214,6cyclictest3138791-21latency_hist22:45:002
3064266992216,3cyclictest3163693-21latency23:55:191
3064266992215,4cyclictest438-21cron22:05:011
3064266992215,4cyclictest3068681-21fschecks_time19:20:161
3064266992215,4cyclictest3068681-21fschecks_time19:20:161
3064266992215,3cyclictest0-21swapper/120:00:171
3064266992214,4cyclictest0-21swapper/123:45:151
3064266992213,6cyclictest0-21swapper/122:50:001
3064271992115,4cyclictest311ktimers/221:20:122
3064271992114,4cyclictest0-21swapper/223:25:272
3064271992114,4cyclictest0-21swapper/223:25:272
3064271992113,6cyclictest3078125-21kworker/u8:1+events_unbound19:50:132
306427199211,12cyclictest0-21swapper/219:46:112
3064266992115,3cyclictest0-21swapper/119:50:221
3064266992110,9cyclictest3170435-21awk00:15:141
3064266992110,9cyclictest3170435-21awk00:15:131
3064271992013,5cyclictest311ktimers/221:50:162
3064266992015,2cyclictest0-21swapper/121:35:001
3064266992014,4cyclictest3109602-21/usr/sbin/munin21:20:221
3064266992014,3cyclictest0-21swapper/121:10:261
3064266992013,5cyclictest231ktimers/122:10:131
3064266992013,4cyclictest3147842-21if_eth023:10:171
3064266992013,4cyclictest3126565-21latency_hist22:10:001
3064266992010,7cyclictest3137623-21if_eth122:40:161
3064266991911,5cyclictest231ktimers/121:45:121
3064266991910,6cyclictest3090069-21/usr/sbin/munin20:20:261
3064266991910,6cyclictest3090069-21/usr/sbin/munin20:20:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional