You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 07:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Fri Mar 27, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3029036996639,22cyclictest121ktimers/023:05:110
3029036996639,22cyclictest121ktimers/023:05:110
3029044995846,8cyclictest3044673-21grep19:50:252
3029036995443,6cyclictest3119581-21unixbench_singl23:45:260
3029041995143,5cyclictest3085235-21cat22:00:001
3029044995041,5cyclictest3081382-21cron21:40:002
3029047994943,4cyclictest3046892-21kworker/u8:0+events_unbound20:07:453
3029047994943,4cyclictest3046892-21kworker/u8:0+events_unbound20:07:443
3029047994943,4cyclictest3034487-21kworker/u8:1+events_unbound19:37:383
3029036994840,5cyclictest438-21cron23:00:000
3029047994739,5cyclictest3106129-21cron23:09:593
3029047994739,5cyclictest3106129-21cron23:09:593
3029036994514,6cyclictest0-21swapper/022:40:000
302904499442,11cyclictest30325152grep19:15:322
3029036994435,5cyclictest3087588-21ls22:10:010
3029047994332,5cyclictest3100802-21kworker/u8:0+events_unbound22:53:173
3029041994331,9cyclictest231ktimers/119:25:121
3029036994335,5cyclictest438-21cron20:50:010
3029047994232,7cyclictest3088877-21sendmail22:20:003
3029047994230,5cyclictest131rcu_preempt21:47:353
3029044994133,4cyclictest3077777-21munin-plugin-st21:30:012
3029041994130,8cyclictest231ktimers/120:20:131
3029036994118,3cyclictest13850irq/36-mmc122:15:010
3029044994031,6cyclictest3113174-21apt23:30:012
3029041994032,6cyclictest3087198-21kworker/u8:0+events_unbound22:23:131
3029036994013,4cyclictest3100652-1kworker/0:1H+mmc_complete23:25:010
3029044993929,7cyclictest3041104-21grep19:40:252
3029041993933,4cyclictest3088745-21kworker/u8:2+events_unbound22:28:131
3029041993931,4cyclictest0-21swapper/120:40:011
3029047993831,4cyclictest3042106-21fschecks_count19:45:153
3029047993830,5cyclictest3029024-21cyclictest00:18:343
3029047993830,4cyclictest0-21swapper/321:59:593
3029047993830,4cyclictest0-21swapper/320:45:003
3029047993816,12cyclictest131rcu_preempt20:15:003
3029047993816,12cyclictest131rcu_preempt20:15:003
3029041993831,5cyclictest3068924-21kworker/u8:3+events_unbound21:14:411
302904199380,7cyclictest0-21swapper/123:30:141
3029036993827,8cyclictest121ktimers/021:05:110
3029036993827,6cyclictest0-21swapper/000:20:260
3029036993825,10cyclictest121ktimers/023:55:140
3029047993729,4cyclictest0-21swapper/323:40:003
3029047993719,12cyclictest131rcu_preempt23:55:013
3029041993724,5cyclictest131rcu_preempt19:55:021
3029047993628,5cyclictest3067519-21apt21:00:003
3029047993620,9cyclictest0-21swapper/319:54:103
3029047993618,10cyclictest131rcu_preempt00:30:173
3029047993618,10cyclictest131rcu_preempt00:30:173
3029047993616,12cyclictest131rcu_preempt22:00:133
3029047993615,11cyclictest131rcu_preempt21:35:193
3029047993611,6cyclictest40-21ksoftirqd/320:00:013
3029044993628,4cyclictest0-21swapper/221:00:162
3029044993626,6cyclictest208-21systemd-logind20:42:502
3029041993629,5cyclictest3082775-21kworker/u8:3+events_unbound21:43:051
3029041993618,5cyclictest131rcu_preempt23:00:211
3029036993627,4cyclictest0-21swapper/021:48:050
3029036993625,7cyclictest3136791-21grep00:35:250
3029036993625,7cyclictest3136791-21grep00:35:250
3029047993519,10cyclictest131rcu_preempt00:20:253
3029047993518,9cyclictest131rcu_preempt20:15:093
3029047993518,10cyclictest391ktimers/322:30:143
3029047993512,12cyclictest131rcu_preempt21:22:353
3029044993527,5cyclictest3123337-21kworker/u8:3+events_unbound00:33:372
3029044993527,5cyclictest3123337-21kworker/u8:3+events_unbound00:33:362
3029044993525,6cyclictest0-21swapper/220:05:002
3029041993523,5cyclictest131rcu_preempt00:33:271
3029041993523,5cyclictest131rcu_preempt00:33:271
3029041993521,4cyclictest131rcu_preempt22:35:221
3029041993520,5cyclictest3073986-21kworker/u8:2+events_unbound21:22:231
302904199351,9cyclictest0-21swapper/122:45:121
3029041993519,9cyclictest131rcu_preempt00:20:201
3029041993519,4cyclictest131rcu_preempt20:05:491
3029041993519,4cyclictest131rcu_preempt20:05:481
3029041993515,5cyclictest131rcu_preempt20:15:171
3029036993527,6cyclictest121ktimers/023:35:120
3029036993524,8cyclictest3085659-21grep22:00:150
3029036993524,6cyclictest0-21swapper/021:35:010
3029036993523,7cyclictest3041121-21grep19:40:240
3029047993428,4cyclictest3068924-21kworker/u8:3+events_unbound21:17:583
3029047993424,7cyclictest391ktimers/300:10:133
3029047993423,5cyclictest131rcu_preempt22:45:253
3029047993420,4cyclictest131rcu_preempt22:55:273
3029047993420,4cyclictest131rcu_preempt19:40:213
3029047993417,4cyclictest131rcu_preempt00:28:043
3029047993417,4cyclictest131rcu_preempt00:04:533
3029047993417,10cyclictest3087198-21kworker/u8:0+events_unbound22:23:023
3029044993426,4cyclictest0-21swapper/221:20:012
3029044993425,5cyclictest0-21swapper/223:50:002
3029044993423,7cyclictest3105727-21grep23:05:262
3029044993423,7cyclictest3105727-21grep23:05:252
3029044993421,9cyclictest3137277-21tr00:40:002
3029044993421,9cyclictest3137277-21tr00:39:592
3029041993423,7cyclictest0-21swapper/119:35:001
3029041993423,7cyclictest0-21swapper/119:35:001
3029041993419,9cyclictest131rcu_preempt23:10:151
3029041993419,9cyclictest131rcu_preempt20:25:191
3029041993416,7cyclictest131rcu_preempt19:35:121
3029041993416,4cyclictest0-21swapper/122:44:351
3029041993414,12cyclictest131rcu_preempt00:20:001
3029036993427,4cyclictest0-21swapper/021:20:110
3029036993426,4cyclictest0-21swapper/021:59:590
302904799336,6cyclictest40-21ksoftirqd/322:35:263
3029047993323,7cyclictest3136793-21sed00:35:253
3029047993323,7cyclictest3136793-21sed00:35:253
3029047993322,5cyclictest131rcu_preempt23:59:183
3029047993322,4cyclictest131rcu_preempt21:10:533
3029047993320,4cyclictest131rcu_preempt23:34:383
3029047993319,4cyclictest131rcu_preempt20:48:343
3029047993319,10cyclictest391ktimers/319:15:313
3029047993315,5cyclictest131rcu_preempt23:15:263
3029047993315,11cyclictest2294756-21kworker/u8:2+events_unbound19:20:333
3029047993314,11cyclictest131rcu_preempt21:30:153
3029047993314,11cyclictest131rcu_preempt20:20:273
3029047993313,12cyclictest131rcu_preempt23:20:243
3029047993312,14cyclictest131rcu_preempt19:30:173
3029047993312,14cyclictest131rcu_preempt19:30:173
3029047993311,5cyclictest131rcu_preempt21:00:183
3029047993310,15cyclictest40-21ksoftirqd/319:30:003
3029044993325,4cyclictest0-21swapper/200:09:592
3029044993325,4cyclictest0-21swapper/200:09:592
3029044993324,6cyclictest3092539-21sort22:30:012
3029044993323,6cyclictest0-21swapper/223:20:252
3029044993322,8cyclictest3079555-21latency_hist21:35:002
302904199339,13cyclictest24-21ksoftirqd/123:45:191
302904199338,17cyclictest24-21ksoftirqd/123:05:251
302904199338,17cyclictest24-21ksoftirqd/123:05:251
3029041993324,4cyclictest3062122-21kworker/u8:2+events_unbound21:07:571
3029041993321,4cyclictest131rcu_preempt20:45:211
3029041993313,9cyclictest131rcu_preempt21:55:021
3029041993313,11cyclictest131rcu_preempt21:00:261
3029041993311,10cyclictest131rcu_preempt00:03:501
3029036993325,4cyclictest0-21swapper/020:15:320
3029036993323,7cyclictest3082677-21grep21:40:250
302904799329,15cyclictest40-21ksoftirqd/323:45:013
302904799329,12cyclictest40-21ksoftirqd/300:05:263
302904799329,12cyclictest40-21ksoftirqd/300:05:253
3029047993225,4cyclictest381rcuc/323:30:003
3029047993222,5cyclictest3097191-21grep22:40:253
3029047993216,4cyclictest131rcu_preempt23:11:413
3029047993215,4cyclictest131rcu_preempt21:52:373
3029047993215,4cyclictest131rcu_preempt21:41:033
3029047993215,4cyclictest131rcu_preempt21:09:273
3029047993213,5cyclictest131rcu_preempt20:35:013
3029047993213,11cyclictest131rcu_preempt23:03:213
3029047993211,13cyclictest131rcu_preempt19:10:233
3029044993224,4cyclictest0-21swapper/220:50:002
302904199327,14cyclictest24-21ksoftirqd/119:15:011
3029041993219,5cyclictest131rcu_preempt19:25:011
3029041993217,5cyclictest131rcu_preempt20:00:011
3029041993215,5cyclictest131rcu_preempt20:30:191
3029041993215,14cyclictest231ktimers/119:18:111
3029041993214,4cyclictest131rcu_preempt23:55:151
3029041993214,4cyclictest131rcu_preempt20:57:401
3029041993214,12cyclictest131rcu_preempt20:45:021
3029041993214,10cyclictest131rcu_preempt23:27:151
3029041993212,12cyclictest131rcu_preempt19:45:261
3029041993210,5cyclictest131rcu_preempt19:40:251
3029036993222,4cyclictest0-21swapper/023:33:260
3029047993115,9cyclictest3107715-21kworker/u8:3+events_unbound23:47:003
3029047993115,4cyclictest131rcu_preempt22:06:123
3029047993115,4cyclictest131rcu_preempt20:28:373
3029047993111,4cyclictest131rcu_preempt22:25:153
3029047993110,9cyclictest40-21ksoftirqd/320:50:243
3029047993110,11cyclictest131rcu_preempt20:00:183
3029044993124,4cyclictest3053917-21latency_hist20:20:002
3029044993124,4cyclictest0-21swapper/223:35:232
302904199319,12cyclictest24-21ksoftirqd/123:35:241
302904199319,10cyclictest24-21ksoftirqd/121:35:011
302904199318,13cyclictest24-21ksoftirqd/120:10:261
302904199318,13cyclictest24-21ksoftirqd/120:10:261
3029041993121,4cyclictest3083535-21kworker/u8:1+events_unbound22:18:111
3029041993117,5cyclictest131rcu_preempt23:50:101
3029041993115,9cyclictest131rcu_preempt22:00:251
3029041993115,5cyclictest131rcu_preempt22:53:011
3029041993115,10cyclictest131rcu_preempt22:30:201
3029041993114,11cyclictest3107715-21kworker/u8:3+events_unbound23:23:231
3029041993113,10cyclictest131rcu_preempt23:15:541
3029041993112,10cyclictest131rcu_preempt00:05:241
3029041993112,10cyclictest131rcu_preempt00:05:231
302904199310,5cyclictest0-21swapper/120:50:101
3029036993124,3cyclictest0-21swapper/021:00:000
3029036993121,6cyclictest3104446-21cut23:04:590
302904799308,12cyclictest40-21ksoftirqd/321:25:183
3029047993014,4cyclictest131rcu_preempt20:35:153
3029044993024,3cyclictest0-21swapper/200:15:012
3029044993023,4cyclictest0-21swapper/221:50:012
3029044993022,5cyclictest3130434-21sh00:20:002
3029041993020,7cyclictest0-21swapper/121:40:001
3029041993018,4cyclictest131rcu_preempt21:15:211
3029041993016,4cyclictest131rcu_preempt21:47:491
3029041993015,9cyclictest131rcu_preempt00:35:151
3029041993015,9cyclictest131rcu_preempt00:35:141
3029041993013,4cyclictest131rcu_preempt00:10:141
3029041993012,10cyclictest131rcu_preempt22:55:211
3029041993012,10cyclictest131rcu_preempt21:25:041
3029041993010,13cyclictest24-21ksoftirqd/123:40:241
3029036993020,6cyclictest0-21swapper/021:55:000
3029036993019,7cyclictest0-21swapper/019:40:000
3029047992912,4cyclictest131rcu_preempt22:12:283
3029044992922,4cyclictest0-21swapper/200:25:272
3029044992919,6cyclictest0-21swapper/200:00:302
3029044992918,7cyclictest3109086-21grep23:15:252
302904499290,6cyclictest0-21swapper/220:30:132
302904199299,7cyclictest24-21ksoftirqd/120:00:171
3029041992919,3cyclictest131rcu_preempt22:13:001
3029036992918,6cyclictest0-21swapper/023:15:260
3029044992821,3cyclictest0-21swapper/222:15:012
3029044992821,3cyclictest0-21swapper/219:15:022
3029044992820,5cyclictest3088855-21cron22:20:012
3029044992820,4cyclictest0-21swapper/223:50:162
3029044992817,8cyclictest3090117-21grep22:20:292
3029041992817,4cyclictest131rcu_preempt00:25:161
3029036992820,4cyclictest13850irq/36-mmc122:30:010
3029036992818,6cyclictest0-21swapper/019:55:000
3029036992818,6cyclictest0-21swapper/000:30:280
3029036992818,6cyclictest0-21swapper/000:30:280
3029041992717,3cyclictest131rcu_preempt22:07:101
3029036992721,4cyclictest3073863-21unixbench_multi21:15:260
3029036992720,3cyclictest0-21swapper/021:35:170
3029036992720,3cyclictest0-21swapper/019:57:390
302903699271,8cyclictest3042086-21diskstats19:45:140
302903699271,5cyclictest3049007-21apt-get20:05:150
302903699271,5cyclictest3049007-21apt-get20:05:150
3029036992713,10cyclictest204-21dbus-daemon21:28:010
3029044992620,3cyclictest0-21swapper/219:25:142
3029044992619,4cyclictest0-21swapper/222:40:262
3029044992618,4cyclictest0-21swapper/223:55:192
3029044992618,4cyclictest0-21swapper/223:00:162
3029044992618,4cyclictest0-21swapper/222:35:172
3029036992619,4cyclictest3130438-21sh00:19:590
3029036992619,4cyclictest3038097-21sh19:35:010
3029036992619,4cyclictest3038097-21sh19:35:010
3029036992617,4cyclictest0-21swapper/023:10:160
302903699261,22cyclictest3126820-21apt-get00:10:020
3029044992519,4cyclictest3100583-21unixbench_singl22:50:242
3029044992518,4cyclictest0-21swapper/221:45:012
3029044992516,6cyclictest0-21swapper/223:35:012
3029036992518,3cyclictest0-21swapper/022:55:010
302903699251,5cyclictest3071176-21apt-get21:10:130
302903699251,20cyclictest0-21swapper/019:14:280
302904499247,3cyclictest131rcu_preempt22:45:112
302904499242,4cyclictest3049010-21taskset20:05:152
302904499242,4cyclictest3049010-21taskset20:05:152
3029044992418,3cyclictest0-21swapper/222:30:212
3029044992418,3cyclictest0-21swapper/221:55:012
3029044992417,3cyclictest0-21swapper/222:10:012
3029036992418,3cyclictest0-21swapper/020:20:170
3029036992417,3cyclictest0-21swapper/019:22:160
3029036992416,5cyclictest0-21swapper/000:05:280
3029036992416,5cyclictest0-21swapper/000:05:280
302903699241,3cyclictest3111258-21apt-get23:25:030
3029036992412,7cyclictest3069236-21cron21:05:000
302903699240,20cyclictest0-21swapper/020:44:170
3029044992317,3cyclictest0-21swapper/219:20:222
3029044992316,4cyclictest0-21swapper/221:05:242
3029044992314,6cyclictest0-21swapper/220:10:262
3029044992314,6cyclictest0-21swapper/220:10:252
3029036992317,3cyclictest13550irq/42-30be0000.ethernet22:20:220
3029036992317,3cyclictest0-21swapper/023:43:290
3029036992316,3cyclictest0-21swapper/020:37:180
3029036992312,7cyclictest3035981-21grep19:25:250
302903699231,18cyclictest0-21swapper/023:50:410
302903699231,18cyclictest0-21swapper/022:31:550
302903699230,19cyclictest0-21swapper/022:46:010
302903699230,19cyclictest0-21swapper/020:14:220
302903699230,19cyclictest0-21swapper/020:14:210
302904499229,9cyclictest3107694-21sshd23:13:232
3029044992216,3cyclictest0-21swapper/223:00:002
3029044992214,5cyclictest311ktimers/220:00:002
3029044992211,7cyclictest0-21swapper/223:40:182
3029036992216,3cyclictest13550irq/42-30be0000.ethernet00:00:160
3029036992215,3cyclictest0-21swapper/022:16:000
3029036992215,3cyclictest0-21swapper/020:34:180
302903699221,17cyclictest0-21swapper/022:40:480
302903699221,17cyclictest0-21swapper/000:28:240
302903699220,20cyclictest0-21swapper/020:51:580
3029044992115,4cyclictest3085381-21latency_hist22:00:002
3029044992114,5cyclictest0-21swapper/220:55:162
3029044992114,5cyclictest0-21swapper/220:35:282
3029044992113,5cyclictest0-21swapper/220:50:152
3029044992113,5cyclictest0-21swapper/219:30:252
3029044992113,5cyclictest0-21swapper/219:30:252
3029044992014,3cyclictest3075301-21mailstats21:20:242
3029044992012,4cyclictest0-21swapper/220:20:222
3029044991914,3cyclictest3071319-21fschecks_count21:10:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional