You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 01:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Mon Jun 15, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2150587995043,5cyclictest2209571-21kworker/u8:1+events_unbound22:02:270
2150596994740,4cyclictest2161358-21munin-plugin-st19:40:012
2150587994539,4cyclictest2232095-21kworker/u8:2+events_unbound23:12:390
2150587994539,4cyclictest2232095-21kworker/u8:2+events_unbound23:12:390
2150600994432,8cyclictest2223211-21grep22:35:253
2150596994436,4cyclictest0-21swapper/220:35:012
2150596994335,6cyclictest311ktimers/223:00:112
2150591994329,10cyclictest231ktimers/123:50:121
2150587994033,4cyclictest2161368-21sendmail19:40:000
2150587994030,6cyclictest0-21swapper/023:17:400
2150587994030,6cyclictest0-21swapper/023:17:400
2150587994028,5cyclictest131rcu_preempt22:25:110
2150596993931,5cyclictest2182035-21munin-run20:40:002
2150596993931,4cyclictest2213016-21apt-key22:10:022
2150596993928,8cyclictest311ktimers/219:20:112
2150600993830,4cyclictest2182047-21sendmail20:40:003
2150600993818,18cyclictest391ktimers/300:05:133
2150587993828,7cyclictest2259250-21grep00:20:290
2150596993729,4cyclictest0-21swapper/223:40:012
2150587993731,4cyclictest2154531-21cron19:20:010
2150600993628,4cyclictest0-21swapper/323:45:173
2150600993624,9cyclictest2211260-21apt-key22:05:013
2150596993628,4cyclictest0-21swapper/223:55:012
2150596993627,4cyclictest0-21swapper/221:12:182
2150591993628,4cyclictest0-21swapper/123:10:151
2150591993628,4cyclictest0-21swapper/123:10:151
2150587993628,5cyclictest2168196-21idleruntime-cro20:00:000
2150600993528,4cyclictest2239594-21runrttasks23:25:153
2150600993527,4cyclictest0-21swapper/323:35:003
2150600993527,4cyclictest0-21swapper/322:55:163
2150600993526,6cyclictest2256664-21cut00:15:163
215059699358,13cyclictest32-21ksoftirqd/221:25:222
2150596993526,6cyclictest208-21systemd-logind23:22:412
2150596993514,11cyclictest0-21swapper/220:10:162
2150591993524,7cyclictest2197173-21sshd21:22:211
2150600993426,4cyclictest0-21swapper/321:25:183
2150600993426,4cyclictest0-21swapper/319:25:183
2150600993425,6cyclictest0-21swapper/323:20:003
2150600993425,6cyclictest0-21swapper/323:20:003
2150596993426,4cyclictest0-21swapper/222:40:162
2150596993410,5cyclictest2234300-21/usr/sbin/munin23:10:242
2150596993410,5cyclictest2234300-21/usr/sbin/munin23:10:242
2150591993426,4cyclictest0-21swapper/119:35:271
2150591993425,5cyclictest0-21swapper/120:45:241
2150587993427,5cyclictest2203923-21kworker/u8:3+events_unbound21:42:410
2150587993410,4cyclictest131rcu_preempt22:20:110
2150600993325,4cyclictest0-21swapper/319:35:013
2150600993313,15cyclictest2259485-21kworker/u8:1-events_power_efficient00:28:143
2150600993313,15cyclictest2259485-21kworker/u8:1-events_power_efficient00:28:133
2150596993326,4cyclictest0-21swapper/221:55:152
2150596993324,4cyclictest0-21swapper/221:35:002
2150591993326,3cyclictest0-21swapper/123:30:151
2150591993325,4cyclictest0-21swapper/120:25:261
2150591993323,5cyclictest0-21swapper/122:30:011
2150587993326,4cyclictest0-21swapper/021:00:250
2150587993321,8cyclictest0-21swapper/020:20:010
215060099328,12cyclictest40-21ksoftirqd/320:00:193
2150600993225,4cyclictest0-21swapper/321:10:003
2150600993224,4cyclictest0-21swapper/323:55:153
2150600993223,4cyclictest0-21swapper/300:35:263
2150600993222,7cyclictest2248162-21fschecks_time23:50:163
2150600993222,6cyclictest2235366-21grep23:10:233
2150600993222,6cyclictest2235366-21grep23:10:233
2150596993225,4cyclictest2257956-21latency_hist00:20:002
2150596993224,4cyclictest0-21swapper/221:00:002
2150596993210,10cyclictest0-21swapper/220:45:212
2150591993227,3cyclictest2230669-21sendmail23:00:011
2150591993226,4cyclictest2255899-21kworker/u8:2+events_unbound00:13:281
2150591993224,4cyclictest0-21swapper/122:15:261
2150591993222,6cyclictest0-21swapper/122:45:001
2150591993221,7cyclictest2226828-21grep22:45:261
2150587993224,4cyclictest0-21swapper/020:59:590
2150587993222,7cyclictest2216602-21sendmail22:20:000
215058799321,9cyclictest2252837-21cron00:05:000
2150587993216,6cyclictest2212820-21kworker/u8:1+events_unbound22:08:560
2150587993215,5cyclictest2150578-21cyclictest22:40:010
215060099315,8cyclictest0-21swapper/321:13:423
2150600993115,9cyclictest131rcu_preempt23:06:143
2150600993115,5cyclictest131rcu_preempt22:05:193
2150600993111,14cyclictest0-21swapper/320:55:223
215059699318,5cyclictest32-21ksoftirqd/200:00:272
2150596993124,5cyclictest2223641-21idleruntime-cro22:40:012
2150596993122,5cyclictest0-21swapper/219:30:182
2150596993120,7cyclictest2167718-21grep19:55:272
2150596993120,7cyclictest2157520-21grep19:25:222
2150591993125,4cyclictest2175166-21kworker/u8:0+events_unbound20:22:101
2150591993124,4cyclictest2182062-21idleruntime-cro20:40:011
2150591993123,4cyclictest0-21swapper/120:10:241
2150591993122,4cyclictest0-21swapper/123:00:231
2150591993122,4cyclictest0-21swapper/121:25:171
2150591993121,6cyclictest0-21swapper/123:55:261
2150591993121,4cyclictest2176914-21kworker/u8:1+events_unbound20:32:131
215058799314,4cyclictest131rcu_preempt22:10:120
2150587993115,6cyclictest2240525-21kworker/u8:2+events_unbound23:25:560
2150587993114,7cyclictest2176914-21kworker/u8:1+events_unbound20:25:230
2150587993114,6cyclictest2156466-21kworker/u8:3+events_unbound19:49:020
2150587993114,6cyclictest2156466-21kworker/u8:3+events_unbound19:49:020
215060099303,7cyclictest40-21ksoftirqd/322:45:233
2150600993022,4cyclictest0-21swapper/323:40:273
2150600993022,4cyclictest0-21swapper/321:50:253
2150600993014,5cyclictest131rcu_preempt20:20:253
2150600993010,11cyclictest131rcu_preempt19:50:083
215059699309,11cyclictest0-21swapper/221:21:272
215059699307,6cyclictest301rcuc/222:25:192
215059699303,5cyclictest311ktimers/222:20:012
2150596993020,7cyclictest311ktimers/223:58:492
2150596993019,9cyclictest311ktimers/200:14:092
2150596993019,7cyclictest2166464-21debian-sa119:55:012
2150596993012,9cyclictest131rcu_preempt19:12:302
2150596993011,4cyclictest301rcuc/223:09:352
2150596993010,8cyclictest2182902-21ps20:40:222
2150596993010,13cyclictest131rcu_preempt21:16:352
2150591993024,4cyclictest2168157-21kworker/u8:3+events_unbound20:17:081
2150591993023,4cyclictest2213158-21latency_hist22:10:011
2150591993023,4cyclictest0-21swapper/119:40:161
2150591993021,5cyclictest0-21swapper/120:40:161
2150591993018,5cyclictest2192506-21kworker/u8:3+events_unbound21:17:571
2150587993017,4cyclictest131rcu_preempt20:15:010
215060099293,6cyclictest40-21ksoftirqd/321:45:013
2150600992921,4cyclictest0-21swapper/322:20:153
2150600992919,7cyclictest2174744-21grep20:15:273
2150600992918,4cyclictest131rcu_preempt21:24:393
2150600992912,5cyclictest131rcu_preempt22:40:203
2150600992912,10cyclictest131rcu_preempt23:20:153
2150600992911,3cyclictest131rcu_preempt21:18:243
215059699296,12cyclictest32-21ksoftirqd/221:40:132
215059699295,6cyclictest0-21swapper/220:25:162
2150596992923,4cyclictest311ktimers/200:35:432
2150596992920,7cyclictest311ktimers/220:05:362
2150596992919,7cyclictest311ktimers/200:28:422
2150596992919,7cyclictest311ktimers/200:28:412
2150596992919,6cyclictest0-21swapper/223:30:242
2150596992914,4cyclictest131rcu_preempt00:30:202
215058799295,12cyclictest2144949-21kworker/0:1-events20:01:440
2150587992919,7cyclictest2241268-21fschecks_count23:30:140
2150587992915,6cyclictest2198754-21kworker/u8:0+events_unbound21:29:180
215058799290,16cyclictest2228829-21runrttasks22:53:370
215060099289,11cyclictest0-21swapper/320:25:163
215060099287,11cyclictest0-21swapper/319:36:443
215060099286,13cyclictest40-21ksoftirqd/321:45:203
215060099285,7cyclictest40-21ksoftirqd/320:45:243
215060099285,5cyclictest40-21ksoftirqd/320:10:243
215060099285,20cyclictest391ktimers/321:35:193
215060099284,5cyclictest2262345-21grep00:30:233
2150600992820,4cyclictest0-21swapper/322:15:263
215060099281,7cyclictest40-21ksoftirqd/321:05:003
2150600992815,6cyclictest131rcu_preempt22:50:173
2150600992815,4cyclictest131rcu_preempt19:10:163
2150600992814,9cyclictest131rcu_preempt22:10:023
2150600992812,9cyclictest131rcu_preempt23:04:303
2150600992812,3cyclictest131rcu_preempt19:55:133
2150600992810,10cyclictest131rcu_preempt00:24:113
215059699287,7cyclictest32-21ksoftirqd/222:34:592
215059699287,5cyclictest311ktimers/223:25:272
215059699286,5cyclictest32-21ksoftirqd/222:45:192
215059699286,5cyclictest301rcuc/220:55:012
215059699286,5cyclictest301rcuc/220:55:012
215059699286,4cyclictest301rcuc/219:45:182
215059699286,4cyclictest301rcuc/219:45:182
215059699286,12cyclictest32-21ksoftirqd/219:40:192
215059699284,6cyclictest2168798-21grep20:00:172
2150596992819,6cyclictest311ktimers/220:19:292
2150596992811,4cyclictest131rcu_preempt22:20:162
2150591992816,8cyclictest0-21swapper/100:00:171
215058799289,9cyclictest0-21swapper/023:41:430
215058799287,12cyclictest2228598-21kworker/u8:1+events_unbound22:55:210
2150587992821,4cyclictest0-21swapper/020:20:260
2150587992814,5cyclictest2198754-21kworker/u8:0+events_unbound21:35:140
215058799281,13cyclictest0-21swapper/023:09:220
2150587992810,10cyclictest2223858-21kworker/u8:2+events_unbound22:43:150
215060099279,11cyclictest131rcu_preempt20:42:353
215060099278,12cyclictest0-21swapper/322:25:463
215060099277,7cyclictest0-21swapper/319:45:223
215060099277,7cyclictest0-21swapper/319:45:223
215060099277,12cyclictest0-21swapper/320:06:493
215060099273,7cyclictest40-21ksoftirqd/300:10:213
215060099272,6cyclictest40-21ksoftirqd/319:20:253
2150600992719,5cyclictest391ktimers/320:50:223
2150600992719,5cyclictest391ktimers/320:50:223
2150600992719,4cyclictest0-21swapper/319:15:273
2150600992718,7cyclictest391ktimers/321:55:163
2150600992718,6cyclictest391ktimers/319:40:103
2150600992718,6cyclictest2252376-21grep00:00:263
2150600992712,8cyclictest53-21kcompactd022:30:243
2150600992711,8cyclictest0-21swapper/321:30:153
2150596992721,3cyclictest0-21swapper/200:20:252
2150596992719,4cyclictest0-21swapper/222:55:242
2150596992718,6cyclictest0-21swapper/222:05:002
2150596992712,8cyclictest131rcu_preempt22:11:342
2150596992711,9cyclictest131rcu_preempt21:03:402
2150591992721,4cyclictest2235739-21kworker/u8:0+events_unbound23:24:401
2150591992720,5cyclictest2259485-21kworker/u8:1+events_unbound00:30:421
2150591992719,4cyclictest0-21swapper/121:50:011
2150591992719,4cyclictest0-21swapper/121:05:261
215058799279,4cyclictest131rcu_preempt00:11:300
215058799277,6cyclictest2238542-21sort23:20:250
215058799277,12cyclictest131rcu_preempt23:55:160
215058799277,10cyclictest11-21ksoftirqd/020:45:250
215058799272,5cyclictest11-21ksoftirqd/019:30:140
2150587992721,3cyclictest0-21swapper/000:05:270
2150587992720,4cyclictest2200798-21cron21:35:010
2150587992713,3cyclictest131rcu_preempt19:20:150
215058799271,13cyclictest0-21swapper/020:06:130
215058799270,14cyclictest2261195-21runrttasks00:28:010
215058799270,14cyclictest2261195-21runrttasks00:28:000
215060099263,8cyclictest40-21ksoftirqd/320:30:253
215059699269,5cyclictest131rcu_preempt21:46:012
215059699269,4cyclictest0-21swapper/222:50:212
215059699269,10cyclictest131rcu_preempt21:06:152
2150596992613,3cyclictest131rcu_preempt23:16:342
2150596992613,3cyclictest131rcu_preempt23:16:342
2150596992610,9cyclictest131rcu_preempt19:15:122
2150591992619,4cyclictest0-21swapper/122:10:251
2150591992619,3cyclictest0-21swapper/122:50:251
2150591992618,4cyclictest0-21swapper/121:40:251
2150591992618,4cyclictest0-21swapper/100:05:271
215059199261,3cyclictest2218290-21cron22:25:011
2150591992613,9cyclictest2237492-21run-parts23:20:001
2150591992613,9cyclictest2237492-21run-parts23:19:591
215058799267,17cyclictest11-21ksoftirqd/023:45:250
2150587992620,4cyclictest2207373-21kworker/u8:0+events_unbound21:54:120
2150587992620,4cyclictest2150578-21cyclictest21:57:210
2150587992620,3cyclictest0-21swapper/023:50:250
2150587992618,4cyclictest0-21swapper/019:26:580
2150587992616,5cyclictest0-21swapper/020:45:010
215058799261,12cyclictest0-21swapper/021:17:290
2150587992610,9cyclictest0-21swapper/020:30:240
215060099254,4cyclictest40-21ksoftirqd/323:35:173
215059699259,3cyclictest131rcu_preempt21:35:152
215059699253,8cyclictest32-21ksoftirqd/223:40:222
2150596992511,4cyclictest131rcu_preempt20:20:182
2150596992510,8cyclictest131rcu_preempt21:50:172
215059199258,3cyclictest131rcu_preempt23:29:591
2150591992519,4cyclictest2244137-21kworker/u8:1+events_unbound23:49:411
2150591992518,4cyclictest0-21swapper/120:00:271
2150591992515,6cyclictest0-21swapper/121:35:011
2150591992514,7cyclictest0-21swapper/119:15:161
2150587992515,4cyclictest2255899-21kworker/u8:2+events_unbound00:17:250
2150587992514,5cyclictest2150245-21kworker/u8:1+events_unbound19:10:110
215058799251,20cyclictest0-21swapper/023:04:340
2150587992511,8cyclictest0-21swapper/019:40:240
215058799251,13cyclictest0-21swapper/021:22:260
215058799251,13cyclictest0-21swapper/020:38:220
215058799251,12cyclictest0-21swapper/023:37:060
215058799251,12cyclictest0-21swapper/020:54:280
215058799251,12cyclictest0-21swapper/020:54:270
215059199249,7cyclictest24-21ksoftirqd/100:35:251
2150591992418,3cyclictest0-21swapper/119:30:241
2150591992417,5cyclictest2156466-21kworker/u8:3+events_unbound19:25:211
2150591992417,4cyclictest2230328-21kworker/u8:0+events_unbound23:07:371
2150591992417,4cyclictest2210478-21timerandwakeup22:00:231
2150591992416,6cyclictest2243688-21timerandwakeup23:35:241
2150591992416,5cyclictest0-21swapper/121:55:251
2150591992416,4cyclictest0-21swapper/119:20:251
2150591992415,5cyclictest2261364-21cron00:30:001
2150591992415,5cyclictest2261364-21cron00:30:001
215058799249,4cyclictest131rcu_preempt00:30:180
215058799248,9cyclictest0-21swapper/019:54:070
215058799246,3cyclictest131rcu_preempt22:45:100
2150587992419,3cyclictest2191480-21rt-features21:05:240
2150591992317,3cyclictest0-21swapper/121:50:231
215058799232,10cyclictest0-21swapper/021:13:190
2150587992313,7cyclictest2220863-21sed22:30:200
2150591992217,3cyclictest0-21swapper/100:25:001
2150591992216,4cyclictest2185331-21kworker/u8:3+events_unbound20:55:011
2150591992216,4cyclictest2185331-21kworker/u8:3+events_unbound20:55:001
2150591992215,3cyclictest0-21swapper/121:00:261
2150591992215,3cyclictest0-21swapper/119:50:161
2150591992214,5cyclictest0-21swapper/122:30:271
2150591992213,7cyclictest2256945-21missed_timers00:15:201
215059199221,11cyclictest0-21swapper/119:59:001
2150591992210,6cyclictest2185331-21kworker/u8:3+events_unbound20:57:161
2150591992117,2cyclictest0-21swapper/119:45:171
2150591992117,2cyclictest0-21swapper/119:45:171
2150591992112,5cyclictest2152489-21cat19:15:021
2150591992014,4cyclictest231ktimers/123:40:141
2150591992013,5cyclictest0-21swapper/122:35:141
2150591992013,5cyclictest0-21swapper/121:35:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional