You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 12:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Mon Apr 13, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2120381995827,5cyclictest0-21swapper/121:45:251
2120386995143,5cyclictest2234032-21fschecks_count00:35:172
2120386994943,4cyclictest2165534-21kworker/u8:3+events_unbound21:42:082
2120381994923,5cyclictest0-21swapper/120:25:181
2120390994838,6cyclictest204-21dbus-daemon00:38:403
2120377994736,7cyclictest2161851-21grep21:05:260
2120386994639,4cyclictest2146908-21cron20:25:012
2120386994535,7cyclictest2198908-21cron22:55:012
2120390994235,4cyclictest2172509-21idleruntime-cro21:40:003
2120390994132,6cyclictest2147288-21fschecks_count20:25:163
2120390994120,5cyclictest131rcu_preempt22:45:263
2120386994135,4cyclictest2094680-21kworker/u8:3+events_unbound19:30:432
2120386994129,8cyclictest2184800-21unixbench_multi22:10:242
2120381994131,8cyclictest231ktimers/123:30:121
2120377994134,4cyclictest2134036-21ntp_kernel_err19:45:240
2120377994130,7cyclictest2122089-21munin-setwarn19:15:010
2120390994015,14cyclictest0-21swapper/322:55:003
2120381994030,6cyclictest2208914-21grep23:20:251
2120390993932,4cyclictest2224926-21latency_hist00:09:593
2120390993928,7cyclictest2209368-21apt23:25:003
2120390993919,10cyclictest145-21jbd2/mmcblk1p2-800:29:063
2120386993931,5cyclictest2193806-21cat22:40:002
2120386993929,6cyclictest0-21swapper/221:20:002
2120386993929,6cyclictest0-21swapper/220:35:262
2120381993927,8cyclictest2172489-21sh21:40:001
2120386993832,4cyclictest2146593-21kworker/u8:0+events_unbound20:52:022
2120386993832,4cyclictest2146593-21kworker/u8:0+events_unbound20:52:012
2120386993830,4cyclictest0-21swapper/223:40:002
2120390993729,4cyclictest2183405-21runrttasks22:10:003
2120390993726,7cyclictest2227900-21grep00:15:243
2120381993729,4cyclictest0-21swapper/120:20:001
2120381993725,7cyclictest2196755-21unixbench_multi22:45:251
2120390993626,6cyclictest0-21swapper/319:20:243
2120386993631,3cyclictest2202251-21kworker/u8:3+events_unbound23:22:272
2120381993630,4cyclictest2214473-21latency_hist23:40:001
2120377993625,7cyclictest2130893-21grep19:35:250
2120390993528,3cyclictest0-21swapper/323:35:003
2120386993523,7cyclictest0-21swapper/223:15:302
2120381993524,8cyclictest231ktimers/120:35:131
2120377993525,4cyclictest0-21swapper/000:35:160
212039099345,8cyclictest40-21ksoftirqd/319:40:153
2120390993424,5cyclictest2201913-21head23:00:253
212038699349,16cyclictest32-21ksoftirqd/219:15:022
212038699348,14cyclictest131rcu_preempt23:00:252
2120386993426,4cyclictest0-21swapper/222:25:252
2120386993426,4cyclictest0-21swapper/220:55:252
2120386993426,4cyclictest0-21swapper/220:55:252
2120386993425,6cyclictest0-21swapper/220:30:002
212038699342,16cyclictest32-21ksoftirqd/200:10:122
2120386993421,5cyclictest2211016-21kworker/u8:2+events_unbound23:47:132
2120381993423,6cyclictest2191633-21grep22:30:261
2120377993424,7cyclictest2135765-21ntp_offset19:50:230
212039099338,7cyclictest40-21ksoftirqd/322:00:003
212039099338,6cyclictest40-21ksoftirqd/322:35:183
212039099335,9cyclictest40-21ksoftirqd/322:25:003
2120390993327,4cyclictest2216660-21kworker/u8:1+events_unbound00:02:383
2120390993320,6cyclictest131rcu_preempt00:00:003
2120386993327,4cyclictest2172374-21kworker/u8:1+events_unbound22:07:132
2120386993327,4cyclictest2165534-21kworker/u8:3+events_unbound21:37:082
2120386993326,4cyclictest0-21swapper/222:55:252
2120386993320,10cyclictest311ktimers/221:55:122
2120381993325,4cyclictest0-21swapper/100:02:351
2120381993322,6cyclictest0-21swapper/122:37:161
2120381993321,9cyclictest231ktimers/119:30:121
2120377993326,4cyclictest2219812-21munin-plugin-st23:55:000
2120377993326,4cyclictest2219812-21munin-plugin-st23:55:000
2120377993320,10cyclictest121ktimers/023:05:130
212039099326,9cyclictest40-21ksoftirqd/319:10:163
2120390993216,3cyclictest131rcu_preempt21:05:153
2120390993212,12cyclictest131rcu_preempt19:30:233
2120386993226,4cyclictest2094680-21kworker/u8:3+events_unbound19:16:462
2120386993225,4cyclictest0-21swapper/222:20:272
2120386993221,7cyclictest2205312-21grep23:10:252
2120386993220,5cyclictest131rcu_preempt20:15:202
2120386993220,5cyclictest131rcu_preempt19:50:012
2120386993211,5cyclictest131rcu_preempt21:45:202
2120386993210,3cyclictest131rcu_preempt00:05:122
2120381993224,4cyclictest0-21swapper/123:30:011
2120381993224,4cyclictest0-21swapper/100:05:251
2120377993223,5cyclictest2172073-21unixbench_singl21:35:260
212037799321,28cyclictest0-21swapper/023:55:120
212039099313,6cyclictest40-21ksoftirqd/322:45:013
2120390993123,4cyclictest0-21swapper/321:15:273
2120390993122,6cyclictest2219342-21unixbench_multi23:50:263
2120390993122,6cyclictest2219342-21unixbench_multi23:50:263
2120390993121,7cyclictest391ktimers/321:04:423
2120390993121,7cyclictest391ktimers/321:04:423
2120390993118,7cyclictest131rcu_preempt20:32:073
2120390993114,4cyclictest131rcu_preempt22:15:233
2120386993125,3cyclictest0-21swapper/223:25:152
2120386993124,5cyclictest2191881-21kworker/u8:3+events_unbound22:33:412
2120386993123,6cyclictest2146593-21kworker/u8:0+events_unbound20:31:452
2120386993121,6cyclictest0-21swapper/222:45:002
2120386993120,6cyclictest0-21swapper/219:55:262
2120386993114,8cyclictest131rcu_preempt00:22:402
2120386993114,6cyclictest131rcu_preempt19:40:102
2120386993112,6cyclictest32-21ksoftirqd/221:05:162
2120381993122,4cyclictest0-21swapper/122:15:221
2120377993125,4cyclictest2138167-21kworker/u8:3+events_unbound20:26:570
2120377993119,9cyclictest438-21cron21:35:010
212037799311,27cyclictest0-21swapper/022:40:140
212039099309,6cyclictest40-21ksoftirqd/319:50:273
212039099302,7cyclictest40-21ksoftirqd/320:20:163
212039099301,5cyclictest40-21ksoftirqd/300:35:013
2120390993014,3cyclictest131rcu_preempt21:20:493
2120390993013,11cyclictest2214926-21kworker/u8:3-events_unbound23:40:173
2120390993013,10cyclictest131rcu_preempt20:40:193
2120390993011,6cyclictest2205739-21latency_hist23:15:013
212039099301,11cyclictest40-21ksoftirqd/320:15:173
212038699307,10cyclictest32-21ksoftirqd/200:25:262
212038699306,6cyclictest32-21ksoftirqd/219:40:002
2120386993023,5cyclictest2214926-21kworker/u8:3+events_unbound23:44:412
2120386993020,6cyclictest0-21swapper/221:25:162
2120386993016,6cyclictest2133029-21kworker/u8:2+events_unbound19:52:132
2120386993014,3cyclictest131rcu_preempt20:44:422
2120386993013,7cyclictest32-21ksoftirqd/223:10:002
2120386993013,5cyclictest131rcu_preempt20:05:112
2120386993013,3cyclictest0-21swapper/222:15:152
2120381993023,4cyclictest2188697-21auditctl22:25:001
2120381993022,4cyclictest0-21swapper/100:35:161
2120381993019,7cyclictest0-21swapper/122:55:001
2120381993018,7cyclictest0-21swapper/123:10:251
2120377993023,4cyclictest0-21swapper/020:20:260
2120377993022,5cyclictest2151947-21kworker/u8:3+events_unbound20:57:010
2120377993022,5cyclictest2151947-21kworker/u8:3+events_unbound20:57:000
2120377993022,5cyclictest0-21swapper/022:05:250
2120377993020,6cyclictest2132625-21grep19:40:250
212039099299,5cyclictest131rcu_preempt19:15:023
212039099298,6cyclictest40-21ksoftirqd/320:00:013
212039099295,7cyclictest40-21ksoftirqd/300:15:013
212039099293,8cyclictest40-21ksoftirqd/323:40:023
212039099292,7cyclictest40-21ksoftirqd/322:35:013
2120390992921,4cyclictest0-21swapper/322:55:243
2120390992920,7cyclictest391ktimers/320:15:013
2120390992919,8cyclictest391ktimers/322:25:153
2120390992919,7cyclictest391ktimers/323:45:243
2120390992919,7cyclictest391ktimers/322:10:123
2120390992919,7cyclictest391ktimers/321:45:123
2120390992919,7cyclictest391ktimers/300:20:263
212039099291,8cyclictest40-21ksoftirqd/320:55:243
212039099291,8cyclictest40-21ksoftirqd/320:55:233
2120390992911,10cyclictest131rcu_preempt23:15:023
212038699298,10cyclictest32-21ksoftirqd/221:30:252
212038699297,14cyclictest32-21ksoftirqd/219:20:242
212038699297,14cyclictest131rcu_preempt21:00:252
212038699297,14cyclictest131rcu_preempt21:00:242
212038699296,5cyclictest32-21ksoftirqd/200:15:152
2120386992923,4cyclictest2172374-21kworker/u8:1+events_unbound21:52:122
2120386992921,4cyclictest0-21swapper/220:10:162
2120386992921,4cyclictest0-21swapper/200:00:282
2120386992916,5cyclictest131rcu_preempt21:15:002
2120386992913,5cyclictest131rcu_preempt22:48:442
2120381992921,4cyclictest0-21swapper/121:25:161
2120381992921,4cyclictest0-21swapper/120:05:261
2120381992921,4cyclictest0-21swapper/100:20:001
2120381992920,6cyclictest2189117-21fschecks_time22:25:151
2120381992920,5cyclictest2134972-21auditctl19:50:011
2120381992919,5cyclictest0-21swapper/120:10:251
2120377992922,4cyclictest2228334-21sendmail00:20:000
2120377992920,5cyclictest0-21swapper/022:55:240
212039099287,4cyclictest391ktimers/321:10:163
212039099284,6cyclictest40-21ksoftirqd/321:30:133
212039099283,8cyclictest40-21ksoftirqd/320:35:143
212039099283,7cyclictest40-21ksoftirqd/321:50:153
212039099283,7cyclictest40-21ksoftirqd/319:45:213
212039099283,6cyclictest40-21ksoftirqd/319:30:023
2120390992821,4cyclictest2210589-21tail23:25:243
2120390992820,4cyclictest0-21swapper/320:05:153
212039099281,9cyclictest40-21ksoftirqd/320:55:003
212039099281,9cyclictest40-21ksoftirqd/320:55:003
2120390992818,6cyclictest0-21swapper/319:35:253
2120390992810,5cyclictest131rcu_preempt22:00:043
212038699289,5cyclictest131rcu_preempt23:50:142
212038699289,5cyclictest131rcu_preempt23:50:142
212038699289,12cyclictest32-21ksoftirqd/221:20:182
212038699287,14cyclictest32-21ksoftirqd/223:55:232
212038699285,13cyclictest32-21ksoftirqd/220:05:012
2120386992818,6cyclictest0-21swapper/222:05:002
2120381992821,4cyclictest2214926-21kworker/u8:3+events_unbound23:52:261
2120381992821,4cyclictest2214926-21kworker/u8:3+events_unbound23:52:251
2120381992820,4cyclictest0-21swapper/120:50:191
2120381992820,4cyclictest0-21swapper/120:50:181
2120381992818,7cyclictest2166980-21grep21:20:261
2120381992818,6cyclictest2158405-21grep20:55:251
2120381992818,6cyclictest2158405-21grep20:55:251
2120381992818,6cyclictest0-21swapper/123:45:251
2120377992822,3cyclictest0-21swapper/023:40:010
2120377992819,5cyclictest2152022-21munin-run20:40:010
2120377992818,7cyclictest121ktimers/000:30:120
2120377992818,6cyclictest2165239-21grep21:15:270
2120377992817,8cyclictest2154811-21threads20:45:240
2120377992813,12cyclictest0-21swapper/021:10:160
212039099278,9cyclictest131rcu_preempt20:00:153
212039099274,7cyclictest40-21ksoftirqd/320:45:253
2120390992712,4cyclictest131rcu_preempt21:25:213
2120386992719,5cyclictest2155160-21kworker/u8:1+events_unbound20:49:532
2120386992717,3cyclictest131rcu_preempt19:25:442
212038699270,6cyclictest0-21swapper/200:30:132
2120381992720,4cyclictest2144838-21kworker/u8:2+events_unbound20:41:571
2120381992719,4cyclictest0-21swapper/119:50:271
2120381992717,7cyclictest2138395-21sendmail20:00:011
2120381992717,5cyclictest0-21swapper/100:20:281
2120381992716,8cyclictest231ktimers/122:40:131
2120377992721,4cyclictest0-21swapper/019:15:120
2120377992720,4cyclictest0-21swapper/020:00:250
2120377992719,4cyclictest0-21swapper/019:20:150
2120377992716,8cyclictest2211016-21kworker/u8:2+events_unbound23:40:060
212039099265,13cyclictest40-21ksoftirqd/321:40:023
212038199262,21cyclictest2204216-21grep23:10:011
2120381992619,4cyclictest0-21swapper/119:15:041
2120381992617,7cyclictest438-21cron20:35:011
2120381992616,7cyclictest2165664-21sh21:20:001
2120381992616,6cyclictest0-21swapper/123:55:251
2120381992614,8cyclictest0-21swapper/100:30:291
2120377992620,3cyclictest0-21swapper/023:20:000
212037799261,5cyclictest2188931-21apt-get22:25:130
2120377992614,8cyclictest13550irq/42-30be0000.ethernet22:00:000
2120381992517,3cyclictest0-21swapper/119:45:021
2120381992514,7cyclictest204-21dbus-daemon21:42:081
2120381992514,7cyclictest0-21swapper/100:10:181
212037799252,21cyclictest0-21swapper/021:45:120
2120377992519,3cyclictest0-21swapper/022:20:120
2120377992515,5cyclictest0-21swapper/020:30:240
2120386992418,3cyclictest2211297-21/usr/sbin/munin23:30:152
2120381992418,3cyclictest0-21swapper/121:30:211
2120381992417,3cyclictest0-21swapper/121:10:011
2120381992415,6cyclictest2183376-21basename22:10:001
2120381992415,5cyclictest0-21swapper/123:40:161
2120377992419,3cyclictest2103247-21kworker/u8:2-ext4-rsv-conversion19:35:010
212037799241,8cyclictest2127742-21idleruntime-cro19:30:010
2120377992417,3cyclictest0-21swapper/021:25:160
2120377992417,3cyclictest0-21swapper/020:40:260
2120377992416,4cyclictest2137904-21unixbench_multi19:55:250
2120377992416,4cyclictest0-21swapper/022:30:260
2120377992416,4cyclictest0-21swapper/021:00:160
2120377992416,4cyclictest0-21swapper/021:00:160
2120377992416,4cyclictest0-21swapper/000:05:250
2120377992415,5cyclictest2197608-21fschecks_count22:50:170
2120377992414,6cyclictest2140487-21uniq20:05:150
2120377992411,9cyclictest2209147-21sshd23:22:250
212037799241,19cyclictest0-21swapper/021:52:520
212037799241,19cyclictest0-21swapper/021:23:580
2120381992316,4cyclictest0-21swapper/122:00:171
2120381992314,4cyclictest0-21swapper/119:30:011
2120381992312,3cyclictest0-21swapper/119:35:241
212037799231,8cyclictest2187006-21lockfile-create22:20:000
2120377992318,3cyclictest0-21swapper/022:10:130
2120377992317,4cyclictest2202251-21kworker/u8:3+events_unbound23:10:170
2120377992316,4cyclictest0-21swapper/023:25:180
212037799231,18cyclictest0-21swapper/023:03:010
212037799231,18cyclictest0-21swapper/022:48:040
212037799231,18cyclictest0-21swapper/022:03:380
212037799231,18cyclictest0-21swapper/020:52:080
212037799231,18cyclictest0-21swapper/020:52:080
212037799230,21cyclictest0-21swapper/023:31:160
2120381992216,3cyclictest0-21swapper/121:50:271
2120381992214,5cyclictest0-21swapper/122:55:241
2120381992214,5cyclictest0-21swapper/120:25:001
2120377992215,5cyclictest2216660-21kworker/u8:1+events_unbound23:45:210
2120377992215,3cyclictest0-21swapper/000:27:170
212037799221,19cyclictest0-21swapper/000:12:390
212037799221,16cyclictest2142991-21timerwakeupswit20:10:260
212037799220,3cyclictest0-21swapper/022:35:280
212037799220,20cyclictest0-21swapper/020:15:220
2120381992113,5cyclictest231ktimers/120:50:001
2120381992113,4cyclictest0-21swapper/119:20:241
2120381992112,6cyclictest2139110-21wc20:00:201
2120381992111,7cyclictest2206871-21fgrep23:15:271
212037799211,3cyclictest0-21swapper/000:01:420
2120381992014,3cyclictest0-21swapper/121:15:011
2120381992013,5cyclictest231ktimers/100:25:261
212037799201,15cyclictest0-21swapper/000:21:250
2120381991911,4cyclictest0-21swapper/121:55:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional