You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 12:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 04, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3290072994941,5cyclictest3398250-21munin-plugin-st00:20:003
3290069994740,5cyclictest3398202-21kworker/u8:1+events_unbound00:23:292
3290064994738,5cyclictest3405279-21munin-run00:40:011
3290072994525,10cyclictest131rcu_preempt22:45:153
3290069994532,10cyclictest311ktimers/222:20:132
3290072994436,5cyclictest3389723-21idleruntime-cro23:55:013
3290060994332,9cyclictest121ktimers/000:00:130
3290072994236,4cyclictest3311455-21kworker/u8:3+events_unbound20:11:103
329006999421,14cyclictest0-21swapper/223:20:112
3290060994230,8cyclictest0-21swapper/021:20:000
3290072994134,5cyclictest3266182-21kworker/u8:3+events_unbound19:24:403
3290072994131,4cyclictest0-21swapper/320:06:093
3290064994135,4cyclictest3370542-21munin-plugin-st23:00:001
3290064994133,5cyclictest3390967-21tail23:55:241
3290064994032,5cyclictest3312708-21unixbench_multi20:10:241
3290064994029,7cyclictest3305888-21grep19:50:261
3290060994032,4cyclictest0-21swapper/023:25:010
3290060994022,15cyclictest3290053-21cyclictest00:15:120
3290069993930,5cyclictest3313789-21fschecks_count20:15:152
3290064993930,6cyclictest0-21swapper/123:05:001
3290064993930,6cyclictest0-21swapper/100:35:011
3290060993930,5cyclictest645-21runrttasks23:55:240
3290072993818,3cyclictest0-21swapper/323:03:183
3290069993823,12cyclictest311ktimers/200:15:112
3290064993828,6cyclictest0-21swapper/122:35:001
3290072993731,4cyclictest3327334-21kworker/u8:3+events_unbound21:51:293
3290072993731,4cyclictest3304889-21kworker/u8:1+events_unbound20:16:123
3290072993722,5cyclictest131rcu_preempt19:45:233
3290072993722,4cyclictest131rcu_preempt21:59:273
3290072993719,6cyclictest131rcu_preempt20:40:153
3290064993727,6cyclictest0-21swapper/122:40:261
3290064993726,8cyclictest438-21cron22:30:001
3290064993725,9cyclictest231ktimers/122:45:111
3290072993628,4cyclictest0-21swapper/321:30:263
3290072993625,7cyclictest3350942-21grep22:00:253
3290072993624,4cyclictest131rcu_preempt20:50:423
3290072993622,5cyclictest3394726-21kworker/u8:3-events_freezable_power_00:38:523
3290072993614,11cyclictest0-21swapper/322:22:033
3290072993613,10cyclictest131rcu_preempt21:39:043
3290069993628,5cyclictest0-21swapper/223:30:002
3290069993626,6cyclictest3388413-21fschecks_count23:50:152
3290069993625,8cyclictest3291896-21latency_hist19:15:012
3290064993627,6cyclictest3377399-21grep23:20:001
3290064993627,6cyclictest0-21swapper/123:45:011
3290064993626,6cyclictest0-21swapper/119:15:251
3290060993628,4cyclictest3313394-21apt-key20:15:010
3290072993529,4cyclictest3351241-21kworker/u8:2+events_unbound22:36:383
3290072993526,6cyclictest0-21swapper/322:10:263
3290072993523,8cyclictest3308063-21sh20:00:003
3290072993521,4cyclictest131rcu_preempt21:00:203
3290072993520,5cyclictest131rcu_preempt20:20:183
3290069993527,4cyclictest629-21snmpd22:00:252
3290069993524,6cyclictest0-21swapper/221:15:002
3290064993527,4cyclictest0-21swapper/119:40:001
3290064993527,4cyclictest0-21swapper/100:05:261
3290064993525,6cyclictest0-21swapper/121:45:011
329006099350,33cyclictest0-21swapper/023:00:120
329007299347,22cyclictest391ktimers/319:40:263
3290072993428,4cyclictest3386283-21kworker/u8:0+events_unbound00:03:173
3290072993428,4cyclictest3360077-21kworker/u8:3+events_unbound23:11:503
3290072993425,5cyclictest0-21swapper/322:30:003
3290072993422,7cyclictest0-21swapper/319:25:243
3290072993420,5cyclictest131rcu_preempt21:10:193
3290072993410,12cyclictest40-21ksoftirqd/320:55:243
3290069993426,3cyclictest0-21swapper/200:25:252
3290064993427,5cyclictest3327334-21kworker/u8:3+events_unbound22:00:401
3290064993427,3cyclictest0-21swapper/120:45:001
3290064993426,5cyclictest3396062-21unixbench_multi00:10:231
3290064993425,6cyclictest0-21swapper/122:50:171
3290064993424,6cyclictest0-21swapper/122:40:001
3290064993424,6cyclictest0-21swapper/119:15:001
3290060993427,4cyclictest0-21swapper/022:15:240
3290060993427,4cyclictest0-21swapper/022:15:230
3290060993426,4cyclictest0-21swapper/021:45:150
3290060993423,8cyclictest0-21swapper/020:39:590
3290072993318,7cyclictest131rcu_preempt23:30:023
3290072993315,10cyclictest131rcu_preempt21:40:183
3290072993313,12cyclictest131rcu_preempt20:00:213
3290072993313,12cyclictest131rcu_preempt20:00:213
3290072993312,9cyclictest131rcu_preempt19:53:483
3290072993312,5cyclictest131rcu_preempt20:35:193
3290072993312,4cyclictest0-21swapper/322:58:423
3290072993310,12cyclictest131rcu_preempt20:46:193
3290069993325,4cyclictest3393131-21cron00:05:002
3290069993325,4cyclictest0-21swapper/219:51:062
3290064993327,4cyclictest3370276-21kworker/u8:2+events_unbound23:06:461
3290064993326,5cyclictest3386283-21kworker/u8:0+events_unbound00:28:281
3290064993326,4cyclictest0-21swapper/123:20:151
3290064993325,4cyclictest0-21swapper/123:45:161
3290064993323,6cyclictest0-21swapper/119:25:011
3290060993326,4cyclictest3332592-21cron21:10:000
3290060993326,4cyclictest3320235-21munin-plugin-st20:35:010
3290060993325,5cyclictest0-21swapper/000:05:100
3290060993324,6cyclictest3354292-21grep22:10:260
3290060993323,7cyclictest0-21swapper/020:55:010
329007299329,4cyclictest131rcu_preempt23:40:243
329007299329,11cyclictest40-21ksoftirqd/322:15:243
329007299329,11cyclictest40-21ksoftirqd/322:15:243
3290072993221,6cyclictest0-21swapper/300:10:233
3290072993218,5cyclictest131rcu_preempt23:45:193
3290072993216,5cyclictest3297642-21kworker/u8:1-events_freezable_power_19:33:453
3290072993216,5cyclictest3297642-21kworker/u8:1-events_freezable_power_19:33:453
3290072993216,5cyclictest131rcu_preempt21:15:153
3290072993216,4cyclictest131rcu_preempt20:26:503
3290072993215,4cyclictest131rcu_preempt21:48:123
3290072993211,13cyclictest40-21ksoftirqd/300:20:143
3290072993211,11cyclictest40-21ksoftirqd/323:15:203
3290069993225,4cyclictest0-21swapper/223:35:142
3290069993224,4cyclictest0-21swapper/222:40:262
3290069993222,7cyclictest3320670-21fschecks_time20:35:162
3290069993221,7cyclictest3334747-21fschecks_time21:15:162
3290064993224,4cyclictest0-21swapper/119:30:151
3290064993224,4cyclictest0-21swapper/119:30:141
3290064993223,6cyclictest0-21swapper/120:50:021
3290060993226,4cyclictest3300734-21kworker/u8:2+events_unbound19:56:080
3290060993226,3cyclictest0-21swapper/023:45:250
3290060993225,4cyclictest3299126-21awk19:35:000
3290060993225,4cyclictest3299126-21awk19:35:000
3290060993225,4cyclictest0-21swapper/000:25:000
3290060993224,6cyclictest121ktimers/023:15:100
329007299316,13cyclictest40-21ksoftirqd/323:55:233
3290072993125,4cyclictest3275552-21kworker/u8:2+events_unbound19:16:013
3290072993124,5cyclictest3391057-21kworker/u8:2+events_unbound00:06:403
3290072993124,5cyclictest3295519-21kworker/u8:0+events_unbound19:36:053
3290072993119,4cyclictest131rcu_preempt23:30:203
3290072993119,4cyclictest131rcu_preempt21:25:183
3290072993117,5cyclictest131rcu_preempt00:30:243
3290072993117,4cyclictest131rcu_preempt21:09:063
3290072993115,5cyclictest131rcu_preempt23:20:213
3290069993124,4cyclictest0-21swapper/220:10:152
3290069993124,3cyclictest0-21swapper/222:40:012
3290069993123,4cyclictest0-21swapper/219:40:262
3290069993121,7cyclictest3325814-21apt-key20:50:022
3290069993120,7cyclictest3341103-21kworker/u8:0-events_unbound21:39:592
3290069993117,8cyclictest0-21swapper/220:50:062
3290064993122,6cyclictest0-21swapper/122:15:241
3290064993122,6cyclictest0-21swapper/122:15:241
3290064993121,6cyclictest0-21swapper/122:15:011
3290064993119,8cyclictest3398253-21cat00:20:001
3290060993122,6cyclictest3302749-21sh19:45:000
3290060993118,11cyclictest121ktimers/020:05:130
329007299308,12cyclictest40-21ksoftirqd/320:30:203
329007299308,10cyclictest40-21ksoftirqd/322:35:003
3290072993022,4cyclictest0-21swapper/300:25:163
3290072993018,5cyclictest131rcu_preempt19:10:173
3290072993012,10cyclictest131rcu_preempt23:05:173
3290069993020,6cyclictest0-21swapper/219:50:012
3290069993013,13cyclictest311ktimers/221:45:112
329006499309,3cyclictest131rcu_preempt21:15:141
329006499304,4cyclictest131rcu_preempt22:20:121
3290064993023,4cyclictest0-21swapper/122:00:011
3290060993022,4cyclictest0-21swapper/021:35:000
3290060993017,8cyclictest204-21dbus-daemon23:41:540
3290060993013,3cyclictest3304716-21latency_hist19:50:010
3290072992918,7cyclictest0-21swapper/323:35:233
3290072992914,4cyclictest131rcu_preempt22:42:503
3290072992912,3cyclictest131rcu_preempt22:54:133
3290072992910,13cyclictest131rcu_preempt22:05:193
3290072992910,11cyclictest40-21ksoftirqd/321:25:013
3290072992910,11cyclictest40-21ksoftirqd/321:25:013
3290069992921,5cyclictest3361902-21cat22:35:002
3290069992921,5cyclictest3301040-21sendmail19:40:002
3290069992921,5cyclictest0-21swapper/223:45:252
3290069992921,4cyclictest0-21swapper/220:30:162
3290069992918,8cyclictest311ktimers/221:50:122
329006999291,5cyclictest0-21swapper/223:10:112
3290064992922,4cyclictest0-21swapper/100:00:251
329006499291,14cyclictest3384792-21cat23:40:011
329006099298,4cyclictest3324605-21missed_timers20:45:190
3290060992921,4cyclictest0-21swapper/021:26:220
3290060992921,4cyclictest0-21swapper/000:10:230
3290069992822,4cyclictest3318248-21kworker/u8:1+events_unbound20:41:162
3290069992822,4cyclictest3275552-21kworker/u8:2+events_unbound19:21:422
3290069992822,3cyclictest0-21swapper/222:05:252
3290069992821,5cyclictest3266182-21kworker/u8:3+events_unbound19:26:042
3290069992821,4cyclictest3318248-21kworker/u8:1+events_unbound20:55:192
3290069992820,5cyclictest311ktimers/200:40:012
3290069992813,6cyclictest3300734-21kworker/u8:2+events_unbound19:56:172
329006499289,8cyclictest24-21ksoftirqd/119:45:111
3290064992817,7cyclictest0-21swapper/122:05:261
3290064992816,9cyclictest3381158-21date23:30:011
3290060992823,2cyclictest13550irq/42-30be0000.ethernet22:00:250
3290060992819,5cyclictest3370108-21grep22:55:260
3290069992721,4cyclictest3368494-21kworker/u8:1+events_unbound22:56:452
3290069992720,5cyclictest3314201-21kworker/u8:2+events_unbound20:23:222
3290069992720,3cyclictest0-21swapper/223:30:252
3290069992719,4cyclictest0-21swapper/221:05:252
329006999271,4cyclictest131rcu_preempt20:05:152
3290064992720,4cyclictest0-21swapper/121:50:151
3290064992719,4cyclictest0-21swapper/120:20:011
3290064992718,6cyclictest0-21swapper/120:25:151
3290064992716,7cyclictest3302306-21grep19:40:261
3290060992720,3cyclictest0-21swapper/019:30:010
3290060992718,5cyclictest3344556-21munin-plugin-st21:45:010
3290060992718,5cyclictest3333886-21grep21:10:250
3290060992717,6cyclictest0-21swapper/022:50:260
3290069992620,3cyclictest3377662-21apt-key23:20:012
3290069992620,3cyclictest0-21swapper/221:40:232
3290069992619,5cyclictest3360077-21kworker/u8:3+events_unbound22:50:412
3290069992618,4cyclictest3372573-21sshd23:05:152
3290069992617,6cyclictest3337256-21unixbench_multi21:20:252
3290069992617,6cyclictest3337256-21unixbench_multi21:20:252
3290069992615,7cyclictest3349665-21ls22:00:012
3290069992614,7cyclictest32-21ksoftirqd/223:00:142
3290064992618,5cyclictest0-21swapper/121:00:001
3290064992616,7cyclictest3339816-21fschecks_count21:30:161
329006499261,23cyclictest0-21swapper/120:00:131
329006499261,23cyclictest0-21swapper/120:00:131
329006099262,4cyclictest33661902grep22:45:200
3290060992620,4cyclictest0-21swapper/020:20:130
3290060992620,3cyclictest0-21swapper/022:45:010
3290060992617,6cyclictest0-21swapper/000:25:250
3290060992616,7cyclictest3362759-21which22:35:230
3290060992615,6cyclictest0-21swapper/020:15:320
329006999254,7cyclictest131rcu_preempt22:15:222
329006999254,7cyclictest131rcu_preempt22:15:222
3290069992519,4cyclictest3386283-21kworker/u8:0+events_unbound00:12:572
3290069992514,7cyclictest0-21swapper/221:00:252
3290069992510,5cyclictest3349480-21kworker/u8:0+events_unbound22:11:092
3290064992517,5cyclictest0-21swapper/119:25:191
3290064992516,6cyclictest0-21swapper/121:45:251
3290064992516,5cyclictest0-21swapper/120:35:161
329006499251,3cyclictest131rcu_preempt23:10:111
329006099252,10cyclictest13850irq/36-mmc119:50:140
3290060992519,3cyclictest0-21swapper/019:40:000
329006099251,3cyclictest3381424-21apt-get23:30:120
3290060992510,4cyclictest121ktimers/023:10:010
3290069992418,3cyclictest0-21swapper/219:15:032
3290069992416,5cyclictest0-21swapper/223:45:012
3290069992416,4cyclictest0-21swapper/200:05:152
329006999241,12cyclictest0-21swapper/220:27:012
3290064992418,4cyclictest3314201-21kworker/u8:2-events_power_efficient20:30:251
3290064992416,5cyclictest0-21swapper/123:50:251
3290064992416,5cyclictest0-21swapper/121:20:241
3290064992416,5cyclictest0-21swapper/121:20:241
3290064992416,5cyclictest0-21swapper/120:20:171
3290064992414,6cyclictest3330955-21wc21:05:011
3290060992416,5cyclictest32931362sleep019:15:230
3290060992416,4cyclictest438-21cron21:55:010
3290060992413,7cyclictest0-21swapper/021:40:000
329006099241,19cyclictest0-21swapper/023:29:580
329006099241,19cyclictest0-21swapper/021:58:570
329006099241,19cyclictest0-21swapper/021:22:270
329006099241,19cyclictest0-21swapper/021:22:270
329006099241,19cyclictest0-21swapper/000:36:360
3290069992317,4cyclictest3337424-21kworker/u8:0+events_unbound21:25:412
3290069992316,4cyclictest3299378-21latency_hist19:35:012
3290069992316,4cyclictest3299378-21latency_hist19:35:002
3290069992313,6cyclictest0-21swapper/222:29:592
3290064992317,3cyclictest0-21swapper/121:25:241
3290064992317,3cyclictest0-21swapper/121:10:161
3290064992317,3cyclictest0-21swapper/121:05:141
3290064992317,3cyclictest0-21swapper/100:20:231
3290064992315,5cyclictest0-21swapper/121:40:001
329006099232,5cyclictest3291958-21munin-node19:15:010
3290060992317,3cyclictest0-21swapper/020:40:150
3290060992316,4cyclictest0-21swapper/023:50:250
3290060992316,3cyclictest0-21swapper/020:00:390
3290060992316,3cyclictest0-21swapper/020:00:390
3290060992315,4cyclictest3327837-21fschecks_count20:55:150
3290060992314,6cyclictest0-21swapper/023:10:140
329006099231,20cyclictest0-21swapper/022:27:110
329006099231,18cyclictest0-21swapper/023:35:440
3290069992217,3cyclictest0-21swapper/220:00:252
3290069992217,3cyclictest0-21swapper/220:00:252
3290069992214,5cyclictest3390991-21unixbench_singl23:55:242
3290064992214,5cyclictest0-21swapper/119:55:201
3290060992216,2cyclictest0-21swapper/020:27:590
3290060992215,5cyclictest121ktimers/021:00:130
329006099220,18cyclictest0-21swapper/022:06:200
329006099220,18cyclictest0-21swapper/000:30:090
329006099211,18cyclictest0-21swapper/019:20:570
3290064992014,3cyclictest0-21swapper/120:05:191
3290060992010,7cyclictest3361371-21awk22:30:250
329006499199,7cyclictest395-21dbus-daemon20:50:031
329006499190,10cyclictest3381658-21cut23:30:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional