You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 05:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Aug 02, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19098995144,5cyclictest89894-21kworker/u8:3+events_unbound22:57:400
19102994842,4cyclictest89894-21kworker/u8:3+events_unbound22:52:401
19107994635,7cyclictest78687-21grep22:00:172
19102994636,5cyclictest45440-21munin-plugin-st20:25:011
19111994529,12cyclictest391ktimers/323:25:113
19098994539,4cyclictest53600-21kworker/u8:0+events_unbound20:52:230
19102994437,4cyclictest88496-21latency_hist22:30:001
19102994434,7cyclictest121144-21grep00:00:321
19107994337,4cyclictest117902-21apt23:55:012
19111994235,4cyclictest107285-21unixbench_singl23:20:343
19111994232,6cyclictest0-21swapper/321:22:253
19098994234,4cyclictest71418-21cron21:40:010
19098994135,4cyclictest71067-21kworker/u8:1+events_unbound22:22:340
19098994135,4cyclictest71067-21kworker/u8:1+events_unbound22:22:330
19102994031,5cyclictest0-21swapper/123:40:001
19102994031,5cyclictest0-21swapper/123:40:001
19102994030,5cyclictest0-21swapper/120:40:001
19107993931,4cyclictest0-21swapper/200:40:002
19102993927,9cyclictest98737-21sendmail23:00:011
19098993933,4cyclictest63981-21kworker/u8:0+events_unbound21:57:300
19111993725,7cyclictest0-21swapper/320:20:253
19102993726,7cyclictest92332-21cut22:40:161
19102993725,8cyclictest0-21swapper/100:39:591
19098993729,6cyclictest121ktimers/021:00:100
19098993729,4cyclictest0-21swapper/022:20:000
19098993728,7cyclictest121ktimers/022:35:140
19111993626,6cyclictest0-21swapper/319:47:123
1910299368,8cyclictest24-21ksoftirqd/123:05:141
19102993627,5cyclictest0-21swapper/122:20:241
19102993627,5cyclictest0-21swapper/122:20:241
19102993621,9cyclictest131rcu_preempt19:47:481
19102993618,14cyclictest231ktimers/119:55:131
19111993524,7cyclictest43705-21sh20:20:003
19111993523,9cyclictest391ktimers/320:40:153
19107993528,3cyclictest0-21swapper/222:20:162
19107993528,3cyclictest0-21swapper/222:20:152
19107993527,4cyclictest0-21swapper/222:15:172
19107993526,5cyclictest31773-21cron19:45:012
19107993526,4cyclictest0-21swapper/219:35:162
19102993524,8cyclictest41581-21grep20:10:281
19102993524,7cyclictest53484-21grep20:45:271
19098993529,4cyclictest45376-21kworker/u8:1+events_unbound20:27:200
19098993529,4cyclictest45376-21kworker/u8:1+events_unbound20:27:200
19111993425,6cyclictest64191-21grep21:20:013
19111993423,7cyclictest0-21swapper/319:40:013
19111993423,6cyclictest0-21swapper/322:10:263
19111993423,6cyclictest0-21swapper/320:00:273
19111993422,7cyclictest0-21swapper/300:15:263
19107993426,4cyclictest0-21swapper/222:27:332
19107993426,4cyclictest0-21swapper/221:47:282
19107993426,4cyclictest0-21swapper/221:10:012
19102993425,5cyclictest0-21swapper/121:20:001
19102993423,7cyclictest28356-21sh19:35:011
19102993421,5cyclictest131rcu_preempt21:25:071
19102993417,10cyclictest131rcu_preempt20:28:061
19102993417,10cyclictest131rcu_preempt20:28:051
19098993427,4cyclictest36729-21kworker/u8:0+events_unbound20:17:180
19098993426,4cyclictest0-21swapper/020:00:010
19098993426,3cyclictest0-21swapper/019:15:020
19111993324,4cyclictest0-21swapper/319:20:253
19111993323,6cyclictest0-21swapper/323:15:003
19111993322,7cyclictest0-21swapper/322:35:283
19111993322,6cyclictest0-21swapper/300:35:273
19107993325,4cyclictest104052-21sh23:15:012
19107993321,9cyclictest112784-21sendmail23:40:002
19107993321,9cyclictest112784-21sendmail23:40:002
19102993325,4cyclictest0-21swapper/120:55:151
1909899334,5cyclictest131rcu_preempt22:25:140
19098993326,4cyclictest0-21swapper/023:55:010
19098993325,5cyclictest0-21swapper/020:55:250
19098993325,4cyclictest0-21swapper/022:47:360
19098993325,4cyclictest0-21swapper/021:25:250
19098993323,8cyclictest121ktimers/022:00:130
1909899330,30cyclictest0-21swapper/020:20:120
19111993222,6cyclictest0-21swapper/323:05:013
19107993224,4cyclictest0-21swapper/222:35:182
19102993224,4cyclictest0-21swapper/120:05:251
19102993217,5cyclictest131rcu_preempt21:38:251
19102993216,4cyclictest131rcu_preempt21:10:321
19098993224,3cyclictest0-21swapper/021:45:010
19111993124,3cyclictest0-21swapper/319:25:243
19111993123,6cyclictest41999-21cron20:15:013
19111993123,5cyclictest0-21swapper/323:55:013
19111993123,4cyclictest0-21swapper/322:00:003
19111993121,6cyclictest0-21swapper/322:05:263
19111993120,6cyclictest0-21swapper/319:15:273
19107993124,4cyclictest0-21swapper/223:20:332
19107993123,4cyclictest0-21swapper/223:00:252
1910299314,8cyclictest24-21ksoftirqd/123:55:251
19102993124,4cyclictest221rcuc/119:53:441
19102993118,8cyclictest31775-21cron19:45:001
19102993116,9cyclictest131rcu_preempt21:06:021
19102993112,3cyclictest131rcu_preempt21:58:451
19098993124,3cyclictest0-21swapper/022:50:260
19098993124,3cyclictest0-21swapper/000:30:250
1909899311,4cyclictest131rcu_preempt23:10:120
1909899311,26cyclictest76556-21awk21:55:010
19111993024,3cyclictest0-21swapper/323:19:593
19111993023,4cyclictest57355-21kthreadd21:00:013
19111993020,7cyclictest0-21swapper/319:45:013
19111993020,6cyclictest0-21swapper/320:45:273
19111993020,5cyclictest0-21swapper/319:30:243
19107993021,5cyclictest20714-21cron19:15:012
19107993021,5cyclictest0-21swapper/223:40:252
1910299307,12cyclictest24-21ksoftirqd/100:18:051
1910299306,6cyclictest24-21ksoftirqd/119:30:021
1910299305,15cyclictest24-21ksoftirqd/100:30:251
1910299304,8cyclictest24-21ksoftirqd/121:30:131
1910299304,7cyclictest24-21ksoftirqd/123:30:261
1910299304,7cyclictest24-21ksoftirqd/123:30:251
1910299303,7cyclictest24-21ksoftirqd/122:40:001
19102993024,4cyclictest221rcuc/119:35:191
19102993022,4cyclictest0-21swapper/123:55:001
19102993021,5cyclictest0-21swapper/122:45:271
19102993020,7cyclictest231ktimers/100:23:441
19102993020,4cyclictest131rcu_preempt21:50:541
19102993018,6cyclictest131rcu_preempt19:12:251
19102993015,9cyclictest131rcu_preempt00:06:491
19102993015,6cyclictest19092-21cyclictest21:20:141
19102993014,10cyclictest63981-21kworker/u8:0-events_unbound21:45:271
19102993012,10cyclictest131rcu_preempt21:43:191
19102993011,3cyclictest131rcu_preempt20:41:401
1909899304,6cyclictest131rcu_preempt00:15:130
19098993020,4cyclictest33065-21grep19:45:240
19098993019,7cyclictest37366-21grep20:00:160
1909899301,5cyclictest131rcu_preempt19:35:130
19111992922,4cyclictest0-21swapper/319:15:013
19111992920,6cyclictest0-21swapper/321:35:273
19111992920,6cyclictest0-21swapper/321:00:243
19111992920,4cyclictest0-21swapper/323:57:463
19107992922,3cyclictest0-21swapper/200:05:292
19107992921,4cyclictest124947-21idleruntime-cro00:14:592
19107992919,7cyclictest95312-21sh22:50:012
19107992916,8cyclictest0-21swapper/219:55:152
1910299294,6cyclictest24-21ksoftirqd/120:50:181
1910299294,5cyclictest24-21ksoftirqd/122:10:251
19102992921,4cyclictest0-21swapper/121:00:231
19102992920,4cyclictest131rcu_preempt22:18:451
19102992915,9cyclictest131rcu_preempt22:00:351
19102992914,5cyclictest131rcu_preempt22:32:271
19102992913,10cyclictest0-21swapper/100:10:151
19102992911,6cyclictest19092-21cyclictest23:40:271
19102992911,3cyclictest131rcu_preempt22:07:191
19102992910,5cyclictest131rcu_preempt20:15:181
19102992910,4cyclictest131rcu_preempt19:20:211
19098992922,5cyclictest86558-21kworker/u8:2+events_unbound22:32:370
19098992920,6cyclictest0-21swapper/021:20:260
19098992919,6cyclictest0-21swapper/023:20:340
19098992918,8cyclictest438-21cron23:10:000
1909899291,5cyclictest131rcu_preempt20:40:140
1909899291,4cyclictest131rcu_preempt20:05:130
19111992821,4cyclictest0-21swapper/322:40:253
19111992820,4cyclictest0-21swapper/322:25:273
19111992819,6cyclictest0-21swapper/322:30:263
19111992818,6cyclictest0-21swapper/320:00:003
19107992820,6cyclictest116672-21kworker/u8:2+events_unbound23:57:472
19107992820,5cyclictest55889-21kworker/u8:2+events_unbound21:17:252
19107992818,5cyclictest0-21swapper/221:35:012
1910299285,5cyclictest24-21ksoftirqd/100:25:191
1910299285,5cyclictest24-21ksoftirqd/100:25:191
1910299284,7cyclictest24-21ksoftirqd/123:02:401
19102992818,7cyclictest231ktimers/123:29:181
19102992818,7cyclictest231ktimers/123:10:231
19102992817,8cyclictest107681-21auditctl23:25:001
19102992817,7cyclictest231ktimers/123:15:251
19102992817,5cyclictest131rcu_preempt20:02:361
19102992810,4cyclictest0-21swapper/120:30:101
19098992821,3cyclictest0-21swapper/020:39:590
1909899281,5cyclictest131rcu_preempt23:55:130
19111992719,4cyclictest0-21swapper/320:27:193
19111992719,4cyclictest0-21swapper/320:27:193
19111992718,6cyclictest0-21swapper/321:40:253
19111992718,6cyclictest0-21swapper/320:39:593
19111992718,5cyclictest0-21swapper/323:00:013
19107992721,3cyclictest0-21swapper/219:45:242
19107992719,4cyclictest71420-21cron21:40:002
19107992715,8cyclictest311ktimers/221:10:122
1910299276,6cyclictest24-21ksoftirqd/123:49:591
19102992720,4cyclictest0-21swapper/119:20:011
1909899277,3cyclictest1052642swap23:15:260
19111992620,3cyclictest0-21swapper/323:30:173
19111992620,3cyclictest0-21swapper/323:30:173
19111992619,4cyclictest0-21swapper/322:45:253
19111992618,4cyclictest0-21swapper/300:20:203
19111992617,5cyclictest0-21swapper/323:05:273
19111992616,7cyclictest0-21swapper/300:04:593
19107992616,6cyclictest0-21swapper/200:15:262
19107992615,7cyclictest0-21swapper/222:40:252
19107992614,8cyclictest51797-21grep20:40:282
1909899268,5cyclictest131rcu_preempt23:45:140
19098992620,4cyclictest116672-21kworker/u8:2+events_unbound00:09:360
1909899261,9cyclictest133279-21sshd00:37:500
19098992618,4cyclictest61223-21fschecks_time21:10:170
1909899261,6cyclictest60801-21cat21:10:000
19111992518,4cyclictest0-21swapper/300:25:243
19111992518,4cyclictest0-21swapper/300:25:243
19111992518,3cyclictest0-21swapper/320:07:173
19111992517,5cyclictest0-21swapper/322:50:243
1910799251,7cyclictest24952-21cron19:25:002
19107992516,6cyclictest0-21swapper/220:55:252
19098992519,4cyclictest66335-21kworker/u8:1+events_unbound21:30:060
19098992518,5cyclictest30098-21kworker/u8:2+events_unbound19:40:290
19098992518,5cyclictest121485-21kworker/u8:3+events_unbound00:23:020
1909899251,20cyclictest0-21swapper/023:25:290
19111992418,3cyclictest0-21swapper/321:35:003
19111992416,5cyclictest0-21swapper/323:40:213
19111992413,7cyclictest204-21dbus-daemon00:07:473
1910799247,4cyclictest131rcu_preempt19:50:232
19107992417,4cyclictest100111-21kworker/u8:0+events_unbound23:17:442
19107992417,3cyclictest0-21swapper/220:15:292
19107992416,5cyclictest0-21swapper/223:30:272
19107992416,5cyclictest0-21swapper/223:30:272
19107992416,5cyclictest0-21swapper/221:55:192
19107992415,6cyclictest0-21swapper/223:29:592
19107992415,5cyclictest0-21swapper/220:45:172
19107992414,7cyclictest58642-21grep21:00:252
1909899249,5cyclictest81478-21kworker/u8:2+events_unbound22:08:360
1909899247,3cyclictest0-21swapper/019:51:240
19098992418,4cyclictest63981-21kworker/u8:0+events_unbound21:45:420
19098992417,5cyclictest0-21swapper/023:04:380
19098992417,5cyclictest0-21swapper/022:45:000
19098992417,4cyclictest0-21swapper/019:17:080
19098992416,5cyclictest0-21swapper/000:25:250
19098992416,5cyclictest0-21swapper/000:25:240
1909899241,20cyclictest0-21swapper/020:30:190
1909899241,19cyclictest0-21swapper/023:36:130
1909899241,19cyclictest0-21swapper/023:36:120
1909899241,19cyclictest0-21swapper/023:31:570
1909899241,19cyclictest0-21swapper/023:31:560
19111992317,3cyclictest0-21swapper/319:50:243
19111992316,4cyclictest0-21swapper/322:20:243
19111992316,4cyclictest0-21swapper/322:20:243
19111992316,3cyclictest0-21swapper/323:35:223
19111992316,3cyclictest0-21swapper/323:35:223
19111992314,6cyclictest67808-21sh21:30:003
19107992317,3cyclictest0-21swapper/220:00:232
19107992317,3cyclictest0-21swapper/219:25:172
19107992316,3cyclictest0-21swapper/220:50:172
19107992316,3cyclictest0-21swapper/219:15:032
19107992314,6cyclictest0-21swapper/222:30:222
19107992312,8cyclictest97017-21idleruntime-cro22:55:002
19098992317,4cyclictest63981-21kworker/u8:0+events_unbound22:11:420
19098992317,4cyclictest63981-21kworker/u8:0+events_unbound21:19:190
19098992316,5cyclictest13550irq/42-30be0000.ethernet23:40:120
19098992316,4cyclictest124539-21head00:10:250
19098992314,7cyclictest11-21ksoftirqd/020:10:470
1909899231,18cyclictest0-21swapper/019:26:380
1911199223,9cyclictest131rcu_preempt21:05:243
19111992216,3cyclictest0-21swapper/323:45:223
19111992216,3cyclictest0-21swapper/322:15:243
19111992216,3cyclictest0-21swapper/321:10:213
19111992215,5cyclictest47114-21kworker/u8:0+events_unbound20:32:213
19111992214,5cyclictest0-21swapper/321:45:183
19107992216,3cyclictest0-21swapper/220:20:242
19107992216,3cyclictest0-21swapper/200:30:192
19107992214,5cyclictest0-21swapper/223:05:272
19107992213,6cyclictest71818-21fschecks_count21:40:142
19098992217,3cyclictest13850irq/36-mmc100:00:230
19098992216,4cyclictest53600-21kworker/u8:0+events_unbound20:47:200
1911199216,3cyclictest131rcu_preempt00:10:253
19111992115,3cyclictest0-21swapper/320:50:263
19111992113,4cyclictest0-21swapper/300:30:253
1910799215,4cyclictest131rcu_preempt22:10:152
19107992115,4cyclictest71067-21kworker/u8:1+events_unbound21:50:072
19107992115,3cyclictest0-21swapper/223:45:202
19107992115,3cyclictest0-21swapper/220:10:212
19107992114,5cyclictest0-21swapper/200:00:302
19107992114,4cyclictest63981-21kworker/u8:0+events_unbound21:22:262
19107992113,5cyclictest0-21swapper/200:20:252
19111992013,3cyclictest0-21swapper/321:50:243
19107992013,5cyclictest311ktimers/220:35:202
19107992013,4cyclictest48064-21mailstats20:30:262
1910799199,7cyclictest38935-21seq20:05:142
19107991913,4cyclictest27028-21fschecks_count19:30:132
19107991913,3cyclictest0-21swapper/220:25:172
19107991913,3cyclictest0-21swapper/220:25:162
19107991911,6cyclictest0-21swapper/200:25:182
19107991911,6cyclictest0-21swapper/200:25:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional