You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 12:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Jun 04, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2179798995243,5cyclictest2246219-21sendmail23:00:002
2179793994737,6cyclictest2180331-21fschecks_time19:10:161
2179804994638,4cyclictest2191625-21munin-plugin-st19:55:013
2179804994638,4cyclictest2191625-21munin-plugin-st19:55:003
2179789994538,5cyclictest2213831-21kworker/u8:2+events_unbound21:41:410
2179804994435,6cyclictest2231071-21fschecks_time22:15:163
2179793994436,4cyclictest2270332-21munin-plugin-st00:10:001
2179789994436,4cyclictest2260079-21munin-run23:40:000
2179789994331,8cyclictest2181145-21grep19:10:260
2179789994234,4cyclictest2225551-21sendmail22:00:010
2179804994131,6cyclictest2239802-21fschecks_count22:40:143
2179793994131,7cyclictest2213121-21unixbench_multi21:20:221
2179793994131,7cyclictest2213121-21unixbench_multi21:20:221
2179804994033,5cyclictest2195463-21kworker/u8:3+events_unbound20:11:303
2179804994033,5cyclictest2195463-21kworker/u8:3+events_unbound20:11:293
2179798994028,9cyclictest311ktimers/223:30:112
2179789994034,4cyclictest2221800-21kworker/u8:1+events_unbound22:06:460
2179789994030,6cyclictest0-21swapper/021:40:000
2179804993931,4cyclictest0-21swapper/323:55:003
2179789993929,7cyclictest121ktimers/022:25:110
2179789993923,5cyclictest131rcu_preempt22:40:230
2179804993830,5cyclictest2209536-21cron21:10:013
2179789993832,4cyclictest2221800-21kworker/u8:1+events_unbound22:11:440
2179789993827,7cyclictest0-21swapper/020:00:010
2179789993827,7cyclictest0-21swapper/020:00:010
2179804993730,4cyclictest2207193-21sendmail21:00:003
2179804993729,4cyclictest0-21swapper/319:15:013
2179804993726,8cyclictest2242817-21munin-plugin-st22:50:003
2179793993730,4cyclictest2195106-21latency_hist20:10:011
2179804993629,4cyclictest2212275-21fschecks_count21:20:123
2179804993629,4cyclictest2212275-21fschecks_count21:20:123
2179804993628,4cyclictest0-21swapper/321:55:163
2179804993625,7cyclictest0-21swapper/320:00:213
2179798993624,8cyclictest311ktimers/220:30:102
2179793993625,7cyclictest2211241-21sh21:15:001
2179789993630,4cyclictest2186907-21kworker/u8:1+events_unbound20:21:320
2179789993629,5cyclictest2249276-21kworker/u8:2+events_unbound23:08:400
2179789993629,3cyclictest0-21swapper/023:30:010
2179789993627,5cyclictest0-21swapper/021:20:000
2179789993626,4cyclictest0-21swapper/019:40:010
2179789993624,7cyclictest0-21swapper/022:15:250
2179804993526,6cyclictest2218254-21unixbench_multi21:35:263
2179804993523,7cyclictest0-21swapper/322:10:253
2179798993522,8cyclictest0-21swapper/221:34:592
2179793993525,7cyclictest2231876-21grep22:15:261
2179789993525,6cyclictest0-21swapper/000:10:250
2179804993427,4cyclictest2192258-21munin-run20:00:013
2179804993427,4cyclictest2192258-21munin-run20:00:013
2179804993424,6cyclictest0-21swapper/323:55:243
2179798993424,7cyclictest438-21cron21:29:592
2179793993425,6cyclictest0-21swapper/100:14:591
2179793993424,6cyclictest0-21swapper/123:55:241
2179804993326,5cyclictest2270206-21kworker/u8:3+events_unbound00:19:253
2179804993326,5cyclictest2270206-21kworker/u8:3+events_unbound00:19:253
2179804993326,5cyclictest2254566-21kworker/u8:2+events_unbound23:31:553
2179804993323,7cyclictest0-21swapper/319:30:013
2179798993326,4cyclictest0-21swapper/200:00:132
2179793993325,4cyclictest0-21swapper/122:45:251
2179793993321,10cyclictest231ktimers/123:30:121
217978999338,4cyclictest131rcu_preempt00:00:090
2179789993327,4cyclictest2241328-21kworker/u8:0+events_unbound22:48:410
2179789993325,4cyclictest0-21swapper/021:30:000
2179789993320,5cyclictest131rcu_preempt21:10:090
2179789993318,9cyclictest131rcu_preempt00:19:440
2179789993318,9cyclictest131rcu_preempt00:19:430
2179804993225,5cyclictest2206998-21kworker/u8:1+events_unbound21:11:383
2179804993225,4cyclictest0-21swapper/321:00:213
2179804993225,4cyclictest0-21swapper/300:30:253
2179804993224,4cyclictest0-21swapper/322:06:443
2179804993223,5cyclictest0-21swapper/323:25:243
2179804993222,6cyclictest0-21swapper/319:20:003
2179804993221,7cyclictest0-21swapper/323:00:013
2179804993219,9cyclictest2203913-21sshd20:41:353
2179798993223,6cyclictest0-21swapper/222:00:002
2179793993223,5cyclictest0-21swapper/119:25:011
2179793993222,6cyclictest0-21swapper/122:20:261
2179793993221,7cyclictest0-21swapper/120:30:211
2179789993226,4cyclictest2223508-21kworker/u8:2+events_unbound21:51:450
217978999320,7cyclictest11-21ksoftirqd/022:35:110
2179804993123,4cyclictest0-21swapper/322:25:153
2179804993122,6cyclictest0-21swapper/322:20:253
2179804993120,7cyclictest0-21swapper/321:45:003
2179798993122,4cyclictest0-21swapper/200:09:502
2179798993119,8cyclictest204-21dbus-daemon00:23:322
2179793993124,4cyclictest0-21swapper/123:05:131
2179793993123,4cyclictest0-21swapper/123:50:151
2179793993121,6cyclictest0-21swapper/120:15:011
2179793993121,6cyclictest0-21swapper/120:15:011
2179793993120,6cyclictest0-21swapper/122:00:251
2179789993124,3cyclictest0-21swapper/019:30:010
2179789993121,7cyclictest2279781-21find00:35:230
2179789993121,6cyclictest0-21swapper/021:20:220
2179789993121,6cyclictest0-21swapper/021:20:210
2179789993114,3cyclictest131rcu_preempt23:15:110
2179789993114,3cyclictest131rcu_preempt00:22:090
2179789993110,3cyclictest131rcu_preempt22:20:080
2179804993023,5cyclictest2249276-21kworker/u8:2+events_unbound23:16:553
2179804993023,4cyclictest2239392-21kthreadd22:40:013
2179804993022,5cyclictest0-21swapper/322:55:013
2179804993019,7cyclictest0-21swapper/322:30:273
2179798993023,4cyclictest0-21swapper/222:15:172
2179798993019,8cyclictest438-21cron19:50:012
217978999308,13cyclictest131rcu_preempt19:55:010
217978999308,13cyclictest131rcu_preempt19:55:000
217978999305,13cyclictest131rcu_preempt23:45:150
217978999302,9cyclictest11-21ksoftirqd/022:00:130
2179789993024,4cyclictest2237492-21kworker/u8:2+events_unbound22:58:410
2179789993023,4cyclictest2244519-21munin-plugin-st22:55:010
2179789993022,6cyclictest2186907-21kworker/u8:1+events_unbound20:26:310
2179789993020,7cyclictest2208351-21sort21:00:200
217978999301,9cyclictest11-21ksoftirqd/020:10:100
217978999301,9cyclictest11-21ksoftirqd/020:10:100
217978999301,8cyclictest11-21ksoftirqd/000:05:130
2179789993010,13cyclictest11-21ksoftirqd/019:15:020
2179804992921,4cyclictest0-21swapper/300:35:163
2179804992920,6cyclictest0-21swapper/323:45:243
2179798992921,5cyclictest0-21swapper/219:10:262
2179798992920,6cyclictest0-21swapper/221:20:222
2179798992920,6cyclictest0-21swapper/221:20:212
2179793992921,4cyclictest0-21swapper/120:36:341
2179793992919,6cyclictest0-21swapper/121:10:011
217978999296,13cyclictest131rcu_preempt20:10:000
217978999295,4cyclictest11-21ksoftirqd/000:35:010
217978999295,14cyclictest11-21ksoftirqd/019:30:170
2179789992921,4cyclictest0-21swapper/023:45:010
217978999291,9cyclictest11-21ksoftirqd/019:40:080
2179789992915,5cyclictest131rcu_preempt23:50:220
2179789992913,3cyclictest131rcu_preempt20:16:150
2179789992911,4cyclictest0-21swapper/020:52:410
2179804992820,6cyclictest2255006-21latency_hist23:25:013
217980499281,11cyclictest0-21swapper/320:36:013
217979899288,4cyclictest2207233-21ls21:00:012
2179798992818,7cyclictest2235990-21idleruntime-cro22:30:002
2179793992822,4cyclictest2221800-21kworker/u8:1+events_unbound21:56:451
2179793992822,4cyclictest2206292-21kworker/u8:2+events_unbound21:01:391
2179793992821,4cyclictest0-21swapper/121:35:251
2179793992820,4cyclictest0-21swapper/100:25:161
2179793992818,6cyclictest0-21swapper/120:30:011
2179793992817,7cyclictest0-21swapper/100:30:251
217978999287,3cyclictest131rcu_preempt21:45:240
2179789992821,5cyclictest2200008-21kworker/u8:3+events_unbound20:46:390
2179789992821,4cyclictest2277161-21latency_hist00:30:000
2179789992813,9cyclictest131rcu_preempt20:43:500
2179804992721,4cyclictest2223841-21munin-plugin-st21:55:003
2179804992719,5cyclictest0-21swapper/323:35:163
2179804992716,7cyclictest0-21swapper/321:30:003
2179798992720,5cyclictest2197381-21kworker/u8:0+events_unbound20:16:302
2179798992720,4cyclictest0-21swapper/222:10:262
2179798992716,7cyclictest2192273-21tr20:00:012
2179798992716,7cyclictest2192273-21tr20:00:002
2179798992715,7cyclictest0-21swapper/220:00:122
2179793992720,4cyclictest0-21swapper/122:40:001
2179793992719,4cyclictest0-21swapper/120:40:211
2179793992718,5cyclictest2263500-21idleruntime-cro23:49:591
2179793992718,5cyclictest0-21swapper/119:40:201
2179793992717,7cyclictest0-21swapper/119:40:001
2179793992717,6cyclictest0-21swapper/123:00:001
2179793992712,12cyclictest2179781-21cyclictest19:30:071
2179789992717,7cyclictest2193703-21grep20:00:200
217980499263,4cyclictest131rcu_preempt19:20:093
2179804992620,4cyclictest2189910-21cron19:50:003
2179804992618,6cyclictest2186907-21kworker/u8:1+events_unbound19:44:043
2179804992618,4cyclictest0-21swapper/320:30:203
2179798992619,4cyclictest0-21swapper/220:30:012
217979399263,5cyclictest131rcu_preempt23:35:131
2179793992619,5cyclictest2181257-21kworker/u8:1+events_unbound19:16:221
2179793992619,4cyclictest2243224-21kworker/u8:1+events_unbound23:02:411
2179793992619,3cyclictest0-21swapper/100:00:131
2179793992617,5cyclictest0-21swapper/123:20:231
2179793992615,7cyclictest2193690-21grep20:00:211
217978999269,3cyclictest0-21swapper/023:10:360
217978999269,3cyclictest0-21swapper/023:10:360
217978999269,3cyclictest0-21swapper/021:05:420
217978999266,4cyclictest0-21swapper/020:36:480
2179789992620,4cyclictest2213831-21kworker/u8:2+events_unbound21:31:420
2179789992612,3cyclictest0-21swapper/022:35:010
2179789992611,6cyclictest11-21ksoftirqd/021:00:000
2179789992611,3cyclictest131rcu_preempt23:20:160
2179804992520,3cyclictest2277326-21latency_hist00:30:003
2179804992519,4cyclictest2272742-21kworker/u8:0+events_unbound00:21:193
2179804992519,4cyclictest2204588-21kworker/u8:1+events_unbound20:49:033
2179804992518,5cyclictest2182540-21kworker/u8:2+events_unbound19:30:083
2179804992517,4cyclictest0-21swapper/323:10:243
2179804992517,4cyclictest0-21swapper/323:10:243
2179804992515,7cyclictest0-21swapper/300:10:253
2179798992518,5cyclictest0-21swapper/221:10:222
2179798992518,4cyclictest2277162-21idleruntime-cro00:30:002
2179798992518,4cyclictest0-21swapper/221:45:252
2179798992518,3cyclictest0-21swapper/221:00:212
2179798992517,5cyclictest0-21swapper/222:00:252
2179798992516,5cyclictest0-21swapper/222:45:252
2179798992513,7cyclictest2199025-21grep20:20:212
2179793992518,5cyclictest0-21swapper/123:15:251
2179793992517,5cyclictest0-21swapper/122:40:251
2179793992517,5cyclictest0-21swapper/122:25:241
2179793992517,5cyclictest0-21swapper/120:50:111
2179793992517,4cyclictest0-21swapper/120:25:001
2179793992515,7cyclictest2249975-21df_inode23:10:141
2179793992515,7cyclictest2249975-21df_inode23:10:141
2179793992515,6cyclictest0-21swapper/100:15:201
2179793992515,6cyclictest0-21swapper/100:15:201
217978999255,11cyclictest11-21ksoftirqd/023:55:160
2179789992511,9cyclictest204-21dbus-daemon20:31:330
2179804992418,4cyclictest2265162-21kworker/u8:1+events_unbound00:08:223
2179804992418,4cyclictest2198871-21kworker/u8:2+events_unbound20:23:423
2179804992418,3cyclictest0-21swapper/321:50:013
2179804992418,3cyclictest0-21swapper/321:30:153
2179804992417,4cyclictest0-21swapper/320:30:003
2179804992415,7cyclictest2186907-21kworker/u8:1+events_unbound19:38:523
217980499241,12cyclictest0-21swapper/320:05:043
2179798992418,3cyclictest0-21swapper/222:50:222
2179798992418,3cyclictest0-21swapper/200:40:012
2179798992418,3cyclictest0-21swapper/200:10:102
2179798992417,4cyclictest0-21swapper/221:40:242
2179798992416,5cyclictest0-21swapper/223:15:152
2179798992416,4cyclictest0-21swapper/200:15:262
2179798992416,4cyclictest0-21swapper/200:15:262
2179798992415,7cyclictest2243224-21kworker/u8:1+events_unbound23:07:332
2179793992417,4cyclictest0-21swapper/120:20:001
2179793992416,6cyclictest2241328-21kworker/u8:0+events_unbound22:50:151
2179793992416,4cyclictest0-21swapper/121:34:591
2179793992415,5cyclictest0-21swapper/121:25:251
2179793992414,6cyclictest0-21swapper/122:05:251
2179789992418,4cyclictest2181257-21kworker/u8:1+events_unbound19:23:020
2179789992413,5cyclictest131rcu_preempt23:00:160
2179804992317,4cyclictest2265162-21kworker/u8:1+events_unbound00:00:023
2179804992316,4cyclictest0-21swapper/320:50:193
2179804992313,7cyclictest2211909-21sendmail21:20:013
2179798992317,3cyclictest0-21swapper/223:10:202
2179798992317,3cyclictest0-21swapper/223:10:202
2179798992315,4cyclictest0-21swapper/219:30:202
2179793992317,3cyclictest0-21swapper/100:35:131
2179793992316,4cyclictest0-21swapper/123:25:141
2179793992316,4cyclictest0-21swapper/121:45:241
2179793992315,4cyclictest0-21swapper/119:50:121
2179793992315,4cyclictest0-21swapper/119:50:121
2179793992313,5cyclictest0-21swapper/122:35:001
2179789992317,2cyclictest0-21swapper/019:47:490
2179804992215,5cyclictest2246169-21kworker/u8:0+events_unbound23:05:123
2179804992214,5cyclictest0-21swapper/323:00:163
2179804992213,6cyclictest0-21swapper/323:40:163
2179798992216,3cyclictest0-21swapper/220:45:002
2179798992216,3cyclictest0-21swapper/219:15:042
2179798992215,4cyclictest2254794-21latency_hist23:24:592
2179798992215,4cyclictest2197007-21latency_hist20:15:002
2179798992215,4cyclictest2197007-21latency_hist20:15:002
2179798992214,5cyclictest0-21swapper/222:40:162
2179798992213,6cyclictest0-21swapper/222:35:012
217979399229,3cyclictest131rcu_preempt20:50:001
217979399222,3cyclictest131rcu_preempt00:20:261
2179793992216,3cyclictest0-21swapper/119:46:261
2179793992215,5cyclictest231ktimers/123:40:181
2179793992215,4cyclictest2220021-21unixbench_singl21:40:241
2179793992214,5cyclictest0-21swapper/121:50:271
2179793992212,6cyclictest0-21swapper/121:20:001
2179793992211,3cyclictest24-21ksoftirqd/122:15:011
2179804992115,4cyclictest391ktimers/320:19:253
2179804992115,4cyclictest2227038-21kworker/u8:0+events_unbound22:04:443
217979899215,12cyclictest2260071-21apt23:40:012
2179798992115,3cyclictest0-21swapper/222:35:162
2179798992115,3cyclictest0-21swapper/222:20:222
2179798992115,3cyclictest0-21swapper/221:10:002
2179798992115,3cyclictest0-21swapper/219:40:172
2179798992115,3cyclictest0-21swapper/200:30:172
2179798992114,5cyclictest2200008-21kworker/u8:3+events_unbound20:46:372
2179798992114,4cyclictest2265197-21latency_hist23:55:012
2179798992113,4cyclictest0-21swapper/223:55:252
2179798992111,7cyclictest2184797-21date19:25:012
2179798992014,3cyclictest2190350-21fschecks_time19:50:122
2179798992014,3cyclictest2190350-21fschecks_time19:50:112
2179798992014,3cyclictest0-21swapper/223:50:002
2179798992014,3cyclictest0-21swapper/222:05:232
2179798992014,3cyclictest0-21swapper/219:20:122
2179798992012,5cyclictest311ktimers/223:25:122
2179798992012,4cyclictest311ktimers/220:50:102
2179798992010,7cyclictest2217835-21open_inodes21:35:232
2179793992014,4cyclictest2206998-21kworker/u8:1+events_unbound20:59:141
2179793992012,5cyclictest0-21swapper/120:00:001
2179793992012,5cyclictest0-21swapper/120:00:001
2179798991913,4cyclictest311ktimers/223:40:252
2179798991912,4cyclictest2247019-21ntp_offset23:00:212
217979899181,7cyclictest645-21runrttasks21:19:022
2179798991813,3cyclictest311ktimers/220:07:012
217979399189,6cyclictest0-21swapper/119:30:011
2179798991711,4cyclictest645-21runrttasks20:35:222
217979899171,11cyclictest2187547-21cron19:40:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional