You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 08:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Jun 30, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137808996432,28cyclictest148107-21grep19:35:260
137821995239,9cyclictest391ktimers/300:00:103
137817995239,8cyclictest210848-21sendmail22:40:012
137808994840,4cyclictest145155-21cron19:30:010
137812994734,9cyclictest231ktimers/123:50:121
137808994723,19cyclictest0-21swapper/023:45:260
137817994634,8cyclictest222507-21grep23:10:252
137817994634,8cyclictest222507-21grep23:10:242
137821994538,4cyclictest162448-21sendmail20:20:013
137817994532,10cyclictest311ktimers/221:25:142
137817994531,9cyclictest311ktimers/221:35:122
137808994418,23cyclictest13550irq/42-30be0000.ethernet22:30:230
137817994335,4cyclictest183111-21cron21:20:002
137808994313,26cyclictest203599-21grep22:15:250
13780899429,5cyclictest220572-21/usr/sbin/munin23:05:240
13780899429,5cyclictest220572-21/usr/sbin/munin23:05:240
13780899427,5cyclictest165187-21/usr/sbin/munin20:25:280
13780899421,10cyclictest169023-21unixbench_singl20:35:270
137808994114,3cyclictest13550irq/42-30be0000.ethernet23:55:160
13780899411,11cyclictest231276-21head23:35:250
137817994029,5cyclictest0-21swapper/222:17:472
137812994029,8cyclictest231ktimers/121:40:131
13780899403,10cyclictest175260-21meminfo20:55:200
13780899401,9cyclictest438-21cron19:20:010
137808994015,22cyclictest0-21swapper/019:55:250
137808994012,3cyclictest0-21swapper/020:20:330
13780899401,11cyclictest250835-21df_inode00:35:150
13780899401,11cyclictest205286-21head22:20:230
13780899401,10cyclictest217901-21wc23:00:000
13780899401,10cyclictest210855-21grep22:40:000
137808994010,5cyclictest174247-1kworker/0:1H+kblockd21:20:010
137808994010,4cyclictest241501-21unixbench_multi00:05:310
137821993931,4cyclictest0-21swapper/321:27:403
137817993931,4cyclictest0-21swapper/222:12:472
137817993926,9cyclictest311ktimers/222:55:112
13780899399,4cyclictest0-21swapper/022:25:260
13780899392,6cyclictest188993-21ntpq21:35:200
13780899391,7cyclictest191447-21grep21:40:250
137808993913,22cyclictest0-21swapper/019:10:200
137808993912,3cyclictest0-21swapper/020:14:480
13780899391,11cyclictest221618-21df23:10:140
13780899391,11cyclictest221618-21df23:10:140
13780899391,11cyclictest177098-21ntp_states21:00:220
13780899391,11cyclictest177098-21ntp_states21:00:220
13780899391,10cyclictest215319-21wc22:50:250
137817993826,4cyclictest182973-21kworker/u8:2+events_unbound21:22:402
137817993825,9cyclictest311ktimers/221:00:142
137817993825,9cyclictest311ktimers/221:00:142
137817993825,5cyclictest195236-21kworker/u8:0+events_unbound22:07:472
13780899389,4cyclictest166740-21missed_timers20:30:200
13780899385,6cyclictest247350-21cpu00:25:130
13780899381,9cyclictest151786-21grep19:45:250
13780899381,9cyclictest145580-21fschecks_time19:30:170
137808993811,3cyclictest0-21swapper/000:20:250
13780899381,10cyclictest172467-21unixbench_singl20:45:240
13780899380,13cyclictest0-21swapper/022:00:150
137817993725,8cyclictest239819-21grep00:00:242
137817993720,12cyclictest311ktimers/222:20:092
137812993727,6cyclictest0-21swapper/119:32:191
137812993719,9cyclictest224876-21kworker/u8:2+events_unbound23:22:531
13780899372,7cyclictest186538-21auditctl21:30:010
13780899372,6cyclictest243180-21grep00:10:280
13780899372,6cyclictest243180-21grep00:10:280
13780899372,6cyclictest232485-21ntpq23:40:190
137808993726,7cyclictest0-21swapper/020:50:270
13780899371,9cyclictest250051-21head00:30:260
13780899371,9cyclictest236395-21grep23:50:250
13780899371,8cyclictest201816-21grep22:10:250
13780899371,8cyclictest184432-21grep21:20:250
13780899371,7cyclictest211259-21fschecks_time22:40:160
137808993712,3cyclictest0-21swapper/021:45:250
13780899371,10cyclictest227889-21grep23:25:270
13780899371,10cyclictest227889-21grep23:25:270
13780899371,10cyclictest143569-21cat19:25:010
137821993625,6cyclictest0-21swapper/322:20:233
137821993624,7cyclictest0-21swapper/321:10:253
137821993623,10cyclictest391ktimers/319:20:143
137817993630,3cyclictest0-21swapper/220:20:182
137817993623,10cyclictest311ktimers/200:20:142
137812993626,6cyclictest209121-21sh22:35:011
137812993626,6cyclictest0-21swapper/120:20:281
13780899369,3cyclictest213473-21mailstats22:45:220
137808993626,7cyclictest245386-21sendmail00:20:000
137808993626,7cyclictest245386-21sendmail00:20:000
13780899361,9cyclictest169910-21tune2fs20:40:170
13780899361,6cyclictest204-21dbus-daemon21:07:330
13780899361,6cyclictest204-21dbus-daemon21:07:330
13780899360,13cyclictest0-21swapper/020:00:180
137821993524,7cyclictest0-21swapper/319:15:293
137817993528,5cyclictest219804-21kworker/u8:1+events_unbound23:37:552
137817993516,7cyclictest131rcu_preempt22:40:122
137817993516,5cyclictest131rcu_preempt23:30:102
137812993527,4cyclictest0-21swapper/121:22:401
137812993527,4cyclictest0-21swapper/119:27:181
13780899358,5cyclictest174247-1kworker/0:1H+mmc_complete21:55:000
13780899358,4cyclictest199906-21grep22:05:260
13780899351,7cyclictest229577-21unixbench_singl23:30:230
137808993512,3cyclictest0-21swapper/000:05:000
13780899351,10cyclictest158102-21ntpq20:05:210
137821993426,4cyclictest200629-21apt-key22:10:013
137821993423,7cyclictest0-21swapper/320:25:313
13781799349,11cyclictest0-21swapper/220:25:192
137817993425,7cyclictest145393-21kworker/u8:0+events_unbound19:36:422
137817993425,6cyclictest170746-21grep20:40:262
137817993414,11cyclictest32-21ksoftirqd/200:40:012
137812993427,4cyclictest137802-21cyclictest22:50:271
137812993423,8cyclictest252196-21munin-plugin-st00:40:001
13780899349,3cyclictest0-21swapper/023:22:040
13780899348,6cyclictest121ktimers/023:15:300
13780899341,12cyclictest195839-21irqstats21:55:180
13780899341,10cyclictest180948-21sed21:10:250
137821993324,6cyclictest0-21swapper/321:55:003
137821993324,5cyclictest0-21swapper/323:50:153
137821993323,7cyclictest391ktimers/300:15:103
137821993323,7cyclictest391ktimers/300:15:103
137821993323,6cyclictest0-21swapper/322:40:253
137821993323,6cyclictest0-21swapper/321:20:253
137821993323,5cyclictest0-21swapper/323:55:233
13781799338,11cyclictest0-21swapper/220:18:192
13781799334,5cyclictest131rcu_preempt20:30:122
137817993325,4cyclictest0-21swapper/200:10:282
137817993325,4cyclictest0-21swapper/200:10:282
137817993323,7cyclictest176287-21cron21:00:002
13781799331,9cyclictest0-21swapper/223:25:142
13781799331,9cyclictest0-21swapper/223:25:132
137817993319,8cyclictest311ktimers/219:20:132
137812993326,4cyclictest0-21swapper/120:00:161
137812993325,4cyclictest0-21swapper/121:50:001
137812993325,4cyclictest0-21swapper/120:05:161
13780899331,8cyclictest187223-21cat21:30:200
137817993216,6cyclictest235359-21kworker/u8:1+events_unbound23:55:112
137812993223,6cyclictest243841-21latency_hist00:15:011
137812993223,6cyclictest243841-21latency_hist00:15:011
13780899321,10cyclictest153910-21cut19:55:000
137821993123,5cyclictest223014-21latency_hist23:15:003
137821993123,5cyclictest223014-21latency_hist23:15:003
137821993123,4cyclictest0-21swapper/300:10:283
137821993123,4cyclictest0-21swapper/300:10:283
137821993122,5cyclictest0-21swapper/322:30:253
137821993121,6cyclictest0-21swapper/322:10:243
137821993120,7cyclictest0-21swapper/320:55:263
137817993125,4cyclictest193527-21kworker/u8:2+events_unbound21:52:442
137817993125,4cyclictest172613-21kworker/u8:1+events_unbound20:47:332
137817993123,4cyclictest0-21swapper/223:50:242
137817993117,6cyclictest231353-21kworker/u8:0+events_unbound23:40:292
137812993125,3cyclictest0-21swapper/100:20:001
137812993125,3cyclictest0-21swapper/100:20:001
137812993122,6cyclictest238947-21fschecks_count00:00:141
137808993110,5cyclictest121ktimers/023:00:150
137821993022,4cyclictest0-21swapper/323:25:273
137821993022,4cyclictest0-21swapper/323:25:273
137821993020,5cyclictest0-21swapper/322:40:013
13781799308,11cyclictest0-21swapper/200:18:592
13781799308,11cyclictest0-21swapper/200:18:582
137817993023,5cyclictest246944-21kworker/u8:0+events_unbound00:26:422
137817993021,6cyclictest180940-21grep21:10:252
137817993018,3cyclictest131rcu_preempt19:15:252
13781299309,3cyclictest1625912cat20:20:011
137812993024,4cyclictest248680-21kworker/u8:1+events_unbound00:33:011
137812993023,5cyclictest193527-21kworker/u8:2+events_unbound21:57:461
137812993023,4cyclictest0-21swapper/121:50:161
137808993011,3cyclictest0-21swapper/020:17:020
137821992921,5cyclictest215755-21unixbench_singl22:50:283
137821992921,5cyclictest0-21swapper/319:45:013
137821992920,6cyclictest0-21swapper/320:50:003
13781799299,11cyclictest32-21ksoftirqd/219:15:012
13781799298,10cyclictest0-21swapper/200:07:202
137817992923,4cyclictest153797-21kworker/u8:1+events_unbound19:54:402
137817992922,4cyclictest159016-21sh20:10:012
137817992921,4cyclictest0-21swapper/220:50:272
137817992921,4cyclictest0-21swapper/219:25:162
137817992918,5cyclictest145393-21kworker/u8:0+events_unbound19:43:422
137817992917,8cyclictest215964-21sshd22:52:492
13781799291,6cyclictest0-21swapper/219:55:122
137812992922,5cyclictest24-21ksoftirqd/120:40:131
137812992922,4cyclictest0-21swapper/100:20:261
137812992921,4cyclictest0-21swapper/123:35:141
137812992921,4cyclictest0-21swapper/121:20:001
137812992921,4cyclictest0-21swapper/121:00:161
137812992921,4cyclictest0-21swapper/121:00:161
137812992921,4cyclictest0-21swapper/120:10:151
137808992921,4cyclictest0-21swapper/019:45:000
137821992823,3cyclictest160272-21unixbench_multi20:10:243
137821992822,4cyclictest143436-21kworker/u8:1+events_unbound19:27:203
137821992821,3cyclictest0-21swapper/320:20:283
137821992820,5cyclictest251728-21unixbench_multi00:35:253
137821992820,4cyclictest0-21swapper/321:40:013
137821992817,8cyclictest204018-21run-parts22:20:003
137817992821,4cyclictest0-21swapper/222:00:252
137817992814,6cyclictest32-21ksoftirqd/221:45:002
137812992820,5cyclictest0-21swapper/123:25:271
137812992820,5cyclictest0-21swapper/123:25:271
137812992820,4cyclictest0-21swapper/119:50:251
137821992720,4cyclictest0-21swapper/319:49:593
137821992719,6cyclictest182637-21unixbench_multi21:15:263
137821992719,5cyclictest0-21swapper/323:15:263
137821992719,5cyclictest0-21swapper/320:40:253
137821992719,4cyclictest0-21swapper/323:00:253
137821992719,4cyclictest0-21swapper/321:30:163
137821992718,6cyclictest0-21swapper/323:45:253
13781799279,4cyclictest0-21swapper/221:31:262
13781799279,11cyclictest32-21ksoftirqd/200:30:242
13781799278,4cyclictest0-21swapper/222:25:142
13781799274,4cyclictest131rcu_preempt23:00:222
137817992719,4cyclictest0-21swapper/221:05:252
137817992719,4cyclictest0-21swapper/221:05:252
137817992715,10cyclictest629-21snmpd19:34:552
13781299276,5cyclictest3203191-21kworker/1:1+events19:40:241
137812992720,5cyclictest158967-21kworker/u8:1+events_unbound20:37:311
137812992720,4cyclictest198252-21grep22:00:241
137812992719,4cyclictest141751-21cron19:20:011
137812992719,4cyclictest0-21swapper/121:10:261
137812992718,6cyclictest199105-21fschecks_time22:05:161
137812992718,5cyclictest0-21swapper/120:55:001
137821992618,5cyclictest0-21swapper/300:25:253
137821992618,4cyclictest0-21swapper/321:05:253
137821992618,4cyclictest0-21swapper/321:05:253
13781799264,13cyclictest32-21ksoftirqd/223:50:002
13781799261,7cyclictest32-21ksoftirqd/220:05:012
137817992616,6cyclictest209122-21sh22:35:012
137812992619,4cyclictest0-21swapper/121:35:261
137812992618,5cyclictest0-21swapper/119:15:011
137812992618,4cyclictest0-21swapper/122:15:001
137812992618,4cyclictest0-21swapper/119:45:251
137812992617,5cyclictest0-21swapper/100:00:001
137821992519,4cyclictest167652-21kworker/u8:0+events_unbound20:35:013
137821992517,5cyclictest0-21swapper/320:50:273
137821992516,6cyclictest198699-21munin-run22:05:003
137821992515,7cyclictest191389-21unixbench_multi21:40:253
137821992514,7cyclictest146381-21grep19:30:263
13781799259,3cyclictest131rcu_preempt21:56:092
13781799259,3cyclictest131rcu_preempt21:45:122
13781799256,11cyclictest32-21ksoftirqd/222:45:012
137817992519,3cyclictest0-21swapper/223:05:162
137817992519,3cyclictest0-21swapper/223:05:162
137812992518,4cyclictest231353-21kworker/u8:0+events_unbound23:44:411
137812992517,5cyclictest0-21swapper/122:59:591
137812992517,4cyclictest154290-21fschecks_count19:55:161
137812992517,4cyclictest0-21swapper/122:40:161
137812992516,6cyclictest209539-21fschecks_time22:35:161
137812992515,7cyclictest143063-21grep19:20:281
137821992416,5cyclictest0-21swapper/323:40:173
137821992416,5cyclictest0-21swapper/322:50:013
137821992416,4cyclictest0-21swapper/322:55:253
137821992415,6cyclictest156013-21grep20:00:173
137821992414,8cyclictest391ktimers/323:05:193
137821992414,8cyclictest391ktimers/323:05:183
137821992414,7cyclictest225302-21fschecks_count23:20:163
137821992414,5cyclictest0-21swapper/322:00:003
13781799241,7cyclictest0-21swapper/220:10:112
137817992411,6cyclictest162660-21kworker/u8:2+events_unbound20:38:022
137812992418,3cyclictest0-21swapper/122:50:011
137812992417,4cyclictest235124-21cron23:50:001
137812992417,4cyclictest0-21swapper/123:15:261
137812992417,3cyclictest0-21swapper/120:25:291
137812992417,3cyclictest0-21swapper/100:05:311
137812992416,5cyclictest0-21swapper/119:35:261
137812992416,4cyclictest0-21swapper/123:05:161
137812992416,4cyclictest0-21swapper/123:05:161
137812992415,6cyclictest0-21swapper/121:30:241
137821992317,4cyclictest145393-21kworker/u8:0+events_unbound19:52:253
137821992315,5cyclictest0-21swapper/300:20:243
137821992314,6cyclictest0-21swapper/322:30:013
13781799231,7cyclictest32-21ksoftirqd/223:15:172
137817992311,3cyclictest131rcu_preempt23:20:232
137812992315,4cyclictest0-21swapper/123:35:001
137821992216,3cyclictest0-21swapper/323:35:013
137821992215,4cyclictest0-21swapper/321:45:213
137821992215,3cyclictest0-21swapper/320:35:273
137821992214,5cyclictest0-21swapper/319:15:013
137821992213,5cyclictest148723-21date19:40:013
137821992212,7cyclictest0-21swapper/321:05:003
137821992212,7cyclictest0-21swapper/321:05:003
13781299223,5cyclictest131rcu_preempt22:15:121
137812992216,3cyclictest0-21swapper/123:00:151
137812992216,3cyclictest0-21swapper/120:30:171
137812992215,3cyclictest0-21swapper/121:25:171
137812992213,6cyclictest0-21swapper/122:20:171
137821992115,3cyclictest0-21swapper/300:30:153
137812992113,5cyclictest0-21swapper/123:15:001
137812992113,5cyclictest0-21swapper/123:15:001
137812992110,7cyclictest0-21swapper/121:05:251
137812992110,7cyclictest0-21swapper/121:05:251
137821992012,5cyclictest0-21swapper/300:05:273
137821992010,7cyclictest230817-21ntpq23:35:213
137812992013,4cyclictest175540-21mailstats20:55:241
137812992011,5cyclictest207426-21auditctl22:30:011
137821991912,4cyclictest645-21runrttasks20:05:203
137812991913,3cyclictest0-21swapper/100:25:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional