You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 08:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sun May 31, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4120010995427,23cyclictest0-21swapper/221:15:012
4120001995138,8cyclictest4192553-21grep22:35:250
4120010994923,4cyclictest0-21swapper/220:05:152
4120005994941,5cyclictest4186174-21cut22:20:011
4120010994634,8cyclictest311ktimers/221:30:112
4120001994639,5cyclictest23534-21kworker/u8:3+events_unbound00:38:100
4120010994437,4cyclictest4156956-21cron20:55:012
4120005994414,27cyclictest4164023-21/usr/sbin/munin21:15:151
4120010994336,4cyclictest4112-21cron22:55:012
4120010994332,7cyclictest311ktimers/200:00:112
4120013994235,4cyclictest26711-21cron00:00:003
4120005994235,4cyclictest4187896-21munin-plugin-st22:25:001
4120005994232,8cyclictest231ktimers/123:55:141
412000599421,9cyclictest4159201-21/usr/sbin/munin21:00:171
412000599421,9cyclictest4156015-21ntp_kernel_err20:50:201
412000599421,8cyclictest11518-21/usr/sbin/munin23:15:181
4120005994217,22cyclictest0-21swapper/123:00:211
4120005994216,23cyclictest0-21swapper/119:40:231
4120005994216,23cyclictest0-21swapper/119:40:231
412000599421,10cyclictest1474-21/usr/sbin/munin22:45:201
4120001994231,8cyclictest438-21cron19:40:000
4120005994133,4cyclictest4141351-21latency_hist20:10:011
412000599412,10cyclictest629-21snmpd22:55:261
412000599411,7cyclictest20489-21/usr/sbin/munin23:40:191
412000599411,7cyclictest10601-21cron23:11:001
4120001994130,8cyclictest121ktimers/022:10:120
4120001994130,7cyclictest4144837-21sendmail20:20:010
4120001994130,7cyclictest4144837-21sendmail20:20:010
412000599401,8cyclictest4129591-21/usr/sbin/munin19:35:171
4120005994016,19cyclictest0-21swapper/100:15:241
4120005994015,21cyclictest4169124-21auditctl21:30:011
4120005994014,21cyclictest0-21swapper/100:03:321
4120005994010,27cyclictest0-21swapper/122:50:141
4120013993929,7cyclictest391ktimers/323:00:123
412000599399,3cyclictest14976-21fschecks_count23:25:171
412000599396,4cyclictest4134325-21latency_hist19:50:011
4120005993926,8cyclictest0-21swapper/121:45:261
412000599392,5cyclictest4158656-21cron21:00:011
412000599391,9cyclictest4170265-21/usr/sbin/munin21:30:241
412000599391,8cyclictest4126335-21memory19:25:181
4120005993913,22cyclictest0-21swapper/122:00:161
412000599391,12cyclictest13939-21head23:20:261
412000599391,11cyclictest4149497-21head20:30:241
412000599391,11cyclictest4138151-21diskstats20:00:151
412000599391,10cyclictest4151728-21taskset20:38:381
4120001993926,9cyclictest4121731-21munin-node19:15:010
4120013993829,4cyclictest0-21swapper/321:35:013
4120013993825,9cyclictest2009-21grep22:45:263
412000599383,6cyclictest4142089-21meminfo20:10:181
412000599382,4cyclictest4191512-21/usr/sbin/munin22:35:201
412000599381,9cyclictest4181822-21/usr/sbin/munin22:05:171
412000599381,9cyclictest4160611-21taskset21:05:091
412000599381,8cyclictest8854-21users23:05:261
412000599381,8cyclictest4182991-21/usr/sbin/munin22:10:261
412000599381,8cyclictest4172893-21/usr/sbin/munin21:40:151
412000599381,8cyclictest4128108-21/usr/sbin/munin19:30:201
412000599381,8cyclictest4120252-21/usr/sbin/munin19:10:121
412000599381,6cyclictest39104-21/usr/sbin/munin00:35:221
412000599381,5cyclictest4188330-21fschecks_time22:25:151
4120005993815,19cyclictest0-21swapper/100:10:261
4120005993813,21cyclictest0-21swapper/100:10:001
412000599381,11cyclictest34571-21ntp_states00:20:201
412000599381,10cyclictest4176174-21apt-get21:50:111
4120001993826,8cyclictest4174235-21cron21:45:000
4120001993826,8cyclictest23101-21sh23:50:000
4120013993728,5cyclictest4128608-21unixbench_multi19:30:263
412000599377,5cyclictest0-21swapper/119:50:141
412000599376,3cyclictest692-21seq22:44:481
412000599374,5cyclictest0-21swapper/100:31:351
412000599371,9cyclictest4171169-21df_inode21:35:131
412000599371,9cyclictest4166074-21diskstats21:20:161
412000599371,9cyclictest4136237-21forks19:55:161
412000599371,9cyclictest36156-21memory00:25:221
412000599371,9cyclictest24110-21/usr/sbin/munin23:50:221
412000599371,7cyclictest4178032-21cut21:55:141
4120005993711,22cyclictest0-21swapper/121:15:011
412000599371,10cyclictest4146042-21/usr/sbin/munin20:20:251
412000599371,10cyclictest4146042-21/usr/sbin/munin20:20:251
4120001993726,7cyclictest0-21swapper/023:40:010
4120001993726,7cyclictest0-21swapper/000:10:010
4120001993725,7cyclictest4147812-21grep20:25:270
412000599363,9cyclictest4152659-21ntp_states20:40:211
412000599361,9cyclictest4190331-21/usr/sbin/munin22:30:201
412000599361,9cyclictest4190331-21/usr/sbin/munin22:30:201
412000599361,9cyclictest4143909-21/usr/sbin/munin20:15:211
412000599361,9cyclictest4143909-21/usr/sbin/munin20:15:211
412000599361,8cyclictest17976-21cron23:35:011
412000599361,7cyclictest18455-21sort23:35:171
412000599361,5cyclictest4153795-21/usr/sbin/munin20:45:181
4120005993615,18cyclictest0-21swapper/120:25:221
4120005993615,18cyclictest0-21swapper/119:15:231
4120001993629,4cyclictest4137602-21idleruntime-cro20:00:000
4120001993627,4cyclictest0-21swapper/020:15:010
4120001993619,14cyclictest11-21ksoftirqd/000:10:120
4120013993527,5cyclictest0-21swapper/300:40:013
4120010993528,4cyclictest0-21swapper/221:35:162
412000599352,7cyclictest21636-21apt-get23:45:141
412000599351,6cyclictest4124347-21cut19:20:151
4120001993529,4cyclictest121ktimers/023:40:110
4120001993527,4cyclictest0-21swapper/021:00:260
4120013993426,4cyclictest0-21swapper/323:05:263
4120010993423,8cyclictest311ktimers/219:55:122
4120001993426,4cyclictest0-21swapper/020:40:250
4120001993424,6cyclictest0-21swapper/019:20:250
4120013993326,4cyclictest4175958-21runrttasks21:50:003
4120013993322,8cyclictest33758-21munin-run00:20:013
4120010993325,4cyclictest0-21swapper/222:30:162
4120010993325,4cyclictest0-21swapper/222:30:162
4120010993325,4cyclictest0-21swapper/219:35:252
4120001993324,6cyclictest3632-21grep22:50:230
4120013993224,4cyclictest0-21swapper/321:10:253
4120013993224,4cyclictest0-21swapper/320:55:263
4120013993222,6cyclictest0-21swapper/322:15:153
4120010993225,5cyclictest4146187-21kworker/u8:3+events_unbound21:04:402
4120010993224,4cyclictest0-21swapper/223:35:252
4120010993223,5cyclictest0-21swapper/223:48:062
4120001993224,4cyclictest0-21swapper/023:05:010
4120001993222,6cyclictest0-21swapper/019:40:250
4120001993222,6cyclictest0-21swapper/019:40:240
4120013993124,4cyclictest4121912-21latency_hist19:15:013
4120013993123,5cyclictest4165770-21apt-key21:20:003
4120013993123,5cyclictest391ktimers/319:20:133
4120010993124,4cyclictest0-21swapper/220:20:012
4120010993124,4cyclictest0-21swapper/220:20:012
4120010993123,4cyclictest0-21swapper/222:55:162
4120001993123,4cyclictest4162087-21kthreadd21:10:010
4120001993123,4cyclictest0-21swapper/023:10:250
4120001993122,5cyclictest0-21swapper/020:35:010
4120001993120,7cyclictest4165076-21grep21:15:280
4120013993023,4cyclictest0-21swapper/321:20:163
4120013993021,5cyclictest4178881-21grep21:55:233
4120013993019,7cyclictest0-21swapper/320:00:013
4120010993021,6cyclictest0-21swapper/220:10:232
4120010993020,6cyclictest0-21swapper/221:15:292
4120010993019,6cyclictest0-21swapper/221:45:012
4120010993018,9cyclictest33772-21sendmail00:20:012
4120001993024,4cyclictest33491-21sh00:17:000
4120001993024,3cyclictest4181135-21latency_hist22:05:010
4120001993022,4cyclictest0-21swapper/023:05:160
4120001993021,6cyclictest38095-21fgrep00:30:230
4120001993017,10cyclictest121ktimers/000:20:100
4120013992921,4cyclictest0-21swapper/323:25:003
4120013992921,4cyclictest0-21swapper/321:00:263
4120013992920,4cyclictest0-21swapper/323:30:153
4120001992921,5cyclictest0-21swapper/022:20:260
4120001992913,10cyclictest204-21dbus-daemon19:27:350
4120013992821,4cyclictest0-21swapper/323:50:253
4120013992821,4cyclictest0-21swapper/319:40:003
4120010992822,3cyclictest0-21swapper/219:45:242
4120010992821,3cyclictest0-21swapper/223:20:162
4120010992820,5cyclictest0-21swapper/219:20:012
4120010992820,4cyclictest0-21swapper/220:35:002
4120010992818,7cyclictest2001-21grep22:45:262
4120001992821,5cyclictest4168734-21kworker/u8:2+events_unbound21:37:570
4120001992819,6cyclictest4178868-21grep21:55:230
4120001992819,6cyclictest0-21swapper/020:05:000
4120001992819,5cyclictest12242-21grep23:15:260
412000199281,24cyclictest0-21swapper/020:35:140
4120013992720,4cyclictest0-21swapper/322:20:263
4120013992719,5cyclictest4171043-21kworker/u8:1+events_unbound22:35:113
4120013992719,5cyclictest0-21swapper/321:50:153
4120013992719,4cyclictest0-21swapper/323:35:173
4120013992719,4cyclictest0-21swapper/322:25:263
4120013992719,4cyclictest0-21swapper/321:10:013
4120013992718,4cyclictest0-21swapper/300:10:263
4120010992721,3cyclictest0-21swapper/223:25:262
4120010992721,3cyclictest0-21swapper/222:40:162
4120010992720,4cyclictest0-21swapper/200:35:002
4120010992718,6cyclictest0-21swapper/222:35:242
4120010992716,7cyclictest4146051-21grep20:20:252
4120010992716,7cyclictest4146051-21grep20:20:252
4120010992716,3cyclictest0-21swapper/220:40:002
4120001992720,5cyclictest9094-21kworker/u8:1+events_unbound00:03:090
4120001992719,6cyclictest4131575-21kworker/u8:2+events_unbound20:57:470
4120001992718,6cyclictest961-21egrep22:45:140
412000199271,10cyclictest4163789-21auditctl21:15:000
4120013992618,4cyclictest0-21swapper/322:10:153
4120010992620,3cyclictest0-21swapper/223:30:152
4120010992618,6cyclictest4162091-21munin-plugin-st21:10:012
4120010992617,6cyclictest0-21swapper/221:25:172
4120010992616,6cyclictest0-21swapper/222:10:012
4120010992615,7cyclictest12213-21awk23:15:262
4120001992619,3cyclictest0-21swapper/021:50:000
4120001992619,3cyclictest0-21swapper/019:50:010
4120001992617,7cyclictest4171043-21kworker/u8:1+events_unbound21:52:590
4120001992617,5cyclictest0-21swapper/023:25:270
4120001992615,8cyclictest24174-21ps23:50:230
4120013992519,4cyclictest4131575-21kworker/u8:2+events_unbound20:40:523
4120013992519,3cyclictest0-21swapper/320:25:263
4120010992519,3cyclictest0-21swapper/220:00:182
4120010992519,3cyclictest0-21swapper/219:30:142
4120010992518,5cyclictest4119679-21kworker/u8:0+events_unbound19:20:272
4120010992517,4cyclictest0-21swapper/200:10:012
4120001992518,4cyclictest0-21swapper/022:55:240
4120001992518,4cyclictest0-21swapper/022:40:260
4120001992517,5cyclictest4184707-21wc22:15:130
4120001992516,6cyclictest4188831-21grep22:25:240
4120001992516,6cyclictest26718-21sendmail00:00:010
412000199251,20cyclictest0-21swapper/021:26:390
412000199251,20cyclictest0-21swapper/021:23:350
4120001992511,9cyclictest0-21swapper/021:32:540
4120013992418,3cyclictest0-21swapper/323:40:243
4120013992418,3cyclictest0-21swapper/321:25:273
4120013992418,3cyclictest0-21swapper/300:25:263
4120013992417,4cyclictest4193862-21proc_pri22:40:233
4120013992417,4cyclictest4172550-21sendmail21:40:013
4120013992417,4cyclictest0-21swapper/322:50:223
4120013992416,5cyclictest0-21swapper/319:50:013
4120013992416,4cyclictest0-21swapper/320:35:173
4120010992418,4cyclictest4165373-21kworker/u8:3+events_unbound21:21:402
4120010992418,3cyclictest0-21swapper/223:55:162
4120010992417,4cyclictest0-21swapper/223:05:252
4120010992416,5cyclictest4121166-21unixbench_multi19:10:252
4120010992414,6cyclictest0-21swapper/200:30:002
412000199242,7cyclictest4182769-21munin-run22:10:000
4120001992418,4cyclictest4128706-21kworker/u8:3+events_unbound19:32:360
4120001992417,3cyclictest0-21swapper/000:29:430
4120013992317,3cyclictest0-21swapper/319:15:223
4120013992315,5cyclictest9094-21kworker/u8:1+events_unbound23:48:073
4120013992315,4cyclictest0-21swapper/300:10:003
4120013992313,7cyclictest4859-21cat22:55:193
4120013992313,6cyclictest34140-21fschecks_count00:20:143
4120013992312,7cyclictest4155270-21ls20:50:003
4120010992317,3cyclictest0-21swapper/223:55:012
4120010992317,3cyclictest0-21swapper/220:55:232
4120010992317,3cyclictest0-21swapper/220:50:012
4120010992316,4cyclictest0-21swapper/223:00:172
4120010992316,4cyclictest0-21swapper/220:40:262
4120010992315,6cyclictest4174006-21kworker/u8:3+events_unbound22:15:352
4120010992314,6cyclictest0-21swapper/223:15:012
412000199236,5cyclictest131rcu_preempt19:15:100
4120001992316,4cyclictest0-21swapper/020:55:010
412000199231,3cyclictest12900-21apt-get23:20:120
412000199231,18cyclictest0-21swapper/020:21:250
412000199231,18cyclictest0-21swapper/020:21:250
412000199230,19cyclictest0-21swapper/023:33:110
412000199230,19cyclictest0-21swapper/019:52:430
4120013992215,3cyclictest0-21swapper/320:05:153
4120013992215,3cyclictest0-21swapper/320:00:153
4120013992215,3cyclictest0-21swapper/300:30:253
4120013992210,9cyclictest391ktimers/321:40:133
4120010992216,3cyclictest0-21swapper/223:40:152
4120010992216,3cyclictest0-21swapper/222:10:232
4120001992214,4cyclictest4154829-21head20:45:260
412000199221,19cyclictest0-21swapper/020:09:110
4120013992115,3cyclictest0-21swapper/319:55:013
4120013992115,3cyclictest0-21swapper/319:30:013
4120013992114,4cyclictest0-21swapper/320:20:013
4120013992113,6cyclictest391ktimers/323:20:013
4120013992113,5cyclictest391ktimers/300:00:113
4120013992112,6cyclictest4156236-21grep20:50:223
4120013992111,7cyclictest10012-21ntpq23:10:203
4120010992115,4cyclictest4128706-21kworker/u8:3+events_unbound19:41:422
4120010992115,4cyclictest4128706-21kworker/u8:3+events_unbound19:41:412
4120010992114,5cyclictest208-21systemd-logind22:26:402
4120010992114,4cyclictest4178025-21fschecks_count21:55:132
4120010992113,5cyclictest311ktimers/222:00:232
4120010992113,5cyclictest311ktimers/200:35:232
4120013992015,3cyclictest4182130-21threads22:05:223
4120013992015,2cyclictest0-21swapper/322:30:123
4120013992015,2cyclictest0-21swapper/322:30:113
4120013992013,4cyclictest438-21cron20:25:003
4120013992013,4cyclictest438-21cron20:25:003
4120013992013,4cyclictest4143682-21irqstats20:15:183
4120010992015,3cyclictest4176171-21/usr/sbin/munin21:50:102
4120010992013,4cyclictest34229-21fschecks_time00:20:152
4120010992013,4cyclictest0-21swapper/200:10:262
4120010992011,6cyclictest4147400-21/usr/sbin/munin20:25:232
412001399198,8cyclictest4131139-21awk19:40:163
412001399198,8cyclictest4131139-21awk19:40:153
4120013991913,3cyclictest15022-21fschecks_time23:25:163
412001099192,13cyclictest4175939-21cron21:50:012
4120010991912,4cyclictest0-21swapper/219:25:152
4120010991812,3cyclictest0-21swapper/219:50:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional