You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 13:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat May 16, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1933983995931,24cyclictest0-21swapper/120:40:011
1933979995750,4cyclictest0-21swapper/021:30:100
1933983995526,4cyclictest0-21swapper/123:45:141
1933988995038,9cyclictest311ktimers/223:45:102
1933988994939,6cyclictest2006109-21grep22:35:252
1933991994738,5cyclictest1982709-21ls21:30:013
1933991994539,4cyclictest1989527-21idleruntime-cro21:50:013
1933988994532,8cyclictest311ktimers/223:20:112
1933988994532,8cyclictest311ktimers/223:20:102
1933991994438,4cyclictest2006359-21kworker/u8:0+events_unbound22:41:423
1933983994331,8cyclictest231ktimers/119:35:111
1933991994135,4cyclictest1997776-21kworker/u8:2+events_unbound22:21:393
1933991994029,7cyclictest2032370-21grep23:50:253
193399199401,6cyclictest0-21swapper/322:00:093
1933983994031,6cyclictest2034034-21grep23:55:261
1933991993925,10cyclictest391ktimers/300:00:113
1933983993929,7cyclictest2007844-21grep22:40:251
1933979993931,4cyclictest0-21swapper/000:35:010
1933991993830,4cyclictest0-21swapper/320:05:003
1933988993830,4cyclictest1975867-21sh21:10:002
1933988993830,4cyclictest1975867-21sh21:10:002
1933988993828,7cyclictest1998047-21auditctl22:14:592
1933979993827,7cyclictest2007869-21grep22:40:260
1933991993731,4cyclictest2048214-21kworker/u8:2+events_unbound00:38:423
1933991993728,5cyclictest0-21swapper/300:20:143
1933991993726,7cyclictest2023617-21grep23:25:253
1933991993726,5cyclictest131rcu_preempt23:36:073
1933991993725,4cyclictest131rcu_preempt22:50:243
1933991993715,12cyclictest1975708-21kworker/u8:3-events_unbound21:54:053
1933988993728,5cyclictest0-21swapper/219:46:102
1933988993725,9cyclictest311ktimers/220:45:122
1933988993725,9cyclictest311ktimers/220:45:112
1933979993721,13cyclictest11-21ksoftirqd/021:10:120
1933991993614,11cyclictest0-21swapper/321:12:563
1933988993627,6cyclictest2044745-21apt-get00:29:592
1933988993626,6cyclictest0-21swapper/220:10:242
1933983993627,5cyclictest0-21swapper/120:45:221
1933983993627,5cyclictest0-21swapper/120:45:211
1933983993625,6cyclictest0-21swapper/119:21:051
1933983993624,8cyclictest1935710-21munin-node19:15:021
1933979993629,3cyclictest0-21swapper/020:45:240
1933979993629,3cyclictest0-21swapper/020:45:240
1933979993627,4cyclictest0-21swapper/019:45:000
1933979993624,10cyclictest121ktimers/021:15:120
1933991993525,7cyclictest1979307-21sendmail21:20:003
1933988993529,4cyclictest1975708-21kworker/u8:3+events_unbound21:46:362
1933988993528,4cyclictest0-21swapper/223:40:232
1933983993527,5cyclictest1982266-21unixbench_singl21:25:241
1933983993525,6cyclictest0-21swapper/122:40:011
1933979993528,4cyclictest1958602-21munin-plugin-st20:20:010
193399199349,8cyclictest131rcu_preempt22:25:113
193399199348,15cyclictest40-21ksoftirqd/320:45:243
193399199348,15cyclictest40-21ksoftirqd/320:45:243
1933991993428,4cyclictest1957117-21kworker/u8:2+events_unbound20:26:203
1933991993427,5cyclictest1930108-21kworker/u8:0+events_unbound19:21:073
1933991993425,6cyclictest0-21swapper/320:40:243
1933988993425,6cyclictest1953865-21fschecks_count20:05:152
1933979993426,4cyclictest0-21swapper/021:40:000
1933979993423,8cyclictest121ktimers/019:15:140
1933979993423,7cyclictest1944972-21sendmail19:40:000
1933979993423,6cyclictest0-21swapper/023:35:240
1933991993327,4cyclictest1975708-21kworker/u8:3+events_unbound21:41:353
1933991993327,4cyclictest1930108-21kworker/u8:0+events_unbound19:16:063
1933991993326,4cyclictest0-21swapper/323:30:253
1933991993315,4cyclictest1959454-21kworker/u8:1-events_freezable_power_20:23:113
1933991993312,3cyclictest0-21swapper/320:54:413
1933991993312,3cyclictest0-21swapper/320:54:403
1933991993310,11cyclictest40-21ksoftirqd/323:00:253
1933991993310,11cyclictest40-21ksoftirqd/323:00:253
1933983993326,4cyclictest2048365-21cron00:40:001
193397999334,5cyclictest131rcu_preempt23:55:110
1933979993324,5cyclictest0-21swapper/019:25:290
1933979993323,7cyclictest1999324-21grep22:15:260
1933991993219,5cyclictest131rcu_preempt22:45:173
1933991993218,5cyclictest131rcu_preempt19:25:163
1933991993216,5cyclictest131rcu_preempt00:35:013
1933991993212,12cyclictest131rcu_preempt20:37:493
1933991993211,14cyclictest40-21ksoftirqd/300:17:453
1933991993211,14cyclictest40-21ksoftirqd/300:17:453
1933991993211,11cyclictest2019165-21kworker/u8:4-events_freezable_power_23:45:003
1933988993224,4cyclictest0-21swapper/220:00:012
1933988993223,6cyclictest0-21swapper/219:20:002
1933988993222,6cyclictest2003171-21sh22:30:012
1933988993216,13cyclictest32-21ksoftirqd/220:35:122
1933983993220,7cyclictest0-21swapper/120:05:211
1933979993225,3cyclictest0-21swapper/022:30:000
193399199317,5cyclictest131rcu_preempt23:15:093
1933991993125,4cyclictest2019165-21kworker/u8:4+events_unbound23:20:413
1933991993125,4cyclictest2019165-21kworker/u8:4+events_unbound23:20:413
1933991993124,4cyclictest0-21swapper/321:05:243
1933991993124,4cyclictest0-21swapper/321:05:233
1933991993120,7cyclictest0-21swapper/321:30:243
1933991993117,4cyclictest131rcu_preempt23:09:043
1933991993117,3cyclictest131rcu_preempt19:53:223
1933991993116,5cyclictest131rcu_preempt20:16:013
1933991993116,4cyclictest131rcu_preempt00:10:013
1933991993114,10cyclictest0-21swapper/322:39:253
1933991993113,5cyclictest131rcu_preempt19:35:223
1933991993113,4cyclictest0-21swapper/320:13:473
1933991993113,11cyclictest0-21swapper/322:16:353
1933991993113,10cyclictest0-21swapper/321:23:153
1933991993112,11cyclictest2043034-21kworker/u8:3-events_power_efficient00:25:543
1933988993123,5cyclictest1939635-21auditctl19:25:002
1933983993122,6cyclictest0-21swapper/123:15:001
1933983993122,5cyclictest0-21swapper/100:20:001
1933983993122,5cyclictest0-21swapper/100:19:591
1933979993125,3cyclictest1955197-21kthreadd20:10:000
1933979993125,3cyclictest0-21swapper/022:35:010
1933979993121,7cyclictest2013615-21latency_hist23:00:010
1933979993119,9cyclictest121ktimers/022:10:120
1933979993119,8cyclictest2036223-21debian-sa100:04:590
193399199307,13cyclictest40-21ksoftirqd/320:05:193
193399199305,6cyclictest40-21ksoftirqd/321:55:203
193399199305,6cyclictest40-21ksoftirqd/321:55:203
1933991993022,4cyclictest0-21swapper/322:55:243
1933991993011,3cyclictest0-21swapper/322:07:323
1933991993011,11cyclictest0-21swapper/322:30:103
1933991993010,11cyclictest40-21ksoftirqd/322:10:163
193399199300,6cyclictest2017260-21apt-get23:10:113
1933988993024,3cyclictest0-21swapper/221:20:172
1933988993023,4cyclictest0-21swapper/221:30:152
1933988993022,4cyclictest0-21swapper/222:20:262
1933988993022,4cyclictest0-21swapper/221:40:252
1933983993023,3cyclictest0-21swapper/123:09:591
1933983993021,5cyclictest0-21swapper/120:40:251
193397999308,4cyclictest19959432grep22:05:260
193397999304,4cyclictest131rcu_preempt21:20:130
1933979993023,4cyclictest0-21swapper/023:50:250
1933979993023,4cyclictest0-21swapper/000:40:010
1933979993023,3cyclictest0-21swapper/019:50:260
193399199297,11cyclictest40-21ksoftirqd/320:30:133
193399199294,6cyclictest40-21ksoftirqd/319:12:393
1933991992916,5cyclictest131rcu_preempt19:45:253
1933991992915,3cyclictest131rcu_preempt20:59:143
1933988992919,6cyclictest0-21swapper/200:15:252
1933988992919,6cyclictest0-21swapper/200:15:252
1933988992918,8cyclictest2027493-21sendmail23:40:002
1933983992922,4cyclictest0-21swapper/122:20:251
1933983992920,6cyclictest0-21swapper/122:00:241
1933983992918,7cyclictest204-21dbus-daemon20:11:161
1933979992922,3cyclictest0-21swapper/020:35:000
193397999290,26cyclictest0-21swapper/023:10:100
193399199289,13cyclictest40-21ksoftirqd/321:00:173
193399199289,13cyclictest40-21ksoftirqd/321:00:173
193399199289,11cyclictest40-21ksoftirqd/323:50:013
193399199285,13cyclictest40-21ksoftirqd/319:40:243
1933991992810,6cyclictest40-21ksoftirqd/319:55:273
1933991992810,12cyclictest40-21ksoftirqd/321:35:223
1933991992810,11cyclictest40-21ksoftirqd/319:35:023
1933988992822,3cyclictest1958599-21kthreadd20:20:002
1933988992821,4cyclictest2039198-21head00:10:232
1933983992820,5cyclictest1996354-21munin-plugin-st22:10:001
1933983992820,5cyclictest1975708-21kworker/u8:3+events_unbound21:15:171
193397999289,17cyclictest121ktimers/021:40:250
1933979992822,3cyclictest2001073-21unixbench_singl22:20:250
1933979992819,5cyclictest0-21swapper/020:55:260
193399199275,6cyclictest40-21ksoftirqd/323:55:253
1933991992714,6cyclictest2031600-21kworker/u8:2+events_unbound00:10:073
1933988992721,3cyclictest0-21swapper/222:00:222
1933988992719,4cyclictest0-21swapper/221:35:252
1933988992719,4cyclictest0-21swapper/220:55:002
1933988992719,4cyclictest0-21swapper/220:55:002
1933988992717,7cyclictest1995862-21grep22:05:262
1933988992717,7cyclictest1949632-21grep19:50:252
1933983992720,5cyclictest164-21systemd-journal21:50:391
1933983992720,4cyclictest1941087-21grep19:25:281
1933983992720,3cyclictest0-21swapper/123:00:011
1933983992719,5cyclictest0-21swapper/121:40:011
1933983992719,4cyclictest0-21swapper/119:50:161
1933983992718,6cyclictest0-21swapper/119:20:011
1933983992718,5cyclictest0-21swapper/121:00:011
1933983992716,7cyclictest0-21swapper/121:35:001
1933983992714,10cyclictest1933973-21cyclictest20:30:141
1933979992722,3cyclictest1935702-21latency_hist19:15:010
1933979992721,4cyclictest1989747-21kworker/u8:1+events_unbound21:56:370
1933979992721,4cyclictest1989747-21kworker/u8:1+events_unbound21:56:360
1933979992719,5cyclictest121ktimers/023:45:390
1933979992716,7cyclictest2040912-21grep00:15:250
1933979992716,7cyclictest2040912-21grep00:15:240
1933979992716,7cyclictest1970071-21grep20:50:250
1933979992716,7cyclictest1970071-21grep20:50:250
1933988992620,3cyclictest0-21swapper/219:30:262
1933988992618,6cyclictest1972465-21sendmail21:00:002
1933988992618,5cyclictest311ktimers/200:25:002
1933983992619,4cyclictest2042575-21grep00:20:251
1933983992619,4cyclictest1959866-21grep20:20:251
1933983992619,4cyclictest0-21swapper/121:55:251
1933983992619,4cyclictest0-21swapper/121:55:251
1933983992619,4cyclictest0-21swapper/121:20:271
1933983992618,5cyclictest0-21swapper/122:10:251
1933983992618,4cyclictest0-21swapper/120:25:251
1933983992617,6cyclictest0-21swapper/100:30:001
1933983992616,6cyclictest0-21swapper/120:00:001
1933979992619,5cyclictest0-21swapper/020:25:010
1933979992619,3cyclictest0-21swapper/022:40:010
1933979992617,6cyclictest121ktimers/021:05:170
1933979992617,6cyclictest121ktimers/021:05:160
1933988992519,3cyclictest0-21swapper/222:40:142
1933988992519,3cyclictest0-21swapper/219:45:012
1933988992519,3cyclictest0-21swapper/219:25:292
1933988992518,5cyclictest1993934-21kworker/u8:0+events_unbound22:17:052
1933988992517,5cyclictest0-21swapper/219:40:012
1933988992516,6cyclictest1982700-21sh21:30:012
1933988992514,7cyclictest2048356-21cron00:40:012
193398399255,4cyclictest2034804-21cpu00:00:131
1933983992519,3cyclictest0-21swapper/123:00:141
1933983992519,3cyclictest0-21swapper/123:00:131
1933983992518,5cyclictest178-21systemd-udevd23:20:391
1933983992518,5cyclictest178-21systemd-udevd23:20:391
1933983992518,3cyclictest0-21swapper/120:20:001
1933983992517,4cyclictest0-21swapper/121:00:171
1933983992517,4cyclictest0-21swapper/121:00:161
1933983992515,7cyclictest231ktimers/122:30:131
193397999252,6cyclictest0-21swapper/020:00:150
1933979992519,3cyclictest0-21swapper/022:50:230
1933979992518,4cyclictest0-21swapper/023:05:000
1933979992518,4cyclictest0-21swapper/023:05:000
1933979992518,4cyclictest0-21swapper/021:45:240
193397999251,7cyclictest1973213-21date21:00:220
193397999251,7cyclictest1973213-21date21:00:220
1933979992516,6cyclictest2021525-21ps23:20:230
1933979992516,6cyclictest2021525-21ps23:20:230
1933979992515,6cyclictest2037441-21grep00:05:260
1933988992419,3cyclictest1933973-21cyclictest20:45:002
1933988992419,2cyclictest0-21swapper/223:10:002
1933988992418,3cyclictest0-21swapper/223:00:222
1933988992418,3cyclictest0-21swapper/223:00:212
1933988992418,3cyclictest0-21swapper/220:25:262
1933988992417,5cyclictest1957117-21kworker/u8:2+events_unbound20:20:132
1933988992417,4cyclictest2009532-21grep22:45:262
1933988992417,4cyclictest0-21swapper/223:10:152
1933988992416,5cyclictest0-21swapper/223:30:162
1933983992416,4cyclictest0-21swapper/123:50:241
1933983992416,4cyclictest0-21swapper/123:31:481
1933983992414,7cyclictest1988607-21ntpq21:45:201
1933983992413,8cyclictest1970803-21sed20:55:011
1933983992413,8cyclictest1970803-21sed20:55:001
193397999248,14cyclictest121ktimers/000:10:100
193397999242,4cyclictest2018728-21apt-get23:15:040
1933979992413,8cyclictest2044237-21sed00:25:250
1933979992413,8cyclictest1950696-21sed19:55:190
193397999241,19cyclictest0-21swapper/023:28:480
193397999241,19cyclictest0-21swapper/019:45:400
1933988992317,3cyclictest0-21swapper/219:10:172
1933988992315,5cyclictest2033432-21sed23:55:192
1933988992314,6cyclictest2035801-21grep00:00:282
1933983992317,3cyclictest0-21swapper/122:15:251
1933983992312,6cyclictest0-21swapper/122:50:001
1933983992311,8cyclictest1-21systemd23:41:491
1933979992315,4cyclictest0-21swapper/000:20:240
193397999231,18cyclictest0-21swapper/023:32:470
193397999230,19cyclictest0-21swapper/023:09:200
193397999230,19cyclictest0-21swapper/022:03:090
193397999230,19cyclictest0-21swapper/021:27:040
193397999230,19cyclictest0-21swapper/020:13:240
193398899229,10cyclictest311ktimers/220:30:142
1933988992216,3cyclictest1972911-21fschecks_time21:00:162
1933988992216,3cyclictest1972911-21fschecks_time21:00:162
1933988992216,3cyclictest0-21swapper/223:15:222
1933988992216,3cyclictest0-21swapper/222:30:142
1933988992216,3cyclictest0-21swapper/220:00:212
1933988992211,3cyclictest2022726-21forks23:25:162
1933983992216,4cyclictest178-21systemd-udevd23:36:401
1933983992216,3cyclictest0-21swapper/122:25:231
1933983992216,3cyclictest0-21swapper/100:30:161
1933983992215,5cyclictest231ktimers/119:45:221
1933983992211,8cyclictest2036832-21wc00:05:191
193397999221,8cyclictest2008961-21cat22:45:190
1933979992215,3cyclictest0-21swapper/021:51:380
1933979992215,3cyclictest0-21swapper/019:22:130
193397999221,19cyclictest0-21swapper/020:40:100
193397999221,19cyclictest0-21swapper/020:26:150
193397999221,19cyclictest0-21swapper/019:33:210
193397999220,18cyclictest0-21swapper/023:41:250
193397999220,18cyclictest0-21swapper/020:37:080
1933988992113,6cyclictest0-21swapper/221:10:162
1933988992112,6cyclictest1990766-21grep21:50:242
1933988992111,6cyclictest311ktimers/223:50:062
1933983992116,3cyclictest645-21runrttasks23:15:101
1933983992115,3cyclictest0-21swapper/123:29:591
1933983992115,3cyclictest0-21swapper/121:40:241
1933983992115,3cyclictest0-21swapper/100:10:171
1933988992014,3cyclictest0-21swapper/200:10:002
1933983992014,3cyclictest0-21swapper/122:50:151
1933983992011,6cyclictest0-21swapper/121:15:011
1933983991813,3cyclictest0-21swapper/119:40:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional