You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 06:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sun Sep 13, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2771884995041,5cyclictest208-21systemd-logind00:28:573
2771879994834,10cyclictest311ktimers/200:25:112
2771879994740,5cyclictest2770286-21kworker/u8:0+events_unbound19:12:372
2771884994640,4cyclictest2860244-21kworker/u8:1+events_unbound23:38:493
2771884994639,5cyclictest2885734-21kworker/u8:3+events_unbound00:38:313
2771879994640,4cyclictest2851504-21kworker/u8:0+events_unbound23:18:442
2771879994640,4cyclictest2851504-21kworker/u8:0+events_unbound23:18:432
2771875994537,6cyclictest2813457-21kworker/u8:2+events_unbound21:23:171
2771884994331,4cyclictest2791411-21kworker/u8:1+events_unbound20:23:053
2771879994335,4cyclictest0-21swapper/222:15:002
2771867994331,8cyclictest121ktimers/021:25:120
2771879994235,4cyclictest2879239-21munin-plugin-st00:20:002
2771879994235,4cyclictest2879239-21munin-plugin-st00:20:002
2771875994236,4cyclictest2803432-21kworker/u8:0+events_unbound20:53:101
2771875994233,6cyclictest0-21swapper/121:00:001
2771867994234,4cyclictest2860278-21idleruntime-cro23:25:000
2771884994133,5cyclictest2863204-21unixbench_multi23:30:233
2771884994132,5cyclictest131rcu_preempt22:15:003
2771884994124,5cyclictest2829322-21kworker/u8:1+events_unbound21:58:543
2771879994133,4cyclictest2865365-21cron23:40:012
2771879994133,4cyclictest0-21swapper/223:15:002
2771875994133,4cyclictest0-21swapper/119:20:011
2771875994128,10cyclictest231ktimers/122:35:141
2771884994026,10cyclictest391ktimers/320:50:133
2771879994034,3cyclictest2837896-21modprobe22:20:002
2771879994033,4cyclictest2817398-21grep21:20:002
2771875994032,4cyclictest0-21swapper/120:40:141
2771884993927,7cyclictest2779037-21grep19:25:283
2771884993918,11cyclictest2815401-21kworker/u8:3-events_freezable_power_21:53:033
2771875993930,5cyclictest2886083-21cron00:40:011
2771884993832,4cyclictest2829322-21kworker/u8:1+events_unbound22:05:413
2771875993830,4cyclictest0-21swapper/100:05:161
2771875993825,10cyclictest231ktimers/121:00:141
2771867993830,4cyclictest2824204-21cron21:40:010
2771884993730,5cyclictest391ktimers/319:20:153
2771884993726,7cyclictest0-21swapper/319:20:013
2771879993731,4cyclictest2839447-21kworker/u8:1+events_unbound22:23:342
2771875993727,6cyclictest0-21swapper/120:25:011
2771875993724,7cyclictest0-21swapper/100:00:271
2771884993617,9cyclictest131rcu_preempt19:30:173
2771875993626,6cyclictest2793674-21fschecks_count20:10:161
2771875993625,7cyclictest2877124-21grep00:10:301
2771867993627,5cyclictest0-21swapper/023:05:000
2771884993529,4cyclictest2800683-21kworker/u8:2+events_unbound20:34:413
2771884993525,7cyclictest391ktimers/319:10:153
2771884993525,7cyclictest0-21swapper/322:20:243
2771875993513,5cyclictest131rcu_preempt19:48:521
2771867993528,4cyclictest2793305-21apt20:10:010
2771884993427,5cyclictest2815401-21kworker/u8:3+events_unbound21:18:183
2771879993426,4cyclictest0-21swapper/221:08:142
2771879993426,4cyclictest0-21swapper/221:08:142
2771879993423,8cyclictest311ktimers/219:40:142
2771879993423,7cyclictest2806476-21grep20:45:272
2771875993416,11cyclictest131rcu_preempt19:52:441
2771875993416,10cyclictest131rcu_preempt22:32:351
2771875993415,5cyclictest0-21swapper/123:00:241
2771875993412,13cyclictest131rcu_preempt20:15:131
2771867993429,3cyclictest2858434-21sshd23:18:440
2771867993429,3cyclictest2858434-21sshd23:18:440
2771867993427,3cyclictest2775856-21kworker/u8:219:20:010
2771867993425,5cyclictest0-21swapper/023:45:010
2771884993326,5cyclictest2818726-21kworker/u8:0+events_unbound21:24:413
2771884993325,4cyclictest0-21swapper/300:30:213
2771884993324,6cyclictest0-21swapper/319:40:273
2771884993323,6cyclictest0-21swapper/321:35:013
2771884993313,4cyclictest131rcu_preempt00:20:213
2771884993313,4cyclictest131rcu_preempt00:20:203
2771884993311,4cyclictest0-21swapper/320:35:253
2771879993327,4cyclictest2839447-21kworker/u8:1+events_unbound22:35:402
2771879993327,4cyclictest2782466-21kworker/u8:2+events_unbound19:57:452
2771879993326,4cyclictest2800132-21kthreadd20:30:012
2771879993325,4cyclictest0-21swapper/220:50:252
2771879993324,6cyclictest2792000-21fschecks_count20:05:172
2771875993326,5cyclictest2870022-21unixbench_multi23:50:261
2771875993325,4cyclictest0-21swapper/121:10:261
2771875993325,4cyclictest0-21swapper/121:10:261
2771875993325,4cyclictest0-21swapper/120:40:011
2771875993324,6cyclictest2780679-21grep19:30:261
2771875993322,4cyclictest131rcu_preempt23:46:031
2771875993319,3cyclictest131rcu_preempt23:35:231
2771875993317,9cyclictest131rcu_preempt21:56:471
2771875993314,9cyclictest131rcu_preempt00:15:281
2771875993314,9cyclictest131rcu_preempt00:15:271
2771867993325,4cyclictest0-21swapper/023:50:270
2771867993322,8cyclictest2784610-21latency_hist19:45:010
277188499327,7cyclictest40-21ksoftirqd/323:25:243
2771884993223,6cyclictest0-21swapper/320:00:243
2771884993219,5cyclictest131rcu_preempt23:45:143
2771884993214,5cyclictest131rcu_preempt19:50:133
2771884993214,10cyclictest131rcu_preempt21:10:213
2771884993214,10cyclictest131rcu_preempt21:10:213
2771884993212,4cyclictest131rcu_preempt23:18:443
2771884993212,4cyclictest131rcu_preempt23:18:443
2771879993227,3cyclictest2872220-21sendmail00:00:012
277187999321,5cyclictest131rcu_preempt00:05:132
2771879993215,5cyclictest0-21swapper/221:13:152
2771879993215,5cyclictest0-21swapper/221:13:152
277187599328,6cyclictest24-21ksoftirqd/123:15:171
277187599328,6cyclictest24-21ksoftirqd/123:15:171
277187599328,5cyclictest2860270-21sh23:25:001
2771875993226,4cyclictest2782466-21kworker/u8:2+events_unbound20:02:441
2771875993222,6cyclictest2856391-21grep23:10:271
2771875993213,3cyclictest131rcu_preempt20:07:001
2771867993226,4cyclictest2770286-21kworker/u8:0+events_unbound19:37:410
2771867993213,16cyclictest2771862-21cyclictest21:05:260
2771867993213,16cyclictest2771862-21cyclictest21:05:250
277188499318,5cyclictest131rcu_preempt20:55:263
277188499318,4cyclictest0-21swapper/323:40:223
2771884993121,6cyclictest2844918-21sendmail22:40:003
2771884993121,6cyclictest0-21swapper/320:05:263
2771884993118,5cyclictest131rcu_preempt21:45:013
2771884993117,5cyclictest131rcu_preempt20:25:233
2771884993115,5cyclictest131rcu_preempt20:40:133
2771884993115,4cyclictest131rcu_preempt19:45:253
2771884993114,5cyclictest2847944-21kworker/u8:1-events_unbound22:46:203
2771884993113,3cyclictest131rcu_preempt00:15:233
2771884993113,3cyclictest131rcu_preempt00:15:233
2771884993111,3cyclictest131rcu_preempt22:25:123
2771884993110,12cyclictest40-21ksoftirqd/322:00:193
2771884993110,10cyclictest2811730-21kworker/u8:1+events_power_efficient21:02:173
2771879993124,3cyclictest0-21swapper/222:45:182
277187599319,8cyclictest24-21ksoftirqd/122:30:011
277187599314,6cyclictest24-21ksoftirqd/119:27:381
277187599313,7cyclictest24-21ksoftirqd/123:05:161
2771875993123,4cyclictest0-21swapper/120:45:181
2771875993122,4cyclictest0-21swapper/120:25:271
2771875993121,7cyclictest231ktimers/121:50:241
2771875993121,7cyclictest231ktimers/119:35:211
2771875993120,9cyclictest231ktimers/122:50:241
2771875993120,8cyclictest231ktimers/122:55:231
2771875993120,3cyclictest131rcu_preempt21:30:211
2771875993115,5cyclictest131rcu_preempt19:41:041
2771867993124,5cyclictest2880653-21kworker/u8:2+events_unbound00:29:260
277188499309,13cyclictest40-21ksoftirqd/320:45:263
277188499309,12cyclictest40-21ksoftirqd/323:20:233
277188499309,11cyclictest40-21ksoftirqd/300:15:003
277188499309,11cyclictest2837996-21apt-config22:20:013
277188499308,11cyclictest40-21ksoftirqd/323:10:153
277188499307,11cyclictest40-21ksoftirqd/323:05:163
2771884993019,7cyclictest0-21swapper/323:55:263
2771884993015,4cyclictest131rcu_preempt23:00:233
2771884993014,5cyclictest131rcu_preempt23:50:193
2771884993013,5cyclictest0-21swapper/321:40:013
277188499300,4cyclictest0-21swapper/321:05:133
277188499300,4cyclictest0-21swapper/321:05:123
2771879993024,3cyclictest0-21swapper/221:55:162
2771879993023,4cyclictest0-21swapper/220:55:262
2771879993022,4cyclictest0-21swapper/220:43:082
2771879993011,6cyclictest2871948-21kworker/u8:1+events_unbound00:10:242
277187999301,14cyclictest0-21swapper/223:31:022
277187599307,6cyclictest24-21ksoftirqd/119:10:231
277187599306,8cyclictest24-21ksoftirqd/100:25:161
277187599304,8cyclictest24-21ksoftirqd/122:50:011
2771875993021,7cyclictest231ktimers/122:15:261
2771875993020,7cyclictest231ktimers/120:30:171
2771875993019,5cyclictest0-21swapper/121:19:591
2771875993015,4cyclictest131rcu_preempt19:23:011
2771875993014,9cyclictest131rcu_preempt22:21:141
2771875993013,4cyclictest131rcu_preempt22:00:261
2771875993010,5cyclictest131rcu_preempt19:55:231
2771867993023,3cyclictest0-21swapper/023:50:010
2771867993022,4cyclictest0-21swapper/023:05:160
2771867993021,5cyclictest0-21swapper/022:44:590
277188499299,10cyclictest40-21ksoftirqd/320:10:163
277188499298,11cyclictest40-21ksoftirqd/300:10:003
277188499298,10cyclictest131rcu_preempt22:33:443
2771884992919,7cyclictest0-21swapper/300:00:123
2771884992916,4cyclictest131rcu_preempt22:55:293
2771884992915,5cyclictest2770286-21kworker/u8:0+events_unbound19:35:463
2771884992911,6cyclictest131rcu_preempt21:25:093
2771884992910,10cyclictest131rcu_preempt22:50:233
2771879992923,4cyclictest2791411-21kworker/u8:1+events_unbound20:38:172
2771879992922,4cyclictest2825511-21unixbench_singl21:40:242
2771879992921,4cyclictest0-21swapper/219:30:272
2771879992919,7cyclictest311ktimers/219:25:152
2771879992913,5cyclictest131rcu_preempt22:55:002
2771879992910,7cyclictest32-21ksoftirqd/200:05:002
277187599299,5cyclictest231ktimers/121:45:251
277187599299,3cyclictest131rcu_preempt00:31:511
277187599299,11cyclictest221rcuc/121:37:581
277187599295,6cyclictest24-21ksoftirqd/121:40:171
2771875992919,7cyclictest231ktimers/123:40:191
2771875992919,7cyclictest231ktimers/121:10:011
2771875992919,7cyclictest231ktimers/121:10:011
2771875992912,9cyclictest131rcu_preempt00:20:201
2771875992912,9cyclictest131rcu_preempt00:20:201
2771875992910,5cyclictest131rcu_preempt22:10:211
2771875992910,4cyclictest0-21swapper/123:30:151
2771867992922,4cyclictest13550irq/42-30be0000.ethernet20:35:250
277186799291,9cyclictest28016892sshd20:33:240
2771867992919,6cyclictest2773048-21grep19:10:280
2771867992913,13cyclictest2786859-21fschecks_count19:50:170
2771884992812,4cyclictest131rcu_preempt20:20:023
277187999282,3cyclictest2810602-21apt-get21:00:152
2771879992822,3cyclictest0-21swapper/219:20:202
2771879992821,4cyclictest2822511-21auditctl21:35:012
2771879992821,3cyclictest0-21swapper/220:10:262
2771879992813,5cyclictest2878342-21kworker/u8:0+events_unbound00:34:412
2771879992812,9cyclictest32-21ksoftirqd/221:45:252
2771879992812,7cyclictest32-21ksoftirqd/223:53:082
277187599286,8cyclictest24-21ksoftirqd/123:25:151
277187599283,6cyclictest24-21ksoftirqd/122:05:161
2771875992819,6cyclictest231ktimers/123:55:201
2771875992815,4cyclictest131rcu_preempt22:45:001
277186799288,9cyclictest11-21ksoftirqd/020:55:130
2771867992820,4cyclictest0-21swapper/021:05:010
2771867992819,5cyclictest0-21swapper/020:00:000
2771867992817,8cyclictest2863671-21audit_send_reply23:35:000
2771867992817,7cyclictest2824513-21awk21:40:120
2771867992816,6cyclictest2868444-21kworker/u8:2+events_unbound00:00:040
2771867992812,10cyclictest0-21swapper/020:15:230
277186799281,14cyclictest438-21cron22:35:000
2771884992718,6cyclictest381rcuc/319:55:163
2771884992715,5cyclictest131rcu_preempt22:40:183
2771884992712,3cyclictest131rcu_preempt21:45:213
277187999279,6cyclictest2815401-21kworker/u8:3+events_unbound21:53:542
2771879992721,4cyclictest2800683-21kworker/u8:2+events_unbound20:34:292
2771879992720,4cyclictest0-21swapper/219:35:132
2771879992719,5cyclictest0-21swapper/221:25:242
2771879992717,6cyclictest0-21swapper/220:15:272
2771879992714,7cyclictest32-21ksoftirqd/221:35:262
2771879992714,7cyclictest32-21ksoftirqd/220:20:172
2771879992714,7cyclictest32-21ksoftirqd/200:20:142
2771879992714,7cyclictest32-21ksoftirqd/200:20:142
2771879992713,7cyclictest32-21ksoftirqd/200:35:142
2771879992712,7cyclictest32-21ksoftirqd/222:55:202
2771879992712,7cyclictest32-21ksoftirqd/221:20:192
2771879992711,10cyclictest32-21ksoftirqd/223:05:152
2771875992710,10cyclictest131rcu_preempt21:25:131
277186799275,16cyclictest2830185-1kworker/0:0H+mmc_complete22:30:020
2771867992720,5cyclictest2834073-21kworker/u8:0+events_unbound22:13:410
2771867992719,5cyclictest0-21swapper/021:15:000
2771867992719,5cyclictest0-21swapper/021:15:000
2771867992718,4cyclictest0-21swapper/000:20:000
2771867992718,4cyclictest0-21swapper/000:20:000
2771867992717,5cyclictest0-21swapper/023:55:260
277186799271,4cyclictest131rcu_preempt20:00:110
2771867992712,7cyclictest131rcu_preempt21:47:270
2771879992618,4cyclictest0-21swapper/222:40:262
2771879992613,7cyclictest32-21ksoftirqd/222:05:112
277186799262,4cyclictest131rcu_preempt19:45:170
2771867992617,6cyclictest2874913-21ntpq00:05:210
2771867992616,6cyclictest2877070-21grep00:10:300
2771867992613,9cyclictest204-21dbus-daemon21:33:230
277186799261,22cyclictest28513872sleep022:56:050
2771879992517,5cyclictest2782466-21kworker/u8:2+events_unbound19:45:042
2771879992516,6cyclictest2831824-21seq22:00:202
2771879992515,6cyclictest0-21swapper/219:20:012
2771879992512,3cyclictest32-21ksoftirqd/223:00:232
2771879992511,7cyclictest32-21ksoftirqd/219:50:172
2771879992510,3cyclictest131rcu_preempt22:30:002
277186799253,3cyclictest2837864-21apt-get22:20:030
2771867992518,4cyclictest0-21swapper/020:10:260
277186799251,5cyclictest2830185-1kworker/0:0H+mmc_complete22:20:000
277186799251,20cyclictest0-21swapper/022:49:530
277186799251,20cyclictest0-21swapper/021:20:050
277186799251,11cyclictest0-21swapper/000:20:240
277186799251,11cyclictest0-21swapper/000:20:240
277186799250,6cyclictest2815957-21cpu21:15:150
277187999245,5cyclictest131rcu_preempt20:00:102
2771879992413,3cyclictest32-21ksoftirqd/223:44:212
2771879992411,7cyclictest32-21ksoftirqd/223:20:222
2771879992411,3cyclictest131rcu_preempt23:25:202
277186799243,15cyclictest2771377-21kworker/0:1-mm_percpu_wq23:10:240
2771867992417,3cyclictest0-21swapper/022:50:310
2771867992416,4cyclictest438-21cron19:25:010
2771867992410,7cyclictest11-21ksoftirqd/020:45:180
277186799236,11cyclictest2842846-21kworker/u8:0+events_unbound22:37:180
2771867992316,4cyclictest2829322-21kworker/u8:1+events_unbound22:04:120
2771867992315,5cyclictest0-21swapper/021:50:230
277186799231,3cyclictest2779685-21apt-get19:30:130
2771867992313,7cyclictest11-21ksoftirqd/022:10:000
2771867992313,6cyclictest2883895-21sed00:30:300
277186799231,20cyclictest0-21swapper/019:26:540
277186799231,11cyclictest2830185-1kworker/0:0H+mmc_complete22:00:010
2771867992310,9cyclictest121ktimers/023:25:110
277186799230,19cyclictest0-21swapper/000:35:500
277186799221,19cyclictest0-21swapper/020:25:060
277186799221,17cyclictest0-21swapper/020:20:090
277187999219,3cyclictest131rcu_preempt23:45:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional