You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 01:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 22, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2269573995340,9cyclictest391ktimers/309:10:123
2269573995037,10cyclictest391ktimers/310:50:123
2269560994835,10cyclictest121ktimers/009:05:120
2269569994634,8cyclictest2294198-21sendmail08:20:012
2269563994531,10cyclictest231ktimers/112:20:101
2269563994531,10cyclictest231ktimers/112:20:101
2269573994432,8cyclictest2321675-21cron09:40:013
2269569994430,10cyclictest311ktimers/210:25:112
2269563994330,10cyclictest231ktimers/111:30:121
2269563994232,6cyclictest2280537-21munin-run07:40:001
2269563994230,8cyclictest2295893-21auditctl08:25:011
2269560994236,4cyclictest2316283-21kworker/u8:1+events_unbound09:28:390
2269573994029,5cyclictest0-21swapper/310:19:593
2269563994032,5cyclictest2277137-21ls07:30:001
2269563994026,10cyclictest231ktimers/110:40:121
2269563994025,12cyclictest231ktimers/108:00:121
2269560994033,5cyclictest2338499-21kworker/u8:0+events_unbound10:28:520
2269560994032,6cyclictest121ktimers/012:05:110
2269560994028,9cyclictest438-21cron12:30:000
2269573993930,5cyclictest2340438-21cron10:35:013
2269563993929,4cyclictest131rcu_preempt07:50:101
2269573993828,7cyclictest2311520-21latency_hist09:10:003
2269560993831,4cyclictest2271887-21fschecks_count07:15:030
2269569993728,6cyclictest0-21swapper/211:00:002
2269569993727,6cyclictest0-21swapper/212:30:242
2269563993728,5cyclictest0-21swapper/112:30:001
2269563993726,7cyclictest0-21swapper/109:45:231
2269563993718,5cyclictest131rcu_preempt07:11:411
2269569993627,6cyclictest2314858-21sh09:20:012
2269569993625,7cyclictest2350262-21grep11:00:252
2269563993619,5cyclictest131rcu_preempt10:00:161
2269560993630,4cyclictest2304235-21kworker/u8:2+events_unbound08:48:330
2269560993628,4cyclictest0-21swapper/011:00:250
2269569993523,8cyclictest2353814-21grep11:10:242
2269569993523,7cyclictest0-21swapper/207:13:162
2269569993522,9cyclictest2317873-21grep09:25:262
2269563993528,4cyclictest2352598-21apt11:10:001
2269563993526,5cyclictest2376465-21cron12:20:001
2269563993525,5cyclictest0-21swapper/112:04:591
2269560993528,4cyclictest2314860-21sh09:20:010
2269569993428,4cyclictest2342165-21sendmail10:40:012
226956399349,4cyclictest231ktimers/112:35:131
2269563993427,4cyclictest0-21swapper/110:45:151
2269563993426,4cyclictest2373063-21latency_hist12:10:001
2269563993424,3cyclictest131rcu_preempt10:20:511
2269563993415,9cyclictest131rcu_preempt08:12:531
2269560993426,4cyclictest2378176-21sh12:25:000
2269560993426,4cyclictest2378176-21sh12:25:000
2269560993423,7cyclictest2365782-21grep11:45:230
2269573993325,4cyclictest0-21swapper/307:40:243
2269573993325,4cyclictest0-21swapper/307:40:243
2269573993324,4cyclictest2365790-21grep11:45:233
2269573993323,5cyclictest0-21swapper/308:08:253
2269569993326,4cyclictest2333478-21kworker/u8:3+events_unbound10:18:482
2269569993324,5cyclictest0-21swapper/212:00:252
2269569993323,6cyclictest0-21swapper/211:50:002
2269569993321,8cyclictest311ktimers/208:00:132
226956399335,5cyclictest2302950-21/usr/sbin/munin08:45:181
2269563993327,4cyclictest2324756-21kworker/u8:2+events_unbound09:52:421
2269563993325,5cyclictest2314868-21munin-run09:20:011
2269563993324,4cyclictest0-21swapper/109:25:261
2269563993322,8cyclictest231ktimers/110:15:201
2269563993320,8cyclictest0-21swapper/109:20:241
2269563993318,9cyclictest131rcu_preempt09:08:361
2269573993221,7cyclictest0-21swapper/309:55:263
2269569993225,4cyclictest0-21swapper/211:35:162
2269569993224,4cyclictest0-21swapper/210:40:162
2269569993224,4cyclictest0-21swapper/207:30:252
2269569993223,6cyclictest208-21systemd-logind07:23:182
2269569993221,6cyclictest0-21swapper/207:35:242
226956399328,14cyclictest24-21ksoftirqd/108:40:011
226956399327,16cyclictest0-21swapper/111:25:011
226956399324,9cyclictest24-21ksoftirqd/108:25:231
2269563993223,5cyclictest2290372-21unixbench_singl08:05:251
226956399321,12cyclictest24-21ksoftirqd/107:20:011
2269560993225,4cyclictest2345285-21kworker/u8:0+events_unbound10:54:020
2269573993123,5cyclictest2297600-21ls08:30:013
2269573993123,4cyclictest0-21swapper/310:45:243
2269569993125,4cyclictest2364480-21kworker/u8:2+events_unbound11:54:112
2269569993124,4cyclictest2290778-21ls08:10:012
2269569993124,4cyclictest0-21swapper/207:45:002
2269569993124,4cyclictest0-21swapper/207:45:002
2269569993123,4cyclictest0-21swapper/209:40:012
2269569993122,5cyclictest0-21swapper/211:45:002
226956399314,6cyclictest24-21ksoftirqd/107:20:171
2269563993124,4cyclictest2283957-21latency_hist07:50:001
2269563993123,5cyclictest0-21swapper/111:00:151
2269563993122,4cyclictest131rcu_preempt09:10:171
2269563993121,6cyclictest2321199-21grep09:35:251
2269563993116,9cyclictest131rcu_preempt11:19:091
2269563993116,9cyclictest131rcu_preempt10:38:551
2269563993116,9cyclictest131rcu_preempt09:30:251
2269563993115,4cyclictest0-21swapper/111:25:131
2269563993114,9cyclictest131rcu_preempt10:55:221
2269563993111,14cyclictest221rcuc/110:05:131
2269563993111,14cyclictest221rcuc/110:05:131
2269560993119,10cyclictest121ktimers/012:10:110
2269560993110,4cyclictest131rcu_preempt11:55:160
2269573993024,3cyclictest2269553-21cyclictest12:30:123
2269573993023,3cyclictest0-21swapper/309:00:253
2269573993023,3cyclictest0-21swapper/308:45:253
2269573993021,4cyclictest0-21swapper/307:15:013
2269573993018,8cyclictest0-21swapper/310:35:163
2269569993022,5cyclictest0-21swapper/211:35:012
2269569993020,6cyclictest0-21swapper/210:20:252
226956399305,5cyclictest24-21ksoftirqd/111:35:161
226956399304,7cyclictest24-21ksoftirqd/111:45:141
2269563993023,4cyclictest0-21swapper/111:50:151
2269563993023,4cyclictest0-21swapper/108:55:261
2269563993020,6cyclictest0-21swapper/107:35:001
2269563993015,5cyclictest131rcu_preempt10:34:091
2269563993013,9cyclictest131rcu_preempt07:55:121
2269563993013,3cyclictest131rcu_preempt10:11:281
2269563993013,3cyclictest131rcu_preempt10:11:281
2269563993012,5cyclictest24-21ksoftirqd/111:10:231
2269563993012,3cyclictest131rcu_preempt12:32:461
2269563993011,4cyclictest131rcu_preempt11:42:031
2269563993011,3cyclictest131rcu_preempt08:32:011
226956099302,4cyclictest131rcu_preempt10:30:120
2269560993023,4cyclictest0-21swapper/007:35:000
2269560993021,6cyclictest0-21swapper/009:40:010
2269560993020,6cyclictest2345162-21grep10:45:250
2269560993020,6cyclictest0-21swapper/009:50:250
2269560993020,5cyclictest2382870-21grep12:35:230
2269573992921,4cyclictest0-21swapper/310:05:243
2269573992921,4cyclictest0-21swapper/310:05:243
2269573992915,12cyclictest2269553-21cyclictest09:25:133
2269569992923,3cyclictest0-21swapper/208:40:012
2269569992921,5cyclictest0-21swapper/209:05:002
226956399298,3cyclictest131rcu_preempt09:41:541
226956399295,6cyclictest24-21ksoftirqd/110:50:221
2269563992912,4cyclictest131rcu_preempt08:40:151
2269563992910,3cyclictest131rcu_preempt08:18:261
226956099297,4cyclictest131rcu_preempt09:55:110
226956099294,4cyclictest131rcu_preempt08:25:130
2269560992923,4cyclictest2349472-21kworker/u8:1+events_unbound11:38:400
2269560992923,4cyclictest2280418-21kworker/u8:3+events_unbound09:00:400
2269560992921,4cyclictest0-21swapper/008:40:160
2269560992921,4cyclictest0-21swapper/007:55:160
2269560992920,6cyclictest2271532-21latency_hist07:15:020
2269560992920,4cyclictest0-21swapper/010:40:150
2269560992917,7cyclictest2336618-21grep10:20:250
226956099291,4cyclictest131rcu_preempt11:10:110
226956099291,25cyclictest2289081-21munin-run08:05:010
2269560992912,13cyclictest151rcuc/010:15:250
2269573992821,4cyclictest0-21swapper/310:30:003
2269573992820,4cyclictest0-21swapper/312:25:263
2269573992819,5cyclictest0-21swapper/312:00:253
2269573992817,6cyclictest2362851-21sendmail-msp11:40:013
226956399286,7cyclictest24-21ksoftirqd/109:00:241
2269563992822,4cyclictest2321385-21kworker/u8:3+events_unbound09:56:411
2269563992810,5cyclictest131rcu_preempt10:25:181
226956399280,8cyclictest24-21ksoftirqd/111:55:251
2269560992820,4cyclictest13550irq/42-30be0000.ethernet10:55:250
2269560992820,4cyclictest0-21swapper/008:55:260
2269573992718,4cyclictest0-21swapper/312:39:183
2269573992716,8cyclictest204-21dbus-daemon07:23:183
2269573992716,7cyclictest1-21systemd12:19:133
2269563992712,3cyclictest131rcu_preempt07:40:131
2269563992712,3cyclictest131rcu_preempt07:40:131
2269563992712,10cyclictest131rcu_preempt12:12:241
2269560992720,3cyclictest0-21swapper/011:30:260
2269560992719,4cyclictest2294174-21sh08:20:010
2269560992715,8cyclictest204-21dbus-daemon10:38:560
2269573992617,6cyclictest2350732-21apt-key11:05:013
2269573992617,5cyclictest0-21swapper/307:15:023
2269573992616,6cyclictest0-21swapper/311:24:043
2269569992618,6cyclictest2352140-21unixbench_multi11:05:252
2269569992616,6cyclictest2294632-21tune2fs08:20:172
2269569992610,13cyclictest32-21ksoftirqd/212:15:102
2269560992620,4cyclictest2352289-21kworker/u8:2+events_unbound11:29:050
2269560992620,3cyclictest2325100-21auditctl09:50:000
2269560992618,4cyclictest13550irq/42-30be0000.ethernet11:05:250
2269560992618,4cyclictest0-21swapper/011:50:250
2269560992617,6cyclictest0-21swapper/012:20:000
2269560992617,6cyclictest0-21swapper/011:25:010
2269560992616,7cyclictest2275441-21grep07:25:010
2269560992611,6cyclictest0-21swapper/007:50:240
2269573992519,3cyclictest0-21swapper/312:05:133
2269573992518,3cyclictest0-21swapper/312:10:143
2269573992518,3cyclictest0-21swapper/311:20:003
2269573992518,3cyclictest0-21swapper/309:00:013
2269573992517,4cyclictest0-21swapper/309:30:253
2269573992517,4cyclictest0-21swapper/308:50:253
2269569992520,2cyclictest0-21swapper/208:45:142
2269569992518,5cyclictest0-21swapper/210:00:002
2269569992518,4cyclictest0-21swapper/209:45:142
2269569992518,3cyclictest0-21swapper/208:30:272
2269560992519,4cyclictest2280418-21kworker/u8:3+events_unbound08:52:250
2269560992518,5cyclictest2273556-21kworker/u8:0+events_unbound07:44:360
2269560992518,5cyclictest2273556-21kworker/u8:0+events_unbound07:44:360
2269560992517,4cyclictest0-21swapper/010:00:260
2269573992416,6cyclictest2326729-21kworker/u8:0+events_unbound09:54:233
2269573992416,5cyclictest0-21swapper/308:40:263
2269573992416,4cyclictest2314861-21sh09:20:013
2269573992415,4cyclictest0-21swapper/307:50:143
2269573992414,7cyclictest2364111-21grep11:40:243
2269573992414,7cyclictest0-21swapper/309:40:243
2269573992414,5cyclictest2352197-21head11:05:253
2269569992418,3cyclictest0-21swapper/210:30:152
2269569992418,3cyclictest0-21swapper/208:10:152
2269569992417,5cyclictest2349472-21kworker/u8:1+events_unbound11:20:352
2269569992417,4cyclictest0-21swapper/212:40:002
2269569992417,4cyclictest0-21swapper/209:05:252
2269569992416,5cyclictest0-21swapper/208:40:262
2269569992415,5cyclictest2287352-21auditctl08:00:012
2269569992415,5cyclictest0-21swapper/210:05:152
2269569992415,5cyclictest0-21swapper/210:05:142
2269569992414,7cyclictest2322136-21tune2fs09:40:142
2269569992412,9cyclictest2333835-21latency_hist10:15:012
2269560992418,4cyclictest2273556-21kworker/u8:0+events_unbound07:45:050
2269560992417,5cyclictest2294106-21kworker/u8:0+events_unbound08:35:240
2269560992417,5cyclictest2280418-21kworker/u8:3+events_unbound09:10:280
2269560992417,4cyclictest13550irq/42-30be0000.ethernet11:40:250
2269560992417,3cyclictest0-21swapper/008:10:230
2269560992416,6cyclictest2278547-21kworker/u8:1+events_unbound07:37:460
2269560992416,6cyclictest121ktimers/012:30:120
2269560992416,5cyclictest0-21swapper/011:20:000
2269560992415,6cyclictest0-21swapper/010:15:010
2269560992415,6cyclictest0-21swapper/010:15:010
226956099241,19cyclictest0-21swapper/009:34:120
2269573992318,3cyclictest0-21swapper/308:00:133
2269573992317,3cyclictest0-21swapper/312:20:143
2269573992317,3cyclictest0-21swapper/312:20:143
2269573992317,3cyclictest0-21swapper/311:30:153
2269573992317,3cyclictest0-21swapper/310:20:173
2269573992316,3cyclictest0-21swapper/311:30:013
2269573992314,5cyclictest0-21swapper/308:40:013
226957399231,3cyclictest23158892wc09:20:233
2269573992312,6cyclictest2295422-21grep08:20:253
2269569992317,4cyclictest2280418-21kworker/u8:3+events_unbound07:48:222
2269569992316,5cyclictest0-21swapper/207:15:032
2269569992315,4cyclictest0-21swapper/210:45:252
226956099235,4cyclictest131rcu_preempt08:20:250
226956099231,19cyclictest22902152sleep008:05:240
226956099231,18cyclictest0-21swapper/012:04:580
226956099231,18cyclictest0-21swapper/008:31:300
226956099230,19cyclictest0-21swapper/009:41:410
2269573992216,3cyclictest0-21swapper/311:10:183
2269573992215,4cyclictest2280418-21kworker/u8:3+events_unbound08:13:263
2269573992215,3cyclictest645-21runrttasks07:30:013
2269573992214,4cyclictest0-21swapper/308:00:013
2269573992213,5cyclictest0-21swapper/309:50:013
2269573992212,6cyclictest2283337-21cat07:45:253
226957399221,13cyclictest0-21swapper/310:40:183
2269569992217,2cyclictest0-21swapper/209:30:222
2269569992216,4cyclictest2280418-21kworker/u8:3+events_unbound08:25:252
2269569992216,3cyclictest2358480-21ntpq11:25:192
2269569992216,3cyclictest0-21swapper/212:25:252
2269569992216,3cyclictest0-21swapper/212:05:232
2269569992215,3cyclictest0-21swapper/211:55:262
2269569992214,5cyclictest2356035-21modprobe11:20:002
2269569992214,5cyclictest0-21swapper/209:55:012
2269569992214,5cyclictest0-21swapper/207:50:142
2269569992214,3cyclictest0-21swapper/210:55:002
2269569992213,5cyclictest0-21swapper/209:20:242
2269569992211,8cyclictest2373871-21awk12:10:212
226956099220,18cyclictest0-21swapper/009:23:230
2269573992115,3cyclictest0-21swapper/310:55:133
2269573992115,3cyclictest0-21swapper/308:30:203
2269573992114,4cyclictest2280532-21latency_hist07:40:003
2269573992113,5cyclictest0-21swapper/311:55:223
226956999219,9cyclictest2311847-21cut09:10:152
2269569992115,3cyclictest0-21swapper/209:00:012
2269569992115,3cyclictest0-21swapper/208:50:252
226956999211,4cyclictest2377722-21tail12:20:232
226956999211,4cyclictest2377722-21tail12:20:232
2269569992113,5cyclictest0-21swapper/210:00:262
226957399208,6cyclictest2294173-21sh08:20:013
2269573992015,3cyclictest2367228-21sh11:50:233
2269573992014,3cyclictest0-21swapper/310:00:243
2269573992011,5cyclictest2278402-21grep07:30:253
2269569992014,3cyclictest2277123-21cron07:30:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional