You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 14:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Fri Dec 26, 2025 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2624221450,2sleep2131rcu_preempt12:10:272
2624221450,2sleep2131rcu_preempt12:10:272
803121300,3chrt0-21swapper/312:25:233
2558521190,3sleep30-21swapper/309:55:303
2558521190,3sleep30-21swapper/309:55:303
3163521160,3chrt0-21swapper/308:30:143
3163521160,3chrt0-21swapper/308:30:143
2307621160,3sleep30-21swapper/311:33:593
2307621160,3sleep30-21swapper/311:33:593
1571721160,3sleep30-21swapper/309:11:493
1571721160,3sleep30-21swapper/309:11:493
2214321140,2sleep20-21swapper/210:59:422
2214321140,2sleep20-21swapper/210:59:422
2214321140,2sleep20-21swapper/210:59:422
2766421050,4sleep30-21swapper/311:05:183
2766421050,4sleep30-21swapper/311:05:183
719221030,2sleep20-21swapper/207:20:222
719221030,2sleep20-21swapper/207:20:222
372721020,5sleep00-21swapper/007:10:240
35342990,4sleep30-21swapper/311:46:453
35342990,4sleep30-21swapper/311:46:453
178142980,3sleep30-21swapper/310:20:333
178142980,3sleep30-21swapper/310:20:333
319362930,3sleep30-21swapper/312:15:553
319362930,3sleep30-21swapper/312:15:553
319362930,3sleep30-21swapper/312:15:553
5862860,3chrt0-21swapper/210:36:322
5862860,3chrt0-21swapper/210:36:322
5862860,3chrt0-21swapper/210:36:322
31682760,4sleep00-21swapper/011:13:070
31682760,4sleep00-21swapper/011:13:070
155532690,3sleep30-21swapper/309:45:253
111922670,2sleep333-21ksoftirqd/311:55:213
111922670,2sleep333-21ksoftirqd/311:55:213
187622660,4sleep20-21swapper/209:49:062
152002660,2sleep30-21swapper/311:25:273
152002660,2sleep30-21swapper/311:25:273
6262650,7sleep333-21ksoftirqd/311:10:243
6262650,7sleep333-21ksoftirqd/311:10:243
214782650,9sleep227-21ksoftirqd/208:00:242
214782650,9sleep227-21ksoftirqd/208:00:242
259672640,6sleep2131rcu_preempt09:22:412
259672640,6sleep2131rcu_preempt09:22:412
191012640,3chrt0-21swapper/112:35:581
191012640,3chrt0-21swapper/112:35:581
191012640,3chrt0-21swapper/112:35:581
165602570,2chrt16561-21/usr/sbin/munin12:00:261
90992560,3sleep30-21swapper/310:45:293
90992560,3sleep30-21swapper/310:45:293
90992560,3sleep30-21swapper/310:45:293
221442560,3sleep00-21swapper/009:19:020
221442560,3sleep00-21swapper/009:19:020
221442560,3sleep00-21swapper/009:19:020
129992560,2sleep0151rcuc/007:35:310
129992560,2sleep0151rcuc/007:35:310
9422550,3sleep20-21swapper/210:04:132
9422550,3sleep20-21swapper/210:04:132
51572520,3chrt0-21swapper/011:49:030
51572520,3chrt0-21swapper/011:49:030
270862520,2sleep30-21swapper/310:30:303
270862520,2sleep30-21swapper/310:30:303
279732510,2sleep2261rcuc/211:05:212
279732510,2sleep2261rcuc/211:05:212
290702490,3sleep20-21swapper/209:25:312
290702490,3sleep20-21swapper/209:25:312
260532490,3sleep30-21swapper/312:10:243
260532490,3sleep30-21swapper/312:10:243
215842490,3sleep30-21swapper/308:00:253
215842490,3sleep30-21swapper/308:00:253
73092480,3chrt0-21swapper/307:20:233
73092480,3chrt0-21swapper/307:20:233
233232480,3sleep30-21swapper/309:53:413
233232480,3sleep30-21swapper/309:53:413
197612480,2sleep20-21swapper/212:04:162
212722470,2sleep012-21ksoftirqd/012:38:590
212722470,2sleep012-21ksoftirqd/012:38:590
212722470,2sleep012-21ksoftirqd/012:38:590
115142470,3chrt0-21swapper/209:40:462
3402460,2sleep30-21swapper/310:36:133
3402460,2sleep30-21swapper/310:36:133
3402460,2sleep30-21swapper/310:36:133
205302460,3chrt0-21swapper/310:57:263
205302460,3chrt0-21swapper/310:57:263
205302460,3chrt0-21swapper/310:57:263
295042450,4sleep20-21swapper/210:33:222
295042450,4sleep20-21swapper/210:33:222
215282450,3sleep10-21swapper/109:51:101
215282450,3sleep10-21swapper/109:51:101
139182450,3sleep30-21swapper/311:24:433
55892440,3sleep30-21swapper/307:15:243
55892440,3sleep30-21swapper/307:15:243
55892440,3sleep30-21swapper/307:15:243
285562440,4chrt0-21swapper/009:59:120
285562440,4chrt0-21swapper/009:59:120
255582440,3sleep30-21swapper/308:10:293
171372440,2sleep10-21swapper/109:13:481
171372440,2sleep10-21swapper/109:13:481
124762440,3chrt0-21swapper/211:55:442
124762440,3chrt0-21swapper/211:55:442
222692430,2sleep30-21swapper/309:19:133
222692430,2sleep30-21swapper/309:19:133
222692430,2sleep30-21swapper/309:19:133
306872420,2sleep20-21swapper/211:41:102
306872420,2sleep20-21swapper/211:41:102
141542420,3sleep10-21swapper/110:17:141
141542420,3sleep10-21swapper/110:17:141
141542420,3sleep10-21swapper/110:17:141
85292400,3chrt0-21swapper/311:52:003
64672400,6sleep2131rcu_preempt12:23:502
64672400,6sleep2131rcu_preempt12:23:502
274552400,3chrt0-21swapper/112:11:271
274552400,3chrt0-21swapper/112:11:271
79612390,3sleep20-21swapper/210:45:082
79612390,3sleep20-21swapper/210:45:082
458099391,11cyclictest5563-21cat08:45:290
458099391,11cyclictest5563-21cat08:45:290
273292390,3chrt0-21swapper/311:05:103
211912390,3sleep00-21swapper/009:50:400
211912390,3sleep00-21swapper/009:50:400
140392390,5sleep2261rcuc/210:50:302
319432380,3sleep30-21swapper/309:29:173
319432380,3sleep30-21swapper/309:29:173
242322380,10sleep333-21ksoftirqd/312:08:443
242322380,10sleep333-21ksoftirqd/312:08:443
167872380,3sleep10-21swapper/110:20:231
167872380,3sleep10-21swapper/110:20:231
163962380,2sleep227-21ksoftirqd/211:26:232
163962380,2sleep227-21ksoftirqd/211:26:232
60612370,2sleep16240-21grep07:15:311
60612370,2sleep16240-21grep07:15:311
60612370,2sleep16240-21grep07:15:311
458099371,11cyclictest15643-21ntp_states09:45:270
327332370,1sleep113239-21diskmemload10:36:071
327332370,1sleep113239-21diskmemload10:36:071
327332370,1sleep113239-21diskmemload10:36:071
283472370,3sleep20-21swapper/209:58:542
283472370,3sleep20-21swapper/209:58:542
241722370,4sleep10-21swapper/111:35:181
57742360,3sleep30-21swapper/311:15:313
57742360,3sleep30-21swapper/311:15:313
4580993612,3cyclictest9525-21ssh11:53:240
186152360,4sleep30-21swapper/312:35:283
186152360,4sleep30-21swapper/312:35:283
186152360,4sleep30-21swapper/312:35:283
184412360,3sleep30-21swapper/312:02:253
139172360,3sleep10-21swapper/110:50:291
458099359,4cyclictest15510-21ssh09:11:310
458099359,4cyclictest15510-21ssh09:11:310
458099354,10cyclictest13078-21/usr/sbin/munin10:50:250
4580993511,3cyclictest14193-21ssh11:58:100
4580993511,3cyclictest14193-21ssh11:58:100
458099351,10cyclictest24346-21df_inode11:35:220
458099351,10cyclictest24346-21df_inode11:35:220
458099351,10cyclictest24346-21df_inode11:35:220
297832350,3chrt29776-21ssh11:40:310
297832350,3chrt29776-21ssh11:40:310
190102350,2sleep219022-21ssh12:35:522
190102350,2sleep219022-21ssh12:35:522
190102350,2sleep219022-21ssh12:35:522
54752340,3sleep10-21swapper/109:35:221
54752340,3sleep10-21swapper/109:35:221
458099347,4cyclictest26224-21/usr/sbin/munin12:10:270
458099347,4cyclictest26224-21/usr/sbin/munin12:10:270
458099346,5cyclictest29284-21/usr/sbin/munin09:25:320
458099346,5cyclictest29284-21/usr/sbin/munin09:25:320
458099343,10cyclictest2926-21cpuspeed12:20:200
458099343,10cyclictest2926-21cpuspeed12:20:200
458099341,9cyclictest9853-21latency_hist09:40:090
458099341,9cyclictest9853-21latency_hist09:40:090
458099341,9cyclictest30254-21grep08:25:240
458099341,9cyclictest30254-21grep08:25:240
458099341,12cyclictest11226-21find07:30:260
458099341,12cyclictest11226-21find07:30:260
458099341,10cyclictest24004-21grep08:05:310
458099341,10cyclictest24004-21grep08:05:310
458099341,10cyclictest13769-21grep12:30:320
458099341,10cyclictest13769-21grep12:30:320
458099341,10cyclictest10277-21df_inode09:40:230
36282340,2sleep10-21swapper/109:33:131
36282340,2sleep10-21swapper/109:33:131
315372340,2sleep14579-21cyclictest09:28:431
315372340,2sleep14579-21cyclictest09:28:431
458099332,9cyclictest19591-21fschecks_time07:55:230
458099332,9cyclictest19591-21fschecks_time07:55:230
458099332,9cyclictest19591-21fschecks_time07:55:230
458099331,9cyclictest8059-21ssh10:45:120
458099331,9cyclictest8059-21ssh10:45:120
458099331,9cyclictest27501-21grep08:15:330
458099331,9cyclictest27501-21grep08:15:330
458099331,9cyclictest21972-21needreboot10:25:250
458099331,11cyclictest695-21runrttasks09:32:180
458099331,11cyclictest695-21runrttasks09:32:180
458099331,11cyclictest12902-21sed10:15:320
458099331,11cyclictest12902-21sed10:15:320
458099331,11cyclictest12902-21sed10:15:320
458099331,10cyclictest9748-21/usr/sbin/munin11:20:240
458099331,10cyclictest27496-21ssh10:30:330
458099331,10cyclictest27496-21ssh10:30:330
458099331,10cyclictest23808-21needreboot09:20:240
458099331,10cyclictest23808-21needreboot09:20:240
458099331,10cyclictest15145-21grep07:40:310
4580993310,3cyclictest17952-21ssh12:01:430
323042330,2sleep032326-21latency_hist11:10:140
323042330,2sleep032326-21latency_hist11:10:140
243352330,4sleep2261rcuc/210:27:562
132622330,3sleep30-21swapper/310:15:593
132622330,3sleep30-21swapper/310:15:593
132622330,3sleep30-21swapper/310:15:593
120862330,3sleep14579-21cyclictest12:29:511
458099321,9cyclictest32122-21cat08:30:230
458099321,9cyclictest32122-21cat08:30:230
458099321,11cyclictest21940-21users12:05:320
458099321,11cyclictest21940-21users12:05:320
458099321,11cyclictest18429-21ssh11:29:150
458099321,11cyclictest18429-21ssh11:29:150
458099321,10cyclictest8455-21grep08:55:230
458099321,10cyclictest8455-21grep08:55:230
458099321,10cyclictest7067-21fschecks_time10:10:220
458099321,10cyclictest29772-21fschecks_time10:00:220
458099321,10cyclictest29772-21fschecks_time10:00:220
41022325,18sleep24186-21/usr/sbin/munin07:10:302
165682320,4sleep30-21swapper/310:53:413
10082320,3sleep24579-21cyclictest09:30:252
10082320,3sleep24579-21cyclictest09:30:252
66702310,2sleep20-21swapper/211:50:262
458099317,4cyclictest62012chrt12:23:270
458099317,4cyclictest62012chrt12:23:270
458099311,9cyclictest9791-21unixbench_multi07:25:310
458099311,9cyclictest9791-21unixbench_multi07:25:310
458099311,9cyclictest29160-21cat08:20:310
458099311,9cyclictest29160-21cat08:20:310
458099311,9cyclictest22147-21sed08:00:310
458099311,9cyclictest22147-21sed08:00:310
458099311,9cyclictest20192-21ssh10:56:570
458099311,9cyclictest20192-21ssh10:56:570
458099311,9cyclictest20192-21ssh10:56:570
458099311,11cyclictest23894-21grep11:00:320
458099311,10cyclictest695-21runrttasks10:47:210
458099311,10cyclictest695-21runrttasks10:47:210
458099311,10cyclictest695-21runrttasks10:47:210
458099311,10cyclictest3300-21wc10:40:120
458099311,10cyclictest3300-21wc10:40:120
458099311,10cyclictest3300-21wc10:40:120
458099311,10cyclictest15924-21fschecks_count07:45:210
458099311,10cyclictest15924-21fschecks_count07:45:210
458099310,12cyclictest8345-21netstat12:25:270
458099307,6cyclictest0-21swapper/008:40:410
458099307,6cyclictest0-21swapper/008:40:410
458099301,9cyclictest5663-21ps11:15:300
458099301,9cyclictest5663-21ps11:15:300
458099301,9cyclictest25744-21grep08:10:300
458099301,9cyclictest2147-21grep08:35:320
458099301,9cyclictest2147-21grep08:35:320
458099301,9cyclictest2147-21grep08:35:320
458099301,9cyclictest10523-21netstat09:00:260
458099301,9cyclictest10523-21netstat09:00:260
458099301,10cyclictest20114-21ps11:30:270
458099301,10cyclictest20114-21ps11:30:270
458099300,10cyclictest1947-21/usr/sbin/munin10:05:230
458099300,10cyclictest1947-21/usr/sbin/munin10:05:230
304972300,1sleep030534-21/usr/sbin/munin12:15:210
110072300,2sleep2261rcuc/207:30:222
110072300,2sleep2261rcuc/207:30:222
458099291,10cyclictest17571-21/usr/sbin/munin07:50:340
458099291,10cyclictest17571-21/usr/sbin/munin07:50:340
95692280,3sleep30-21swapper/309:39:463
95692280,3sleep30-21swapper/309:39:463
4582992816,10cyclictest14034-21ssh11:24:532
458099281,10cyclictest7104-21fschecks_count07:20:210
458099281,10cyclictest7104-21fschecks_count07:20:210
253422280,3sleep30-21swapper/311:35:323
253422280,3sleep30-21swapper/311:35:323
253422280,3sleep30-21swapper/311:35:323
192822280,1sleep019292-21ssh10:22:400
192822280,1sleep019292-21ssh10:22:400
167072280,3sleep20-21swapper/207:45:292
167072280,3sleep20-21swapper/207:45:292
26612270,3sleep20-21swapper/211:45:322
26612270,3sleep20-21swapper/211:45:322
109612270,3chrt0-21swapper/309:40:313
92862250,3sleep30-21swapper/310:12:133
4582992515,8cyclictest26251-21cat08:15:122
305502250,2sleep230553-21grep08:25:272
305502250,2sleep230553-21grep08:25:272
49882240,4sleep30-21swapper/310:07:593
49882240,4sleep30-21swapper/310:07:593
4581992417,5cyclictest22440-21ssh12:06:131
4581992417,5cyclictest22440-21ssh12:06:131
4581992412,9cyclictest136-21systemd-journal11:40:091
4581992412,9cyclictest136-21systemd-journal11:40:091
4581992412,9cyclictest136-21systemd-journal11:40:091
4581992412,10cyclictest17279-21ssh11:27:371
4581992412,10cyclictest17279-21ssh11:27:371
4582992316,5cyclictest27528-21ssh11:38:272
4582992316,5cyclictest27528-21ssh11:38:272
4582992316,5cyclictest27528-21ssh11:38:272
4582992311,10cyclictest12294-21strings10:15:272
4582992311,10cyclictest12294-21strings10:15:272
4582992311,10cyclictest12294-21strings10:15:272
458199221,7cyclictest109152ssh10:47:311
458199221,7cyclictest109152ssh10:47:311
458199221,7cyclictest109152ssh10:47:311
4581992213,7cyclictest21117-21ssh11:31:131
4581992213,6cyclictest0-21swapper/111:05:241
4581992213,6cyclictest0-21swapper/111:05:241
4581992211,9cyclictest4679-21sh12:21:211
4581992211,9cyclictest4679-21sh12:21:211
458199221,15cyclictest8167-21find08:55:201
458199221,15cyclictest8167-21find08:55:201
272472220,3sleep30-21swapper/309:24:273
272472220,3sleep30-21swapper/309:24:273
87022210,3sleep20-21swapper/210:11:242
4582992114,5cyclictest23114-21cat11:00:242
458199219,10cyclictest18370-21ssh09:48:321
458199212,17cyclictest2174-21sed08:35:321
458199212,17cyclictest2174-21sed08:35:321
458199212,17cyclictest2174-21sed08:35:321
458199212,15cyclictest12891-21tune2fs12:30:231
458199212,15cyclictest12891-21tune2fs12:30:231
4581992115,5cyclictest20373-21ssh09:16:321
4581992115,5cyclictest20373-21ssh09:16:321
4581992115,5cyclictest20373-21ssh09:16:321
458199211,4cyclictest131rcu_preempt07:20:231
458199211,4cyclictest131rcu_preempt07:20:231
4581992113,6cyclictest0-21swapper/107:55:221
4581992113,6cyclictest0-21swapper/107:55:221
4581992113,6cyclictest0-21swapper/107:55:221
4581992113,5cyclictest31639-21latency_hist08:30:141
4581992113,5cyclictest31639-21latency_hist08:30:141
458199211,18cyclictest9980-21grep11:20:221
4581992110,9cyclictest3569-21ssh11:13:451
4581992110,9cyclictest3569-21ssh11:13:451
4581992110,8cyclictest6174-21ssh10:09:391
4581992110,8cyclictest6174-21ssh10:09:391
458299208,10cyclictest20642-21ssh11:30:322
458299208,10cyclictest20642-21ssh11:30:322
4582992010,7cyclictest7850-21sh09:37:212
4582992010,7cyclictest7850-21sh09:37:212
458199205,13cyclictest16844-21sed07:45:301
458199205,13cyclictest16844-21sed07:45:301
458199203,4cyclictest131rcu_preempt11:15:201
458199203,4cyclictest131rcu_preempt11:15:201
4581992013,5cyclictest5724-21ssh11:49:511
4581992013,5cyclictest5724-21ssh11:49:511
4581992013,5cyclictest22463-21sendmail11:00:091
4581992013,5cyclictest22463-21sendmail11:00:091
4581992013,5cyclictest22463-21sendmail11:00:091
4581992012,6cyclictest0-21swapper/108:00:281
4581992012,6cyclictest0-21swapper/108:00:281
4581992012,5cyclictest23188-21kernelversion11:00:251
4581992012,5cyclictest13239-21diskmemload09:42:481
4581992012,5cyclictest0-21swapper/110:45:181
4581992012,5cyclictest0-21swapper/110:45:181
458199201,17cyclictest2728-21ls12:20:151
458199201,17cyclictest2728-21ls12:20:151
458199201,17cyclictest2728-21ls12:20:151
458199200,17cyclictest11475-21latency_hist09:05:161
458199200,17cyclictest11475-21latency_hist09:05:161
33672201,13sleep30-21swapper/307:10:193
313342200,3sleep10-21swapper/111:42:051
313342200,3sleep10-21swapper/111:42:051
207842201,15sleep20-21swapper/210:24:472
207842201,15sleep20-21swapper/210:24:472
458399191,14cyclictest0-21swapper/307:35:323
458399191,14cyclictest0-21swapper/307:35:323
458399191,13cyclictest0-21swapper/309:30:203
458399191,13cyclictest0-21swapper/309:30:203
458399191,12cyclictest0-21swapper/310:25:213
458399191,12cyclictest0-21swapper/308:30:223
458399191,12cyclictest0-21swapper/308:30:223
458299197,9cyclictest7370-21ssh11:17:142
458299197,9cyclictest7370-21ssh11:17:142
458299192,15cyclictest1200-21ssh11:10:302
458299192,15cyclictest1200-21ssh11:10:302
4582991912,5cyclictest7054-21kworker/u8:009:52:522
4582991912,5cyclictest7054-21kworker/u8:009:52:522
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional