You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 00:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot4.osadl.org (updated Fri Dec 05, 2025 12:45:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3030622630,1sleep128817-21kworker/u8:607:08:371
3005922540,2sleep20-21swapper/207:05:272
3040022530,2sleep328816-21kworker/u8:507:09:463
3049398171161,7cyclictest10-21ksoftirqd/008:32:210
3049398163153,7cyclictest10-21ksoftirqd/012:31:580
3049398163153,7cyclictest10-21ksoftirqd/012:31:570
304939810392,8cyclictest10-21ksoftirqd/011:46:540
30498989992,4cyclictest15740-21kworker/u8:6708:32:201
121802970,2sleep312179-21ssh09:51:203
121802970,2sleep312179-21ssh09:51:203
30493989690,3cyclictest1050ksoftirqd/007:17:350
30498989284,4cyclictest20200-21kworker/u8:2212:31:581
30498989284,4cyclictest20200-21kworker/u8:2212:31:571
30493986555,7cyclictest10-21ksoftirqd/010:16:480
30493985853,3cyclictest1050ksoftirqd/010:32:210
30493985853,3cyclictest1050ksoftirqd/010:32:210
30503985750,4cyclictest15596-21kworker/u8:108:32:213
254982530,3sleep318752-21kworker/u8:011:25:433
30503985143,4cyclictest10452-21kworker/u8:312:31:583
30503985143,4cyclictest10452-21kworker/u8:312:31:573
7312490,4sleep1442-21kworker/u8:509:29:141
30493984434,7cyclictest10-21ksoftirqd/009:36:550
30493984434,7cyclictest10-21ksoftirqd/009:36:550
30493984433,8cyclictest10-21ksoftirqd/007:47:180
43352430,2sleep34309-21ssh09:35:273
43352430,2sleep34309-21ssh09:35:273
30493984338,3cyclictest1050ksoftirqd/009:22:440
30493984131,7cyclictest10-21ksoftirqd/008:26:120
3050098399,9cyclictest15236-21ssh12:12:172
30493983832,3cyclictest1050ksoftirqd/012:17:370
3049898361,7cyclictest0-21swapper/112:20:251
3050098358,6cyclictest32159-21ntpq09:25:382
30493983525,7cyclictest10-21ksoftirqd/008:46:400
3050098347,10cyclictest9129-21/usr/sbin/munin12:00:182
3050098344,10cyclictest24346-21ntpq12:30:342
3050098344,10cyclictest24346-21ntpq12:30:332
3050098343,10cyclictest8204-21ssh11:58:122
133522340,6sleep119-21ksoftirqd/109:55:201
133522340,6sleep119-21ksoftirqd/109:55:201
3050098338,9cyclictest22723-21chrt09:02:532
3049898322,3cyclictest121rcu_preempt09:35:121
3049898322,3cyclictest121rcu_preempt09:35:111
3050398311,7cyclictest7748-21cron07:55:003
3050098316,9cyclictest22062-21ntpq12:25:422
3050098316,7cyclictest2302-21ssh10:38:472
30500983120,8cyclictest22889-21ntpq11:20:332
30493983121,7cyclictest10-21ksoftirqd/008:01:380
278442310,2sleep325232-21kworker/u8:109:17:303
72302300,3sleep37209-21ssh11:55:273
3050398308,4cyclictest121rcu_preempt12:15:183
3050098306,6cyclictest0-21swapper/209:45:122
3050098306,6cyclictest0-21swapper/209:45:122
3050098305,11cyclictest42772kworker/u8:510:43:362
3050098302,8cyclictest14519-21ssh09:55:552
3050098302,8cyclictest14519-21ssh09:55:552
30500983018,10cyclictest7888-21df_inode10:50:222
30500983014,12cyclictest6057-21/usr/sbin/munin10:45:292
30500983013,13cyclictest23622-21if_eth010:15:392
30498983023,4cyclictest28274-21kworker/u8:011:46:541
3049898301,3cyclictest121rcu_preempt12:05:151
30493983013,13cyclictest10-21ksoftirqd/012:00:120
268882300,4sleep126889-21/usr/sbin/munin10:20:431
306832290,6sleep1191ksoftirqd/107:10:041
3050098293,8cyclictest2095-21ntpq09:30:352
3050098293,8cyclictest2095-21ntpq09:30:342
3050098292,8cyclictest10000-21ssh10:55:142
3050098292,7cyclictest12745-21ssh09:54:172
3050098292,7cyclictest12745-21ssh09:54:172
30500982919,7cyclictest22709-21cron10:15:002
30500982913,12cyclictest21553-21/usr/sbin/munin08:55:362
30500982912,13cyclictest14917-21/usr/sbin/munin11:05:182
30493982920,7cyclictest10-21ksoftirqd/010:56:560
288152290,8sleep130492-21cyclictest11:34:301
273882290,4sleep330492-21cyclictest10:23:103
249012290,2sleep10-21swapper/110:17:451
206412290,5sleep3311ksoftirqd/308:55:113
203612290,2sleep10-21swapper/111:15:281
189932290,1sleep118752-21kworker/u8:011:13:271
71402280,2sleep30-21swapper/310:48:573
33052280,2sleep33065-21kworker/u8:007:29:573
3050098288,6cyclictest17133-21runrttasks08:38:522
3050098285,2cyclictest9309-21kworker/u8:508:09:212
30500982820,5cyclictest14305-21apt-get08:25:132
30500982815,10cyclictest24887-21grep09:10:372
30500982815,10cyclictest24887-21grep09:10:372
30500982814,11cyclictest744-21modprobe07:20:012
30500982813,11cyclictest30254-21grep10:30:012
30500982813,11cyclictest11399-21/usr/sbin/munin08:10:202
30500982813,10cyclictest28902-21apt-get09:20:282
30500982812,13cyclictest18145-21sh12:20:012
30500982812,12cyclictest11577-21/usr/sbin/munin12:05:262
30500982811,13cyclictest29290-21aten2_rfpower_p11:35:152
30500982811,13cyclictest21880-21grep11:20:012
3049898284,4cyclictest121rcu_preempt12:10:441
3049398286,12cyclictest2044-21snmpd09:55:340
3049398286,12cyclictest2044-21snmpd09:55:340
262832280,1sleep10-21swapper/111:28:481
103612280,2sleep10-21swapper/109:49:251
103612280,2sleep10-21swapper/109:49:251
64062270,2sleep30-21swapper/307:44:173
61312270,2sleep20-21swapper/207:40:582
60912270,5sleep1191ksoftirqd/111:54:331
3050398274,5cyclictest121rcu_preempt10:00:003
3050398274,5cyclictest121rcu_preempt10:00:003
3050098272,7cyclictest3644-21ssh11:49:262
30500982718,6cyclictest4987-21ssh11:50:412
30500982717,7cyclictest27290-21cut11:30:252
30500982716,8cyclictest8796-21ntpq07:55:292
30500982715,9cyclictest31309-21runrttasks10:30:412
30500982715,9cyclictest31309-21runrttasks10:30:412
30500982715,8cyclictest15636-21apt-get10:00:172
30500982715,8cyclictest15636-21apt-get10:00:172
30500982713,10cyclictest20384-21cron08:55:012
30500982713,10cyclictest1482-21idleruntime-cro07:25:002
30500982712,11cyclictest31992-21/usr/sbin/munin11:40:222
30500982712,11cyclictest30134-21kworker/u8:907:10:212
30500982712,11cyclictest24522-21aten2.4-expect11:25:182
30500982712,11cyclictest18264-21runrttasks08:40:282
30500982712,11cyclictest17164-21/usr/sbin/munin11:10:482
30500982711,14cyclictest26619-21ssh09:15:232
30500982711,13cyclictest14145-21sed08:25:012
30500982711,12cyclictest6088-21aten2_rfpower_f09:40:182
30500982711,12cyclictest6088-21aten2_rfpower_f09:40:182
30500982710,14cyclictest18266-21http12:20:062
3049898276,6cyclictest121rcu_preempt09:15:321
3049898272,3cyclictest121rcu_preempt10:30:161
3049898272,3cyclictest121rcu_preempt10:30:151
3049898271,4cyclictest121rcu_preempt10:55:151
30493982718,7cyclictest10-21ksoftirqd/008:16:590
252882270,11sleep3121rcu_preempt10:19:483
48302260,2sleep10-21swapper/110:44:231
3050398265,8cyclictest121rcu_preempt12:35:423
3050398265,8cyclictest121rcu_preempt12:35:413
3050398261,5cyclictest20482-21latency_hist10:10:013
3050398261,4cyclictest121rcu_preempt11:30:153
30500982614,9cyclictest23556-21ssh09:10:002
30500982613,9cyclictest2104-21sed07:25:272
30500982613,10cyclictest18805-21sed10:05:382
30500982611,10cyclictest16617-21awk08:35:002
30500982610,13cyclictest26215-21if_eth112:35:232
30500982610,13cyclictest26215-21if_eth112:35:232
30493982616,7cyclictest10-21ksoftirqd/009:47:060
30493982616,7cyclictest10-21ksoftirqd/009:47:060
256512260,2sleep325232-21kworker/u8:109:13:283
256512260,2sleep325232-21kworker/u8:109:13:283
232892260,2sleep10-21swapper/109:07:021
173802260,2sleep10-21swapper/112:16:051
95422250,2sleep30-21swapper/312:00:233
70162250,2sleep16977-21ssh09:40:401
70162250,2sleep16977-21ssh09:40:401
6912250,2sleep328484-21kworker/u8:1911:41:573
311792250,2sleep30-21swapper/311:39:233
3050398256,4cyclictest121rcu_preempt08:55:013
3050398251,3cyclictest121rcu_preempt10:40:243
3050098253,5cyclictest0-21swapper/208:48:162
30500982515,7cyclictest25782-21head10:20:202
30500982511,11cyclictest5744-21basename09:40:002
30500982511,11cyclictest5744-21basename09:40:002
30500982511,10cyclictest7870-21sed07:55:012
30500982511,10cyclictest3961-21latency_hist07:35:002
30500982511,10cyclictest3961-21latency_hist07:34:592
30500982510,11cyclictest7126-21awk07:50:002
30500982510,11cyclictest12612-21cpu11:00:192
3049898254,5cyclictest19-21ksoftirqd/112:05:021
3049898254,3cyclictest121rcu_preempt10:50:241
3049898253,3cyclictest121rcu_preempt10:10:321
30498982520,3cyclictest29487-21kworker/u8:107:17:351
3049898251,5cyclictest121rcu_preempt10:00:271
3049898251,5cyclictest121rcu_preempt10:00:271
3049898251,4cyclictest121rcu_preempt07:40:401
3049898250,4cyclictest1497-21ssh09:30:221
3049898250,4cyclictest1497-21ssh09:30:221
3049398255,8cyclictest10-21ksoftirqd/011:05:210
30493982517,5cyclictest10-21ksoftirqd/011:35:110
30493982515,7cyclictest10-21ksoftirqd/010:07:470
290872250,13sleep127850-21kworker/u8:2109:20:331
275592250,2sleep10-21swapper/112:37:581
275592250,2sleep10-21swapper/112:37:571
226062250,2sleep10-21swapper/112:26:441
3050398241,5cyclictest31102-21ssh10:30:343
3050398241,5cyclictest31102-21ssh10:30:343
3050398241,4cyclictest0-21swapper/310:55:403
3050398241,3cyclictest121rcu_preempt11:05:363
3050098242,3cyclictest0-21swapper/208:19:262
30500982412,8cyclictest4275-21kworker/u8:607:39:592
3049898246,4cyclictest121rcu_preempt09:10:361
3049898246,4cyclictest121rcu_preempt09:10:351
3049898241,4cyclictest0-21swapper/111:05:201
3049898241,3cyclictest121rcu_preempt11:35:561
3049898240,3cyclictest0-21swapper/107:50:021
3049398244,10cyclictest10-21ksoftirqd/010:13:430
30493982419,3cyclictest118150irq/29-4f00000.11:15:270
30493982412,10cyclictest111rcuc/012:20:460
234782240,13sleep30-21swapper/309:09:293
170952240,2sleep37558-21kworker/u8:1010:01:333
170952240,2sleep37558-21kworker/u8:1010:01:333
125372240,13sleep331-21ksoftirqd/308:12:323
65612230,12sleep119-21ksoftirqd/110:45:481
3050398235,4cyclictest121rcu_preempt08:20:003
3050398233,4cyclictest121rcu_preempt07:55:373
3050398232,4cyclictest121rcu_preempt09:20:313
3050398231,5cyclictest14071-21munin-run08:24:593
3050398231,3cyclictest0-21swapper/309:40:343
3050398231,3cyclictest0-21swapper/309:40:343
30500982313,7cyclictest10269-21modprobe08:05:012
3049898234,3cyclictest121rcu_preempt11:20:411
3049898231,6cyclictest7295-21ntpq11:55:321
3049898231,4cyclictest121rcu_preempt07:34:591
3049898231,4cyclictest121rcu_preempt07:34:591
3049898231,3cyclictest121rcu_preempt09:50:131
3049898231,3cyclictest121rcu_preempt09:50:131
3049898231,3cyclictest121rcu_preempt07:55:111
3049398238,13cyclictest10-21ksoftirqd/011:10:300
3049398236,10cyclictest10-21ksoftirqd/010:04:580
3049398236,10cyclictest10-21ksoftirqd/010:04:580
3049398235,7cyclictest10-21ksoftirqd/009:43:020
3049398235,7cyclictest10-21ksoftirqd/009:43:010
30493982317,4cyclictest111rcuc/010:40:310
30493982317,4cyclictest10-21ksoftirqd/009:17:460
30493982315,6cyclictest111rcuc/011:40:350
225682230,2sleep10-21swapper/109:00:541
201152230,1sleep119487-21kworker/u8:408:51:391
193932230,1sleep318840-21kworker/u8:1408:45:373
187642230,2sleep331-21ksoftirqd/308:40:513
142952230,1sleep113749-21kworker/u8:1708:25:051
13142230,2sleep1191ksoftirqd/110:35:391
10192230,12sleep331-21ksoftirqd/307:20:053
100722230,2sleep10-21swapper/108:02:441
90142220,2sleep30-21swapper/310:51:093
32782220,11sleep119-21ksoftirqd/107:29:361
3050398227,3cyclictest121rcu_preempt07:40:003
3050398224,3cyclictest121rcu_preempt10:40:003
3050398223,6cyclictest31-21ksoftirqd/312:10:133
3050398223,3cyclictest121rcu_preempt12:20:493
3050398222,4cyclictest121rcu_preempt08:40:023
3050398222,4cyclictest0-21swapper/311:50:463
3050398221,5cyclictest22917-21munin-run09:05:003
3050398221,4cyclictest121rcu_preempt11:45:453
3050398221,4cyclictest121rcu_preempt10:25:323
3050398221,4cyclictest121rcu_preempt08:05:003
3050398221,3cyclictest121rcu_preempt12:05:163
3050398221,2cyclictest0-21swapper/311:25:013
3049898224,3cyclictest121rcu_preempt11:40:161
3049898223,3cyclictest121rcu_preempt10:25:281
3049398228,5cyclictest7241-21ntpq11:55:290
3049398227,3cyclictest11390-21ssh12:05:210
3049398226,9cyclictest10-21ksoftirqd/012:10:330
3049398222,7cyclictest26024-21ssh12:35:170
3049398222,7cyclictest26024-21ssh12:35:170
30493982217,3cyclictest118150irq/29-4f00000.10:35:190
30493982217,3cyclictest118150irq/29-4f00000.07:40:290
30493982213,7cyclictest10-21ksoftirqd/011:52:020
30493982211,9cyclictest111rcuc/011:00:340
3050398213,3cyclictest121rcu_preempt11:00:253
3050398210,4cyclictest121rcu_preempt08:25:403
3049898214,3cyclictest121rcu_preempt10:05:481
3049898211,4cyclictest121rcu_preempt08:40:331
3049898211,3cyclictest0-21swapper/108:55:151
3049398218,5cyclictest10-21ksoftirqd/009:12:050
3049398218,5cyclictest10-21ksoftirqd/009:12:050
3049398217,8cyclictest10-21ksoftirqd/011:34:410
3049398215,7cyclictest10-21ksoftirqd/007:55:200
3049398212,9cyclictest10-21ksoftirqd/010:20:370
30493982116,3cyclictest24423-21ssh11:25:150
30493982116,3cyclictest118150irq/29-4f00000.09:30:190
30493982116,3cyclictest118150irq/29-4f00000.09:30:190
30493982111,8cyclictest111rcuc/009:50:180
30493982111,8cyclictest111rcuc/009:50:170
30493982111,7cyclictest14134-21kworker/0:011:25:000
195602210,3sleep3311ksoftirqd/311:15:103
171852210,7sleep331-21ksoftirqd/311:10:153
3050398209,8cyclictest30692-21apt-get07:10:113
3050398203,8cyclictest321072kworker/u8:3207:15:193
3050398201,3cyclictest121rcu_preempt09:45:193
3050398201,3cyclictest121rcu_preempt09:45:193
3050398201,3cyclictest121rcu_preempt07:35:023
3050398201,3cyclictest121rcu_preempt07:35:013
3050398201,3cyclictest0-21swapper/308:09:283
30503982013,4cyclictest21290-21aten2.4-expect12:25:203
3049898203,7cyclictest194892kworker/u8:508:48:431
3049898201,4cyclictest12710-21ssh11:00:221
30498982013,4cyclictest4616-21latency_hist07:40:001
3049398209,8cyclictest111rcuc/010:45:220
3049398208,10cyclictest111rcuc/010:55:020
30493982015,3cyclictest10-21ksoftirqd/008:55:160
30493982014,3cyclictest1723-21apt-get07:25:110
30493982011,7cyclictest111rcuc/012:25:430
30493982011,6cyclictest32021-21ntp_kernel_err09:25:300
3050398191,3cyclictest121rcu_preempt10:10:203
30503981913,4cyclictest31846-21irqstats09:25:273
3049898191,6cyclictest2081-21runrttasks08:19:011
3049898191,3cyclictest121rcu_preempt08:10:211
3049898191,3cyclictest0-21swapper/107:51:411
3049898190,4cyclictest0-21swapper/107:22:231
3049898190,3cyclictest121rcu_preempt08:25:001
3049398199,7cyclictest111rcuc/008:41:570
30493981914,3cyclictest111rcuc/007:10:170
30493981913,4cyclictest10-21ksoftirqd/010:25:150
30493981910,7cyclictest111rcuc/008:10:320
26912190,8sleep330492-21cyclictest09:31:373
26912190,8sleep330492-21cyclictest09:31:373
172142190,9sleep119-21ksoftirqd/108:39:521
3050398182,3cyclictest62442kworker/u8:1207:46:583
3049898181,3cyclictest121rcu_preempt08:10:021
3049398188,8cyclictest111rcuc/009:02:150
3049398188,7cyclictest1405-21sshd07:39:290
3049398187,8cyclictest111rcuc/008:10:020
30493981810,6cyclictest10-21ksoftirqd/008:51:480
3049398178,7cyclictest111rcuc/007:55:020
3049398175,8cyclictest10-21ksoftirqd/008:24:590
3049398172,9cyclictest10-21ksoftirqd/009:05:400
30493981712,3cyclictest118150irq/29-4f00000.07:21:570
30493981712,3cyclictest10-21ksoftirqd/007:33:300
30493981712,3cyclictest10-21ksoftirqd/007:33:300
30493981611,3cyclictest2044-21snmpd08:37:070
3049398158,3cyclictest1050ksoftirqd/007:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional