You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 20:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Tue Nov 25, 2025 12:45:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2403823620,7sleep119-21ksoftirqd/107:05:281
2424122660,5sleep225-21ksoftirqd/207:05:372
2413922480,3sleep324138-21ntpq07:05:353
2492298230223,4cyclictest20845-21kworker/u8:308:32:021
2492198129118,7cyclictest10-21ksoftirqd/008:32:020
3065621180,2sleep30-21swapper/312:15:013
1558521060,2sleep115584-21ssh11:43:061
24922989488,4cyclictest1796-21kworker/u8:5309:22:001
24924988982,4cyclictest22632-21kworker/u8:2908:32:022
24922988981,4cyclictest1807-21kworker/u8:6409:17:051
24922988072,5cyclictest30402-21kworker/u8:2808:52:191
24922988072,5cyclictest30402-21kworker/u8:2808:52:191
24929987468,4cyclictest5482-21kworker/u8:2209:22:003
24929987061,5cyclictest1759-21kworker/u8:1609:17:053
116852660,2chrt0-21swapper/110:28:071
237642530,12sleep118868-21kworker/u8:2110:51:301
249712480,4sleep115248-21kworker/u8:112:01:081
324352450,3sleep120895-21kworker/u8:1207:28:331
238652430,2sleep323866-21cat08:30:263
2492498413,11cyclictest29119-21ntpq12:10:302
2492498404,9cyclictest2044-21snmpd08:16:002
2492498395,10cyclictest17144-21ntpq11:45:382
2492498395,10cyclictest17144-21ntpq11:45:372
24922983933,3cyclictest14769-21kworker/u8:809:37:221
138122390,2chrt2763-1kworker/u9:110:31:451
99422380,2chrt0-21swapper/307:55:223
2492998380,3cyclictest121rcu_preempt08:20:303
2492498375,8cyclictest5762-21diskmemload11:30:212
24922983730,4cyclictest28343-21kworker/u8:007:22:121
2492498369,7cyclictest9329-21ntpq09:15:372
2492498366,11cyclictest18309-21ssh10:40:532
40092350,13sleep2121rcu_preempt07:40:022
2492498359,9cyclictest4943-21ntpq09:05:302
2492498359,9cyclictest4943-21ntpq09:05:302
2492498358,10cyclictest20431-21ps08:20:592
2492498356,9cyclictest6886-21ntpq09:10:352
2492498356,9cyclictest6886-21ntpq09:10:352
2492498355,9cyclictest28764-21ntpq09:55:302
2492298353,6cyclictest121rcu_preempt11:05:181
2492998342,3cyclictest121rcu_preempt12:35:293
2492498349,7cyclictest14266-21ntpq08:05:362
2492498348,9cyclictest7521-21ntpq11:25:352
2492498346,9cyclictest2003-21cpu11:15:192
2492498345,8cyclictest0-21swapper/212:00:532
2492498344,16cyclictest1909-21ntp_states12:20:472
2492498343,10cyclictest24194-21ntpq09:45:542
24922983427,4cyclictest27119-21kworker/u8:2410:02:091
24922983424,4cyclictest19-21ksoftirqd/111:45:151
24922983424,4cyclictest19-21ksoftirqd/111:45:151
2492998333,4cyclictest121rcu_preempt07:30:153
2492498336,10cyclictest23072-21memory10:50:412
2492498334,8cyclictest6313-21timerandwakeup10:15:452
2492498333,9cyclictest25619-21ntpq10:55:402
2492298334,5cyclictest121rcu_preempt10:05:131
24922983322,9cyclictest4960-21kworker/u8:812:32:281
215962330,9sleep2251ksoftirqd/209:40:542
69602320,6sleep331-21ksoftirqd/309:10:383
69602320,6sleep331-21ksoftirqd/309:10:383
2492498326,10cyclictest30432-21ntpq11:05:432
2492498324,9cyclictest27029-21python312:05:432
2492498324,8cyclictest6662-21ntpq12:30:442
2492498322,11cyclictest12371-21ntpq11:35:362
2492498322,10cyclictest18761-21ntpq09:35:292
2492298326,4cyclictest121rcu_preempt12:20:501
2492498317,6cyclictest19398-21ntpq11:50:282
2492498314,5cyclictest9738-21ssh12:36:222
2492498311,10cyclictest1110-21ntpq10:05:302
2492298312,4cyclictest121rcu_preempt09:45:581
2492298311,6cyclictest10151-21/usr/sbin/munin11:30:411
134592310,7sleep119-21ksoftirqd/111:39:401
77412300,7sleep119-21ksoftirqd/109:12:501
77412300,7sleep119-21ksoftirqd/109:12:501
75162300,3sleep3311ksoftirqd/312:33:253
2492998301,3cyclictest121rcu_preempt11:15:153
2492498304,4cyclictest25-21ksoftirqd/211:10:322
2492498302,9cyclictest1380-21python308:55:422
2492498302,9cyclictest1380-21python308:55:422
2492498302,8cyclictest29914-21ntpq07:20:432
2492498301,8cyclictest2126-21bootmenu10:20:172
2492498300,9cyclictest31778-21ntpq07:25:372
2492498300,10cyclictest11782-21ntpq09:20:402
24922983024,4cyclictest32272-21kworker/u8:509:02:331
24922983024,4cyclictest32272-21kworker/u8:509:02:331
81132290,17sleep331-21ksoftirqd/311:26:353
74912290,3sleep331-21ksoftirqd/307:48:503
46022290,8sleep12126-21bootmenu10:13:311
310092290,2sleep131008-21hddtemp_smartct12:15:251
2492498297,5cyclictest25930-21ntpq07:10:342
2492498294,8cyclictest29144-21aten2.4-expect08:45:172
2492498294,4cyclictest2756-21ssh10:10:112
2492498294,4cyclictest13992-21ssh10:32:422
2492498294,10cyclictest5030-21ntpq07:40:342
2492498293,9cyclictest5171-21ntpq11:20:412
2492498293,8cyclictest4121-21ntpq12:25:302
2492498292,8cyclictest31610-21sh10:00:472
2492498291,9cyclictest14612-21ntpq11:40:262
2492498291,8cyclictest31786-21ntpq08:50:452
2492498291,8cyclictest31786-21ntpq08:50:452
2492298296,7cyclictest121rcu_preempt07:20:021
2492298296,4cyclictest121rcu_preempt11:55:251
2492298296,4cyclictest121rcu_preempt10:40:001
2492298292,6cyclictest121rcu_preempt07:59:591
24922982912,6cyclictest19-21ksoftirqd/111:20:191
2492198292,7cyclictest0-21swapper/008:47:590
138072290,11sleep331-21ksoftirqd/311:40:073
47082280,2sleep10-21swapper/112:26:061
36372280,7sleep119-21ksoftirqd/111:18:251
304892280,6sleep331-21ksoftirqd/308:48:103
2492998281,8cyclictest16610-21/usr/sbin/munin09:30:413
2492998281,13cyclictest16823-21idleruntime-cro10:40:003
2492498285,4cyclictest25-21ksoftirqd/210:45:422
2492498284,7cyclictest2126-21bootmenu12:15:322
2492498284,5cyclictest27970-21ntpq11:00:342
2492498283,8cyclictest13419-21cpu09:25:202
2492498282,8cyclictest0-21swapper/208:10:192
2492498282,6cyclictest8642-21ntpq07:50:332
2492498281,8cyclictest3108-21ntpq09:00:332
2492498281,8cyclictest3108-21ntpq09:00:332
24924982816,9cyclictest12083-21latency_hist10:30:012
2492498280,11cyclictest13159-21latency_hist08:05:022
2492298286,4cyclictest121rcu_preempt11:55:021
24922982822,4cyclictest1739-21kworker/u8:1907:51:541
24922982815,3cyclictest19-21ksoftirqd/111:10:241
2492298281,4cyclictest121rcu_preempt07:35:171
2492298281,3cyclictest121rcu_preempt09:55:301
2492298281,3cyclictest121rcu_preempt07:40:151
24922982812,9cyclictest121rcu_preempt08:45:191
169872280,3sleep331-21ksoftirqd/308:15:013
16702280,6sleep32126-21bootmenu08:56:343
16702280,6sleep32126-21bootmenu08:56:343
270322270,12sleep3121rcu_preempt09:51:263
2492998277,7cyclictest121rcu_preempt09:40:483
2492998271,4cyclictest121rcu_preempt12:03:013
2492998271,3cyclictest121rcu_preempt08:45:003
2492998271,12cyclictest8399-21ntp_kernel_pll_10:20:303
2492498274,5cyclictest16560-21ssh10:38:512
2492498271,9cyclictest21883-21ntp_states11:55:392
2492498271,8cyclictest26458-21ntpq09:50:362
2492498270,9cyclictest26338-21python308:35:492
2492298276,4cyclictest121rcu_preempt07:30:421
2492298273,4cyclictest121rcu_preempt11:00:141
2492298273,4cyclictest121rcu_preempt10:15:331
2492298273,3cyclictest121rcu_preempt09:40:221
2492298272,5cyclictest121rcu_preempt10:45:151
2492298272,3cyclictest121rcu_preempt08:15:351
24922982716,3cyclictest19-21ksoftirqd/112:05:291
2492298271,4cyclictest121rcu_preempt11:25:271
2492298271,4cyclictest121rcu_preempt10:20:581
24922982714,9cyclictest19-21ksoftirqd/109:30:291
24922982714,4cyclictest19-21ksoftirqd/107:45:271
24922982713,3cyclictest19-21ksoftirqd/108:05:371
216192270,11sleep119-21ksoftirqd/108:25:261
188402270,5sleep119-21ksoftirqd/110:41:561
82262260,2sleep18225-21gpgv12:35:041
49672260,1sleep33686-21kworker/u8:607:40:303
324582260,3sleep3311ksoftirqd/307:28:523
317742260,2sleep325289-21kworker/u8:1112:15:433
285852260,5sleep331-21ksoftirqd/307:19:543
2492998267,7cyclictest121rcu_preempt07:35:193
2492998262,4cyclictest121rcu_preempt11:20:243
2492998261,13cyclictest27951-21apt-get09:55:123
2492498268,14cyclictest28856-21latency_hist07:20:022
2492498264,4cyclictest28778-21munin-run08:45:002
2492498263,4cyclictest6861-21ntpq07:45:352
2492498262,6cyclictest22065-21ntpq08:25:322
24922982613,3cyclictest19-21ksoftirqd/108:00:431
24922982612,3cyclictest19-21ksoftirqd/108:20:231
2492198262,7cyclictest13161-21rm09:25:060
2492198262,14cyclictest118150irq/29-4f00000.09:20:010
325382251,18sleep332610-21ntpq11:10:263
321882250,2sleep30-21swapper/308:51:233
321882250,2sleep30-21swapper/308:51:233
274832250,1sleep315252-21kworker/u8:812:07:023
265662250,2sleep30-21swapper/307:13:053
2492998258,3cyclictest121rcu_preempt10:18:103
2492998254,3cyclictest121rcu_preempt11:55:283
2492998253,3cyclictest121rcu_preempt10:00:403
2492998252,4cyclictest0-21swapper/311:35:423
2492998252,3cyclictest121rcu_preempt12:25:153
2492998251,11cyclictest0-21swapper/310:30:353
2492998250,4cyclictest0-21swapper/310:10:163
24924982510,11cyclictest9783-21aten2_rfpower_f07:55:192
2492298255,4cyclictest121rcu_preempt09:05:181
2492298255,4cyclictest121rcu_preempt09:05:181
2492298255,3cyclictest121rcu_preempt07:10:461
2492298254,5cyclictest19-21ksoftirqd/110:55:301
2492298252,7cyclictest15964-21missed_timers08:10:291
2492298252,4cyclictest121rcu_preempt08:35:151
2492298252,3cyclictest121rcu_preempt09:50:181
24922982515,4cyclictest19-21ksoftirqd/108:40:161
24922982512,4cyclictest19-21ksoftirqd/112:10:291
2492198259,13cyclictest10-21ksoftirqd/007:40:150
216172250,2sleep30-21swapper/310:48:573
193862250,1sleep329501-21kworker/u8:3310:44:473
134052250,13sleep331-21ksoftirqd/308:05:163
2492998247,10cyclictest31-21ksoftirqd/310:25:103
2492998245,4cyclictest18338-21sh11:50:003
2492998245,4cyclictest18338-21sh11:49:593
2492998245,4cyclictest121rcu_preempt11:30:173
2492998245,3cyclictest121rcu_preempt10:09:193
2492998244,9cyclictest121rcu_preempt10:55:333
2492998244,7cyclictest121rcu_preempt11:50:423
2492998244,5cyclictest27892-21ntp_kernel_err11:00:293
2492998241,4cyclictest0-21swapper/309:45:123
2492998241,3cyclictest121rcu_preempt10:50:163
2492998241,10cyclictest3056-21ssh12:25:003
2492498243,6cyclictest16967-21ssh09:31:102
2492298243,3cyclictest121rcu_preempt09:25:211
24922982411,3cyclictest19-21ksoftirqd/108:55:211
24922982411,3cyclictest19-21ksoftirqd/108:55:211
16952240,13sleep225-21ksoftirqd/207:31:012
2492998235,3cyclictest121rcu_preempt08:15:043
2492998234,8cyclictest121rcu_preempt09:05:263
2492998234,8cyclictest121rcu_preempt09:05:263
2492998233,3cyclictest121rcu_preempt08:35:053
2492998232,4cyclictest121rcu_preempt08:25:313
2492998232,3cyclictest121rcu_preempt09:25:373
2492998231,12cyclictest11639-21cut08:00:213
2492998231,11cyclictest0-21swapper/311:05:303
2492998230,4cyclictest121rcu_preempt09:00:203
2492998230,4cyclictest121rcu_preempt09:00:203
24921982315,6cyclictest1767-21sh12:20:370
2492998224,3cyclictest121rcu_preempt07:50:153
2492998221,4cyclictest0-21swapper/307:20:443
2492998221,12cyclictest18343-21ps09:35:233
24921982217,3cyclictest2044-21snmpd11:25:280
24921982217,3cyclictest118150irq/29-4f00000.11:35:230
24921982215,5cyclictest10-21ksoftirqd/011:15:380
24921982215,4cyclictest2044-21snmpd12:35:210
24921982114,4cyclictest28785-21ssh09:55:310
24921982113,6cyclictest25912-21ntpq07:10:320
2492198210,11cyclictest0-21swapper/007:17:590
2492198208,9cyclictest20078-21cron09:40:000
2492198206,11cyclictest26484-1kworker/u9:107:20:230
2492198204,8cyclictest20222-1kworker/u9:209:40:180
24921982015,3cyclictest26916-21awk08:40:000
24921982015,3cyclictest25287-1kworker/u9:208:55:280
24921982015,3cyclictest25287-1kworker/u9:208:55:280
24921982015,3cyclictest10-21ksoftirqd/012:30:530
24921982014,3cyclictest19901-21ssh10:45:210
24921982012,6cyclictest332-21open_inodes11:10:400
24921982012,6cyclictest27121-21sh11:00:160
24921982012,6cyclictest17176-21sh09:32:180
24921982011,6cyclictest25403-21latency10:55:300
2492198201,16cyclictest13330-21wc10:30:450
2492198201,10cyclictest170132ntp_kernel_err11:45:300
2492198201,10cyclictest170132ntp_kernel_err11:45:300
24921982010,6cyclictest5762-21diskmemload12:15:470
2492198199,8cyclictest2081-21runrttasks10:10:130
2492198198,9cyclictest10-21ksoftirqd/010:40:120
24921981914,3cyclictest7551-21/usr/sbin/munin10:20:260
24921981914,3cyclictest28594-21ssh12:10:230
24921981914,3cyclictest24456-21ssh12:00:400
24921981914,3cyclictest20273-21ntpq08:20:480
24921981914,3cyclictest10-21ksoftirqd/011:05:400
24921981913,4cyclictest10-21ksoftirqd/010:05:350
24921981911,6cyclictest9909-21sh10:25:060
24921981911,6cyclictest9754-21load11:30:250
24921981911,6cyclictest3120-21ntp_offset07:35:350
24921981911,6cyclictest24471-21timerandwakeup09:46:000
24921981911,6cyclictest16860-21idleruntime-cro08:14:590
24921981911,6cyclictest15465-21sshd11:42:290
24921981910,7cyclictest4528-21irqrtprio09:05:240
24921981910,7cyclictest4528-21irqrtprio09:05:240
2492198189,7cyclictest8093-21/usr/sbin/munin07:50:190
2492198189,7cyclictest6033-21/usr/sbin/munin09:10:230
2492198189,7cyclictest6033-21/usr/sbin/munin09:10:230
2492198188,5cyclictest3525-21sh12:25:210
2492198184,11cyclictest0-21swapper/010:00:370
24921981813,3cyclictest2044-21snmpd10:35:170
24921981813,3cyclictest10-21ksoftirqd/009:50:190
24921981813,3cyclictest10-21ksoftirqd/008:25:180
24921981813,3cyclictest10-21ksoftirqd/008:15:310
24921981811,5cyclictest23652-21uptime10:50:590
24921981811,5cyclictest2081-21runrttasks07:59:190
24921981811,5cyclictest10-21ksoftirqd/009:00:170
24921981811,5cyclictest10-21ksoftirqd/009:00:170
24921981810,6cyclictest31769-21ntpq07:25:370
24921981810,6cyclictest28036-21sh08:40:380
24921981810,6cyclictest27293-21sh12:06:000
24921981810,6cyclictest18978-21if_eth111:50:230
24921981810,6cyclictest12920-21sh09:25:000
24921981810,5cyclictest10-21ksoftirqd/010:15:420
2492198178,5cyclictest2081-21runrttasks08:00:150
2492198172,13cyclictest2081-21runrttasks08:05:170
24921981712,3cyclictest4502-21ssh11:20:230
24921981712,3cyclictest22389-21ssh11:56:170
24921981712,3cyclictest1172-21ntpq07:30:300
24921981710,4cyclictest10-21ksoftirqd/007:45:280
2492198161,10cyclictest118150irq/29-4f00000.08:50:130
2492198161,10cyclictest118150irq/29-4f00000.08:50:130
2492198157,6cyclictest24946-21latency_hist07:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional