You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 22:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot4.osadl.org (updated Thu Dec 04, 2025 12:45:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
765298282273,6cyclictest1050ksoftirqd/007:32:110
765698275267,5cyclictest14832-21kworker/u8:2407:32:111
683922700,2sleep35454-1kworker/u9:007:05:303
598522680,3sleep25981-21apt-get07:05:142
673322610,2sleep10-21swapper/107:05:251
765298252244,4cyclictest1050ksoftirqd/008:17:140
765698244237,4cyclictest24382-21kworker/u8:808:17:141
766098166160,4cyclictest14838-21kworker/u8:3007:32:103
766098141131,6cyclictest31881-21kworker/u8:6108:17:133
765998140134,4cyclictest14809-21kworker/u8:007:32:112
726721320,3sleep27266-21/usr/sbin/munin10:55:432
726721320,3sleep27266-21/usr/sbin/munin10:55:432
765298130124,3cyclictest1050ksoftirqd/012:06:400
765698125117,5cyclictest20016-21kworker/u8:1412:06:411
1700121230,2sleep116978-21mailstats11:15:411
765998115104,6cyclictest31929-21kworker/u8:10908:17:142
7652989889,6cyclictest1050ksoftirqd/008:41:530
7652989690,3cyclictest1050ksoftirqd/009:12:320
7652989386,3cyclictest1050ksoftirqd/010:17:020
7656988982,4cyclictest5147-21kworker/u8:408:41:531
7656988779,4cyclictest18559-21kworker/u8:610:17:031
7652987766,8cyclictest10-21ksoftirqd/007:16:500
7652987669,3cyclictest1050ksoftirqd/011:12:210
202722720,3sleep30-21swapper/310:15:353
7656987062,4cyclictest5361-21kworker/u8:411:12:201
7652986655,8cyclictest10-21ksoftirqd/007:11:470
7656986559,3cyclictest9222-21kworker/u8:4007:16:491
273832460,2sleep327386-21missed_timers10:30:263
111802440,3sleep110685-21kworker/u8:908:45:111
7652984333,7cyclictest10-21ksoftirqd/009:06:230
7652984332,8cyclictest10-21ksoftirqd/010:01:540
7652984332,8cyclictest10-21ksoftirqd/010:01:530
101372420,2sleep30-21swapper/308:40:343
7652983928,8cyclictest10-21ksoftirqd/012:37:200
7660983811,23cyclictest26260-21ntpq09:20:393
246502370,7sleep225-21ksoftirqd/209:18:102
246502370,7sleep225-21ksoftirqd/209:18:102
158842370,1sleep2241rcuc/210:05:452
158842370,1sleep2241rcuc/210:05:442
766098369,4cyclictest19183-21ntpq11:20:323
7660983512,20cyclictest3441-21sshd08:24:223
7660983510,4cyclictest3477-21/usr/sbin/munin11:55:273
7652983524,8cyclictest10-21ksoftirqd/009:26:560
766098348,6cyclictest12767-21cron08:50:003
7656983414,5cyclictest19-21ksoftirqd/109:05:151
312362340,10sleep119-21ksoftirqd/108:10:351
292142340,7sleep1191ksoftirqd/108:05:291
89662330,8sleep119-21ksoftirqd/108:38:551
766098339,5cyclictest15693-21ntpq08:55:453
766098339,4cyclictest4499-21kworker/u8:512:00:423
766098339,4cyclictest18170-21ntpq12:25:353
765698331,4cyclictest121rcu_preempt12:15:151
175502330,3chrt0-21swapper/209:00:322
766098329,4cyclictest7119-21ntpq10:55:423
766098329,4cyclictest7119-21ntpq10:55:413
766098329,4cyclictest16187-21/usr/sbin/munin11:15:223
766098328,5cyclictest0-21swapper/312:30:313
766098325,6cyclictest18979-21ps09:05:313
766098325,6cyclictest15885-21date11:15:013
766098321,13cyclictest29005-21ntpq11:40:423
766098321,10cyclictest12041-21/usr/sbin/munin11:05:443
7660983210,4cyclictest29928-21ntp_states10:35:403
7660983210,4cyclictest29482-21ntpq08:05:403
765998326,4cyclictest25163-21ntpq10:25:372
7656983225,4cyclictest8889-21kworker/u8:310:01:541
7656983225,4cyclictest8889-21kworker/u8:310:01:531
766098318,4cyclictest8890-21kworker/u8:510:00:003
766098317,4cyclictest1174-21ssh11:50:273
766098316,6cyclictest7255-21date09:50:013
766098315,5cyclictest16130-21kworker/u8:310:10:003
766098315,5cyclictest16130-21kworker/u8:310:10:003
766098315,4cyclictest19099-21modprobe07:40:003
766098315,4cyclictest0-21swapper/312:40:013
766098313,5cyclictest10109-21grep07:15:283
766098311,8cyclictest12213-21apt-get10:00:123
766098311,8cyclictest12213-21apt-get10:00:123
766098311,11cyclictest26564-21ntpq11:35:483
7652983123,5cyclictest10-21ksoftirqd/011:15:170
766098309,6cyclictest31-21ksoftirqd/308:00:303
766098309,6cyclictest31-21ksoftirqd/308:00:303
766098308,4cyclictest14208-21ntp_kernel_err07:25:313
766098307,7cyclictest13655-21expr08:50:263
766098305,4cyclictest31799-21ps10:40:243
766098304,4cyclictest24413-21runrttasks09:17:003
766098304,4cyclictest24413-21runrttasks09:17:003
766098302,6cyclictest25373-21wc10:26:103
766098301,8cyclictest17817-21ntpq10:10:293
766098301,8cyclictest17817-21ntpq10:10:293
765998306,6cyclictest25-21ksoftirqd/211:10:122
765998306,5cyclictest4603-21ntpq08:25:332
765998303,6cyclictest2650-21apt-get09:40:172
765698303,4cyclictest121rcu_preempt11:25:141
7656983011,4cyclictest19-21ksoftirqd/107:10:131
7652983022,5cyclictest10-21ksoftirqd/008:45:170
69802300,14sleep1121rcu_preempt12:02:351
766098297,6cyclictest31-21ksoftirqd/307:20:333
766098297,4cyclictest8445-21/usr/sbin/munin12:05:263
766098296,4cyclictest0-21swapper/311:25:283
766098293,7cyclictest20007-21kworker/u8:311:30:283
766098293,6cyclictest22614-21munin-plugin-st09:15:003
766098293,6cyclictest12342-21ls12:15:013
766098293,6cyclictest12342-21ls12:15:013
766098292,8cyclictest30852-21ps08:10:303
766098291,7cyclictest3683-21find09:40:423
765998294,8cyclictest3208-21chrt08:21:262
765998294,5cyclictest25-21ksoftirqd/210:45:002
765998293,7cyclictest23926-21ntpq11:30:322
765998293,11cyclictest25-21ksoftirqd/210:03:272
765998293,11cyclictest25-21ksoftirqd/210:03:272
765998292,9cyclictest22715-21ntpq10:20:322
765298297,19cyclictest111rcuc/009:54:470
765298295,18cyclictest111rcuc/010:40:370
56982290,1sleep130458-21kworker/u8:110:53:501
56982290,1sleep130458-21kworker/u8:110:53:491
766098286,4cyclictest6777-21sort08:30:423
766098282,7cyclictest12500-21ssh12:15:153
766098281,7cyclictest7429-21ssh09:50:143
765998285,4cyclictest16819-21ntpq11:15:342
765998284,6cyclictest25-21ksoftirqd/211:20:212
765998284,4cyclictest6074-21ntpq12:00:332
7656982819,4cyclictest19-21ksoftirqd/111:55:141
765698281,4cyclictest121rcu_preempt10:25:201
765298287,18cyclictest111rcuc/008:50:040
4842280,1sleep129228-21kworker/u8:709:35:351
242332280,16sleep122176-21kworker/u8:109:16:001
242332280,16sleep122176-21kworker/u8:109:16:001
231232280,2sleep10-21swapper/112:35:401
766098278,4cyclictest23603-21sh10:22:533
766098277,6cyclictest19361-21/usr/sbin/munin07:40:413
766098275,4cyclictest30479-21irqrtprio09:30:263
766098272,7cyclictest8745-21aten2_rfpower_v11:00:183
766098272,7cyclictest5409-21taskset08:30:003
766098271,9cyclictest29886-21latency_hist09:30:003
766098271,9cyclictest25015-21aten2_rfpower_p07:55:173
766098271,8cyclictest21476-21/usr/sbin/munin07:45:203
766098271,8cyclictest17866-21timerandwakeup09:01:043
766098271,8cyclictest15700-21ntpq12:20:313
765998273,6cyclictest25-21ksoftirqd/208:45:202
765998270,7cyclictest25-21ksoftirqd/211:35:302
765698271,3cyclictest121rcu_preempt08:00:121
765698271,3cyclictest121rcu_preempt08:00:121
225722270,2sleep20-21swapper/207:47:122
180462270,7sleep1121rcu_preempt12:25:281
162722270,10sleep1121rcu_preempt08:57:461
766098266,4cyclictest0-21swapper/310:50:383
766098266,4cyclictest0-21swapper/310:50:383
766098266,3cyclictest0-21swapper/307:10:183
766098265,4cyclictest2081-21runrttasks08:38:333
766098262,7cyclictest31276-21ntpq11:45:303
766098262,7cyclictest2178-21missed_timers10:45:273
766098262,7cyclictest2178-21missed_timers10:45:263
766098261,9cyclictest1186-21ntpq09:35:543
7659982611,10cyclictest22068-21apt-get12:35:142
765698267,4cyclictest19-21ksoftirqd/109:40:381
765698265,5cyclictest121rcu_preempt12:15:001
765698265,5cyclictest121rcu_preempt12:15:001
765698261,3cyclictest121rcu_preempt07:50:171
765298268,16cyclictest111rcuc/011:10:030
7652982620,4cyclictest10-21ksoftirqd/012:20:150
7652982619,4cyclictest10-21ksoftirqd/010:05:180
7652982619,4cyclictest10-21ksoftirqd/010:05:180
7652982612,12cyclictest111rcuc/011:50:270
276012260,5sleep1191ksoftirqd/111:39:101
144272260,5sleep1191ksoftirqd/108:52:391
766098251,8cyclictest23861-21ntpq07:50:343
765998257,13cyclictest1586-21aten2.4-expect10:45:192
765998257,13cyclictest1586-21aten2.4-expect10:45:182
765998253,5cyclictest25-21ksoftirqd/212:30:192
765998253,5cyclictest25-21ksoftirqd/209:05:262
765998253,4cyclictest25-21ksoftirqd/212:10:452
765998253,4cyclictest25-21ksoftirqd/212:10:452
765998252,4cyclictest29419-21ntpq08:05:342
7659982513,9cyclictest27442-21/usr/sbin/munin08:00:262
7659982513,9cyclictest27442-21/usr/sbin/munin08:00:262
765998250,7cyclictest31854-21ssh09:33:252
765698253,3cyclictest121rcu_preempt11:50:221
765698252,4cyclictest121rcu_preempt11:50:001
7656982520,3cyclictest191ksoftirqd/108:30:151
765698251,9cyclictest221412rm09:12:281
765698251,3cyclictest121rcu_preempt10:30:141
7656982511,8cyclictest304582kworker/u8:110:56:321
7656982511,8cyclictest304582kworker/u8:110:56:311
7652982519,4cyclictest10-21ksoftirqd/010:10:320
7652982519,4cyclictest10-21ksoftirqd/010:10:310
7652982518,5cyclictest118150irq/29-4f00000.09:35:310
765998249,11cyclictest387-21apt-get11:50:132
765998243,9cyclictest25-21ksoftirqd/210:10:242
765998243,9cyclictest25-21ksoftirqd/210:10:242
765998243,4cyclictest25-21ksoftirqd/207:25:132
765998243,10cyclictest25-21ksoftirqd/208:40:202
765998242,4cyclictest25-21ksoftirqd/211:45:242
765998242,4cyclictest25-21ksoftirqd/207:35:112
765998241,7cyclictest23160-21sshd07:50:192
7659982417,4cyclictest27539-21ntpq10:30:352
765998241,4cyclictest22247-21ssh11:26:562
765998241,4cyclictest221752kworker/u8:009:20:452
765698243,4cyclictest121rcu_preempt10:20:411
765698243,3cyclictest121rcu_preempt11:05:181
765698243,3cyclictest121rcu_preempt10:41:011
765698243,3cyclictest121rcu_preempt09:20:321
765698242,4cyclictest121rcu_preempt11:30:271
765698241,5cyclictest121rcu_preempt11:00:161
765698241,4cyclictest121rcu_preempt10:48:261
765698241,4cyclictest121rcu_preempt10:48:251
765698241,4cyclictest121rcu_preempt09:55:251
765698241,4cyclictest0-21swapper/111:20:321
765698241,3cyclictest121rcu_preempt09:25:421
765698241,3cyclictest121rcu_preempt07:35:181
765298247,15cyclictest111rcuc/008:30:430
7652982419,3cyclictest2044-21snmpd09:00:420
7652982418,4cyclictest10-21ksoftirqd/011:35:130
181672240,2sleep118027-21kworker/u8:009:02:451
765998237,12cyclictest1304-21ps09:35:582
765998237,11cyclictest21730-21ls10:20:002
765998233,9cyclictest25-21ksoftirqd/209:27:422
765998233,4cyclictest25-21ksoftirqd/212:25:422
765998232,6cyclictest25-21ksoftirqd/211:55:192
765998232,4cyclictest16471-21ssh12:22:102
765998231,5cyclictest25-21ksoftirqd/212:19:512
765998231,5cyclictest25-21ksoftirqd/209:55:372
7659982312,8cyclictest12549-21ps07:20:422
7659982311,8cyclictest8842-21mailstats07:10:412
765998230,7cyclictest25-21ksoftirqd/207:15:312
765698233,3cyclictest121rcu_preempt11:40:271
765698233,2cyclictest121rcu_preempt12:30:181
765698233,2cyclictest121rcu_preempt07:25:171
765698232,4cyclictest121rcu_preempt10:10:311
765698232,4cyclictest121rcu_preempt10:10:301
765698232,3cyclictest121rcu_preempt10:05:211
765698232,3cyclictest121rcu_preempt10:05:211
765698232,2cyclictest121rcu_preempt07:40:191
765698231,3cyclictest121rcu_preempt09:51:581
765698231,3cyclictest121rcu_preempt07:45:391
765298239,11cyclictest111rcuc/010:39:580
7652982317,4cyclictest10-21ksoftirqd/012:30:410
7652982317,4cyclictest10-21ksoftirqd/010:55:170
7652982317,4cyclictest10-21ksoftirqd/010:55:160
7652982317,4cyclictest10-21ksoftirqd/010:30:160
7652982317,4cyclictest10-21ksoftirqd/008:25:310
7652982317,4cyclictest10-21ksoftirqd/007:25:360
7652982312,8cyclictest10-21ksoftirqd/008:07:120
70602230,2sleep10-21swapper/109:49:301
166902230,11sleep114023-21kworker/u8:512:23:191
129132230,12sleep119-21ksoftirqd/107:21:241
765998229,10cyclictest5151-21kworker/u8:1008:30:242
765998229,10cyclictest19364-21apt-get07:40:172
765998226,13cyclictest5906-21sh10:55:002
765998226,13cyclictest5906-21sh10:54:592
765998222,5cyclictest25-21ksoftirqd/209:50:142
7659982213,6cyclictest31705-21sshd-session08:10:512
765998220,8cyclictest25-21ksoftirqd/208:55:382
765998220,7cyclictest25-21ksoftirqd/207:55:342
765998220,6cyclictest25-21ksoftirqd/209:13:182
765998220,4cyclictest0-21swapper/211:09:382
765698229,4cyclictest19-21ksoftirqd/108:20:321
765698222,5cyclictest121rcu_preempt10:35:201
765698222,3cyclictest121rcu_preempt09:30:401
765698221,4cyclictest121rcu_preempt08:25:411
765698221,4cyclictest121rcu_preempt08:00:001
7652982217,3cyclictest10-21ksoftirqd/007:50:380
7652982216,4cyclictest10-21ksoftirqd/009:45:430
7652982216,4cyclictest10-21ksoftirqd/009:30:330
7652982216,4cyclictest10-21ksoftirqd/009:15:290
7652982216,4cyclictest10-21ksoftirqd/009:15:290
7652982216,4cyclictest10-21ksoftirqd/007:20:180
765298221,5cyclictest281152kworker/u8:908:02:010
765298221,5cyclictest281152kworker/u8:908:02:010
7652982213,7cyclictest10-21ksoftirqd/009:20:280
7652982211,9cyclictest10-21ksoftirqd/009:40:230
765998219,9cyclictest8028-21/usr/sbin/munin12:05:232
765998218,10cyclictest9384-21/usr/sbin/munin11:00:312
765998217,11cyclictest29793-21ssh10:35:302
765998216,12cyclictest5795-21ls09:45:282
765998216,11cyclictest13784-21ldconfig08:50:282
765998212,5cyclictest25-21ksoftirqd/211:40:142
7652982116,3cyclictest10-21ksoftirqd/010:25:180
7652982115,4cyclictest10-21ksoftirqd/012:10:170
7652982115,4cyclictest10-21ksoftirqd/012:10:160
7652982115,4cyclictest10-21ksoftirqd/012:00:330
7652982115,4cyclictest10-21ksoftirqd/011:25:310
7652982115,4cyclictest10-21ksoftirqd/011:20:180
7652982115,4cyclictest10-21ksoftirqd/011:00:310
7652982115,4cyclictest10-21ksoftirqd/010:50:150
7652982115,4cyclictest10-21ksoftirqd/010:50:140
7652982115,4cyclictest10-21ksoftirqd/010:45:150
7652982115,4cyclictest10-21ksoftirqd/010:45:140
7652982115,4cyclictest10-21ksoftirqd/008:55:190
7652982115,4cyclictest10-21ksoftirqd/007:35:350
7652982114,5cyclictest10-21ksoftirqd/012:25:180
7652982114,5cyclictest10-21ksoftirqd/012:15:150
7652982114,5cyclictest10-21ksoftirqd/011:40:350
765998207,9cyclictest7737-21ls08:35:232
7652982015,3cyclictest10-21ksoftirqd/011:45:290
7652982015,3cyclictest10-21ksoftirqd/008:35:330
7652982014,4cyclictest10-21ksoftirqd/011:30:170
7652982014,4cyclictest10-21ksoftirqd/010:20:180
7652982014,4cyclictest10-21ksoftirqd/009:55:330
7652982014,4cyclictest10-21ksoftirqd/008:10:360
7652982014,4cyclictest10-21ksoftirqd/007:45:280
7652982013,5cyclictest10-21ksoftirqd/011:55:160
7652982011,7cyclictest10-21ksoftirqd/007:40:180
765298199,8cyclictest111rcuc/007:10:010
7652981914,3cyclictest10-21ksoftirqd/007:55:340
7652981812,4cyclictest10-21ksoftirqd/008:20:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional