You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 21:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Tue Dec 02, 2025 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2879798286278,5cyclictest3750-21kworker/u8:2011:16:573
2798522740,2sleep10-21swapper/107:05:331
2789522660,2sleep326626-21kworker/u8:3207:05:273
2878898255242,9cyclictest10-21ksoftirqd/011:16:580
2787922530,3sleep226626-21kworker/u8:3207:05:262
2879598186179,4cyclictest3752-21kworker/u8:2211:16:572
92172820,2sleep39216-21ssh11:24:503
246442770,2chrt0-21swapper/108:25:011
55212600,14sleep330259-21kworker/u8:1012:24:463
28797986053,4cyclictest14694-21kworker/u8:4608:02:243
324232470,3sleep330260-21kworker/u8:1112:11:033
324232470,3sleep330260-21kworker/u8:1112:11:033
2879398475,9cyclictest19-21ksoftirqd/108:50:151
207342450,6sleep320505-21latency_hist08:15:023
174232450,2sleep20-21swapper/209:25:412
28797984235,4cyclictest4762-21kworker/u8:2709:01:473
218472420,5sleep126104-21kworker/1:109:35:291
2879398419,6cyclictest19-21ksoftirqd/111:15:011
2879798401,3cyclictest121rcu_preempt12:15:153
131722400,2sleep10-21swapper/112:40:021
2879398390,9cyclictest19-21ksoftirqd/109:10:211
2879598388,11cyclictest21596-21aten2.4-expect11:50:192
2879398385,5cyclictest19-21ksoftirqd/112:20:001
2879598367,11cyclictest12326-21/usr/sbin/munin07:50:342
2879398365,5cyclictest19-21ksoftirqd/110:00:001
2879398364,5cyclictest19-21ksoftirqd/109:00:001
2879398362,5cyclictest19-21ksoftirqd/111:00:281
2879598352,11cyclictest20025-21ntpq11:45:382
2879398358,6cyclictest19-21ksoftirqd/108:35:001
2879398355,6cyclictest19-21ksoftirqd/112:25:421
2879398353,6cyclictest19-21ksoftirqd/108:00:001
189062350,2sleep30-21swapper/310:35:443
5442340,3sleep10-21swapper/108:45:401
2879598348,7cyclictest16209-21ssh11:39:022
2879598346,9cyclictest31613-21ntpq07:15:332
2879598342,10cyclictest8533-21ntpq07:40:302
2879598342,10cyclictest27366-21ntpq08:30:332
2879398344,5cyclictest19-21ksoftirqd/112:30:531
28797983327,4cyclictest18450-21kworker/u8:1208:37:123
2879598336,8cyclictest8779-21diskmemload11:08:002
2879598336,8cyclictest3700-21/usr/sbin/munin08:55:242
2879598333,9cyclictest30352-21ssh09:53:472
2879598333,11cyclictest23689-21ld08:20:332
2879598332,9cyclictest16011-21ntpq08:00:292
2879598331,12cyclictest32689-21ssh12:12:292
2879598331,12cyclictest32689-21ssh12:12:282
2879398338,5cyclictest19-21ksoftirqd/107:30:491
158392330,2sleep115837-21sh11:36:551
103752330,8sleep3311ksoftirqd/312:33:523
103002330,2sleep10-21swapper/110:20:011
2879598327,8cyclictest8647-21ssh11:21:492
2879598326,8cyclictest25434-21ssh11:57:022
2879598326,8cyclictest11479-21ssh11:29:182
2879598325,8cyclictest10472-21ssh09:11:192
2879598324,9cyclictest3294-21apt-get10:05:162
2879598323,9cyclictest14670-21ntpq09:20:282
2879598323,9cyclictest1061-21ntpq07:20:292
2879598323,6cyclictest11321-21ld10:20:322
2879598323,11cyclictest9466-21ntpq12:30:502
2879598322,11cyclictest6048-21aten2.4-expect07:35:202
2879598322,11cyclictest14175-21ntpq07:55:442
2879598321,9cyclictest22572-21ssh09:36:562
2879598321,11cyclictest2253-21aten2.4-expect07:25:182
2879398327,4cyclictest121rcu_preempt11:22:371
2879398325,7cyclictest19-21ksoftirqd/112:05:291
2879398325,7cyclictest19-21ksoftirqd/112:05:291
2879398322,10cyclictest19-21ksoftirqd/107:20:331
2879398321,7cyclictest19-21ksoftirqd/110:40:001
28793983216,5cyclictest19-21ksoftirqd/111:05:451
265872320,2sleep126582-21ssh12:00:201
2879598312,9cyclictest19653-21ntpq08:10:282
2879598311,10cyclictest2475-21ntpq08:50:412
2879398316,4cyclictest121rcu_preempt07:10:331
2879398315,6cyclictest19-21ksoftirqd/109:40:481
2879398314,5cyclictest19-21ksoftirqd/110:55:001
2879398314,5cyclictest19-21ksoftirqd/108:40:401
2879398314,5cyclictest19-21ksoftirqd/108:40:391
2879398314,5cyclictest19-21ksoftirqd/107:50:211
2879398314,3cyclictest121rcu_preempt11:40:161
2879398313,5cyclictest19-21ksoftirqd/112:10:511
2879398313,5cyclictest19-21ksoftirqd/112:10:501
2879398312,5cyclictest19-21ksoftirqd/111:25:301
28793983124,5cyclictest181rcuc/107:45:171
28793983123,5cyclictest181rcuc/110:40:321
141382313,6sleep331-21ksoftirqd/307:55:423
78382300,2sleep10-21swapper/109:05:261
2879798302,4cyclictest121rcu_preempt09:31:063
2879798301,4cyclictest121rcu_preempt10:25:233
2879598306,7cyclictest9110-21/usr/sbin/munin10:15:412
2879598305,8cyclictest11075-21taskset07:48:532
2879598303,9cyclictest8779-21diskmemload12:06:302
2879598303,9cyclictest8779-21diskmemload12:06:292
2879598303,9cyclictest2644-21ssh12:17:072
2879598303,8cyclictest2206-21/usr/sbin/munin11:10:232
2879598302,8cyclictest17986-21ps08:05:432
2879598301,8cyclictest26568-21df12:00:172
2879598301,7cyclictest20968-21apt-get08:15:192
2879598300,9cyclictest24495-21ssh10:48:532
2879598300,11cyclictest27594-21ssh09:46:482
2879398308,4cyclictest121rcu_preempt10:20:421
2879398307,3cyclictest121rcu_preempt10:45:271
2879398305,7cyclictest19-21ksoftirqd/109:50:361
2879398304,5cyclictest19-21ksoftirqd/109:24:121
2879398303,6cyclictest19-21ksoftirqd/111:30:271
2879398303,6cyclictest19-21ksoftirqd/110:30:301
28793983024,4cyclictest181rcuc/108:10:391
28793983010,5cyclictest19-21ksoftirqd/109:31:031
2879598297,8cyclictest2267-21chrt10:01:042
2879598295,5cyclictest5036-21ssh12:22:072
2879598294,7cyclictest20780-21munin-run09:35:012
2879598294,7cyclictest18627-21ssh11:43:532
2879598294,4cyclictest11516-21ssh09:15:232
2879598293,9cyclictest29204-21ntpq08:35:362
2879598291,9cyclictest27393-21apt10:55:132
2879598291,9cyclictest14128-21cat11:35:012
2879598291,8cyclictest21068-21ntpq10:40:312
2879598291,11cyclictest14674-21sh10:27:242
2879598290,9cyclictest4940-21ntpq07:30:542
2879398298,10cyclictest121rcu_preempt08:05:301
2879398296,5cyclictest19-21ksoftirqd/110:25:351
2879398296,5cyclictest19-21ksoftirqd/108:20:021
2879398295,6cyclictest19-21ksoftirqd/111:59:071
2879398295,6cyclictest19-21ksoftirqd/109:05:021
2879398295,4cyclictest121rcu_preempt11:45:291
2879398294,6cyclictest19-21ksoftirqd/110:00:171
2879398294,5cyclictest19-21ksoftirqd/107:20:021
2879398293,7cyclictest19-21ksoftirqd/111:50:141
2879398293,5cyclictest19-21ksoftirqd/110:05:171
245242290,6sleep328785-21cyclictest10:49:033
228502290,6sleep331-21ksoftirqd/308:20:093
307952280,4sleep331-21ksoftirqd/309:55:023
2879798281,4cyclictest121rcu_preempt10:20:173
2879598285,7cyclictest30611-21/usr/sbin/munin07:15:002
2879598284,5cyclictest7315-21ssh10:12:412
2879598284,4cyclictest17327-21ssh10:33:552
28795982817,8cyclictest25518-21ld08:25:332
2879598280,9cyclictest30761-21ssh11:00:422
2879598280,8cyclictest23518-21ssh09:40:192
2879598280,11cyclictest6802-21ld12:25:422
2879398287,5cyclictest121rcu_preempt09:25:251
2879398285,5cyclictest19-21ksoftirqd/112:20:171
2879398285,5cyclictest19-21ksoftirqd/108:39:591
2879398284,5cyclictest19-21ksoftirqd/107:40:011
2879398283,5cyclictest19-21ksoftirqd/109:45:561
2879398283,5cyclictest121rcu_preempt07:25:141
2879398281,9cyclictest19-21ksoftirqd/108:25:301
2879398281,7cyclictest19-21ksoftirqd/110:55:211
28793982811,8cyclictest19-21ksoftirqd/107:40:311
28793982810,11cyclictest181rcuc/109:15:341
258992280,5sleep331-21ksoftirqd/311:59:293
20732280,2sleep30-21swapper/308:50:253
133572280,16sleep36291-21kworker/u8:111:31:293
289082270,15sleep321829-21kworker/u8:410:56:483
2879798274,7cyclictest31-21ksoftirqd/307:25:383
2879598272,5cyclictest25-21ksoftirqd/209:05:232
28795982715,9cyclictest31054-21/usr/sbin/munin08:40:312
28795982715,9cyclictest31054-21/usr/sbin/munin08:40:302
28795982714,8cyclictest10865-21apt-get12:35:202
2879598270,9cyclictest26349-21ssh10:51:022
2879398276,5cyclictest19-21ksoftirqd/108:00:191
2879398273,6cyclictest19-21ksoftirqd/111:15:171
2879398271,7cyclictest19-21ksoftirqd/110:10:311
274292270,2sleep30-21swapper/308:30:393
129862270,2sleep30-21swapper/309:16:543
58072260,2sleep33584-21kworker/u8:007:35:023
2879798262,4cyclictest121rcu_preempt11:55:003
2879798262,4cyclictest121rcu_preempt09:55:123
2879798261,5cyclictest121rcu_preempt09:45:003
2879798261,4cyclictest121rcu_preempt11:45:313
2879598261,7cyclictest31801-21ssh09:55:382
2879598260,7cyclictest19462-21ssh10:37:292
159262260,2sleep311135-21kworker/u8:1211:37:253
2879798254,4cyclictest121rcu_preempt07:10:383
2879798252,5cyclictest31-21ksoftirqd/310:34:433
2879798252,4cyclictest121rcu_preempt12:25:293
2879798251,7cyclictest17435-21ps08:05:273
2879798251,6cyclictest5876-21cpuspeed10:10:223
2879798251,5cyclictest1901-21ssh10:00:403
2879798251,3cyclictest121rcu_preempt11:00:163
282292250,2sleep30-21swapper/312:04:083
260532250,14sleep331-21ksoftirqd/309:45:093
22112250,7sleep3121rcu_preempt11:10:143
158222250,2sleep30-21swapper/309:24:093
80292240,5sleep3311ksoftirqd/310:15:133
307222240,2sleep30-21swapper/312:09:433
307222240,2sleep30-21swapper/312:09:423
2879798243,7cyclictest121rcu_preempt08:16:003
2879798241,7cyclictest8720-1kworker/u9:111:25:133
2879798241,4cyclictest7457-21cron07:40:003
2879598242,6cyclictest25-21ksoftirqd/209:00:242
28795982413,7cyclictest32493-21ps08:45:262
2878898248,8cyclictest15187-21latency_hist10:30:010
2878898241,8cyclictest158372sh11:36:550
201882240,2sleep30-21swapper/310:40:023
110802240,1sleep33593-21kworker/u8:807:48:563
2879798233,5cyclictest121rcu_preempt09:10:003
2879798232,5cyclictest9364-21hddtemp_smartct09:10:263
2879798232,4cyclictest121rcu_preempt08:50:013
2879798231,6cyclictest121rcu_preempt10:50:133
2879798231,4cyclictest18403-21munin-run09:30:013
2879798231,4cyclictest121rcu_preempt12:35:293
2879798231,3cyclictest121rcu_preempt11:40:383
28788982317,3cyclictest1050ksoftirqd/008:02:240
327162220,1sleep332240-21kworker/u8:1107:20:103
315172220,2sleep30-21swapper/308:40:443
315172220,2sleep30-21swapper/308:40:433
2879798229,3cyclictest3593-21kworker/u8:807:50:103
2879798221,5cyclictest8188-21irqrtprio07:40:243
2879798221,5cyclictest31-21ksoftirqd/311:05:173
2879798221,3cyclictest121rcu_preempt09:35:263
2879798221,3cyclictest121rcu_preempt08:25:253
28788982217,3cyclictest2044-21snmpd07:50:280
28788982212,8cyclictest4988-21wc07:30:560
28788982212,8cyclictest19920-21cron10:40:000
28788982211,8cyclictest10-21ksoftirqd/011:00:270
2879798212,5cyclictest121rcu_preempt07:15:303
2879798211,3cyclictest121rcu_preempt10:05:263
2878898215,13cyclictest109050irq/20-fttdcc0111:25:140
28788982116,3cyclictest10-21ksoftirqd/009:40:500
28788982114,4cyclictest10-21ksoftirqd/012:30:500
2879798201,4cyclictest3861-21sed08:55:253
28788982015,3cyclictest12265-21ntpq09:15:360
28788982014,4cyclictest29535-21munin-run11:00:010
28788982014,4cyclictest10-21ksoftirqd/009:20:300
28788982014,4cyclictest10-21ksoftirqd/009:00:280
28788982014,3cyclictest8037-21ssh10:15:160
28788982012,6cyclictest7521-21irqrtprio11:20:230
28788982012,6cyclictest6891-21timerwakeupswit10:10:460
28788982012,6cyclictest3198-21latency_hist12:20:010
28788982012,6cyclictest16728-21sh11:40:190
28788982012,6cyclictest1405-21sshd08:20:280
28788982011,7cyclictest30880-21aten2_rfpower_c09:55:170
28788982011,3cyclictest2044-21snmpd11:59:100
28788982010,6cyclictest906-21latency07:20:260
28788982010,3cyclictest6564-21rm12:25:280
2878898199,8cyclictest8779-21diskmemload11:33:100
2878898198,9cyclictest26298-21apt12:00:140
2878898195,4cyclictest26690-21kworker/0:107:20:000
28788981914,3cyclictest19592-21ssh09:30:500
28788981914,3cyclictest10-21ksoftirqd/012:35:350
28788981914,3cyclictest10-21ksoftirqd/012:05:180
28788981914,3cyclictest10-21ksoftirqd/012:05:180
28788981914,3cyclictest10-21ksoftirqd/011:10:320
28788981914,3cyclictest10-21ksoftirqd/010:45:350
28788981913,3cyclictest4309-21ntpq12:20:310
28788981913,3cyclictest25595-21ntpq08:25:390
28788981913,3cyclictest2044-21snmpd11:45:080
28788981913,3cyclictest16777-21ssh10:30:530
28788981912,5cyclictest886-21aten2_rfpower_e10:00:170
28788981912,5cyclictest32220-21sh11:05:180
28788981911,6cyclictest26754-21sh10:53:020
28788981911,6cyclictest26056-21sh09:45:100
28788981911,5cyclictest29895-21open_files07:10:410
28788981911,5cyclictest20228-21/usr/sbin/munin10:40:190
28788981910,7cyclictest31445-21interrupts12:10:260
28788981910,7cyclictest31445-21interrupts12:10:250
2878898188,8cyclictest109050irq/20-fttdcc0107:40:240
28788981813,3cyclictest9055-21apt-get09:10:140
28788981813,3cyclictest2442-21ntpq08:50:360
28788981813,3cyclictest10-21ksoftirqd/010:05:160
28788981813,3cyclictest10-21ksoftirqd/009:05:150
28788981813,3cyclictest10-21ksoftirqd/008:55:250
28788981813,3cyclictest10-21ksoftirqd/007:45:140
28788981810,6cyclictest32455-21if_eth008:45:270
28788981810,6cyclictest29787-21sh09:50:490
28788981810,6cyclictest18914-21aten2_rfpower_c08:10:180
28788981810,6cyclictest17048-21/usr/sbin/munin08:05:190
2878898179,6cyclictest29450-21switchtime08:35:490
2878898179,6cyclictest27458-21open_inodes08:30:420
2878898179,6cyclictest22908-21sh11:51:130
2878898178,7cyclictest20916-21apt-key08:15:050
2878898174,11cyclictest22243-21timerandwakeup09:35:420
2878898171,9cyclictest2936-21/usr/sbin/munin07:25:260
28788981712,3cyclictest14957-21munin-run08:00:020
28788981712,3cyclictest10-21ksoftirqd/010:20:140
28788981712,3cyclictest10-21ksoftirqd/008:40:250
28788981712,3cyclictest10-21ksoftirqd/008:40:250
28788981712,3cyclictest10-21ksoftirqd/007:35:150
28788981710,5cyclictest1405-21sshd09:25:390
2878898151,11cyclictest28794-21cut07:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional