You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 07:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Sun Jul 13, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30719672260,2sleep30-21swapper/322:20:243
2796897992613,3cyclictest3070600-21kthreadcore22:20:251
2796896992522,2cyclictest2811420-21grep19:20:010
25010912518,3phc2sys0-21swapper/321:39:063
25010912518,3phc2sys0-21swapper/321:15:143
25010912518,2phc2sys0-21swapper/319:50:213
2796897992421,2cyclictest3295196-21apt-config00:30:001
2796897992411,3cyclictest0-21swapper/123:25:021
2796896992416,7cyclictest3016359-21sed21:50:240
25010912418,3phc2sys0-21swapper/323:07:353
25010912418,3phc2sys0-21swapper/319:15:013
25010912418,2phc2sys0-21swapper/323:53:533
25010912418,2phc2sys0-21swapper/323:35:373
25010912418,2phc2sys0-21swapper/323:26:313
25010912418,2phc2sys0-21swapper/322:56:413
25010912418,2phc2sys0-21swapper/322:43:113
25010912418,2phc2sys0-21swapper/321:46:123
25010912418,2phc2sys0-21swapper/321:29:083
25010912418,2phc2sys0-21swapper/320:33:333
25010912418,2phc2sys0-21swapper/320:24:033
25010912418,2phc2sys0-21swapper/320:01:073
25010912418,2phc2sys0-21swapper/319:59:043
25010912418,2phc2sys0-21swapper/300:17:583
25010912417,2phc2sys0-21swapper/323:45:113
2796897992320,2cyclictest3303946-21latency_hist00:35:021
2796897992312,3cyclictest3194912-21grep23:30:271
2796896992320,2cyclictest3295410-21systemd-run00:30:000
2796896992313,6cyclictest3041739-21cstates22:05:180
25010912318,3phc2sys0-21swapper/323:59:053
25010912318,3phc2sys0-21swapper/323:21:053
25010912318,3phc2sys0-21swapper/323:17:573
25010912318,3phc2sys0-21swapper/321:41:173
25010912318,3phc2sys0-21swapper/321:32:553
25010912318,3phc2sys0-21swapper/321:23:133
25010912318,3phc2sys0-21swapper/321:11:393
25010912318,3phc2sys0-21swapper/321:04:013
25010912318,2phc2sys0-21swapper/321:06:443
25010912317,3phc2sys0-21swapper/323:00:333
25010912317,2phc2sys0-21swapper/322:36:373
25010912317,2phc2sys0-21swapper/322:12:003
25010912317,2phc2sys0-21swapper/321:52:363
25010912317,2phc2sys0-21swapper/320:57:543
25010912317,2phc2sys0-21swapper/319:49:423
25010912317,2phc2sys0-21swapper/319:38:203
25010912317,2phc2sys0-21swapper/300:05:243
330155622218,2sleep30-21swapper/300:31:033
329406122218,2sleep30-21swapper/300:28:283
327172322218,2sleep20-21swapper/200:15:232
324885822218,2sleep30-21swapper/300:00:493
319760822218,2sleep20-21swapper/223:33:482
317191222218,2sleep20-21swapper/223:19:442
308405422218,2sleep20-21swapper/222:29:102
306522022218,2sleep30-21swapper/322:17:023
303123122218,2sleep30-21swapper/321:58:343
301937422218,2sleep20-21swapper/221:50:272
301202922218,2sleep20-21swapper/221:45:572
298835422218,2sleep20-21swapper/221:34:592
296794722218,2sleep20-21swapper/221:20:282
295964522218,2sleep20-21swapper/221:15:392
295271322218,2sleep20-21swapper/221:13:392
289748322218,2sleep20-21swapper/220:30:192
289061622218,2sleep30-21swapper/320:25:043
287753322218,2sleep20-21swapper/220:10:312
279689799229,3cyclictest0-21swapper/121:35:021
2796897992212,2cyclictest178850irq/121-eno122:10:001
279689699223,5cyclictest2829395-21cron19:39:550
2796896992218,3cyclictest0-21swapper/000:35:030
2796896992217,3cyclictest0-21swapper/000:20:010
279689699221,6cyclictest2797156-21apt-get19:10:160
2796896992216,2cyclictest17350irq/127-ahci[0000:00:17.0]20:10:000
2796896992216,2cyclictest17350irq/127-ahci[0000:00:17.0]00:00:010
2796896992213,8cyclictest3182463-21irqrtprio23:25:210
2796896992212,1cyclictest178850irq/121-eno100:12:490
279662422217,3sleep20-21swapper/219:08:532
25010912217,3phc2sys0-21swapper/323:42:293
25010912217,3phc2sys0-21swapper/322:47:513
25010912217,3phc2sys0-21swapper/322:06:553
25010912217,3phc2sys0-21swapper/320:53:153
25010912217,3phc2sys0-21swapper/320:40:133
25010912217,3phc2sys0-21swapper/319:32:133
25010912216,2phc2sys0-21swapper/322:33:133
331237722117,2sleep20-21swapper/200:39:042
331097222117,2sleep30-21swapper/300:36:453
330316722117,2sleep20-21swapper/200:33:472
328492322117,2sleep20-21swapper/200:22:532
326627522117,2sleep20-21swapper/200:10:542
324933122117,2sleep20-21swapper/200:01:372
323129322117,2sleep20-21swapper/223:51:032
322214322117,2sleep20-21swapper/223:45:452
321430722117,2sleep20-21swapper/223:42:222
318215822117,2sleep20-21swapper/223:25:212
316045522117,2sleep20-21swapper/223:10:312
315210722117,2sleep20-21swapper/223:06:132
313579622118,2sleep20-21swapper/222:58:082
312575222117,2sleep20-21swapper/222:50:512
311126922117,2sleep20-21swapper/222:45:092
309968422117,2sleep20-21swapper/222:35:592
308285222118,2sleep30-21swapper/322:27:113
307540422117,2sleep20-21swapper/222:24:222
305931422117,2sleep20-21swapper/222:15:192
305408522117,2sleep20-21swapper/222:10:232
304844122117,2sleep20-21swapper/222:08:102
303248322117,2sleep20-21swapper/222:00:092
303080422117,2sleep20-21swapper/221:57:522
300403122118,2sleep20-21swapper/221:42:052
298952022117,2sleep20-21swapper/221:35:192
297962122117,2sleep20-21swapper/221:29:542
288364522118,2sleep30-21swapper/320:16:063
284134822118,2sleep20-21swapper/219:43:022
284126922118,2sleep30-21swapper/319:42:033
282839722117,2sleep20-21swapper/219:30:242
2796897992119,1cyclictest2920601-21latency_hist20:50:001
2796897992110,3cyclictest0-21swapper/123:50:251
2796896992118,2cyclictest2944791-21latency_hist21:10:000
25010912117,2phc2sys0-21swapper/323:33:013
25010912117,2phc2sys0-21swapper/300:13:053
325750222017,2sleep20-21swapper/200:05:452
324046122017,2sleep20-21swapper/223:56:232
320472722017,2sleep20-21swapper/223:36:032
317824622017,2sleep20-21swapper/223:20:532
311046322017,2sleep20-21swapper/222:44:222
294457522017,2sleep20-21swapper/221:07:302
293868422017,2sleep20-21swapper/221:04:172
292638322017,2sleep20-21swapper/220:52:032
292025322017,2sleep20-21swapper/220:46:022
291421222017,2sleep20-21swapper/220:40:532
290814822017,2sleep20-21swapper/220:36:002
289605822017,2sleep20-21swapper/220:25:582
288988322017,2sleep20-21swapper/220:22:582
288361922017,2sleep20-21swapper/220:15:452
286001722017,2sleep20-21swapper/220:00:052
285954722017,2sleep20-21swapper/219:58:182
285335322017,2sleep20-21swapper/219:51:242
284752122017,2sleep20-21swapper/219:49:242
283529222017,2sleep20-21swapper/219:38:102
281110122017,2sleep20-21swapper/219:18:552
2796897992017,2cyclictest3131577-21kthreadcore22:55:241
2796896992017,2cyclictest3163151-21latency_hist23:15:020
2796896992017,2cyclictest2950362-21mailstats21:10:260
2796896992017,2cyclictest0-21swapper/022:05:030
2796896992014,5cyclictest1-21systemd23:50:000
2796896992013,6cyclictest3246016-21kthreadcore00:00:220
2796896992013,6cyclictest3131594-21kthreadcore22:55:240
25010912017,2phc2sys0-21swapper/322:53:553
25010912017,2phc2sys0-21swapper/320:12:033
25010912017,2phc2sys0-21swapper/320:06:223
25010912017,2phc2sys0-21swapper/319:28:003
25010912017,2phc2sys0-21swapper/319:20:333
25010912017,1phc2sys0-21swapper/320:35:163
25010912014,2phc2sys0-21swapper/320:49:253
2796897991914,3cyclictest1707-21polkitd21:25:261
2796897991911,1cyclictest924598rtkit-daemon22:25:191
279689799190,10cyclictest2884017-21sendmail-msp20:20:001
279689699199,6cyclictest2980717-21df_inode21:30:170
279689699199,6cyclictest2954060-21aten2.4-expect21:15:130
279689699198,7cyclictest2797071-21unin-run19:10:020
279689699197,7cyclictest3013985-21diskmemload21:49:120
279689699196,8cyclictest3117619-21diskmemload22:46:420
279689699196,6cyclictest3181048-21kworker/u16:0+xprtiod23:39:100
279689699196,3cyclictest3041138-21kworker/u16:1+nfsiod22:25:140
279689699195,6cyclictest2896232-21kworker/u16:2+xprtiod21:26:000
2796896991917,1cyclictest2883978-21idleruntime-cro20:20:000
2796896991916,2cyclictest0-21swapper/023:55:010
2796896991915,3cyclictest0-21swapper/019:30:010
2796896991913,5cyclictest3305839-21irqrtprio00:35:210
279689799189,1cyclictest178850irq/121-eno123:35:161
2796897991815,2cyclictest2989227-21cstates21:35:171
2796897991815,2cyclictest2796894-21cyclictest21:20:221
2796897991814,3cyclictest2907704-21mailstats20:35:251
279689699188,6cyclictest3177752-21sort23:20:270
279689699188,6cyclictest3068445-21/usr/sbin/munin22:20:220
279689699188,6cyclictest2895670-21cut20:25:260
279689699181,5cyclictest3137478-21aten2.4-expect23:00:160
2796896991815,2cyclictest3280812-21kthreadcore00:20:270
2796896991815,2cyclictest3105403-21kthreadcore22:40:210
2796896991815,2cyclictest3060149-21kthreadcore22:15:230
2796896991815,2cyclictest2934345-21kthreadcore21:00:240
2796896991815,2cyclictest2917640-21kthreadcore20:45:220
2796896991815,2cyclictest2898030-21kthreadcore20:30:220
2796896991815,2cyclictest2874939-21kthreadcore20:10:250
2796896991815,2cyclictest2850692-21kthreadcore19:50:230
2796896991815,2cyclictest2826456-21kthreadcore19:30:220
2796896991815,2cyclictest1-21systemd21:00:010
2796896991814,3cyclictest2997088-21latency_hist21:40:020
2796896991812,5cyclictest0-21swapper/023:45:010
2796896991812,2cyclictest171ktimers/021:40:180
2796896991811,6cyclictest3095423-21kthreadcore22:35:230
279689899178,4cyclictest0-21swapper/200:25:132
2796897991714,2cyclictest2955592-21kthreadcore21:15:201
2796897991714,2cyclictest2859258-21grep19:55:291
2796897991714,2cyclictest2796894-21cyclictest22:00:231
2796897991713,3cyclictest3164514-21fschecks_time23:15:171
2796897991712,3cyclictest3059157-21cstates22:15:181
279689799170,9cyclictest3093361-21latency_hist22:35:021
279689699178,5cyclictest3086532-21tr22:30:240
279689699177,6cyclictest3154577-21munin-run23:10:000
279689699177,6cyclictest2963355-21df_inode21:20:190
279689699176,7cyclictest3164201-21ssh23:15:150
279689699175,8cyclictest2896232-21kworker/u16:2+xprtiod21:55:450
279689699172,5cyclictest2842016-21aten2.4-expect19:45:160
2796896991714,2cyclictest2904084-21kthreadcore20:35:210
2796896991714,2cyclictest2861357-21kthreadcore20:00:240
2796896991712,4cyclictest3122606-21kthreadcore22:50:270
2796896991710,6cyclictest0-21swapper/023:30:240
279689799163,4cyclictest3224949-21cat23:50:011
279689799161,3cyclictest3154477-21latency_hist23:10:011
2796897991613,2cyclictest8799-21cron19:40:001
2796897991613,2cyclictest3863153-21avahi-daemon23:40:281
2796897991613,2cyclictest2796894-21cyclictest22:40:011
2796897991613,2cyclictest0-21swapper/100:10:231
2796897991612,3cyclictest3002623-21ptp4l21:40:281
2796897991610,4cyclictest0-21swapper/122:55:011
279689699166,6cyclictest3054226-21kthreadcore22:10:220
2796896991613,2cyclictest3254698-21kthreadcore00:05:260
2796896991613,2cyclictest2889160-21pmu-power20:20:260
2796896991613,2cyclictest2854955-21irqcore19:55:210
2796896991613,2cyclictest2812864-21kthreadcore19:20:230
2501091160,2phc2sys0-21swapper/323:15:013
2796898991513,1cyclictest0-21swapper/219:30:022
2796898991513,1cyclictest0-21swapper/219:15:012
2796898991511,2cyclictest0-21swapper/220:05:252
279689799159,5cyclictest2814301-21grep19:20:231
279689799156,2cyclictest178850irq/121-eno121:05:161
279689799151,5cyclictest2895681-21python320:25:261
279689799151,4cyclictest178850irq/121-eno123:00:451
2796897991512,2cyclictest3253014-21irqrtprio00:05:241
2796897991512,2cyclictest3243298-21aten_repower_vo00:00:151
2796897991512,2cyclictest3242739-21kworker/u16:3-rpciod00:20:201
2796897991512,2cyclictest3189587-21grep23:30:001
2796897991512,2cyclictest3104332-21kthreadcore22:40:211
2796897991512,2cyclictest3014537-21latency_hist21:50:001
2796897991512,2cyclictest2930343-21kthreadcore20:55:231
2796897991512,2cyclictest2877913-21wc20:15:011
2796897991512,2cyclictest2861148-21grep20:00:221
2796897991511,3cyclictest2826456-21kthreadcore19:30:221
279689799150,8cyclictest3032361-21cat22:00:021
279689799150,3cyclictest2953661-21cat21:15:011
279689699156,4cyclictest0-21swapper/020:40:160
2796896991512,2cyclictest2922038-21irqrtprio20:50:210
2796896991512,2cyclictest2836834-21irqcore19:40:230
2796898991411,1cyclictest0-21swapper/222:35:022
2796898991411,1cyclictest0-21swapper/220:55:252
2796898991411,1cyclictest0-21swapper/219:20:262
279689799148,2cyclictest178850irq/121-eno123:55:061
279689799148,2cyclictest178850irq/121-eno122:12:591
279689799143,3cyclictest3111422-21aten2.4-expect22:45:141
279689799141,6cyclictest3155303-21cstates23:10:161
279689799141,3cyclictest2871960-21cat20:10:001
2796897991412,1cyclictest2914536-21cron20:45:001
2796897991411,2cyclictest3306049-21kthreadcore00:35:231
2796897991411,2cyclictest2937975-21sendmail_mailqu21:00:281
2796897991411,2cyclictest2899495-21kthreadcore20:30:231
2796897991411,2cyclictest2884462-21aten2.4-expect20:20:161
2796897991411,2cyclictest2796894-21cyclictest19:25:191
2796897991410,3cyclictest2837299-21kthreadcore19:40:231
279689799140,3cyclictest0-21swapper/119:50:531
279689799140,3cyclictest0-21swapper/100:15:191
279689799140,13cyclictest71-21kcompactd020:55:021
328613621310,2sleep30-21swapper/300:24:503
279689899130,10cyclictest0-21swapper/223:00:462
279689799136,2cyclictest178850irq/121-eno121:50:041
2796897991311,1cyclictest2809985-21kthreadcore19:15:261
2796897991310,2cyclictest2846029-21kthreadcore19:45:231
2796897991310,2cyclictest2797255-21aten_repower_po19:10:171
2501091129,1phc2sys0-21swapper/319:15:553
27968979991,6cyclictest1-21systemd19:10:031
250109170,3phc2sys0-21swapper/319:05:173
250109170,2phc2sys0-21swapper/322:00:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional