You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 10:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackcslot4.osadl.org (updated Mon Nov 03, 2025 00:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27931572268180,28sleep10-21swapper/119:08:031
27929892256189,52sleep00-21swapper/019:06:160
295198721360,4sleep10-21swapper/123:38:131
125899560,4rtkit-daemon1257-21rtkit-daemon00:30:051
29126592470,2sleep00-21swapper/022:45:030
125899470,3rtkit-daemon0-21swapper/023:16:410
29330642450,4sleep10-21swapper/123:11:021
125899450,3rtkit-daemon0-21swapper/022:31:100
125899450,3rtkit-daemon0-21swapper/019:22:010
29406142440,3sleep00-21swapper/023:21:530
28746142430,4sleep10-21swapper/121:53:201
125899410,3rtkit-daemon0-21swapper/020:53:070
125899410,3rtkit-daemon0-21swapper/000:06:060
125899400,3rtkit-daemon0-21swapper/020:41:400
125899400,3rtkit-daemon0-21swapper/020:22:380
125899380,4rtkit-daemon1257-21rtkit-daemon00:13:330
125899370,3rtkit-daemon0-21swapper/121:28:000
125899360,4rtkit-daemon1257-21rtkit-daemon21:35:071
125899330,1rtkit-daemon1257-21rtkit-daemon22:29:200
125899320,1rtkit-daemon1257-21rtkit-daemon22:13:590
279342999318,8cyclictest13-21ksoftirqd/021:50:370
2793429993127,3cyclictest2908359-1kworker/0:1H23:40:170
125899310,5rtkit-daemon1257-21rtkit-daemon20:28:501
2793434993015,9cyclictest2956719-21apt-get23:45:171
279342999298,9cyclictest13-21ksoftirqd/022:51:590
279342999295,9cyclictest13-21ksoftirqd/023:53:450
2793429992913,10cyclictest2828320-21apt-get20:35:140
125899290,4rtkit-daemon1257-21rtkit-daemon22:05:301
125899290,1rtkit-daemon1257-21rtkit-daemon23:26:130
125899290,1rtkit-daemon1257-21rtkit-daemon22:02:330
279343499281,22cyclictest2916923-21apt-get22:50:191
279342999281,14cyclictest2842225-21diskmemload00:15:470
125899280,1rtkit-daemon1257-21rtkit-daemon21:29:031
29567002270,14sleep013-21ksoftirqd/023:45:150
279343499271,8cyclictest2800165-21apt-config19:25:011
279342999274,8cyclictest13-21ksoftirqd/021:14:170
279342999271,13cyclictest2842225-21diskmemload21:47:580
279343499261,3cyclictest2992727-21python300:35:031
279343499261,20cyclictest2908957-40apt-check22:40:151
279342999267,13cyclictest2824413-21apt-get20:25:150
279342999265,7cyclictest13-21ksoftirqd/019:33:250
279342999264,7cyclictest13-21ksoftirqd/022:37:500
279342999263,8cyclictest13-21ksoftirqd/023:39:520
279342999261,8cyclictest2842225-21diskmemload23:59:080
279342999261,8cyclictest2842225-21diskmemload21:21:410
279342999261,7cyclictest2842225-21diskmemload00:31:510
2793434992517,6cyclictest2798871-21ntp_states19:20:231
279343499251,5cyclictest2893786-21munin-run22:20:001
279343499251,22cyclictest2982526-21fschecks_time00:20:181
279343499251,21cyclictest2793801-21df_inode19:10:161
279343499250,23cyclictest2816399-21cat20:05:011
279342999259,4cyclictest2842225-21diskmemload23:08:050
279342999251,7cyclictest2842225-21diskmemload22:16:540
279342999251,7cyclictest2842225-21diskmemload00:22:470
279342999251,19cyclictest2816536-21apt-get20:05:120
279342999251,12cyclictest2842225-21diskmemload00:00:400
279343499242,15cyclictest2905028-21apt-get22:35:151
2793434992413,6cyclictest63750irq/132-enp2s023:30:141
279342999246,4cyclictest0-21swapper/019:47:270
279342999246,4cyclictest0-21swapper/019:47:260
279342999243,7cyclictest13-21ksoftirqd/023:00:110
279342999243,7cyclictest13-21ksoftirqd/022:07:380
2793429992420,2cyclictest2921233-21head22:55:240
279342999241,6cyclictest2842225-21diskmemload21:35:380
279342999241,6cyclictest2842225-21diskmemload00:35:560
279342999241,15cyclictest2838528-21apt-get21:00:140
2793429992411,3cyclictest2842225-21diskmemload21:33:540
2793429992410,9cyclictest2793596-21apt-get19:10:120
125899240,3rtkit-daemon0-21swapper/121:22:051
125899240,3rtkit-daemon0-21swapper/022:40:160
125899240,3rtkit-daemon0-21swapper/020:45:090
125899240,3rtkit-daemon0-21swapper/020:45:090
28785652230,4sleep013-21ksoftirqd/021:59:030
279343499239,9cyclictest2863165-1kworker/u9:121:55:151
279343499235,10cyclictest26-21ksoftirqd/123:50:361
279343499234,17cyclictest2916199-21python322:50:001
279343499234,17cyclictest2842228-21latency_hist21:10:011
279343499232,12cyclictest2894052-21apt-get22:20:151
2793434992312,6cyclictest63750irq/132-enp2s023:55:161
279343499231,20cyclictest2953422-21fschecks_time23:40:171
279342999236,8cyclictest13-21ksoftirqd/023:12:470
279342999235,3cyclictest141rcu_preempt19:44:590
279342999232,15cyclictest2796126-21apt-get19:15:140
279342999232,14cyclictest2846323-21apt-get21:15:160
279342999232,14cyclictest2840481-21apt-get21:05:180
2793429992310,3cyclictest2842225-21diskmemload23:30:570
279342999230,7cyclictest2842225-21diskmemload00:25:490
279343499223,17cyclictest2818267-21cat20:09:551
279343499222,14cyclictest2978442-21apt-get00:15:121
279343499222,14cyclictest2920499-21apt-get22:55:161
279343499222,14cyclictest2897679-21apt-get22:25:181
279343499222,14cyclictest2886512-21apt-get22:10:151
279343499221,3cyclictest2832069-21python320:45:001
2793434992212,6cyclictest63750irq/132-enp2s023:05:171
2793434992211,6cyclictest63750irq/132-enp2s023:20:161
279342999226,4cyclictest0-21swapper/020:33:100
2793429992219,2cyclictest63750irq/132-enp2s021:42:420
279342999221,4cyclictest2842225-21diskmemload22:24:150
125899220,3rtkit-daemon1257-21rtkit-daemon00:14:081
279343499213,10cyclictest2901408-21apt-get22:30:191
279343499212,13cyclictest2810030-21apt-get19:50:161
2793434992118,2cyclictest63750irq/132-enp2s023:18:341
2793434992117,3cyclictest63750irq/132-enp2s023:26:351
2793434992113,6cyclictest2974529-21latency_hist00:10:011
2793434992112,7cyclictest26-21ksoftirqd/100:04:591
279343499211,18cyclictest2868529-21fschecks_time21:45:191
279342999213,10cyclictest2820439-21apt-get20:15:130
279342999213,10cyclictest2812617-21apt-get19:55:180
279342999212,13cyclictest2810654-21apt-get19:50:140
279342999212,13cyclictest2804363-21apt-get19:35:120
125899210,3rtkit-daemon0-21swapper/121:40:041
279343499202,13cyclictest2879236-21apt-get22:00:121
2793434992015,3cyclictest2810146-21latency_hist19:50:021
2793434992015,3cyclictest2810146-21latency_hist19:50:011
279343499201,14cyclictest2985840-21apt-get00:25:151
2793434992010,6cyclictest2845198-1kworker/u9:121:30:141
279343499200,7cyclictest2847156-21ntp_states21:15:251
279343499200,3cyclictest2814406-1kworker/1:3H20:00:021
279343499200,2cyclictest2843411-21awk21:10:221
279342999201,14cyclictest2836552-21apt-get20:55:140
28293372190,4sleep10-21swapper/120:35:251
279343499192,9cyclictest2924051-21apt-get23:00:121
279343499191,17cyclictest2820484-21unattended-upgr20:15:131
2793434991911,6cyclictest2839533-21swap21:00:251
279343499191,13cyclictest2837322-21ntp_states20:55:221
279343499191,13cyclictest2823230-21ntp_states20:20:251
279343499190,17cyclictest2797894-21munin-run19:20:011
279342999197,7cyclictest13-21ksoftirqd/020:10:140
279342999197,7cyclictest13-21ksoftirqd/020:10:130
125899190,6rtkit-daemon2801753-21users19:25:290
2793434991813,3cyclictest26-21ksoftirqd/119:45:001
2793434991810,6cyclictest2827922-21seq20:33:041
279343499180,16cyclictest0-21swapper/119:40:001
2793434991711,4cyclictest287-20systemd-journal20:45:021
2793434991711,4cyclictest287-20systemd-journal20:45:011
2793434991710,5cyclictest2819050-21sed20:10:201
2793434991710,5cyclictest2819050-21sed20:10:191
2793429991710,5cyclictest2816003-21seq20:01:380
279343499166,8cyclictest26-21ksoftirqd/119:32:271
279343499161,11cyclictest2834817-21diskstats20:50:171
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional