You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-19 - 13:50
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sun Oct 19, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2408162993330,2cyclictest2832849-40updatedb.mlocat00:00:002
2408156992724,2cyclictest2671212-21idleruntime-cro22:20:000
2408162992521,2cyclictest2614374-21kworker/u8:3-nfsiod22:45:002
2408160992422,1cyclictest2614781-21grep21:45:001
2408160992421,2cyclictest547-21gdbus21:39:591
2408166992319,1cyclictest0-21swapper/300:00:003
2408162992218,2cyclictest0-21swapper/200:20:002
2408162992218,2cyclictest0-21swapper/200:20:002
2408160992219,2cyclictest2703670-21cron22:40:001
2408166992118,1cyclictest0-21swapper/319:50:003
2408166992118,1cyclictest0-21swapper/319:15:013
2408166992118,1cyclictest0-21swapper/300:20:003
2408166992118,1cyclictest0-21swapper/300:20:003
240816099217,13cyclictest0-21swapper/100:10:001
2408160992117,3cyclictest522-21in:imuxsock23:50:001
2408156992117,2cyclictest2527959-21gltestperf20:45:150
2408166992017,1cyclictest0-21swapper/322:35:003
2408166992017,1cyclictest0-21swapper/322:05:003
2408160992015,4cyclictest522-21in:imuxsock22:20:001
2408156992017,2cyclictest0-21swapper/000:35:010
2408156992016,3cyclictest750-21sshd19:10:210
2408156992016,3cyclictest2574223-21/usr/sbin/munin21:20:000
2408166991916,1cyclictest0-21swapper/320:20:013
2408160991916,2cyclictest2727928-21latency_hist22:55:011
2408160991916,2cyclictest0-21swapper/122:35:001
2408160991916,2cyclictest0-21swapper/100:35:011
2408160991915,3cyclictest761-21cups-browsed20:05:001
2408160991915,2cyclictest514-21systemd-logind00:24:081
2408160991915,2cyclictest514-21systemd-logind00:24:071
24165822180,1sleep00-21swapper/019:15:140
2408166991811,4cyclictest2502585-21chrt20:23:103
2408162991815,2cyclictest2752199-21latency_hist23:10:012
2408162991815,2cyclictest2471706-21cron20:00:002
2408162991814,2cyclictest2889468-21latency_hist00:35:012
240816099189,7cyclictest2865055-21apt00:20:001
240816099189,7cyclictest2865055-21apt00:20:001
2408160991815,2cyclictest500-21avahi-daemon20:40:011
2408160991815,2cyclictest2832956-21latency_hist00:00:001
2408160991815,2cyclictest2793135-21gltestperf23:35:181
2408160991814,3cyclictest2838624-21timerandwakeup00:00:251
2408160991814,2cyclictest0-21swapper/123:34:591
2408156991815,2cyclictest2873210-21latency_hist00:25:010
2408156991815,2cyclictest2873210-21latency_hist00:25:010
2408166991714,1cyclictest0-21swapper/322:55:153
2408166991714,1cyclictest0-21swapper/322:51:173
2408166991714,1cyclictest0-21swapper/322:15:233
2408166991714,1cyclictest0-21swapper/322:05:173
2408166991714,1cyclictest0-21swapper/321:35:213
2408166991714,1cyclictest0-21swapper/321:00:013
2408166991714,1cyclictest0-21swapper/300:35:213
2408166991714,1cyclictest0-21swapper/300:20:153
2408166991714,1cyclictest0-21swapper/300:20:153
2408162991715,1cyclictest2647055-21cron22:05:002
2408162991714,2cyclictest2857148-21latency_hist00:15:002
2408162991714,2cyclictest2765433-21ssh23:15:202
2408162991714,2cyclictest2545838-21sendmail21:00:012
2408162991714,2cyclictest2416924-21gltestperf19:15:172
2408162991714,2cyclictest0-21swapper/221:55:002
2408160991714,2cyclictest2574930-21gltestperf21:20:171
2408160991713,2cyclictest501-21dbus-daemon22:10:001
2408160991713,2cyclictest2897681-21ssh00:40:011
2408160991713,2cyclictest2502987-21/usr/sbin/munin20:25:171
2408160991713,2cyclictest2502987-21/usr/sbin/munin20:25:171
2408160991713,2cyclictest0-21swapper/122:29:591
2408160991712,3cyclictest2719823-21systemd22:50:011
2408156991714,2cyclictest508-21polkitd00:40:000
2408156991714,2cyclictest3818356-21systemd-journal00:09:590
2408156991714,2cyclictest2808596-21latency_hist23:45:000
2408156991714,2cyclictest2792445-21latency_hist23:35:000
2408156991714,2cyclictest2726775-21kworker/0:1+kacpi_notify00:12:070
2408156991714,2cyclictest2672061-21irqcore22:20:160
2408156991714,2cyclictest2672061-21irqcore22:20:150
2408156991714,2cyclictest2558088-21diskmemload21:45:190
2408156991714,2cyclictest2527549-21latency_hist20:45:010
2408156991714,2cyclictest0-21swapper/023:10:010
2408156991713,2cyclictest2468784-21kthreadcore19:55:160
2408156991712,4cyclictest2772087-21kthreadcore23:20:200
2408166991613,1cyclictest0-21swapper/323:18:213
2408166991613,1cyclictest0-21swapper/322:10:173
2408166991613,1cyclictest0-21swapper/321:45:253
2408166991613,1cyclictest0-21swapper/321:40:013
2408166991613,1cyclictest0-21swapper/321:25:203
2408166991613,1cyclictest0-21swapper/321:15:193
2408166991613,1cyclictest0-21swapper/319:15:013
2408166991613,1cyclictest0-21swapper/300:05:133
2408166991612,1cyclictest0-21swapper/322:30:003
2408166991612,1cyclictest0-21swapper/319:55:003
2408162991614,1cyclictest0-21swapper/200:05:002
2408162991613,2cyclictest2877403-21kthreadcore00:25:192
2408162991613,2cyclictest2753698-21ssh23:10:192
2408162991613,2cyclictest2536728-21kthreadcore20:50:212
2408162991613,2cyclictest2453305-21sh19:45:002
2408162991613,2cyclictest2446034-21latency19:35:212
2408162991613,2cyclictest0-21swapper/223:05:012
2408162991613,2cyclictest0-21swapper/219:25:012
2408162991613,2cyclictest0-21swapper/219:15:012
2408162991612,2cyclictest514-21systemd-logind23:25:012
2408160991613,2cyclictest2777133-21irqcore23:25:201
2408160991613,2cyclictest2773433-21latency23:20:211
2408160991613,2cyclictest2636705-21timerandwakeup21:55:241
2408160991613,2cyclictest0-21swapper/121:00:011
2408160991612,3cyclictest514-21systemd-logind22:15:001
240815699169,6cyclictest2603480-21kthreadcore21:35:220
2408156991614,1cyclictest0-21swapper/021:35:000
2408156991613,2cyclictest64450irq/159-eno2:rx-022:40:190
2408156991613,2cyclictest2558088-21diskmemload23:50:130
2408156991613,2cyclictest2557594-21unixbench-2d21:05:270
2408156991613,2cyclictest0-21swapper/023:40:000
2408166991513,1cyclictest0-21swapper/323:25:203
2408166991512,1cyclictest0-21swapper/323:45:193
2408166991512,1cyclictest0-21swapper/323:41:023
2408166991512,1cyclictest0-21swapper/323:30:263
2408166991512,1cyclictest0-21swapper/323:24:193
2408166991512,1cyclictest0-21swapper/323:11:093
2408166991512,1cyclictest0-21swapper/323:05:193
2408166991512,1cyclictest0-21swapper/323:00:173
2408166991512,1cyclictest0-21swapper/322:48:223
2408166991512,1cyclictest0-21swapper/322:23:073
2408166991512,1cyclictest0-21swapper/322:23:073
2408166991512,1cyclictest0-21swapper/321:50:193
2408166991512,1cyclictest0-21swapper/321:10:163
2408166991512,1cyclictest0-21swapper/320:55:003
2408166991512,1cyclictest0-21swapper/320:50:013
2408166991512,1cyclictest0-21swapper/320:35:173
2408166991512,1cyclictest0-21swapper/320:10:003
2408166991512,1cyclictest0-21swapper/319:35:013
2408166991512,1cyclictest0-21swapper/319:25:223
2408166991512,1cyclictest0-21swapper/319:25:013
2408166991512,1cyclictest0-21swapper/300:30:213
2408162991512,2cyclictest508-21polkitd22:50:242
2408162991512,2cyclictest2822100-21ntp_kernel_pll_23:50:202
2408162991512,2cyclictest2814006-21needreboot23:45:252
2408162991512,2cyclictest2733852-21unixbench_singl22:55:262
2408162991512,2cyclictest2672656-21irqrtprio22:20:172
2408162991512,2cyclictest2672656-21irqrtprio22:20:172
2408162991512,2cyclictest2553624-21kthreadcore21:05:202
2408162991512,2cyclictest2496565-21cron20:20:002
2408162991511,3cyclictest2579541-21needreboot21:20:222
2408162991511,3cyclictest0-21swapper/222:35:012
2408162991511,2cyclictest0-21swapper/221:15:012
2408162991511,2cyclictest0-21swapper/200:39:592
2408162991510,4cyclictest2636402-21ntpq21:55:212
2408160991512,2cyclictest2745807-21kthreadcore23:05:181
2408160991512,2cyclictest2590460-21latency_hist21:30:011
2408160991512,2cyclictest2567066-21irqcore21:15:191
2408160991512,2cyclictest2465565-21sh19:54:591
2408160991512,2cyclictest2441514-21cut19:35:171
2408160991511,3cyclictest2764631-21kthreadcore23:15:191
2408160991511,2cyclictest2677144-21unixbench_multi22:20:251
2408160991511,2cyclictest2677144-21unixbench_multi22:20:251
240815699159,5cyclictest501-21dbus-daemon22:55:010
240815699159,4cyclictest501-21dbus-daemon22:00:000
240815699155,3cyclictest0-21swapper/019:53:570
2408156991512,2cyclictest2858307-21sed00:15:190
2408156991512,2cyclictest2858307-21sed00:15:180
2408156991512,2cyclictest2838153-21latency00:00:200
2408156991512,2cyclictest2741802-21unixbench_multi23:00:230
2408156991512,2cyclictest2733227-21needreboot22:55:210
2408156991512,2cyclictest2712622-21irqcore22:45:160
2408156991512,2cyclictest2546314-21fschecks_count21:00:180
2408156991512,2cyclictest2450353-21kthreadcore19:40:190
2408166991411,1cyclictest0-21swapper/323:50:163
2408166991411,1cyclictest0-21swapper/323:35:213
2408166991411,1cyclictest0-21swapper/322:40:053
2408166991411,1cyclictest0-21swapper/322:35:273
2408166991411,1cyclictest0-21swapper/321:33:463
2408166991411,1cyclictest0-21swapper/321:22:583
2408166991411,1cyclictest0-21swapper/320:00:133
2408166991411,1cyclictest0-21swapper/319:35:213
2408166991411,1cyclictest0-21swapper/300:10:143
2408166991411,1cyclictest0-21swapper/300:00:163
240816299149,3cyclictest3818356-21systemd-journal19:49:552
240816299148,5cyclictest2435120-21apt-get19:30:152
2408162991411,2cyclictest2518257-21kthreadcore20:35:182
2408162991410,3cyclictest2715141-21kthreadcore22:45:172
2408162991410,3cyclictest2588181-21unixbench_singl21:25:262
240816099147,5cyclictest3818356-21systemd-journal21:50:001
2408160991411,2cyclictest2850263-21sed00:10:181
2408160991411,2cyclictest2630937-21/usr/sbin/munin21:55:001
2408160991411,2cyclictest2561455-21kthreadcore21:10:201
2408160991411,2cyclictest2496089-21unixbench-2d20:15:271
2408160991411,2cyclictest2453903-21gltestperf19:45:181
2408160991411,2cyclictest0-21swapper/123:50:231
2408160991410,3cyclictest2753563-21irqrtprio23:10:191
2408160991410,3cyclictest2704933-21irqcore22:40:171
2408160991410,2cyclictest0-21swapper/122:05:001
240816099140,13cyclictest0-21swapper/121:00:161
240815699149,3cyclictest3818356-21systemd-journal20:32:250
240815699144,6cyclictest231rcuc/000:25:180
240815699144,3cyclictest0-21swapper/023:18:230
240815699143,3cyclictest16-21ksoftirqd/021:30:000
240815699143,2cyclictest25385602cat20:50:230
2408156991411,2cyclictest2757409-21needreboot23:10:220
2408156991411,2cyclictest2697439-21kthreadcore22:35:200
2408156991411,2cyclictest2640762-21kthreadcore22:00:180
2408156991411,2cyclictest2558957-21irqcore21:10:170
2408156991411,2cyclictest2490916-21fschecks_count20:15:170
2408156991411,2cyclictest2477906-21sh20:05:000
2408156991411,2cyclictest0-21swapper/000:00:000
2408156991410,3cyclictest2648831-21kthreadcore22:05:180
2408156991410,2cyclictest0-21swapper/023:25:220
2408166991310,1cyclictest0-21swapper/321:05:183
2408166991310,1cyclictest0-21swapper/321:00:203
2408166991310,1cyclictest0-21swapper/320:40:173
2408166991310,1cyclictest0-21swapper/320:25:243
2408166991310,1cyclictest0-21swapper/320:25:243
240816299139,3cyclictest1-21systemd20:27:512
240816299139,3cyclictest1-21systemd20:27:512
240816299138,4cyclictest2434775-21sshd19:29:202
240816299134,3cyclictest2490174-21dpkg20:15:002
2408162991311,1cyclictest0-21swapper/221:15:172
2408162991310,2cyclictest2841719-21sed00:05:142
2408162991310,2cyclictest2806331-21unixbench-2d23:40:212
2408162991310,2cyclictest2784608-21kworker/u8:1-xprtiod23:35:272
2408162991310,2cyclictest2699355-21kthreadcore22:35:212
2408162991310,2cyclictest2685570-21runrttasks22:26:082
2408162991310,2cyclictest2611318-21kthreadcore21:40:202
2408162991310,2cyclictest2600126-21kernelversion21:35:202
2408162991310,2cyclictest2526444-21ntp_kernel_err20:40:202
2408162991310,2cyclictest0-21swapper/223:30:172
2408162991310,2cyclictest0-21swapper/221:30:162
2408162991310,2cyclictest0-21swapper/220:20:172
240816099137,4cyclictest2873449-21apt-get00:25:121
240816099137,4cyclictest2433187-21tr19:25:211
2408160991311,1cyclictest0-21swapper/119:44:591
2408160991310,2cyclictest2732708-21kthreadcore22:55:201
2408160991310,2cyclictest2536723-21kthreadcore20:50:231
2408160991310,2cyclictest2523908-21kthreadcore20:40:161
2408160991310,2cyclictest2467192-21kernelversion19:55:151
2408160991310,2cyclictest2435958-21irqcore19:30:191
240816099130,4cyclictest2479555-21cat20:05:171
240815699139,2cyclictest0-21swapper/019:30:010
240815699138,4cyclictest749-21lldpd22:10:180
240815699138,3cyclictest2484760-21irqcore20:10:170
240815699136,5cyclictest231rcuc/020:35:170
240815699134,7cyclictest2612236-21cut21:40:240
2408156991311,1cyclictest2687523-21latency_hist22:30:010
2408156991311,1cyclictest1952031-21kworker/0:0+kacpid19:23:440
2408156991311,1cyclictest0-21swapper/020:25:000
2408156991310,2cyclictest2581820-21kworker/0:2+kacpi_notify21:54:200
2408156991310,2cyclictest2441536-21gltestperf19:35:170
2408156991310,2cyclictest0-21swapper/020:55:240
2408156991310,2cyclictest0-21swapper/020:10:010
240815699130,3cyclictest2581820-21kworker/0:2+events22:35:000
240816699129,1cyclictest0-21swapper/321:55:173
240816699129,1cyclictest0-21swapper/320:30:203
240816699129,1cyclictest0-21swapper/319:55:183
240816699129,1cyclictest0-21swapper/319:40:163
240816699129,1cyclictest0-21swapper/300:25:193
2408166991210,1cyclictest0-21swapper/320:10:173
240816299129,2cyclictest0-21swapper/221:45:162
240816299128,2cyclictest0-21swapper/223:25:172
240816299127,3cyclictest2648208-21irqcore22:05:172
240816099129,2cyclictest2592017-21kthreadcore21:30:191
240816099129,2cyclictest2414548-21head19:15:011
240816099128,3cyclictest3004-21cron19:25:011
240816099127,4cyclictest2514902-21sshd20:33:261
240816099127,4cyclictest2500569-21tr20:20:201
240816099126,4cyclictest501-21dbus-daemon20:15:001
240816099125,5cyclictest2408372-21apt-get19:10:141
2408160991210,1cyclictest0-21swapper/123:00:201
240816099120,11cyclictest0-21swapper/123:42:541
240815699129,2cyclictest311-21jbd2/sda2-823:45:220
240815699129,2cyclictest0-21swapper/020:25:210
240815699129,2cyclictest0-21swapper/020:25:200
2408156991210,1cyclictest0-21swapper/019:35:000
24022102123,4sleep30-21swapper/319:05:113
240816299119,1cyclictest0-21swapper/222:15:162
240816299118,2cyclictest2509497-21gltestperf20:30:172
240816299118,2cyclictest2478282-21cpuspeed_turbos20:05:142
240816299118,2cyclictest2472326-21gltestperf20:00:142
240816299118,2cyclictest0-21swapper/221:00:202
240816299118,2cyclictest0-21swapper/200:20:172
240816299118,2cyclictest0-21swapper/200:20:172
240816299116,4cyclictest2656367-21sed22:10:162
240816299116,4cyclictest2459974-21perl19:50:152
240816299115,4cyclictest2527777-21df20:45:132
240816099119,1cyclictest2555323-21kthreadcore21:05:211
240816099118,2cyclictest0-21swapper/120:45:241
240815699118,2cyclictest231rcuc/021:20:190
240816299108,1cyclictest0-21swapper/219:10:012
240815699107,2cyclictest171ktimers/019:45:150
24081609985,1cyclictest0-21swapper/119:10:011
2402247270,4sleep02402399-21df_inode19:05:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional