You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 17:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Tue Dec 02, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
281965699443,26cyclictest2980875-21sendmail-msp11:54:240
281965699413,3cyclictest0-21swapper/009:33:140
2819656994118,3cyclictest0-21swapper/009:58:410
2819656993734,2cyclictest0-21swapper/011:11:070
281965799365,11cyclictest2974645-21ssh11:38:101
281965799344,9cyclictest2964004-21apt-get11:26:091
281965799336,19cyclictest2955915-21ssh11:16:081
281965799332,10cyclictest2997384-21sendmail-msp12:13:141
2819657993317,3cyclictest2998811-21cut12:08:121
2819660993226,3cyclictest2880331-21cut09:43:052
281965799324,8cyclictest2841728-21latency_hist08:21:071
281965799323,2cyclictest2898720-21sendmail-msp10:13:151
281965699321,30cyclictest0-21swapper/010:38:100
2819657993112,17cyclictest0-21swapper/108:03:101
281965699314,23cyclictest0-21swapper/010:03:110
2819656993123,7cyclictest2970591-21ssh11:33:120
281965699311,3cyclictest2977927-21/usr/sbin/munin11:43:130
281965699311,22cyclictest0-21swapper/012:13:180
281965799302,9cyclictest2868955-21aten_r2power_fr09:28:031
281965799301,12cyclictest2822967-21sendmail-msp07:28:091
281965699305,23cyclictest0-21swapper/009:46:080
2819660992925,3cyclictest2819655-21cyclictest11:23:072
2819657992915,7cyclictest2984870-21munin-run11:51:081
2819656992917,8cyclictest0-21swapper/007:38:160
2819656992914,5cyclictest0-21swapper/010:41:100
2819656992914,5cyclictest0-21swapper/010:41:100
2819660992818,6cyclictest2947920-21sendmail-msp11:06:162
281965799283,6cyclictest2819658-21/usr/sbin/munin07:16:061
281965799283,5cyclictest2873369-21/usr/sbin/munin09:33:141
281965799283,11cyclictest2989240-21ssh11:55:511
281965799282,11cyclictest2865799-21ssh09:23:061
2819657992813,5cyclictest2856569-21basename09:06:071
281965799281,11cyclictest2927334-21gpg-connect-age10:41:071
2819656992825,2cyclictest2866493-21sed09:23:140
2819656992815,2cyclictest0-21swapper/010:58:110
281965699281,25cyclictest0-21swapper/011:23:450
281965799278,5cyclictest11050irq/107-eth%d09:58:091
281965799274,6cyclictest2828460-21/usr/sbin/munin07:43:011
281966099262,7cyclictest11050irq/107-eth%d10:23:102
281966099262,3cyclictest11050irq/107-eth%d11:48:032
281966099261,21cyclictest2892493-21ssh09:58:092
281965799269,1cyclictest0-21swapper/110:26:091
281965799264,15cyclictest11050irq/107-eth%d10:41:101
281965799264,15cyclictest11050irq/107-eth%d10:41:101
281965699264,5cyclictest11050irq/107-eth%d09:28:110
281965699260,22cyclictest0-21swapper/011:18:140
281966099253,3cyclictest11050irq/107-eth%d09:16:092
2819660992521,3cyclictest0-21swapper/210:26:122
281965699252,4cyclictest0-21swapper/012:03:150
281965699251,21cyclictest2862026-21proc_pri09:18:200
2819660992418,4cyclictest2908449-21grep10:18:092
281965799243,8cyclictest3024747-21ssh12:38:121
2819657992419,3cyclictest1007-21mta-sts-daemon11:33:121
2819656992421,2cyclictest2877562-21grep09:38:180
2819656992421,1cyclictest0-21swapper/009:16:080
2819656992420,3cyclictest0-21swapper/009:53:030
281965699241,18cyclictest2984959-21apt-config11:51:080
281965699234,14cyclictest111788-21systemd-journal10:26:120
281965699231,2cyclictest0-21swapper/012:18:080
281965699231,16cyclictest2933622-21/usr/sbin/munin10:48:100
281966099224,16cyclictest1008-21mta-sts-daemon10:43:092
281966099224,16cyclictest1008-21mta-sts-daemon10:43:092
281966099224,11cyclictest2964037-21sendmail-msp11:26:102
281965799227,4cyclictest11050irq/107-eth%d10:08:051
281965799225,6cyclictest3015043-21/usr/sbin/munin12:28:041
281965699228,2cyclictest0-21swapper/012:41:100
2819656992217,4cyclictest2855573-21gltestperf09:03:050
281966099216,10cyclictest3018268-21latency_hist12:31:072
281966099214,12cyclictest2997384-21sendmail-msp12:08:162
281965799216,12cyclictest2877079-21ssh09:38:121
281965799215,13cyclictest2859871-21diskmemload11:56:231
281965799212,11cyclictest3008944-21ssh12:20:451
2819657992114,2cyclictest0-21swapper/109:53:061
281965699213,18cyclictest0-21swapper/012:28:040
2819656992119,1cyclictest2939640-21ssh10:56:080
281965699211,19cyclictest0-21swapper/010:24:540
281965699211,16cyclictest0-21swapper/011:38:070
281966099204,14cyclictest3024745-21ntpq12:38:122
281966099203,12cyclictest2868951-21aten_r2power_fr09:28:032
2819660992011,8cyclictest2859871-21diskmemload11:13:122
281965799204,13cyclictest2920225-21/usr/sbin/munin10:33:021
2819657992018,1cyclictest0-21swapper/107:53:021
281965699203,1cyclictest0-21swapper/010:08:040
2819656992018,1cyclictest2847361-21gltestperf08:38:130
2819656992012,5cyclictest11650irq/162-mmc012:08:160
281966199192,9cyclictest0-21swapper/310:48:113
281966099194,13cyclictest2887977-21ssh09:53:072
281966099193,15cyclictest2941715-21/usr/sbin/munin10:58:112
281966099193,12cyclictest2836487-21true08:06:072
2819657991914,4cyclictest2819655-21cyclictest11:11:071
2819657991914,4cyclictest0-21swapper/110:03:091
2819657991912,6cyclictest2945281-21fschecks_time11:03:071
2819656991914,4cyclictest0-21swapper/011:58:430
2819656991913,5cyclictest2831261-21xargs07:48:170
281965699191,13cyclictest2832672-21sshd07:53:080
281965699190,19cyclictest0-21swapper/012:23:060
281966099185,10cyclictest2900081-21ssh10:08:052
281966099184,12cyclictest1005-21mta-sts-daemon12:41:092
281966099182,12cyclictest2933639-21netstat10:48:102
2819660991810,7cyclictest1125-21rtkit-daemon11:36:192
281965799187,8cyclictest3010837-21grep12:23:061
281965699185,12cyclictest0-21swapper/011:08:050
2819656991811,2cyclictest2966960-21grep11:28:140
281966199170,10cyclictest0-21swapper/310:03:053
281966099176,8cyclictest2997384-21sendmail-msp12:13:142
281966099176,7cyclictest0-21swapper/209:23:092
281966099173,11cyclictest2826797-21tune2fs07:38:072
281966099172,9cyclictest2834959-21cat08:01:072
281966099172,14cyclictest2840340-21cut08:18:062
281966099172,12cyclictest2884611-21ssh09:48:112
2819660991713,2cyclictest0-21swapper/208:21:092
2819660991710,5cyclictest111788-21systemd-journal11:53:202
281965799174,11cyclictest0-21swapper/109:48:111
281965799173,9cyclictest2849990-21munin-run08:46:071
281965799173,9cyclictest2849990-21munin-run08:46:071
2819657991711,2cyclictest0-21swapper/109:08:111
281965699179,6cyclictest4175464-1kworker/0:2H+kblockd10:13:240
2819656991716,1cyclictest0-21swapper/008:06:080
2819656991713,2cyclictest0-21swapper/008:33:100
2819656991712,4cyclictest2839691-21grep08:13:170
281966199163,8cyclictest0-21swapper/309:33:143
281966199163,7cyclictest0-21swapper/309:58:093
281966199163,5cyclictest0-21swapper/311:26:073
281966199163,5cyclictest0-21swapper/309:13:113
281966099169,5cyclictest0-21swapper/207:18:162
281966099167,6cyclictest3007309-21rm12:18:132
281966099163,11cyclictest2829133-21/usr/sbin/munin07:43:062
281966099162,9cyclictest2989772-21sh11:56:232
281966099162,11cyclictest2914740-21sendmail-msp10:33:092
281966099162,10cyclictest2925599-21/usr/sbin/munin10:38:162
281966099161,10cyclictest2819668-21munin-run07:16:072
281965799167,5cyclictest0-21swapper/109:18:201
281965799166,6cyclictest0-21swapper/112:03:001
281965799165,9cyclictest2853559-21/usr/sbin/munin08:58:051
281965799165,8cyclictest2859242-21/usr/sbin/munin09:13:101
281965799162,9cyclictest2978636-21ssh11:43:101
281965799162,9cyclictest2914753-21ssh10:26:071
281965799162,10cyclictest2845680-21fschecks_time08:33:061
281965799161,8cyclictest2834960-21grep08:01:071
2819657991613,2cyclictest0-21swapper/110:18:111
2819657991612,3cyclictest2825203-21fschecks_time07:33:211
281965699167,3cyclictest2908763-21/usr/sbin/munin10:18:110
2819656991615,1cyclictest0-21swapper/012:33:080
281965699161,2cyclictest3025195-21/usr/sbin/munin12:38:180
281965699160,9cyclictest2857682-21ntpq09:08:110
281965699160,8cyclictest0-21swapper/009:43:140
281966199153,6cyclictest0-21swapper/308:53:103
281966099155,6cyclictest2970650-21ntpq11:33:132
281966099153,7cyclictest2994665-21ssh12:03:002
281966099152,8cyclictest3011442-21ld12:23:122
281966099151,7cyclictest111788-21systemd-journal08:08:122
281966099151,4cyclictest2831531-21apt07:51:072
281966099151,11cyclictest2904197-21aten_r2power_vo10:13:042
2819660991510,5cyclictest2832596-21ntp_kernel_pll_07:53:072
2819660991510,3cyclictest0-21swapper/208:33:032
281965799153,9cyclictest2961412-21grep11:23:071
281965799152,9cyclictest2837197-21/usr/sbin/munin08:08:091
281965799152,11cyclictest3028796-21cut12:43:031
281965799152,11cyclictest2936960-21aten_r2power_po10:53:031
281965799151,12cyclictest3020886-21users12:33:161
281965799151,11cyclictest2847609-21cat08:38:141
2819657991510,4cyclictest2826950-21gltestperf07:38:071
281965699159,3cyclictest0-21swapper/007:23:080
281965699151,9cyclictest2947895-21munin-run11:06:070
281965699151,3cyclictest2838119-21apt08:11:070
281965699150,2cyclictest2920956-21ntpq10:33:090
112699150,1rtkit-daemon0-21swapper/007:44:000
281966199146,6cyclictest0-21swapper/310:26:123
281966199143,7cyclictest0-21swapper/310:26:073
281966199143,6cyclictest0-21swapper/312:38:123
281966199143,6cyclictest0-21swapper/308:03:063
281966199143,5cyclictest0-21swapper/307:38:113
281966199143,4cyclictest0-21swapper/311:51:103
281966199142,5cyclictest0-21swapper/308:33:023
281966199140,8cyclictest0-21swapper/312:43:063
281966199140,7cyclictest0-21swapper/311:51:083
281966099149,4cyclictest2945245-21fschecks_time11:03:072
281966099146,4cyclictest3020510-21/usr/sbin/munin12:33:142
281966099143,8cyclictest2896057-21grep10:03:052
281966099143,7cyclictest2855179-21/usr/sbin/munin09:03:032
281966099142,7cyclictest2867868-21sendmail-msp09:33:102
281966099141,8cyclictest11050irq/107-eth%d11:16:082
281965799144,7cyclictest2839636-21sed08:13:171
281965799142,8cyclictest2823064-21grep07:26:081
281965799142,7cyclictest762-21in:imuxsock11:08:111
281965799141,8cyclictest2820651-21netstat07:18:071
281965799141,11cyclictest2880348-21tune2fs09:43:051
281965799141,10cyclictest2842351-21grep08:23:041
281965699147,5cyclictest2819655-21cyclictest07:16:060
281965699146,5cyclictest11050irq/107-eth%d08:21:070
281965699143,9cyclictest2843435-21sendmail-msp08:28:090
281965699142,9cyclictest2854794-21sed08:58:180
281965699141,12cyclictest2823522-21cut07:28:050
281966199137,4cyclictest0-21swapper/311:46:073
281966199135,4cyclictest0-21swapper/311:13:153
281966199134,4cyclictest0-21swapper/308:38:163
281966199133,6cyclictest0-21swapper/310:58:103
281966199133,5cyclictest0-21swapper/308:08:123
281966199133,4cyclictest0-21swapper/310:53:103
281966199133,4cyclictest0-21swapper/309:28:033
281966199132,6cyclictest0-21swapper/312:33:133
281966199132,6cyclictest0-21swapper/312:28:133
281966199132,6cyclictest0-21swapper/309:03:093
281966199132,5cyclictest0-21swapper/311:38:113
281966199132,4cyclictest0-21swapper/312:01:253
281966099139,2cyclictest0-21swapper/209:13:102
281966099136,5cyclictest0-21swapper/208:13:102
281966099134,5cyclictest607-21dbus-daemon07:36:062
281966099133,6cyclictest607-21dbus-daemon09:01:072
281966099132,9cyclictest2824596-21idleruntime-cro07:31:072
281966099132,8cyclictest2978637-21/usr/sbin/munin11:43:102
281966099132,8cyclictest2848829-21/usr/sbin/munin08:43:052
281966099132,8cyclictest2848829-21/usr/sbin/munin08:43:052
281966099132,7cyclictest2852693-21sshd08:53:102
281966099130,10cyclictest2850015-21sendmail-msp08:48:172
281966099130,10cyclictest111788-21systemd-journal10:55:212
281965799137,3cyclictest259-21jbd2/mmcblk0p2-810:48:151
281965799135,4cyclictest2844711-21/usr/sbin/munin08:28:171
281965799134,7cyclictest2940864-21aten_r2power_fr10:58:041
281965799132,8cyclictest2831424-21grep07:48:171
281965699133,7cyclictest2822967-21sendmail-msp07:33:270
281965699133,5cyclictest2848878-21/usr/sbin/munin08:43:060
281965699133,5cyclictest2848878-21/usr/sbin/munin08:43:060
2819656991311,1cyclictest0-21swapper/008:23:030
281965699130,8cyclictest0-21swapper/008:48:140
281966199124,4cyclictest0-21swapper/309:38:073
281966199124,3cyclictest0-21swapper/310:41:093
281966199124,3cyclictest0-21swapper/310:41:093
281966199123,4cyclictest0-21swapper/308:48:103
281966199122,6cyclictest0-21swapper/312:08:163
281966199122,6cyclictest0-21swapper/310:13:103
281966199122,6cyclictest0-21swapper/307:53:043
281966199122,6cyclictest0-21swapper/307:33:213
281966199122,5cyclictest0-21swapper/312:13:143
281966199122,5cyclictest0-21swapper/309:23:053
281966199121,7cyclictest0-21swapper/312:23:083
281966199121,6cyclictest0-21swapper/311:03:113
281966199121,6cyclictest0-21swapper/307:28:023
281966099129,2cyclictest0-21swapper/208:38:122
281966099126,5cyclictest2878964-21cron09:41:072
281966099122,8cyclictest2856893-21aten_r2power_en09:08:032
281966099122,7cyclictest2821518-21/usr/sbin/munin07:23:062
281965799123,6cyclictest2850482-21/usr/sbin/munin08:48:091
281965799122,7cyclictest2852803-21/usr/sbin/munin08:53:131
281965699122,9cyclictest2851872-21munin-node08:53:020
281965699122,8cyclictest2834834-21munin-run08:01:070
281965699121,4cyclictest2820015-21aten_r2power_po07:18:020
281966199114,4cyclictest0-21swapper/310:18:183
281966199113,5cyclictest0-21swapper/311:26:093
281966199113,5cyclictest0-21swapper/307:18:133
281966199113,4cyclictest0-21swapper/310:08:133
281966199112,6cyclictest0-21swapper/308:21:093
281966199111,6cyclictest0-21swapper/312:18:073
281966199111,6cyclictest0-21swapper/309:53:023
281966199111,5cyclictest0-21swapper/308:58:113
281966199111,5cyclictest0-21swapper/307:23:083
281966199110,6cyclictest0-21swapper/308:13:073
281966099111,8cyclictest111788-21systemd-journal08:28:092
281966199106,2cyclictest0-21swapper/311:58:103
281966199104,3cyclictest0-21swapper/309:43:043
281966199103,4cyclictest0-21swapper/311:33:073
281966199103,4cyclictest0-21swapper/309:18:173
281966199103,4cyclictest0-21swapper/309:08:033
281966199103,4cyclictest0-21swapper/307:41:133
281966199102,5cyclictest0-21swapper/308:18:093
281966199102,3cyclictest0-21swapper/308:43:033
281966199102,3cyclictest0-21swapper/308:43:033
281966199101,6cyclictest0-21swapper/308:28:073
281966199101,5cyclictest0-21swapper/309:48:073
281966199100,5cyclictest0-21swapper/307:58:143
28196619992,5cyclictest0-21swapper/311:08:103
28196619992,4cyclictest0-21swapper/307:48:083
28196619991,6cyclictest0-21swapper/311:16:083
28196619990,5cyclictest0-21swapper/310:33:053
28196619981,5cyclictest0-21swapper/310:37:083
28196619981,4cyclictest431ktimers/307:16:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional