You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-17 - 11:28
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8.osadl.org (updated Fri Oct 17, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9288902330,1chrt231rcuc/023:45:190
5947412330,1sleep0594747-21cut19:50:160
545159992825,2cyclictest949161-21systemd23:59:591
545154992622,3cyclictest761-21cups-browsed00:40:010
545163992522,2cyclictest0-21swapper/221:39:592
545163992421,2cyclictest501-21dbus-daemon20:50:012
545154992419,4cyclictest522-21in:imuxsock23:35:000
545159992218,3cyclictest588288-21ps19:45:211
545159992218,3cyclictest3004-21cron00:15:001
545163992018,1cyclictest754756-21cron22:00:002
545163992017,2cyclictest812279-21gltestperf22:35:162
545163992017,2cyclictest500-21avahi-daemon20:00:012
545159992017,2cyclictest892567-21latency_hist23:25:001
545165991916,1cyclictest0-21swapper/320:25:013
545165991916,1cyclictest0-21swapper/319:50:133
545165991914,3cyclictest659490-21sleep20:45:003
545163991916,2cyclictest1007355-21grep00:35:212
545163991916,2cyclictest0-21swapper/222:40:222
545159991916,2cyclictest735904-21munin-plugin-st21:45:001
545154991916,2cyclictest819768-21apt-key22:40:010
545154991916,2cyclictest635537-21irqcore20:25:180
545165991815,1cyclictest0-21swapper/322:40:003
545165991815,1cyclictest0-21swapper/322:35:013
545165991815,1cyclictest0-21swapper/322:15:263
545163991816,1cyclictest811272-21cron22:35:012
54516399181,5cyclictest0-21swapper/200:00:182
545163991815,2cyclictest744527-21unixbench_singl21:50:202
545163991815,2cyclictest744-21snmpd22:05:252
545163991815,2cyclictest522-21in:imuxsock19:45:002
545163991814,3cyclictest597348-21cron19:54:592
54516399181,14cyclictest699142-21cpuspeed_turbos21:15:172
545159991816,1cyclictest1005756-21munin-run00:35:001
545159991815,2cyclictest794265-21sshd22:23:101
545159991815,2cyclictest723122-21kthreadcore21:35:141
545159991815,2cyclictest0-21swapper/120:20:001
545159991815,2cyclictest0-21swapper/120:04:591
545154991815,2cyclictest989562-21idleruntime-cro00:24:590
545154991815,2cyclictest719799-21sh21:35:000
545154991815,2cyclictest628632-21cron20:20:000
545154991815,2cyclictest591365-21latency_hist19:50:010
545154991814,2cyclictest809201-21unixbench_singl22:30:290
545154991812,4cyclictest725636-21unixbench_multi21:35:210
545165991714,1cyclictest0-21swapper/323:20:003
545165991714,1cyclictest0-21swapper/321:55:143
545165991714,1cyclictest0-21swapper/321:45:003
545165991714,1cyclictest0-21swapper/321:15:003
545165991714,1cyclictest0-21swapper/300:20:203
54516399172,8cyclictest795154-21munin-run22:25:002
54516399172,8cyclictest591210-21munin-run19:50:002
545163991714,2cyclictest0-21swapper/220:30:012
545163991714,2cyclictest0-21swapper/200:35:012
545163991713,3cyclictest866086-21unixbench-2d23:05:272
545159991714,2cyclictest900644-21munin-plugin-st23:30:001
545159991714,2cyclictest853036-21irqcore23:00:171
545159991714,2cyclictest615827-21apt-get20:10:001
545159991714,2cyclictest0-21swapper/120:40:011
54515999170,15cyclictest501-21dbus-daemon20:00:001
545154991714,2cyclictest603505-21sendmail20:00:000
545154991714,2cyclictest559257-21needreboot19:20:160
545154991714,2cyclictest0-21swapper/022:50:010
545154991713,3cyclictest914696-21grep23:35:250
545165991613,1cyclictest0-21swapper/323:57:383
545165991613,1cyclictest0-21swapper/323:40:013
545163991613,2cyclictest933569-21gltestperf23:50:162
545163991613,2cyclictest906096-21proc_pri23:30:222
545163991613,2cyclictest738473-21ssh21:50:002
54515999166,2cyclictest0-21swapper/123:45:191
545159991613,2cyclictest963188-21unixbench_multi00:05:271
545159991613,2cyclictest949724-21fschecks_time00:00:151
545159991613,2cyclictest902287-21irqrtprio23:30:171
545159991613,2cyclictest816970-21netstat22:35:211
545159991613,2cyclictest803959-21gltestperf22:30:191
545159991613,2cyclictest747557-21irqcore21:55:161
545159991613,2cyclictest684760-21cpuspeed_turbos21:05:171
545159991613,2cyclictest678796-21gltestperf21:00:151
545159991613,2cyclictest3818356-21systemd-journal19:44:591
545159991613,2cyclictest0-21swapper/121:50:011
545159991613,2cyclictest0-21swapper/119:54:591
54515999161,2cyclictest699017-21apt-get21:15:151
545159991612,3cyclictest938813-21unixbench_multi23:50:251
545159991612,2cyclictest545648-21gltestperf19:10:161
54515999161,12cyclictest860586-21apt-get23:05:141
545154991613,2cyclictest788755-21irqrtprio22:20:180
545154991613,2cyclictest650370-21kthreadcore20:35:240
545154991613,2cyclictest1-21systemd21:20:000
545154991612,3cyclictest2962703-21kworker/u8:3-ext4-rsv-conversion22:45:000
545154991612,2cyclictest0-21swapper/021:10:140
545154991610,5cyclictest2962703-21kworker/u8:3-ext4-rsv-conversion00:00:120
545154991610,5cyclictest0-21swapper/023:10:160
545165991513,1cyclictest0-21swapper/323:24:593
545165991512,1cyclictest0-21swapper/323:30:163
545165991512,1cyclictest0-21swapper/323:25:233
545165991512,1cyclictest0-21swapper/322:45:253
545165991512,1cyclictest0-21swapper/322:40:143
545165991512,1cyclictest0-21swapper/322:20:203
545165991512,1cyclictest0-21swapper/322:10:193
545165991512,1cyclictest0-21swapper/322:10:193
545165991512,1cyclictest0-21swapper/321:54:393
545165991512,1cyclictest0-21swapper/321:48:423
545165991512,1cyclictest0-21swapper/320:15:193
545165991512,1cyclictest0-21swapper/319:45:183
545165991512,1cyclictest0-21swapper/319:36:153
545165991512,1cyclictest0-21swapper/319:15:013
545165991512,1cyclictest0-21swapper/300:28:313
54516599150,11cyclictest706708-21turbostat21:20:013
54516399153,3cyclictest769-21runrttasks22:25:202
545163991512,2cyclictest755450-21gltestperf22:00:172
545163991512,2cyclictest712667-21kthreadcore21:25:132
545163991512,2cyclictest670518-21kthreadcore20:50:222
545163991512,2cyclictest653302-21idleruntime-cro20:40:012
545163991512,2cyclictest622504-21gpgconf20:15:012
545163991512,2cyclictest622504-21gpgconf20:15:002
545163991512,2cyclictest0-21swapper/223:05:002
545163991512,2cyclictest0-21swapper/200:00:002
545163991511,3cyclictest957957-21gltestperf00:05:172
545159991513,1cyclictest830720-21kthreadcore22:45:191
545159991513,1cyclictest0-21swapper/123:10:131
545159991512,2cyclictest987484-21unixbench_singl00:20:301
545159991512,2cyclictest881734-21needreboot23:15:221
545159991512,2cyclictest743939-21needreboot21:50:161
545159991512,2cyclictest710255-21irqcore21:25:111
545159991512,2cyclictest660211-21sed20:45:161
545159991512,2cyclictest622615-21latency_hist20:15:011
545159991512,2cyclictest622615-21latency_hist20:15:011
545159991511,3cyclictest995502-21unixbench_multi00:25:281
545159991511,3cyclictest768693-21unixbench-2d22:05:271
545159991511,2cyclictest973877-21grep00:15:141
54515499152,3cyclictest795475-21apt-get22:25:130
545154991513,1cyclictest640649-21kworker/0:1+kacpid20:50:200
545154991512,2cyclictest946892-21unixbench-2d23:55:260
545154991512,2cyclictest754773-21sh22:00:000
545154991512,2cyclictest690501-21diskmemload23:05:510
545154991512,2cyclictest565246-21latency19:25:210
545154991511,3cyclictest690494-21cron21:10:000
545154991511,3cyclictest551548-21fschecks_time19:15:020
545154991511,3cyclictest522-21in:imuxsock00:30:010
545154991511,2cyclictest981469-21turbostat00:20:000
545154991511,2cyclictest0-21swapper/000:10:260
545154991511,1cyclictest0-21swapper/022:15:240
545165991412,1cyclictest0-21swapper/323:43:143
545165991412,1cyclictest0-21swapper/319:25:253
545165991411,1cyclictest0-21swapper/323:50:493
545165991411,1cyclictest0-21swapper/323:45:223
545165991411,1cyclictest0-21swapper/323:10:153
545165991411,1cyclictest0-21swapper/323:05:163
545165991411,1cyclictest0-21swapper/323:00:283
545165991411,1cyclictest0-21swapper/322:55:023
545165991411,1cyclictest0-21swapper/322:50:283
545165991411,1cyclictest0-21swapper/322:25:153
545165991411,1cyclictest0-21swapper/322:05:253
545165991411,1cyclictest0-21swapper/321:30:123
545165991411,1cyclictest0-21swapper/321:25:083
545165991411,1cyclictest0-21swapper/321:05:163
545165991411,1cyclictest0-21swapper/321:01:183
545165991411,1cyclictest0-21swapper/320:55:143
545165991411,1cyclictest0-21swapper/320:50:313
545165991411,1cyclictest0-21swapper/320:30:233
545165991411,1cyclictest0-21swapper/320:10:203
545165991411,1cyclictest0-21swapper/320:10:193
545165991411,1cyclictest0-21swapper/320:05:133
545165991411,1cyclictest0-21swapper/320:02:433
545165991411,1cyclictest0-21swapper/319:17:223
545165991411,1cyclictest0-21swapper/300:35:213
545165991411,1cyclictest0-21swapper/300:30:223
545165991411,1cyclictest0-21swapper/300:10:223
545165991411,1cyclictest0-21swapper/300:05:183
545165991411,1cyclictest0-21swapper/300:00:293
545163991412,1cyclictest0-21swapper/223:30:002
545163991411,2cyclictest966376-21irqcore00:10:222
545163991411,2cyclictest885961-21irqrtprio23:20:162
545163991411,2cyclictest773389-21kthreadcore22:10:192
545163991411,2cyclictest773389-21kthreadcore22:10:182
545163991411,2cyclictest750-21sshd20:41:372
545163991411,2cyclictest729505-21irqrtprio21:40:172
545163991411,2cyclictest0-21swapper/223:15:212
545163991411,2cyclictest0-21swapper/223:10:142
545163991411,2cyclictest0-21swapper/222:50:012
545163991411,2cyclictest0-21swapper/221:05:242
545163991411,2cyclictest0-21swapper/219:20:192
545163991411,2cyclictest0-21swapper/219:20:002
545163991411,2cyclictest0-21swapper/200:25:002
54516399140,13cyclictest609678-21turbostat.cron20:09:552
54515999144,2cyclictest693545-21kthreadcore21:10:171
54515999142,6cyclictest803208-21apt22:30:011
545159991411,2cyclictest918747-21kthreadcore23:40:181
545159991411,2cyclictest841956-21unixbench_multi22:50:251
545159991411,2cyclictest773258-21kthreadcore22:10:191
545159991411,2cyclictest773258-21kthreadcore22:10:181
545159991411,2cyclictest653889-21gltestperf20:40:181
545159991410,3cyclictest572028-21grep19:30:291
54515999140,4cyclictest0-21swapper/120:25:141
545154991412,1cyclictest778929-21kworker/0:2+kacpid23:22:120
545154991412,1cyclictest778929-21kworker/0:2+kacpid23:01:210
545154991412,1cyclictest640649-21kworker/0:1+kacpid21:21:520
545154991411,2cyclictest897269-21kthreadcore23:25:200
545154991411,2cyclictest878139-21kthreadcore23:15:200
545154991411,2cyclictest837336-21irqcore22:50:170
545154991411,2cyclictest755422-21fschecks_time22:00:150
545154991411,2cyclictest745050-21kworker/u8:1-rpciod23:40:180
545154991411,2cyclictest653707-21tr20:40:170
545154991411,2cyclictest640649-21kworker/0:1+kacpid22:11:430
545154991411,2cyclictest640649-21kworker/0:1+kacpid22:11:420
54515499140,5cyclictest664878-21runrttasks20:45:230
545165991311,1cyclictest0-21swapper/322:01:583
545165991311,1cyclictest0-21swapper/321:36:173
545165991311,1cyclictest0-21swapper/320:39:023
545165991311,1cyclictest0-21swapper/320:27:323
545165991311,1cyclictest0-21swapper/319:55:033
545165991311,1cyclictest0-21swapper/319:30:163
545165991310,1cyclictest0-21swapper/321:20:093
545165991310,1cyclictest0-21swapper/300:15:403
54516399138,4cyclictest694647-21tr21:10:182
54516399137,4cyclictest922223-21ntpq23:40:222
545163991310,2cyclictest925866-21irqcore23:45:172
545163991310,2cyclictest912078-21kthreadcore23:35:202
545163991310,2cyclictest779651-21gltestperf22:15:152
545163991310,2cyclictest563414-21kthreadcore19:25:192
545163991310,2cyclictest0-21swapper/219:10:002
54515999134,8cyclictest501-21dbus-daemon21:30:391
545159991311,1cyclictest780720-21kthreadcore22:15:181
545159991310,2cyclictest914313-21sendmail_mailqu23:35:231
545159991310,2cyclictest756220-21irqrtprio22:00:171
545159991310,2cyclictest690501-21diskmemload23:00:011
545159991310,2cyclictest644696-21kthreadcore20:30:151
545159991310,2cyclictest634819-21idleruntime-cro20:25:001
545159991310,2cyclictest575140-21kthreadcore19:35:191
545159991310,2cyclictest554891-21irqcore19:20:131
545159991310,2cyclictest0-21swapper/119:15:021
54515499138,3cyclictest0-21swapper/020:00:170
545154991311,1cyclictest963346-21kworker/0:0+kacpid00:30:250
545154991311,1cyclictest949082-21kworker/0:1+kacpid00:05:010
545154991311,1cyclictest640649-21kworker/0:1+kacpid21:40:030
545154991311,1cyclictest584845-21kworker/0:2+kacpid20:23:190
545154991311,1cyclictest582814-21kthreadcore19:40:200
545154991311,1cyclictest545148-21cyclictest21:49:050
545154991310,2cyclictest711104-21kthreadcore21:25:120
545154991310,2cyclictest680509-21kthreadcore21:00:180
545154991310,2cyclictest646150-21needreboot20:30:170
545154991310,2cyclictest616628-21cut20:10:160
545154991310,2cyclictest616628-21cut20:10:150
545154991310,2cyclictest611318-21kthreadcore20:05:140
545154991310,2cyclictest569556-21kthreadcore19:30:220
545154991310,2cyclictest546730-21kthreadcore19:10:180
545154991310,2cyclictest0-21swapper/022:10:010
6231452120,2sleep2421rcuc/220:15:112
54516599129,1cyclictest0-21swapper/320:45:243
545165991210,1cyclictest0-21swapper/319:40:203
545165991210,1cyclictest0-21swapper/319:20:023
54516399129,2cyclictest837238-21irqcore22:50:182
54516399129,2cyclictest672772-21sed20:55:172
54516399129,2cyclictest431ktimers/220:25:012
54516399129,2cyclictest0-21swapper/219:15:012
54516399127,3cyclictest3818356-21systemd-journal21:33:382
54516399126,5cyclictest981439-21cron00:19:592
54516399126,5cyclictest547-21gdbus21:25:012
54516399126,4cyclictest3818356-21systemd-journal19:40:002
54516399125,5cyclictest3818356-21systemd-journal19:35:002
545163991210,1cyclictest644197-21kthreadcore20:30:162
54516399120,3cyclictest991314-21irqstats00:25:192
54515999129,2cyclictest0-21swapper/120:55:011
54515999128,3cyclictest827331-21sshd22:43:361
545159991210,1cyclictest0-21swapper/121:25:011
54515499129,2cyclictest933590-21gltestperf23:50:160
54515499129,2cyclictest0-21swapper/022:55:140
54515499127,3cyclictest743910-21cat21:50:150
545154991210,1cyclictest526697-21kworker/0:0+kacpid19:35:180
54516399118,2cyclictest845149-21irqcore22:55:172
54516399118,2cyclictest0-21swapper/221:00:162
54516399117,3cyclictest501-21dbus-daemon20:00:202
54515999119,1cyclictest0-21swapper/100:35:161
54515999114,6cyclictest563608-21cut19:25:201
545159991110,1cyclictest0-21swapper/120:55:221
54515499118,2cyclictest673684-21kthreadcore20:55:180
5401692111,7sleep10-21swapper/119:05:171
539221291,3sleep0539254-21apt-get19:05:130
545023270,2sleep30-21swapper/319:09:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional