You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 12:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Fri Dec 05, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233750721050,2sleep12337510-21fschecks_count23:45:131
229430721010,2sleep30-21swapper/323:20:143
24154482390,2sleep30-21swapper/300:30:003
20066682270,1sleep10-21swapper/120:15:131
1923435992421,2cyclictest2188977-21sh22:20:011
1923435992320,2cyclictest2415581-21apt-config00:30:001
302487291220,2phc2sys0-21swapper/322:30:393
20472242220,2sleep30-21swapper/320:45:213
1923434992219,2cyclictest1998992-21dpkg20:10:000
1923436992118,1cyclictest0-21swapper/200:25:002
192343599219,1cyclictest191rcu_preempt22:00:221
1923435992118,2cyclictest1-21systemd19:40:011
1923435992114,3cyclictest2150702-21mailstats21:55:231
1923434992119,1cyclictest2398039-21/usr/sbin/munin00:20:010
1923434992118,2cyclictest1652-1atopacctd23:00:020
1923434992110,9cyclictest0-21swapper/021:35:070
1923436992016,2cyclictest0-21swapper/221:40:002
1923435992017,2cyclictest1929609-21unixbench_singl19:15:011
1923435992012,1cyclictest191rcu_preempt23:16:561
192343499209,6cyclictest0-21swapper/023:55:110
1923434992017,2cyclictest2381596-21fschecks_time00:10:140
1923436991916,1cyclictest0-21swapper/222:59:532
1923436991916,1cyclictest0-21swapper/222:30:472
192343599198,1cyclictest191rcu_preempt23:23:211
1923435991916,2cyclictest0-21swapper/100:05:011
1923434991917,1cyclictest2240985-21perf22:50:010
1923434991917,1cyclictest2087801-21cron21:20:010
1923434991916,2cyclictest2319113-21latency_hist23:35:010
1923434991916,2cyclictest2128067-21systemd21:45:010
1923434991916,2cyclictest1992902-21idleruntime-cro20:05:000
1923434991910,5cyclictest2428555-21kthreadcore00:35:210
302487291182,2phc2sys0-21swapper/323:43:323
302487291180,2phc2sys0-21swapper/322:36:403
1923436991816,1cyclictest0-21swapper/222:10:012
1923436991815,1cyclictest0-21swapper/223:35:012
1923436991815,1cyclictest0-21swapper/222:45:012
1923436991815,1cyclictest0-21swapper/221:25:192
1923436991815,1cyclictest0-21swapper/220:15:012
192343599185,4cyclictest2059185-21latency20:55:181
1923435991815,2cyclictest2238177-21grep22:45:241
1923435991815,2cyclictest1937848-21idleruntime-cro19:20:001
1923435991815,2cyclictest0-21swapper/100:20:001
1923435991812,1cyclictest191rcu_preempt22:57:511
1923435991812,1cyclictest191rcu_preempt00:10:191
1923435991811,2cyclictest2417485-21kthreadcore00:30:191
1923435991810,1cyclictest170550irq/121-eno123:30:241
192343599180,2cyclictest191rcu_preempt20:30:011
192343499188,9cyclictest1975143-21aten2.4-expect19:50:090
1923434991816,1cyclictest2154024-21/usr/sbin/munin22:00:010
1923434991815,2cyclictest1702-21in:imuxsock23:20:010
1923434991815,2cyclictest1635-21dbus-daemon00:35:000
1923434991814,2cyclictest1987022-21systemd20:00:010
1923434991812,5cyclictest2073252-21cstates21:10:100
302487291170,2phc2sys0-21swapper/322:17:143
302487291170,2phc2sys0-21swapper/321:15:283
192343699179,3cyclictest0-21swapper/219:50:012
1923436991714,1cyclictest0-21swapper/223:40:002
1923436991714,1cyclictest0-21swapper/223:40:002
1923436991714,1cyclictest0-21swapper/221:15:012
1923436991714,1cyclictest0-21swapper/221:00:002
1923436991714,1cyclictest0-21swapper/220:50:002
1923436991714,1cyclictest0-21swapper/220:10:012
1923436991714,1cyclictest0-21swapper/219:15:012
1923436991714,1cyclictest0-21swapper/200:40:012
1923436991714,1cyclictest0-21swapper/200:05:112
1923436991714,1cyclictest0-21swapper/200:05:112
1923436991712,3cyclictest2398042-21taskset00:20:012
192343599179,3cyclictest36-21ksoftirqd/121:40:001
192343599179,3cyclictest36-21ksoftirqd/120:15:001
192343599179,3cyclictest0-21swapper/122:40:011
192343599179,1cyclictest170550irq/121-eno122:23:361
1923435991714,2cyclictest2278286-21kthreadcore23:10:201
1923435991714,2cyclictest2128105-21latency_hist21:45:021
1923435991714,2cyclictest2041041-21needreboot20:40:191
1923435991714,2cyclictest2041041-21needreboot20:40:191
1923435991712,1cyclictest191rcu_preempt21:53:431
1923435991712,1cyclictest191rcu_preempt21:30:011
1923435991711,1cyclictest501rcuop/223:52:331
1923435991711,1cyclictest191rcu_preempt00:39:101
192343599170,2cyclictest0-21swapper/121:20:221
192343499179,4cyclictest1652-1atopacctd22:35:180
192343499178,4cyclictest0-21swapper/021:47:340
192343499178,2cyclictest0-21swapper/000:20:170
1923434991714,2cyclictest1930045-21timerandwakeup19:15:010
1923434991714,2cyclictest1700-21systemd-logind19:10:010
1923434991714,2cyclictest1700-21systemd-logind19:10:010
1923434991714,2cyclictest1635-21dbus-daemon22:10:010
1923434991714,2cyclictest0-21swapper/022:20:010
1923434991713,2cyclictest2372718-21hddtemp_smartct00:05:130
1923434991713,2cyclictest2372718-21hddtemp_smartct00:05:130
302487291160,2phc2sys0-21swapper/323:15:363
192343699162,5cyclictest0-21swapper/222:30:012
1923436991614,1cyclictest0-21swapper/219:55:012
1923436991614,1cyclictest0-21swapper/200:15:022
1923436991614,1cyclictest0-21swapper/200:05:012
1923436991613,1cyclictest0-21swapper/223:15:002
1923436991613,1cyclictest0-21swapper/221:45:182
1923436991613,1cyclictest0-21swapper/221:30:232
1923436991613,1cyclictest0-21swapper/221:20:012
1923436991613,1cyclictest0-21swapper/220:40:002
1923436991613,1cyclictest0-21swapper/220:35:012
1923436991612,2cyclictest0-21swapper/220:25:112
192343599168,3cyclictest36-21ksoftirqd/119:10:011
192343599168,3cyclictest36-21ksoftirqd/119:10:011
192343599168,3cyclictest0-21swapper/122:10:001
192343599168,1cyclictest191rcu_preempt20:05:141
192343599164,6cyclictest2318385-21kworker/u16:3+rpciod23:59:381
192343599162,4cyclictest2171311-21kworker/u16:2+xprtiod22:25:061
1923435991613,2cyclictest341rcuc/121:10:011
1923435991613,2cyclictest1700-21systemd-logind20:50:001
1923435991611,1cyclictest1986871-21kworker/1:0+events_freezable20:35:171
1923435991611,1cyclictest191rcu_preempt23:38:301
1923435991611,1cyclictest191rcu_preempt23:38:301
1923435991611,1cyclictest191rcu_preempt23:25:171
1923435991611,1cyclictest191rcu_preempt22:32:171
1923435991611,1cyclictest191rcu_preempt21:46:221
1923435991611,1cyclictest191rcu_preempt21:30:511
1923435991610,2cyclictest170550irq/121-eno121:15:211
192343499169,1cyclictest0-21swapper/023:37:310
192343499169,1cyclictest0-21swapper/023:37:310
192343499168,1cyclictest0-21swapper/022:25:220
192343499167,4cyclictest0-21swapper/023:10:210
192343499161,4cyclictest0-21swapper/000:04:380
1923434991614,1cyclictest2415488-21/usr/sbin/munin00:30:000
1923434991613,2cyclictest2173004-21sed22:10:160
1923434991613,2cyclictest2173004-21sed22:10:160
1923434991613,2cyclictest2154927-21cut22:00:110
1923434991613,2cyclictest2054225-21perf20:55:000
1923434991613,2cyclictest2045908-21kthreadcore20:45:170
1923434991613,2cyclictest1974897-21munin-plugin-st19:50:020
1923434991613,2cyclictest1652-1atopacctd23:50:210
1923434991610,5cyclictest2227478-21kthreadcore22:40:190
1923434991610,5cyclictest1652-1atopacctd22:50:200
835298150,1rtkit-daemon0-21swapper/120:21:181
302487291154,2phc2sys0-21swapper/323:25:133
302487291150,3phc2sys0-21swapper/321:42:283
1923436991513,1cyclictest0-21swapper/222:50:082
1923436991513,1cyclictest0-21swapper/222:10:112
1923436991513,1cyclictest0-21swapper/222:10:112
1923436991512,2cyclictest0-21swapper/223:40:162
1923436991512,1cyclictest0-21swapper/223:55:182
1923436991512,1cyclictest0-21swapper/223:20:002
1923436991512,1cyclictest0-21swapper/222:45:412
1923436991512,1cyclictest0-21swapper/222:35:132
1923436991512,1cyclictest0-21swapper/222:04:222
1923436991512,1cyclictest0-21swapper/219:45:012
1923436991512,1cyclictest0-21swapper/200:25:192
1923436991511,2cyclictest0-21swapper/220:18:062
192343599159,1cyclictest1929568-21kworker/1:1+events_freezable19:20:081
192343599156,1cyclictest170550irq/121-eno100:20:151
192343599155,5cyclictest2241527-21aten2.4-expect22:50:101
192343599155,4cyclictest1975924-21irqcore19:50:141
192343599154,6cyclictest36-21ksoftirqd/123:00:101
192343599153,7cyclictest2268808-21cut23:05:171
1923435991512,2cyclictest2081237-21systemd-run21:15:011
1923435991510,1cyclictest2293137-21kworker/1:1+events_freezable00:05:161
1923435991510,1cyclictest2293137-21kworker/1:1+events_freezable00:05:161
1923435991510,1cyclictest1962580-21kworker/1:0+events_freezable19:40:021
1923435991510,1cyclictest191rcu_preempt22:40:281
192343599150,3cyclictest0-21swapper/120:01:291
192343499159,5cyclictest2189630-21cpuspeed_turbos22:20:110
192343499158,1cyclictest0-21swapper/021:34:560
192343499156,4cyclictest0-21swapper/023:40:180
192343499155,2cyclictest491rcuog/219:25:150
192343499154,6cyclictest2033-21lldpd23:05:130
1923434991513,1cyclictest8351-21rtkit-daemon23:24:360
1923434991512,2cyclictest2207384-21fschecks_time22:30:160
1923434991512,2cyclictest2137859-21irqcore21:50:130
1923434991512,2cyclictest2006606-21sed20:15:120
1923434991512,2cyclictest1955215-21pmu-power19:30:180
1923434991512,2cyclictest1930336-21kthreadcore19:15:020
1923434991510,4cyclictest2283676-21kworker/u16:3-events_unbound23:26:110
302487291142,2phc2sys0-21swapper/300:32:303
302487291140,3phc2sys0-21swapper/319:10:083
302487291140,2phc2sys0-21swapper/323:35:193
302487291140,2phc2sys0-21swapper/323:35:193
302487291140,2phc2sys0-21swapper/300:05:293
302487291140,2phc2sys0-21swapper/300:05:293
302487291140,2phc2sys0-21swapper/300:04:083
302487291140,1phc2sys0-21swapper/321:04:383
192343699144,7cyclictest19451752sleep219:25:142
1923436991411,1cyclictest0-21swapper/223:50:082
1923436991411,1cyclictest0-21swapper/223:45:132
1923436991411,1cyclictest0-21swapper/223:25:192
1923436991411,1cyclictest0-21swapper/222:20:192
1923436991411,1cyclictest0-21swapper/222:20:002
1923436991411,1cyclictest0-21swapper/221:55:192
1923436991411,1cyclictest0-21swapper/221:45:012
1923436991411,1cyclictest0-21swapper/221:00:192
1923436991411,1cyclictest0-21swapper/220:25:012
1923436991411,1cyclictest0-21swapper/219:35:162
1923436991411,1cyclictest0-21swapper/219:30:202
1923436991411,1cyclictest0-21swapper/219:25:012
192343599149,1cyclictest191rcu_preempt22:11:281
192343599149,1cyclictest191rcu_preempt22:11:281
192343599148,4cyclictest2028950-21/usr/sbin/munin20:30:251
192343599143,5cyclictest191rcu_preempt19:45:181
1923435991411,2cyclictest2333321-21sendmail_mailqu23:40:201
1923435991411,2cyclictest1951496-21irqrtprio19:30:131
1923435991411,2cyclictest1700-21systemd-logind20:55:011
1923435991411,2cyclictest1700-21systemd-logind19:25:191
192343499148,1cyclictest0-21swapper/023:45:090
192343499147,6cyclictest0-21swapper/021:25:230
192343499145,5cyclictest0-21swapper/021:22:410
1923434991412,1cyclictest2067445-21gltestperf21:05:150
1923434991411,2cyclictest1944019-21latency_hist19:25:000
1923434991410,3cyclictest2171311-21kworker/u16:2+nfsiod23:02:560
192343499140,9cyclictest1967981-21sed19:40:200
302487291133,2phc2sys0-21swapper/300:38:473
302487291130,4phc2sys0-21swapper/323:13:243
302487291130,2phc2sys0-21swapper/322:44:423
302487291130,2phc2sys0-21swapper/321:28:093
302487291130,2phc2sys0-21swapper/321:10:353
302487291130,2phc2sys0-21swapper/300:11:163
302487291130,1phc2sys0-21swapper/319:24:203
1923436991311,1cyclictest0-21swapper/219:55:142
1923436991311,1cyclictest0-21swapper/200:30:092
1923436991310,1cyclictest0-21swapper/223:20:152
1923436991310,1cyclictest0-21swapper/223:05:102
1923436991310,1cyclictest0-21swapper/221:50:142
1923436991310,1cyclictest0-21swapper/220:50:172
1923436991310,1cyclictest0-21swapper/220:40:172
1923436991310,1cyclictest0-21swapper/220:40:172
1923436991310,1cyclictest0-21swapper/220:00:142
1923435991310,2cyclictest1983829-21kthreadcore19:55:181
192343599130,6cyclictest36-21ksoftirqd/121:00:211
192343499135,3cyclictest2023099-21python320:25:210
192343499134,5cyclictest0-21swapper/019:36:210
1923434991311,1cyclictest2061381-21tail21:00:170
1923434991310,2cyclictest2031573-21kthreadcore20:35:160
1923434991310,2cyclictest2025284-21irqrtprio20:30:200
1923434991310,2cyclictest2012926-21irqcore20:20:160
1923434991310,2cyclictest2003386-21kthreadcore20:10:180
835298120,7rtkit-daemon2036308-21apt-get20:40:100
835298120,7rtkit-daemon2036308-21apt-get20:40:100
302487291121,3phc2sys0-21swapper/321:55:113
302487291121,2phc2sys0-21swapper/321:54:553
302487291121,2phc2sys0-21swapper/321:36:483
302487291120,3phc2sys0-21swapper/321:00:013
302487291120,2phc2sys0-21swapper/322:13:023
302487291120,2phc2sys0-21swapper/322:13:023
302487291120,2phc2sys0-21swapper/322:01:043
302487291120,2phc2sys0-21swapper/320:32:363
302487291120,2phc2sys0-21swapper/319:51:573
302487291120,2phc2sys0-21swapper/319:45:033
302487291120,2phc2sys0-21swapper/319:38:573
192343699129,2cyclictest0-21swapper/221:05:182
1923436991210,1cyclictest0-21swapper/223:00:122
1923436991210,1cyclictest0-21swapper/219:15:022
192343499129,2cyclictest2057371-21kthreadcore20:55:170
302487291111,4phc2sys0-21swapper/319:05:063
302487291111,4phc2sys0-21swapper/319:05:063
302487291111,2phc2sys0-21swapper/322:59:483
302487291111,2phc2sys0-21swapper/322:24:563
302487291110,3phc2sys0-21swapper/323:45:173
302487291110,3phc2sys0-21swapper/323:00:123
302487291110,2phc2sys0-21swapper/322:45:133
302487291110,2phc2sys0-21swapper/321:20:083
302487291110,2phc2sys0-21swapper/320:43:533
302487291110,2phc2sys0-21swapper/320:43:533
302487291110,2phc2sys0-21swapper/319:30:173
302487291110,2phc2sys0-21swapper/300:22:083
192343699119,1cyclictest0-21swapper/221:20:102
302487291101,3phc2sys0-21swapper/322:51:113
302487291101,2phc2sys0-21swapper/322:27:263
302487291101,2phc2sys0-21swapper/321:30:223
302487291101,2phc2sys0-21swapper/321:05:143
302487291101,2phc2sys0-21swapper/320:50:233
302487291101,2phc2sys0-21swapper/300:16:063
302487291100,3phc2sys0-21swapper/323:30:063
302487291100,3phc2sys0-21swapper/322:05:213
302487291100,3phc2sys0-21swapper/320:35:123
302487291100,2phc2sys0-21swapper/323:57:033
302487291100,2phc2sys0-21swapper/323:50:143
302487291100,2phc2sys0-21swapper/323:07:103
302487291100,2phc2sys0-21swapper/321:46:253
302487291100,2phc2sys0-21swapper/320:16:213
302487291100,2phc2sys0-21swapper/320:10:323
302487291100,2phc2sys0-21swapper/320:00:103
302487291100,2phc2sys0-21swapper/319:55:173
302487291100,2phc2sys0-21swapper/319:25:083
192343699108,1cyclictest0-21swapper/219:10:012
192343699108,1cyclictest0-21swapper/219:10:012
30248729190,2phc2sys0-21swapper/320:28:513
30248729190,2phc2sys0-21swapper/320:05:033
30248729190,2phc2sys0-21swapper/319:44:563
30248729180,3phc2sys0-21swapper/320:20:093
30248729180,3phc2sys0-21swapper/319:15:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional