You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 17:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Thu Nov 27, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
984592270,1sleep10-21swapper/111:50:061
41021832270,2sleep30-21swapper/309:57:583
3867130992215,3cyclictest62240-21kthreadcore11:25:291
3867130992213,4cyclictest0-21swapper/109:40:011
3867128992219,2cyclictest1700-21systemd-logind12:05:000
386713099215,9cyclictest82665-1ssh11:38:441
3867130992112,4cyclictest179739-21tail12:35:241
3867130992111,1cyclictest191rcu_preempt09:50:241
3867128992112,5cyclictest4026820-21sed09:15:250
386713099208,4cyclictest0-21swapper/110:35:181
386713099205,3cyclictest191rcu_preempt07:20:011
3867130992012,2cyclictest191rcu_preempt10:26:191
3867130992010,1cyclictest170550irq/121-eno111:24:081
3867128992017,2cyclictest3867126-21cyclictest07:30:020
3867128992016,2cyclictest115614-21systemd-run12:00:010
3867128992016,2cyclictest0-21swapper/008:00:000
3867128992014,5cyclictest27929-21/usr/sbin/munin11:05:280
3867128992012,4cyclictest14036-21latency_hist11:00:010
40741232190,0sleep14074122-21pmu-power09:40:281
386713199191,8cyclictest0-21swapper/210:30:012
386713099194,7cyclictest191rcu_preempt07:30:011
3867130991916,2cyclictest1635-21dbus-daemon09:35:001
3867130991916,2cyclictest14138-21latency_hist11:00:011
3867130991915,3cyclictest159057-21latency_hist12:25:001
3867130991910,4cyclictest0-21swapper/110:45:021
3867130991910,1cyclictest191rcu_preempt12:06:421
3867130991910,1cyclictest191rcu_preempt12:06:421
386712899198,5cyclictest0-21swapper/010:45:020
386712899196,8cyclictest4146741-21idleruntime-cro10:25:000
3867128991916,2cyclictest4077891-21aten_repower_fr09:45:180
3867128991916,2cyclictest4054653-21kthreadcore09:30:300
3867128991916,2cyclictest3956065-21sh08:20:020
3867128991913,5cyclictest3867126-21cyclictest11:00:220
3867128991912,6cyclictest4062365-21kthreadcore09:35:220
302487291190,3phc2sys0-21swapper/308:15:313
386713199181,8cyclictest0-21swapper/210:00:012
3867131991816,1cyclictest0-21swapper/210:40:022
3867131991815,1cyclictest0-21swapper/210:55:002
3867131991814,2cyclictest0-21swapper/208:05:012
3867131991813,3cyclictest98113-21turbostat11:50:002
386713099187,1cyclictest191rcu_preempt11:59:541
3867130991815,2cyclictest1700-21systemd-logind09:20:021
3867130991814,3cyclictest3923717-21mailstats07:50:331
3867130991812,1cyclictest191rcu_preempt10:07:401
3867130991811,3cyclictest4187354-21/usr/sbin/munin10:45:321
3867130991811,3cyclictest34824-21kthreadcore11:10:251
3867130991811,1cyclictest191rcu_preempt12:00:301
3867130991810,1cyclictest191rcu_preempt12:30:381
3867128991815,2cyclictest4042583-21apt09:25:000
3867128991814,2cyclictest1635-21dbus-daemon08:40:010
386712899181,15cyclictest0-21swapper/011:40:010
302487291180,3phc2sys0-21swapper/312:15:023
302487291180,2phc2sys0-21swapper/312:39:343
302487291180,2phc2sys0-21swapper/312:26:403
302487291180,2phc2sys0-21swapper/311:36:263
40439162170,2sleep30-21swapper/309:25:243
3867131991715,1cyclictest0-21swapper/212:00:242
3867131991715,1cyclictest0-21swapper/210:05:022
3867131991714,1cyclictest0-21swapper/209:50:022
3867131991714,1cyclictest0-21swapper/209:45:012
386713099179,3cyclictest36-21ksoftirqd/110:05:011
3867130991714,2cyclictest8351-21rtkit-daemon08:15:181
3867130991714,2cyclictest22691-21systemd-run11:05:011
3867130991714,2cyclictest1700-21systemd-logind09:25:021
3867130991713,3cyclictest1-21systemd10:31:001
3867130991712,1cyclictest3806814-21kworker/1:1+events_freezable07:20:261
3867130991712,1cyclictest191rcu_preempt10:20:151
3867130991712,1cyclictest191rcu_preempt08:25:021
3867130991710,3cyclictest191rcu_preempt09:48:321
386712899179,7cyclictest0-21swapper/011:15:010
386712899178,5cyclictest4157335-21sed10:30:240
386712899171,7cyclictest4147605-21telnet10:25:200
3867128991715,1cyclictest159250-21cut12:25:010
3867128991714,2cyclictest3944115-21cpuspeed_turbos08:10:190
3867128991714,2cyclictest1803-21gdbus11:20:020
3867128991714,2cyclictest1700-21systemd-logind07:45:010
3867128991714,2cyclictest1635-21dbus-daemon12:35:010
3867128991713,2cyclictest1-21systemd09:30:010
3867128991711,5cyclictest4169949-21ssh10:35:310
302487291170,3phc2sys0-21swapper/311:34:493
302487291170,3phc2sys0-21swapper/311:29:003
302487291170,3phc2sys0-21swapper/310:42:533
3867131991614,1cyclictest0-21swapper/212:25:012
3867131991614,1cyclictest0-21swapper/210:25:012
3867131991613,1cyclictest0-21swapper/211:40:002
3867131991613,1cyclictest0-21swapper/211:25:282
3867131991613,1cyclictest0-21swapper/211:20:242
3867131991613,1cyclictest0-21swapper/211:15:292
3867131991613,1cyclictest0-21swapper/211:10:212
3867131991613,1cyclictest0-21swapper/208:45:002
3867131991613,1cyclictest0-21swapper/207:35:012
3867131991612,2cyclictest0-21swapper/207:40:232
386713199160,14cyclictest0-21swapper/210:48:332
386713099164,7cyclictest3927871-21tr07:55:281
3867130991614,1cyclictest8351-21rtkit-daemon11:42:001
3867130991613,2cyclictest1652-1atopacctd09:10:011
3867130991612,3cyclictest4045415-21kthreadcore09:25:261
3867130991612,1cyclictest191rcu_preempt11:45:321
3867130991611,1cyclictest90107-21kworker/1:0+events_freezable12:10:261
3867130991610,2cyclictest3998559-21kworker/1:1+events_freezable09:10:261
3867130991610,1cyclictest501rcuop/207:32:581
3867128991614,1cyclictest3873314-21apt-config07:15:000
3867128991613,2cyclictest4104550-21sort10:00:220
3867128991612,3cyclictest4109790-21kworker/u16:1+nfsiod10:08:350
3867128991610,2cyclictest89310-21timerandwakeup11:40:310
302487291160,2phc2sys0-21swapper/307:40:293
386713199151,6cyclictest0-21swapper/207:15:192
386713199151,6cyclictest0-21swapper/207:10:012
3867131991512,1cyclictest0-21swapper/212:30:232
3867131991512,1cyclictest0-21swapper/210:10:242
3867131991512,1cyclictest0-21swapper/209:35:242
3867131991512,1cyclictest0-21swapper/209:15:312
3867131991512,1cyclictest0-21swapper/207:13:112
3867131991511,2cyclictest0-21swapper/210:55:242
3867131991511,2cyclictest0-21swapper/207:50:222
386713199150,7cyclictest0-21swapper/211:50:332
386713099158,3cyclictest191rcu_preempt09:59:101
386713099158,2cyclictest170550irq/121-eno110:50:541
386713099155,2cyclictest0-21swapper/111:30:361
386713099153,7cyclictest162945-21tr12:25:241
3867130991513,1cyclictest3968344-21/usr/sbin/munin08:30:201
3867130991512,2cyclictest3936418-21mailstats08:00:271
3867130991512,2cyclictest3867126-21cyclictest11:05:231
3867130991512,2cyclictest260-21systemd-journal09:05:021
3867130991511,3cyclictest3984788-21kthreadcore08:40:251
3867130991511,2cyclictest484912sleep111:19:531
3867130991511,1cyclictest191rcu_preempt07:14:191
3867130991510,1cyclictest4112170-21kworker/1:0+events_freezable10:15:271
3867130991510,1cyclictest191rcu_preempt12:15:171
3867130991510,1cyclictest191rcu_preempt08:45:321
386712899159,5cyclictest3867126-21cyclictest11:20:330
386712899157,4cyclictest0-21swapper/010:55:010
386712899156,5cyclictest100957-21kthreadcore11:50:260
386712899153,3cyclictest170550irq/121-eno108:20:080
3867128991512,2cyclictest8351-21rtkit-daemon10:19:360
3867128991512,2cyclictest74994-21systemd-run11:35:020
3867128991512,2cyclictest4187205-21pmu-power10:45:310
3867128991512,2cyclictest4129661-21latency_hist10:15:010
3867128991512,2cyclictest4074171-21proc_pri09:40:290
3867128991512,2cyclictest4004717-21munin-plugin-st09:00:010
3867128991512,2cyclictest133895-21cstates12:10:210
3867128991511,3cyclictest70-21kcompactd011:50:010
3867128991511,2cyclictest0-21swapper/008:05:010
3867128991510,4cyclictest16-21ksoftirqd/009:10:000
386712899150,10cyclictest0-21swapper/012:25:140
302487291155,2phc2sys0-21swapper/310:50:263
302487291150,2phc2sys0-21swapper/310:59:443
302487291150,2phc2sys0-21swapper/309:39:183
1376202150,2sleep20-21swapper/212:10:272
386713199141,4cyclictest0-21swapper/207:50:012
3867131991412,1cyclictest0-21swapper/212:40:012
3867131991412,1cyclictest0-21swapper/212:10:022
3867131991412,1cyclictest0-21swapper/212:10:022
3867131991412,1cyclictest0-21swapper/209:50:252
3867131991411,1cyclictest0-21swapper/211:55:272
3867131991411,1cyclictest0-21swapper/211:40:192
3867131991411,1cyclictest0-21swapper/211:30:232
3867131991411,1cyclictest0-21swapper/210:30:192
3867131991411,1cyclictest0-21swapper/209:25:002
3867131991411,1cyclictest0-21swapper/209:05:192
3867131991411,1cyclictest0-21swapper/208:34:182
3867131991411,1cyclictest0-21swapper/208:21:322
3867131991411,1cyclictest0-21swapper/208:00:002
3867131991411,1cyclictest0-21swapper/207:40:002
386713099149,1cyclictest191rcu_preempt10:14:151
386713099148,1cyclictest501rcuop/208:10:331
386713099148,1cyclictest3621664-21kworker/u16:3+events_unbound08:30:011
3867130991412,1cyclictest3999521-21idleruntime08:55:221
3867130991410,3cyclictest3904228-21kthreadcore07:35:261
386712899148,5cyclictest151640-21kworker/u16:2-rpciod12:35:180
386712899147,6cyclictest125190-21fschecks_time12:05:210
386712899147,6cyclictest125190-21fschecks_time12:05:210
386712899145,8cyclictest4097511-21tr09:55:270
386712899145,5cyclictest0-21swapper/008:31:180
386712899143,9cyclictest3915748-21kthreadcore07:45:250
386712899141,5cyclictest3924456-21apt-get07:55:020
3867128991411,2cyclictest57766-21/usr/sbin/munin11:25:270
3867128991411,2cyclictest4087844-21kthreadcore09:50:250
3867128991411,2cyclictest3940250-21kthreadcore08:05:250
3867128991411,2cyclictest3882304-21aten_repower_vo07:20:200
3867128991411,2cyclictest3876697-21gltestperf07:15:230
3867128991411,2cyclictest1700-21systemd-logind09:15:010
302487291141,3phc2sys0-21swapper/308:35:163
302487291141,2phc2sys0-21swapper/312:00:233
302487291141,2phc2sys0-21swapper/307:58:053
302487291140,3phc2sys0-21swapper/311:50:283
302487291140,2phc2sys0-21swapper/311:58:473
302487291140,2phc2sys0-21swapper/311:23:013
302487291140,2phc2sys0-21swapper/310:14:323
302487291140,2phc2sys0-21swapper/309:51:183
302487291140,2phc2sys0-21swapper/307:05:193
386713199134,4cyclictest0-21swapper/209:05:002
386713199131,6cyclictest0-21swapper/212:25:172
386713199131,6cyclictest0-21swapper/210:40:182
3867131991311,1cyclictest0-21swapper/211:05:012
3867131991311,1cyclictest0-21swapper/209:30:282
3867131991311,1cyclictest0-21swapper/208:05:252
3867131991310,1cyclictest0-21swapper/212:15:252
3867131991310,1cyclictest0-21swapper/211:05:282
3867131991310,1cyclictest0-21swapper/210:15:272
3867131991310,1cyclictest0-21swapper/209:25:192
3867131991310,1cyclictest0-21swapper/209:10:242
3867131991310,1cyclictest0-21swapper/208:55:192
3867131991310,1cyclictest0-21swapper/208:45:242
3867131991310,1cyclictest0-21swapper/208:10:252
3867131991310,1cyclictest0-21swapper/207:20:252
386713099139,1cyclictest191rcu_preempt07:45:231
386713099135,6cyclictest3977283-21cut08:35:241
3867130991310,2cyclictest3997500-21pmu-power08:50:301
3867130991310,2cyclictest3909308-21kthreadcore07:40:281
3867130991310,2cyclictest341rcuc/108:05:171
386712899132,6cyclictest0-21swapper/007:30:210
3867128991310,2cyclictest3987837-21irqrtprio08:45:280
3867128991310,2cyclictest3962645-21cstates08:25:190
3867128991310,2cyclictest3903389-21kthreadcore07:35:260
3867128991310,2cyclictest142947-21gltestperf12:15:230
302487291133,2phc2sys0-21swapper/312:30:093
302487291130,3phc2sys0-21swapper/310:27:543
302487291130,2phc2sys0-21swapper/310:19:523
302487291130,2phc2sys0-21swapper/310:05:583
386713199129,1cyclictest0-21swapper/208:35:172
386713199129,1cyclictest0-21swapper/208:15:242
3867131991210,1cyclictest0-21swapper/210:05:232
386713199120,5cyclictest0-21swapper/207:25:172
386713099129,2cyclictest3867244-21latency_hist07:10:021
386712899120,7cyclictest4009410-21cut09:00:240
386712899120,7cyclictest3985398-21/usr/sbin/munin08:40:280
386712899120,3cyclictest0-21swapper/008:51:410
302487291123,2phc2sys0-21swapper/310:35:303
302487291122,3phc2sys0-21swapper/311:17:033
302487291122,3phc2sys0-21swapper/311:00:203
302487291121,5phc2sys0-21swapper/308:25:173
302487291121,3phc2sys0-21swapper/309:23:013
302487291121,2phc2sys0-21swapper/308:57:163
302487291120,3phc2sys0-21swapper/309:31:023
302487291120,3phc2sys0-21swapper/309:10:183
302487291120,2phc2sys0-21swapper/309:40:423
302487291120,2phc2sys0-21swapper/308:11:203
302487291120,2phc2sys0-21swapper/308:09:593
302487291120,2phc2sys0-21swapper/308:04:563
386713199118,1cyclictest0-21swapper/208:50:212
386713199118,1cyclictest0-21swapper/208:25:212
386712899119,1cyclictest0-21swapper/007:10:020
302487291112,2phc2sys0-21swapper/311:14:563
302487291111,3phc2sys0-21swapper/309:15:273
302487291111,2phc2sys0-21swapper/307:40:013
302487291110,3phc2sys0-21swapper/312:10:013
302487291110,3phc2sys0-21swapper/312:10:013
302487291110,3phc2sys0-21swapper/311:05:213
302487291110,3phc2sys0-21swapper/310:50:023
302487291110,3phc2sys0-21swapper/307:49:563
302487291110,2phc2sys0-21swapper/307:19:173
302487291110,1phc2sys0-21swapper/310:01:053
302487291110,1phc2sys0-21swapper/308:46:023
302487291110,1phc2sys0-21swapper/307:24:553
302487291101,2phc2sys0-21swapper/310:31:133
302487291100,4phc2sys0-21swapper/308:30:183
302487291100,3phc2sys0-21swapper/312:16:143
302487291100,2phc2sys0-21swapper/312:22:393
302487291100,2phc2sys0-21swapper/311:50:013
302487291100,2phc2sys0-21swapper/311:41:523
302487291100,2phc2sys0-21swapper/310:20:553
302487291100,2phc2sys0-21swapper/309:47:533
30248729191,2phc2sys0-21swapper/309:05:213
30248729191,2phc2sys0-21swapper/308:40:213
30248729191,2phc2sys0-21swapper/308:25:023
30248729190,3phc2sys0-21swapper/307:30:233
30248729190,2phc2sys0-21swapper/309:03:253
30248729190,2phc2sys0-21swapper/308:50:193
30248729190,2phc2sys0-21swapper/307:50:043
30248729190,2phc2sys0-21swapper/307:25:303
30248729190,2phc2sys0-21swapper/307:15:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional