You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Mon May 05, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3226022330,2sleep10-21swapper/123:45:261
3345042310,1sleep10-21swapper/123:51:561
25010913018,3phc2sys0-21swapper/321:19:283
4089886992616,6cyclictest374906-21kthreadcore00:15:240
25010912618,3phc2sys0-21swapper/323:15:473
4089888992522,1cyclictest0-21swapper/200:00:002
25010912518,3phc2sys0-21swapper/321:34:323
25010912518,2phc2sys0-21swapper/323:46:413
25010912518,2phc2sys0-21swapper/321:35:283
25010912418,3phc2sys0-21swapper/323:31:463
25010912418,2phc2sys0-21swapper/323:56:473
25010912418,2phc2sys0-21swapper/323:26:213
25010912418,2phc2sys0-21swapper/323:04:223
25010912418,2phc2sys0-21swapper/321:55:043
25010912417,2phc2sys0-21swapper/321:11:403
25010912417,2phc2sys0-21swapper/321:00:263
25010912417,2phc2sys0-21swapper/300:30:313
11340422418,4sleep30-21swapper/321:47:293
4089886992315,5cyclictest265524-21systemctl23:15:000
4089886992314,5cyclictest2240602-1atopacctd20:00:200
4089886992313,6cyclictest210028-21runrttasks22:41:170
3807722318,3sleep30-21swapper/321:05:183
25010912318,3phc2sys0-21swapper/323:38:393
25010912318,3phc2sys0-21swapper/322:00:443
25010912318,3phc2sys0-21swapper/300:16:023
25010912317,3phc2sys0-21swapper/323:10:013
25010912317,3phc2sys0-21swapper/322:50:543
25010912317,3phc2sys0-21swapper/320:35:203
25010912317,2phc2sys0-21swapper/323:14:043
25010912317,2phc2sys0-21swapper/322:46:173
25010912317,2phc2sys0-21swapper/322:42:463
25010912317,2phc2sys0-21swapper/322:12:203
25010912317,2phc2sys0-21swapper/322:05:253
25010912317,2phc2sys0-21swapper/320:50:563
25010912317,2phc2sys0-21swapper/320:49:243
25010912317,2phc2sys0-21swapper/320:42:503
25010912317,2phc2sys0-21swapper/320:09:523
25010912317,2phc2sys0-21swapper/319:57:183
25010912317,2phc2sys0-21swapper/319:54:383
25010912317,2phc2sys0-21swapper/319:25:203
25010912317,2phc2sys0-21swapper/319:13:503
25010912317,2phc2sys0-21swapper/300:09:583
25010912317,2phc2sys0-21swapper/300:00:573
25010912315,3phc2sys0-21swapper/300:40:003
8846822218,2sleep20-21swapper/221:35:032
7028322218,2sleep20-21swapper/221:24:292
39687022218,2sleep30-21swapper/300:27:373
29193022218,2sleep20-21swapper/223:29:532
25010912218,2phc2sys0-21swapper/323:20:183
25010912218,2phc2sys0-21swapper/322:16:313
25010912217,3phc2sys0-21swapper/323:50:263
25010912217,3phc2sys0-21swapper/322:20:523
25010912217,3phc2sys0-21swapper/321:25:573
25010912217,3phc2sys0-21swapper/320:55:563
25010912217,3phc2sys0-21swapper/320:34:203
25010912217,3phc2sys0-21swapper/320:23:183
25010912217,3phc2sys0-21swapper/320:11:363
25010912217,3phc2sys0-21swapper/320:01:023
25010912217,3phc2sys0-21swapper/319:49:483
25010912217,3phc2sys0-21swapper/319:42:263
25010912217,3phc2sys0-21swapper/319:38:533
25010912217,3phc2sys0-21swapper/319:17:583
25010912217,3phc2sys0-21swapper/300:24:333
25010912216,2phc2sys0-21swapper/323:42:013
18427522218,2sleep30-21swapper/322:27:413
15033122218,2sleep20-21swapper/222:09:492
12398522218,2sleep30-21swapper/321:54:483
9534522117,2sleep20-21swapper/221:37:022
7718422117,2sleep20-21swapper/221:26:202
5298022117,2sleep20-21swapper/221:15:062
5227222117,2sleep20-21swapper/221:14:312
418987422118,2sleep20-21swapper/220:30:222
417144722117,2sleep20-21swapper/220:15:232
41358722117,2sleep20-21swapper/200:35:462
412226922117,2sleep20-21swapper/219:31:192
411617622117,2sleep20-21swapper/219:26:052
4089888992119,1cyclictest0-21swapper/219:25:022
4089887992118,2cyclictest1700-21gmain23:05:011
4089887992114,3cyclictest120262-21packagekitd21:15:021
408988699219,6cyclictest0-21swapper/022:45:210
39598122117,2sleep20-21swapper/200:26:122
38885022117,2sleep20-21swapper/200:23:562
37928922117,2sleep20-21swapper/200:17:502
37115522117,2sleep20-21swapper/200:13:502
36031522117,2sleep20-21swapper/200:05:442
35215222117,2sleep20-21swapper/200:01:402
32801822117,2sleep20-21swapper/223:50:142
32604922117,2sleep20-21swapper/223:47:562
31704722117,2sleep20-21swapper/223:42:442
30748422117,2sleep20-21swapper/223:36:262
28051322117,2sleep20-21swapper/223:20:442
27195422117,2sleep20-21swapper/223:16:142
25633722117,2sleep20-21swapper/223:09:282
25010912117,2phc2sys0-21swapper/322:35:253
25010912117,2phc2sys0-21swapper/321:40:503
25010912117,2phc2sys0-21swapper/321:20:283
25010912117,2phc2sys0-21swapper/300:10:093
23749822117,2sleep20-21swapper/222:57:382
22942322117,2sleep20-21swapper/222:53:542
21863722117,2sleep20-21swapper/222:45:522
20957622117,2sleep20-21swapper/222:40:362
20138622117,2sleep20-21swapper/222:36:262
19412022117,2sleep30-21swapper/322:34:193
17724122117,2sleep20-21swapper/222:25:042
16857922117,2sleep20-21swapper/222:20:162
15962622117,2sleep20-21swapper/222:15:062
15209722117,2sleep20-21swapper/222:10:262
14106722117,2sleep20-21swapper/222:04:042
13138522117,2sleep20-21swapper/221:57:382
12164322117,2sleep20-21swapper/221:51:062
11250222117,2sleep20-21swapper/221:46:042
728022017,2sleep20-21swapper/220:37:112
418896622017,2sleep20-21swapper/220:28:092
417076522017,2sleep20-21swapper/220:12:152
416490522017,2sleep20-21swapper/220:09:582
415854322017,2sleep20-21swapper/220:01:172
415241922017,2sleep20-21swapper/219:55:352
414046922017,2sleep20-21swapper/219:46:572
413444622017,2sleep20-21swapper/219:42:012
412853822017,2sleep20-21swapper/219:39:082
410394422017,2sleep20-21swapper/219:17:282
409559622017,2sleep20-21swapper/219:11:322
4089887992017,2cyclictest407479-21apt-config00:35:011
4089887992017,2cyclictest309699-21turbostat.cron23:40:001
4089887992017,2cyclictest150479-21grep22:10:001
40583522017,2sleep20-21swapper/200:32:502
3134322017,2sleep20-21swapper/220:55:422
26315222017,2sleep20-21swapper/223:11:182
2538022017,2sleep20-21swapper/220:51:342
25010912017,2phc2sys0-21swapper/322:57:453
25010912017,2phc2sys0-21swapper/320:29:503
25010912017,2phc2sys0-21swapper/320:18:523
25010912017,2phc2sys0-21swapper/319:32:523
25010912017,2phc2sys0-21swapper/319:22:503
1936922017,2sleep20-21swapper/220:47:122
1343122017,2sleep20-21swapper/220:43:052
4089888991916,1cyclictest0-21swapper/222:35:012
408988799194,6cyclictest97264-21munin-run21:40:001
4089887991916,2cyclictest4189430-21apt-config20:30:011
4089887991916,2cyclictest4095977-21munin-node00:35:261
4089887991916,2cyclictest1695-21dbus-daemon19:25:021
4089887991916,2cyclictest1-21systemd00:00:001
408988699197,5cyclictest0-21swapper/023:55:260
408988699192,3cyclictest203627-21kworker/u16:2+nfsiod00:35:160
4089886991916,2cyclictest52719-21cut21:15:010
4089886991911,7cyclictest1-21systemd22:25:010
4089886991911,4cyclictest3730681-21sshd21:40:200
408988699191,14cyclictest0-21swapper/000:25:320
4089886991910,5cyclictest0-21swapper/023:20:020
4089887991815,2cyclictest61927-21cat21:20:011
4089887991815,2cyclictest221319-21systemd-run22:50:001
4089887991815,2cyclictest1-21systemd21:50:001
4089887991811,3cyclictest82045-21kthreadcore21:30:271
408988699188,5cyclictest0-21swapper/022:35:280
4089886991815,2cyclictest4171679-21cpuspeed_turbos20:15:230
4089886991815,2cyclictest1726-21systemd-logind20:55:020
4089886991815,2cyclictest1695-21dbus-daemon21:10:010
4089886991815,2cyclictest0-21swapper/000:15:000
4089886991814,3cyclictest71493-21tr21:25:190
4089886991810,7cyclictest0-21swapper/022:30:160
4089886991810,4cyclictest151537-21/usr/sbin/munin22:10:220
408988699180,8cyclictest501rcuop/222:25:170
408988799171,7cyclictest373222-21sort00:15:211
4089887991714,2cyclictest4096361-21grep19:15:021
4089887991714,2cyclictest0-21swapper/122:15:031
4089887991713,3cyclictest52665-21kworker/u16:2+nfsiod21:25:331
4089887991713,3cyclictest233699-21kthreadcore22:55:281
4089887991711,5cyclictest363287-21kworker/u16:3+nfsiod00:21:301
4089887991710,5cyclictest1761-21gdbus20:15:021
4089887991710,2cyclictest4089884-21cyclictest23:16:431
408988699179,4cyclictest150184-21runrttasks22:09:340
408988699173,7cyclictest4129036-21aten_repower_en19:40:170
4089886991714,2cyclictest93769-21phc2sys-jitter21:35:270
4089886991714,2cyclictest88506-21latency_hist21:35:020
4089886991714,2cyclictest1726-21systemd-logind20:50:010
4089886991714,2cyclictest0-21swapper/023:50:020
4089886991713,3cyclictest1700-21gmain23:45:010
4089886991711,5cyclictest9244-21rtkit-daemon00:22:440
4089886991711,5cyclictest284452-21cut23:25:200
4089886991711,5cyclictest124917-21cpuspeed_turbos21:55:200
4089886991710,2cyclictest245575-21kworker/u16:0-events_unbound23:03:040
408988699170,4cyclictest363020-21idleruntime-cro00:10:010
4089888991612,2cyclictest0-21swapper/220:25:012
408988799168,6cyclictest0-21swapper/123:15:011
408988799168,3cyclictest0-21swapper/100:10:201
408988799161,9cyclictest4104404-1cat19:20:021
4089887991614,1cyclictest9244-21rtkit-daemon20:18:181
4089887991613,2cyclictest4191642-21kthreadcore20:30:271
4089887991613,2cyclictest4165175-21cut20:10:021
4089887991613,2cyclictest4122717-21systemd-run19:35:011
4089887991613,2cyclictest299946-21runrttasks23:33:331
4089887991613,2cyclictest275396-21/usr/sbin/munin23:20:221
4089887991613,2cyclictest25867-21systemd-run20:55:021
4089887991613,2cyclictest194834-21gpgv22:35:011
4089887991613,2cyclictest176941-21/usr/sbin/munin22:25:011
4089887991612,3cyclictest3974023-21kworker/u16:0+nfsiod22:28:491
4089887991612,3cyclictest136231-21kthreadcore22:00:271
4089887991610,5cyclictest4138786-21kthreadcore19:45:251
408988699169,6cyclictest0-21swapper/021:50:220
408988699168,4cyclictest0-21swapper/019:20:210
408988699167,4cyclictest0-21swapper/022:00:190
408988699165,6cyclictest0-21swapper/000:30:260
4089886991613,2cyclictest333546-21unixbench-2d23:50:310
4089886991613,2cyclictest301469-21head23:35:180
4089886991611,4cyclictest4177147-21kworker/u16:1-events_unbound23:22:050
4089886991611,1cyclictest601rcuop/322:15:300
4089886991610,5cyclictest59814-21runrttasks21:17:210
4089886991610,5cyclictest230648-21/usr/sbin/munin22:55:270
4089886991610,5cyclictest221742-21/usr/sbin/munin22:50:250
4089888991512,1cyclictest0-21swapper/221:40:342
4089888991512,1cyclictest0-21swapper/221:05:262
408988799155,5cyclictest0-21swapper/100:05:241
4089887991512,2cyclictest43785-21diskmemload22:40:011
4089887991512,2cyclictest4089884-21cyclictest19:40:251
4089887991512,2cyclictest19866-21latency_hist20:50:021
4089887991512,2cyclictest115980-21aten2.4-expect21:50:211
4089887991511,3cyclictest3974023-21kworker/u16:0+nfsiod21:59:261
4089887991511,3cyclictest3974023-21kworker/u16:0+nfsiod21:20:461
4089887991511,3cyclictest203627-21kworker/u16:2+nfsiod00:00:531
4089887991511,2cyclictest0-21swapper/120:25:021
4089887991510,4cyclictest4089884-21cyclictest21:05:181
408988699157,4cyclictest4152801-21wc20:00:000
4089886991512,2cyclictest4190317-21fschecks_count20:30:240
4089886991512,2cyclictest4123622-21gltestperf19:35:210
4089886991512,2cyclictest4104169-21perf19:20:000
4089886991512,2cyclictest4092254-21kthreadcore19:10:250
4089886991512,2cyclictest4089884-21cyclictest20:25:020
4089886991512,2cyclictest348783-21kthreadcore00:00:240
4089886991512,2cyclictest31958-21latency_hist21:00:010
4089886991511,3cyclictest3974023-21kworker/u16:0+nfsiod21:24:150
4089888991411,1cyclictest0-21swapper/223:00:202
4089888991411,1cyclictest0-21swapper/219:55:012
408988799148,5cyclictest287139-21cut23:25:231
4089887991411,2cyclictest9244-21rtkit-daemon21:40:171
4089887991411,2cyclictest4177147-21kworker/u16:1-events_power_efficient23:00:161
4089887991411,2cyclictest391398-21tr00:25:231
4089887991411,2cyclictest27437-21kthreadcore20:55:251
4089887991411,2cyclictest2240602-1atopacctd23:40:211
4089887991410,3cyclictest4144779-21kthreadcore19:50:241
4089887991410,3cyclictest3107-21kthreadcore20:35:241
4089887991410,3cyclictest208880-21head22:40:271
408988699145,4cyclictest1755-21/usr/sbin/munin20:35:190
4089886991412,1cyclictest1695-21dbus-daemon20:10:010
4089886991411,2cyclictest8547-21gltestperf20:40:230
4089886991411,2cyclictest4186200-21kthreadcore20:25:270
4089886991411,2cyclictest4165988-21gltestperf20:10:240
4089886991411,2cyclictest4144231-21kthreadcore19:50:240
4089886991411,2cyclictest4135285-21cpuspeed_turbos19:45:190
4089886991411,2cyclictest4111413-21fschecks_time19:25:210
4089886991411,2cyclictest251183-21kthreadcore23:05:250
4089886991411,2cyclictest1-21systemd23:30:190
4089886991411,1cyclictest0-21swapper/019:10:010
4089886991410,3cyclictest4120461-21kthreadcore19:30:260
4089886991410,3cyclictest32329-21cpuspeed_turbos21:00:240
4089886991410,3cyclictest107840-21irqrtprio21:45:210
924598130,2rtkit-daemon4153243-21aten2.4-expect20:00:201
4089888991311,1cyclictest0-21swapper/221:00:222
4089888991310,1cyclictest0-21swapper/223:30:282
4089887991311,1cyclictest4089884-21cyclictest22:15:291
4089887991310,2cyclictest4112112-21kthreadcore19:25:241
4089887991310,2cyclictest0-21swapper/119:35:191
408988799130,7cyclictest4153005-21unin-run20:00:011
408988799129,2cyclictest32036-21/usr/sbin/munin21:00:231
408988799129,2cyclictest223032-21irqrtprio22:50:241
408988799129,2cyclictest1707-21polkitd19:10:001
408988799120,7cyclictest11832-21kthreadcore20:40:271
408988899111,7cyclictest0-21swapper/219:10:012
250109180,2phc2sys0-21swapper/319:05:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional