You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 09:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Thu Dec 04, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14900521050,2sleep30-21swapper/321:50:173
3883622230,2sleep20-21swapper/200:06:312
4121933992214,3cyclictest104506-21irqcore21:25:161
4121933992118,2cyclictest0-21swapper/119:15:011
4121933992115,2cyclictest170550irq/121-eno123:40:021
4121930992118,2cyclictest250996-21latency_hist22:50:010
4121930992111,9cyclictest0-21swapper/000:05:200
2399242210,1sleep10-21swapper/122:40:571
835298200,5rtkit-daemon4128200-21munin-node22:36:350
4121935992017,1cyclictest0-21swapper/220:15:002
4121935992016,1cyclictest0-21swapper/219:38:332
4121933992016,2cyclictest120667-21sh21:35:011
4121933992016,2cyclictest120667-21sh21:35:011
412193099207,5cyclictest78195-21idleruntime21:10:140
4121930992017,2cyclictest4136322-21idleruntime-cro19:20:000
4121930992017,2cyclictest4136322-21idleruntime-cro19:20:000
302487291200,2phc2sys0-21swapper/322:09:553
4121935991916,1cyclictest0-21swapper/223:20:002
412193399198,5cyclictest0-21swapper/122:15:131
4121933991916,2cyclictest374234-21fschecks_time00:00:141
4121933991915,3cyclictest4154576-21cron19:35:001
4121933991913,2cyclictest170550irq/121-eno121:20:191
4121933991911,3cyclictest0-21swapper/123:45:021
4121930991916,2cyclictest94572-21/usr/sbin/munin21:20:010
4121930991916,2cyclictest1652-1atopacctd20:55:000
4121930991916,2cyclictest1635-21dbus-daemon19:40:000
4121930991911,6cyclictest0-21swapper/023:50:170
412193099190,2cyclictest4173769-21cpuspeed_turbos19:50:110
302487291191,2phc2sys0-21swapper/323:00:443
302487291190,3phc2sys0-21swapper/322:16:513
302487291190,2phc2sys0-21swapper/300:39:483
4121935991815,1cyclictest0-21swapper/220:25:002
4121933991815,2cyclictest4136574-21cut19:20:021
4121933991815,2cyclictest4136574-21cut19:20:021
4121933991815,2cyclictest277534-21kworker/u16:3+events_unbound00:35:011
4121933991815,2cyclictest213013-21proc_pri22:25:201
4121933991815,2cyclictest0-21swapper/121:20:021
412193099189,8cyclictest0-21swapper/000:20:100
412193099188,6cyclictest233609-21kworker/u16:2-events_unbound23:27:100
412193099187,2cyclictest0-21swapper/022:30:120
4121930991815,2cyclictest259880-21grep22:55:010
4121930991815,2cyclictest1700-21systemd-logind23:10:000
4121930991815,2cyclictest120667-21/usr/sbin/munin21:35:010
4121930991815,2cyclictest120667-21/usr/sbin/munin21:35:010
4121930991813,4cyclictest1652-1atopacctd21:21:260
412193099181,2cyclictest0-21swapper/000:12:230
4121930991811,5cyclictest0-21swapper/021:40:020
4121930991810,6cyclictest0-21swapper/022:20:180
412193099180,2cyclictest263206-21kthreadcore22:55:180
412193099180,2cyclictest241rcuc/022:15:480
302487291181,2phc2sys0-21swapper/323:06:343
302487291180,2phc2sys0-21swapper/323:28:263
302487291180,2phc2sys0-21swapper/300:00:083
412193599171,6cyclictest0-21swapper/221:30:012
4121935991715,1cyclictest0-21swapper/221:55:022
4121935991714,1cyclictest0-21swapper/222:55:012
4121935991714,1cyclictest0-21swapper/222:05:012
4121935991714,1cyclictest0-21swapper/221:15:012
412193399174,5cyclictest77069-21wc21:10:001
412193399173,5cyclictest491rcuog/219:55:011
412193399172,9cyclictest174154-21awk22:05:181
4121933991714,2cyclictest82396-21ptp4l21:10:201
4121933991714,2cyclictest52510-21sh20:50:001
4121933991714,2cyclictest408976-21gltestperf00:20:141
4121933991714,2cyclictest1661-21polkitd19:45:021
4121933991714,2cyclictest0-21swapper/122:40:001
4121933991710,2cyclictest170550irq/121-eno120:06:111
4121933991710,2cyclictest170550irq/121-eno120:06:111
412193099178,2cyclictest0-21swapper/022:25:230
412193099176,6cyclictest0-21swapper/023:48:090
412193099171,6cyclictest0-21swapper/021:42:380
4121930991714,2cyclictest4173372-21cut19:50:020
4121930991714,2cyclictest34192-21grep20:35:000
4121930991714,2cyclictest303292-21idleruntime-cro23:20:000
4121930991714,2cyclictest0-21swapper/021:00:000
4121930991713,3cyclictest4123452-21kernelversion19:10:150
4121930991711,4cyclictest373259-21/usr/sbin/munin00:00:020
4121930991710,6cyclictest4121924-21cyclictest00:35:210
302487291170,4phc2sys0-21swapper/300:22:013
302487291170,2phc2sys0-21swapper/323:56:583
302487291170,2phc2sys0-21swapper/323:49:543
302487291170,2phc2sys0-21swapper/322:40:563
302487291170,2phc2sys0-21swapper/321:18:043
302487291170,2phc2sys0-21swapper/300:18:233
4121935991614,1cyclictest0-21swapper/221:40:012
4121935991613,1cyclictest0-21swapper/223:55:002
4121935991613,1cyclictest0-21swapper/222:26:032
4121935991613,1cyclictest0-21swapper/219:19:252
4121935991613,1cyclictest0-21swapper/219:19:252
4121935991613,1cyclictest0-21swapper/200:04:352
4121935991612,2cyclictest0-21swapper/223:40:192
4121935991612,2cyclictest0-21swapper/221:15:182
412193399163,6cyclictest170550irq/121-eno100:15:001
4121933991614,1cyclictest137900-21dump-pmu-power21:45:001
4121933991613,2cyclictest442552-21cron00:40:001
4121933991613,2cyclictest4185435-21systemctl20:00:021
4121933991613,2cyclictest4159762-21pmu-power19:35:201
4121933991613,2cyclictest321197-21systemd-run23:30:021
4121933991613,2cyclictest1661-21polkitd22:25:011
4121933991613,2cyclictest138384-21aten_repower_en21:45:121
4121933991613,2cyclictest129195-21latency_hist21:40:001
4121933991613,2cyclictest1-21systemd23:20:111
4121933991613,2cyclictest0-21swapper/121:55:011
4121933991612,3cyclictest4189880-21kthreadcore20:00:181
4121933991612,3cyclictest4145484-21kthreadcore19:25:161
4121933991612,3cyclictest365804-21irqcore23:55:151
4121933991612,3cyclictest1652-1atopacctd23:10:181
412193399160,10cyclictest190004-21ssh22:14:471
412193099168,6cyclictest0-21swapper/023:30:160
412193099168,6cyclictest0-21swapper/022:40:080
412193099161,8cyclictest0-21swapper/000:30:230
4121930991613,2cyclictest4121924-21cyclictest21:50:010
4121930991613,2cyclictest4121924-21cyclictest20:25:010
4121930991613,2cyclictest334884-21head23:35:210
4121930991613,2cyclictest309222-21unixbench_singl23:20:240
4121930991613,2cyclictest2608-21head20:05:220
4121930991613,2cyclictest2608-21head20:05:220
4121930991613,2cyclictest171ktimers/000:01:130
4121930991613,2cyclictest1700-21systemd-logind21:05:010
4121930991613,2cyclictest1652-1atopacctd00:25:120
4121930991612,3cyclictest404677-21mailstats00:15:240
4121930991610,5cyclictest338694-21/usr/sbin/munin23:40:170
302487291160,3phc2sys0-21swapper/322:14:473
302487291160,2phc2sys0-21swapper/322:29:063
302487291160,2phc2sys0-21swapper/321:47:273
302487291160,2phc2sys0-21swapper/321:33:233
302487291160,2phc2sys0-21swapper/321:33:233
302487291160,2phc2sys0-21swapper/320:00:203
412193599151,3cyclictest0-21swapper/200:20:012
4121935991513,1cyclictest0-21swapper/222:40:172
4121935991512,1cyclictest0-21swapper/223:50:002
4121935991512,1cyclictest0-21swapper/223:25:002
4121935991512,1cyclictest0-21swapper/223:15:002
4121935991512,1cyclictest0-21swapper/222:40:012
4121935991512,1cyclictest0-21swapper/222:35:002
4121935991512,1cyclictest0-21swapper/219:10:222
4121935991512,1cyclictest0-21swapper/200:30:222
4121935991512,1cyclictest0-21swapper/200:30:012
412193399159,2cyclictest170550irq/121-eno122:00:101
412193399155,2cyclictest170550irq/121-eno123:48:091
412193399153,7cyclictest164780-21kworker/u16:4+nfsiod22:30:231
412193399153,6cyclictest163515-21diskmemload21:59:071
412193399152,7cyclictest255110-21kthreadcore22:50:181
412193399151,9cyclictest275365-21runrttasks23:01:471
4121933991512,2cyclictest4137314-21cut19:20:141
4121933991512,2cyclictest27454-21timerandwakeup20:25:201
4121933991512,2cyclictest13064-21kthreadcore20:15:161
4121933991512,2cyclictest0-21swapper/121:00:001
4121933991511,3cyclictest43384-21kthreadcore20:40:181
4121933991511,3cyclictest402407-21kthreadcore00:15:201
4121933991511,3cyclictest33216-21cut20:30:191
4121933991511,3cyclictest243831-21irqcore22:45:141
4121933991511,2cyclictest0-21swapper/119:10:021
412193399150,8cyclictest382364-21cut00:05:131
412193099158,5cyclictest0-21swapper/022:00:170
412193099155,8cyclictest171ktimers/020:15:140
412193099155,2cyclictest104857-21kthreadcore21:25:170
412193099151,8cyclictest0-21swapper/023:12:380
4121930991512,2cyclictest277440-21latency_hist23:05:010
4121930991512,2cyclictest173332-21tail22:05:130
4121930991512,2cyclictest1700-21systemd-logind19:30:250
4121930991512,2cyclictest156114-21cpuspeed_turbos21:55:110
4121930991511,3cyclictest4182297-21kthreadcore19:55:180
4121930991511,3cyclictest4162658-21kthreadcore19:40:150
302487291151,4phc2sys0-21swapper/322:00:093
302487291150,4phc2sys0-21swapper/322:53:423
302487291150,3phc2sys0-21swapper/320:20:243
302487291150,2phc2sys0-21swapper/322:24:133
302487291150,2phc2sys0-21swapper/300:25:223
412193599147,4cyclictest0-21swapper/222:00:012
412193599141,7cyclictest0-21swapper/200:40:012
4121935991412,1cyclictest0-21swapper/223:30:162
4121935991412,1cyclictest0-21swapper/223:05:022
4121935991412,1cyclictest0-21swapper/220:20:012
4121935991411,1cyclictest0-21swapper/223:57:582
4121935991411,1cyclictest0-21swapper/223:25:202
4121935991411,1cyclictest0-21swapper/222:45:122
4121935991411,1cyclictest0-21swapper/222:20:232
4121935991411,1cyclictest0-21swapper/222:05:172
4121935991411,1cyclictest0-21swapper/221:45:162
4121935991411,1cyclictest0-21swapper/221:40:152
4121935991411,1cyclictest0-21swapper/220:50:002
4121935991411,1cyclictest0-21swapper/200:20:152
412193399144,6cyclictest295143-21aten2.4-expect23:15:111
412193399141,8cyclictest2025-21snmpd23:50:191
412193399141,5cyclictest260674-21tr22:55:121
4121933991411,2cyclictest5643-21kthreadcore20:10:161
4121933991411,2cyclictest4121924-21cyclictest21:00:231
4121933991411,2cyclictest322100-21gltestperf23:30:121
4121933991411,2cyclictest277704-21aten_repower_cu23:05:101
4121933991410,3cyclictest419828-21kthreadcore00:25:201
4121933991410,3cyclictest18808-21kthreadcore20:20:201
412193099147,5cyclictest170550irq/121-eno122:10:470
412193099146,6cyclictest24046-21tr20:25:140
4121930991411,2cyclictest46615-21systemd-run20:45:020
4121930991411,2cyclictest4145387-21kthreadcore19:25:150
4121930991411,2cyclictest4121924-21cyclictest20:10:120
4121930991411,2cyclictest147675-21forks21:50:140
4121930991410,3cyclictest46735-21aten_repower_en20:45:090
302487291141,4phc2sys0-21swapper/300:11:183
302487291140,3phc2sys0-21swapper/319:58:503
302487291140,2phc2sys0-21swapper/323:41:503
302487291140,2phc2sys0-21swapper/323:21:053
302487291140,2phc2sys0-21swapper/321:22:133
412193599131,3cyclictest0-21swapper/220:40:012
4121935991311,1cyclictest0-21swapper/221:05:222
4121935991311,1cyclictest0-21swapper/219:10:022
4121935991310,1cyclictest0-21swapper/222:55:182
4121935991310,1cyclictest0-21swapper/222:13:112
4121935991310,1cyclictest0-21swapper/221:30:182
4121935991310,1cyclictest0-21swapper/221:30:182
4121935991310,1cyclictest0-21swapper/221:00:162
4121935991310,1cyclictest0-21swapper/220:00:182
4121935991310,1cyclictest0-21swapper/219:55:232
4121935991310,1cyclictest0-21swapper/219:40:222
4121935991310,1cyclictest0-21swapper/219:25:212
412193599130,9cyclictest0-21swapper/223:01:102
4121933991310,2cyclictest4167132-21aten_repower_cu19:45:091
412193399130,4cyclictest56642-21tr20:50:181
4121930991310,2cyclictest71308-21aten_repower_cu21:05:100
4121930991310,2cyclictest4139415-21kthreadcore19:20:180
4121930991310,2cyclictest35171-21gltestperf20:35:140
4121930991310,2cyclictest1700-21systemd-logind20:05:000
302487291130,2phc2sys0-21swapper/323:17:243
302487291130,2phc2sys0-21swapper/322:33:293
412193599129,1cyclictest0-21swapper/221:24:102
412193599129,1cyclictest0-21swapper/220:30:112
412193599129,1cyclictest0-21swapper/220:05:382
412193599129,1cyclictest0-21swapper/220:05:382
412193599129,1cyclictest0-21swapper/219:45:092
412193599128,2cyclictest0-21swapper/220:55:142
4121935991210,1cyclictest0-21swapper/223:35:182
4121935991210,1cyclictest0-21swapper/222:16:122
4121935991210,1cyclictest0-21swapper/219:30:132
412193399129,2cyclictest35765-21irqrtprio20:35:161
412193099129,2cyclictest1635-21dbus-daemon19:10:020
302487291122,2phc2sys0-21swapper/319:15:223
302487291122,2phc2sys0-21swapper/319:15:223
302487291121,2phc2sys0-21swapper/321:00:173
302487291121,2phc2sys0-21swapper/320:09:363
302487291121,2phc2sys0-21swapper/320:09:363
302487291121,2phc2sys0-21swapper/300:32:433
302487291120,3phc2sys0-21swapper/320:45:023
302487291120,2phc2sys0-21swapper/323:30:093
302487291120,2phc2sys0-21swapper/322:46:543
302487291120,2phc2sys0-21swapper/321:44:143
412193599119,1cyclictest0-21swapper/220:50:172
412193599119,1cyclictest0-21swapper/220:40:182
412193599119,1cyclictest0-21swapper/220:25:052
412193599119,1cyclictest0-21swapper/219:21:362
302487291112,2phc2sys0-21swapper/319:55:013
302487291111,3phc2sys0-21swapper/320:15:173
302487291111,2phc2sys0-21swapper/319:25:083
302487291110,3phc2sys0-21swapper/321:00:013
302487291110,3phc2sys0-21swapper/319:35:213
302487291110,3phc2sys0-21swapper/319:10:093
302487291110,2phc2sys0-21swapper/322:59:023
302487291110,2phc2sys0-21swapper/321:36:033
302487291110,2phc2sys0-21swapper/320:31:003
412193599108,1cyclictest0-21swapper/200:10:222
412193599106,2cyclictest0-21swapper/219:50:102
302487291101,3phc2sys0-21swapper/321:27:463
302487291101,2phc2sys0-21swapper/323:52:263
302487291101,2phc2sys0-21swapper/322:36:003
302487291101,2phc2sys0-21swapper/320:35:163
302487291101,2phc2sys0-21swapper/319:35:023
302487291100,4phc2sys0-21swapper/319:05:113
302487291100,3phc2sys0-21swapper/323:10:183
302487291100,2phc2sys0-21swapper/323:36:593
302487291100,2phc2sys0-21swapper/321:56:083
302487291100,2phc2sys0-21swapper/320:54:553
302487291100,2phc2sys0-21swapper/320:25:153
302487291100,2phc2sys0-21swapper/319:22:463
302487291100,2phc2sys0-21swapper/300:05:253
30248729191,2phc2sys0-21swapper/320:45:143
30248729190,2phc2sys0-21swapper/321:10:433
30248729190,2phc2sys0-21swapper/321:05:023
30248729190,2phc2sys0-21swapper/320:10:203
30248729190,2phc2sys0-21swapper/319:45:113
30248729190,2phc2sys0-21swapper/319:40:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional