You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 10:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Tue Dec 02, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27789822230,2sleep30-21swapper/320:55:233
63838621020,3sleep30-21swapper/300:27:483
3972072610,2sleep30-21swapper/322:10:183
4761682320,1sleep00-21swapper/022:55:190
4761682320,1sleep00-21swapper/022:55:190
142688993024,2cyclictest170550irq/121-eno121:15:021
4951352290,1sleep10-21swapper/123:05:221
142687992320,2cyclictest1-21systemd22:35:000
4377152220,1sleep20-21swapper/222:32:172
142689992215,3cyclictest0-21swapper/222:50:122
142687992211,4cyclictest570627-21tr23:50:130
142689992119,1cyclictest0-21swapper/223:20:012
142688992115,2cyclictest170550irq/121-eno122:25:001
142687992118,2cyclictest509119-21perf23:15:000
142687992118,2cyclictest413241-21grep22:20:010
142687992115,5cyclictest142685-21cyclictest23:20:240
142687992114,6cyclictest489080-21runrttasks23:00:320
142687992112,5cyclictest1700-21systemd-logind21:45:010
142688992014,5cyclictest0-21swapper/100:30:001
142688992013,2cyclictest8734-21sendmail-mta00:24:531
142687992010,5cyclictest0-21swapper/022:05:020
302487291190,2phc2sys0-21swapper/300:24:413
302471791190,2ptp4l0-21swapper/323:55:313
1617822190,2sleep20-21swapper/219:20:212
142689991916,1cyclictest0-21swapper/222:56:412
142689991916,1cyclictest0-21swapper/222:56:412
142689991916,1cyclictest0-21swapper/200:35:002
142688991916,2cyclictest187710-21ls19:45:011
142688991916,2cyclictest1700-21systemd-logind22:05:011
142688991911,3cyclictest303505-21kthreadcore21:15:191
142688991911,3cyclictest0-21swapper/122:55:011
14268799199,5cyclictest448834-21apt22:40:130
142687991913,5cyclictest527933-21irqcore23:25:190
302487291181,6phc2sys0-21swapper/321:00:143
302487291180,2phc2sys0-21swapper/323:40:413
142689991815,1cyclictest0-21swapper/222:05:212
142688991815,2cyclictest1704-21rs:main1
142688991815,2cyclictest163106-21apt-get19:25:001
142688991811,3cyclictest425239-21kthreadcore22:25:221
142688991810,6cyclictest0-21swapper/120:10:011
142688991810,3cyclictest622444-21systemd00:20:021
142687991816,1cyclictest0-21swapper/022:40:000
14268799181,5cyclictest2793143-1atop20:10:010
142687991815,2cyclictest1661-21polkitd19:25:000
142687991815,2cyclictest0-21swapper/000:20:010
142687991812,5cyclictest413696-21cpu22:20:160
142687991811,4cyclictest596020-21latency_hist00:05:010
142687991811,4cyclictest273225-21kworker/u16:3-rpciod21:24:010
142687991810,4cyclictest0-21swapper/019:45:190
302487291170,3phc2sys0-21swapper/323:55:013
302487291170,3phc2sys0-21swapper/319:35:143
302487291170,2phc2sys0-21swapper/322:43:243
302487291170,2phc2sys0-21swapper/321:58:293
302487291170,2phc2sys0-21swapper/321:35:483
302487291170,2phc2sys0-21swapper/321:17:453
302487291170,2phc2sys0-21swapper/320:30:253
142689991715,1cyclictest0-21swapper/221:35:012
142689991715,1cyclictest0-21swapper/221:35:012
142689991715,1cyclictest0-21swapper/220:50:022
142689991714,1cyclictest0-21swapper/222:25:012
142689991714,1cyclictest0-21swapper/222:03:122
14268899179,3cyclictest0-21swapper/123:30:201
142688991714,2cyclictest142685-21cyclictest20:00:171
142688991714,2cyclictest0-21swapper/122:40:011
142688991712,3cyclictest0-21swapper/120:20:011
142688991710,6cyclictest317977-21chrt21:25:111
14268799179,7cyclictest0-21swapper/023:10:000
14268799179,4cyclictest607568-21kthreadcore00:10:210
14268799179,4cyclictest302428-21kthreadcore21:15:180
142687991714,2cyclictest423123-21gltestperf22:25:170
142687991714,2cyclictest242656-21apt-key20:30:010
142687991714,2cyclictest1700-21systemd-logind21:05:000
142687991713,2cyclictest343803-21sh21:40:020
302487291160,3phc2sys0-21swapper/323:32:113
302487291160,2phc2sys0-21swapper/322:23:583
302487291160,2phc2sys0-21swapper/321:42:543
302487291160,2phc2sys0-21swapper/321:22:263
302487291160,2phc2sys0-21swapper/300:35:553
142689991614,1cyclictest0-21swapper/223:45:012
142689991614,1cyclictest0-21swapper/223:40:012
142689991613,1cyclictest0-21swapper/221:40:142
142689991613,1cyclictest0-21swapper/221:30:002
142689991613,1cyclictest0-21swapper/219:55:002
142689991613,1cyclictest0-21swapper/219:45:012
142689991613,1cyclictest0-21swapper/200:40:022
142689991613,1cyclictest0-21swapper/200:25:162
142689991613,1cyclictest0-21swapper/200:20:012
142689991613,1cyclictest0-21swapper/200:15:012
142689991610,3cyclictest0-21swapper/223:50:112
14268999160,2cyclictest0-21swapper/221:50:132
14268899169,1cyclictest170550irq/121-eno122:00:011
142688991613,2cyclictest431797-21cut22:30:171
142688991613,2cyclictest352350-21latency_hist21:45:001
142688991613,2cyclictest329585-21kthreadcore21:30:191
142688991613,2cyclictest329585-21kthreadcore21:30:191
142688991613,2cyclictest311620-21kthreadcore21:20:191
142688991613,2cyclictest149072-21sh19:15:011
142688991612,3cyclictest653934-21mailstats00:35:251
142688991612,3cyclictest421798-21kworker/u16:3+nfsiod00:07:331
142688991612,3cyclictest219234-21gltestperf20:10:171
14268799169,6cyclictest0-21swapper/021:10:010
14268799168,1cyclictest0-21swapper/023:45:180
14268799168,1cyclictest0-21swapper/022:05:180
14268799165,6cyclictest327421-21gltestperf21:30:160
14268799165,6cyclictest327421-21gltestperf21:30:160
14268799161,5cyclictest0-21swapper/000:22:130
142687991614,1cyclictest587522-21latency_hist00:00:020
142687991614,1cyclictest0-21swapper/022:50:010
142687991613,2cyclictest370772-21grep21:55:180
142687991613,2cyclictest1635-21dbus-daemon21:00:010
142687991613,2cyclictest142685-21cyclictest21:25:220
142687991613,2cyclictest142685-21cyclictest19:25:240
142687991611,4cyclictest1-21systemd22:54:150
835298150,6rtkit-daemon2025-21snmpd20:03:140
302487291154,2phc2sys0-21swapper/300:12:433
302487291150,5phc2sys0-21swapper/323:06:503
302487291150,2phc2sys0-21swapper/323:48:423
302487291150,2phc2sys0-21swapper/322:49:503
14268999156,3cyclictest0-21swapper/220:25:022
14268999153,9cyclictest0-21swapper/223:55:282
142689991513,1cyclictest0-21swapper/222:20:022
142689991512,1cyclictest0-21swapper/223:30:012
142689991512,1cyclictest0-21swapper/223:09:552
142689991512,1cyclictest0-21swapper/222:00:012
142689991512,1cyclictest0-21swapper/221:23:422
142689991512,1cyclictest0-21swapper/221:16:152
142689991512,1cyclictest0-21swapper/221:15:012
14268899159,2cyclictest170550irq/121-eno119:45:191
14268899158,3cyclictest366351-21/usr/sbin/munin21:50:231
142688991512,2cyclictest596395-21apt-key00:05:021
142688991512,2cyclictest401521-21unixbench_multi22:10:261
142688991512,2cyclictest395665-21sort22:10:011
142688991512,2cyclictest291442-21diskmemload00:30:241
142688991512,2cyclictest280233-21fschecks_count21:00:171
142688991512,2cyclictest180873-21mailstats19:35:241
142688991512,2cyclictest1661-21polkitd23:25:011
142688991512,2cyclictest1661-21polkitd22:40:251
142688991512,2cyclictest1631-21gmain22:18:151
142688991511,3cyclictest509241-21kworker/u16:1+nfsiod23:29:191
142688991511,3cyclictest482599-21kworker/u16:0+nfsiod23:11:301
142688991511,3cyclictest421798-21kworker/u16:3+nfsiod23:57:591
142688991511,3cyclictest421798-21kworker/u16:3+nfsiod23:01:501
142688991511,3cyclictest290520-21pmu-power21:05:231
142688991511,2cyclictest0-21swapper/120:00:011
142688991511,2cyclictest0-21swapper/120:00:011
142688991510,4cyclictest175064-21grep19:30:271
14268799152,1cyclictest0-21swapper/000:40:010
142687991513,1cyclictest559584-21rm23:42:180
142687991513,1cyclictest0-21swapper/023:40:010
142687991512,2cyclictest536929-21kthreadcore23:30:210
142687991512,2cyclictest515007-21sed23:15:260
142687991512,2cyclictest366466-21mailstats21:50:240
142687991512,2cyclictest267246-21munin-plugin-st20:50:010
142687991512,2cyclictest170554-21smartctl19:30:180
142687991510,4cyclictest396092-21aten2.4-expect22:10:120
14268799150,2cyclictest639689-21apt00:30:000
302487291140,3phc2sys0-21swapper/321:12:233
302487291140,2phc2sys0-21swapper/323:00:043
302487291140,2phc2sys0-21swapper/300:15:123
142689991412,1cyclictest0-21swapper/223:20:162
142689991412,1cyclictest0-21swapper/223:10:202
142689991412,1cyclictest0-21swapper/223:05:002
142689991412,1cyclictest0-21swapper/220:10:012
142689991412,1cyclictest0-21swapper/200:05:022
142689991411,1cyclictest0-21swapper/223:30:222
142689991411,1cyclictest0-21swapper/222:40:222
142689991411,1cyclictest0-21swapper/222:10:172
142689991411,1cyclictest0-21swapper/221:00:212
142689991411,1cyclictest0-21swapper/220:15:202
142689991411,1cyclictest0-21swapper/220:10:162
142689991411,1cyclictest0-21swapper/219:45:202
142689991411,1cyclictest0-21swapper/219:15:022
142689991411,1cyclictest0-21swapper/200:10:022
142689991410,2cyclictest0-21swapper/222:35:272
14268899145,2cyclictest170550irq/121-eno119:17:331
14268899144,5cyclictest613741-21cat00:15:011
14268899142,6cyclictest0-21swapper/119:30:021
14268899141,7cyclictest479346-21cut22:55:211
14268899141,7cyclictest479346-21cut22:55:211
142688991411,2cyclictest574910-21kthreadcore23:50:201
142688991411,2cyclictest547109-21kthreadcore23:35:211
14268899141,12cyclictest267120-21idleruntime-cro20:50:001
142688991411,2cyclictest248062-21mailstats20:30:251
142688991411,2cyclictest0-21swapper/123:20:001
142688991410,3cyclictest461781-21kthreadcore22:45:211
142688991410,3cyclictest343631-21kworker/u16:2+nfsiod23:49:201
142688991410,3cyclictest1635-21dbus-daemon20:30:011
142688991410,2cyclictest0-21swapper/119:10:011
14268799147,1cyclictest0-21swapper/019:50:130
14268799146,4cyclictest352752-21/usr/sbin/munin21:45:190
14268799142,3cyclictest292257-21cpuspeed_turbos21:10:140
14268799141,6cyclictest218579-21aten_repower_fr20:10:140
142687991411,2cyclictest260277-21mailstats20:40:240
142687991411,2cyclictest231992-21sort20:20:200
142687991411,2cyclictest178624-21kthreadcore19:35:200
142687991411,2cyclictest1652-1atopacctd19:10:200
142687991411,2cyclictest155862-21latency19:15:210
142687991411,2cyclictest142698-21unin-run19:10:000
302487291131,3phc2sys0-21swapper/320:15:143
302487291130,4phc2sys0-21swapper/322:50:183
302487291130,3phc2sys0-21swapper/319:20:193
302487291130,2phc2sys0-21swapper/323:20:013
302487291130,2phc2sys0-21swapper/322:57:223
302487291130,2phc2sys0-21swapper/322:57:223
302487291130,2phc2sys0-21swapper/322:04:143
302487291130,2phc2sys0-21swapper/321:28:233
302487291130,2phc2sys0-21swapper/319:29:133
142689991311,1cyclictest0-21swapper/221:40:002
142689991311,1cyclictest0-21swapper/220:55:002
142689991311,1cyclictest0-21swapper/220:30:182
142689991310,1cyclictest0-21swapper/223:50:012
142689991310,1cyclictest0-21swapper/221:45:142
142689991310,1cyclictest0-21swapper/220:35:192
142689991310,1cyclictest0-21swapper/220:00:192
142689991310,1cyclictest0-21swapper/219:40:012
142689991310,1cyclictest0-21swapper/219:30:192
142689991310,1cyclictest0-21swapper/219:25:212
142689991310,1cyclictest0-21swapper/200:20:192
14268899139,3cyclictest343631-21kworker/u16:2+nfsiod21:49:171
14268899139,3cyclictest338810-21kthreadcore21:35:201
142688991310,2cyclictest274830-21kthreadcore20:55:221
142688991310,2cyclictest268888-21kthreadcore20:50:201
142688991310,2cyclictest255249-21/usr/sbin/munin20:40:251
142688991310,2cyclictest249885-21gltestperf20:35:161
142688991310,2cyclictest233672-21kthreadcore20:20:211
142688991310,2cyclictest195419-21kthreadcore19:50:201
14268799134,8cyclictest182031-21cut19:40:140
14268799131,7cyclictest0-21swapper/020:50:150
14268799131,6cyclictest640246-21aten2.4-expect00:30:120
142687991310,2cyclictest229685-21threads20:15:260
142687991310,2cyclictest200943-21gltestperf19:55:180
142687991310,2cyclictest200943-21gltestperf19:55:180
142687991310,2cyclictest1-21systemd20:35:010
142687991310,2cyclictest0-21swapper/000:05:020
3269492120,2sleep30-21swapper/321:30:143
3269492120,2sleep30-21swapper/321:30:143
302487291123,2phc2sys0-21swapper/319:55:213
302487291123,2phc2sys0-21swapper/319:55:213
302487291120,3phc2sys0-21swapper/319:05:123
302487291120,2phc2sys0-21swapper/322:06:583
302487291120,2phc2sys0-21swapper/320:21:273
302487291120,2phc2sys0-21swapper/320:07:403
302487291120,2phc2sys0-21swapper/319:16:583
14268999129,1cyclictest0-21swapper/221:05:202
14268999129,1cyclictest0-21swapper/220:55:212
142689991210,1cyclictest0-21swapper/222:45:172
142689991210,1cyclictest0-21swapper/222:30:012
142689991210,1cyclictest0-21swapper/219:59:212
142689991210,1cyclictest0-21swapper/219:59:212
142689991210,1cyclictest0-21swapper/219:15:022
142689991210,1cyclictest0-21swapper/219:10:012
14268799129,2cyclictest249268-21aten_repower_fr20:35:130
302487291111,4phc2sys0-21swapper/320:40:133
302487291111,3phc2sys0-21swapper/319:45:193
302487291111,2phc2sys0-21swapper/321:50:233
302487291110,3phc2sys0-21swapper/320:55:013
302487291110,3phc2sys0-21swapper/320:35:133
302487291110,3phc2sys0-21swapper/320:00:143
302487291110,2phc2sys0-21swapper/323:35:473
302487291110,2phc2sys0-21swapper/323:12:523
302487291110,2phc2sys0-21swapper/322:34:553
302487291110,2phc2sys0-21swapper/322:27:063
302487291110,2phc2sys0-21swapper/300:06:343
302487291110,2phc2sys0-21swapper/300:04:383
14268999118,2cyclictest0-21swapper/220:40:132
14268999118,2cyclictest0-21swapper/220:25:162
302487291101,3phc2sys0-21swapper/319:50:203
302487291101,2phc2sys0-21swapper/323:20:133
302487291100,4phc2sys0-21swapper/319:10:123
302487291100,3phc2sys0-21swapper/322:35:163
302487291100,2phc2sys0-21swapper/322:15:123
302487291100,2phc2sys0-21swapper/321:46:393
302487291100,2phc2sys0-21swapper/300:30:103
30248729190,4phc2sys0-21swapper/320:45:143
30248729190,2phc2sys0-21swapper/323:25:103
30248729190,2phc2sys0-21swapper/321:05:273
30248729190,2phc2sys0-21swapper/320:10:173
30248729190,2phc2sys0-21swapper/319:33:493
30248729180,3phc2sys0-21swapper/319:40:023
30248729180,2phc2sys0-21swapper/320:25:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional