You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 00:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Tue Nov 25, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
302487291372,12phc2sys0-21swapper/311:30:013
1198562370,2sleep30-21swapper/309:50:333
4090068992315,4cyclictest207111-21sendmail_mailtr10:40:330
4090069992219,2cyclictest7979-21grep08:40:001
4090068992211,6cyclictest0-21swapper/009:35:020
4090070992119,1cyclictest0-21swapper/211:45:012
4090070992118,1cyclictest0-21swapper/207:20:002
4090068992111,5cyclictest0-21swapper/011:20:010
4090068992110,6cyclictest0-21swapper/012:10:010
835298200,3rtkit-daemon4096169-21munin-node11:27:190
835298200,3rtkit-daemon2025-21snmpd10:50:030
4090070992017,1cyclictest0-21swapper/210:55:012
4090070992017,1cyclictest0-21swapper/210:25:012
4090070992017,1cyclictest0-21swapper/207:45:002
4090069992017,2cyclictest1629-21avahi-daemon11:40:001
4090069992013,3cyclictest74256-21kthreadcore09:25:301
4090068992011,5cyclictest117134-21kthreadcore09:50:300
408872200,3sleep30-21swapper/309:05:283
835298190,2rtkit-daemon0-21swapper/007:52:500
4090070991916,1cyclictest0-21swapper/208:24:552
4090069991916,2cyclictest1700-21systemd-logind12:00:021
4090069991916,2cyclictest1700-21systemd-logind10:15:011
4090069991916,2cyclictest1700-21systemd-logind08:00:011
4090069991911,3cyclictest0-21swapper/111:50:011
4090068991918,1cyclictest0-21swapper/009:47:150
4090068991916,2cyclictest4096089-21wc07:15:000
4090068991916,2cyclictest375480-21systemd-run12:20:010
4090068991915,2cyclictest1629-21avahi-daemon09:20:020
409006899190,1cyclictest0-21swapper/012:10:350
3024872911910,2phc2sys0-21swapper/308:00:013
4090070991816,1cyclictest0-21swapper/209:45:292
4090070991816,1cyclictest0-21swapper/209:25:292
409007099181,5cyclictest0-21swapper/211:40:012
4090070991815,1cyclictest0-21swapper/212:35:282
4090070991815,1cyclictest0-21swapper/212:25:312
4090070991815,1cyclictest0-21swapper/212:10:012
4090070991815,1cyclictest0-21swapper/211:30:332
4090070991815,1cyclictest0-21swapper/211:20:362
4090070991815,1cyclictest0-21swapper/209:10:022
4090070991815,1cyclictest0-21swapper/208:30:002
4090070991815,1cyclictest0-21swapper/208:05:292
4090070991815,1cyclictest0-21swapper/208:00:322
4090070991815,1cyclictest0-21swapper/207:30:302
4090069991814,3cyclictest4128134-21timerandwakeup07:35:341
4090069991814,2cyclictest0-21swapper/107:45:021
409006899188,6cyclictest177691-21kthreadcore10:25:260
409006899185,7cyclictest4110915-21aten_repower_po07:25:220
302487291181,2phc2sys0-21swapper/307:40:223
302487291180,3phc2sys0-21swapper/312:32:213
302487291180,2phc2sys0-21swapper/311:35:463
302487291180,2phc2sys0-21swapper/308:45:013
409007099175,2cyclictest0-21swapper/211:30:012
4090070991715,1cyclictest0-21swapper/212:30:292
4090070991715,1cyclictest0-21swapper/210:35:292
4090070991715,1cyclictest0-21swapper/210:15:312
4090070991715,1cyclictest0-21swapper/209:50:302
4090070991715,1cyclictest0-21swapper/208:55:292
4090070991714,1cyclictest0-21swapper/212:10:292
4090070991714,1cyclictest0-21swapper/211:45:282
4090070991714,1cyclictest0-21swapper/210:00:282
4090070991714,1cyclictest0-21swapper/209:40:282
4090070991714,1cyclictest0-21swapper/209:20:282
4090070991714,1cyclictest0-21swapper/208:50:012
4090070991714,1cyclictest0-21swapper/207:50:272
4090070991714,1cyclictest0-21swapper/207:45:262
4090070991714,1cyclictest0-21swapper/207:10:252
409006999179,3cyclictest0-21swapper/112:15:011
409006999171,6cyclictest325968-21grep11:50:301
4090069991714,2cyclictest4098069-21fschecks_time07:15:021
4090069991714,2cyclictest349530-21cut12:05:021
4090069991714,2cyclictest212245-21kthreadcore10:45:271
4090069991714,2cyclictest1803-21gdbus10:55:021
4090069991714,2cyclictest175372-21systemd-run10:25:011
4090069991714,2cyclictest105998-21latency_hist09:45:021
4090069991713,3cyclictest4179292-21kthreadcore08:20:301
4090069991713,2cyclictest0-21swapper/109:50:011
409006999171,1cyclictest123555-21apt-get09:55:201
409006999171,1cyclictest123555-21apt-get09:55:201
409006899179,6cyclictest0-21swapper/011:55:010
4090068991714,2cyclictest0-21swapper/009:45:000
4090068991713,3cyclictest171ktimers/011:01:410
4090068991713,2cyclictest0-21swapper/010:25:010
409006899170,15cyclictest311612-21ssh11:40:330
409006899170,12cyclictest0-21swapper/012:01:050
302487291170,3phc2sys0-21swapper/311:08:003
302487291170,3phc2sys0-21swapper/310:02:293
302487291170,2phc2sys0-21swapper/310:11:023
302487291170,2phc2sys0-21swapper/309:57:443
302487291170,2phc2sys0-21swapper/309:57:443
302487291170,2phc2sys0-21swapper/309:49:423
302487291170,2phc2sys0-21swapper/309:26:063
4090070991614,1cyclictest0-21swapper/212:00:322
4090070991614,1cyclictest0-21swapper/211:15:302
4090070991614,1cyclictest0-21swapper/210:45:262
4090070991614,1cyclictest0-21swapper/210:40:292
4090070991614,1cyclictest0-21swapper/210:15:022
4090070991614,1cyclictest0-21swapper/210:10:002
4090070991614,1cyclictest0-21swapper/209:10:302
4090070991614,1cyclictest0-21swapper/207:55:302
4090070991614,1cyclictest0-21swapper/207:35:282
4090070991613,1cyclictest0-21swapper/212:20:542
4090070991613,1cyclictest0-21swapper/211:55:292
4090070991613,1cyclictest0-21swapper/211:15:002
4090070991613,1cyclictest0-21swapper/211:05:292
4090070991613,1cyclictest0-21swapper/210:30:302
4090070991613,1cyclictest0-21swapper/209:20:012
4090070991613,1cyclictest0-21swapper/208:35:302
4090070991613,1cyclictest0-21swapper/208:15:282
4090070991613,1cyclictest0-21swapper/208:10:282
4090070991612,2cyclictest0-21swapper/209:30:232
409006999169,3cyclictest114909-21/usr/sbin/munin09:50:301
4090069991613,2cyclictest8499-21cpu08:40:241
4090069991613,2cyclictest44919-21latency_hist09:10:021
4090069991613,2cyclictest245239-21systemd-run11:05:011
4090069991612,3cyclictest384905-21cpuspeed_turbos12:25:251
4090069991612,3cyclictest357984-21kworker/u16:3+nfsiod12:24:471
4090069991611,4cyclictest1652-1atopacctd10:00:301
409006899168,4cyclictest0-21swapper/010:35:290
409006899167,4cyclictest0-21swapper/007:20:220
409006899166,2cyclictest0-21swapper/012:30:200
409006899164,8cyclictest71150-21systemctl09:25:020
4090068991613,2cyclictest387487-21kthreadcore12:25:300
4090068991613,2cyclictest305915-21latency_hist11:40:000
4090068991613,2cyclictest20438-21systemd-run08:50:010
4090068991613,2cyclictest159179-21grep10:15:270
4090068991610,2cyclictest4129210-21aten_repower_po07:40:230
302487291160,2phc2sys0-21swapper/311:21:153
302487291160,2phc2sys0-21swapper/311:11:463
302487291160,2phc2sys0-21swapper/310:16:523
4090070991513,1cyclictest0-21swapper/212:15:292
4090070991513,1cyclictest0-21swapper/210:25:222
4090070991513,1cyclictest0-21swapper/209:35:232
4090070991513,1cyclictest0-21swapper/208:50:322
4090070991512,1cyclictest0-21swapper/211:50:272
4090070991512,1cyclictest0-21swapper/211:00:262
4090070991512,1cyclictest0-21swapper/207:25:022
4090070991511,2cyclictest0-21swapper/208:40:232
409006999159,2cyclictest170550irq/121-eno111:44:551
4090069991513,1cyclictest205749-21kthreadcore10:40:291
4090069991512,2cyclictest91181-21kthreadcore09:35:291
4090069991512,2cyclictest4096778-21latency_hist07:15:011
4090069991512,2cyclictest297480-21systemd-run11:35:011
4090069991512,2cyclictest264222-21irqrtprio11:15:281
4090069991512,2cyclictest176470-21fschecks_count10:25:231
4090069991512,2cyclictest1652-1atopacctd10:16:111
4090069991512,2cyclictest1-21systemd12:30:331
4090069991511,3cyclictest4155301-21kthreadcore08:00:311
4090069991511,3cyclictest4136553-21irqrtprio07:45:251
4090069991511,3cyclictest350450-21gltestperf12:05:241
4090069991511,3cyclictest22886-21kthreadcore08:50:311
4090069991511,3cyclictest18548-21kthreadcore08:45:291
4090069991511,3cyclictest145452-21kthreadcore10:05:301
4090069991511,3cyclictest14163-21kworker/u16:0+nfsiod09:32:301
4090069991511,2cyclictest0-21swapper/111:10:011
409006899156,4cyclictest0-21swapper/011:35:000
4090068991513,1cyclictest38647-21latency_hist09:05:010
4090068991512,2cyclictest1803-21gdbus10:50:000
4090068991512,2cyclictest124726-21irqrtprio09:55:260
4090068991512,2cyclictest124726-21irqrtprio09:55:260
4090068991510,4cyclictest2033-21lldpd11:48:230
409006899150,14cyclictest0-21swapper/010:35:020
302487291150,2phc2sys0-21swapper/312:02:593
302487291150,2phc2sys0-21swapper/310:37:443
302487291150,2phc2sys0-21swapper/308:19:523
409007099141,5cyclictest0-21swapper/207:25:212
4090070991412,1cyclictest0-21swapper/210:55:242
4090070991412,1cyclictest0-21swapper/209:00:252
4090070991411,1cyclictest0-21swapper/209:55:262
4090070991411,1cyclictest0-21swapper/209:55:262
4090070991411,1cyclictest0-21swapper/208:30:262
4090070991411,1cyclictest0-21swapper/207:10:012
409006999149,4cyclictest357984-21kworker/u16:3+nfsiod12:38:211
409006999149,3cyclictest54252-21grep09:15:231
409006999146,7cyclictest4108597-21tr07:20:281
4090069991411,2cyclictest66672-21kthreadcore09:20:321
4090069991411,2cyclictest4142054-21fschecks_count07:50:231
4090069991411,2cyclictest367193-21aten_repower_en12:15:221
4090069991411,2cyclictest284180-21kthreadcore11:25:301
4090069991411,2cyclictest256560-21kthreadcore11:10:281
4090069991411,2cyclictest229651-21kthreadcore10:55:291
4090069991411,2cyclictest188543-21kthreadcore10:30:311
4090069991411,2cyclictest1635-21dbus-daemon07:10:011
4090069991410,3cyclictest48893-21kthreadcore09:10:301
409006899148,5cyclictest38685-21kworker/u16:1-nfsiod10:09:240
409006899148,2cyclictest272051-21cstates11:20:240
409006899146,4cyclictest132432-21aten2.4-expect10:00:220
409006899142,7cyclictest4171935-21aten_repower_en08:15:220
409006899142,5cyclictest0-21swapper/008:55:230
4090068991412,1cyclictest12602-21kthreadcore08:40:310
4090068991411,2cyclictest90137-21irqrtprio09:35:280
4090068991411,2cyclictest4159365-21latency_hist08:05:010
4090068991411,2cyclictest4141305-21latency_hist07:50:010
4090068991411,2cyclictest333879-21kthreadcore11:55:290
4090068991411,2cyclictest254926-21grep11:10:240
4090068991411,2cyclictest246403-21gltestperf11:05:260
4090068991411,2cyclictest228317-21aten_repower_cu10:55:220
4090068991411,2cyclictest1652-1atopacctd12:20:320
4090068991411,2cyclictest158086-21systemd-run10:15:010
4090068991410,2cyclictest4165651-21munin-plugin-st08:10:010
409006899140,9cyclictest4100213-21grep07:15:300
409006899140,5cyclictest72575-21ps09:25:280
302487291141,4phc2sys0-21swapper/307:45:193
302487291140,3phc2sys0-21swapper/311:58:103
302487291140,2phc2sys0-21swapper/312:22:563
302487291140,2phc2sys0-21swapper/312:16:483
302487291140,2phc2sys0-21swapper/311:43:473
302487291140,2phc2sys0-21swapper/311:31:573
302487291140,2phc2sys0-21swapper/310:44:023
409006999139,3cyclictest4192894-21kthreadcore08:30:291
409006999139,3cyclictest4176191-21kthreadcore08:15:291
409006999139,3cyclictest34364-21kthreadcore09:00:291
4090069991311,1cyclictest4167100-21kthreadcore08:10:271
4090069991310,2cyclictest4160078-21cstates08:05:241
4090069991310,2cyclictest4117151-21cpuspeed_turbos07:30:241
4090069991310,2cyclictest4110834-21aten2.4-expect07:25:221
4090069991310,2cyclictest30408-21kthreadcore08:55:291
4090069991310,2cyclictest194206-21irqcore10:35:271
4090069991310,2cyclictest175485-21kworker/u16:2+nfsiod11:20:071
409006899138,2cyclictest0-21swapper/008:30:010
409006899137,5cyclictest4165839-21aten2.4-expect08:10:210
409006899136,2cyclictest0-21swapper/012:35:230
409006899134,2cyclictest0-21swapper/007:38:380
409006899131,7cyclictest4116836-21/usr/sbin/munin07:30:220
4090068991310,2cyclictest4929-21kthreadcore08:35:290
4090068991310,2cyclictest45884-21sh09:10:250
4090068991310,2cyclictest4178125-21aten2.4-expect08:20:240
4090068991310,2cyclictest41679-21kthreadcore09:05:280
4090068991310,2cyclictest1652-1atopacctd08:50:320
302487291130,4phc2sys0-21swapper/309:40:263
302487291130,4phc2sys0-21swapper/309:39:013
302487291130,2phc2sys0-21swapper/312:35:553
302487291130,2phc2sys0-21swapper/312:12:253
302487291130,2phc2sys0-21swapper/311:45:083
302487291130,2phc2sys0-21swapper/311:19:073
302487291130,2phc2sys0-21swapper/311:03:043
302487291130,2phc2sys0-21swapper/310:55:483
302487291130,2phc2sys0-21swapper/310:31:493
302487291130,2phc2sys0-21swapper/307:39:563
302487291130,2phc2sys0-21swapper/307:30:243
409006999127,3cyclictest170550irq/121-eno108:25:241
409006899124,3cyclictest4191600-21cat08:30:270
409006899120,7cyclictest4147552-21/usr/sbin/munin07:55:250
302487291120,2phc2sys0-21swapper/308:05:583
302487291120,2phc2sys0-21swapper/307:27:313
302487291120,1phc2sys0-21swapper/308:04:063
302487291111,3phc2sys0-21swapper/310:45:333
302487291111,3phc2sys0-21swapper/309:22:403
302487291111,2phc2sys0-21swapper/308:45:253
302487291110,3phc2sys0-21swapper/309:30:233
302487291110,3phc2sys0-21swapper/307:15:013
302487291110,2phc2sys0-21swapper/310:50:263
302487291110,2phc2sys0-21swapper/310:25:293
302487291110,2phc2sys0-21swapper/310:24:173
302487291101,2phc2sys0-21swapper/309:15:033
302487291101,2phc2sys0-21swapper/308:50:303
302487291100,4phc2sys0-21swapper/307:05:233
302487291100,2phc2sys0-21swapper/312:05:283
302487291100,2phc2sys0-21swapper/309:10:033
302487291100,2phc2sys0-21swapper/309:05:013
302487291100,2phc2sys0-21swapper/308:35:283
302487291100,2phc2sys0-21swapper/308:25:263
30248729191,2phc2sys0-21swapper/311:50:453
30248729190,3phc2sys0-21swapper/307:20:223
30248729190,2phc2sys0-21swapper/312:25:093
30248729190,2phc2sys0-21swapper/310:05:133
30248729190,2phc2sys0-21swapper/308:59:563
30248729190,2phc2sys0-21swapper/308:20:173
30248729190,2phc2sys0-21swapper/308:10:073
30248729190,2phc2sys0-21swapper/307:54:553
30248729190,2phc2sys0-21swapper/307:15:253
40900689983,4cyclictest1635-21dbus-daemon07:10:010
30248729180,2phc2sys0-21swapper/308:30:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional