You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 19:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Wed Nov 26, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200889821490,2sleep30-21swapper/308:45:283
202347421050,1sleep10-21swapper/109:00:211
21645852940,2sleep30-21swapper/310:23:553
20829862420,1sleep10-21swapper/109:35:281
23514872410,1sleep20-21swapper/212:10:272
20759452280,2sleep12075944-21ssh09:31:031
1886612992619,2cyclictest170550irq/121-eno111:20:291
1886612992611,10cyclictest0-21swapper/110:35:011
1886612992416,3cyclictest2159233-21kthreadcore10:20:371
1886611992416,7cyclictest0-21swapper/009:55:010
1886612992313,3cyclictest2116695-21kthreadcore09:55:281
1886612992313,3cyclictest2088734-21irqrtprio09:40:361
1886612992312,3cyclictest2152445-21kthreadcore10:15:281
1886611992316,6cyclictest2357218-21wc12:15:220
1886611992316,6cyclictest2091772-21kthreadcore09:40:380
1886611992315,4cyclictest2309615-21missed_timers11:45:300
1886611992311,8cyclictest2075143-21grep09:30:370
19127652220,0sleep11912764-21users07:25:321
1886612992219,2cyclictest1937460-21idleruntime-cro07:50:001
1886612992211,5cyclictest0-21swapper/111:00:191
1886611992219,2cyclictest2035090-21gpgconf09:10:010
1886611992210,8cyclictest2055727-21kthreadcore09:20:280
1886612992118,2cyclictest2208903-21sh10:50:011
1886612992118,2cyclictest2010444-21wc08:50:001
1886612992118,2cyclictest1803-21gdbus11:20:001
1886612992118,2cyclictest1700-21systemd-logind10:05:001
1886612992110,6cyclictest0-21swapper/111:15:001
1886611992115,5cyclictest2365711-21tail12:20:200
1886611992112,5cyclictest0-21swapper/010:55:320
1886611992111,6cyclictest2270943-21ssh11:25:240
1886613992017,1cyclictest0-21swapper/210:55:022
1886613992017,1cyclictest0-21swapper/209:10:012
1886612992017,2cyclictest2315523-21ssh11:50:271
1886612992017,2cyclictest2218499-21fschecks_count10:55:231
1886612992017,2cyclictest1635-21dbus-daemon12:40:001
1886612992017,2cyclictest1-21systemd09:15:011
1886612992017,2cyclictest0-21swapper/107:15:011
1886612992010,3cyclictest2385775-21kthreadcore12:30:261
188661199209,7cyclictest2035167-21kworker/u16:0-rpciod10:38:440
1886611992017,2cyclictest2286988-21cron11:35:000
1886611992016,3cyclictest2018160-21kthreadcore08:55:270
1886611992014,1cyclictest2043780-21latency_hist09:15:010
1886611992012,4cyclictest2150389-21kthreadcore10:15:260
1886611992010,3cyclictest2391542-21/usr/sbin/munin12:35:270
3024872911911,2phc2sys0-21swapper/308:15:203
1886613991917,1cyclictest0-21swapper/211:10:012
1886613991916,1cyclictest0-21swapper/212:40:002
1886613991916,1cyclictest0-21swapper/209:27:312
188661299197,3cyclictest2279767-21/usr/sbin/munin11:30:221
1886612991916,2cyclictest2239575-21kthreadcore11:05:271
1886612991916,2cyclictest1635-21dbus-daemon07:45:011
188661299190,12cyclictest0-21swapper/108:10:011
1886611991916,2cyclictest260-21systemd-journal09:57:550
1886611991916,2cyclictest2351006-21kthreadcore12:10:270
1886611991916,2cyclictest2314871-21kthreadcore11:50:270
1886611991916,2cyclictest2299041-21kthreadcore11:40:280
1886611991916,2cyclictest2159985-21kthreadcore10:20:380
1886611991916,2cyclictest2131774-21gltestperf10:05:230
1886611991916,2cyclictest2045507-21kthreadcore09:15:280
1886611991916,2cyclictest1975627-21kthreadcore08:20:280
1886611991916,2cyclictest1952726-21kthreadcore08:00:270
1886611991916,2cyclictest1943031-21timerwakeupswit07:51:020
1886611991916,2cyclictest1913744-21cpuspeed_turbos07:30:210
1886611991916,2cyclictest1908721-21kthreadcore07:25:240
1886611991916,2cyclictest1906136-21phc2sys07:20:320
1886611991915,2cyclictest2010623-21latency_hist08:50:010
1886611991914,4cyclictest1928612-21kthreadcore07:40:270
1886611991913,5cyclictest2235464-21aten2.4-expect11:05:200
1886611991913,5cyclictest2201077-21cstates10:45:230
1886611991913,5cyclictest1652-1atopacctd12:00:210
1886611991910,8cyclictest0-21swapper/010:10:200
1886611991910,5cyclictest2295799-21munin-run11:40:010
1886611991910,5cyclictest2269974-21munin-run11:25:010
1886611991910,5cyclictest1700-21systemd-logind08:15:010
835298180,4rtkit-daemon0-21swapper/010:50:020
302487291180,3phc2sys0-21swapper/312:21:343
302487291180,3phc2sys0-21swapper/310:59:113
302487291180,2phc2sys0-21swapper/311:40:473
302487291180,2phc2sys0-21swapper/310:36:473
302487291180,2phc2sys0-21swapper/309:21:443
188661399181,8cyclictest0-21swapper/212:00:012
1886613991815,1cyclictest0-21swapper/212:05:282
1886613991815,1cyclictest0-21swapper/209:35:002
1886613991814,2cyclictest0-21swapper/209:40:012
1886613991812,2cyclictest0-21swapper/210:10:242
188661299188,3cyclictest1886609-21cyclictest10:12:171
1886612991815,2cyclictest2339485-21aten_repower_cu12:05:201
1886612991815,2cyclictest2313074-21kworker/u16:0-rpciod12:10:251
1886612991815,2cyclictest0-21swapper/109:10:011
188661199189,8cyclictest2125677-21tr10:00:260
188661199186,4cyclictest2003481-21pmu-power08:40:330
188661199183,6cyclictest2080064-21sed09:35:250
1886611991815,2cyclictest2192485-21fschecks_count10:40:250
1886611991815,2cyclictest2182772-21runrttasks10:35:010
1886611991815,2cyclictest1892934-21kthreadcore07:15:020
1886611991815,2cyclictest0-21swapper/007:15:010
1886611991814,2cyclictest0-21swapper/008:20:010
1886611991813,4cyclictest2326019-21kthreadcore11:55:280
1886611991813,1cyclictest170550irq/121-eno109:28:420
1886611991812,5cyclictest2170622-21grep10:25:290
1886611991810,5cyclictest2321716-21kworker/0:0+events12:05:240
1886611991810,4cyclictest0-21swapper/012:30:260
302487291170,3phc2sys0-21swapper/310:49:293
302487291170,2phc2sys0-21swapper/311:10:183
302487291170,2phc2sys0-21swapper/310:32:583
1886613991715,1cyclictest0-21swapper/209:20:022
1886613991715,1cyclictest0-21swapper/207:47:412
1886613991714,1cyclictest0-21swapper/212:30:302
1886613991714,1cyclictest0-21swapper/212:20:012
1886613991714,1cyclictest0-21swapper/210:45:012
1886613991714,1cyclictest0-21swapper/210:00:302
1886613991714,1cyclictest0-21swapper/207:45:012
1886613991713,2cyclictest0-21swapper/211:20:022
188661299179,3cyclictest0-21swapper/107:50:551
188661299174,4cyclictest2296324-21aten_repower_po11:40:211
188661299173,4cyclictest2199484-21rm10:44:071
188661299173,4cyclictest2110484-21sh09:51:011
1886612991714,2cyclictest1652-1atopacctd07:20:281
1886612991714,2cyclictest0-21swapper/112:05:011
1886612991713,3cyclictest2018160-21kthreadcore08:55:271
1886612991713,3cyclictest1973092-21proc_pri08:15:301
1886612991712,4cyclictest2133851-21kthreadcore10:05:281
1886612991712,3cyclictest2373818-21latency_hist12:25:011
188661199177,7cyclictest2234568-21ssh11:04:390
188661199176,6cyclictest0-21swapper/011:10:200
1886611991714,2cyclictest2375226-21irqcore12:25:250
1886611991714,2cyclictest2254327-21kernelversion11:15:260
1886611991714,2cyclictest2010801-21aten_repower_cu08:50:190
1886611991714,2cyclictest1987763-21kernelversion08:30:270
1886611991714,2cyclictest1960935-21ptp4l08:05:310
1886611991710,4cyclictest0-21swapper/008:25:330
302487291160,4phc2sys0-21swapper/307:50:473
302487291160,3phc2sys0-21swapper/308:50:273
188661399161,9cyclictest0-21swapper/208:30:012
1886613991614,1cyclictest0-21swapper/211:55:012
1886613991614,1cyclictest0-21swapper/209:55:272
1886613991614,1cyclictest0-21swapper/209:25:002
1886613991614,1cyclictest0-21swapper/208:20:012
1886613991614,1cyclictest0-21swapper/208:00:002
1886613991614,1cyclictest0-21swapper/207:20:362
1886613991613,1cyclictest0-21swapper/211:45:002
1886613991613,1cyclictest0-21swapper/211:15:012
1886613991613,1cyclictest0-21swapper/210:15:212
1886613991613,1cyclictest0-21swapper/210:05:202
1886613991613,1cyclictest0-21swapper/209:50:242
1886613991613,1cyclictest0-21swapper/209:40:412
1886613991613,1cyclictest0-21swapper/208:55:272
1886613991613,1cyclictest0-21swapper/208:30:262
1886613991613,1cyclictest0-21swapper/207:20:022
188661299166,2cyclictest351ktimers/108:00:011
188661299165,2cyclictest170550irq/121-eno110:25:271
188661299164,3cyclictest2374325-21aten2.4-expect12:25:201
188661299164,2cyclictest170550irq/121-eno109:25:271
1886612991613,2cyclictest1995313-21kthreadcore08:35:261
1886612991613,2cyclictest1700-21systemd-logind08:45:011
1886612991612,3cyclictest2184890-21kthreadcore10:35:261
1886612991612,3cyclictest2053185-21cpuspeed_turbos09:20:211
1886612991612,3cyclictest2044260-21aten_repower_po09:15:211
1886612991612,3cyclictest1894422-21kthreadcore07:15:021
1886612991610,2cyclictest170550irq/121-eno111:55:261
188661299160,8cyclictest2295623-21cron11:40:001
1886611991613,2cyclictest2098892-21kthreadcore09:45:300
1886611991613,2cyclictest2025700-21kthreadcore09:00:260
1886611991613,2cyclictest1993852-21kthreadcore08:35:250
302487291151,3phc2sys0-21swapper/309:55:193
302487291151,2phc2sys0-21swapper/308:20:293
302487291150,3phc2sys0-21swapper/311:31:303
302487291150,3phc2sys0-21swapper/309:16:583
302487291150,2phc2sys0-21swapper/310:43:103
1886613991513,1cyclictest0-21swapper/212:20:322
1886613991513,1cyclictest0-21swapper/211:50:012
1886613991513,1cyclictest0-21swapper/211:00:002
1886613991513,1cyclictest0-21swapper/210:30:312
1886613991512,1cyclictest0-21swapper/212:00:262
1886613991512,1cyclictest0-21swapper/211:05:002
1886613991512,1cyclictest0-21swapper/210:20:372
1886613991512,1cyclictest0-21swapper/209:50:012
1886613991512,1cyclictest0-21swapper/208:20:282
1886613991512,1cyclictest0-21swapper/208:04:562
1886613991512,1cyclictest0-21swapper/207:15:012
1886613991511,2cyclictest0-21swapper/211:25:262
188661399151,10cyclictest0-21swapper/210:25:192
188661299157,3cyclictest170550irq/121-eno109:45:231
188661299155,2cyclictest2307517-21kthreadcore11:45:281
1886612991512,2cyclictest2273225-21kthreadcore11:25:281
1886612991512,2cyclictest2209962-21fschecks_time10:50:241
1886612991512,2cyclictest2010759-21acpi08:50:181
1886612991512,2cyclictest1980739-21cpuspeed_turbos08:25:221
1886612991512,2cyclictest1980065-21latency_hist08:25:021
1886612991512,2cyclictest1967079-21sendmail_mailqu08:10:301
1886612991511,3cyclictest1986828-21cpuspeed_turbos08:30:221
1886612991511,3cyclictest1953730-21kthreadcore08:00:281
1886612991511,3cyclictest1915838-21kthreadcore07:30:271
188661299150,5cyclictest2357548-21tr12:15:241
188661199159,4cyclictest1932359-21tune2fs07:45:240
188661199156,5cyclictest1943866-21/usr/sbin/munin07:55:300
1886611991512,2cyclictest1920778-21irqrtprio07:35:250
302487291140,3phc2sys0-21swapper/311:38:423
302487291140,2phc2sys0-21swapper/312:06:263
302487291140,2phc2sys0-21swapper/311:54:143
302487291140,2phc2sys0-21swapper/310:50:383
302487291140,2phc2sys0-21swapper/310:08:423
302487291140,2phc2sys0-21swapper/307:10:333
188661399141,8cyclictest0-21swapper/207:30:012
1886613991412,1cyclictest0-21swapper/211:40:002
1886613991412,1cyclictest0-21swapper/210:45:262
1886613991412,1cyclictest0-21swapper/208:40:002
1886613991411,1cyclictest0-21swapper/212:25:332
1886613991411,1cyclictest0-21swapper/209:10:272
1886613991411,1cyclictest0-21swapper/208:55:012
1886613991411,1cyclictest0-21swapper/208:45:212
1886613991411,1cyclictest0-21swapper/207:30:262
302487291131,3phc2sys0-21swapper/311:05:013
302487291131,3phc2sys0-21swapper/308:10:193
302487291130,3phc2sys0-21swapper/311:50:013
302487291130,2phc2sys0-21swapper/312:17:063
302487291130,2phc2sys0-21swapper/309:44:173
302487291130,2phc2sys0-21swapper/309:31:203
302487291130,2phc2sys0-21swapper/309:26:373
302487291130,2phc2sys0-21swapper/309:09:183
302487291130,2phc2sys0-21swapper/308:25:053
188661399131,7cyclictest0-21swapper/207:10:012
188661399131,7cyclictest0-21swapper/207:10:012
1886613991311,1cyclictest0-21swapper/208:10:262
1886613991311,1cyclictest0-21swapper/207:35:282
1886613991310,2cyclictest0-21swapper/210:37:282
1886613991310,1cyclictest0-21swapper/211:30:142
1886613991310,1cyclictest0-21swapper/209:00:222
1886613991310,1cyclictest0-21swapper/208:40:232
1886613991310,1cyclictest0-21swapper/208:05:302
188661299136,5cyclictest1924496-21mlocate07:35:311
302487291120,3phc2sys0-21swapper/309:14:113
302487291120,2phc2sys0-21swapper/312:39:143
302487291120,2phc2sys0-21swapper/310:16:283
302487291120,2phc2sys0-21swapper/309:53:163
302487291120,2phc2sys0-21swapper/309:49:253
302487291120,2phc2sys0-21swapper/308:35:113
302487291120,2phc2sys0-21swapper/307:27:363
302487291120,2phc2sys0-21swapper/307:22:033
302487291120,2phc2sys0-21swapper/307:05:203
302487291120,2phc2sys0-21swapper/307:05:203
1886613991210,1cyclictest0-21swapper/211:20:292
302487291111,2phc2sys0-21swapper/311:55:543
302487291111,2phc2sys0-21swapper/307:15:223
302487291110,3phc2sys0-21swapper/311:27:093
302487291110,3phc2sys0-21swapper/311:21:003
302487291110,2phc2sys0-21swapper/312:00:333
302487291110,2phc2sys0-21swapper/310:11:473
302487291110,1phc2sys0-21swapper/308:57:003
188661399119,1cyclictest0-21swapper/207:50:472
188661299111,8cyclictest1886443-21latency_hist07:10:011
188661299111,8cyclictest1886443-21latency_hist07:10:011
188661199115,4cyclictest1635-21dbus-daemon07:10:000
188661199115,4cyclictest1635-21dbus-daemon07:10:000
302487291101,3phc2sys0-21swapper/308:40:253
302487291101,2phc2sys0-21swapper/311:15:033
302487291101,2phc2sys0-21swapper/310:30:023
302487291100,3phc2sys0-21swapper/310:03:293
302487291100,3phc2sys0-21swapper/308:34:563
302487291100,3phc2sys0-21swapper/308:02:443
302487291100,3phc2sys0-21swapper/307:44:563
302487291100,2phc2sys0-21swapper/312:30:333
302487291100,2phc2sys0-21swapper/312:25:043
302487291100,2phc2sys0-21swapper/312:10:333
302487291100,2phc2sys0-21swapper/311:05:333
302487291100,2phc2sys0-21swapper/309:35:073
302487291100,2phc2sys0-21swapper/307:40:023
30248729190,2phc2sys0-21swapper/309:03:333
30248729190,2phc2sys0-21swapper/308:08:553
30248729190,2phc2sys0-21swapper/307:55:253
30248729190,2phc2sys0-21swapper/307:45:313
30248729190,2phc2sys0-21swapper/307:30:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional