You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-09 - 21:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sun Nov 09, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
175131822100,2sleep30-21swapper/307:55:503
210180021050,2sleep30-21swapper/311:38:483
210533821040,2sleep01840664-21diskmemload11:40:500
20422362810,1sleep20-21swapper/211:05:492
19025122320,2sleep20-21swapper/209:45:452
1692179992716,6cyclictest0-21swapper/111:05:011
302487291246,2phc2sys0-21swapper/309:49:163
169217899241,18cyclictest1928504-21apt-get10:00:430
1692179992320,2cyclictest2084947-21sh11:30:011
1692179992320,2cyclictest2009-21runrttasks11:40:501
1692179992312,3cyclictest1957378-21kthreadcore10:15:541
1692179992310,3cyclictest0-21swapper/110:40:011
1692178992320,2cyclictest1828260-21grep09:00:000
1692178992316,5cyclictest0-21swapper/010:55:010
1692180992220,1cyclictest0-21swapper/210:15:022
1692179992219,2cyclictest2137886-21sh12:00:021
169217899224,5cyclictest1961339-21ssh10:18:100
1692178992215,6cyclictest2088467-21kthreadcore11:30:530
1692178992215,6cyclictest2088467-21kthreadcore11:30:530
1692178992212,6cyclictest2094527-21/usr/sbin/munin11:35:540
1692178992212,1cyclictest191rcu_preempt11:57:190
1692179992114,6cyclictest1661-21polkitd11:55:001
1692178992116,1cyclictest170550irq/121-eno110:25:560
1692178992112,8cyclictest0-21swapper/011:00:020
1692179992018,1cyclictest1816147-21latency_hist08:50:001
1692179992017,2cyclictest1840930-21grep09:10:021
1692179992017,2cyclictest0-21swapper/111:00:001
169217899209,7cyclictest2196662-21diskmemload12:31:470
169217899209,7cyclictest2064942-21diskmemload11:16:270
169217899207,4cyclictest1593802-21kworker/u16:3+nfsiod11:20:150
1692178992017,2cyclictest0-21swapper/011:30:010
1692178992013,6cyclictest1917088-21runrttasks09:51:450
1692178992012,4cyclictest0-21swapper/010:11:100
1692178992011,2cyclictest170550irq/121-eno110:05:520
1692180991917,1cyclictest0-21swapper/212:40:002
1692180991916,1cyclictest0-21swapper/212:20:002
1692180991916,1cyclictest0-21swapper/209:00:002
1692179991916,2cyclictest1910392-21sh09:50:001
1692179991916,2cyclictest1635-21dbus-daemon08:20:011
1692179991916,2cyclictest0-21swapper/109:00:011
169217899199,6cyclictest1857079-21diskmemload09:18:200
169217899199,5cyclictest0-21swapper/009:35:530
169217899197,8cyclictest2151250-21cut12:05:500
169217899196,8cyclictest1804550-21aten2.4-expect08:40:470
169217899195,6cyclictest2155393-21kworker/u16:0+xprtiod12:27:320
169217899193,5cyclictest2112203-21aten2.4-expect11:45:430
169217899193,5cyclictest1963412-21aten2.4-expect10:20:440
169217899193,5cyclictest1867502-21aten2.4-expect09:25:430
169217899193,5cyclictest1867502-21aten2.4-expect09:25:430
1692178991916,2cyclictest2156748-21gltestperf12:10:450
1692178991916,2cyclictest1693768-21kthreadcore07:10:510
1692178991915,3cyclictest2123633-21kthreadcore11:50:540
1692178991915,3cyclictest2000826-21kthreadcore10:40:520
1692178991915,3cyclictest1776778-21kthreadcore08:15:520
1692178991915,3cyclictest1764640-21kthreadcore08:05:530
1692178991915,3cyclictest1764640-21kthreadcore08:05:530
1692178991913,1cyclictest170550irq/121-eno112:15:560
1692178991911,7cyclictest0-21swapper/009:50:020
302487291181,3phc2sys0-21swapper/311:25:023
302487291180,5phc2sys0-21swapper/309:40:193
302487291180,2phc2sys0-21swapper/311:49:313
1692180991815,1cyclictest0-21swapper/211:00:012
1692180991814,2cyclictest0-21swapper/209:05:002
169217999188,3cyclictest0-21swapper/110:25:561
1692179991815,2cyclictest0-21swapper/111:35:011
1692179991815,2cyclictest0-21swapper/111:35:011
1692179991814,3cyclictest1948732-21kthreadcore10:10:511
1692179991814,3cyclictest1931327-21kthreadcore10:00:521
169217899189,8cyclictest0-21swapper/009:40:430
169217899189,5cyclictest2044805-21ssh11:05:530
169217899188,6cyclictest1920022-21cat09:55:450
169217899187,7cyclictest1880061-21kthreadcore09:30:520
169217899187,6cyclictest1593802-21kworker/u16:3+xprtiod09:21:190
169217899184,3cyclictest191rcu_preempt07:30:420
169217899183,4cyclictest1731560-21aten2.4-expect07:40:450
169217899182,5cyclictest2173495-21aten2.4-expect12:20:430
1692178991815,2cyclictest1843933-21kthreadcore09:10:500
1692178991815,2cyclictest1793549-21kthreadcore08:30:520
1692178991814,3cyclictest2202129-21kthreadcore12:35:530
1692178991814,3cyclictest2035702-21kthreadcore11:00:540
1692178991810,4cyclictest0-21swapper/012:04:360
302487291170,3phc2sys0-21swapper/312:30:123
302487291170,3phc2sys0-21swapper/310:00:423
302487291170,2phc2sys0-21swapper/311:41:023
302487291170,2phc2sys0-21swapper/310:50:493
1692180991714,1cyclictest0-21swapper/209:15:002
169217999171,7cyclictest1773624-21latency_hist08:15:001
1692179991715,1cyclictest2058436-21dump-pmu-power11:15:001
1692179991715,1cyclictest0-21swapper/107:40:011
1692179991714,2cyclictest2191962-21kthreadcore12:30:511
1692179991714,2cyclictest2120347-21munin-plugin-st11:50:021
1692179991714,2cyclictest1896350-21kthreadcore09:40:501
1692179991714,2cyclictest1798946-21fschecks_time08:35:461
169217999171,3cyclictest2155293-21latency_hist12:10:011
169217999171,3cyclictest1706564-21latency_hist07:20:011
1692179991713,3cyclictest2020372-21mailstats10:50:531
1692179991713,3cyclictest1791140-21mailstats08:25:561
169217899178,2cyclictest0-21swapper/010:30:460
169217899177,6cyclictest2006734-21aten2.4-expect10:45:450
169217899177,6cyclictest1725257-21aten2.4-expect07:35:440
169217899177,6cyclictest1700871-21aten2.4-expect07:15:420
169217899175,8cyclictest2051572-21cut11:10:490
169217899175,7cyclictest0-21swapper/007:45:450
169217899173,8cyclictest1835094-21telnet09:05:470
169217899171,5cyclictest1706997-21aten2.4-expect07:20:450
1692178991714,2cyclictest1751003-21kthreadcore07:55:500
1692178991714,2cyclictest1715795-21kthreadcore07:25:510
1692178991713,3cyclictest1817080-21fschecks_count08:50:460
1692178991713,3cyclictest1782879-21kthreadcore08:20:510
1692178991713,3cyclictest1759264-21kthreadcore08:00:500
302487291160,3phc2sys0-21swapper/310:38:433
302487291160,3phc2sys0-21swapper/307:44:563
302487291160,13phc2sys0-21swapper/309:58:353
169218099161,9cyclictest0-21swapper/208:10:002
169218099161,9cyclictest0-21swapper/208:10:002
1692180991614,1cyclictest0-21swapper/212:35:012
1692180991614,1cyclictest0-21swapper/211:30:022
1692180991614,1cyclictest0-21swapper/210:20:012
1692180991613,1cyclictest0-21swapper/211:45:012
1692180991613,1cyclictest0-21swapper/210:50:482
1692180991613,1cyclictest0-21swapper/210:20:512
1692180991613,1cyclictest0-21swapper/208:25:562
1692180991613,1cyclictest0-21swapper/207:45:002
169218099160,14cyclictest0-21swapper/212:25:412
169217999166,2cyclictest170550irq/121-eno110:00:021
1692179991614,1cyclictest1834599-21basename09:05:001
1692179991613,2cyclictest2169647-21ps12:15:541
1692179991613,2cyclictest1868824-21kthreadcore09:25:491
1692179991613,2cyclictest1868824-21kthreadcore09:25:491
1692179991613,2cyclictest1866834-21sh09:25:011
1692179991613,2cyclictest1840664-21diskmemload10:46:371
1692179991613,2cyclictest1700-21systemd-logind11:40:021
1692179991612,3cyclictest1940598-21kthreadcore10:05:531
1692179991612,3cyclictest1735007-21kthreadcore07:40:531
1692179991612,3cyclictest1652-1atopacctd08:00:481
1692179991611,4cyclictest1635-21dbus-daemon10:45:011
169217899169,4cyclictest0-21swapper/008:36:020
169217899161,4cyclictest1768069-21aten2.4-expect08:10:450
1692178991613,2cyclictest260-21systemd-journal10:35:020
1692178991613,2cyclictest1744266-21fschecks_time07:50:470
1692178991612,3cyclictest1786450-21cpuspeed_turbos08:25:470
302487291150,4phc2sys0-21swapper/309:15:163
302487291150,3phc2sys0-21swapper/310:56:093
302487291150,2phc2sys0-21swapper/311:26:443
302487291150,2phc2sys0-21swapper/310:12:543
169218099152,6cyclictest0-21swapper/210:35:572
169218099151,7cyclictest0-21swapper/207:20:002
1692180991513,1cyclictest0-21swapper/211:30:582
1692180991513,1cyclictest0-21swapper/211:30:582
1692180991512,1cyclictest0-21swapper/211:15:512
1692180991512,1cyclictest0-21swapper/210:29:552
1692180991512,1cyclictest0-21swapper/209:40:492
1692180991512,1cyclictest0-21swapper/209:30:402
1692180991512,1cyclictest0-21swapper/209:20:502
1692180991512,1cyclictest0-21swapper/208:49:562
1692180991512,1cyclictest0-21swapper/207:15:012
1692180991511,2cyclictest0-21swapper/211:59:532
1692180991511,2cyclictest0-21swapper/211:00:542
1692180991511,2cyclictest0-21swapper/210:34:412
1692180991511,2cyclictest0-21swapper/210:05:522
1692180991510,2cyclictest0-21swapper/208:40:582
169217999159,2cyclictest170550irq/121-eno107:22:261
169217999151,6cyclictest1849361-21latency_hist09:15:021
169217999151,5cyclictest1850114-21/usr/sbin/munin09:15:471
1692179991512,2cyclictest1889414-21kthreadcore09:35:531
1692179991512,2cyclictest1819937-21kthreadcore08:50:501
1692179991512,2cyclictest1792416-21cpu08:30:461
1692179991512,2cyclictest1635-21dbus-daemon12:25:011
1692179991512,2cyclictest0-21swapper/107:15:011
1692179991511,3cyclictest1876332-21kworker/u16:1+nfsiod09:52:431
1692179991511,3cyclictest1751469-21kthreadcore07:55:501
1692179991511,2cyclictest1692176-21cyclictest09:34:591
169217999150,8cyclictest1749449-21cat07:55:011
169217999150,7cyclictest1737557-21/usr/sbin/munin07:45:561
169217899154,4cyclictest1828966-21aten2.4-expect09:00:440
302487291143,5phc2sys0-21swapper/312:01:373
302487291141,4phc2sys0-21swapper/307:30:423
302487291140,4phc2sys0-21swapper/308:30:423
302487291140,2phc2sys0-21swapper/312:28:353
302487291140,2phc2sys0-21swapper/312:05:033
302487291140,2phc2sys0-21swapper/311:58:463
302487291140,2phc2sys0-21swapper/311:03:033
302487291140,2phc2sys0-21swapper/309:31:153
169218099141,4cyclictest0-21swapper/211:40:002
1692180991412,1cyclictest0-21swapper/207:30:012
1692180991411,1cyclictest0-21swapper/212:10:482
1692180991411,1cyclictest0-21swapper/212:00:472
1692180991411,1cyclictest0-21swapper/211:52:442
1692180991411,1cyclictest0-21swapper/211:45:492
1692180991411,1cyclictest0-21swapper/211:21:002
1692180991411,1cyclictest0-21swapper/210:46:302
1692180991411,1cyclictest0-21swapper/209:25:492
1692180991411,1cyclictest0-21swapper/209:25:492
1692180991411,1cyclictest0-21swapper/208:50:572
1692180991411,1cyclictest0-21swapper/208:15:002
1692180991411,1cyclictest0-21swapper/207:10:012
1692180991410,2cyclictest0-21swapper/209:15:532
169217999148,2cyclictest170550irq/121-eno112:25:441
169217999148,2cyclictest170550irq/121-eno110:20:161
169217999146,1cyclictest170550irq/121-eno110:30:351
169217999141,3cyclictest1724788-21latency_hist07:35:021
1692179991411,2cyclictest2044447-21kthreadcore11:05:531
1692179991411,2cyclictest1767559-21cron08:10:001
1692179991411,2cyclictest1767559-21cron08:10:001
1692179991411,2cyclictest1692176-21cyclictest12:00:561
1692179991410,3cyclictest2072354-21kthreadcore11:20:511
1692179991410,3cyclictest2060496-21irqrtprio11:15:501
1692179991410,3cyclictest1806126-21kthreadcore08:40:531
169217999140,2cyclictest1692263-21cat07:10:021
169217899141,7cyclictest1692022-21latency_hist07:10:020
1692178991411,2cyclictest1810977-21sh08:45:460
302487291133,2phc2sys0-21swapper/311:13:133
302487291133,2phc2sys0-21swapper/307:05:463
302487291131,4phc2sys0-21swapper/311:30:453
302487291131,4phc2sys0-21swapper/311:30:453
302487291131,3phc2sys0-21swapper/312:20:423
302487291130,3phc2sys0-21swapper/309:25:543
302487291130,3phc2sys0-21swapper/309:25:543
302487291130,2phc2sys0-21swapper/312:36:053
302487291130,2phc2sys0-21swapper/311:51:243
302487291130,2phc2sys0-21swapper/310:29:043
302487291130,2phc2sys0-21swapper/310:24:443
302487291130,2phc2sys0-21swapper/309:09:563
169218099139,2cyclictest0-21swapper/208:20:502
169218099139,2cyclictest0-21swapper/208:15:502
169218099138,3cyclictest17584062sleep208:00:502
169218099131,5cyclictest0-21swapper/209:50:422
1692180991311,1cyclictest0-21swapper/208:40:022
1692180991310,1cyclictest0-21swapper/212:07:402
1692180991310,1cyclictest0-21swapper/210:00:582
1692180991310,1cyclictest0-21swapper/209:06:482
1692180991310,1cyclictest0-21swapper/208:30:552
1692180991310,1cyclictest0-21swapper/207:50:442
1692180991310,1cyclictest0-21swapper/207:45:512
1692180991310,1cyclictest0-21swapper/207:35:482
169217999139,3cyclictest1715343-21kthreadcore07:25:501
169217999137,2cyclictest170550irq/121-eno112:35:131
1692179991310,2cyclictest2157319-21kthreadcore12:10:471
1692179991310,2cyclictest1785187-21switchtime08:20:561
302487291125,2phc2sys0-21swapper/309:55:013
302487291122,4phc2sys0-21swapper/308:20:433
302487291121,2phc2sys0-21swapper/309:20:433
302487291121,2phc2sys0-21swapper/308:05:013
302487291120,3phc2sys0-21swapper/309:00:473
302487291120,3phc2sys0-21swapper/308:55:423
302487291120,3phc2sys0-21swapper/307:20:443
302487291120,2phc2sys0-21swapper/311:08:483
169218099129,2cyclictest0-21swapper/209:35:462
169218099129,1cyclictest0-21swapper/207:55:432
169218099129,1cyclictest0-21swapper/207:20:502
169218099128,2cyclictest0-21swapper/209:55:492
1692180991210,1cyclictest0-21swapper/212:20:492
1692180991210,1cyclictest0-21swapper/211:10:562
1692180991210,1cyclictest0-21swapper/207:30:492
302487291111,2phc2sys0-21swapper/310:06:163
302487291110,3phc2sys0-21swapper/312:14:563
302487291110,3phc2sys0-21swapper/309:13:583
302487291110,3phc2sys0-21swapper/307:50:513
302487291110,2phc2sys0-21swapper/311:15:183
302487291110,2phc2sys0-21swapper/309:36:583
302487291110,2phc2sys0-21swapper/308:15:433
302487291110,2phc2sys0-21swapper/308:14:313
302487291110,2phc2sys0-21swapper/308:05:413
302487291110,2phc2sys0-21swapper/308:05:413
169218099119,1cyclictest0-21swapper/210:40:512
302487291102,2phc2sys0-21swapper/308:35:513
302487291101,4phc2sys0-21swapper/307:10:423
302487291101,3phc2sys0-21swapper/310:15:443
302487291100,3phc2sys0-21swapper/312:18:223
302487291100,3phc2sys0-21swapper/310:30:483
302487291100,2phc2sys0-21swapper/310:41:033
302487291100,2phc2sys0-21swapper/308:50:423
302487291100,2phc2sys0-21swapper/308:45:533
302487291100,2phc2sys0-21swapper/308:40:483
30248729192,2phc2sys0-21swapper/307:35:353
30248729191,2phc2sys0-21swapper/310:45:203
30248729191,2phc2sys0-21swapper/307:25:573
30248729190,2phc2sys0-21swapper/308:25:453
30248729190,2phc2sys0-21swapper/307:49:563
30248729190,2phc2sys0-21swapper/307:15:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional