You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 16:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Thu Nov 13, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
155509821700,3sleep30-21swapper/310:40:503
149367521080,2sleep11493679-21grep10:05:451
16289702930,2sleep30-21swapper/311:20:463
1247517992319,3cyclictest1253936-21open_files07:15:011
1247517992315,3cyclictest260-21systemd-journal12:09:551
302487291221,5phc2sys0-21swapper/310:55:393
1247517992220,1cyclictest1430998-21/usr/sbin/munin09:30:021
1247517992219,2cyclictest1571008-21grep10:50:001
1247516992219,2cyclictest1658340-21systemd-run11:40:000
1247518992119,1cyclictest0-21swapper/207:25:022
1247518992118,1cyclictest0-21swapper/211:20:002
1247517992017,2cyclictest1404518-21sh09:15:011
124751699209,6cyclictest0-21swapper/010:50:000
124751699205,1cyclictest1606938-21apt-get11:10:380
1247516992011,4cyclictest0-21swapper/012:05:020
1247516992010,5cyclictest0-21swapper/011:30:020
1247517991915,3cyclictest1588396-21apt-key11:00:001
1247517991914,4cyclictest260-21systemd-journal08:09:551
1247516991915,2cyclictest0-21swapper/012:35:020
124751699190,16cyclictest1541177-21kworker/0:1+mm_percpu_wq11:50:010
302487291181,3phc2sys0-21swapper/310:25:373
302487291180,3phc2sys0-21swapper/311:18:183
302487291180,2phc2sys0-21swapper/310:52:103
302487291180,2phc2sys0-21swapper/309:20:313
1247518991816,1cyclictest0-21swapper/210:34:142
1247518991815,1cyclictest0-21swapper/212:20:012
1247518991815,1cyclictest0-21swapper/211:05:002
1247518991815,1cyclictest0-21swapper/208:40:002
1247517991817,1cyclictest0-21swapper/108:13:481
1247517991815,2cyclictest1469311-21kthreadcore09:50:451
1247517991814,3cyclictest1599056-21cut11:05:431
1247517991814,3cyclictest1371717-21latency_hist08:50:001
124751799181,15cyclictest1553751-21/usr/sbin/munin10:40:011
1247517991811,3cyclictest1685067-21aten2.4-expect11:55:391
124751699189,2cyclictest0-21swapper/012:25:390
124751699188,5cyclictest0-21swapper/011:45:000
1247516991815,2cyclictest1254395-21latency_hist07:15:020
124751699180,15cyclictest1395949-21diskmemload10:34:140
302487291170,2phc2sys0-21swapper/311:03:163
302487291170,2phc2sys0-21swapper/307:25:353
1247518991715,1cyclictest0-21swapper/209:00:452
1247518991714,1cyclictest0-21swapper/209:50:012
1247518991714,1cyclictest0-21swapper/207:45:012
1247517991715,1cyclictest1280133-21latency_hist07:35:001
1247517991714,2cyclictest8351-21rtkit-daemon11:19:351
1247517991713,3cyclictest1456746-21sh09:45:001
1247517991713,2cyclictest1700-21systemd-logind11:50:021
1247517991711,5cyclictest1536895-21grep10:30:441
1247517991711,2cyclictest1444579-21kthreadcore09:35:491
124751699179,4cyclictest1457440-21/usr/sbin/munin09:45:510
124751699178,5cyclictest1803-21gdbus09:45:010
124751699178,5cyclictest1594283-21pmu-power11:00:490
1247516991715,1cyclictest1442981-21sed09:35:480
1247516991714,2cyclictest1719661-21tail12:15:400
1247516991714,2cyclictest1700-21systemd-logind11:25:020
1247516991714,2cyclictest1588311-21apt-get11:00:000
1247516991714,2cyclictest1380901-21sed08:55:440
1247516991714,2cyclictest1247514-21cyclictest09:05:400
302487291161,4phc2sys0-21swapper/307:30:363
302487291160,3phc2sys0-21swapper/310:00:303
302487291160,2phc2sys0-21swapper/311:08:363
15532372160,1sleep20-21swapper/210:39:252
1247518991614,1cyclictest0-21swapper/209:55:022
1247518991613,2cyclictest0-21swapper/208:45:462
1247518991613,1cyclictest0-21swapper/212:30:012
1247518991613,1cyclictest0-21swapper/211:21:262
1247518991613,1cyclictest0-21swapper/211:00:002
1247518991613,1cyclictest0-21swapper/209:35:012
1247518991613,1cyclictest0-21swapper/209:00:012
124751799169,3cyclictest1731398-21kthreadcore12:20:421
1247517991614,1cyclictest70-21kcompactd011:45:011
1247517991613,2cyclictest260-21systemd-journal09:15:021
1247517991613,2cyclictest1753899-21apt-config12:35:011
1247517991613,2cyclictest1597834-21latency_hist11:05:021
1247517991613,2cyclictest1484331-21fschecks_count10:00:411
1247517991613,2cyclictest1396164-21cut09:10:021
1247517991613,2cyclictest1334924-21latency_hist08:20:011
1247517991613,2cyclictest0-21swapper/107:55:001
1247517991612,3cyclictest1631-21gmain07:45:011
1247517991612,3cyclictest1606465-21kworker/u16:1+nfsiod12:13:171
1247517991612,3cyclictest1154955-21kworker/u16:2+nfsiod10:12:041
1247517991611,3cyclictest1-21systemd08:35:021
124751699169,5cyclictest0-21swapper/010:25:020
124751699168,1cyclictest0-21swapper/010:05:520
124751699161,9cyclictest0-21swapper/010:28:590
1247516991614,1cyclictest1247514-21cyclictest11:30:420
1247516991613,2cyclictest8351-21rtkit-daemon12:06:550
1247516991613,2cyclictest1511394-21kthreadcore10:15:480
1247516991613,2cyclictest1480614-21vmstat09:55:520
1247516991613,2cyclictest1414805-21cut09:20:420
1247516991613,2cyclictest1404624-21latency_hist09:15:010
1247516991613,2cyclictest1390062-21cut09:05:010
1247516991613,2cyclictest1331716-21kthreadcore08:15:460
1247516991610,5cyclictest1574166-21tr10:50:460
1247516991610,5cyclictest1468699-21kthreadcore09:50:440
124751699160,11cyclictest1304736-21/usr/sbin/munin07:55:470
124751699160,11cyclictest1304736-21/usr/sbin/munin07:55:470
302487291152,2phc2sys0-21swapper/309:57:153
302487291150,3phc2sys0-21swapper/310:05:513
302487291150,3phc2sys0-21swapper/309:12:333
302487291150,2phc2sys0-21swapper/312:25:223
302487291150,2phc2sys0-21swapper/310:22:263
124751899151,5cyclictest0-21swapper/210:15:012
1247518991513,1cyclictest0-21swapper/212:10:012
1247518991513,1cyclictest0-21swapper/210:30:022
1247518991513,1cyclictest0-21swapper/208:30:022
1247518991513,1cyclictest0-21swapper/208:10:012
1247518991512,1cyclictest0-21swapper/212:00:492
1247518991512,1cyclictest0-21swapper/211:05:432
1247518991512,1cyclictest0-21swapper/210:45:012
1247518991512,1cyclictest0-21swapper/210:20:412
1247518991512,1cyclictest0-21swapper/210:00:372
1247518991512,1cyclictest0-21swapper/209:30:002
1247518991512,1cyclictest0-21swapper/209:20:012
1247518991512,1cyclictest0-21swapper/207:30:422
1247518991512,1cyclictest0-21swapper/207:10:422
124751799158,3cyclictest170550irq/121-eno109:30:481
124751799154,5cyclictest1609416-21kthreadcore11:10:461
1247517991512,2cyclictest1696444-21kthreadcore12:00:441
1247517991512,2cyclictest1677025-21tail11:50:421
1247517991512,2cyclictest1651783-21kthreadcore11:35:461
1247517991512,2cyclictest1633330-21cpuspeed_turbos11:25:431
1247517991512,2cyclictest1571709-21head10:50:381
1247517991512,2cyclictest1476004-21irqcore09:55:431
1247517991512,2cyclictest0-21swapper/111:25:011
1247517991512,2cyclictest0-21swapper/108:30:011
1247517991511,3cyclictest1652-1atopacctd12:35:441
1247517991511,3cyclictest1641035-21kworker/u16:3+nfsiod11:30:431
1247517991511,3cyclictest1413606-21kworker/u16:1+nfsiod10:41:221
1247517991511,3cyclictest1413606-21kworker/u16:1+nfsiod09:24:421
124751799150,6cyclictest1720529-21ps12:15:461
124751699159,5cyclictest1736443-21/usr/sbin/munin12:25:010
124751699157,4cyclictest1688721-21kthreadcore11:55:470
124751699157,4cyclictest0-21swapper/009:30:010
124751699156,5cyclictest0-21swapper/009:30:490
124751699156,2cyclictest0-21swapper/010:10:370
1247516991512,2cyclictest1598233-21/usr/sbin/munin11:05:490
1247516991512,2cyclictest1545937-21cpuspeed_turbos10:35:390
1247516991512,2cyclictest1247514-21cyclictest08:35:440
124751699150,14cyclictest1491758-21munin-run10:05:010
124751699150,14cyclictest0-21swapper/010:40:060
302487291140,3phc2sys0-21swapper/311:40:333
302487291140,2phc2sys0-21swapper/312:23:393
302487291140,2phc2sys0-21swapper/311:13:423
302487291140,2phc2sys0-21swapper/310:11:473
302487291140,2phc2sys0-21swapper/309:30:323
302487291140,2phc2sys0-21swapper/309:15:513
302487291140,2phc2sys0-21swapper/309:07:493
302487291140,2phc2sys0-21swapper/308:25:543
1247518991412,1cyclictest0-21swapper/212:15:022
1247518991412,1cyclictest0-21swapper/211:40:442
1247518991412,1cyclictest0-21swapper/209:55:442
1247518991412,1cyclictest0-21swapper/208:35:012
1247518991412,1cyclictest0-21swapper/207:25:422
1247518991411,2cyclictest0-21swapper/210:45:462
1247518991411,1cyclictest0-21swapper/212:25:002
1247518991411,1cyclictest0-21swapper/211:30:012
1247518991411,1cyclictest0-21swapper/211:10:422
1247518991411,1cyclictest0-21swapper/210:50:402
1247518991411,1cyclictest0-21swapper/210:06:482
1247518991411,1cyclictest0-21swapper/209:20:462
1247518991411,1cyclictest0-21swapper/209:10:502
1247518991411,1cyclictest0-21swapper/208:40:472
1247518991411,1cyclictest0-21swapper/208:20:002
1247518991411,1cyclictest0-21swapper/207:35:462
1247518991410,2cyclictest0-21swapper/212:35:462
1247518991410,2cyclictest0-21swapper/209:05:522
124751799141,5cyclictest260-21systemd-journal10:25:001
1247517991411,2cyclictest1737520-21forks12:25:431
1247517991411,2cyclictest1458671-21irqrtprio09:45:441
1247517991411,2cyclictest1388249-21kthreadcore09:00:471
1247517991411,2cyclictest1372721-21fschecks_time08:50:401
1247517991411,2cyclictest1336193-21tr08:20:431
1247517991411,2cyclictest1311555-21gltestperf08:00:421
1247517991411,2cyclictest1281093-21fschecks_time07:35:421
1247517991411,2cyclictest0-21swapper/110:20:021
1247517991411,2cyclictest0-21swapper/108:40:001
1247517991410,3cyclictest1509621-21kworker/u16:0+nfsiod10:29:061
1247517991410,3cyclictest1381506-21kthreadcore08:55:451
124751799140,13cyclictest1310487-21idleruntime-cro08:00:001
124751799140,13cyclictest1310487-21idleruntime-cro08:00:001
1247516991412,1cyclictest1677806-21kthreadcore11:50:440
1247516991411,2cyclictest1755255-21gltestperf12:35:420
1247516991411,2cyclictest1661-21polkitd08:15:000
1247516991411,2cyclictest1407367-21kthreadcore09:15:450
1247516991411,2cyclictest1376305-21kthreadcore08:50:450
1247516991411,2cyclictest1360224-21tr08:40:410
1247516991411,2cyclictest1295029-21kthreadcore07:45:440
1247516991411,2cyclictest1272082-21kthreadcore07:25:420
1247516991411,2cyclictest1262189-21/usr/sbin/munin07:20:460
124751699140,9cyclictest1274942-21diskstats07:30:380
302487291133,3phc2sys0-21swapper/310:45:053
302487291132,3phc2sys0-21swapper/312:34:453
302487291131,5phc2sys0-21swapper/308:05:373
302487291130,3phc2sys0-21swapper/311:25:403
302487291130,2phc2sys0-21swapper/307:54:563
15099682130,4sleep30-21swapper/310:15:303
1247518991311,1cyclictest0-21swapper/212:30:452
1247518991311,1cyclictest0-21swapper/211:50:022
1247518991311,1cyclictest0-21swapper/208:50:372
1247518991311,1cyclictest0-21swapper/208:00:022
1247518991311,1cyclictest0-21swapper/207:15:382
1247518991310,1cyclictest0-21swapper/211:55:562
1247518991310,1cyclictest0-21swapper/211:35:462
1247518991310,1cyclictest0-21swapper/211:30:412
1247518991310,1cyclictest0-21swapper/209:40:382
1247518991310,1cyclictest0-21swapper/207:45:452
124751799139,3cyclictest1267211-21mailstats07:20:491
124751799139,3cyclictest1257152-21irqcore07:15:441
1247517991310,2cyclictest1293477-21if_enp1s0.807:45:421
1247517991310,2cyclictest1271115-21kthreadcore07:25:421
124751699137,2cyclictest1260990-21ps07:15:480
124751699136,6cyclictest1290217-21tr07:40:460
124751699133,5cyclictest1615703-21aten_repower_po11:15:380
1247516991310,2cyclictest1711182-21cpu12:10:400
1247516991310,2cyclictest1661-21polkitd08:50:010
1247516991310,2cyclictest1353231-21cron08:35:010
1247516991310,2cyclictest1343474-21kthreadcore08:25:450
1247516991310,2cyclictest1337692-21kthreadcore08:20:440
1247516991310,2cyclictest1319662-21kthreadcore08:05:440
1247516991310,2cyclictest1316170-21unixbench_singl08:00:510
1247516991310,2cyclictest1280499-21aten_repower_cu07:35:380
302487291120,3phc2sys0-21swapper/312:18:543
302487291120,2phc2sys0-21swapper/309:35:393
302487291120,2phc2sys0-21swapper/307:38:213
124751899129,1cyclictest0-21swapper/209:35:462
124751899129,1cyclictest0-21swapper/208:10:522
124751899129,1cyclictest0-21swapper/207:55:432
124751899129,1cyclictest0-21swapper/207:55:432
124751899128,2cyclictest0-21swapper/210:15:492
1247518991210,1cyclictest0-21swapper/208:20:382
1247518991210,1cyclictest0-21swapper/207:50:452
124751799129,2cyclictest1652-1atopacctd08:40:461
124751699128,2cyclictest0-21swapper/007:10:010
302487291114,3phc2sys0-21swapper/312:05:463
302487291113,2phc2sys0-21swapper/311:53:143
302487291112,2phc2sys0-21swapper/307:05:273
302487291111,2phc2sys0-21swapper/307:20:383
302487291110,3phc2sys0-21swapper/312:10:483
302487291110,3phc2sys0-21swapper/309:50:173
302487291110,3phc2sys0-21swapper/309:05:013
302487291110,3phc2sys0-21swapper/308:45:013
302487291110,2phc2sys0-21swapper/312:03:193
302487291110,2phc2sys0-21swapper/311:49:093
302487291110,2phc2sys0-21swapper/310:37:553
302487291110,2phc2sys0-21swapper/309:41:103
302487291110,2phc2sys0-21swapper/307:15:013
302487291110,1phc2sys0-21swapper/308:52:233
302487291110,1phc2sys0-21swapper/307:57:133
302487291110,1phc2sys0-21swapper/307:57:133
124751899119,1cyclictest0-21swapper/211:50:452
124751899110,2cyclictest0-21swapper/207:10:012
124751799114,2cyclictest11systemd07:10:001
124751699110,1cyclictest8351-21rtkit-daemon07:50:280
302487291101,4phc2sys0-21swapper/308:45:393
302487291101,3phc2sys0-21swapper/310:33:313
302487291101,2phc2sys0-21swapper/309:25:453
302487291101,2phc2sys0-21swapper/308:15:523
302487291100,4phc2sys0-21swapper/311:35:373
302487291100,2phc2sys0-21swapper/312:37:023
302487291100,2phc2sys0-21swapper/311:55:463
302487291100,2phc2sys0-21swapper/311:32:223
302487291100,2phc2sys0-21swapper/309:45:043
302487291100,2phc2sys0-21swapper/308:35:033
302487291100,2phc2sys0-21swapper/307:40:383
302487291100,2phc2sys0-21swapper/307:15:533
30248729191,2phc2sys0-21swapper/309:00:013
30248729191,2phc2sys0-21swapper/308:04:023
30248729190,2phc2sys0-21swapper/308:30:033
30248729190,2phc2sys0-21swapper/308:20:373
30248729190,2phc2sys0-21swapper/308:10:473
30248729190,2phc2sys0-21swapper/307:45:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional