You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 23:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Fri Nov 28, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21733602310,1sleep00-21swapper/012:35:250
16732722270,3sleep11673264-21systemd-run07:15:011
1666673992618,3cyclictest1963433-21latency_hist10:35:021
1666672992615,10cyclictest2137231-21/usr/sbin/munin12:15:220
1666673992518,2cyclictest170550irq/121-eno111:25:021
1666673992417,3cyclictest1989750-21aten_repower_en10:50:191
1666673992414,3cyclictest2012059-21pmu-power11:00:291
1666673992414,2cyclictest170550irq/121-eno111:06:411
1666673992413,3cyclictest0-21swapper/110:10:011
1666673992413,3cyclictest0-21swapper/109:30:011
1666672992415,5cyclictest2136949-21latency_hist12:15:020
1666673992320,2cyclictest1652-1atopacctd12:25:291
1666673992310,3cyclictest1931483-21kthreadcore10:15:251
166667299235,9cyclictest2102177-21perf11:55:000
1666672992318,1cyclictest20329421systemd-run11:15:010
19856872220,2sleep30-21swapper/310:45:273
1666673992212,3cyclictest1973621-21kernelversion10:40:221
1666672992214,4cyclictest1993196-21kthreadcore10:50:270
1666672992211,6cyclictest1838801-21unixbench-2d09:20:300
166667299220,17cyclictest0-21swapper/010:32:420
1666674992119,1cyclictest0-21swapper/211:00:212
1666673992118,2cyclictest1797121-21sh08:55:001
1666673992118,2cyclictest1631-21gmain10:05:011
1666673992117,3cyclictest1681243-21grep07:20:011
1666672992115,5cyclictest2107146-21kthreadcore11:55:240
1666672992113,4cyclictest2034687-21kthreadcore11:15:220
1666672992112,5cyclictest1951821-21sed10:25:320
1666672992111,6cyclictest1989404-21latency_hist10:50:020
1666672992110,6cyclictest0-21swapper/012:00:220
302487291200,2phc2sys0-21swapper/311:15:023
166667399204,5cyclictest2029498-21grep11:10:281
1666673992017,2cyclictest1704-21rs:main1
1666673992010,3cyclictest1836243-21kthreadcore09:20:251
166667299209,7cyclictest2075562-21diskmemload11:39:030
166667299209,7cyclictest2049821-21diskmemload11:24:290
166667299209,7cyclictest1979214-21diskmemload10:42:440
1666672992018,1cyclictest2171508-21latency_hist12:35:000
1666672992017,2cyclictest1717055-21switchtime07:45:290
1666672992017,2cyclictest1676555-21kthreadcore07:15:260
1666672992014,5cyclictest1829198-21kthreadcore09:15:270
1666672992011,5cyclictest2162784-21turbostat12:30:000
1666672992011,5cyclictest0-21swapper/009:10:210
302487291191,3phc2sys0-21swapper/312:16:453
1666674991917,1cyclictest0-21swapper/209:40:012
1666674991916,1cyclictest0-21swapper/211:40:222
1666674991916,1cyclictest0-21swapper/208:41:352
1666673991916,2cyclictest2082962-21runrttasks11:41:511
1666673991916,2cyclictest1824136-21cron09:15:001
1666673991913,1cyclictest170550irq/121-eno111:57:261
1666673991910,3cyclictest2033410-21ssh11:15:171
166667299199,6cyclictest1873559-21sed09:40:300
1666672991916,2cyclictest2154078-21cron12:25:010
1666672991916,2cyclictest2017086-21kthreadcore11:05:240
1666672991916,2cyclictest1938303-21uniq10:20:200
1666672991916,2cyclictest1879661-21kthreadcore09:45:270
1666672991916,2cyclictest1853603-21kthreadcore09:30:260
1666672991916,2cyclictest1843395-21kthreadcore09:25:240
1666672991916,2cyclictest1815469-21apt-key09:10:010
1666672991916,2cyclictest1780527-21kthreadcore08:40:230
1666672991916,2cyclictest1769778-21kthreadcore08:30:260
1666672991916,2cyclictest1727194-21kthreadcore07:55:230
1666672991916,2cyclictest1690466-21kthreadcore07:25:240
1666672991914,4cyclictest1762047-21cut08:25:220
1666672991913,5cyclictest1894139-21aten2.4-expect09:55:180
1666672991913,5cyclictest0-21swapper/007:40:010
1666672991912,6cyclictest2092903-21runrttasks11:49:000
302487291180,2phc2sys0-21swapper/311:47:533
302487291180,2phc2sys0-21swapper/310:21:243
302487291180,2phc2sys0-21swapper/309:55:113
1666674991816,1cyclictest0-21swapper/209:10:022
1666674991816,1cyclictest0-21swapper/208:25:022
1666674991815,1cyclictest0-21swapper/212:39:412
1666674991815,1cyclictest0-21swapper/211:20:012
1666674991814,2cyclictest0-21swapper/207:15:032
1666673991816,1cyclictest1791178-21/usr/sbin/munin08:50:011
1666673991815,2cyclictest2093752-21systemd-run11:50:021
1666673991815,2cyclictest1815484-21apt-key09:10:011
1666673991815,2cyclictest1652-1atopacctd09:36:241
1666673991814,3cyclictest1704-21rs:main1
1666673991814,3cyclictest1702-21in:imuxsock08:30:011
166667299189,1cyclictest0-21swapper/012:08:220
166667299188,5cyclictest0-21swapper/010:05:020
1666672991815,2cyclictest2008434-21kernelversion11:00:250
1666672991815,2cyclictest1966452-21kthreadcore10:35:230
1666672991815,2cyclictest1912809-21kthreadcore10:05:240
1666672991815,2cyclictest1860551-21irqrtprio09:35:240
1666672991815,2cyclictest1673643-21kthreadcore07:15:020
1666672991811,4cyclictest0-21swapper/008:10:280
1666672991810,5cyclictest1925690-21unixbench_singl10:10:330
302487291170,2phc2sys0-21swapper/311:13:253
18865432170,2sleep30-21swapper/309:50:243
1666674991715,1cyclictest0-21swapper/208:30:012
1666674991714,1cyclictest0-21swapper/212:20:252
1666674991714,1cyclictest0-21swapper/212:15:162
1666674991714,1cyclictest0-21swapper/210:20:002
1666674991714,1cyclictest0-21swapper/210:10:252
1666674991714,1cyclictest0-21swapper/209:58:552
166667499170,3cyclictest20988712sleep211:50:282
166667399179,3cyclictest0-21swapper/110:25:191
166667399179,3cyclictest0-21swapper/108:00:291
166667399177,2cyclictest170550irq/121-eno112:20:251
166667399176,3cyclictest1573401-21kworker/u16:1+events_unbound07:25:161
166667399176,1cyclictest170550irq/121-eno109:40:191
166667399174,4cyclictest1705640-21sendmail07:40:001
166667399171,6cyclictest0-21swapper/109:00:291
1666673991714,2cyclictest1981494-21cstates10:45:211
1666673991714,2cyclictest1938340-21gltestperf10:20:211
1666673991714,2cyclictest1832950-21systemd-run09:20:011
1666673991714,2cyclictest0-21swapper/107:40:251
1666673991713,3cyclictest2069342-21kthreadcore11:35:251
1666673991713,3cyclictest1920119-21/usr/sbin/munin10:10:251
1666673991713,3cyclictest1858954-21latency_hist09:35:001
1666673991713,3cyclictest0-21swapper/111:30:021
166667399170,8cyclictest2102183-21idleruntime-cro11:55:001
166667299178,3cyclictest0-21swapper/007:24:120
166667299177,1cyclictest191rcu_preempt10:15:230
166667299176,7cyclictest2050747-21stty11:25:190
1666672991715,1cyclictest2079488-21kthreadcore11:40:260
1666672991715,1cyclictest1711725-21perf07:45:010
1666672991714,2cyclictest2059382-21aten2.4-expect11:30:180
1666672991714,2cyclictest1999404-21irqcore10:55:220
1666672991714,2cyclictest1824293-21kworker/u16:0-rpciod09:50:250
1666672991714,2cyclictest1792670-21kthreadcore08:50:240
1666672991714,2cyclictest1720866-21kthreadcore07:50:260
1666672991711,3cyclictest0-21swapper/009:00:010
302487291160,3phc2sys0-21swapper/311:44:393
302487291160,3phc2sys0-21swapper/310:00:313
302487291160,2phc2sys0-21swapper/312:27:283
1666674991614,1cyclictest0-21swapper/207:15:022
1666674991613,1cyclictest0-21swapper/211:50:012
1666674991613,1cyclictest0-21swapper/211:35:272
1666674991613,1cyclictest0-21swapper/211:15:012
1666674991613,1cyclictest0-21swapper/210:35:202
1666674991613,1cyclictest0-21swapper/210:20:302
1666674991613,1cyclictest0-21swapper/209:21:292
1666674991613,1cyclictest0-21swapper/208:35:162
1666674991613,1cyclictest0-21swapper/207:20:252
166667399166,5cyclictest0-21swapper/110:30:301
166667399165,8cyclictest1635-21dbus-daemon09:55:011
166667399161,6cyclictest1742355-21perf08:10:001
1666673991613,2cyclictest2114192-21sed12:00:241
1666673991613,2cyclictest2000810-21kthreadcore10:55:241
1666673991613,2cyclictest1635-21dbus-daemon12:35:001
1666673991611,3cyclictest1880589-21kthreadcore09:45:261
166667399160,7cyclictest0-21swapper/112:05:281
1666672991614,1cyclictest1791178-21systemd-run08:50:010
1666672991613,2cyclictest1805879-21kthreadcore09:00:330
1666672991613,2cyclictest1775894-21kthreadcore08:35:210
1666672991613,2cyclictest1738072-21kthreadcore08:05:250
1666672991613,2cyclictest1731350-21if_enp1s0.808:00:240
1666672991610,3cyclictest0-21swapper/008:20:300
302487291151,3phc2sys0-21swapper/310:54:103
302487291150,2phc2sys0-21swapper/310:15:233
302487291150,2phc2sys0-21swapper/308:05:273
1666674991513,1cyclictest0-21swapper/212:15:012
1666674991513,1cyclictest0-21swapper/210:05:022
1666674991512,1cyclictest0-21swapper/212:35:002
1666674991512,1cyclictest0-21swapper/211:30:212
1666674991512,1cyclictest0-21swapper/208:35:012
1666674991512,1cyclictest0-21swapper/207:52:152
1666674991512,1cyclictest0-21swapper/207:40:022
1666674991511,2cyclictest0-21swapper/210:50:212
166667499150,3cyclictest21545182sleep212:25:142
166667399154,4cyclictest1681750-21aten2.4-expect07:20:191
166667399151,6cyclictest0-21swapper/108:40:211
1666673991512,2cyclictest2130024-21kthreadcore12:10:251
1666673991512,2cyclictest1899549-21grep09:55:321
1666673991512,2cyclictest1798728-21kthreadcore08:55:231
1666673991512,2cyclictest1755952-21cut08:20:241
1666673991512,2cyclictest0-21swapper/107:45:171
1666673991511,3cyclictest1769778-21kthreadcore08:30:261
1666673991511,3cyclictest1750066-21kthreadcore08:15:251
1666673991511,3cyclictest1721498-21kthreadcore07:50:251
1666672991513,1cyclictest1748834-21aten2.4-expect08:15:180
1666672991512,2cyclictest1696540-21kthreadcore07:30:260
302487291143,3phc2sys0-21swapper/309:40:123
302487291141,3phc2sys0-21swapper/307:42:263
302487291141,2phc2sys0-21swapper/311:53:433
302487291140,4phc2sys0-21swapper/312:08:043
302487291140,3phc2sys0-21swapper/311:01:593
302487291140,3phc2sys0-21swapper/309:25:393
302487291140,2phc2sys0-21swapper/311:21:283
302487291140,2phc2sys0-21swapper/309:18:063
1666674991412,1cyclictest0-21swapper/211:25:272
1666674991412,1cyclictest0-21swapper/209:25:202
1666674991411,1cyclictest0-21swapper/212:05:272
1666674991411,1cyclictest0-21swapper/211:55:292
1666674991411,1cyclictest0-21swapper/210:45:012
1666674991411,1cyclictest0-21swapper/209:50:262
1666674991411,1cyclictest0-21swapper/209:45:252
1666674991411,1cyclictest0-21swapper/209:30:182
1666674991411,1cyclictest0-21swapper/208:55:242
1666674991411,1cyclictest0-21swapper/208:10:292
1666674991411,1cyclictest0-21swapper/207:45:242
1666673991411,2cyclictest2174828-21kthreadcore12:35:271
1666673991411,2cyclictest1694516-21head07:30:201
1666673991411,2cyclictest0-21swapper/107:10:001
1666673991410,3cyclictest1775987-21kthreadcore08:35:211
1666673991410,3cyclictest1745065-21kthreadcore08:10:301
1666672991411,2cyclictest1666653-21munin-run07:10:000
302487291136,3phc2sys0-21swapper/311:33:253
302487291131,2phc2sys0-21swapper/308:30:423
302487291131,2phc2sys0-21swapper/307:13:203
302487291130,4phc2sys0-21swapper/311:05:513
302487291130,4phc2sys0-21swapper/307:05:193
302487291130,3phc2sys0-21swapper/309:45:253
302487291130,2phc2sys0-21swapper/311:55:203
302487291130,2phc2sys0-21swapper/309:25:013
302487291130,2phc2sys0-21swapper/308:50:233
302487291130,2phc2sys0-21swapper/307:45:503
1666674991311,1cyclictest0-21swapper/210:30:252
1666674991311,1cyclictest0-21swapper/210:30:012
1666674991311,1cyclictest0-21swapper/210:05:232
1666674991311,1cyclictest0-21swapper/209:40:212
1666674991311,1cyclictest0-21swapper/209:00:342
1666674991311,1cyclictest0-21swapper/208:00:302
1666674991310,1cyclictest0-21swapper/212:00:252
1666674991310,1cyclictest0-21swapper/210:45:292
1666674991310,1cyclictest0-21swapper/209:15:262
1666674991310,1cyclictest0-21swapper/208:50:202
1666674991310,1cyclictest0-21swapper/208:45:242
1666674991310,1cyclictest0-21swapper/208:15:192
1666674991310,1cyclictest0-21swapper/208:05:242
1666674991310,1cyclictest0-21swapper/207:55:162
1666674991310,1cyclictest0-21swapper/207:30:182
166667399130,12cyclictest1725063-21grep07:55:181
302487291123,3phc2sys0-21swapper/312:14:383
302487291123,2phc2sys0-21swapper/312:00:193
302487291121,5phc2sys0-21swapper/308:15:163
302487291121,3phc2sys0-21swapper/312:24:443
302487291121,3phc2sys0-21swapper/307:20:013
302487291120,3phc2sys0-21swapper/309:31:293
302487291120,2phc2sys0-21swapper/310:32:423
302487291120,2phc2sys0-21swapper/308:11:433
302487291120,1phc2sys0-21swapper/310:58:113
166667499129,2cyclictest0-21swapper/210:55:242
166667499129,1cyclictest0-21swapper/207:25:252
166667499121,5cyclictest0-21swapper/209:10:122
1666674991210,1cyclictest0-21swapper/211:20:212
1666674991210,1cyclictest0-21swapper/211:05:252
302487291112,2phc2sys0-21swapper/309:36:273
302487291111,2phc2sys0-21swapper/309:10:023
302487291110,3phc2sys0-21swapper/312:30:093
302487291110,3phc2sys0-21swapper/311:36:033
302487291110,3phc2sys0-21swapper/310:44:323
302487291110,3phc2sys0-21swapper/310:36:433
302487291110,3phc2sys0-21swapper/310:26:493
302487291110,3phc2sys0-21swapper/307:35:283
302487291110,3phc2sys0-21swapper/307:20:263
302487291110,2phc2sys0-21swapper/312:38:023
302487291110,2phc2sys0-21swapper/310:10:303
302487291110,2phc2sys0-21swapper/309:11:393
302487291110,2phc2sys0-21swapper/309:00:303
166667499119,1cyclictest0-21swapper/207:40:242
302487291101,2phc2sys0-21swapper/311:26:373
302487291101,2phc2sys0-21swapper/310:05:253
302487291101,2phc2sys0-21swapper/308:55:243
302487291101,2phc2sys0-21swapper/308:37:363
302487291101,2phc2sys0-21swapper/308:25:453
302487291101,2phc2sys0-21swapper/308:20:243
302487291101,2phc2sys0-21swapper/307:33:523
302487291100,4phc2sys0-21swapper/308:00:163
302487291100,2phc2sys0-21swapper/307:55:543
30248729192,2phc2sys0-21swapper/308:43:213
30248729191,2phc2sys0-21swapper/308:48:463
30248729190,2phc2sys0-21swapper/307:54:563
30248729190,2phc2sys0-21swapper/307:25:223
16666749997,1cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional