You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 18:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Sun Nov 30, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164610821470,1sleep11646105-21df10:35:191
15942552300,1sleep00-21swapper/010:05:200
1349024992412,7cyclictest0-21swapper/007:35:010
1349024992316,6cyclictest1716350-21irqrtprio11:15:220
1349024992314,5cyclictest1753337-21kthreadcore11:35:230
1349026992219,1cyclictest0-21swapper/209:40:012
1349024992215,6cyclictest1632299-21kthreadcore10:25:230
1349024992214,5cyclictest1607646-21sed10:10:290
1349024992211,7cyclictest1508725-21kthreadcore09:15:250
1349026992118,1cyclictest0-21swapper/212:20:002
1349026992116,2cyclictest0-21swapper/209:30:002
1349025992118,2cyclictest1635-21dbus-daemon08:50:011
1349025992118,2cyclictest1355873-21kthreadcore07:15:021
1349024992113,7cyclictest1778721-21kthreadcore11:50:210
1349024992113,7cyclictest0-21swapper/012:20:000
1349024992112,5cyclictest1732774-21cstates11:25:170
302487291200,3phc2sys0-21swapper/309:55:023
16680902200,2sleep30-21swapper/310:45:273
16680902200,2sleep30-21swapper/310:45:273
1349026992018,1cyclictest0-21swapper/209:00:012
1349026992017,1cyclictest0-21swapper/212:20:132
1349026992017,1cyclictest0-21swapper/211:40:002
1349025992017,2cyclictest1662668-21apt-key10:45:011
1349025992017,2cyclictest1662668-21apt-key10:45:011
1349025992017,2cyclictest1498225-21munin-run09:10:021
1349025992015,4cyclictest1567191-21idleruntime-cro09:50:001
134902499209,6cyclictest0-21swapper/009:35:130
1349024992016,3cyclictest1631-21gmain10:40:010
1349024992010,5cyclictest0-21swapper/009:45:010
1349026991916,1cyclictest0-21swapper/209:15:002
134902599198,4cyclictest0-21swapper/108:20:011
1349025991913,5cyclictest1586151-21ssh10:00:231
1349025991913,5cyclictest1586151-21ssh10:00:231
1349025991912,3cyclictest1707795-21kernelversion11:10:291
1349025991911,4cyclictest1777213-21kthreadcore11:50:201
1349024991916,2cyclictest1349092-21runrttasks07:10:010
1349024991916,2cyclictest1-21systemd12:00:270
1349024991916,2cyclictest1-21systemd09:25:140
134902499191,3cyclictest1458675-21cut08:35:220
1349024991911,4cyclictest1500001-21ssh09:10:220
302487291180,3phc2sys0-21swapper/309:28:323
1349025991815,2cyclictest1464569-21kthreadcore08:40:241
1349025991815,2cyclictest1461433-21gpgconf08:40:001
134902599181,3cyclictest1524326-21apt-get09:25:141
134902499189,4cyclictest0-21swapper/009:10:020
1349024991815,2cyclictest1567414-21sh09:50:020
1349024991815,2cyclictest1449023-21cron08:30:000
1349024991810,4cyclictest1769298-21kthreadcore11:45:210
302487291171,3phc2sys0-21swapper/311:10:293
302487291170,2phc2sys0-21swapper/312:34:443
1349026991714,1cyclictest0-21swapper/212:00:192
1349026991714,1cyclictest0-21swapper/211:25:232
1349026991714,1cyclictest0-21swapper/209:45:372
1349026991714,1cyclictest0-21swapper/208:30:222
1349026991714,1cyclictest0-21swapper/207:55:002
134902599178,4cyclictest0-21swapper/112:20:011
134902599178,4cyclictest0-21swapper/111:40:001
134902599178,4cyclictest0-21swapper/109:25:001
134902599172,1cyclictest170550irq/121-eno109:40:121
1349025991714,2cyclictest1749356-21latency_hist11:35:001
1349025991714,2cyclictest1611917-21irqcore10:15:201
1349025991713,3cyclictest1645211-21kworker/u16:0+nfsiod12:13:041
1349025991711,5cyclictest1508340-21kthreadcore09:15:251
134902499178,5cyclictest1709963-21kthreadcore11:10:310
134902499178,4cyclictest0-21swapper/012:00:010
134902499178,4cyclictest0-21swapper/011:45:010
134902499177,5cyclictest0-21swapper/012:20:210
134902499176,6cyclictest0-21swapper/009:30:230
134902499176,5cyclictest1523867-21grep09:25:000
134902499175,2cyclictest1827371-21kworker/u16:3+xprtiod12:28:380
1349024991714,2cyclictest1627835-21kworker/u16:3-rpciod11:00:010
1349024991714,2cyclictest1355561-21munin-run07:15:010
1349024991714,2cyclictest1-21systemd10:20:000
1349024991714,2cyclictest1-21systemd07:30:010
302487291161,2phc2sys0-21swapper/310:37:473
302487291160,2phc2sys0-21swapper/311:55:413
302487291160,2phc2sys0-21swapper/310:50:263
134902699161,8cyclictest0-21swapper/210:20:012
1349026991614,1cyclictest0-21swapper/210:05:012
1349026991614,1cyclictest0-21swapper/210:05:012
1349026991614,1cyclictest0-21swapper/209:50:222
1349026991613,1cyclictest0-21swapper/212:35:192
1349026991613,1cyclictest0-21swapper/212:30:242
1349026991613,1cyclictest0-21swapper/212:30:002
1349026991613,1cyclictest0-21swapper/212:00:012
1349026991613,1cyclictest0-21swapper/211:45:002
1349026991613,1cyclictest0-21swapper/211:05:012
1349026991613,1cyclictest0-21swapper/209:20:142
1349026991613,1cyclictest0-21swapper/207:45:002
134902599169,3cyclictest1437307-21aten2.4-expect08:20:161
134902599167,4cyclictest0-21swapper/110:30:251
1349025991613,2cyclictest1858740-21tr12:35:261
1349025991613,2cyclictest1702-21in:imuxsock12:25:011
1349025991613,2cyclictest1700708-21kthreadcore11:05:361
1349025991613,2cyclictest0-21swapper/111:50:011
134902499168,4cyclictest1698211-21cstates11:05:300
134902499167,5cyclictest1586147-21grep10:00:230
134902499167,5cyclictest1586147-21grep10:00:230
1349024991613,2cyclictest8351-21rtkit-daemon07:59:040
1349024991613,2cyclictest1364612-21cut07:20:230
1349024991613,2cyclictest1349014-21cyclictest08:15:220
1349024991612,3cyclictest1645211-21kworker/u16:0+nfsiod10:51:570
1349024991611,4cyclictest1726443-21cut11:20:230
134902499160,11cyclictest1395278-21if_enp1s007:45:190
302487291151,4phc2sys0-21swapper/308:50:143
302487291150,4phc2sys0-21swapper/309:44:373
302487291150,3phc2sys0-21swapper/311:46:033
302487291150,3phc2sys0-21swapper/309:15:303
302487291150,2phc2sys0-21swapper/311:35:513
302487291150,2phc2sys0-21swapper/310:06:343
302487291150,2phc2sys0-21swapper/309:24:153
134902699151,7cyclictest0-21swapper/212:10:162
1349026991512,1cyclictest0-21swapper/212:05:202
1349026991512,1cyclictest0-21swapper/210:54:232
1349026991512,1cyclictest0-21swapper/210:50:002
1349026991512,1cyclictest0-21swapper/210:50:002
1349026991512,1cyclictest0-21swapper/210:00:002
1349026991512,1cyclictest0-21swapper/208:25:012
1349026991512,1cyclictest0-21swapper/208:10:022
1349026991512,1cyclictest0-21swapper/208:00:162
1349026991512,1cyclictest0-21swapper/207:35:292
1349026991511,2cyclictest0-21swapper/211:14:582
134902599159,5cyclictest1737271-21cut11:25:241
1349025991513,1cyclictest8351-21rtkit-daemon11:40:081
1349025991512,2cyclictest8351-21rtkit-daemon09:55:391
1349025991512,2cyclictest1804582-21kthreadcore12:05:241
1349025991512,2cyclictest1718887-21kthreadcore11:15:241
1349025991512,2cyclictest1704-21rs:main1
1349025991512,2cyclictest1601866-21cut10:10:011
1349025991512,2cyclictest1569560-21kthreadcore09:50:211
1349025991512,2cyclictest1485842-21latency_hist09:00:011
1349025991512,2cyclictest1382198-21/usr/sbin/munin07:35:231
1349025991511,3cyclictest1396936-21kthreadcore07:45:211
1349025991511,3cyclictest1362095-21kthreadcore07:15:241
134902499158,3cyclictest1485804-21sendmail09:00:000
134902499156,5cyclictest0-21swapper/009:50:140
134902499156,4cyclictest0-21swapper/012:35:010
134902499155,6cyclictest1804582-21kthreadcore12:05:240
134902499155,6cyclictest0-21swapper/009:01:480
1349024991512,2cyclictest1862150-21latency_hist12:40:020
1349024991512,2cyclictest1671297-21turbostat.cron10:50:000
1349024991512,2cyclictest1671297-21turbostat.cron10:50:000
1349024991512,2cyclictest1662590-21apt-key10:45:010
1349024991512,2cyclictest1662590-21apt-key10:45:010
1349024991512,2cyclictest1360493-21kthreadcore07:15:230
1349024991511,3cyclictest1454261-21processes08:30:250
134902499150,13cyclictest1406337-21perf07:55:000
302487291147,3phc2sys0-21swapper/312:15:003
302487291143,2phc2sys0-21swapper/310:34:423
302487291141,2phc2sys0-21swapper/312:20:183
302487291141,2phc2sys0-21swapper/309:51:493
302487291140,4phc2sys0-21swapper/310:42:513
302487291140,4phc2sys0-21swapper/310:42:513
302487291140,2phc2sys0-21swapper/312:05:173
302487291140,2phc2sys0-21swapper/311:05:403
302487291140,2phc2sys0-21swapper/310:14:233
302487291140,2phc2sys0-21swapper/309:33:143
134902699141,6cyclictest0-21swapper/211:00:012
1349026991412,1cyclictest0-21swapper/211:30:332
1349026991412,1cyclictest0-21swapper/210:25:242
1349026991412,1cyclictest0-21swapper/210:25:012
1349026991412,1cyclictest0-21swapper/209:42:212
1349026991411,1cyclictest0-21swapper/211:05:332
1349026991411,1cyclictest0-21swapper/210:30:212
1349026991411,1cyclictest0-21swapper/210:10:212
1349026991411,1cyclictest0-21swapper/209:05:022
1349026991411,1cyclictest0-21swapper/208:45:102
1349026991411,1cyclictest0-21swapper/208:30:002
1349026991411,1cyclictest0-21swapper/208:15:252
1349026991411,1cyclictest0-21swapper/207:15:012
1349026991410,2cyclictest0-21swapper/211:50:252
1349026991410,2cyclictest0-21swapper/211:20:162
134902599147,3cyclictest2009-21runrttasks12:00:151
134902599144,5cyclictest1369890-21cat07:25:021
1349025991411,2cyclictest8351-21rtkit-daemon08:29:131
1349025991411,2cyclictest1840933-21kthreadcore12:25:241
1349025991411,2cyclictest1785852-21kthreadcore11:55:231
1349025991411,2cyclictest1723932-21aten2.4-expect11:20:171
1349025991411,2cyclictest1691942-21kthreadcore11:00:231
1349025991411,2cyclictest1680887-21df_inode10:55:191
1349025991411,2cyclictest1665520-21kthreadcore10:45:231
1349025991411,2cyclictest1665520-21kthreadcore10:45:231
1349025991411,2cyclictest1652-1atopacctd10:51:121
1349025991411,2cyclictest1628279-21aten2.4-expect10:25:161
1349025991411,2cyclictest1620209-21gltestperf10:20:211
1349025991411,2cyclictest1606493-21kthreadcore10:10:231
1349025991411,2cyclictest1491996-21sh09:05:011
1349025991411,2cyclictest1419929-21irqrtprio08:05:211
1349025991411,2cyclictest1371302-21kthreadcore07:25:221
1349025991410,3cyclictest1535937-21kthreadcore09:30:231
1349025991410,3cyclictest1485295-21kworker/u16:0+nfsiod09:10:031
1349025991410,3cyclictest1477606-21kthreadcore08:50:221
1349025991410,3cyclictest1453320-21kthreadcore08:30:221
1349025991410,3cyclictest1415587-21kthreadcore08:00:221
1349025991410,3cyclictest1405746-21timerandwakeup07:50:391
1349025991410,2cyclictest0-21swapper/108:00:021
134902499144,4cyclictest1818406-21sshd12:14:380
1349024991411,2cyclictest1689039-21runrttasks11:00:140
1349024991411,2cyclictest1637974-21irqrtprio10:30:240
1349024991411,2cyclictest1620859-21kthreadcore10:20:240
1349024991411,2cyclictest1440796-21kthreadcore08:20:220
1349024991411,2cyclictest1421111-21kthreadcore08:05:220
1349024991411,2cyclictest1383525-21kthreadcore07:35:230
1349024991410,3cyclictest1477806-21kthreadcore08:50:220
1349024991410,3cyclictest1427684-21kthreadcore08:10:230
134902499140,5cyclictest2009-21runrttasks09:55:280
134902499140,13cyclictest0-21swapper/008:40:190
134902499140,10cyclictest1392054-21cut07:40:240
302487291131,2phc2sys0-21swapper/310:55:383
302487291130,3phc2sys0-21swapper/307:40:173
302487291130,2phc2sys0-21swapper/311:20:193
302487291130,2phc2sys0-21swapper/309:12:273
134902699131,5cyclictest0-21swapper/207:55:152
134902699131,5cyclictest0-21swapper/207:10:012
1349026991311,1cyclictest0-21swapper/210:45:012
1349026991311,1cyclictest0-21swapper/210:45:012
1349026991310,1cyclictest0-21swapper/211:45:222
1349026991310,1cyclictest0-21swapper/210:05:182
1349026991310,1cyclictest0-21swapper/209:30:192
1349026991310,1cyclictest0-21swapper/209:15:252
1349026991310,1cyclictest0-21swapper/209:05:202
1349026991310,1cyclictest0-21swapper/207:45:222
1349026991310,1cyclictest0-21swapper/207:25:222
1349026991310,1cyclictest0-21swapper/207:15:222
134902599132,4cyclictest1541718-21head09:35:141
1349025991310,2cyclictest1376872-21gltestperf07:30:181
134902599130,4cyclictest1430705-21munin-plugin-st08:15:001
134902499134,5cyclictest0-21swapper/011:33:130
1349024991310,2cyclictest1472041-21kthreadcore08:45:230
1349024991310,2cyclictest1416532-21kthreadcore08:00:220
302487291123,2phc2sys0-21swapper/312:38:543
302487291122,2phc2sys0-21swapper/307:15:253
302487291121,3phc2sys0-21swapper/309:46:163
302487291121,3phc2sys0-21swapper/307:45:223
302487291120,3phc2sys0-21swapper/308:10:153
302487291120,2phc2sys0-21swapper/310:29:533
302487291120,2phc2sys0-21swapper/309:04:563
134902699129,1cyclictest0-21swapper/208:40:242
134902699129,1cyclictest0-21swapper/208:35:232
134902699121,5cyclictest0-21swapper/211:20:012
1349026991210,1cyclictest0-21swapper/210:35:202
1349026991210,1cyclictest0-21swapper/207:30:222
1349026991210,1cyclictest0-21swapper/207:20:272
134902599129,2cyclictest1388708-21cstates07:40:191
134902599120,6cyclictest1349028-21systemd-run07:10:011
302487291111,3phc2sys0-21swapper/311:04:443
302487291111,2phc2sys0-21swapper/311:50:453
302487291111,2phc2sys0-21swapper/311:29:493
302487291111,2phc2sys0-21swapper/309:05:253
302487291110,2phc2sys0-21swapper/311:40:313
302487291110,2phc2sys0-21swapper/311:30:033
302487291110,2phc2sys0-21swapper/308:55:153
302487291110,2phc2sys0-21swapper/308:07:183
134902699119,1cyclictest0-21swapper/208:50:202
134902699119,1cyclictest0-21swapper/208:10:212
302487291101,2phc2sys0-21swapper/311:15:183
302487291101,2phc2sys0-21swapper/309:35:063
302487291101,2phc2sys0-21swapper/307:05:193
302487291100,3phc2sys0-21swapper/312:25:513
302487291100,3phc2sys0-21swapper/310:21:523
302487291100,3phc2sys0-21swapper/308:25:013
302487291100,3phc2sys0-21swapper/308:00:013
302487291100,3phc2sys0-21swapper/307:30:283
302487291100,2phc2sys0-21swapper/312:17:343
302487291100,2phc2sys0-21swapper/312:02:393
302487291100,2phc2sys0-21swapper/310:02:563
302487291100,2phc2sys0-21swapper/310:02:563
302487291100,2phc2sys0-21swapper/308:25:173
302487291100,2phc2sys0-21swapper/308:15:283
302487291100,1phc2sys0-21swapper/308:43:213
30248729190,2phc2sys0-21swapper/310:15:033
30248729190,2phc2sys0-21swapper/308:45:173
30248729190,2phc2sys0-21swapper/308:30:143
30248729190,2phc2sys0-21swapper/308:00:053
30248729190,2phc2sys0-21swapper/307:50:153
30248729190,2phc2sys0-21swapper/307:35:163
30248729190,2phc2sys0-21swapper/307:25:153
30248729190,2phc2sys0-21swapper/307:20:263
30248729190,2phc2sys0-21swapper/307:10:243
30248729180,2phc2sys0-21swapper/308:35:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional