You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6.osadl.org (updated Fri May 02, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124731099133118,12cyclictest1340790-40mandb00:00:001
124731099122116,4cyclictest1265019-21kworker/u8:2+flush-179:020:10:241
124731099122115,4cyclictest1334127-21kworker/u8:2+events_unbound23:40:011
124730999116102,11cyclictest1261667-21gpgv19:55:000
124730999111102,7cyclictest1250397-21kworker/u8:0+flush-179:019:20:210
124730999111102,7cyclictest1250397-21kworker/u8:0+flush-179:019:20:200
124730999110102,6cyclictest1337573-21kworker/u8:0+events_unbound00:04:000
12473099910896,9cyclictest1284334-21latency_hist21:05:000
12473109910798,6cyclictest1289342-21kworker/u8:3+events_unbound22:10:141
12473099910798,7cyclictest1284831-21kworker/u8:1+flush-179:021:20:270
12473099910697,7cyclictest1289342-21kworker/u8:3+events_unbound21:50:020
12473099910695,9cyclictest1340790-40mandb00:00:010
12473109910493,8cyclictest1316661-21latency_hist22:45:011
12473099910494,7cyclictest1257044-21apt-get19:40:200
12473099910391,9cyclictest1326188-21latency_hist23:15:000
12473109910292,7cyclictest1334192-21http23:40:011
12473109910291,8cyclictest1258611-21/usr/sbin/munin19:45:281
12473109910195,4cyclictest1284831-21kworker/u8:1+events_unbound21:30:201
12473109910193,5cyclictest1289342-21kworker/u8:3+events_unbound21:25:191
12473099910188,10cyclictest1275040-21apt-get20:35:120
1247309999990,7cyclictest1337848-21apt-get23:50:150
1247309999987,4cyclictest1279579-21kworker/u8:2+events_unbound20:50:180
1247309999890,5cyclictest1321402-21kworker/u8:1+flush-179:023:30:230
1247310999789,7cyclictest1310333-21kworker/u8:2+events_unbound22:45:211
1247310999789,5cyclictest1284831-21kworker/u8:1+events_unbound21:20:201
1247309999789,6cyclictest1255162-21kworker/u8:0+events_unbound19:55:020
1247310999689,5cyclictest1321402-21kworker/u8:1+events_unbound23:10:001
1247309999688,6cyclictest1321402-21kworker/u8:1+flush-179:023:40:220
1247310999582,4cyclictest1245747-21kworker/u8:3+events_unbound19:10:221
1247309999588,5cyclictest1344051-21kworker/u8:1+flush-179:000:15:010
1247309999586,7cyclictest1289342-21kworker/u8:3+events_unbound21:40:180
1247310999487,4cyclictest1310333-21kworker/u8:2+events_unbound22:35:141
1247310999487,4cyclictest1310333-21kworker/u8:2+events_unbound22:35:141
1247310999379,5cyclictest1255162-21kworker/u8:0+flush-179:019:55:241
1247309999383,8cyclictest1302318-21kworker/u8:2+events_unbound22:05:240
1247310999181,7cyclictest1310333-21kworker/u8:2+events_unbound22:30:221
1247309999178,10cyclictest1292798-21apt-get21:30:170
1247310999082,6cyclictest1340839-21kworker/u8:2+events_unbound00:15:151
1247310999082,6cyclictest1307131-21kworker/u8:0+events_unbound22:25:171
1247310998979,8cyclictest1270285-21apt-get20:20:151
1247309998982,6cyclictest1292527-21kworker/u8:0+flush-179:022:00:000
1247309998976,4cyclictest1268183-21kworker/u8:4+flush-179:020:15:240
1247310998882,4cyclictest1345617-21kworker/u8:4+flush-179:000:25:221
1247310998877,3cyclictest1255162-21kworker/u8:0+flush-179:019:35:151
1247310998781,4cyclictest1286417-21kworker/u8:0+flush-179:021:10:251
1247309998782,3cyclictest1334127-21kworker/u8:2+events_unbound23:45:230
1247309998780,5cyclictest1287227-21kworker/u8:2+flush-179:021:15:210
1247309998674,9cyclictest1294385-21apt-get21:35:150
1247310998577,5cyclictest1350696-21store00:30:011
1247310998577,5cyclictest1265019-21kworker/u8:2+flush-179:020:25:241
1247309998578,4cyclictest1350691-21gpgv00:30:020
1247309998577,5cyclictest1271647-21kworker/u8:0+events_unbound20:30:150
1247310998474,7cyclictest1284852-21apt-get21:05:131
1247310998377,4cyclictest1316899-21kworker/u8:0+events_unbound22:50:221
1247310998377,3cyclictest1321402-21kworker/u8:1+flush-179:023:15:231
1247310998376,5cyclictest1276434-21kworker/u8:3+flush-179:020:40:221
1247309998374,6cyclictest1310333-21kworker/u8:2+events_unbound22:40:200
1247309998370,5cyclictest1337573-21kworker/u8:0+events_unbound00:10:000
1247309998370,4cyclictest1253512-21kworker/u8:2+events_unbound19:30:210
1247310998276,5cyclictest1332538-21kworker/u8:0+events_unbound23:35:011
1247310998276,4cyclictest1264969-21kworker/u8:1+flush-179:020:10:011
1247310998275,5cyclictest1310333-21kworker/u8:2+flush-179:023:00:231
1247310998275,4cyclictest1321402-21kworker/u8:1+flush-179:023:10:221
1247310998271,9cyclictest1298908-21apt-get21:50:001
1247310998176,4cyclictest1321402-21kworker/u8:1+events_unbound23:29:591
1247309998172,6cyclictest1310333-21kworker/u8:2+flush-179:022:35:210
1247309998172,6cyclictest1310333-21kworker/u8:2+flush-179:022:35:210
1247310998074,4cyclictest1268183-21kworker/u8:4+events_unbound20:15:171
1247309998074,5cyclictest1302318-21kworker/u8:2+flush-179:022:05:010
1247309998072,6cyclictest1244848-21kworker/u8:1+flush-179:019:15:220
1247310997972,6cyclictest1282167-21kworker/u8:1+events_unbound20:55:261
1247310997970,6cyclictest1252267-21apt-get19:25:121
1247309997974,3cyclictest1264969-21kworker/u8:1+events_unbound20:05:240
1247310997873,3cyclictest1347436-21kworker/u8:0+flush-179:000:20:241
1247310997866,9cyclictest1301002-21apt-get21:55:131
1247310997766,8cyclictest1342680-21apt-get00:05:131
1247309997771,5cyclictest1284831-21kworker/u8:1+flush-179:021:05:180
1247309997768,7cyclictest1347436-21kworker/u8:0+events_unbound00:30:010
1247309997764,10cyclictest1308970-21apt-get22:20:130
1247309997670,5cyclictest1310333-21kworker/u8:2+events_unbound22:45:250
1247310997570,4cyclictest1289342-21kworker/u8:3+flush-179:021:50:201
1247310997569,4cyclictest1271647-21kworker/u8:0+flush-179:020:45:251
1247310997564,4cyclictest1340839-21kworker/u8:2+events_unbound00:00:241
1247309997569,4cyclictest1244848-21kworker/u8:1+flush-179:019:25:210
1247310997469,4cyclictest1334214-21kworker/u8:3+flush-179:023:50:281
1247309997368,3cyclictest191rcuc/023:30:000
1247309997367,4cyclictest1310333-21kworker/u8:2+flush-179:023:20:230
1247309997359,5cyclictest1289342-21kworker/u8:3+flush-179:022:10:230
1247310997268,3cyclictest1255162-21kworker/u8:0+events_unbound19:40:221
1247310997266,4cyclictest1340839-21kworker/u8:2+flush-179:000:10:211
1247310997266,4cyclictest1334214-21kworker/u8:3+events_unbound23:45:281
1247309997266,4cyclictest1271647-21kworker/u8:0+flush-179:020:40:280
1247309997265,6cyclictest1310333-21kworker/u8:2+flush-179:022:55:260
1247310997165,4cyclictest1348832-21kworker/u8:1+flush-179:000:35:141
1247309997166,4cyclictest1255162-21kworker/u8:0+events_unbound19:50:010
1247309997159,9cyclictest1291214-21apt-get21:25:150
1247316997063,5cyclictest1282736-21turbostat21:00:003
1247309997057,10cyclictest1298901-21latency_hist21:50:010
1247309997056,6cyclictest1255162-21kworker/u8:0+events_unbound20:00:260
1247309996859,7cyclictest1287766-21latency_hist21:15:010
1247310996760,5cyclictest1276434-21kworker/u8:3+events_unbound21:00:291
1247310996758,5cyclictest1244848-21kworker/u8:1+events_unbound19:15:171
1247309996761,5cyclictest1321402-21kworker/u8:1+events_unbound23:15:250
1247310996561,3cyclictest1271647-21kworker/u8:0+flush-179:020:35:211
1247310996559,4cyclictest1305512-21kworker/u8:1+events_unbound22:20:211
1247310996555,4cyclictest1271647-21kworker/u8:0+events_unbound20:50:241
1247309996458,4cyclictest191rcuc/020:25:260
1247309996458,4cyclictest1310333-21kworker/u8:2+events_unbound23:05:220
1247316996361,1cyclictest0-21swapper/319:52:593
1247310996356,5cyclictest1255162-21kworker/u8:0+flush-179:020:00:211
1247309996351,4cyclictest1348832-21kworker/u8:1+events_unbound00:40:010
1247310996256,4cyclictest1302318-21kworker/u8:2+events_unbound22:05:181
1247310996156,4cyclictest1292527-21kworker/u8:0+flush-179:021:35:241
1247316996058,1cyclictest0-21swapper/323:45:583
1247312996028,2cyclictest0-21swapper/200:00:592
1247310996055,4cyclictest1271647-21kworker/u8:0+events_unbound20:30:241
1247310996055,3cyclictest1253512-21kworker/u8:2+flush-179:019:50:161
1247309996053,6cyclictest1279579-21kworker/u8:2+flush-179:020:55:250
1247310995954,4cyclictest1318279-21kworker/u8:3+events_unbound22:55:261
1247309995953,4cyclictest1245747-21kworker/u8:3+events_unbound19:10:210
1247310995849,6cyclictest1328055-21apt-get23:20:141
1247309995853,4cyclictest1253512-21kworker/u8:2+flush-179:019:35:200
1247309995747,8cyclictest1307131-21kworker/u8:0+flush-179:022:15:160
1247310995651,4cyclictest1253512-21kworker/u8:2+flush-179:019:30:201
1247310995550,4cyclictest1307131-21kworker/u8:0+events_unbound22:15:231
1247309995550,4cyclictest1316899-21kworker/u8:0+events_unbound22:53:110
1247309995547,6cyclictest1265019-21kworker/u8:2+flush-179:020:10:160
1247309995439,11cyclictest1334469-21gpg-connect-age23:40:010
1247309995348,4cyclictest1276434-21kworker/u8:3+flush-179:020:45:310
1247309995245,6cyclictest1268183-21kworker/u8:4+flush-179:020:20:150
1247312995047,2cyclictest0-21swapper/222:12:002
1247309995046,3cyclictest1310333-21kworker/u8:2+events_unbound23:02:110
1247309995045,4cyclictest1345617-21kworker/u8:4+flush-179:000:20:260
1247309995041,7cyclictest1345849-21apt-get00:15:120
1247316994947,1cyclictest0-21swapper/321:58:003
1247310994938,3cyclictest1287227-21kworker/u8:2+events_unbound21:15:211
4505291470,13ptp4l61790irq/134-eno1-TxRx-019:09:563
1247310994742,4cyclictest1292527-21kworker/u8:0+flush-179:021:40:291
124731699460,44cyclictest1298909-21turbostat21:50:003
1247309994540,4cyclictest1-21systemd22:30:010
1247316994439,4cyclictest1255198-21turbostat19:35:003
1247310994338,4cyclictest1302318-21kworker/u8:2+events_unbound22:00:231
1247309994338,4cyclictest1310333-21kworker/u8:2+events_unbound22:30:280
124731699410,40cyclictest1256795-21turbostat19:44:563
1247312994138,2cyclictest0-21swapper/221:46:592
1247310993934,4cyclictest1244848-21kworker/u8:1+flush-179:019:20:281
1247310993934,4cyclictest1244848-21kworker/u8:1+flush-179:019:20:271
1247312993834,2cyclictest0-21swapper/223:34:592
124731299380,36cyclictest0-21swapper/222:02:592
124731299380,36cyclictest0-21swapper/219:34:582
124731299380,35cyclictest0-21swapper/200:31:592
1247316993731,5cyclictest1281151-21turbostat20:55:003
124731699370,36cyclictest0-21swapper/322:27:003
124731699370,30cyclictest431rcuc/322:13:583
124731299370,35cyclictest0-21swapper/222:37:592
124731299370,35cyclictest0-21swapper/222:37:592
1247316993634,1cyclictest0-21swapper/322:06:593
1247316993634,1cyclictest0-21swapper/300:06:593
1247316993633,2cyclictest0-21swapper/320:15:003
124731699360,35cyclictest0-21swapper/322:33:593
124731699360,1cyclictest0-21swapper/300:36:593
1247312993633,2cyclictest0-21swapper/220:17:582
124731299360,1cyclictest0-21swapper/219:28:002
1247316993533,1cyclictest0-21swapper/321:26:593
1247316993532,2cyclictest0-21swapper/322:01:593
1247316993532,2cyclictest0-21swapper/319:25:593
1247316993530,4cyclictest1276392-21turbostat20:40:003
1247316993530,4cyclictest1248824-21turbostat19:15:013
1247316993529,4cyclictest1300750-21turbostat21:55:003
1247312993532,2cyclictest0-21swapper/223:54:552
1247312993532,2cyclictest0-21swapper/222:56:592
1247316993431,2cyclictest0-21swapper/321:02:593
1247312993431,2cyclictest0-21swapper/223:16:592
1247312993431,2cyclictest0-21swapper/221:23:592
1247312993431,2cyclictest0-21swapper/220:02:002
1247316993327,5cyclictest1342440-21turbostat00:05:013
1247312993331,1cyclictest0-21swapper/219:49:592
1247316993230,1cyclictest0-21swapper/322:24:553
1247316993226,4cyclictest1323030-21turbostat23:05:013
1247312993230,1cyclictest0-21swapper/222:29:592
1247316993129,1cyclictest0-21swapper/323:52:003
1247316993129,1cyclictest0-21swapper/323:05:593
1247316993126,4cyclictest1326198-21turbostat23:15:003
1247316993126,4cyclictest1263413-21turbostat20:00:013
124731699310,2cyclictest0-21swapper/320:25:593
1247312993128,2cyclictest0-21swapper/223:35:592
1247312993128,2cyclictest0-21swapper/200:09:562
1247316993027,2cyclictest0-21swapper/320:20:163
1247316993025,4cyclictest1266593-21turbostat20:10:003
1247316993024,4cyclictest1297330-21turbostat21:45:003
124731699300,28cyclictest0-21swapper/320:20:013
1247312993027,2cyclictest0-21swapper/223:40:142
1247312993027,2cyclictest0-21swapper/223:26:002
1247312993027,2cyclictest0-21swapper/221:50:032
1247312993027,2cyclictest0-21swapper/219:40:212
124731299300,29cyclictest0-21swapper/221:00:182
1247316992927,1cyclictest0-21swapper/319:39:003
1247316992926,2cyclictest0-21swapper/323:18:593
1247316992926,2cyclictest0-21swapper/322:40:123
1247316992926,2cyclictest0-21swapper/319:48:583
1247316992924,4cyclictest1289379-21turbostat21:20:003
124731699290,28cyclictest0-21swapper/323:55:133
124731699290,27cyclictest0-21swapper/323:20:153
124731699290,27cyclictest0-21swapper/322:45:143
124731699290,27cyclictest0-21swapper/320:30:153
124731699290,1cyclictest0-21swapper/320:45:193
1247312992926,2cyclictest0-21swapper/223:47:592
1247312992926,2cyclictest0-21swapper/223:21:592
1247312992926,2cyclictest0-21swapper/220:50:162
1247312992926,2cyclictest0-21swapper/219:52:592
1247312992926,2cyclictest0-21swapper/219:20:132
1247312992926,2cyclictest0-21swapper/219:20:132
1247312992926,2cyclictest0-21swapper/200:10:132
124731299290,28cyclictest0-21swapper/223:55:122
124731299290,27cyclictest0-21swapper/222:15:152
124731299290,27cyclictest0-21swapper/220:26:592
124731299290,27cyclictest0-21swapper/219:55:022
1247316992826,1cyclictest0-21swapper/320:40:203
1247316992823,4cyclictest1315081-21turbostat22:40:013
1247316992823,4cyclictest1315081-21turbostat22:40:013
124731699280,26cyclictest0-21swapper/323:40:023
124731699280,26cyclictest0-21swapper/323:30:153
124731699280,26cyclictest0-21swapper/321:05:013
124731699280,26cyclictest0-21swapper/319:15:143
124731699280,26cyclictest0-21swapper/300:20:153
1247312992825,2cyclictest0-21swapper/221:28:002
124731299280,26cyclictest0-21swapper/221:15:132
124731299280,26cyclictest0-21swapper/219:12:002
124731299280,26cyclictest0-21swapper/200:20:162
1247310992819,7cyclictest1247205-21latency_hist19:10:021
4505291270,6ptp4l441ktimers/322:59:543
1247316992725,1cyclictest0-21swapper/300:18:003
124731699270,1cyclictest0-21swapper/321:39:593
1247312992724,2cyclictest0-21swapper/222:07:592
124731299270,26cyclictest0-21swapper/221:05:012
124731299270,24cyclictest0-21swapper/222:51:592
4505291260,7ptp4l61790irq/134-eno1-TxRx-022:55:003
124731699260,24cyclictest0-21swapper/300:25:143
1247312992623,2cyclictest0-21swapper/221:13:592
1247312992623,2cyclictest0-21swapper/220:59:552
124731299260,1cyclictest0-21swapper/220:38:002
4505291250,6ptp4l61790irq/134-eno1-TxRx-000:15:013
124731699250,24cyclictest1294135-21turbostat21:35:003
1247312992523,1cyclictest0-21swapper/223:02:582
1247312992522,2cyclictest0-21swapper/221:36:592
4505291240,4ptp4l441ktimers/321:15:013
4505291240,3ptp4l441ktimers/320:05:003
1247316992422,1cyclictest0-21swapper/319:25:003
1247316992422,1cyclictest0-21swapper/319:24:593
1247312992422,1cyclictest0-21swapper/220:09:592
1247312992421,2cyclictest0-21swapper/222:48:582
1247312992421,2cyclictest0-21swapper/221:32:592
1247312992421,2cyclictest0-21swapper/220:49:552
1247312992421,2cyclictest0-21swapper/220:20:172
124731299240,1cyclictest0-21swapper/222:34:592
4505291230,3ptp4l61790irq/134-eno1-TxRx-022:19:563
4505291230,3ptp4l441ktimers/323:30:013
1247316992321,1cyclictest0-21swapper/300:34:003
1247312992321,1cyclictest0-21swapper/220:44:592
1247312992320,2cyclictest0-21swapper/222:40:132
1247312992320,2cyclictest0-21swapper/221:59:552
1247312992320,2cyclictest0-21swapper/220:12:592
1247312992320,2cyclictest0-21swapper/219:18:592
4505291220,2ptp4l441ktimers/323:39:563
201699220,13rtkit-daemon816013-21ntpd19:09:430
1247316992220,1cyclictest0-21swapper/321:21:003
1247312992017,2cyclictest0-21swapper/200:38:592
1247312991916,2cyclictest0-21swapper/223:11:592
1247312991816,1cyclictest0-21swapper/222:25:002
1247312991816,1cyclictest0-21swapper/221:41:592
1247312991815,2cyclictest0-21swapper/223:06:592
1247312991713,2cyclictest0-21swapper/220:32:582
1247312991311,1cyclictest0-21swapper/200:19:002
124731299108,1cyclictest0-21swapper/219:37:582
12473129970,6cyclictest0-21swapper/200:26:002
12473129930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional