You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 20:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sun Sep 06, 2026 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
128151599151138,10cyclictest1213033-21systemd-journal10:55:010
128151799146135,8cyclictest1341361-21latency_hist10:15:021
128151799144135,6cyclictest1365240-21latency_hist11:30:021
128151799144135,6cyclictest1365240-21latency_hist11:30:011
128151799144132,9cyclictest1379555-21latency_hist12:15:021
128151799144132,9cyclictest1379555-21latency_hist12:15:011
128151799141131,7cyclictest1292863-21apt-get07:45:031
128151599134128,4cyclictest1320395-21kworker/u8:1+flush-179:009:35:010
128151799132121,8cyclictest1357284-21latency_hist11:05:021
128151799128117,8cyclictest1360457-21latency_hist11:15:011
128151599125118,4cyclictest1346174-21kworker/u8:2+events_unbound11:15:230
128151599123114,6cyclictest1378207-21kworker/u8:1+events_unbound12:25:000
128151599120113,4cyclictest1268463-21kworker/u8:1+events_unbound07:25:140
128151599120109,8cyclictest1352506-21latency_hist10:50:010
128151799119108,9cyclictest1357543-21apt-get11:05:111
128151599119112,5cyclictest1339565-21kworker/u8:3+events_unbound10:10:260
128151599119106,8cyclictest1328365-21kworker/u8:3+flush-179:009:35:200
128151799118107,8cyclictest1347728-21latency_hist10:35:011
128151599118111,5cyclictest1265256-21kworker/u8:3+flush-179:007:25:010
128151599116111,4cyclictest1346174-21kworker/u8:2+events_unbound10:45:000
128151599114107,5cyclictest1292909-21kworker/u8:0+events_unbound07:45:230
12815159911398,12cyclictest1213033-21systemd-journal11:25:010
128151799111103,6cyclictest1330238-21apt-get09:40:121
128151599111105,5cyclictest1307924-21kworker/u8:0+events_unbound08:40:250
128151599111103,5cyclictest1325187-21kworker/u8:0+flush-179:009:25:240
128151799110101,6cyclictest1298145-21apt-get08:00:111
12815159911099,8cyclictest510-21rs:main0
12815159910997,9cyclictest1386722-21diskstats12:35:180
12815159910997,9cyclictest1386722-21diskstats12:35:180
128151599109101,5cyclictest1379608-21kworker/u8:3+events_unbound12:30:180
12815159910897,8cyclictest1365498-21apt-get11:30:120
12815159910799,5cyclictest1379608-21kworker/u8:3+flush-179:012:25:250
12815159910597,6cyclictest1379608-21kworker/u8:3+events_unbound12:20:010
12815159910497,5cyclictest1320395-21kworker/u8:1+flush-179:010:00:170
12815159910495,6cyclictest1368468-21kworker/u8:3+flush-179:011:55:160
12815159910397,4cyclictest1357951-21kworker/u8:0+flush-179:011:05:220
12815159910396,5cyclictest1307924-21kworker/u8:0+flush-179:008:35:240
12815159910386,12cyclictest1213033-21systemd-journal12:05:000
12815159910291,9cyclictest1341618-21apt-get10:15:120
12815159910194,5cyclictest1265256-21kworker/u8:3+events_unbound07:40:000
12815159910193,5cyclictest1346174-21kworker/u8:2+events_unbound10:55:150
12815159910187,10cyclictest1346174-21kworker/u8:2+flush-179:011:10:160
12815179910089,8cyclictest1354092-21latency_hist10:55:001
12815179910085,12cyclictest1339527-21apt-get10:10:011
12815159910088,8cyclictest1268463-21kworker/u8:1+events_unbound07:30:220
1281515999991,5cyclictest1320395-21kworker/u8:1+events_unbound09:20:240
1281515999991,5cyclictest1302883-21kworker/u8:2+flush-179:008:55:220
1281515999988,7cyclictest1299476-21latency_hist08:05:010
1281515999986,8cyclictest1346174-21kworker/u8:2+events_unbound11:00:160
1281515999890,5cyclictest1360435-21kworker/u8:1+flush-179:011:35:210
1281515999890,5cyclictest1292916-21kworker/u8:2+flush-179:007:45:000
1281515999889,6cyclictest1320395-21kworker/u8:1+events_unbound10:30:240
1281515999887,8cyclictest1331802-21kworker/u8:2+events_unbound09:55:250
1281515999690,4cyclictest1314096-21kworker/u8:3+flush-179:009:10:250
1281515999689,5cyclictest1268463-21kworker/u8:1+flush-179:008:15:010
1281515999689,4cyclictest1363912-21kworker/u8:0+flush-179:011:45:230
1281515999685,7cyclictest1307924-21kworker/u8:0+flush-179:008:50:180
1281517999582,9cyclictest1346174-21kworker/u8:2+flush-179:012:05:011
1281517999581,10cyclictest1213033-21systemd-journal10:30:001
1281515999586,5cyclictest1368468-21kworker/u8:3+events_unbound11:50:130
1281515999581,8cyclictest1363912-21kworker/u8:0+events_unbound11:25:130
1281515999581,8cyclictest1363912-21kworker/u8:0+events_unbound11:25:130
1281515999484,7cyclictest1344554-21latency_hist10:25:000
1281515999484,7cyclictest1302883-21kworker/u8:2+flush-179:008:20:210
1281517999383,7cyclictest1322003-21latency_hist09:15:001
1281517999378,11cyclictest1307441-21apt-get08:30:001
1281515999386,4cyclictest1307924-21kworker/u8:0+flush-179:009:15:250
1281515999385,5cyclictest1292909-21kworker/u8:0+flush-179:007:50:230
1281515999385,5cyclictest1292909-21kworker/u8:0+flush-179:007:50:230
1281515999284,5cyclictest1302883-21kworker/u8:2+flush-179:008:25:220
1281515999283,6cyclictest1268463-21kworker/u8:1+flush-179:008:15:210
1281517999078,9cyclictest1307924-21kworker/u8:0+events_unbound09:00:231
1281515999086,3cyclictest1339517-21latency_hist10:10:000
1281515999084,4cyclictest1320395-21kworker/u8:1+flush-179:009:40:170
1281515999081,6cyclictest1268463-21kworker/u8:1+flush-179:007:10:210
1281517998676,8cyclictest1323869-21apt-get09:20:121
1281517998664,20cyclictest1268463-21kworker/u8:1+flush-179:007:55:161
1281515998676,6cyclictest1331802-21kworker/u8:2+events_unbound09:50:200
1281515998573,8cyclictest1331802-21kworker/u8:2+flush-179:009:45:210
1281517998475,7cyclictest1285618-21kworker/u8:0+events_unbound07:20:261
1281515998478,4cyclictest1307924-21kworker/u8:0+flush-179:009:03:070
1281517998371,9cyclictest1213033-21systemd-journal08:35:001
1281515998378,4cyclictest1320395-21kworker/u8:1+flush-179:010:25:210
1281517998272,8cyclictest1311140-21apt-get08:40:121
1281517998172,7cyclictest1362612-21diskstats11:20:161
1281517998170,8cyclictest1339565-21kworker/u8:3+events_unbound10:15:241
1281515998173,4cyclictest1363912-21kworker/u8:0+flush-179:011:40:150
1281517998069,8cyclictest1363912-21kworker/u8:0+events_unbound11:35:001
1281517998067,10cyclictest1213033-21systemd-journal07:35:001
1281517997971,6cyclictest1363912-21kworker/u8:0+flush-179:011:45:201
1281517997967,8cyclictest1379608-21kworker/u8:3+events_unbound12:20:241
1281515997975,3cyclictest1307924-21kworker/u8:0+flush-179:008:30:200
1281515997973,4cyclictest1346174-21kworker/u8:2+events_unbound12:10:170
1281515997973,4cyclictest1346174-21kworker/u8:2+events_unbound12:10:170
1281517997865,9cyclictest1346174-21kworker/u8:2+flush-179:012:05:211
1281515997771,4cyclictest1346174-21kworker/u8:2+flush-179:012:09:560
1281517997669,5cyclictest1363912-21kworker/u8:0+flush-179:011:40:231
1281517997669,4cyclictest1302883-21kworker/u8:2+flush-179:008:15:161
1281517997666,7cyclictest1334736-21latency_hist09:55:021
1281517997665,9cyclictest1350325-21kworker/u8:0+flush-179:010:40:231
1281517997665,8cyclictest1354136-21kworker/u8:3+flush-179:011:00:011
1281515997570,4cyclictest1314096-21kworker/u8:3+flush-179:009:05:250
1281515997567,4cyclictest1346174-21kworker/u8:2+flush-179:010:35:130
1281517997463,8cyclictest1314096-21kworker/u8:3+flush-179:009:05:261
1281515997468,4cyclictest1268463-21kworker/u8:1+flush-179:007:55:220
1281515997468,4cyclictest1-21systemd08:08:070
1281517997260,10cyclictest1284616-21latency_hist07:20:011
1281517997158,9cyclictest1328365-21kworker/u8:3+flush-179:009:35:221
1281515997164,5cyclictest1265256-21kworker/u8:3+flush-179:007:15:170
1281517997067,2cyclictest1368468-21kworker/u8:3+events_unbound11:55:001
1281517997066,3cyclictest1387753-21kworker/u8:0+flush-179:012:40:011
1281517997066,3cyclictest1387753-21kworker/u8:0+flush-179:012:40:011
1281517997060,7cyclictest1302883-21kworker/u8:2+flush-179:008:45:211
1281517996860,5cyclictest1326773-21kworker/u8:2+flush-179:009:30:151
1281517996752,13cyclictest1363912-21kworker/u8:0+flush-179:011:36:081
1281517996652,11cyclictest1307924-21kworker/u8:0+events_unbound08:35:251
1281517996555,8cyclictest1350325-21kworker/u8:0+flush-179:010:45:141
1281517996452,10cyclictest510-21rs:main1
1281517996349,9cyclictest1265256-21kworker/u8:3+events_unbound07:40:191
1281517996256,5cyclictest1292909-21kworker/u8:0+flush-179:007:50:211
1281517996256,5cyclictest1292909-21kworker/u8:0+flush-179:007:50:211
1281517996250,9cyclictest1213033-21systemd-journal12:30:001
1281517996152,7cyclictest1325187-21kworker/u8:0+flush-179:009:25:191
1281517995948,9cyclictest1281681-21apt-get07:10:101
1281517995848,6cyclictest1265256-21kworker/u8:3+flush-179:007:35:161
1281517995845,9cyclictest1268463-21kworker/u8:1+events_unbound07:25:151
1281520995552,2cyclictest0-21swapper/211:10:592
1281517995547,6cyclictest1331802-21kworker/u8:2+events_unbound09:45:231
1281517995545,7cyclictest1349322-21latency_hist10:40:011
1281520995451,2cyclictest0-21swapper/207:18:002
1281517995346,5cyclictest1302883-21kworker/u8:2+flush-179:008:55:001
1281517995241,8cyclictest1268463-21kworker/u8:1+events_unbound08:10:011
1281517995240,9cyclictest1307924-21kworker/u8:0+flush-179:009:15:221
1281517995239,10cyclictest1213033-21systemd-journal12:35:001
4577091500,13ptp4l441ktimers/307:10:013
1281521995043,5cyclictest1383022-21turbostat12:25:003
1281517994941,6cyclictest510-21rs:main1
1281521994846,1cyclictest0-21swapper/311:46:593
1281517994736,9cyclictest1316180-21diskstats08:55:171
1281517994234,6cyclictest1344408-21grep10:20:251
1281517994233,7cyclictest1379608-21kworker/u8:3+events_unbound12:15:231
1281521994140,1cyclictest0-21swapper/310:46:003
1281517994134,5cyclictest1213033-21systemd-journal11:59:071
4577091400,6ptp4l441ktimers/309:00:013
1281521993937,1cyclictest0-21swapper/307:19:593
1281517993933,4cyclictest1336330-21latency_hist10:00:011
1281521993836,1cyclictest0-21swapper/312:10:003
1281521993833,4cyclictest1381421-21turbostat12:20:003
1281520993835,2cyclictest0-21swapper/207:20:592
128152099380,36cyclictest0-21swapper/210:10:582
128152099380,36cyclictest0-21swapper/208:55:592
128152099380,36cyclictest0-21swapper/208:47:002
128152099380,35cyclictest0-21swapper/208:34:552
128152099380,30cyclictest0-21swapper/209:33:002
1281520993734,2cyclictest0-21swapper/212:02:592
1281520993734,2cyclictest0-21swapper/209:40:582
128152099370,35cyclictest0-21swapper/207:12:592
128152099370,34cyclictest0-21swapper/212:00:012
1281517993734,2cyclictest0-21swapper/108:24:591
1281521993634,1cyclictest0-21swapper/312:04:593
1281521993634,1cyclictest0-21swapper/310:05:003
1281521993634,1cyclictest0-21swapper/309:51:583
1281521993634,1cyclictest0-21swapper/308:51:593
128152199360,35cyclictest0-21swapper/310:18:003
128152199360,35cyclictest0-21swapper/307:46:583
128152199360,1cyclictest0-21swapper/308:45:593
1281520993634,1cyclictest0-21swapper/211:00:012
1281520993634,1cyclictest0-21swapper/207:29:592
1281520993633,2cyclictest0-21swapper/209:18:002
1281520993633,2cyclictest0-21swapper/209:00:592
128152099360,1cyclictest0-21swapper/209:40:002
4577091350,28ptp4l441ktimers/310:05:123
1281521993533,1cyclictest0-21swapper/307:59:553
1281521993532,2cyclictest0-21swapper/311:41:583
1281521993532,2cyclictest0-21swapper/309:35:003
1281520993532,2cyclictest0-21swapper/208:25:002
1281517993529,5cyclictest0-21swapper/110:01:591
4577091340,5ptp4l61490irq/134-eno1-TxRx-011:30:013
4577091340,5ptp4l61490irq/134-eno1-TxRx-011:30:013
1281521993432,1cyclictest0-21swapper/308:37:593
1281521993432,1cyclictest0-21swapper/308:07:593
1281521993431,2cyclictest0-21swapper/309:20:593
1281520993432,1cyclictest0-21swapper/209:25:002
1281520993431,2cyclictest0-21swapper/210:27:582
1281520993431,2cyclictest0-21swapper/208:15:012
1281520993430,2cyclictest0-21swapper/212:40:002
1281520993430,2cyclictest0-21swapper/212:40:002
1281515993430,3cyclictest1281525-21latency_hist07:10:020
4577091330,4ptp4l61490irq/134-eno1-TxRx-007:30:023
1281521993331,1cyclictest0-21swapper/309:50:003
1281521993331,1cyclictest0-21swapper/308:32:003
1281520993331,1cyclictest0-21swapper/212:15:012
1281520993331,1cyclictest0-21swapper/212:15:002
1281520993330,2cyclictest0-21swapper/211:39:552
1281521993230,1cyclictest0-21swapper/311:09:563
1281521993230,1cyclictest0-21swapper/311:04:003
1281521993230,1cyclictest0-21swapper/309:19:003
1281520993229,2cyclictest0-21swapper/209:55:582
1281520993228,2cyclictest0-21swapper/207:34:002
4577091310,7ptp4l441ktimers/309:15:013
1281521993129,1cyclictest0-21swapper/308:27:593
128152199310,30cyclictest1326799-21turbostat09:30:013
128152199310,30cyclictest0-21swapper/308:40:593
1281520993128,2cyclictest0-21swapper/212:29:552
1281520993128,2cyclictest0-21swapper/212:10:002
1281520993128,2cyclictest0-21swapper/211:50:592
1281520993128,2cyclictest0-21swapper/210:03:002
4577091300,7ptp4l441ktimers/308:05:003
4577091300,6ptp4l441ktimers/309:45:013
4577091300,6ptp4l441ktimers/307:45:003
4577091300,6ptp4l441ktimers/307:40:003
1281521993028,1cyclictest0-21swapper/311:55:003
1281521993028,1cyclictest0-21swapper/309:58:593
1281521993027,2cyclictest0-21swapper/309:35:123
128152199300,2cyclictest1350929-21turbostat10:44:593
128152199300,2cyclictest0-21swapper/309:05:143
1281520993027,2cyclictest0-21swapper/211:45:112
128152099300,28cyclictest0-21swapper/207:40:132
4577091290,6ptp4l441ktimers/312:30:003
4577091290,6ptp4l441ktimers/312:00:003
4577091290,6ptp4l441ktimers/311:35:013
4577091290,6ptp4l441ktimers/310:35:013
4577091290,6ptp4l441ktimers/310:15:013
4577091290,6ptp4l441ktimers/307:15:013
4577091290,5ptp4l441ktimers/311:20:013
4577091290,5ptp4l441ktimers/308:20:003
231999290,17rtkit-daemon1281000-21sendmail_mailqu07:05:281
1281521992927,1cyclictest0-21swapper/310:55:123
1281520992927,1cyclictest0-21swapper/212:15:022
1281520992927,1cyclictest0-21swapper/208:20:002
1281520992926,2cyclictest0-21swapper/209:47:002
1281520992926,2cyclictest0-21swapper/209:11:592
1281520992926,2cyclictest0-21swapper/207:57:592
128152099290,2cyclictest0-21swapper/208:40:132
128152099290,28cyclictest0-21swapper/211:15:122
128152099290,27cyclictest0-21swapper/211:20:142
128152099290,27cyclictest0-21swapper/210:50:132
128152099290,27cyclictest0-21swapper/208:50:112
4577091280,5ptp4l441ktimers/310:30:003
4577091280,4ptp4l441ktimers/311:15:003
128152199280,2cyclictest0-21swapper/312:35:163
128152199280,2cyclictest0-21swapper/312:35:163
128152199280,26cyclictest0-21swapper/309:00:123
128152199280,26cyclictest0-21swapper/307:31:583
128152199280,1cyclictest0-21swapper/312:30:133
1281520992826,1cyclictest0-21swapper/210:49:592
1281520992825,2cyclictest0-21swapper/212:20:132
1281520992825,2cyclictest0-21swapper/210:40:132
1281520992825,2cyclictest0-21swapper/208:10:002
128152099280,26cyclictest0-21swapper/209:53:592
1281521992725,1cyclictest0-21swapper/307:54:593
1281521992725,1cyclictest0-21swapper/307:54:593
1281521992721,5cyclictest1363669-21turbostat11:25:013
1281520992725,1cyclictest0-21swapper/209:09:592
1281520992724,2cyclictest0-21swapper/212:31:592
1281520992724,2cyclictest0-21swapper/211:08:002
1281520992724,2cyclictest0-21swapper/211:02:592
1281520992724,2cyclictest0-21swapper/208:35:592
1281520992724,2cyclictest0-21swapper/207:53:592
1281520992724,2cyclictest0-21swapper/207:53:592
128152099270,1cyclictest0-21swapper/210:23:592
4577091260,5ptp4l61490irq/134-eno1-TxRx-007:25:003
4577091260,5ptp4l441ktimers/308:24:553
1281521992624,1cyclictest0-21swapper/312:13:583
1281521992624,1cyclictest0-21swapper/312:13:583
1281521992624,1cyclictest0-21swapper/310:37:593
1281521992624,1cyclictest0-21swapper/308:13:583
1281520992624,1cyclictest0-21swapper/210:34:592
1281520992623,2cyclictest0-21swapper/207:45:592
1281520992623,2cyclictest0-21swapper/207:40:002
4577091250,4ptp4l441ktimers/310:24:553
4577091250,3ptp4l441ktimers/311:39:553
1281521992523,1cyclictest0-21swapper/310:53:593
1281520992523,1cyclictest0-21swapper/210:09:592
1281520992523,1cyclictest0-21swapper/209:30:012
1281520992421,2cyclictest0-21swapper/211:32:592
1281520992421,2cyclictest0-21swapper/211:30:012
1281520992421,2cyclictest0-21swapper/211:30:002
1281520992421,2cyclictest0-21swapper/210:18:002
1281520992321,1cyclictest0-21swapper/208:02:592
1281520992017,2cyclictest0-21swapper/210:38:002
1281520991715,1cyclictest0-21swapper/208:27:592
128152099129,2cyclictest1370034-21turbostat11:45:002
12815209940,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional