You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-06 - 03:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6.osadl.org (updated Sat Jul 05, 2025 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12291489910694,9cyclictest1232237-21latency_hist07:20:011
12291449910497,5cyclictest1285539-21kworker/u8:0+events_unbound10:30:020
12291449910094,4cyclictest1330061-21kworker/u8:0+flush-179:012:20:220
12291449910090,8cyclictest1279434-21/usr/sbin/munin09:45:240
1229144999792,4cyclictest1316873-21kworker/u8:0+events_unbound12:10:240
1229144999792,4cyclictest1316873-21kworker/u8:0+events_unbound12:10:230
1229144999792,4cyclictest1310708-21kworker/u8:1+flush-179:011:20:210
1229144999688,6cyclictest1287643-21kworker/u8:1+flush-179:010:45:240
1229144999488,4cyclictest1264631-21kworker/u8:3+flush-179:009:10:160
1229144999287,3cyclictest1315210-21kworker/u8:2+flush-179:011:40:230
1229144999282,8cyclictest1250518-21/usr/sbin/munin08:15:240
1229144999282,8cyclictest1250518-21/usr/sbin/munin08:15:230
1229144999279,10cyclictest1302492-21apt-get10:55:110
1229144999085,4cyclictest1320138-21kworker/u8:3+flush-179:012:00:220
1229149998757,27cyclictest0-21swapper/209:12:592
1229148998775,10cyclictest1248438-21latency_hist08:10:011
1229148998771,15cyclictest1315209-21kworker/u8:1+flush-179:011:50:261
1229144998774,10cyclictest1238899-21apt-get07:40:130
1229144998581,3cyclictest1256674-21kworker/u8:3+events_unbound08:45:240
1229144998576,3cyclictest1287643-21kworker/u8:1+events_unbound10:15:230
1229150998456,1cyclictest0-21swapper/309:12:583
1229144998479,4cyclictest1330061-21kworker/u8:0+events_unbound12:25:230
1229144998479,4cyclictest1264631-21kworker/u8:3+events_unbound09:00:230
1229144998472,9cyclictest3105085-21systemd-journal11:15:000
1229148998270,9cyclictest1283957-21latency_hist10:00:001
1229144998278,3cyclictest1285539-21kworker/u8:0+events_unbound10:05:240
1229144998277,4cyclictest1223026-21kworker/u8:3+flush-179:007:15:210
1229144998277,3cyclictest1275992-21kworker/u8:1+events_unbound09:50:160
1229148998067,10cyclictest1325300-21apt-get12:05:131
1229144998072,4cyclictest1256674-21kworker/u8:3+events_unbound08:40:270
1229148997969,7cyclictest1274672-21apt-get09:30:141
1229144997969,8cyclictest1258240-21latency_hist08:40:020
1229148997868,7cyclictest502-21rs:main1
1229144997873,4cyclictest1287643-21kworker/u8:1+events_unbound10:20:250
1229144997872,4cyclictest1320138-21kworker/u8:3+flush-179:012:05:220
1229144997773,3cyclictest1258292-21kworker/u8:1+flush-179:009:05:220
1229144997772,4cyclictest1315209-21kworker/u8:1+flush-179:012:15:220
1229144997771,5cyclictest1303813-21kworker/u8:2+flush-179:011:05:010
1229144997771,5cyclictest1303813-21kworker/u8:2+flush-179:011:05:010
1229144997771,4cyclictest1241791-21kworker/u8:1+events_unbound07:55:210
1229144997771,4cyclictest1241791-21kworker/u8:1+events_unbound07:55:210
1229144997769,6cyclictest1315209-21kworker/u8:1+events_unbound11:55:130
1229144997768,4cyclictest1333233-21kworker/u8:2+events_unbound12:35:280
1229144997768,3cyclictest1241791-21kworker/u8:1+events_unbound08:05:150
1229144997767,7cyclictest1310708-21kworker/u8:1+events_unbound11:25:140
1229144997767,4cyclictest1230879-21kworker/u8:1+events_unbound07:20:180
1229144997570,3cyclictest1269734-21kworker/u8:0+flush-179:009:30:210
1229144997566,4cyclictest1235414-21kworker/u8:0+events_unbound07:50:160
1229148997464,7cyclictest1248951-21apt-get08:10:121
1229148997460,9cyclictest1320010-21apt-get11:50:011
1229144997470,3cyclictest1264631-21kworker/u8:3+events_unbound09:55:250
1229144997469,4cyclictest1261663-21kworker/u8:2+flush-179:008:55:240
1229144997461,10cyclictest1313897-21apt-get11:30:130
1229148997363,7cyclictest3105085-21systemd-journal10:20:221
1229148997362,9cyclictest1266461-21apt-get09:05:141
1229144997369,3cyclictest1295027-21kworker/u8:3+flush-179:010:40:250
1229144997268,3cyclictest1272610-21kworker/u8:2+events_unbound09:25:050
1229144997268,3cyclictest1272610-21kworker/u8:2+events_unbound09:25:050
1229144997267,4cyclictest1223026-21kworker/u8:3+events_unbound07:25:160
1229144997264,6cyclictest1315209-21kworker/u8:1+events_unbound11:35:150
1229144997263,4cyclictest1269734-21kworker/u8:0+flush-179:009:15:170
1229144997263,3cyclictest1258292-21kworker/u8:1+events_unbound09:20:150
1229144997167,3cyclictest1287643-21kworker/u8:1+flush-179:010:35:210
1229144997167,3cyclictest1269734-21kworker/u8:0+events_unbound09:35:170
1229144997166,4cyclictest1236997-21kworker/u8:4+flush-179:007:35:220
1229144997163,3cyclictest1250265-21kworker/u8:1+events_unbound08:20:210
1229144997062,7cyclictest1303813-21kworker/u8:2+flush-179:011:05:260
1229148996962,5cyclictest1255063-21latency_hist08:30:011
1229144996962,5cyclictest1235414-21kworker/u8:0+flush-179:008:10:260
1229148996859,7cyclictest1305431-21latency_hist11:05:011
1229148996859,7cyclictest1305431-21latency_hist11:05:011
1229144996864,3cyclictest1250265-21kworker/u8:1+flush-179:008:30:210
1229144996862,5cyclictest1316873-21kworker/u8:0+flush-179:011:50:260
1229149996763,2cyclictest0-21swapper/209:38:592
1229148996756,9cyclictest1235681-21apt-get07:30:131
1229144996763,3cyclictest1264631-21kworker/u8:3+flush-179:010:01:100
1229148996660,5cyclictest1326621-21kworker/u8:2+flush-179:012:15:011
1229148996660,5cyclictest1326621-21kworker/u8:2+flush-179:012:15:001
1229148996658,6cyclictest3105085-21systemd-journal07:21:201
1229148996655,8cyclictest1243653-21apt-get07:55:131
1229148996655,8cyclictest1243653-21apt-get07:55:131
1229144996662,3cyclictest1301810-21kworker/u8:0+events_unbound11:15:280
1229148996558,5cyclictest1274417-21latency_hist09:30:011
1229148996558,5cyclictest1274417-21latency_hist09:30:011
1229144996560,4cyclictest1333233-21kworker/u8:2+events_unbound12:30:260
1229148996459,3cyclictest3105085-21systemd-journal10:40:211
1229144996460,3cyclictest1285606-21kworker/u8:2+events_unbound10:10:290
1229144996459,4cyclictest1316873-21kworker/u8:0+flush-179:011:45:300
1229148996332,29cyclictest0-21swapper/109:12:581
1229144996358,4cyclictest1261663-21kworker/u8:2+flush-179:008:50:310
1229144996352,9cyclictest1253733-21apt-get08:25:130
1229150996260,1cyclictest0-21swapper/309:39:003
1229148996250,9cyclictest1289247-21apt-get10:15:141
1229144996256,4cyclictest1216163-21kworker/u8:0+events_unbound07:10:190
1229144996254,6cyclictest1293911-21gpgv10:30:020
122915099610,1cyclictest0-21swapper/310:44:593
1229148996156,4cyclictest1253463-21kworker/u8:0+events_unbound08:50:581
1229148995946,10cyclictest1310459-21latency_hist11:20:011
1229148995945,11cyclictest1331415-21apt-get12:24:591
1229144995954,4cyclictest1299225-21kworker/u8:4+events_unbound10:53:230
1229144995853,4cyclictest1245501-21kworker/u8:2+flush-179:008:00:270
1229144995648,3cyclictest1275992-21kworker/u8:1+events_unbound09:40:260
1229144995550,4cyclictest1223026-21kworker/u8:3+events_unbound07:49:210
1229148995448,5cyclictest1315209-21kworker/u8:1+flush-179:012:15:171
1229148995345,6cyclictest3105085-21systemd-journal07:54:561
1229148995342,9cyclictest1295873-21apt-get10:35:151
1229148995241,9cyclictest1284228-21apt-get10:00:141
1229144995147,3cyclictest1223026-21kworker/u8:3+events_unbound07:32:210
1229148994937,10cyclictest1229315-21apt-get07:10:141
4505291480,13ptp4l441ktimers/307:09:563
1229148994843,4cyclictest1315209-21kworker/u8:1+flush-179:011:35:251
1229148994842,5cyclictest1299305-21/usr/sbin/munin10:45:171
1229148994842,4cyclictest1313642-21latency_hist11:30:001
1229148994639,6cyclictest3105085-21systemd-journal08:17:011
1229148994639,6cyclictest3105085-21systemd-journal08:17:011
1229148994639,5cyclictest3105085-21systemd-journal10:10:011
1229148994537,6cyclictest502-21rs:main1
1229148994536,7cyclictest3105085-21systemd-journal08:35:011
1229148994440,3cyclictest1264631-21kworker/u8:3+events_unbound09:05:001
1229150994341,1cyclictest0-21swapper/308:45:583
1229148994337,4cyclictest1259851-21turbostat08:49:551
1229148994334,7cyclictest1315231-21latency_hist11:35:011
1229148994238,3cyclictest1333233-21kworker/u8:2+flush-179:012:35:211
1229148994236,4cyclictest722-21Xorg08:23:591
1229148994232,8cyclictest1292440-21apt-get10:25:141
1229148994230,11cyclictest1236997-21kworker/u8:4+flush-179:007:35:261
1229148994138,2cyclictest0-21swapper/108:01:591
122914899411,38cyclictest1325064-21idleruntime-cro12:05:001
1229149994036,2cyclictest0-21swapper/207:57:592
1229149994036,2cyclictest0-21swapper/207:57:582
1229148994037,2cyclictest1302275-21systemd-run10:55:001
1229148994036,3cyclictest1258292-21kworker/u8:1+events_unbound09:17:001
1229148994035,4cyclictest1269734-21kworker/u8:0+flush-179:009:40:251
1229148994034,5cyclictest1287643-21kworker/u8:1+flush-179:010:55:261
122914899401,37cyclictest722-21Xorg09:36:591
122914899400,38cyclictest722-21Xorg07:46:591
122915099390,37cyclictest0-21swapper/308:15:593
122915099390,37cyclictest0-21swapper/308:15:583
122915099390,1cyclictest0-21swapper/309:41:583
122914999390,36cyclictest0-21swapper/211:19:552
122914999390,36cyclictest0-21swapper/209:59:562
122914999390,36cyclictest0-21swapper/208:15:592
122914999390,36cyclictest0-21swapper/208:15:582
122914999390,36cyclictest0-21swapper/207:27:002
122914999390,31cyclictest0-21swapper/208:12:592
122914999390,2cyclictest0-21swapper/209:49:552
1229148993935,3cyclictest1333233-21kworker/u8:2+events_unbound12:33:531
1229148993934,4cyclictest1308638-21gpgv11:15:001
122914899391,33cyclictest1294267-21apt-get10:30:031
122915099380,36cyclictest0-21swapper/308:12:593
122915099380,36cyclictest0-21swapper/307:28:003
122915099380,35cyclictest0-21swapper/312:38:593
1229148993834,2cyclictest722-21Xorg07:41:591
1229148993832,5cyclictest1261663-21kworker/u8:2+events_unbound08:55:231
1229149993734,2cyclictest0-21swapper/208:39:592
1229149993734,2cyclictest0-21swapper/207:21:582
1229149993732,2cyclictest0-21swapper/211:36:592
122914999370,2cyclictest0-21swapper/212:38:582
122914999370,29cyclictest0-21swapper/211:14:592
1229148993732,4cyclictest281ktimers/109:50:131
122914899371,33cyclictest1287559-21dpkg10:10:011
1229150993634,1cyclictest0-21swapper/311:44:593
1229150993634,1cyclictest0-21swapper/310:52:593
1229150993634,1cyclictest0-21swapper/310:03:593
1229150993634,1cyclictest0-21swapper/308:54:553
1229150993633,2cyclictest0-21swapper/308:43:583
122915099360,35cyclictest0-21swapper/311:19:553
1229149993634,1cyclictest0-21swapper/210:09:582
1229149993631,2cyclictest0-21swapper/210:25:592
1229148993631,3cyclictest1333288-21systemd-run12:30:011
1229150993533,1cyclictest0-21swapper/308:40:003
1229150993533,1cyclictest0-21swapper/307:57:593
1229150993533,1cyclictest0-21swapper/307:57:593
1229150993532,2cyclictest0-21swapper/310:09:583
122915099350,1cyclictest0-21swapper/310:19:553
1229149993532,2cyclictest0-21swapper/210:47:592
1229149993531,2cyclictest0-21swapper/207:39:552
1229148993530,4cyclictest1223026-21kworker/u8:3+flush-179:007:25:291
1229150993432,1cyclictest0-21swapper/309:47:593
1229150993432,1cyclictest0-21swapper/307:21:593
1229149993431,2cyclictest0-21swapper/207:51:592
1229149993430,2cyclictest0-21swapper/212:20:592
1229149993430,2cyclictest0-21swapper/208:03:592
1229148993427,5cyclictest1999-21lightdm-gtk-gre08:35:151
122915099330,27cyclictest0-21swapper/311:20:143
1229149993331,1cyclictest0-21swapper/212:14:592
1229149993331,1cyclictest0-21swapper/212:14:592
1229149993331,1cyclictest0-21swapper/207:19:592
1229149993330,2cyclictest0-21swapper/212:18:592
1229148993329,3cyclictest1308650-21kworker/u8:3+events_unbound11:21:591
1229148993328,3cyclictest0-21swapper/111:45:011
122914899330,20cyclictest3105085-21systemd-journal09:50:011
1229150993230,1cyclictest0-21swapper/311:36:593
1229150993229,2cyclictest0-21swapper/312:14:593
1229150993229,2cyclictest0-21swapper/312:14:583
1229150993229,2cyclictest0-21swapper/310:47:593
1229148993228,3cyclictest1303813-21kworker/u8:2+events_unbound11:06:111
122914899321,29cyclictest0-21swapper/109:20:141
1229150993129,1cyclictest0-21swapper/312:19:003
1229150993129,1cyclictest0-21swapper/310:26:003
1229150993129,1cyclictest0-21swapper/307:39:563
1229150993128,2cyclictest0-21swapper/307:52:003
1229150993128,2cyclictest0-21swapper/307:19:593
1229150993125,5cyclictest1333265-21turbostat12:30:003
122915099310,29cyclictest0-21swapper/309:00:123
1229149993128,2cyclictest0-21swapper/211:30:592
1229149993128,2cyclictest0-21swapper/211:26:592
1229149993128,2cyclictest0-21swapper/209:05:152
1229149993126,3cyclictest0-21swapper/212:00:142
1229149993123,7cyclictest0-21swapper/209:25:032
1229149993123,7cyclictest0-21swapper/209:25:032
122914999310,29cyclictest0-21swapper/210:20:142
122914999310,29cyclictest0-21swapper/209:00:122
1229150993028,1cyclictest0-21swapper/308:03:583
1229150993027,2cyclictest0-21swapper/312:00:133
122915099300,28cyclictest0-21swapper/310:20:143
1229149993027,2cyclictest0-21swapper/210:10:012
122914999300,2cyclictest0-21swapper/208:45:132
4505291290,6ptp4l441ktimers/307:50:003
1229150992927,1cyclictest0-21swapper/312:20:593
1229150992927,1cyclictest0-21swapper/311:26:593
1229150992927,1cyclictest0-21swapper/309:05:163
1229150992927,1cyclictest0-21swapper/308:25:143
1229150992926,2cyclictest0-21swapper/307:30:143
122915099290,28cyclictest0-21swapper/311:30:153
122915099290,27cyclictest0-21swapper/310:10:013
122915099290,21cyclictest0-21swapper/309:25:033
122915099290,21cyclictest0-21swapper/309:25:023
1229149992926,2cyclictest0-21swapper/209:34:552
1229149992925,2cyclictest0-21swapper/212:25:012
1229149992925,2cyclictest0-21swapper/212:05:582
122914999290,2cyclictest0-21swapper/211:20:592
122914999290,2cyclictest0-21swapper/207:30:152
122914999290,27cyclictest0-21swapper/210:40:122
122914999290,27cyclictest0-21swapper/208:25:152
4505291280,7ptp4l441ktimers/312:10:013
4505291280,6ptp4l441ktimers/308:35:003
1229150992826,1cyclictest0-21swapper/309:59:593
1229150992821,6cyclictest0-21swapper/309:24:003
122915099280,26cyclictest0-21swapper/307:44:593
1229149992825,2cyclictest0-21swapper/212:32:002
1229149992825,2cyclictest0-21swapper/210:53:592
1229149992825,2cyclictest0-21swapper/207:13:592
1229149992822,5cyclictest0-21swapper/209:23:592
122914999280,2cyclictest0-21swapper/207:44:592
122914999280,26cyclictest0-21swapper/210:15:152
4505291270,6ptp4l61790irq/134-eno1-TxRx-011:00:013
4505291270,6ptp4l441ktimers/308:25:013
4505291270,6ptp4l441ktimers/308:10:013
201699270,15rtkit-daemon1228522-21ntp_states07:05:291
1229150992725,1cyclictest0-21swapper/311:14:593
1229150992724,2cyclictest0-21swapper/309:34:553
122915099270,25cyclictest1307025-21turbostat11:10:003
1229149992725,1cyclictest0-21swapper/211:54:592
1229149992723,2cyclictest0-21swapper/208:57:592
122914999270,24cyclictest0-21swapper/210:58:592
4505291260,6ptp4l61790irq/134-eno1-TxRx-011:50:013
4505291260,6ptp4l441ktimers/312:00:003
4505291260,6ptp4l441ktimers/308:59:563
4505291260,5ptp4l441ktimers/310:40:013
4505291260,5ptp4l441ktimers/307:14:563
1229150992624,1cyclictest0-21swapper/312:32:003
1229150992623,2cyclictest0-21swapper/311:54:593
122914999260,2cyclictest0-21swapper/208:09:542
4505291250,6ptp4l61790irq/134-eno1-TxRx-009:54:563
4505291250,5ptp4l61790irq/134-eno1-TxRx-011:04:563
4505291250,5ptp4l61790irq/134-eno1-TxRx-011:04:563
1229149992522,2cyclictest0-21swapper/211:07:592
1229149992521,2cyclictest0-21swapper/209:54:582
1229149992521,2cyclictest0-21swapper/208:33:592
1229149992519,5cyclictest0-21swapper/211:47:592
4505291240,4ptp4l61790irq/134-eno1-TxRx-009:19:553
1229149992321,1cyclictest0-21swapper/210:39:592
1229149992321,1cyclictest0-21swapper/208:21:002
1229144992319,3cyclictest0-21swapper/007:10:020
1229149992118,2cyclictest0-21swapper/208:50:152
1229149992117,2cyclictest0-21swapper/211:57:592
1229149991713,2cyclictest1279204-21turbostat09:45:012
4505291150,3ptp4l441ktimers/310:30:013
1229149991512,2cyclictest0-21swapper/208:40:592
1229149991412,1cyclictest0-21swapper/207:49:592
1229149991411,2cyclictest0-21swapper/210:35:012
122914999118,2cyclictest0-21swapper/211:04:552
122914999118,2cyclictest0-21swapper/211:04:552
12291499985,2cyclictest0-21swapper/210:00:582
12291499985,2cyclictest0-21swapper/209:16:592
12291499963,2cyclictest0-21swapper/211:42:442
12291499941,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional