You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 20:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Thu Apr 16, 2026 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9938949910191,7cyclictest1004985-21latency_hist07:45:000
993899999080,7cyclictest1056965-21latency_hist10:25:011
993899998675,9cyclictest1024088-21latency_hist08:45:011
993894998474,8cyclictest1099645-21latency_hist12:35:010
993899998359,22cyclictest1055369-21latency_hist10:20:011
993899998172,6cyclictest1042114-21latency_hist09:40:021
993899997868,8cyclictest1032301-21latency_hist09:10:011
993899997769,5cyclictest1040516-21latency_hist09:35:011
993899997768,6cyclictest1065178-21latency_hist10:50:011
993899997768,6cyclictest1065178-21latency_hist10:50:011
993894997766,9cyclictest266-21systemd-journal10:30:210
993894997667,7cyclictest995635-21/usr/sbin/munin07:15:240
993899997366,5cyclictest1011350-21latency_hist08:05:011
993894997361,9cyclictest1089847-21apt-get12:05:000
993894997164,5cyclictest1045556-21latency_hist09:50:010
993899997060,8cyclictest266-21systemd-journal11:55:011
993894996861,5cyclictest1076304-21kworker/u8:2+flush-179:012:20:200
993894996456,5cyclictest1-21systemd08:04:590
993899996255,5cyclictest1001767-21latency_hist07:35:011
993894996152,7cyclictest1035715-21kworker/u8:0+events_unbound09:40:230
993899995948,9cyclictest1011609-21apt-get08:05:121
993894995951,6cyclictest1076304-21kworker/u8:2+flush-179:011:30:010
993894995943,13cyclictest997265-21apt-get07:20:100
993905995852,4cyclictest1055367-21turbostat10:20:013
993899995849,8cyclictest981194-21kworker/u8:1+flush-179:007:15:011
993899995849,8cyclictest981194-21kworker/u8:1+flush-179:007:15:011
993899995849,7cyclictest1019564-21apt-get08:30:121
993899995848,8cyclictest1001813-21kworker/u8:3+flush-179:008:20:011
993899995748,7cyclictest1048987-21/usr/sbin/munin10:00:221
993894995749,6cyclictest1083214-21latency_hist11:45:010
993899995634,20cyclictest1076587-21latency_hist11:25:011
993894995649,5cyclictest1094874-21latency_hist12:20:020
993894995649,5cyclictest1094874-21latency_hist12:20:020
993894995546,8cyclictest1035715-21kworker/u8:0+flush-179:009:30:150
993903995451,2cyclictest0-21swapper/210:20:002
993903995423,2cyclictest0-21swapper/212:02:002
993894995447,5cyclictest1051977-21kworker/u8:2+flush-179:010:15:160
993899995346,5cyclictest1098312-21apt-get12:30:111
993894995247,4cyclictest1062040-21kworker/u8:3+flush-179:011:00:260
993899995142,7cyclictest1071800-21apt-get11:10:111
993894995145,4cyclictest1062040-21kworker/u8:3+flush-179:011:05:260
993894995141,8cyclictest1076304-21kworker/u8:2+flush-179:011:35:230
993899995040,8cyclictest1076304-21kworker/u8:2+flush-179:012:00:011
993899995033,16cyclictest1004981-21cron07:45:001
993894995040,8cyclictest981194-21kworker/u8:1+flush-179:007:50:220
993894995040,8cyclictest1079771-21apt-get11:35:010
993894995040,8cyclictest1034383-21/usr/sbin/munin09:15:230
993899994943,5cyclictest1043724-21apt-get09:45:001
993899994943,4cyclictest1093528-21apt-get12:15:111
993899994943,4cyclictest1093528-21apt-get12:15:101
993899994941,6cyclictest996968-21kworker/u8:0+flush-179:007:25:201
993899994941,6cyclictest266-21systemd-journal12:02:201
993899994938,8cyclictest266-21systemd-journal11:00:001
993894994941,6cyclictest1062040-21kworker/u8:3+flush-179:011:25:000
993899994842,4cyclictest1021133-21/usr/sbin/munin08:35:161
993894994841,6cyclictest1056112-21kworker/u8:0+events_unbound10:30:000
4577091480,13ptp4l61490irq/134-eno1-TxRx-007:10:013
993899994739,6cyclictest266-21systemd-journal08:58:111
993894994738,7cyclictest1002006-21/usr/sbin/munin07:35:250
993899994642,2cyclictest1048788-21systemd-run10:00:011
993894994638,6cyclictest1001813-21kworker/u8:3+flush-179:009:15:010
993894994635,9cyclictest266-21systemd-journal08:20:000
99390599450,43cyclictest0-21swapper/312:38:583
993899994540,4cyclictest993826-21kworker/u8:3+flush-179:007:15:211
993894994538,5cyclictest1027518-21latency_hist08:55:010
99390399440,40cyclictest0-21swapper/208:12:002
993894994426,16cyclictest1009762-21latency_hist08:00:010
99390399430,40cyclictest0-21swapper/212:38:592
993899994326,16cyclictest0-21swapper/111:40:011
993894994326,16cyclictest1001526-21timerandwakeup07:30:250
993899994238,3cyclictest1006570-21cron07:50:001
993899994236,5cyclictest1065213-21kworker/u8:1+flush-179:010:50:231
993899994235,5cyclictest1078173-21latency_hist11:30:011
993899994235,4cyclictest1017734-21dump-pmu-power08:25:001
993894994239,2cyclictest1017759-21systemd-run08:25:010
993894994238,3cyclictest1075037-21systemd-run11:20:000
993894994236,5cyclictest1022499-21systemctl08:40:010
993894994228,13cyclictest501-21systemd-logind12:14:040
99390599410,6cyclictest1000188-21turbostat07:30:003
99390599410,1cyclictest0-21swapper/308:11:593
993899994135,4cyclictest1062040-21kworker/u8:3+flush-179:011:05:231
993899994134,4cyclictest0-21swapper/108:53:591
993899994119,20cyclictest0-21swapper/109:45:241
993894994137,3cyclictest1000212-21systemd-run07:30:000
993899994036,3cyclictest1092375-21hwlatdetect12:10:151
993899994034,5cyclictest1096514-21kworker/u8:1+flush-179:012:35:261
99389999402,33cyclictest1068626-21apt-get11:00:141
993899994019,3cyclictest0-21swapper/111:15:181
993899994012,6cyclictest714-21Xorg10:07:591
993894994037,2cyclictest0-21swapper/012:39:580
993894994036,3cyclictest1019312-21munin-plugin-st08:30:000
993894994036,3cyclictest1019312-21munin-plugin-st08:30:000
993894994033,5cyclictest266-21systemd-journal08:12:590
993894994033,5cyclictest1066767-21latency_hist10:55:010
993894994028,10cyclictest0-21swapper/010:10:000
99390399390,36cyclictest0-21swapper/208:23:592
99390399390,36cyclictest0-21swapper/207:15:592
993899993935,3cyclictest1019313-21cron08:30:011
993899993935,3cyclictest1019313-21cron08:30:001
993899993931,6cyclictest993783-21latency_hist07:10:011
993899993930,7cyclictest1096468-21latency_hist12:25:011
993899993915,6cyclictest714-21Xorg07:39:591
99389499393,6cyclictest714-21Xorg09:22:590
993894993934,4cyclictest1001813-21kworker/u8:3+flush-179:008:55:150
993894993922,16cyclictest1084802-21munin-run11:50:010
993905993835,2cyclictest0-21swapper/312:09:593
993905993834,2cyclictest0-21swapper/310:59:553
993905993833,4cyclictest1098069-21turbostat12:30:003
993903993834,2cyclictest0-21swapper/212:09:592
993903993834,2cyclictest0-21swapper/210:59:552
99390399380,36cyclictest0-21swapper/210:12:592
99390399380,36cyclictest0-21swapper/209:56:592
99389999384,9cyclictest2304-21lightdm-gtk-gre10:14:591
993899993831,6cyclictest1061968-21kworker/u8:2+flush-179:010:40:001
993899993829,6cyclictest510-21rs:main1
99389499383,6cyclictest714-21Xorg09:06:000
993894993832,5cyclictest1043688-21kworker/u8:2+flush-179:009:50:190
993894993830,6cyclictest1024586-21/usr/sbin/munin08:45:160
993894993830,5cyclictest1048785-21kworker/u8:1+events_unbound10:05:000
993894993828,8cyclictest1052725-21diskstats10:10:150
99389499382,10cyclictest714-21Xorg12:26:590
99389499382,10cyclictest714-21Xorg07:48:590
993903993732,2cyclictest0-21swapper/208:51:592
99389999374,8cyclictest714-21Xorg08:13:581
99389999374,10cyclictest714-21Xorg10:44:591
993899993733,2cyclictest714-21Xorg12:26:591
993899993732,3cyclictest1037338-21cron09:25:011
99389999371,35cyclictest1032821-21http09:10:131
993894993728,8cyclictest1067424-21fschecks_time10:55:180
993894993722,14cyclictest0-21swapper/008:32:590
993894993719,17cyclictest0-21swapper/008:40:240
993894993717,18cyclictest0-21swapper/010:45:010
993905993633,2cyclictest0-21swapper/310:10:593
99390599360,35cyclictest0-21swapper/309:56:593
99390599360,35cyclictest0-21swapper/308:24:003
99390599360,35cyclictest0-21swapper/307:15:593
99389999365,10cyclictest2304-21lightdm-gtk-gre07:59:591
99389999362,8cyclictest0-21swapper/111:43:591
993899993617,2cyclictest1046539-21netstat09:50:171
993894993632,2cyclictest714-21Xorg08:06:000
99389499362,7cyclictest714-21Xorg12:07:580
993894993626,8cyclictest1040770-21apt-get09:35:120
993894993615,3cyclictest0-21swapper/011:55:160
993894993612,5cyclictest1073533-21grep11:15:010
231999360,26rtkit-daemon23940-21sendmail-mta07:06:120
993903993533,1cyclictest0-21swapper/212:29:592
993899993532,2cyclictest0-21swapper/107:22:581
993899993531,3cyclictest1029515-21cpuspeed_turbos09:00:121
993899993515,3cyclictest1079762-21latency_hist11:35:011
99389999350,6cyclictest1089847-21apt-get12:05:021
993894993527,7cyclictest1037579-21kworker/u8:2+flush-179:009:25:160
4577091350,13ptp4l441ktimers/311:24:553
993905993431,2cyclictest0-21swapper/311:14:593
993905993431,2cyclictest0-21swapper/308:52:003
993903993430,2cyclictest0-21swapper/212:19:592
993903993430,2cyclictest0-21swapper/212:19:582
993903993430,2cyclictest0-21swapper/211:14:592
99389999345,9cyclictest2304-21lightdm-gtk-gre09:18:591
99389999344,8cyclictest714-21Xorg07:54:591
993899993431,2cyclictest0-21swapper/110:27:591
993894993432,1cyclictest0-21swapper/009:04:550
993894993431,2cyclictest0-21swapper/007:14:000
993894993431,2cyclictest0-21swapper/007:13:590
993894993430,3cyclictest0-21swapper/010:25:010
99389499341,4cyclictest0-21swapper/010:45:140
99389499341,4cyclictest0-21swapper/010:45:140
993905993331,1cyclictest0-21swapper/312:19:593
993905993331,1cyclictest0-21swapper/312:19:593
993903993330,2cyclictest0-21swapper/209:14:552
993903993329,2cyclictest0-21swapper/207:54:002
99389999333,7cyclictest1037598-21apt-get09:25:111
993899993328,4cyclictest1059910-21phc2sys-jitter10:30:231
993894993328,3cyclictest0-21swapper/010:00:010
231999330,5rtkit-daemon2304-21lightdm-gtk-gre10:35:530
993905993229,2cyclictest0-21swapper/309:14:563
993905993229,2cyclictest0-21swapper/307:43:593
993903993229,2cyclictest0-21swapper/207:44:002
99390399320,2cyclictest0-21swapper/211:06:592
993905993128,2cyclictest0-21swapper/311:59:593
993905993128,2cyclictest0-21swapper/308:34:593
993905993127,3cyclictest1065185-21turbostat10:50:013
993905993127,3cyclictest1065185-21turbostat10:50:013
99390599310,2cyclictest0-21swapper/308:15:133
99390599310,29cyclictest0-21swapper/311:35:023
993903993128,2cyclictest0-21swapper/208:34:592
993903993127,2cyclictest0-21swapper/210:43:592
99390399310,29cyclictest0-21swapper/208:15:132
99390399310,23cyclictest0-21swapper/209:05:592
993905993028,1cyclictest0-21swapper/310:43:593
993905993028,1cyclictest0-21swapper/307:54:003
993903993027,2cyclictest0-21swapper/211:59:582
993903993027,1cyclictest0-21swapper/210:50:012
993903993027,1cyclictest0-21swapper/210:50:012
99390399300,28cyclictest0-21swapper/211:35:032
99390399300,28cyclictest0-21swapper/211:20:152
99390399300,28cyclictest0-21swapper/209:45:032
99390399300,28cyclictest0-21swapper/209:30:132
99390399300,28cyclictest0-21swapper/208:40:132
99390399300,27cyclictest0-21swapper/212:34:592
99390399300,27cyclictest0-21swapper/209:20:592
99390399300,1cyclictest0-21swapper/209:54:592
231999300,4rtkit-daemon908065-21snmpd11:50:420
993905992926,2cyclictest0-21swapper/312:11:583
993905992926,2cyclictest0-21swapper/311:30:133
993905992926,2cyclictest0-21swapper/311:05:143
993905992926,2cyclictest0-21swapper/309:08:593
993905992926,2cyclictest0-21swapper/308:40:123
993905992926,2cyclictest0-21swapper/308:40:003
993905992925,3cyclictest0-21swapper/312:02:003
993905992925,2cyclictest0-21swapper/310:50:143
993905992924,3cyclictest0-21swapper/308:47:593
99390599290,27cyclictest0-21swapper/310:25:023
99390599290,27cyclictest0-21swapper/309:40:143
993903992926,2cyclictest0-21swapper/210:00:592
993903992926,2cyclictest0-21swapper/209:40:132
993903992926,2cyclictest0-21swapper/208:39:592
993903992925,2cyclictest0-21swapper/209:26:582
99390399290,2cyclictest0-21swapper/210:50:142
99390399290,27cyclictest0-21swapper/212:23:592
99390399290,27cyclictest0-21swapper/211:30:132
99390399290,27cyclictest0-21swapper/211:25:592
99389999293,8cyclictest2304-21lightdm-gtk-gre11:48:591
4577091290,6ptp4l441ktimers/311:05:003
993905992826,1cyclictest0-21swapper/310:00:593
993905992825,2cyclictest0-21swapper/309:30:123
993905992825,2cyclictest0-21swapper/307:33:593
99390599280,27cyclictest1038946-21turbostat09:30:013
99390599280,27cyclictest0-21swapper/312:23:583
99390599280,26cyclictest0-21swapper/309:45:033
993903992825,2cyclictest0-21swapper/212:11:592
993903992825,2cyclictest0-21swapper/207:35:152
993903992825,2cyclictest0-21swapper/207:33:582
99390399280,2cyclictest0-21swapper/209:18:002
99390399280,19cyclictest0-21swapper/209:01:592
4577091280,7ptp4l61490irq/134-eno1-TxRx-009:20:003
4577091280,6ptp4l441ktimers/308:04:563
4577091280,6ptp4l441ktimers/307:24:543
993905992726,1cyclictest0-21swapper/311:15:033
993905992725,1cyclictest0-21swapper/307:35:153
993905992724,2cyclictest0-21swapper/311:47:003
99390599270,26cyclictest0-21swapper/312:34:593
99390599270,26cyclictest0-21swapper/311:25:593
99390599270,26cyclictest0-21swapper/309:04:593
99390599270,1cyclictest0-21swapper/309:20:593
993903992724,2cyclictest0-21swapper/211:19:552
993903992723,2cyclictest0-21swapper/208:47:592
993903992723,2cyclictest0-21swapper/207:58:002
993903992722,2cyclictest0-21swapper/208:09:542
99390399270,2cyclictest0-21swapper/207:14:562
99390399270,2cyclictest0-21swapper/207:14:552
4577091270,7ptp4l441ktimers/310:25:013
4577091270,6ptp4l441ktimers/310:40:013
4577091270,6ptp4l441ktimers/309:54:553
4577091270,6ptp4l441ktimers/307:50:013
993905992623,2cyclictest0-21swapper/310:05:143
993903992623,2cyclictest0-21swapper/211:47:002
99390399260,1cyclictest0-21swapper/210:34:592
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:35:013
4577091260,6ptp4l61490irq/134-eno1-TxRx-008:30:003
4577091260,6ptp4l61490irq/134-eno1-TxRx-008:30:003
4577091260,6ptp4l441ktimers/309:39:553
993905992523,1cyclictest0-21swapper/307:57:593
993903992522,2cyclictest0-21swapper/211:01:592
993903992522,2cyclictest0-21swapper/210:05:142
4577091250,5ptp4l61490irq/134-eno1-TxRx-008:59:553
4577091250,4ptp4l441ktimers/308:10:013
4577091250,3ptp4l441ktimers/307:15:013
4577091250,3ptp4l441ktimers/307:15:003
993903992421,2cyclictest0-21swapper/210:25:022
993903992421,2cyclictest0-21swapper/207:20:132
993903992420,2cyclictest0-21swapper/208:28:592
993903992420,2cyclictest0-21swapper/208:28:592
4577091240,5ptp4l61490irq/134-eno1-TxRx-011:54:553
4577091240,5ptp4l61490irq/134-eno1-TxRx-011:44:553
993903992219,2cyclictest0-21swapper/210:20:592
993903992218,2cyclictest0-21swapper/207:29:552
993903992118,2cyclictest0-21swapper/211:50:142
993903991915,2cyclictest0-21swapper/209:36:592
993903991815,2cyclictest0-21swapper/207:47:582
993903991713,2cyclictest0-21swapper/210:38:592
993903991512,2cyclictest0-21swapper/211:40:582
993903991512,2cyclictest0-21swapper/208:56:002
9939039974,2cyclictest0-21swapper/208:01:582
9939039940,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional