You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 05:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Apr 14, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250103599141119,16cyclictest2510893-21dpkg19:36:411
250103299141130,8cyclictest2510893-21dpkg19:36:380
2501032999989,7cyclictest2607250-21latency_hist00:35:010
2501032998780,5cyclictest2559489-21latency_hist22:10:020
2501032998777,8cyclictest2585727-21latency_hist23:30:010
2501032998678,6cyclictest266-21systemd-journal20:35:000
2501032998476,6cyclictest2512786-21latency_hist19:45:000
2501032998474,7cyclictest2582553-21latency_hist23:20:010
2501032997971,5cyclictest2546298-21kworker/u8:1+flush-179:022:30:000
2501032997367,4cyclictest2603494-21kworker/u8:3+flush-179:000:35:230
2501032997366,5cyclictest2548092-21latency_hist21:35:010
2501032997266,4cyclictest2494895-21kworker/u8:2+flush-179:019:15:010
2501032997261,9cyclictest2567956-21apt-get22:35:140
2501032997164,5cyclictest2603494-21kworker/u8:3+events_unbound00:20:250
2501032997164,5cyclictest2603494-21kworker/u8:3+events_unbound00:20:240
2501032997162,7cyclictest2595782-40logrotate00:00:010
2501035996963,4cyclictest2506002-21kworker/u8:3+events_unbound19:25:241
2501032996657,6cyclictest2546504-21latency_hist21:30:010
2501035996459,3cyclictest0-21swapper/119:45:141
2501032996458,5cyclictest2494895-21kworker/u8:2+flush-179:019:15:230
2501032996457,5cyclictest2601129-21apt-get00:15:120
2501035996358,4cyclictest2574046-21kworker/u8:0+flush-179:022:54:551
2501035996357,4cyclictest2506002-21kworker/u8:3+flush-179:019:30:181
2501032996257,4cyclictest2536094-21kworker/u8:1+flush-179:021:14:550
2501035996155,5cyclictest2582592-21kworker/u8:3+events_unbound23:50:001
2501035996154,5cyclictest266-21systemd-journal00:31:571
2501035996055,4cyclictest2574098-21kworker/u8:3+events_unbound23:05:001
2501032996055,3cyclictest2570929-21kworker/u8:2+flush-179:023:35:160
2501035995950,7cyclictest2597448-21latency_hist00:05:011
2501035995852,4cyclictest2587617-21kworker/u8:1+flush-179:023:55:001
2501032995853,4cyclictest2599009-21kworker/u8:3+flush-179:000:10:260
2501032995852,4cyclictest2570929-21kworker/u8:2+flush-179:023:10:220
2501032995852,4cyclictest191rcuc/023:55:000
2501032995850,6cyclictest2567701-21latency_hist22:35:010
2501032995849,7cyclictest2524167-21/usr/sbin/munin20:20:240
2501032995752,4cyclictest2549406-21kworker/u8:3+flush-179:021:47:280
2501035995651,4cyclictest2580666-21kworker/u8:1+flush-179:023:15:001
2501035995651,4cyclictest2549406-21kworker/u8:3+events_unbound21:55:011
2501032995651,4cyclictest2567678-21kworker/u8:0+events_unbound22:45:250
2501032995651,4cyclictest2531907-21kworker/u8:3+flush-179:021:20:250
2501032995649,5cyclictest2587617-21kworker/u8:1+flush-179:023:45:190
2501035995442,6cyclictest2574098-21kworker/u8:3+events_unbound23:05:021
2501035995346,5cyclictest2509134-21kworker/u8:0+flush-179:019:40:231
2501035995335,17cyclictest2570929-21kworker/u8:2+flush-179:023:35:001
2501032995345,7cyclictest2578081-21kworker/u8:0+flush-179:023:10:000
2501032995344,7cyclictest266-21systemd-journal20:01:560
2501035995248,2cyclictest714-21Xorg22:47:591
2501035995247,4cyclictest2553170-21kworker/u8:2+flush-179:021:55:211
2501035995233,18cyclictest1-21systemd00:00:011
2501032995246,4cyclictest2553170-21kworker/u8:2+flush-179:021:52:270
2501032995246,4cyclictest2515366-21kworker/u8:2+flush-179:020:55:170
2501035995146,4cyclictest2531907-21kworker/u8:3+flush-179:020:49:551
2501035995145,5cyclictest2584142-21latency_hist23:25:011
2501032995147,3cyclictest2546298-21kworker/u8:1+flush-179:022:22:340
2501032995146,4cyclictest2531907-21kworker/u8:3+events_unbound21:05:230
2501032995145,5cyclictest2570929-21kworker/u8:2+flush-179:023:40:220
2501032995144,5cyclictest2595788-21kworker/u8:0+flush-179:000:25:210
250103299511,44cyclictest2543330-21munin-run21:20:010
2501037995047,2cyclictest0-21swapper/222:47:592
2501035995045,4cyclictest2504334-21kworker/u8:1+events_unbound20:04:551
2501032995044,4cyclictest2527973-21kworker/u8:0+flush-179:020:35:230
2501041994947,1cyclictest0-21swapper/323:15:593
2501035994944,4cyclictest2549406-21kworker/u8:3+flush-179:021:45:241
2501035994944,3cyclictest2549406-21kworker/u8:3+flush-179:022:00:181
2501032994944,4cyclictest2562937-21latency_hist22:20:000
2501032994942,5cyclictest2556323-21latency_hist22:00:000
2501032994938,9cyclictest2519405-21apt-get20:05:120
2501035994843,4cyclictest2570929-21kworker/u8:2+flush-179:023:00:011
2501035994840,6cyclictest2539882-21latency_hist21:10:021
250103599481,45cyclictest2543348-21tr21:20:001
2501032994842,5cyclictest2515366-21kworker/u8:2+flush-179:020:25:230
4577091470,13ptp4l61490irq/134-eno1-TxRx-019:10:013
2501035994741,5cyclictest2578081-21kworker/u8:0+flush-179:023:15:171
2501035994739,6cyclictest2536698-21latency_hist21:00:011
2501032994742,4cyclictest2582592-21kworker/u8:3+flush-179:023:30:220
2501035994642,3cyclictest2530342-21grep20:40:011
2501035994636,8cyclictest2559727-21/usr/sbin/munin22:10:171
2501032994641,3cyclictest484-21dbus-daemon00:04:000
2501032994637,7cyclictest2538296-21latency_hist21:05:020
2501032994636,8cyclictest2548587-21/usr/sbin/munin21:35:220
2501032994635,9cyclictest2504923-21diskstats19:20:140
250103299461,2cyclictest714-21Xorg23:23:590
2501035994540,4cyclictest2515366-21kworker/u8:2+flush-179:019:50:211
2501035994540,3cyclictest2590768-21munin-run23:44:591
2501035994538,5cyclictest266-21systemd-journal00:05:571
2501032994541,2cyclictest714-21Xorg00:06:590
2501035994440,3cyclictest2567678-21kworker/u8:0+flush-179:022:44:561
2501035994439,4cyclictest2520770-21kworker/u8:3+flush-179:020:15:171
2501035994430,13cyclictest2504334-21kworker/u8:1+flush-179:020:05:261
2501032994438,4cyclictest2549406-21kworker/u8:3+flush-179:022:10:160
2501032994437,5cyclictest2575669-21latency_hist23:00:010
250103299441,5cyclictest2533529-21idleruntime-cro20:49:590
2501037994340,2cyclictest0-21swapper/200:06:592
250103799430,41cyclictest0-21swapper/220:45:002
2501035994338,4cyclictest2595788-21kworker/u8:0+flush-179:000:25:201
2501035994338,4cyclictest2509134-21kworker/u8:0+flush-179:019:55:151
2501035994337,5cyclictest2504334-21kworker/u8:1+flush-179:019:20:181
250103599430,4cyclictest2567718-21perf22:35:001
2501032994338,4cyclictest2549406-21kworker/u8:3+flush-179:022:04:550
2501032994337,5cyclictest2506002-21kworker/u8:3+events_unbound19:25:170
2501032994334,7cyclictest266-21systemd-journal19:48:580
2501032994334,7cyclictest2530583-21/usr/sbin/munin20:40:170
250104199420,1cyclictest0-21swapper/323:29:553
2501037994240,1cyclictest0-21swapper/220:40:002
2501035994238,3cyclictest2504334-21kworker/u8:1+flush-179:020:14:551
2501035994237,4cyclictest2549406-21kworker/u8:3+flush-179:022:09:551
250103599420,40cyclictest714-21Xorg20:54:001
250103599420,1cyclictest0-21swapper/121:23:591
2501032994237,4cyclictest2570929-21kworker/u8:2+flush-179:022:50:220
2501032994235,5cyclictest2549406-21kworker/u8:3+events_unbound21:40:120
2501032994233,7cyclictest2577276-21apt-get23:05:000
250103299420,40cyclictest0-21swapper/020:53:590
250103299420,38cyclictest714-21Xorg22:43:590
250103799410,38cyclictest0-21swapper/200:36:592
250103799410,37cyclictest0-21swapper/219:29:002
2501035994137,3cyclictest266-21systemd-journal21:42:581
2501035994134,5cyclictest2542714-21kworker/u8:0+flush-179:021:40:001
250103599410,3cyclictest2604067-21cron00:25:001
250103599410,3cyclictest2604067-21cron00:25:001
2501032994134,4cyclictest2509164-21dump-pmu-power19:35:010
2501041994034,5cyclictest2504387-21turbostat19:20:003
2501037994038,1cyclictest0-21swapper/223:45:002
2501035994035,4cyclictest2523798-21kworker/u8:0+flush-179:020:20:201
2501035994035,3cyclictest0-21swapper/119:16:001
2501035994033,6cyclictest266-21systemd-journal23:30:001
2501032994035,4cyclictest2515366-21kworker/u8:2+flush-179:019:50:210
2501041993935,3cyclictest2527113-21turbostat20:30:003
250104199390,38cyclictest2584147-21turbostat23:25:003
250104199390,38cyclictest2549962-21turbostat21:39:593
250104199390,38cyclictest2541484-21turbostat21:19:553
2501037993935,2cyclictest0-21swapper/223:52:592
250103799390,37cyclictest0-21swapper/220:54:002
250103799390,35cyclictest0-21swapper/220:34:552
2501035993934,3cyclictest2546542-21kworker/u8:2+flush-179:021:30:151
250103599390,2cyclictest714-21Xorg00:10:591
2501041993833,4cyclictest2505969-21turbostat19:25:003
2501037993834,2cyclictest0-21swapper/223:46:592
2501037993834,2cyclictest0-21swapper/221:21:002
2501035993832,4cyclictest0-21swapper/122:36:591
250103599380,30cyclictest0-21swapper/100:36:591
250103599380,2cyclictest0-21swapper/120:34:541
2501041993735,1cyclictest0-21swapper/300:17:593
2501037993735,1cyclictest0-21swapper/221:19:592
2501037993734,2cyclictest0-21swapper/222:55:592
2501037993734,2cyclictest0-21swapper/221:42:582
250103799370,35cyclictest0-21swapper/200:20:592
250103799370,35cyclictest0-21swapper/200:20:582
250103799370,2cyclictest0-21swapper/222:43:592
2501035993730,6cyclictest2539341-21kworker/u8:2+events_unbound21:10:181
250104199360,35cyclictest0-21swapper/323:09:553
250104199360,35cyclictest0-21swapper/321:57:583
2501037993634,1cyclictest0-21swapper/220:24:592
2501037993633,2cyclictest0-21swapper/219:15:592
250103599361,29cyclictest2600625-21apt-get00:15:021
250103599360,35cyclictest0-21swapper/121:28:591
2501032993632,2cyclictest714-21Xorg19:59:000
2501041993533,1cyclictest0-21swapper/323:53:593
2501041993533,1cyclictest0-21swapper/323:43:593
2501041993533,1cyclictest0-21swapper/323:11:593
2501041993533,1cyclictest0-21swapper/322:22:003
250104199350,1cyclictest0-21swapper/320:19:553
2501037993533,1cyclictest0-21swapper/219:55:002
2501037993532,2cyclictest0-21swapper/222:54:592
2501037993532,2cyclictest0-21swapper/219:59:002
250103799350,33cyclictest0-21swapper/221:28:582
2501035993532,2cyclictest714-21Xorg20:26:591
2501035993531,3cyclictest2502524-21idleruntime-cro19:15:001
2501035993530,4cyclictest2546298-21kworker/u8:1+flush-179:022:15:051
2501035993530,3cyclictest2546298-21kworker/u8:1+events_unbound22:20:131
2501032993527,6cyclictest2500898-21latency_hist19:10:020
2501041993432,1cyclictest0-21swapper/323:04:553
2501041993432,1cyclictest0-21swapper/300:39:553
2501041993431,2cyclictest0-21swapper/300:33:003
2501037993432,1cyclictest0-21swapper/219:35:002
2501037993431,2cyclictest0-21swapper/220:27:002
250103599341,29cyclictest2536964-21apt-get21:00:131
2501041993331,1cyclictest0-21swapper/322:59:003
2501041993331,1cyclictest0-21swapper/322:27:593
2501041993331,1cyclictest0-21swapper/322:14:593
2501037993331,1cyclictest0-21swapper/220:50:002
2501041993230,1cyclictest0-21swapper/319:35:593
2501041993230,1cyclictest0-21swapper/300:26:593
2501037993229,2cyclictest0-21swapper/223:05:592
250103799320,30cyclictest0-21swapper/221:46:592
250103799320,30cyclictest0-21swapper/221:05:002
250103799320,2cyclictest0-21swapper/220:00:592
250103799320,28cyclictest0-21swapper/220:55:132
2501032993230,1cyclictest0-21swapper/020:16:580
250103299321,29cyclictest714-21Xorg20:13:590
2501041993129,1cyclictest0-21swapper/321:09:593
2501037993128,2cyclictest0-21swapper/220:16:592
2501037993126,2cyclictest0-21swapper/223:15:022
250103799310,29cyclictest0-21swapper/219:36:552
250103799310,27cyclictest0-21swapper/219:45:132
2501035993127,3cyclictest2589306-21latency_hist23:40:011
2501035993126,4cyclictest2566156-21systemd22:30:011
2501035993126,4cyclictest2504334-21kworker/u8:1+events_unbound20:40:231
2501041993028,1cyclictest0-21swapper/323:38:593
2501041993028,1cyclictest0-21swapper/319:57:003
2501037993028,1cyclictest0-21swapper/200:05:002
2501037993027,2cyclictest0-21swapper/222:23:592
2501037993027,2cyclictest0-21swapper/200:00:022
2501037993026,2cyclictest0-21swapper/223:20:132
2501037993026,2cyclictest0-21swapper/200:25:592
2501037993025,2cyclictest0-21swapper/222:10:142
250103799300,2cyclictest0-21swapper/200:15:032
250103799300,27cyclictest0-21swapper/221:13:582
250103799300,26cyclictest0-21swapper/222:25:592
4577091290,7ptp4l61490irq/134-eno1-TxRx-020:50:003
2501041992928,1cyclictest0-21swapper/323:47:593
2501041992927,1cyclictest0-21swapper/319:27:593
2501041992926,2cyclictest0-21swapper/323:55:123
2501041992926,2cyclictest0-21swapper/321:25:143
250104199290,27cyclictest0-21swapper/323:30:013
250104199290,27cyclictest0-21swapper/320:00:133
250104199290,27cyclictest0-21swapper/300:10:133
2501037992926,2cyclictest0-21swapper/223:25:132
2501037992925,2cyclictest0-21swapper/200:30:142
250103799290,2cyclictest0-21swapper/222:05:122
250103799290,27cyclictest0-21swapper/223:14:592
4577091280,6ptp4l441ktimers/300:10:013
2501041992826,1cyclictest0-21swapper/322:40:123
2501041992826,1cyclictest0-21swapper/320:10:123
2501041992825,2cyclictest0-21swapper/321:43:583
250104199280,26cyclictest0-21swapper/322:15:023
2501037992825,2cyclictest0-21swapper/219:10:142
250103799280,2cyclictest0-21swapper/221:35:032
250103799280,2cyclictest0-21swapper/221:30:142
250103799280,2cyclictest0-21swapper/220:13:592
250103799280,27cyclictest0-21swapper/222:00:142
250103799280,27cyclictest0-21swapper/220:05:122
250103799280,26cyclictest0-21swapper/223:37:002
250103799280,26cyclictest0-21swapper/222:32:592
250103799280,26cyclictest0-21swapper/219:23:592
250103799280,20cyclictest0-21swapper/222:18:592
4577091270,6ptp4l61490irq/134-eno1-TxRx-021:00:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-020:45:013
4577091270,6ptp4l441ktimers/319:15:003
4577091270,5ptp4l61490irq/134-eno1-TxRx-022:55:003
2501041992725,1cyclictest0-21swapper/300:02:593
2501041992724,2cyclictest0-21swapper/320:35:593
2501041992721,5cyclictest2520747-21turbostat20:10:013
2501041992721,4cyclictest2512801-21turbostat19:49:553
250103799270,2cyclictest0-21swapper/219:44:002
4577091260,6ptp4l61490irq/134-eno1-TxRx-020:35:003
4577091260,6ptp4l441ktimers/322:05:003
4577091260,6ptp4l441ktimers/321:15:003
4577091260,6ptp4l441ktimers/320:25:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-021:50:023
2501041992624,1cyclictest2572493-21turbostat22:50:003
2501041992623,2cyclictest0-21swapper/321:32:003
250104199260,25cyclictest2515965-21turbostat19:55:013
250104199260,25cyclictest0-21swapper/319:43:593
4577091250,5ptp4l61490irq/134-eno1-TxRx-020:54:543
4577091250,4ptp4l441ktimers/321:05:023
250104199250,24cyclictest0-21swapper/319:34:593
2501037992522,2cyclictest0-21swapper/221:51:002
2501041992423,1cyclictest0-21swapper/322:36:593
2501041992419,4cyclictest2544927-21turbostat21:25:003
2501037992422,1cyclictest0-21swapper/200:14:592
2501037992421,2cyclictest0-21swapper/222:35:152
2501037992421,2cyclictest0-21swapper/221:08:002
4577091230,3ptp4l61490irq/134-eno1-TxRx-022:10:023
4577091230,3ptp4l441ktimers/300:24:563
4577091230,3ptp4l441ktimers/300:24:553
2501037992321,1cyclictest0-21swapper/223:05:002
2501041992220,1cyclictest0-21swapper/322:30:133
231999220,13rtkit-daemon3203871-21ntpd19:07:431
2501037992117,2cyclictest0-21swapper/221:56:582
250104199200,18cyclictest2554728-21turbostat21:55:003
250103799160,14cyclictest0-21swapper/223:33:112
25010379930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional