You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 02:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sat Dec 13, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2758994999181,8cyclictest2781751-21latency_hist08:20:010
2758996998275,6cyclictest2758922-21kworker/u8:0+events_unbound07:35:011
2758996998175,5cyclictest2768719-21kworker/u8:3+events_unbound07:40:021
2758996997869,7cyclictest2808813-21latency_hist09:45:011
2758994997670,5cyclictest2802480-21kworker/u8:0+flush-179:010:00:320
2758994997560,14cyclictest0-21swapper/010:26:000
2758996997469,4cyclictest2851008-21kworker/u8:2+events_unbound12:10:241
2758996997368,3cyclictest2781712-21kworker/u8:0+flush-179:008:30:161
2758996997065,3cyclictest2789729-21kworker/u8:2+events_unbound09:05:151
2758996997055,14cyclictest2824517-21kworker/u8:3+flush-179:010:35:251
2758996996965,3cyclictest2849355-21kworker/u8:1+flush-179:011:55:001
2758996996961,3cyclictest2843000-21kworker/u8:2+events_unbound11:45:241
2758994996953,14cyclictest2783338-21latency_hist08:25:010
2758996996662,3cyclictest2821844-21kworker/u8:0+events_unbound10:55:241
275899499660,2cyclictest0-21swapper/010:56:590
2758994996459,3cyclictest2802480-21kworker/u8:0+flush-179:009:35:250
2758996996258,3cyclictest2775337-21kworker/u8:2+events_unbound08:15:251
2758996996249,4cyclictest2781712-21kworker/u8:0+events_unbound08:20:191
2758994996253,7cyclictest2835067-21latency_hist11:05:010
2758994996250,9cyclictest2848056-21apt-get11:45:120
2758996996156,4cyclictest2802480-21kworker/u8:0+flush-179:009:35:261
2758994996152,7cyclictest2804287-21apt-get09:30:120
4577091600,9ptp4l441ktimers/307:07:593
2758996996055,4cyclictest2809506-21kworker/u8:1+events_unbound10:20:251
2758996996049,10cyclictest2855800-21kworker/u8:3+flush-179:012:25:001
2758996995950,7cyclictest2777207-21/usr/sbin/munin08:05:221
2758994995952,5cyclictest2817026-21latency_hist10:10:010
2758996995753,3cyclictest2809506-21kworker/u8:1+events_unbound10:00:151
2758994995749,6cyclictest2786513-21latency_hist08:35:010
2758994995649,5cyclictest2758922-21kworker/u8:0+flush-179:007:40:000
2758996995550,4cyclictest2775337-21kworker/u8:2+events_unbound08:00:191
2758996995547,6cyclictest2780142-21latency_hist08:15:001
2758996995547,6cyclictest2780142-21latency_hist08:15:001
2758996995543,9cyclictest266-21systemd-journal09:05:001
2758996995543,9cyclictest266-21systemd-journal09:05:001
2758996995450,3cyclictest2809506-21kworker/u8:1+events_unbound10:10:151
2758996995449,4cyclictest2815703-21kworker/u8:2+events_unbound10:15:201
2758996995449,4cyclictest2770646-21kworker/u8:1+flush-179:007:59:541
2758994995342,9cyclictest266-21systemd-journal07:32:150
2758996995248,3cyclictest2802480-21kworker/u8:0+flush-179:009:59:561
2758996995247,4cyclictest2781712-21kworker/u8:0+events_unbound08:25:231
2758996995247,4cyclictest2738876-21kworker/u8:3+flush-179:007:20:261
2758996995147,3cyclictest2847210-21kworker/u8:0+flush-179:012:05:221
2758996995146,4cyclictest2796041-21kworker/u8:1+events_unbound09:20:241
2758996995145,4cyclictest2844845-21/usr/sbin/munin11:35:231
2758996995141,8cyclictest2827106-21apt-get10:40:141
2758996995140,9cyclictest2830535-21apt-get10:50:131
2758994995147,3cyclictest2847210-21kworker/u8:0+flush-179:012:00:220
2758994995144,4cyclictest2821844-21kworker/u8:0+flush-179:010:50:010
2758994995142,7cyclictest2783576-21/usr/sbin/munin08:25:250
2758996995045,4cyclictest2833513-21kworker/u8:1+events_unbound11:00:201
2758996995045,4cyclictest2783373-21kworker/u8:3+events_unbound08:35:201
2758994995047,2cyclictest0-21swapper/009:26:000
2758994995046,3cyclictest2738876-21kworker/u8:3+flush-179:007:20:000
2758996994945,3cyclictest2826870-21kworker/u8:1+events_unbound10:46:171
2758996994944,4cyclictest2849355-21kworker/u8:1+flush-179:011:55:271
2758996994944,4cyclictest2797646-21kworker/u8:0+flush-179:009:10:381
2758996994942,5cyclictest2783373-21kworker/u8:3+flush-179:008:45:001
2758994994942,5cyclictest2789729-21kworker/u8:2+events_unbound09:05:000
2758994994942,5cyclictest2789729-21kworker/u8:2+events_unbound09:04:590
2758994994929,18cyclictest2820215-21latency_hist10:20:000
2758996994743,3cyclictest2796041-21kworker/u8:1+flush-179:009:28:151
2758996994738,7cyclictest2760730-21/usr/sbin/munin07:15:201
275899499470,2cyclictest0-21swapper/009:15:130
2758996994642,3cyclictest2862359-21kworker/u8:0+events_unbound12:30:131
2758996994642,3cyclictest2838271-21kworker/u8:0+events_unbound11:25:271
2758994994640,5cyclictest2789729-21kworker/u8:2+flush-179:008:55:260
275900299450,44cyclictest2778557-21turbostat08:10:013
2758996994541,3cyclictest2789684-21kworker/u8:0+flush-179:008:49:551
2758996994540,4cyclictest2809506-21kworker/u8:1+flush-179:010:29:541
2758996994534,5cyclictest2831902-21kworker/u8:2+events_unbound11:14:381
2758994994539,4cyclictest2789746-21systemd-run08:45:000
2758994994534,9cyclictest2846468-21apt-get11:40:130
2758994994528,15cyclictest2797918-21apt-get09:10:260
2758994994521,3cyclictest0-21swapper/009:45:220
275899499451,42cyclictest714-21Xorg08:37:590
2758996994440,3cyclictest2838271-21kworker/u8:0+flush-179:011:24:561
2758996994440,3cyclictest2824517-21kworker/u8:3+events_unbound11:05:221
2758996994440,3cyclictest2824517-21kworker/u8:3+events_unbound11:05:211
2758996994440,3cyclictest2805597-21kworker/u8:2+flush-179:009:34:541
2758994994425,2cyclictest0-21swapper/011:06:000
2758994994425,2cyclictest0-21swapper/011:06:000
2758996994335,6cyclictest2824517-21kworker/u8:3+flush-179:010:30:251
2758996994335,6cyclictest2772422-21/usr/sbin/munin07:50:241
2758994994335,6cyclictest2826849-21latency_hist10:40:010
2759000994239,2cyclictest0-21swapper/210:00:582
2758996994238,3cyclictest2802480-21kworker/u8:0+flush-179:009:54:551
2758996994233,7cyclictest510-21rs:main1
2758996994233,7cyclictest510-21rs:main1
275899699420,40cyclictest2858958-21munin-plugin-st12:20:011
275899699420,2cyclictest171rcu_preempt08:50:151
2758996994137,3cyclictest2796041-21kworker/u8:1+events_unbound09:17:161
2758996994136,4cyclictest2847210-21kworker/u8:0+flush-179:012:01:161
2758996994136,4cyclictest2789729-21kworker/u8:2+events_unbound08:56:151
275899699411,38cyclictest714-21Xorg09:47:591
2758994994135,4cyclictest2809506-21kworker/u8:1+flush-179:010:30:190
2758994994132,7cyclictest2764233-21diskstats07:25:170
2758994994132,6cyclictest2797646-21kworker/u8:0+flush-179:009:10:000
2758994994130,9cyclictest2801113-21apt-get09:20:130
2758994994128,10cyclictest2808822-21apt-get09:45:010
275899499411,38cyclictest2855760-21dump-pmu-power12:10:000
2759002994034,5cyclictest2781760-21turbostat08:20:003
275900299400,38cyclictest2810671-21turbostat09:50:013
2759000994036,2cyclictest0-21swapper/211:29:552
275899699400,38cyclictest714-21Xorg12:37:591
2758994994035,3cyclictest2862160-21systemd-run12:30:000
2758994994035,3cyclictest2862160-21systemd-run12:30:000
2758994994034,4cyclictest484-21dbus-daemon07:55:000
275899499403,12cyclictest2304-21lightdm-gtk-gre12:15:590
275899499401,37cyclictest714-21Xorg11:37:590
2759002993934,4cyclictest2844615-21turbostat11:34:593
2759002993934,4cyclictest2844615-21turbostat11:34:593
2759002993933,5cyclictest2815463-21turbostat10:04:593
275900299390,4cyclictest2820216-21turbostat10:19:593
2759000993936,2cyclictest0-21swapper/209:59:002
2758996993934,4cyclictest2843000-21kworker/u8:2+events_unbound11:31:161
2758996993934,4cyclictest2843000-21kworker/u8:2+events_unbound11:31:161
2758996993934,4cyclictest2764931-21kworker/u8:1+events_unbound07:30:271
275899699391,31cyclictest29-21ksoftirqd/111:40:131
2758994993928,9cyclictest2820477-21apt-get10:20:120
2759002993832,4cyclictest2836656-21turbostat11:10:003
2759002993832,4cyclictest2836656-21turbostat11:09:593
2759002993831,5cyclictest2818618-21turbostat10:15:013
275900299380,37cyclictest2862138-21turbostat12:30:003
275900299380,37cyclictest2862138-21turbostat12:30:003
275900099380,35cyclictest0-21swapper/209:28:592
275900099380,35cyclictest0-21swapper/207:54:552
2758994993834,3cyclictest2852565-21systemctl12:00:000
2758994993822,3cyclictest2792804-21grep08:50:270
275899499380,2cyclictest714-21Xorg08:07:590
275899499380,2cyclictest0-21swapper/007:21:590
2759002993735,1cyclictest0-21swapper/307:46:593
275900299370,36cyclictest0-21swapper/307:14:593
2759000993734,2cyclictest0-21swapper/208:31:002
2759000993734,2cyclictest0-21swapper/208:10:592
2759000993734,2cyclictest0-21swapper/208:10:582
275900099370,35cyclictest0-21swapper/207:17:592
2758994993734,2cyclictest714-21Xorg12:20:590
2758994993733,3cyclictest2851008-21kworker/u8:2+flush-179:012:10:250
2758994993733,2cyclictest2780157-21sh08:15:000
2758994993733,2cyclictest2780157-21sh08:15:000
2758994993731,4cyclictest2838271-21kworker/u8:0+events_unbound11:15:240
2759002993634,1cyclictest0-21swapper/310:37:593
2759002993630,5cyclictest2804037-21turbostat09:30:003
275900299360,35cyclictest0-21swapper/312:09:563
2759000993634,1cyclictest0-21swapper/207:40:002
2759000993633,2cyclictest0-21swapper/212:26:002
2759000993633,2cyclictest0-21swapper/212:25:592
2759000993633,2cyclictest0-21swapper/212:16:592
2759000993633,2cyclictest0-21swapper/212:05:592
2759000993633,2cyclictest0-21swapper/207:58:592
2759000993633,2cyclictest0-21swapper/207:41:592
2759000993633,1cyclictest0-21swapper/207:15:002
275900099360,1cyclictest0-21swapper/207:25:592
2758996993632,3cyclictest2738876-21kworker/u8:3+events_unbound07:29:551
2759002993533,1cyclictest0-21swapper/312:22:593
2759002993533,1cyclictest0-21swapper/312:15:593
2759002993533,1cyclictest0-21swapper/309:44:543
2759002993533,1cyclictest0-21swapper/309:02:593
2759002993533,1cyclictest0-21swapper/309:02:583
2759002993530,4cyclictest2833475-21turbostat11:00:003
2759002993529,5cyclictest2784933-21turbostat08:30:003
2759002993529,5cyclictest2762093-21turbostat07:20:003
2759000993533,1cyclictest0-21swapper/212:34:592
2759000993533,1cyclictest0-21swapper/209:03:592
2759000993533,1cyclictest0-21swapper/209:03:592
2759000993533,1cyclictest0-21swapper/207:25:002
2759000993532,2cyclictest0-21swapper/208:29:592
2759000993531,2cyclictest0-21swapper/207:33:592
275900099350,1cyclictest0-21swapper/211:50:002
2758996993532,2cyclictest0-21swapper/107:47:591
2758996993530,4cyclictest2831902-21kworker/u8:2+events_unbound11:16:161
2758994993530,3cyclictest2824517-21kworker/u8:3+events_unbound11:10:240
2758994993529,4cyclictest2802480-21kworker/u8:0+flush-179:009:55:190
275899499351,4cyclictest2774028-21apt-get07:55:120
275899499351,32cyclictest2769236-21gpgv07:40:010
2759002993432,1cyclictest0-21swapper/310:21:583
2759002993429,4cyclictest2847818-21turbostat11:45:003
2759002993429,4cyclictest2789712-21turbostat08:44:593
2759002993429,4cyclictest2788116-21turbostat08:40:003
2759000993432,1cyclictest0-21swapper/210:55:002
2759000993432,1cyclictest0-21swapper/209:20:012
2758996993429,4cyclictest2802480-21kworker/u8:0+flush-179:010:06:141
275899499341,8cyclictest2843034-21cron11:30:010
275899499341,30cyclictest0-21swapper/011:50:140
2759002993331,1cyclictest0-21swapper/310:10:003
275900299330,4cyclictest2805626-21turbostat09:35:003
2759000993331,1cyclictest0-21swapper/208:05:002
2759000993330,2cyclictest0-21swapper/209:49:552
2758996993329,3cyclictest2738876-21kworker/u8:3+events_unbound07:14:151
2758994993329,3cyclictest2772223-21systemd-run07:50:000
275899499331,30cyclictest2817281-21apt-get10:10:140
2759002993230,1cyclictest0-21swapper/312:10:593
2759000993229,2cyclictest0-21swapper/212:03:592
2758994993226,5cyclictest2840083-21/usr/sbin/munin11:20:170
2758994993222,7cyclictest2830021-21latency_hist10:50:010
275899499320,6cyclictest714-21Xorg08:46:000
2759002993129,1cyclictest0-21swapper/310:45:593
2759002993129,1cyclictest0-21swapper/308:24:553
2759002993126,4cyclictest2865315-21turbostat12:40:003
2759002993125,5cyclictest2863725-21turbostat12:35:003
2759002993125,5cyclictest2854181-21turbostat12:04:593
2759002993125,5cyclictest2812255-21turbostat09:55:013
2759000993129,1cyclictest0-21swapper/211:25:002
2759000993128,2cyclictest0-21swapper/211:35:592
2759000993128,2cyclictest0-21swapper/211:00:582
2759000993128,2cyclictest0-21swapper/208:25:002
2758994993129,1cyclictest2824517-21kworker/u8:3+events_unbound10:40:150
2758994993119,10cyclictest266-21systemd-journal12:34:160
4577091300,7ptp4l441ktimers/311:25:003
4577091300,7ptp4l441ktimers/309:00:013
2759002993028,1cyclictest0-21swapper/311:12:593
2759002993028,1cyclictest0-21swapper/307:26:593
2759002993025,4cyclictest2791309-21turbostat08:50:003
2759000993027,2cyclictest0-21swapper/210:43:592
2759000993027,2cyclictest0-21swapper/209:05:582
275900099300,2cyclictest0-21swapper/207:45:142
275900099300,28cyclictest0-21swapper/210:09:592
2758994993023,5cyclictest2776757-21timerwakeupswit08:00:240
4577091290,7ptp4l441ktimers/310:35:013
4577091290,7ptp4l441ktimers/309:39:593
4577091290,6ptp4l441ktimers/311:50:013
4577091290,6ptp4l441ktimers/311:20:003
4577091290,6ptp4l441ktimers/307:50:013
2759002992927,1cyclictest0-21swapper/308:51:593
2759002992926,2cyclictest0-21swapper/309:55:163
2759002992926,2cyclictest0-21swapper/308:10:143
2759002992926,2cyclictest0-21swapper/308:10:143
2759002992924,4cyclictest2797670-21turbostat09:10:003
275900299290,28cyclictest0-21swapper/308:30:153
275900299290,27cyclictest0-21swapper/308:00:133
2759000992927,1cyclictest0-21swapper/210:29:592
2759000992925,2cyclictest0-21swapper/211:40:132
275900099290,27cyclictest0-21swapper/212:20:142
275900099290,27cyclictest0-21swapper/210:55:132
275900099290,27cyclictest0-21swapper/210:30:032
275900099290,27cyclictest0-21swapper/210:20:142
4577091280,6ptp4l441ktimers/312:00:003
4577091280,6ptp4l441ktimers/310:29:563
4577091280,6ptp4l441ktimers/309:15:013
4577091280,6ptp4l441ktimers/307:35:013
4577091280,6ptp4l441ktimers/307:25:003
2759002992826,1cyclictest0-21swapper/307:35:153
2759002992823,4cyclictest2835069-21turbostat11:05:003
275900299280,26cyclictest0-21swapper/307:40:033
275900299280,21cyclictest0-21swapper/310:50:013
2759000992826,1cyclictest0-21swapper/211:55:012
2759000992826,1cyclictest0-21swapper/209:15:002
2759000992825,2cyclictest0-21swapper/212:12:002
2759000992825,2cyclictest0-21swapper/210:45:132
2759000992825,2cyclictest0-21swapper/208:35:152
275900099280,2cyclictest0-21swapper/210:15:592
275900099280,26cyclictest0-21swapper/209:50:592
275900099280,26cyclictest0-21swapper/208:46:582
275900099280,21cyclictest0-21swapper/209:32:592
2758994992823,3cyclictest2809506-21kworker/u8:1+flush-179:009:50:210
2759000992724,2cyclictest0-21swapper/208:05:142
275900099270,25cyclictest0-21swapper/209:43:592
4577091260,5ptp4l441ktimers/309:19:553
2759002992624,1cyclictest0-21swapper/307:57:593
2759000992623,2cyclictest0-21swapper/211:15:592
2759000992623,2cyclictest0-21swapper/208:55:592
275900099260,24cyclictest0-21swapper/211:33:002
275900099260,24cyclictest0-21swapper/211:33:002
275899499263,17cyclictest2304-21lightdm-gtk-gre11:33:590
275899499263,17cyclictest2304-21lightdm-gtk-gre11:33:590
2758994992622,3cyclictest2760158-21switchtime07:10:200
4577091250,4ptp4l441ktimers/311:54:553
4577091250,4ptp4l441ktimers/311:39:553
4577091250,4ptp4l441ktimers/311:29:563
4577091250,4ptp4l441ktimers/310:44:553
2759000992522,2cyclictest0-21swapper/208:15:152
2759002992422,1cyclictest0-21swapper/309:21:593
2758994992422,1cyclictest0-21swapper/012:39:590
2759000992220,1cyclictest0-21swapper/211:09:592
2759000992220,1cyclictest0-21swapper/211:09:592
2759000992220,1cyclictest0-21swapper/210:40:002
2759000992219,2cyclictest0-21swapper/211:13:592
2759000992219,2cyclictest0-21swapper/208:53:592
2758996992011,3cyclictest29-21ksoftirqd/107:10:011
275899499193,11cyclictest2758999-21sed07:10:010
2759000991716,1cyclictest0-21swapper/209:24:582
2759000991714,2cyclictest0-21swapper/212:37:592
2759000991513,1cyclictest0-21swapper/209:40:002
2759000991412,1cyclictest0-21swapper/211:59:582
27590009974,2cyclictest0-21swapper/210:10:092
27590009963,2cyclictest0-21swapper/208:40:412
27590009930,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional