You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 19:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Fri Jan 02, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5863009910091,6cyclictest668935-21kworker/u8:1+flush-179:012:00:001
586300999890,5cyclictest681690-21latency_hist12:05:011
586295999892,5cyclictest662300-21kworker/u8:2+flush-179:011:20:250
586300999675,19cyclictest672115-21kworker/u8:0+flush-179:011:40:011
586295999181,7cyclictest688057-21latency_hist12:25:010
58629599901,85cyclictest1-21systemd10:10:000
586300998979,7cyclictest621611-21kworker/u8:0+flush-179:009:00:001
586295998985,3cyclictest627017-21kworker/u8:3+events_unbound09:20:230
586295998778,7cyclictest266-21systemd-journal12:09:590
586300998680,4cyclictest598041-21kworker/u8:2+flush-179:008:20:001
586295998475,7cyclictest647923-21/usr/sbin/munin10:20:230
586295998475,7cyclictest647923-21/usr/sbin/munin10:20:230
586300998373,8cyclictest586609-21/usr/sbin/munin07:10:251
586295998378,4cyclictest589571-21kworker/u8:3+events_unbound07:40:240
586300998277,3cyclictest598039-21kworker/u8:1+flush-179:009:40:241
586300998073,5cyclictest607640-21kworker/u8:0+flush-179:008:20:301
586300997970,7cyclictest685099-21/usr/sbin/munin12:15:241
586295997872,4cyclictest630137-21kworker/u8:0+flush-179:009:35:200
586300997769,6cyclictest680678-21kworker/u8:2+flush-179:012:05:241
586295997763,5cyclictest672115-21kworker/u8:0+events_unbound11:50:230
586300997666,7cyclictest636774-21/usr/sbin/munin09:45:251
586295997570,4cyclictest644523-21kworker/u8:3+flush-179:010:40:240
586295997565,4cyclictest687523-21kworker/u8:2+events_unbound12:25:230
586295997564,8cyclictest592995-21apt-get07:30:130
586295997369,3cyclictest630137-21kworker/u8:0+events_unbound09:25:260
586295997363,7cyclictest662332-21apt-get11:05:000
586295997268,3cyclictest651148-21kworker/u8:0+events_unbound10:55:240
586295997267,3cyclictest641322-21latency_hist10:00:010
586295997266,4cyclictest691212-21kworker/u8:0+events_unbound12:35:220
586300997164,5cyclictest691212-21kworker/u8:0+flush-179:012:35:001
586295997166,4cyclictest644467-21kworker/u8:2+events_unbound10:25:140
586295997166,4cyclictest579291-21kworker/u8:2+flush-179:007:15:260
586300996961,5cyclictest613975-21latency_hist08:35:011
586295996964,4cyclictest631733-21kworker/u8:3+flush-179:009:30:250
586300996761,5cyclictest651148-21kworker/u8:0+flush-179:010:40:011
586300996761,4cyclictest662300-21kworker/u8:2+flush-179:011:25:001
586300996759,5cyclictest595919-21kworker/u8:0+flush-179:007:40:021
586300996634,1cyclictest0-21swapper/111:46:001
586295996561,3cyclictest665734-21kworker/u8:0+flush-179:011:15:300
586295996560,4cyclictest668935-21kworker/u8:1+flush-179:012:00:160
58630499630,60cyclictest0-21swapper/307:15:593
586295996359,3cyclictest668935-21kworker/u8:1+flush-179:011:45:190
586295996359,3cyclictest651148-21kworker/u8:0+events_unbound10:30:150
586300996244,17cyclictest612354-21kworker/u8:3+events_unbound08:35:141
586295996253,4cyclictest655930-21kworker/u8:1+events_unbound10:50:160
586300996156,3cyclictest651148-21kworker/u8:0+events_unbound11:00:191
586295996156,4cyclictest612354-21kworker/u8:3+flush-179:008:30:250
586300996053,5cyclictest665734-21kworker/u8:0+flush-179:011:15:011
586300996052,5cyclictest681650-21kworker/u8:3+flush-179:012:10:271
586295996056,3cyclictest668935-21kworker/u8:1+flush-179:011:25:280
586295996056,3cyclictest621611-21kworker/u8:0+flush-179:008:59:550
586295996055,4cyclictest598039-21kworker/u8:1+events_unbound09:00:180
586295995955,3cyclictest668935-21kworker/u8:1+events_unbound11:35:260
586295995954,4cyclictest612354-21kworker/u8:3+events_unbound08:35:120
586295995954,4cyclictest598041-21kworker/u8:2+events_unbound08:15:240
586295995954,4cyclictest598039-21kworker/u8:1+flush-179:008:10:200
586295995954,4cyclictest598039-21kworker/u8:1+flush-179:008:10:190
586300995853,4cyclictest668935-21kworker/u8:1+flush-179:011:25:241
586300995853,4cyclictest651148-21kworker/u8:0+flush-179:010:45:251
586300995852,4cyclictest665734-21kworker/u8:0+events_unbound11:15:161
586295995854,3cyclictest623772-21kworker/u8:2+events_unbound09:10:220
586295995853,4cyclictest662300-21kworker/u8:2+flush-179:011:10:240
586295995853,4cyclictest568651-21kworker/u8:1+flush-179:007:20:150
586300995750,5cyclictest658844-21kworker/u8:4+flush-179:011:00:001
586295995753,3cyclictest618991-21kworker/u8:2+events_unbound08:50:250
586295995752,4cyclictest668935-21kworker/u8:1+flush-179:011:30:250
586295995752,4cyclictest607640-21kworker/u8:0+events_unbound08:20:260
586295995752,4cyclictest598041-21kworker/u8:2+flush-179:008:05:210
586295995748,3cyclictest568651-21kworker/u8:1+events_unbound07:10:190
586295995652,3cyclictest612354-21kworker/u8:3+events_unbound08:29:550
586300995545,4cyclictest651148-21kworker/u8:0+events_unbound10:55:001
586300995451,2cyclictest644523-21kworker/u8:3+events_unbound10:30:241
586300995449,4cyclictest630137-21kworker/u8:0+flush-179:009:24:561
586300995448,4cyclictest630137-21kworker/u8:0+events_unbound09:35:241
586295995449,4cyclictest630137-21kworker/u8:0+flush-179:009:45:290
586295995449,4cyclictest623772-21kworker/u8:2+flush-179:009:19:550
586300995344,7cyclictest266-21systemd-journal12:25:031
586295995348,4cyclictest687523-21kworker/u8:2+events_unbound12:30:180
586295995348,4cyclictest644523-21kworker/u8:3+events_unbound10:15:200
586295995343,4cyclictest598039-21kworker/u8:1+events_unbound07:55:250
586300995247,3cyclictest598041-21kworker/u8:2+flush-179:008:05:001
586295995248,3cyclictest598039-21kworker/u8:1+events_unbound09:40:190
586295995247,4cyclictest598039-21kworker/u8:1+events_unbound09:50:240
586295995246,5cyclictest598039-21kworker/u8:1+events_unbound10:00:120
586295995147,3cyclictest672115-21kworker/u8:0+flush-179:011:40:310
586295995147,3cyclictest672115-21kworker/u8:0+flush-179:011:40:300
586295995146,4cyclictest598041-21kworker/u8:2+flush-179:007:54:140
586295995142,4cyclictest598039-21kworker/u8:1+events_unbound08:45:240
586302995046,2cyclictest0-21swapper/209:26:592
586300995045,3cyclictest644523-21kworker/u8:3+flush-179:010:15:261
586300995044,4cyclictest568651-21kworker/u8:1+flush-179:007:25:231
586295995045,4cyclictest644467-21kworker/u8:2+events_unbound10:11:320
586300994946,2cyclictest271rcuc/108:42:591
586300994943,4cyclictest644523-21kworker/u8:3+flush-179:010:25:161
586300994943,4cyclictest592775-21kworker/u8:2+flush-179:007:30:171
586295994945,3cyclictest589571-21kworker/u8:3+events_unbound07:35:200
58629599491,46cyclictest654109-21munin-run10:39:590
586304994846,1cyclictest0-21swapper/309:26:593
586300994742,4cyclictest641270-21kworker/u8:0+events_unbound10:05:251
586300994742,3cyclictest714-21Xorg09:02:001
586300994741,4cyclictest611377-21kworker/u8:2+events_unbound08:25:241
586300994737,5cyclictest685404-21kworker/u8:1+flush-179:012:20:221
4577091470,12ptp4l441ktimers/307:09:563
586300994641,4cyclictest598039-21kworker/u8:1+flush-179:009:58:301
586300994639,5cyclictest624055-21apt-get09:05:101
586300994637,7cyclictest644744-21apt-get10:10:111
586300994536,7cyclictest607605-21latency_hist08:15:011
586300994536,7cyclictest607605-21latency_hist08:15:001
586295994541,3cyclictest668935-21kworker/u8:1+events_unbound11:58:310
586295994540,4cyclictest655930-21kworker/u8:1+events_unbound10:49:320
586300994438,3cyclictest0-21swapper/110:40:131
586300994436,6cyclictest631733-21kworker/u8:3+flush-179:009:35:011
586295994440,3cyclictest589571-21kworker/u8:3+events_unbound07:29:560
586304994337,5cyclictest686459-21turbostat12:20:003
586304994336,5cyclictest638133-21turbostat09:50:003
586300994339,3cyclictest598039-21kworker/u8:1+flush-179:009:54:351
586300994338,4cyclictest623772-21kworker/u8:2+flush-179:009:15:251
586300994338,4cyclictest598039-21kworker/u8:1+flush-179:008:54:551
586300994337,4cyclictest630137-21kworker/u8:0+flush-179:009:25:241
586295994339,3cyclictest598041-21kworker/u8:2+events_unbound08:03:300
586300994237,3cyclictest600268-21kworker/u8:0+events_unbound07:50:331
58630099420,40cyclictest647703-21turbostat10:24:561
58630099420,40cyclictest647703-21turbostat10:24:561
586295994237,4cyclictest685404-21kworker/u8:1+events_unbound12:18:330
586295994236,5cyclictest484-21dbus-daemon07:49:590
586295994232,4cyclictest683260-21kworker/u8:0+events_unbound12:10:130
586295994137,3cyclictest658844-21kworker/u8:4+events_unbound11:06:320
586295994137,3cyclictest598039-21kworker/u8:1+events_unbound09:09:260
586300994034,4cyclictest598039-21kworker/u8:1+flush-179:008:10:001
58630099400,38cyclictest714-21Xorg11:50:591
58630499390,38cyclictest672134-21turbostat11:35:003
586302993935,2cyclictest0-21swapper/207:24:582
58630299390,37cyclictest0-21swapper/211:32:002
58630299390,36cyclictest0-21swapper/210:19:002
58630299390,36cyclictest0-21swapper/209:49:002
586304993835,2cyclictest0-21swapper/308:09:593
58630499380,1cyclictest0-21swapper/312:24:593
58630299380,35cyclictest0-21swapper/211:56:002
58630299380,35cyclictest0-21swapper/211:21:582
58630299380,35cyclictest0-21swapper/208:20:002
58630299380,2cyclictest0-21swapper/211:10:592
586300993833,4cyclictest672115-21kworker/u8:0+events_unbound11:44:591
586300993833,4cyclictest672115-21kworker/u8:0+events_unbound11:44:591
586300993833,3cyclictest602560-21cron08:00:001
586300993832,4cyclictest668935-21kworker/u8:1+events_unbound11:30:261
586300993829,8cyclictest662300-21kworker/u8:2+flush-179:011:05:201
586295993835,2cyclictest0-21swapper/008:41:590
586304993734,2cyclictest0-21swapper/310:43:593
586304993734,2cyclictest0-21swapper/307:49:593
586304993732,4cyclictest639716-21turbostat09:55:003
58630499370,36cyclictest0-21swapper/311:42:003
58630499370,36cyclictest0-21swapper/311:42:003
58630499370,36cyclictest0-21swapper/310:19:003
586302993735,1cyclictest0-21swapper/208:10:002
586302993735,1cyclictest0-21swapper/207:50:002
586302993734,2cyclictest0-21swapper/210:43:582
586300993730,5cyclictest589571-21kworker/u8:3+flush-179:007:40:201
586304993634,1cyclictest0-21swapper/307:24:593
586304993633,2cyclictest0-21swapper/310:27:593
58630499360,35cyclictest0-21swapper/308:19:593
58630499360,34cyclictest0-21swapper/311:56:003
586302993633,2cyclictest0-21swapper/210:27:592
586300993629,5cyclictest598039-21kworker/u8:1+flush-179:008:45:271
586300993623,5cyclictest568651-21kworker/u8:1+events_unbound07:20:241
586304993532,2cyclictest0-21swapper/309:41:593
58630499350,34cyclictest0-21swapper/311:21:593
586302993532,2cyclictest0-21swapper/209:41:592
586300993428,4cyclictest691212-21kworker/u8:0+events_unbound12:35:121
586300993422,8cyclictest641571-21apt-get10:00:111
586302993331,1cyclictest0-21swapper/209:55:002
586302993330,2cyclictest0-21swapper/211:05:592
586302993330,2cyclictest0-21swapper/210:47:002
586300993331,1cyclictest0-21swapper/107:16:001
586300993327,4cyclictest598041-21kworker/u8:2+events_unbound07:45:141
586304993230,1cyclictest0-21swapper/311:05:593
586304993129,1cyclictest0-21swapper/311:11:583
586304993129,1cyclictest0-21swapper/310:47:003
58630299310,29cyclictest0-21swapper/210:30:142
58630099310,29cyclictest626979-21munin-plugin-st09:15:001
586304993025,4cyclictest660464-21turbostat10:59:593
58630499300,2cyclictest676914-21turbostat11:49:593
58630499300,28cyclictest0-21swapper/312:10:143
58630299300,2cyclictest0-21swapper/208:55:032
58630299300,28cyclictest0-21swapper/211:40:132
58630299300,28cyclictest0-21swapper/211:40:132
58630299300,28cyclictest0-21swapper/210:00:112
58630299300,28cyclictest0-21swapper/209:15:132
58630299300,28cyclictest0-21swapper/208:20:182
58630299300,28cyclictest0-21swapper/207:25:132
58630299300,27cyclictest0-21swapper/212:10:132
58630299300,1cyclictest0-21swapper/212:25:002
4577091300,10ptp4l441ktimers/309:25:003
586304992926,2cyclictest0-21swapper/307:40:013
58630499290,27cyclictest0-21swapper/310:00:113
58630499290,27cyclictest0-21swapper/309:15:133
58630499290,27cyclictest0-21swapper/308:20:183
58630499290,26cyclictest0-21swapper/307:25:123
586302992925,2cyclictest0-21swapper/207:40:122
58630299290,28cyclictest0-21swapper/207:40:012
58630299290,27cyclictest0-21swapper/211:50:132
58630299290,27cyclictest0-21swapper/208:40:122
58630299290,27cyclictest0-21swapper/207:15:132
586304992825,2cyclictest0-21swapper/311:00:133
58630499280,2cyclictest594331-21turbostat07:35:003
58630499280,27cyclictest0-21swapper/311:15:143
58630499280,27cyclictest0-21swapper/308:48:593
58630499280,27cyclictest0-21swapper/307:40:133
58630499280,26cyclictest0-21swapper/310:30:143
58630499280,26cyclictest0-21swapper/308:55:023
58630499280,21cyclictest0-21swapper/308:40:123
586302992825,2cyclictest0-21swapper/211:15:152
586302992825,2cyclictest0-21swapper/211:00:122
586302992825,2cyclictest0-21swapper/211:00:002
586302992825,2cyclictest0-21swapper/209:14:592
58630299280,27cyclictest0-21swapper/208:48:592
58630299280,26cyclictest0-21swapper/208:00:442
4577091280,6ptp4l441ktimers/311:50:013
4577091280,6ptp4l441ktimers/307:55:003
4577091280,5ptp4l441ktimers/310:15:013
58630499270,26cyclictest0-21swapper/308:13:003
58630499270,26cyclictest0-21swapper/308:12:593
586302992724,2cyclictest0-21swapper/207:54:012
586295992717,7cyclictest586084-21latency_hist07:10:020
4577091270,7ptp4l61490irq/134-eno1-TxRx-010:24:563
4577091270,7ptp4l61490irq/134-eno1-TxRx-010:24:563
4577091270,7ptp4l441ktimers/308:54:563
4577091270,6ptp4l61490irq/134-eno1-TxRx-010:09:593
4577091270,6ptp4l441ktimers/311:30:013
4577091270,6ptp4l441ktimers/310:55:013
4577091270,6ptp4l441ktimers/310:40:003
4577091270,6ptp4l441ktimers/309:14:563
586304992623,2cyclictest0-21swapper/309:33:593
58630499260,2cyclictest689659-21turbostat12:30:003
58630499260,24cyclictest0-21swapper/308:00:453
58630499260,24cyclictest0-21swapper/307:55:093
586302992623,2cyclictest0-21swapper/210:21:592
586302992623,2cyclictest0-21swapper/210:21:592
586302992623,2cyclictest0-21swapper/210:05:132
586302992623,2cyclictest0-21swapper/208:31:552
586302992623,2cyclictest0-21swapper/208:27:592
586302992622,2cyclictest0-21swapper/212:25:592
586302992622,2cyclictest0-21swapper/209:33:592
58630299260,24cyclictest0-21swapper/207:56:072
58630299260,18cyclictest0-21swapper/208:11:312
58630299260,18cyclictest0-21swapper/208:11:312
4577091260,7ptp4l61490irq/134-eno1-TxRx-008:30:003
4577091260,6ptp4l61490irq/134-eno1-TxRx-011:40:013
4577091260,6ptp4l441ktimers/307:14:543
4577091260,5ptp4l441ktimers/310:00:013
586304992523,1cyclictest0-21swapper/308:31:563
58630499250,24cyclictest0-21swapper/309:09:183
586302992522,2cyclictest0-21swapper/210:39:592
586302992522,2cyclictest0-21swapper/209:35:122
4577091250,6ptp4l61490irq/134-eno1-TxRx-012:04:553
4577091250,5ptp4l61490irq/134-eno1-TxRx-009:04:553
4577091250,5ptp4l441ktimers/312:09:553
4577091250,4ptp4l441ktimers/312:39:563
586302992421,2cyclictest0-21swapper/208:54:592
586302992420,2cyclictest0-21swapper/212:09:552
4577091240,4ptp4l441ktimers/312:34:563
586304992321,1cyclictest0-21swapper/309:35:123
586302992320,2cyclictest0-21swapper/209:55:122
586302992320,2cyclictest0-21swapper/209:07:572
586302992320,2cyclictest0-21swapper/207:10:142
586302992319,2cyclictest0-21swapper/210:54:592
4577091230,4ptp4l61490irq/134-eno1-TxRx-008:39:553
586302992220,1cyclictest0-21swapper/212:34:582
586302992219,2cyclictest0-21swapper/207:30:162
586302992218,2cyclictest0-21swapper/212:18:592
586302992118,2cyclictest0-21swapper/210:11:162
231999210,12rtkit-daemon291-21systemd-udevd07:05:561
586302992017,2cyclictest0-21swapper/211:49:552
586302992017,2cyclictest0-21swapper/208:39:002
586302991814,2cyclictest0-21swapper/209:02:592
586302991713,2cyclictest0-21swapper/211:29:002
586302991210,1cyclictest0-21swapper/211:39:582
58630299119,1cyclictest0-21swapper/212:40:002
5863029996,2cyclictest0-21swapper/212:02:002
5863029970,6cyclictest0-21swapper/209:20:502
5863029940,3cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional