You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 22:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Sat Nov 29, 2025 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
380230999987,9cyclictest480211-21latency_hist12:20:001
380230999685,8cyclictest271-21systemd-journal12:40:001
380230998883,4cyclictest425316-21kworker/u8:3+events_unbound09:45:251
380230998480,3cyclictest425316-21kworker/u8:3+flush-179:009:50:261
380230998479,4cyclictest444710-21kworker/u8:4+events_unbound10:30:251
380230998479,4cyclictest444710-21kworker/u8:4+events_unbound10:30:251
380230998479,4cyclictest435128-21kworker/u8:1+events_unbound10:00:231
380230998477,5cyclictest411204-21kworker/u8:1+events_unbound09:35:021
380228998480,3cyclictest411204-21kworker/u8:1+events_unbound09:20:250
380228998378,4cyclictest411204-21kworker/u8:1+events_unbound09:25:260
380230998171,5cyclictest476676-21kworker/u8:1+events_unbound12:30:191
380228998171,7cyclictest485243-21latency_hist12:35:020
380228998076,3cyclictest462747-21kworker/u8:3+events_unbound12:10:210
380230997970,7cyclictest438289-21kworker/u8:0+flush-179:010:25:011
380230997969,4cyclictest431935-21kworker/u8:2+events_unbound10:10:251
380230997873,4cyclictest407757-21kworker/u8:0+flush-179:008:35:251
380230997671,4cyclictest425316-21kworker/u8:3+events_unbound09:40:231
380230997667,4cyclictest378641-21kworker/u8:2+events_unbound07:15:231
380230997571,3cyclictest386415-21kworker/u8:3+events_unbound08:15:241
38022899751,70cyclictest1-21systemd10:45:000
380230997267,4cyclictest480257-21kworker/u8:0+events_unbound12:20:221
380230997163,6cyclictest444710-21kworker/u8:4+flush-179:010:45:001
380230997060,7cyclictest459518-21latency_hist11:15:001
380230997060,3cyclictest462747-21kworker/u8:3+events_unbound12:05:281
380230997059,8cyclictest392944-21latency_hist07:50:001
380228997059,9cyclictest415999-21apt-get09:00:130
380228996863,4cyclictest444710-21kworker/u8:4+events_unbound10:50:220
380230996763,3cyclictest447767-21kworker/u8:1+flush-179:010:50:171
380230996763,3cyclictest386415-21kworker/u8:3+events_unbound08:10:271
380230996662,3cyclictest392931-21kworker/u8:1+events_unbound07:55:201
380230996660,4cyclictest381713-21latency_hist07:15:011
380230996660,4cyclictest381713-21latency_hist07:15:001
380228996662,2cyclictest723-21Xorg11:22:000
380228996662,2cyclictest723-21Xorg11:22:000
38022899650,63cyclictest723-21Xorg12:04:590
4670791640,18ptp4l61690irq/136-eno1-TxRx-007:05:473
380230996460,3cyclictest462747-21kworker/u8:3+flush-179:011:35:161
380230996460,3cyclictest392931-21kworker/u8:1+events_unbound08:04:561
380230996459,4cyclictest462747-21kworker/u8:3+flush-179:011:40:291
380230996456,3cyclictest407759-21kworker/u8:2+events_unbound09:00:201
380228996455,3cyclictest389735-21kworker/u8:0+events_unbound07:41:300
380236996359,2cyclictest0-21swapper/310:36:593
380234996359,2cyclictest0-21swapper/210:36:592
380230996359,3cyclictest281ktimers/112:05:001
380228996359,3cyclictest425316-21kworker/u8:3+flush-179:009:59:550
380228996359,3cyclictest401185-21kworker/u8:1+events_unbound08:30:260
380228996359,3cyclictest401185-21kworker/u8:1+events_unbound08:30:250
380228996358,4cyclictest411204-21kworker/u8:1+events_unbound09:15:250
380228996358,4cyclictest411204-21kworker/u8:1+events_unbound09:05:280
380228996358,4cyclictest407757-21kworker/u8:0+events_unbound08:35:200
380228996258,3cyclictest386415-21kworker/u8:3+events_unbound07:35:030
380228996256,4cyclictest467537-21kworker/u8:0+events_unbound11:45:150
380228996256,4cyclictest467537-21kworker/u8:0+events_unbound11:45:140
380230996156,4cyclictest411204-21kworker/u8:1+flush-179:009:05:241
380228996155,5cyclictest438289-21kworker/u8:0+flush-179:010:35:250
380228996153,3cyclictest435128-21kworker/u8:1+events_unbound10:15:180
380230996056,3cyclictest409416-21kworker/u8:3+events_unbound08:50:151
380230996055,4cyclictest411204-21kworker/u8:1+events_unbound09:10:161
380228996057,2cyclictest723-21Xorg09:46:590
380228996056,3cyclictest431935-21kworker/u8:2+events_unbound10:20:280
380228996054,4cyclictest411204-21kworker/u8:1+flush-179:009:15:010
380230995956,3cyclictest411204-21kworker/u8:1+events_unbound09:15:231
380230995956,3cyclictest401185-21kworker/u8:1+events_unbound08:20:181
380230995955,3cyclictest467537-21kworker/u8:0+flush-179:011:54:541
380230995955,3cyclictest444710-21kworker/u8:4+events_unbound11:05:201
380230995948,9cyclictest405928-21latency_hist08:30:011
380230995943,12cyclictest411204-21kworker/u8:1+events_unbound08:45:171
380228995951,6cyclictest271-21systemd-journal09:30:190
380230995853,4cyclictest415777-21kworker/u8:0+flush-179:009:55:291
380230995853,4cyclictest392931-21kworker/u8:1+flush-179:007:50:271
380230995849,3cyclictest431935-21kworker/u8:2+events_unbound10:25:181
380230995849,3cyclictest431935-21kworker/u8:2+events_unbound10:05:211
380228995854,3cyclictest411204-21kworker/u8:1+events_unbound08:50:280
380228995853,4cyclictest425316-21kworker/u8:3+events_unbound09:39:180
380228995852,5cyclictest447767-21kworker/u8:1+flush-179:010:45:260
380228995846,10cyclictest444692-21apt-get10:30:000
380230995752,4cyclictest447767-21kworker/u8:1+flush-179:011:15:281
380230995752,4cyclictest411204-21kworker/u8:1+flush-179:009:30:191
380228995753,3cyclictest447767-21kworker/u8:1+events_unbound11:15:210
380230995652,3cyclictest447767-21kworker/u8:1+flush-179:010:45:251
380228995652,3cyclictest467537-21kworker/u8:0+events_unbound11:50:290
380228995652,3cyclictest454536-21kworker/u8:2+events_unbound11:25:200
380228995652,3cyclictest392931-21kworker/u8:1+events_unbound08:01:070
380230995551,3cyclictest476676-21kworker/u8:1+flush-179:012:25:291
380228995551,3cyclictest425316-21kworker/u8:3+events_unbound09:53:190
380228995550,4cyclictest431935-21kworker/u8:2+events_unbound10:10:030
380230995451,2cyclictest0-21swapper/111:22:001
380230995451,2cyclictest0-21swapper/111:21:591
380230995450,3cyclictest462747-21kworker/u8:3+flush-179:011:55:141
380228995450,3cyclictest447767-21kworker/u8:1+events_unbound11:00:530
380228995446,6cyclictest404599-21apt-get08:25:130
380230995349,3cyclictest398010-21kworker/u8:2+flush-179:008:05:271
380230995349,3cyclictest398010-21kworker/u8:2+flush-179:008:05:271
380230995348,4cyclictest444710-21kworker/u8:4+events_unbound10:57:221
380230995348,4cyclictest415777-21kworker/u8:0+events_unbound09:20:031
380228995349,3cyclictest467537-21kworker/u8:0+events_unbound11:56:210
380228995349,3cyclictest425316-21kworker/u8:3+events_unbound10:07:220
380228995349,3cyclictest411204-21kworker/u8:1+events_unbound08:55:230
380228995349,3cyclictest401185-21kworker/u8:1+events_unbound08:24:220
380230995248,3cyclictest462747-21kworker/u8:3+events_unbound12:11:001
380230995248,3cyclictest388062-21kworker/u8:1+flush-179:007:35:301
380228995246,5cyclictest447767-21kworker/u8:1+flush-179:010:55:250
380230995147,3cyclictest367682-21kworker/u8:1+events_unbound07:20:291
380230995146,4cyclictest378641-21kworker/u8:2+events_unbound07:25:271
380228995147,3cyclictest476676-21kworker/u8:1+events_unbound12:16:210
380228995147,3cyclictest392931-21kworker/u8:1+events_unbound07:48:300
380228995147,3cyclictest386415-21kworker/u8:3+events_unbound07:53:320
380228995147,3cyclictest386415-21kworker/u8:3+events_unbound07:33:310
380228995146,4cyclictest480257-21kworker/u8:0+events_unbound12:22:190
380228995146,4cyclictest447767-21kworker/u8:1+events_unbound11:10:280
380228995146,4cyclictest415777-21kworker/u8:0+events_unbound09:44:190
380230995046,3cyclictest462747-21kworker/u8:3+events_unbound11:45:251
380230995046,3cyclictest462747-21kworker/u8:3+events_unbound11:45:251
380230995046,3cyclictest383682-21kworker/u8:0+events_unbound07:31:291
380228995046,3cyclictest462747-21kworker/u8:3+events_unbound11:42:210
380228995046,3cyclictest444710-21kworker/u8:4+events_unbound10:32:220
380228995046,3cyclictest444710-21kworker/u8:4+events_unbound10:32:220
380230994940,3cyclictest444710-21kworker/u8:4+events_unbound11:00:151
380228994945,3cyclictest400615-21kworker/u8:0+events_unbound08:14:220
380228994944,4cyclictest367682-21kworker/u8:1+events_unbound07:20:020
380228994944,3cyclictest383682-21kworker/u8:0+events_unbound07:30:010
38023699482,44cyclictest452901-21turbostat10:59:553
380230994844,3cyclictest462747-21kworker/u8:3+events_unbound11:30:221
380230994844,3cyclictest447767-21kworker/u8:1+flush-179:010:39:551
380230994844,3cyclictest411204-21kworker/u8:1+events_unbound09:25:181
380230994843,4cyclictest435128-21kworker/u8:1+flush-179:010:17:201
380228994844,3cyclictest454536-21kworker/u8:2+events_unbound11:39:220
380230994744,3cyclictest407757-21kworker/u8:0+events_unbound08:40:181
380228994641,4cyclictest386415-21kworker/u8:3+events_unbound07:59:430
38023699450,4cyclictest464307-21turbostat11:29:593
38023699450,1cyclictest0-21swapper/312:10:003
380230994541,3cyclictest407759-21kworker/u8:2+events_unbound08:58:191
380230994541,3cyclictest386415-21kworker/u8:3+events_unbound07:40:301
380228994541,3cyclictest476676-21kworker/u8:1+events_unbound12:06:210
380228994541,3cyclictest409416-21kworker/u8:3+events_unbound08:48:180
380228994541,3cyclictest407757-21kworker/u8:0+events_unbound08:41:170
380228994541,3cyclictest378641-21kworker/u8:2+events_unbound07:15:010
38023499440,2cyclictest0-21swapper/211:12:592
380230994340,3cyclictest386415-21kworker/u8:3+events_unbound08:30:161
380230994340,3cyclictest386415-21kworker/u8:3+events_unbound08:30:151
380228994338,4cyclictest444710-21kworker/u8:4+flush-179:011:05:290
38023499420,1cyclictest0-21swapper/210:59:562
380230994238,3cyclictest454536-21kworker/u8:2+events_unbound11:27:221
380228994239,3cyclictest392931-21kworker/u8:1+events_unbound08:05:020
380228994239,3cyclictest392931-21kworker/u8:1+events_unbound08:05:010
380228994227,5cyclictest486128-21missed_timers12:35:200
38022899420,41cyclictest0-21swapper/012:29:560
380236994135,5cyclictest436689-21turbostat10:09:553
38023699410,39cyclictest483671-21turbostat12:30:013
38023699410,39cyclictest412559-21turbostat08:50:003
38023699410,2cyclictest0-21swapper/311:12:593
380236994033,5cyclictest423705-21turbostat09:29:553
38023699400,5cyclictest435094-21turbostat10:00:003
38023699400,5cyclictest422110-21turbostat09:20:003
38023699400,5cyclictest410981-21turbostat08:45:003
38023699400,5cyclictest402759-21turbostat08:20:003
38023699400,38cyclictest457682-21turbostat11:10:003
380234994036,3cyclictest0-21swapper/208:26:002
380234994035,2cyclictest0-21swapper/210:46:582
380228994036,3cyclictest462747-21kworker/u8:3+events_unbound11:30:000
38023699390,37cyclictest0-21swapper/312:00:583
380234993935,2cyclictest0-21swapper/211:52:592
38023499390,36cyclictest0-21swapper/210:43:592
38023499390,36cyclictest0-21swapper/209:10:592
38023499390,36cyclictest0-21swapper/209:08:592
380236993836,1cyclictest0-21swapper/308:25:593
380236993835,2cyclictest0-21swapper/310:46:593
380236993834,2cyclictest0-21swapper/307:46:593
380236993833,4cyclictest397992-21turbostat08:05:003
38023699380,37cyclictest0-21swapper/311:55:003
38023699380,1cyclictest0-21swapper/311:19:553
380234993835,2cyclictest0-21swapper/210:01:592
380234993834,2cyclictest0-21swapper/207:46:582
38023499380,36cyclictest0-21swapper/212:00:592
38023499380,35cyclictest0-21swapper/210:15:002
38023499380,1cyclictest0-21swapper/209:24:592
380228993834,3cyclictest425316-21kworker/u8:3+events_unbound10:00:020
380228993834,3cyclictest386415-21kworker/u8:3+events_unbound08:18:220
380236993735,1cyclictest0-21swapper/308:53:593
380236993734,2cyclictest0-21swapper/310:01:593
380236993733,3cyclictest433496-21turbostat09:55:003
380234993734,2cyclictest0-21swapper/209:29:552
380234993734,2cyclictest0-21swapper/208:53:592
38023499370,35cyclictest0-21swapper/210:09:592
38023499370,2cyclictest0-21swapper/209:17:592
38023499370,2cyclictest0-21swapper/208:46:582
38023499370,1cyclictest0-21swapper/212:09:592
380236993631,4cyclictest444696-21turbostat10:30:003
38023699360,35cyclictest0-21swapper/309:08:593
38023699360,29cyclictest0-21swapper/310:43:583
38023699360,1cyclictest0-21swapper/309:24:593
380234993633,2cyclictest0-21swapper/209:55:002
380234993632,2cyclictest0-21swapper/212:34:562
38023499360,2cyclictest0-21swapper/211:19:562
380236993531,2cyclictest0-21swapper/307:54:563
38023699350,1cyclictest0-21swapper/309:10:593
380234993533,1cyclictest0-21swapper/208:05:002
380234993532,2cyclictest0-21swapper/207:29:552
380234993531,2cyclictest0-21swapper/208:09:002
380234993531,2cyclictest0-21swapper/208:08:592
380234993531,2cyclictest0-21swapper/207:54:562
380228993526,3cyclictest378641-21kworker/u8:2+events_unbound07:14:200
380228993526,3cyclictest378641-21kworker/u8:2+events_unbound07:14:190
380236993432,1cyclictest0-21swapper/312:34:563
380236993432,1cyclictest0-21swapper/307:29:553
380236993429,4cyclictest428737-21turbostat09:40:003
4670791330,5ptp4l441ktimers/309:50:003
380236993330,2cyclictest0-21swapper/308:09:003
380236993330,2cyclictest0-21swapper/308:08:593
380236993328,4cyclictest456097-21turbostat11:05:003
380236993327,5cyclictest396389-21turbostat08:00:003
380234993331,1cyclictest0-21swapper/210:30:012
380234993330,2cyclictest0-21swapper/211:29:552
380234993329,2cyclictest0-21swapper/209:56:592
380228993327,4cyclictest380105-21latency_hist07:10:010
380236993228,3cyclictest0-21swapper/307:34:593
380236993227,4cyclictest470672-21turbostat11:49:593
380236993227,4cyclictest470672-21turbostat11:49:593
380236993227,4cyclictest430324-21turbostat09:45:013
380234993228,2cyclictest0-21swapper/207:34:582
380234993228,1cyclictest0-21swapper/212:20:002
380234993129,1cyclictest0-21swapper/209:40:002
380234993128,2cyclictest0-21swapper/211:04:592
380234993128,2cyclictest0-21swapper/207:17:592
380236993027,2cyclictest0-21swapper/312:19:593
380236993027,2cyclictest0-21swapper/310:30:143
380236993027,2cyclictest0-21swapper/310:30:143
38023699300,28cyclictest0-21swapper/310:15:163
38023699300,27cyclictest0-21swapper/309:00:143
380234993027,2cyclictest0-21swapper/212:14:582
380234993027,2cyclictest0-21swapper/210:15:162
380234993027,2cyclictest0-21swapper/208:00:012
38023499300,2cyclictest0-21swapper/209:30:142
38023499300,28cyclictest0-21swapper/209:00:142
38023499300,28cyclictest0-21swapper/208:40:152
380236992927,1cyclictest0-21swapper/307:17:593
380236992926,2cyclictest0-21swapper/312:14:593
380234992927,1cyclictest0-21swapper/211:50:002
380234992927,1cyclictest0-21swapper/211:49:592
380234992926,2cyclictest0-21swapper/212:35:152
380234992926,2cyclictest0-21swapper/210:20:152
38023499290,2cyclictest0-21swapper/210:30:142
38023499290,2cyclictest0-21swapper/210:30:132
38023499290,2cyclictest0-21swapper/209:40:132
38023499290,2cyclictest0-21swapper/208:30:022
38023499290,2cyclictest0-21swapper/208:30:022
38023499290,28cyclictest0-21swapper/211:20:142
38023499290,28cyclictest0-21swapper/211:20:132
38023499290,26cyclictest0-21swapper/211:56:592
380236992826,1cyclictest0-21swapper/307:20:153
380236992825,2cyclictest0-21swapper/312:35:143
380236992825,2cyclictest0-21swapper/312:20:013
380236992825,2cyclictest0-21swapper/311:20:143
380236992825,2cyclictest0-21swapper/311:20:143
380236992825,2cyclictest0-21swapper/310:20:153
38023699280,2cyclictest0-21swapper/309:30:143
38023699280,27cyclictest0-21swapper/311:56:593
38023699280,27cyclictest0-21swapper/308:35:153
380234992825,2cyclictest0-21swapper/212:20:012
380234992825,2cyclictest0-21swapper/207:20:162
380234992824,2cyclictest0-21swapper/207:40:592
38023499280,2cyclictest0-21swapper/212:25:152
38023499280,26cyclictest0-21swapper/208:35:142
4670791270,7ptp4l441ktimers/308:15:003
4670791270,6ptp4l441ktimers/311:45:013
38023699270,1cyclictest0-21swapper/308:30:023
38023699270,1cyclictest0-21swapper/308:30:023
380234992725,1cyclictest0-21swapper/208:55:142
380236992624,1cyclictest0-21swapper/307:40:593
380236992623,2cyclictest0-21swapper/310:10:593
380236992622,3cyclictest0-21swapper/311:32:583
380234992623,2cyclictest0-21swapper/208:14:592
380234992622,2cyclictest0-21swapper/211:32:592
380230992621,4cyclictest0-21swapper/107:10:011
4670791250,6ptp4l441ktimers/310:55:013
4670791250,5ptp4l441ktimers/307:39:553
380236992523,1cyclictest0-21swapper/308:24:003
380236992523,1cyclictest0-21swapper/307:10:243
380236992523,1cyclictest0-21swapper/307:10:233
380234992523,1cyclictest0-21swapper/208:19:592
380234992522,2cyclictest0-21swapper/207:39:002
380234992522,2cyclictest0-21swapper/207:10:232
380234992522,2cyclictest0-21swapper/207:10:232
4670791240,5ptp4l441ktimers/311:39:563
4670791240,5ptp4l441ktimers/308:59:563
380234992421,2cyclictest0-21swapper/211:35:592
380234992219,2cyclictest0-21swapper/208:20:132
380234992017,2cyclictest0-21swapper/211:41:002
380234992017,2cyclictest0-21swapper/211:08:002
380234991814,2cyclictest0-21swapper/210:52:592
38023499100,2cyclictest0-21swapper/209:47:222
3802349930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional