You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 22:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Wed Jul 15, 2026 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
513599137127,7cyclictest14655-21latency_hist07:40:021
513599130120,7cyclictest1213033-21systemd-journal11:19:591
513199124113,8cyclictest21267-21latency_hist08:00:020
513599122112,7cyclictest68497-21kworker/u8:3+flush-179:010:45:011
513199122112,7cyclictest66895-21latency_hist10:20:010
513199122110,9cyclictest91321-21latency_hist11:35:020
513599121112,6cyclictest8201-21latency_hist07:20:021
513199119105,11cyclictest1213033-21systemd-journal08:15:000
513199116103,10cyclictest24468-21apt-get08:10:000
513199116102,12cyclictest68512-21http10:25:010
513199116102,11cyclictest1213033-21systemd-journal10:50:010
513599113107,4cyclictest29497-21latency_hist08:25:011
513199112103,6cyclictest191rcuc/010:45:010
513599111101,7cyclictest12942-21latency_hist07:35:001
51319910696,8cyclictest102479-21apt-get12:09:590
5131999992,5cyclictest37428-21kworker/u8:1+flush-179:009:25:150
5135999788,6cyclictest60525-21latency_hist10:00:001
5131999692,3cyclictest92895-21kworker/u8:0+flush-179:011:45:260
5131999691,4cyclictest105890-21kworker/u8:0+flush-179:012:20:240
5135999386,5cyclictest81762-21kworker/u8:1+flush-179:011:05:181
5135999383,7cyclictest1213033-21systemd-journal09:55:001
5135999281,8cyclictest1213033-21systemd-journal08:50:001
5131999281,8cyclictest57333-21latency_hist09:50:000
5131999079,9cyclictest1213033-21systemd-journal12:20:010
5131998777,7cyclictest73817-21latency_hist10:40:000
5135998678,6cyclictest4944-21kworker/u8:0+flush-179:007:50:231
5131998679,5cyclictest26557-21apt-get08:15:120
5131998474,6cyclictest1-21systemd09:55:000
5135998173,6cyclictest54156-21latency_hist09:40:011
5135998171,8cyclictest67150-21apt-get10:20:121
5131998171,7cyclictest65285-21latency_hist10:15:010
5135998074,4cyclictest94490-21kworker/u8:3+flush-179:011:55:001
5131998071,7cyclictest89722-21kworker/u8:2+flush-179:011:30:000
5131997968,9cyclictest91575-21apt-get11:35:120
5131997968,9cyclictest91575-21apt-get11:35:110
5131997871,6cyclictest44907-21kworker/u8:2+events_unbound09:20:010
5135997768,6cyclictest42746-21latency_hist09:05:011
5131997768,7cyclictest1213033-21systemd-journal09:25:000
5131997765,9cyclictest1213033-21systemd-journal08:30:000
5135997667,7cyclictest9770-21latency_hist07:25:011
5131997669,5cyclictest83368-21latency_hist11:10:000
5131997666,7cyclictest77529-21kworker/u8:1+flush-179:010:50:170
5135997565,5cyclictest1-21systemd07:50:011
5135997564,8cyclictest24439-21kworker/u8:2+flush-179:008:30:121
5135997563,9cyclictest39041-21apt-get08:55:011
5135997563,9cyclictest39041-21apt-get08:55:001
513599752,68cyclictest1-21systemd08:30:001
5131997466,6cyclictest4944-21kworker/u8:0+flush-179:007:45:150
5131997365,6cyclictest78840-21apt-get10:55:130
5135997264,6cyclictest100909-21kworker/u8:1+events_unbound12:20:001
5135997260,11cyclictest100909-21kworker/u8:1+flush-179:012:11:401
5131997262,8cyclictest93184-21apt-get11:40:120
5135997158,10cyclictest1213033-21systemd-journal10:15:001
5135997067,2cyclictest81762-21kworker/u8:1+events_unbound11:25:231
5135997063,5cyclictest92895-21kworker/u8:0+flush-179:012:00:011
5135997049,18cyclictest107501-21kworker/u8:2+flush-179:012:30:201
5131997062,6cyclictest4963-21latency_hist07:10:030
5131997059,9cyclictest4944-21kworker/u8:0+flush-179:007:40:220
5135996965,2cyclictest714-21Xorg10:15:591
5135996962,5cyclictest68458-21kworker/u8:0+flush-179:010:25:171
5135996960,6cyclictest44907-21kworker/u8:2+flush-179:009:30:141
5136996736,2cyclictest0-21swapper/210:48:592
5135996759,6cyclictest54121-21kworker/u8:3+flush-179:009:45:171
5135996661,4cyclictest4944-21kworker/u8:0+flush-179:007:55:161
5135996658,6cyclictest97719-21kworker/u8:2+flush-179:012:05:251
5138996535,1cyclictest0-21swapper/310:48:593
5135996556,7cyclictest54121-21kworker/u8:3+flush-179:009:45:001
5131996560,4cyclictest37428-21kworker/u8:1+flush-179:009:15:010
5131996557,5cyclictest24439-21kworker/u8:2+flush-179:008:40:010
5131996556,7cyclictest44907-21kworker/u8:2+flush-179:009:35:220
5135996457,5cyclictest29473-21kworker/u8:0+flush-179:008:40:181
5131996457,5cyclictest54121-21kworker/u8:3+flush-179:010:00:130
5131996357,5cyclictest80148-21kworker/u8:2+flush-179:011:10:170
5135996257,3cyclictest44907-21kworker/u8:2+flush-179:009:20:261
5135996254,6cyclictest24458-21latency_hist08:10:011
5135996249,12cyclictest92895-21kworker/u8:0+flush-179:012:05:001
5131996257,4cyclictest4954-21kworker/u8:2+flush-179:007:10:170
5135996154,6cyclictest86526-21kworker/u8:0+flush-179:011:20:251
5135996147,13cyclictest54121-21kworker/u8:3+flush-179:010:08:561
5131996153,6cyclictest42651-21kworker/u8:0+flush-179:009:05:230
5131996152,7cyclictest86526-21kworker/u8:0+flush-179:011:20:220
5131996050,7cyclictest70363-21apt-get10:29:470
5135995927,24cyclictest0-21swapper/110:48:581
5131995952,6cyclictest54121-21kworker/u8:3+flush-179:010:05:260
5131995853,4cyclictest37428-21kworker/u8:1+flush-179:008:50:190
5131995853,4cyclictest37428-21kworker/u8:1+flush-179:008:50:190
5131995851,5cyclictest19913-21kworker/u8:1+flush-179:008:00:220
5131995850,5cyclictest109097-21latency_hist12:30:020
5131995850,5cyclictest109097-21latency_hist12:30:010
5131995846,10cyclictest4944-21kworker/u8:0+flush-179:007:35:170
5131995846,10cyclictest36404-21diskstats08:45:160
5135995746,8cyclictest68497-21kworker/u8:3+flush-179:010:30:191
5131995750,5cyclictest1213033-21systemd-journal12:40:000
5135995648,6cyclictest80430-21/usr/sbin/munin11:00:211
5135995645,9cyclictest24972-21apt-get08:10:111
5135995549,4cyclictest109142-21kworker/u8:3+events_unbound12:40:001
5135995546,7cyclictest510-21rs:main1
5135995344,7cyclictest92895-21kworker/u8:0+flush-179:011:40:011
5135995344,7cyclictest92895-21kworker/u8:0+flush-179:011:40:001
5131995350,2cyclictest44907-21kworker/u8:2+flush-179:009:40:210
5131995343,8cyclictest39014-21kworker/u8:2+flush-179:009:00:210
5135995242,7cyclictest39014-21kworker/u8:2+events_unbound08:55:151
5131995248,3cyclictest81762-21kworker/u8:1+flush-179:011:17:210
5131995247,4cyclictest24505-21kworker/u8:3+flush-179:008:40:110
5131995246,5cyclictest68497-21kworker/u8:3+flush-179:010:30:140
5135995146,4cyclictest96078-21kworker/u8:1+events_unbound11:50:001
5131995142,7cyclictest99530-21/usr/sbin/munin12:00:180
5131995140,9cyclictest4944-21kworker/u8:0+flush-179:007:20:230
5135995044,5cyclictest81762-21kworker/u8:1+flush-179:011:30:271
5135995044,5cyclictest105890-21kworker/u8:0+flush-179:012:20:221
5135994941,6cyclictest4954-21kworker/u8:2+flush-179:007:25:151
5131994945,3cyclictest4944-21kworker/u8:0+flush-179:007:30:260
4577091490,13ptp4l441ktimers/307:10:023
513899480,5cyclictest110698-21turbostat12:35:003
5135994743,3cyclictest4944-21kworker/u8:0+flush-179:007:40:211
5135994741,4cyclictest37428-21kworker/u8:1+flush-179:009:25:211
5131994738,7cyclictest99274-21latency_hist12:00:010
5131994738,7cyclictest19431-21apt-get07:55:000
5131994535,8cyclictest1213033-21systemd-journal12:35:010
513899440,35cyclictest0-21swapper/310:37:593
513699440,42cyclictest0-21swapper/209:27:592
5135994438,4cyclictest1-21systemd07:15:001
5135994417,14cyclictest22330-21ntp_states08:00:221
5135994341,1cyclictest44333-21latency_hist09:10:011
5135994338,2cyclictest93184-21apt-get11:40:141
5135994337,5cyclictest81762-21kworker/u8:1+flush-179:011:15:011
5138994135,5cyclictest0-21swapper/308:07:583
513699410,2cyclictest0-21swapper/209:09:552
513699410,1cyclictest0-21swapper/210:38:002
5131994137,3cyclictest97719-21kworker/u8:2+flush-179:012:14:550
5131994134,5cyclictest44907-21kworker/u8:2+flush-179:009:30:150
5131994131,8cyclictest1213033-21systemd-journal07:25:010
513899400,37cyclictest0-21swapper/308:16:593
5136994036,2cyclictest0-21swapper/208:23:592
5136994034,4cyclictest0-21swapper/209:56:592
5135994028,9cyclictest68497-21kworker/u8:3+flush-179:010:50:161
5131994035,3cyclictest81797-21awk11:05:000
513899390,5cyclictest29513-21turbostat08:25:003
513899390,37cyclictest0-21swapper/308:47:593
513899390,37cyclictest0-21swapper/308:28:593
513699390,36cyclictest0-21swapper/210:13:592
513699390,36cyclictest0-21swapper/208:47:592
513699390,30cyclictest0-21swapper/208:28:592
513699390,2cyclictest0-21swapper/208:16:592
5135993936,2cyclictest714-21Xorg10:38:001
5131993936,2cyclictest0-21swapper/009:56:000
5131993934,4cyclictest4944-21kworker/u8:0+events_unbound07:15:250
513199390,37cyclictest40899-21grep09:00:000
513699380,35cyclictest0-21swapper/209:45:592
5135993832,5cyclictest54121-21kworker/u8:3+flush-179:010:00:221
5135993815,8cyclictest33637-21grep08:35:201
5138993734,1cyclictest0-21swapper/307:24:593
513899370,35cyclictest0-21swapper/312:03:593
5136993733,2cyclictest0-21swapper/211:45:592
5135993733,3cyclictest0-21swapper/109:15:591
5135993720,12cyclictest0-21swapper/110:58:001
231999370,3rtkit-daemon2318-21rtkit-daemon11:52:160
5138993634,1cyclictest0-21swapper/312:05:583
5138993633,2cyclictest0-21swapper/311:45:593
5138993633,2cyclictest0-21swapper/309:56:593
513899360,1cyclictest0-21swapper/309:46:583
5136993634,1cyclictest0-21swapper/207:24:592
513699360,2cyclictest0-21swapper/212:03:582
5136993532,1cyclictest0-21swapper/209:54:592
5136993530,2cyclictest0-21swapper/211:44:552
5135993532,2cyclictest714-21Xorg08:16:591
5138993432,1cyclictest0-21swapper/309:55:003
513699340,2cyclictest0-21swapper/209:20:142
513699340,27cyclictest0-21swapper/208:10:132
513899330,27cyclictest0-21swapper/309:20:143
513699330,2cyclictest0-21swapper/210:40:592
513599339,9cyclictest107519-21turbostat.cron12:29:561
513599339,9cyclictest107519-21turbostat.cron12:29:561
5136993228,2cyclictest0-21swapper/210:59:552
5136993225,6cyclictest0-21swapper/211:30:142
5131993227,4cyclictest31752-21gltestperf08:30:140
5131993226,4cyclictest29499-21munin-run08:25:000
5138993129,1cyclictest0-21swapper/307:29:553
5138993128,2cyclictest0-21swapper/311:44:563
5138993125,5cyclictest0-21swapper/310:29:493
513899310,30cyclictest0-21swapper/308:10:133
513899310,27cyclictest0-21swapper/311:35:143
513899310,27cyclictest0-21swapper/311:35:133
5136993127,2cyclictest0-21swapper/208:54:592
5136993127,2cyclictest0-21swapper/208:54:592
5136993124,6cyclictest0-21swapper/208:55:592
513699310,2cyclictest0-21swapper/210:29:482
5138993027,2cyclictest0-21swapper/310:59:563
5138993026,2cyclictest0-21swapper/307:37:583
5138993024,5cyclictest0-21swapper/311:30:153
513899300,28cyclictest0-21swapper/312:10:023
513899300,28cyclictest0-21swapper/308:55:133
513899300,1cyclictest0-21swapper/309:29:593
5136993026,2cyclictest0-21swapper/211:57:592
5136993026,2cyclictest0-21swapper/207:37:582
513699300,1cyclictest0-21swapper/211:35:142
513699300,1cyclictest0-21swapper/211:35:142
4577091300,7ptp4l441ktimers/307:15:013
5138992928,1cyclictest0-21swapper/311:28:593
5138992927,1cyclictest0-21swapper/307:47:593
513899290,27cyclictest0-21swapper/310:40:153
513899290,27cyclictest0-21swapper/310:30:593
5136992925,3cyclictest0-21swapper/208:00:142
5136992925,2cyclictest0-21swapper/212:05:142
5136992925,2cyclictest0-21swapper/211:10:132
5136992925,2cyclictest0-21swapper/211:05:162
5136992925,2cyclictest0-21swapper/209:31:592
5136992925,2cyclictest0-21swapper/207:55:012
513699290,2cyclictest0-21swapper/210:20:132
513699290,2cyclictest0-21swapper/208:40:132
513699290,27cyclictest0-21swapper/212:10:022
513699290,27cyclictest0-21swapper/211:50:132
513699290,27cyclictest0-21swapper/209:40:132
513699290,27cyclictest0-21swapper/207:15:132
5138992826,1cyclictest0-21swapper/311:05:153
5138992826,1cyclictest0-21swapper/308:54:593
5138992826,1cyclictest0-21swapper/308:54:593
5138992826,1cyclictest0-21swapper/308:40:133
5138992826,1cyclictest0-21swapper/308:00:133
5138992825,2cyclictest0-21swapper/311:57:593
5138992825,2cyclictest0-21swapper/309:12:593
513899280,27cyclictest0-21swapper/311:50:123
513899280,27cyclictest0-21swapper/311:10:133
513899280,27cyclictest0-21swapper/309:00:123
513899280,27cyclictest0-21swapper/308:38:593
513899280,27cyclictest0-21swapper/307:55:023
513899280,26cyclictest0-21swapper/309:40:133
513899280,1cyclictest0-21swapper/310:20:133
5136992825,2cyclictest0-21swapper/209:36:592
5136992824,2cyclictest0-21swapper/208:38:592
5136992824,2cyclictest0-21swapper/207:45:132
5136992823,2cyclictest0-21swapper/211:01:592
513699280,2cyclictest0-21swapper/210:30:592
513699280,26cyclictest0-21swapper/209:00:122
513699280,25cyclictest0-21swapper/207:42:592
4577091280,6ptp4l441ktimers/311:20:003
4577091280,6ptp4l441ktimers/309:09:553
4577091280,5ptp4l441ktimers/307:45:023
5138992725,1cyclictest0-21swapper/310:11:003
5138992724,2cyclictest0-21swapper/309:36:593
5138992724,2cyclictest0-21swapper/309:31:593
5138992722,3cyclictest0-21swapper/307:53:583
513899270,26cyclictest0-21swapper/308:34:593
513899270,1cyclictest0-21swapper/312:37:593
513899270,1cyclictest0-21swapper/309:18:593
5136992723,2cyclictest0-21swapper/211:15:122
5136992723,2cyclictest0-21swapper/207:53:582
513699270,25cyclictest0-21swapper/209:13:592
513699270,1cyclictest0-21swapper/212:34:582
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:25:013
4577091270,6ptp4l441ktimers/310:55:003
4577091270,5ptp4l441ktimers/310:09:563
5136992623,2cyclictest0-21swapper/212:16:582
5136992622,2cyclictest0-21swapper/212:38:002
5136992622,2cyclictest0-21swapper/212:20:592
5136992622,2cyclictest0-21swapper/210:04:552
513699260,2cyclictest0-21swapper/211:28:592
513699260,2cyclictest0-21swapper/209:18:592
513699260,24cyclictest0-21swapper/208:34:592
4577091260,5ptp4l441ktimers/307:34:563
5138992523,1cyclictest0-21swapper/312:16:593
5138992523,1cyclictest0-21swapper/310:02:593
5138992522,2cyclictest0-21swapper/311:01:593
5135992516,7cyclictest5143-21latency_hist07:10:021
4577091250,5ptp4l441ktimers/311:24:543
4577091250,5ptp4l441ktimers/310:19:563
5136992421,2cyclictest0-21swapper/210:10:002
4577091240,5ptp4l61490irq/134-eno1-TxRx-007:14:553
5136992320,2cyclictest0-21swapper/207:25:592
5136992219,2cyclictest0-21swapper/208:05:592
5136992017,2cyclictest0-21swapper/211:20:592
513699199,8cyclictest0-21swapper/210:16:592
5136991714,2cyclictest0-21swapper/210:53:002
5136991714,2cyclictest0-21swapper/207:34:562
4577091160,3ptp4l441ktimers/312:25:143
4577091160,3ptp4l441ktimers/312:25:143
5136991410,3cyclictest0-21swapper/212:25:592
5136991410,3cyclictest0-21swapper/212:25:592
513699110,2cyclictest0-21swapper/207:10:152
513699110,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional