You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 08:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Tue Dec 30, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332335499114104,7cyclictest3417140-40logrotate00:00:010
33233549910698,5cyclictest3391154-21latency_hist22:40:010
3323358999283,7cyclictest3410778-21latency_hist23:40:021
3323354998679,5cyclictest3413947-21kworker/u8:1+events_unbound23:50:000
3323358998478,5cyclictest3378387-21kworker/u8:1+flush-179:022:10:001
3323358998377,5cyclictest3321764-21kworker/u8:2+flush-179:019:40:001
3323358998175,5cyclictest3381030-21kworker/u8:2+flush-179:022:35:001
3323358997869,7cyclictest3347910-21latency_hist20:25:011
3323354997870,6cyclictest3334928-21apt-get19:45:000
3323358997671,3cyclictest3321764-21kworker/u8:2+events_unbound19:50:011
3323354997667,6cyclictest3376824-21latency_hist21:55:010
3323358997568,5cyclictest3321696-21kworker/u8:1+flush-179:019:20:001
3323358997469,3cyclictest3415534-21kworker/u8:2+events_unbound23:55:211
3323358997465,6cyclictest3362218-21kworker/u8:3+flush-179:021:50:211
3323354997462,10cyclictest266-21systemd-journal21:25:000
3323358997369,3cyclictest3381030-21kworker/u8:2+flush-179:022:10:261
3323358997263,7cyclictest3338581-21/usr/sbin/munin19:55:231
3323354997263,7cyclictest3383431-21/usr/sbin/munin22:15:220
3323354997262,8cyclictest3422216-21/usr/sbin/munin00:15:260
3323358997164,5cyclictest3372879-21kworker/u8:2+flush-179:021:45:001
3323358997162,7cyclictest3398829-21kworker/u8:0+flush-179:000:20:001
3323358997061,6cyclictest3370197-21latency_hist21:35:011
3323358996863,4cyclictest3351061-21kworker/u8:2+flush-179:020:50:241
3323358996863,4cyclictest3349474-21kworker/u8:0+flush-179:020:30:221
3323358996862,5cyclictest3381030-21kworker/u8:2+flush-179:022:39:551
3323358996860,6cyclictest3406000-21kworker/u8:1+flush-179:023:25:191
3323354996862,4cyclictest3396763-21kworker/u8:1+events_unbound23:00:010
3323354996862,4cyclictest3321764-21kworker/u8:2+flush-179:019:10:230
3323354996763,3cyclictest1-21systemd00:25:000
3323354996757,8cyclictest3351323-21/usr/sbin/munin20:35:240
3323358996659,5cyclictest3341785-21kworker/u8:1+flush-179:020:15:161
3323358996560,4cyclictest3413947-21kworker/u8:1+events_unbound00:00:251
3323358996556,7cyclictest3343363-21/usr/sbin/munin20:10:241
3323354996559,5cyclictest3383171-21kworker/u8:0+events_unbound22:30:000
3323354996555,7cyclictest3399383-21latency_hist23:05:010
3323358996460,2cyclictest714-21Xorg22:21:591
3323358996459,4cyclictest3398829-21kworker/u8:0+events_unbound23:25:001
3323354996455,7cyclictest3325066-21/usr/sbin/munin19:15:250
3323354996455,6cyclictest3383191-21latency_hist22:15:010
3323358996358,3cyclictest3420422-21kworker/u8:2+flush-179:000:25:211
3323358996256,5cyclictest3341785-21kworker/u8:1+flush-179:021:00:001
3323358996255,5cyclictest3398829-21kworker/u8:0+events_unbound00:40:001
3323358996249,4cyclictest3351061-21kworker/u8:2+events_unbound20:45:011
3323354996256,4cyclictest3336247-21kworker/u8:1+flush-179:019:55:220
3323358996156,4cyclictest3398829-21kworker/u8:0+flush-179:023:30:251
3323358996154,6cyclictest3351061-21kworker/u8:2+flush-179:021:05:001
3323358996153,6cyclictest3395927-21latency_hist22:55:011
3323354996156,3cyclictest3415534-21kworker/u8:2+flush-179:023:55:010
3323358996055,4cyclictest3375493-21kworker/u8:0+flush-179:021:59:561
3323358996055,4cyclictest3375493-21kworker/u8:0+flush-179:021:59:561
3323358996055,3cyclictest3392991-21kworker/u8:0+flush-179:022:55:011
3323354996056,3cyclictest3321764-21kworker/u8:2+flush-179:019:25:010
3323354996052,6cyclictest3357453-21latency_hist20:55:010
3323354995954,4cyclictest3321764-21kworker/u8:2+flush-179:020:17:100
3323358995848,8cyclictest3402808-21apt-get23:15:131
3323358995752,4cyclictest3381030-21kworker/u8:2+flush-179:023:00:221
3323358995752,4cyclictest3341785-21kworker/u8:1+flush-179:020:35:191
3323358995751,5cyclictest3362218-21kworker/u8:3+flush-179:021:10:211
3323354995752,3cyclictest3398829-21kworker/u8:0+flush-179:000:05:010
3323354995751,5cyclictest3420422-21kworker/u8:2+events_unbound00:30:260
3323354995649,5cyclictest3321764-21kworker/u8:2+flush-179:020:25:000
3323358995551,3cyclictest3398829-21kworker/u8:0+flush-179:000:10:241
3323358995549,4cyclictest3413947-21kworker/u8:1+flush-179:023:50:221
3323358995549,4cyclictest3378387-21kworker/u8:1+events_unbound22:05:011
3323354995549,4cyclictest3365418-21latency_hist21:20:010
3323354995544,9cyclictest3370451-21apt-get21:35:130
3323358995450,3cyclictest3351061-21kworker/u8:2+flush-179:021:05:211
3323358995449,4cyclictest3362218-21kworker/u8:3+flush-179:021:25:241
3323358995447,5cyclictest3389555-21kworker/u8:3+events_unbound22:40:151
3323358995439,4cyclictest3321696-21kworker/u8:1+events_unbound19:25:251
3323358995346,5cyclictest3341785-21kworker/u8:1+flush-179:020:10:001
3323358995344,7cyclictest3374977-21latency_hist21:50:011
3323358995343,6cyclictest3321764-21kworker/u8:2+flush-179:019:50:191
3323354995348,4cyclictest3398829-21kworker/u8:0+flush-179:023:25:220
3323354995347,5cyclictest3413947-21kworker/u8:1+flush-179:000:05:220
3323358995246,4cyclictest3381030-21kworker/u8:2+flush-179:023:05:201
3323354995247,4cyclictest3349474-21kworker/u8:0+events_unbound20:30:230
3323354995244,6cyclictest3333323-21latency_hist19:40:010
3323354995244,5cyclictest3368605-21latency_hist21:30:010
3323354995241,8cyclictest3351061-21kworker/u8:2+flush-179:020:40:170
3323358995145,5cyclictest3409222-21kworker/u8:2+flush-179:023:45:241
3323354995140,9cyclictest3420648-21apt-get00:10:140
3323358995040,7cyclictest3341541-21latency_hist20:05:021
3323354995045,4cyclictest3389555-21kworker/u8:3+flush-179:022:40:170
3323354995042,6cyclictest266-21systemd-journal23:11:310
3323354994943,5cyclictest3321764-21kworker/u8:2+events_unbound19:30:210
3323354994940,8cyclictest3377078-21apt-get21:55:130
3323354994940,8cyclictest3377078-21apt-get21:55:130
4577091480,13ptp4l441ktimers/319:10:003
3323358994843,4cyclictest3398829-21kworker/u8:0+flush-179:023:15:011
3323358994842,4cyclictest3321764-21kworker/u8:2+flush-179:019:30:001
3323358994743,3cyclictest3341785-21kworker/u8:1+flush-179:020:50:001
3323358994731,14cyclictest3420422-21kworker/u8:2+events_unbound00:35:001
3323354994741,5cyclictest3351061-21kworker/u8:2+flush-179:021:00:270
3323354994738,7cyclictest3373629-21/usr/sbin/munin21:45:220
332336399460,44cyclictest3397800-21turbostat23:00:003
3323354994641,4cyclictest3378387-21kworker/u8:1+flush-179:022:05:240
3323354994638,7cyclictest3398829-21kworker/u8:0+events_unbound23:45:000
3323358994537,6cyclictest3349500-21latency_hist20:30:011
3323354994540,4cyclictest3398829-21kworker/u8:0+flush-179:000:35:280
3323354994540,4cyclictest3321764-21kworker/u8:2+events_unbound19:50:250
3323363994338,4cyclictest3352677-21turbostat20:40:003
332336099430,40cyclictest0-21swapper/221:54:592
3323358994338,4cyclictest3321764-21kworker/u8:2+flush-179:019:24:561
3323354994338,4cyclictest3398829-21kworker/u8:0+flush-179:023:30:180
3323354994338,4cyclictest3392991-21kworker/u8:0+events_unbound22:50:230
3323363994239,2cyclictest0-21swapper/321:10:593
3323354994238,3cyclictest3375493-21kworker/u8:0+events_unbound22:00:240
332336399410,39cyclictest3333340-21turbostat19:40:003
3323358994135,5cyclictest3362218-21kworker/u8:3+flush-179:021:35:321
3323354994137,3cyclictest3409222-21kworker/u8:2+flush-179:023:35:210
3323354994135,4cyclictest3336759-21latency_hist19:50:010
3323354994133,7cyclictest3354535-21apt-get20:45:150
332335499410,39cyclictest3360667-21turbostat21:09:560
3323363994038,1cyclictest0-21swapper/320:26:003
332336399400,39cyclictest0-21swapper/300:17:003
3323358994035,4cyclictest3383171-21kworker/u8:0+flush-179:022:17:321
3323358994035,4cyclictest3351061-21kworker/u8:2+flush-179:021:20:201
3323358994035,4cyclictest3321696-21kworker/u8:1+events_unbound19:10:251
3323358994031,7cyclictest3321764-21kworker/u8:2+flush-179:019:40:151
3323354994037,2cyclictest3321696-21kworker/u8:1+events_unbound19:25:220
3323354994035,4cyclictest3420422-21kworker/u8:2+flush-179:000:25:220
3323354994034,5cyclictest3381030-21kworker/u8:2+flush-179:023:15:230
3323354994034,4cyclictest3381030-21kworker/u8:2+flush-179:022:45:210
3323363993933,4cyclictest3395937-21turbostat22:54:593
3323363993933,4cyclictest3360667-21turbostat21:05:003
332336399390,38cyclictest0-21swapper/322:49:593
332336399390,38cyclictest0-21swapper/320:02:593
3323358993934,4cyclictest3363858-21kworker/u8:1+events_unbound21:15:171
3323354993934,4cyclictest3372879-21kworker/u8:2+events_unbound21:40:250
332336399380,35cyclictest0-21swapper/323:45:583
3323360993834,2cyclictest0-21swapper/221:09:552
3323354993833,4cyclictest3383171-21kworker/u8:0+flush-179:022:20:190
3323354993833,4cyclictest3321764-21kworker/u8:2+flush-179:020:05:290
3323363993734,2cyclictest0-21swapper/319:55:593
3323363993732,4cyclictest3404154-21turbostat23:20:003
332336399370,35cyclictest0-21swapper/322:10:003
3323358993732,4cyclictest3409222-21kworker/u8:2+flush-179:023:40:211
3323354993732,4cyclictest3363804-21kworker/u8:0+flush-179:021:14:560
3323354993732,4cyclictest3321764-21kworker/u8:2+events_unbound20:10:270
3323354993731,5cyclictest3341785-21kworker/u8:1+flush-179:020:25:170
3323363993634,1cyclictest0-21swapper/319:35:003
3323363993634,1cyclictest0-21swapper/300:26:583
3323363993634,1cyclictest0-21swapper/300:13:593
3323363993633,2cyclictest0-21swapper/321:27:593
3323363993633,2cyclictest0-21swapper/321:06:003
3323363993631,4cyclictest3329890-21turbostat19:29:593
332336399360,35cyclictest0-21swapper/323:27:593
332336399360,1cyclictest0-21swapper/322:36:593
3323360993634,1cyclictest0-21swapper/219:54:592
3323358993632,3cyclictest3383171-21kworker/u8:0+flush-179:022:25:221
231999360,4rtkit-daemon2304-21lightdm-gtk-gre20:02:120
3323363993533,1cyclictest0-21swapper/322:40:593
3323363993532,2cyclictest0-21swapper/323:21:003
3323363993532,2cyclictest0-21swapper/323:07:003
332336399350,1cyclictest0-21swapper/322:00:593
3323360993532,2cyclictest0-21swapper/223:40:592
3323360993531,2cyclictest0-21swapper/223:30:592
3323354993528,5cyclictest3359226-21latency_hist21:00:010
3323363993432,1cyclictest0-21swapper/321:31:593
3323363993432,1cyclictest0-21swapper/321:21:593
3323363993432,1cyclictest0-21swapper/320:14:593
3323363993432,1cyclictest0-21swapper/300:08:583
3323363993431,2cyclictest0-21swapper/322:34:593
3323363993431,2cyclictest0-21swapper/321:44:593
3323363993431,1cyclictest0-21swapper/319:47:583
3323363993429,3cyclictest3334933-21turbostat19:45:003
3323358993429,4cyclictest3398829-21kworker/u8:0+flush-179:000:10:001
332335499331,30cyclictest0-21swapper/023:05:130
4577091320,12ptp4l441ktimers/300:00:013
3323363993230,1cyclictest0-21swapper/300:38:593
3323363993230,1cyclictest0-21swapper/300:21:003
3323360993230,1cyclictest0-21swapper/219:19:592
3323360993229,2cyclictest0-21swapper/223:08:002
3323360993228,2cyclictest0-21swapper/221:46:592
332336099320,30cyclictest0-21swapper/222:13:592
332336099320,29cyclictest0-21swapper/222:58:592
3323358993230,1cyclictest0-21swapper/122:49:581
3323354993229,2cyclictest3368844-21kworker/u8:1+events_unbound21:30:200
3323354993227,4cyclictest3406176-21latency_hist23:25:010
3323363993129,1cyclictest0-21swapper/320:57:583
332336099310,29cyclictest0-21swapper/221:42:592
3323354993122,6cyclictest3388211-21/usr/sbin/munin22:30:180
3323360993027,2cyclictest0-21swapper/222:36:592
3323360993027,2cyclictest0-21swapper/222:21:582
3323360993027,2cyclictest0-21swapper/219:45:122
332336099300,2cyclictest0-21swapper/220:09:552
332336099300,2cyclictest0-21swapper/219:55:142
332336099300,28cyclictest0-21swapper/222:50:142
332336099300,28cyclictest0-21swapper/219:20:162
332336099300,26cyclictest0-21swapper/222:15:122
3323358993025,4cyclictest3420422-21kworker/u8:2+events_unbound00:20:181
3323363992926,2cyclictest0-21swapper/321:55:153
3323363992926,2cyclictest0-21swapper/321:55:153
3323363992926,2cyclictest0-21swapper/320:49:553
332336399290,28cyclictest0-21swapper/319:15:153
3323360992924,2cyclictest0-21swapper/223:55:152
332336099290,27cyclictest0-21swapper/223:00:132
332336099290,27cyclictest0-21swapper/222:01:592
332336099290,27cyclictest0-21swapper/219:30:012
332336099290,26cyclictest0-21swapper/222:33:592
332336099290,26cyclictest0-21swapper/219:28:582
332336099290,26cyclictest0-21swapper/200:11:582
4577091280,6ptp4l441ktimers/320:20:003
4577091280,6ptp4l441ktimers/319:55:013
3323363992826,1cyclictest0-21swapper/321:51:593
3323363992825,2cyclictest0-21swapper/320:50:143
3323363992823,4cyclictest3383196-21turbostat22:15:003
332336399280,26cyclictest0-21swapper/323:10:133
332336399280,26cyclictest0-21swapper/322:20:163
332336399280,26cyclictest0-21swapper/320:40:143
332336399280,1cyclictest0-21swapper/323:36:003
3323360992826,1cyclictest0-21swapper/219:35:162
3323360992826,1cyclictest0-21swapper/200:24:592
3323360992825,2cyclictest0-21swapper/223:10:132
3323360992825,2cyclictest0-21swapper/221:35:152
3323360992825,2cyclictest0-21swapper/219:40:132
3323360992825,2cyclictest0-21swapper/200:35:592
3323360992824,2cyclictest0-21swapper/220:20:002
332336099280,2cyclictest0-21swapper/219:11:592
332336099280,26cyclictest0-21swapper/223:25:592
332336099280,26cyclictest0-21swapper/220:10:142
4577091270,6ptp4l441ktimers/321:50:003
4577091270,5ptp4l441ktimers/323:34:553
3323363992725,1cyclictest0-21swapper/323:50:593
3323360992724,2cyclictest0-21swapper/223:21:002
332336099270,2cyclictest0-21swapper/220:40:592
332336099270,24cyclictest0-21swapper/223:47:462
332336099270,24cyclictest0-21swapper/221:23:512
332336099270,24cyclictest0-21swapper/220:59:582
4577091260,6ptp4l441ktimers/321:40:003
4577091260,5ptp4l441ktimers/320:34:553
4577091260,5ptp4l441ktimers/319:25:003
4577091260,5ptp4l441ktimers/300:05:003
332336399260,24cyclictest0-21swapper/319:10:153
332336399260,1cyclictest0-21swapper/321:18:593
3323360992624,1cyclictest0-21swapper/223:55:002
3323360992623,2cyclictest0-21swapper/222:42:592
3323360992623,2cyclictest0-21swapper/221:17:592
3323360992623,2cyclictest0-21swapper/220:53:552
3323360992623,2cyclictest0-21swapper/220:26:032
3323360992623,2cyclictest0-21swapper/200:32:592
3323360992622,2cyclictest0-21swapper/221:55:592
3323360992622,2cyclictest0-21swapper/221:55:592
3323360992622,2cyclictest0-21swapper/220:23:572
332336099260,24cyclictest0-21swapper/221:00:592
332336099260,24cyclictest0-21swapper/220:46:102
332336099260,24cyclictest0-21swapper/220:01:062
332336099260,24cyclictest0-21swapper/200:02:242
4577091250,5ptp4l61490irq/134-eno1-TxRx-022:19:553
4577091250,5ptp4l61490irq/134-eno1-TxRx-000:34:563
3323363992523,1cyclictest0-21swapper/320:06:033
332336399250,24cyclictest0-21swapper/322:28:443
332336399250,24cyclictest0-21swapper/320:22:593
332336399250,23cyclictest0-21swapper/323:01:143
3323360992522,2cyclictest0-21swapper/220:31:592
332336099250,23cyclictest0-21swapper/220:40:002
3323363992422,1cyclictest0-21swapper/323:40:143
3323360992421,2cyclictest0-21swapper/221:32:572
3323360992419,2cyclictest0-21swapper/200:25:142
332336099240,23cyclictest0-21swapper/221:25:072
332336099240,1cyclictest0-21swapper/223:18:162
3323360992321,1cyclictest0-21swapper/200:09:592
3323360992219,2cyclictest0-21swapper/223:37:502
3323360992219,2cyclictest0-21swapper/222:28:102
3323360992017,2cyclictest0-21swapper/222:45:592
3323358991814,2cyclictest3323216-21latency_hist19:10:031
3323354991813,4cyclictest0-21swapper/019:10:020
3323360991714,2cyclictest0-21swapper/221:10:122
3323360991613,2cyclictest0-21swapper/200:19:592
33233609985,2cyclictest0-21swapper/222:07:592
33233609930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional