You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 16:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Thu Dec 25, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3211786999285,5cyclictest3273022-21kworker/u8:2+events_unbound11:20:000
3211786998673,11cyclictest266-21systemd-journal09:20:200
3211786998472,9cyclictest266-21systemd-journal10:10:200
3211786997871,5cyclictest3262628-21kworker/u8:3+flush-179:010:39:590
3211786997869,7cyclictest3286215-21/usr/sbin/munin11:00:240
3211787997567,5cyclictest3282786-21latency_hist10:50:021
3211786997465,7cyclictest3276164-21apt-get10:30:010
3211786997246,8cyclictest3218042-21latency_hist07:30:010
3211786997061,7cyclictest3255448-21/usr/sbin/munin09:25:230
3211786997049,6cyclictest3306674-21latency_hist12:05:000
3211786996860,6cyclictest3229737-21latency_hist08:05:010
3211787996757,8cyclictest3232909-21latency_hist08:15:011
3211786996657,7cyclictest3284371-21latency_hist10:55:010
3211786996657,7cyclictest266-21systemd-journal11:35:000
3211787996457,5cyclictest3237726-21kworker/u8:3+flush-179:008:35:241
3211786996356,5cyclictest3286464-21kworker/u8:0+flush-179:011:10:010
3211786996354,6cyclictest3278008-21latency_hist10:35:010
3211786996255,5cyclictest3209611-21kworker/u8:1+flush-179:007:15:010
3211787996152,7cyclictest3259983-21latency_hist09:40:001
321178699591,53cyclictest685-21snmpd08:15:010
3211787995850,5cyclictest3262628-21kworker/u8:3+events_unbound10:30:021
3211786995851,5cyclictest3228110-21kworker/u8:1+flush-179:008:20:190
3211787995747,8cyclictest266-21systemd-journal09:00:001
3211787995650,5cyclictest3262628-21kworker/u8:3+flush-179:010:10:231
3211787995547,6cyclictest3228128-21latency_hist08:00:011
3211786995551,3cyclictest3249592-21kworker/u8:0+flush-179:009:30:260
3211786995344,7cyclictest3284407-21kworker/u8:3+flush-179:010:55:220
3211787995240,9cyclictest3213515-21apt-get07:15:111
3211786995247,3cyclictest3206674-21kworker/u8:0+flush-179:007:45:170
3211786995247,3cyclictest3206674-21kworker/u8:0+flush-179:007:45:170
3211786995246,5cyclictest3297091-21kworker/u8:3+flush-179:011:50:240
3211786995245,5cyclictest3298707-21latency_hist11:40:010
3211787995147,3cyclictest3273022-21kworker/u8:2+events_unbound11:24:551
3211787995143,6cyclictest3309879-21kworker/u8:1+flush-179:012:35:201
3211787995143,6cyclictest266-21systemd-journal09:29:191
3211786995142,7cyclictest3273022-21kworker/u8:2+events_unbound11:20:200
3211786995045,4cyclictest3298756-21kworker/u8:2+flush-179:011:40:130
3211787994943,4cyclictest3286464-21kworker/u8:0+events_unbound11:15:221
3211787994943,4cyclictest3253638-21kworker/u8:2+flush-179:009:50:001
3211787994941,6cyclictest3228110-21kworker/u8:1+flush-179:008:15:201
3211787994941,6cyclictest3228110-21kworker/u8:1+flush-179:008:15:201
3211787994939,8cyclictest3241142-21apt-get08:40:111
3211786994943,5cyclictest3266653-21kworker/u8:1+flush-179:010:05:230
4577091480,13ptp4l441ktimers/307:10:013
3211787994843,4cyclictest3249592-21kworker/u8:0+events_unbound09:05:251
3211787994841,5cyclictest3309879-21kworker/u8:1+events_unbound12:30:161
3211787994839,7cyclictest3297091-21kworker/u8:3+flush-179:011:55:001
3211787994836,5cyclictest3264757-21perf09:55:011
3211787994833,14cyclictest3266653-21kworker/u8:1+flush-179:010:20:261
3211786994842,5cyclictest3298756-21kworker/u8:2+flush-179:012:20:000
3211786994842,5cyclictest3230847-21kworker/u8:2+events_unbound08:40:190
3211786994841,4cyclictest3230847-21kworker/u8:2+flush-179:008:55:260
3211786994840,6cyclictest3249592-21kworker/u8:0+events_unbound09:55:020
3211787994736,9cyclictest266-21systemd-journal12:05:011
3211787994639,5cyclictest3228110-21kworker/u8:1+flush-179:008:00:231
3211787994639,5cyclictest266-21systemd-journal08:45:191
3211787994637,7cyclictest3214301-21kworker/u8:2+events_unbound07:30:031
3211787994632,13cyclictest3244042-21kworker/u8:1+flush-179:009:19:551
3211786994636,7cyclictest3297091-21kworker/u8:3+flush-179:012:20:210
3211787994540,4cyclictest3297091-21kworker/u8:3+events_unbound11:50:011
3211787994538,5cyclictest3223109-21latency_hist07:45:011
3211787994534,10cyclictest3249592-21kworker/u8:0+events_unbound09:30:211
3211786994539,4cyclictest3237726-21kworker/u8:3+flush-179:008:35:190
3211786994537,6cyclictest3262628-21kworker/u8:3+flush-179:010:20:180
3211786994535,7cyclictest3264768-21apt09:55:010
321178699451,40cyclictest3234492-21cron08:20:010
321178699451,40cyclictest3234492-21cron08:20:010
3211786994439,3cyclictest3244042-21kworker/u8:1+flush-179:009:05:010
3211786994435,7cyclictest3273022-21kworker/u8:2+events_unbound11:10:140
3211791994340,2cyclictest0-21swapper/210:06:592
321179199430,40cyclictest0-21swapper/212:39:552
3211787994335,6cyclictest510-21rs:main1
321179299420,1cyclictest0-21swapper/312:10:583
3211787994236,5cyclictest3298756-21kworker/u8:2+flush-179:012:10:241
3211786994236,5cyclictest3253638-21kworker/u8:2+flush-179:009:35:190
3211786994233,7cyclictest3298756-21kworker/u8:2+events_unbound11:55:190
3211786994227,14cyclictest3226520-21kworker/u8:3+flush-179:008:05:150
321179299410,1cyclictest0-21swapper/310:09:593
321179199410,1cyclictest0-21swapper/211:09:552
3211787994136,3cyclictest0-21swapper/110:37:591
3211787994135,5cyclictest3206674-21kworker/u8:0+events_unbound07:35:241
3211786994134,5cyclictest3220127-21/usr/sbin/munin07:35:160
3211792994038,1cyclictest0-21swapper/308:39:553
321179299400,38cyclictest3245656-21turbostat08:55:003
3211791994036,2cyclictest0-21swapper/208:59:542
3211787994035,3cyclictest3286016-21systemd-run11:00:001
321178799401,2cyclictest714-21Xorg12:23:591
3211786994035,4cyclictest3228110-21kworker/u8:1+flush-179:008:25:230
3211786994035,4cyclictest3206674-21kworker/u8:0+events_unbound07:20:220
3211786994034,4cyclictest3221777-21apt-get07:40:100
3211786994033,6cyclictest3273022-21kworker/u8:2+flush-179:010:40:200
3211792993936,2cyclictest0-21swapper/309:19:593
321179299390,4cyclictest3285973-21turbostat10:59:593
321179199390,37cyclictest0-21swapper/212:02:592
3211787993933,4cyclictest3297091-21kworker/u8:3+flush-179:012:25:171
3211787993933,4cyclictest3297091-21kworker/u8:3+flush-179:012:25:171
3211787993933,4cyclictest3266743-21latency_hist10:00:011
3211787993930,7cyclictest3244042-21kworker/u8:1+events_unbound09:00:171
321178799390,32cyclictest271rcuc/108:07:591
3211786993935,3cyclictest714-21Xorg12:37:590
3211786993934,4cyclictest3297091-21kworker/u8:3+flush-179:012:25:240
3211786993934,4cyclictest3297091-21kworker/u8:3+flush-179:012:25:240
3211786993934,4cyclictest3262628-21kworker/u8:3+events_unbound10:15:240
3211786993933,5cyclictest3244042-21kworker/u8:1+flush-179:009:10:220
3211786993932,4cyclictest0-21swapper/012:30:590
3211791993834,2cyclictest0-21swapper/211:14:552
321179199380,36cyclictest0-21swapper/209:18:592
3211787993832,5cyclictest3298756-21kworker/u8:2+flush-179:011:40:191
3211787993831,4cyclictest0-21swapper/107:25:591
3211787993830,6cyclictest3249592-21kworker/u8:0+flush-179:009:25:001
3211786993828,8cyclictest3217533-21kworker/u8:1+flush-179:007:50:190
321179299370,1cyclictest0-21swapper/310:49:593
3211791993734,2cyclictest0-21swapper/212:23:592
3211791993734,2cyclictest0-21swapper/209:51:592
3211791993733,2cyclictest0-21swapper/208:07:592
321179199370,35cyclictest0-21swapper/209:46:592
321179199370,35cyclictest0-21swapper/209:02:592
321179199370,34cyclictest0-21swapper/208:20:012
321179199370,34cyclictest0-21swapper/208:20:012
3211787993734,2cyclictest0-21swapper/112:19:551
3211787993731,4cyclictest3244104-21kworker/u8:3+events_unbound08:50:231
3211786993730,5cyclictest3292383-21kworker/u8:1+flush-179:011:45:200
3211786993730,5cyclictest3230847-21kworker/u8:2+events_unbound08:30:140
321178699370,5cyclictest714-21Xorg11:26:000
3211792993634,1cyclictest0-21swapper/310:51:003
3211792993634,1cyclictest0-21swapper/309:39:563
321179299360,35cyclictest0-21swapper/311:43:583
321179299360,35cyclictest0-21swapper/311:08:003
321179299360,35cyclictest0-21swapper/307:39:593
321179299360,1cyclictest0-21swapper/311:21:593
321179199360,34cyclictest0-21swapper/209:34:582
321179199360,2cyclictest0-21swapper/210:32:582
321179199360,2cyclictest0-21swapper/208:20:592
321179199360,1cyclictest0-21swapper/209:24:552
3211787993631,4cyclictest3214301-21kworker/u8:2+flush-179:007:24:551
3211787993628,6cyclictest3276176-21awk10:30:011
3211787993617,18cyclictest0-21swapper/108:20:181
3211786993633,2cyclictest0-21swapper/008:52:590
3211786993630,4cyclictest266-21systemd-journal07:56:190
3211786993629,5cyclictest3230847-21kworker/u8:2+events_unbound08:45:140
3211792993533,1cyclictest0-21swapper/311:50:003
3211792993533,1cyclictest0-21swapper/311:26:003
3211792993533,1cyclictest0-21swapper/310:04:583
3211792993533,1cyclictest0-21swapper/308:32:593
3211792993529,5cyclictest3290751-21turbostat11:15:013
321179299350,1cyclictest0-21swapper/312:36:593
321179299350,1cyclictest0-21swapper/307:46:593
321179299350,1cyclictest0-21swapper/307:46:593
321179199350,1cyclictest0-21swapper/212:28:002
321179199350,1cyclictest0-21swapper/212:27:592
321179199350,1cyclictest0-21swapper/210:44:592
3211787993531,3cyclictest3292386-21kworker/u8:3+flush-179:011:25:141
3211787993531,3cyclictest3224702-21/usr/sbin/munin07:50:011
3211787993531,3cyclictest3224702-21/usr/sbin/munin07:50:011
3211787993527,6cyclictest3249592-21kworker/u8:0+events_unbound09:40:251
3211787993527,5cyclictest0-21swapper/111:59:591
321178699352,30cyclictest3249098-21apt-get09:05:110
3211792993432,1cyclictest0-21swapper/309:45:583
3211787993429,3cyclictest0-21swapper/110:10:011
3211787993428,4cyclictest266-21systemd-journal11:08:191
3211787993427,6cyclictest3296515-21kworker/u8:0+flush-179:011:35:201
321178799341,3cyclictest714-21Xorg10:51:591
3211786993430,3cyclictest3297091-21kworker/u8:3+flush-179:012:13:500
4577091330,6ptp4l61490irq/134-eno1-TxRx-011:20:003
3211792993331,1cyclictest0-21swapper/312:07:003
3211792993331,1cyclictest0-21swapper/307:57:593
3211792993331,1cyclictest0-21swapper/307:40:593
3211792993330,2cyclictest0-21swapper/310:24:553
321179199330,30cyclictest0-21swapper/211:25:592
3211787993328,4cyclictest3286464-21kworker/u8:0+flush-179:011:10:191
3211787993328,3cyclictest3239316-21systemd-run08:35:011
3211787993328,2cyclictest3306929-21apt-get12:05:121
3211787993327,4cyclictest3226037-21phc2sys07:50:221
3211787993326,5cyclictest266-21systemd-journal07:15:001
3211786993327,5cyclictest3253638-21kworker/u8:2+flush-179:009:40:190
3211786993327,4cyclictest0-21swapper/012:05:130
3211786993326,5cyclictest3281211-21turbostat10:49:560
3211786993326,5cyclictest3253638-21kworker/u8:2+flush-179:010:00:150
3211791993229,2cyclictest0-21swapper/212:17:592
3211791993229,2cyclictest0-21swapper/210:17:592
321179199320,27cyclictest0-21swapper/210:55:142
3211787993226,4cyclictest3273022-21kworker/u8:2+events_unbound10:40:141
321178699321,29cyclictest3218045-21apt-get07:30:030
3211792993129,1cyclictest0-21swapper/311:59:593
3211792993129,1cyclictest0-21swapper/309:27:593
3211792993129,1cyclictest0-21swapper/308:29:553
321179199310,27cyclictest0-21swapper/211:20:132
321179199310,21cyclictest0-21swapper/207:50:132
4577091300,9ptp4l441ktimers/309:15:013
4577091300,4ptp4l441ktimers/312:34:553
3211792993028,1cyclictest0-21swapper/309:07:583
3211792993025,4cyclictest3314630-21turbostat12:30:003
3211792993025,4cyclictest3314630-21turbostat12:29:593
321179299300,28cyclictest0-21swapper/307:10:113
3211791993029,1cyclictest0-21swapper/208:04:592
3211791993027,2cyclictest0-21swapper/209:35:592
3211791993027,2cyclictest0-21swapper/207:39:552
321179199300,2cyclictest0-21swapper/207:46:592
321179199300,2cyclictest0-21swapper/207:46:592
321179199300,28cyclictest0-21swapper/208:35:102
4577091290,7ptp4l441ktimers/308:05:003
3211792992927,1cyclictest0-21swapper/307:15:133
3211792992926,2cyclictest0-21swapper/310:40:123
3211792992926,2cyclictest0-21swapper/308:45:133
3211792992926,2cyclictest0-21swapper/307:20:153
3211791992926,2cyclictest0-21swapper/210:22:002
3211791992926,2cyclictest0-21swapper/209:05:122
3211791992926,2cyclictest0-21swapper/207:12:002
321179199290,27cyclictest0-21swapper/211:15:152
321179199290,27cyclictest0-21swapper/207:30:032
3211787992924,4cyclictest3296197-21gltestperf11:30:171
3211787992924,4cyclictest3271742-21cpuspeed_turbos10:15:131
3211786992925,3cyclictest3211877-21latency_hist07:10:010
4577091280,6ptp4l441ktimers/311:55:003
3211792992826,1cyclictest0-21swapper/310:29:583
3211792992826,1cyclictest0-21swapper/308:55:143
3211792992825,2cyclictest0-21swapper/311:02:593
3211792992822,4cyclictest3226547-21turbostat07:55:003
321179299280,27cyclictest0-21swapper/312:00:143
321179299280,27cyclictest0-21swapper/310:10:143
321179299280,27cyclictest0-21swapper/307:25:123
321179299280,26cyclictest0-21swapper/312:20:143
321179299280,26cyclictest0-21swapper/310:35:133
321179299280,26cyclictest0-21swapper/309:50:133
321179299280,26cyclictest0-21swapper/309:40:133
321179299280,26cyclictest0-21swapper/308:05:113
3211791992825,2cyclictest0-21swapper/212:30:142
3211791992825,2cyclictest0-21swapper/211:55:132
3211791992825,2cyclictest0-21swapper/211:50:132
3211791992825,2cyclictest0-21swapper/211:45:142
3211791992825,2cyclictest0-21swapper/208:44:592
321179199280,2cyclictest0-21swapper/212:07:592
3211786992824,3cyclictest3263024-21unixbench-2d09:45:230
3211786992824,2cyclictest0-21swapper/007:15:130
4577091270,7ptp4l441ktimers/309:35:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-010:35:013
4577091270,4ptp4l61490irq/134-eno1-TxRx-008:14:563
3211792992725,1cyclictest0-21swapper/312:17:593
3211792992725,1cyclictest0-21swapper/307:31:593
321179299270,26cyclictest0-21swapper/308:40:133
321179299270,1cyclictest0-21swapper/311:30:143
321179299270,1cyclictest0-21swapper/309:20:133
3211791992724,2cyclictest0-21swapper/209:27:002
321179199270,2cyclictest0-21swapper/208:52:592
321179199270,25cyclictest0-21swapper/211:01:582
321179199270,1cyclictest0-21swapper/207:58:592
3211787992723,3cyclictest3237761-21latency_hist08:30:011
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:20:013
4577091260,5ptp4l441ktimers/308:19:563
4577091260,5ptp4l441ktimers/308:19:553
3211791992623,2cyclictest0-21swapper/210:50:592
321179199260,24cyclictest0-21swapper/207:42:592
321179199260,24cyclictest0-21swapper/207:25:252
321179199260,24cyclictest0-21swapper/207:20:202
321179199260,1cyclictest0-21swapper/210:49:592
3211787992622,2cyclictest714-21Xorg11:00:591
3211787992621,4cyclictest3268147-21grep10:00:271
4577091250,5ptp4l441ktimers/309:04:563
3211792992523,1cyclictest0-21swapper/308:21:593
3211791992522,2cyclictest0-21swapper/211:40:322
3211791992522,2cyclictest0-21swapper/208:45:132
3211791992522,2cyclictest0-21swapper/208:32:592
3211791992522,2cyclictest0-21swapper/207:15:212
3211791992521,2cyclictest0-21swapper/210:39:002
321179199250,2cyclictest0-21swapper/210:28:052
3211786992522,2cyclictest714-21Xorg09:17:590
4577091240,5ptp4l61490irq/134-eno1-TxRx-011:39:553
3211792992422,1cyclictest0-21swapper/309:55:033
3211791992421,2cyclictest0-21swapper/210:10:592
3211791992219,2cyclictest0-21swapper/208:10:592
3211791992118,2cyclictest0-21swapper/212:11:522
3211791992118,2cyclictest0-21swapper/211:32:592
3211791992118,2cyclictest0-21swapper/209:41:312
3211791992117,2cyclictest0-21swapper/211:39:002
321178799170,1cyclictest0-21swapper/107:10:011
321179199150,13cyclictest0-21swapper/209:14:592
32117919997,1cyclictest0-21swapper/210:00:012
32117919980,7cyclictest0-21swapper/208:26:132
32117919970,6cyclictest0-21swapper/210:04:022
32117919950,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional