You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 18:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sun Dec 28, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3318654999987,8cyclictest3407190-21latency_hist11:40:000
3318658999583,9cyclictest3321780-21latency_hist07:20:011
3318658998883,4cyclictest3373512-21kworker/u8:2+events_unbound10:20:251
3318654998883,4cyclictest3393134-21kworker/u8:0+flush-179:011:00:270
3318658998783,3cyclictest3393134-21kworker/u8:0+events_unbound10:55:241
3318654998783,3cyclictest3420660-21kworker/u8:2+events_unbound12:20:250
3318654998782,4cyclictest3373512-21kworker/u8:2+events_unbound10:05:240
3318654998479,4cyclictest3405567-21kworker/u8:0+events_unbound12:10:250
3318654998375,6cyclictest3330021-21latency_hist07:45:010
3318658998271,9cyclictest3359961-21latency_hist09:15:011
3318654998277,4cyclictest3382119-21kworker/u8:0+events_unbound10:20:210
3318654998070,4cyclictest3339808-21kworker/u8:1+events_unbound09:05:260
3318654997974,4cyclictest3396019-21kworker/u8:1+flush-179:011:05:260
3318654997974,4cyclictest3366572-21kworker/u8:3+flush-179:010:15:240
3318658997570,4cyclictest3321736-21kworker/u8:2+events_unbound07:35:261
3318658997470,3cyclictest3393134-21kworker/u8:0+events_unbound11:10:171
3318654997464,7cyclictest3415665-21latency_hist12:05:000
3318654997368,4cyclictest3331640-21kworker/u8:3+events_unbound07:55:260
3318654997363,3cyclictest3339808-21kworker/u8:1+flush-179:008:35:220
3318654997267,4cyclictest3420660-21kworker/u8:2+events_unbound12:25:270
3318654997267,4cyclictest3317094-21kworker/u8:1+flush-179:007:25:200
3318654997263,4cyclictest3396019-21kworker/u8:1+events_unbound11:25:170
3318654997263,4cyclictest3396019-21kworker/u8:1+events_unbound11:25:160
3318654997262,8cyclictest3360459-21/usr/sbin/munin09:15:220
3318658997167,3cyclictest3339808-21kworker/u8:1+events_unbound09:05:151
3318658997160,9cyclictest266-21systemd-journal10:45:271
3318654997167,3cyclictest3405567-21kworker/u8:0+events_unbound11:55:200
3318654997167,3cyclictest3321736-21kworker/u8:2+events_unbound07:45:160
3318654997066,3cyclictest3330014-21kworker/u8:1+events_unbound08:05:260
3318654997065,3cyclictest3396019-21kworker/u8:1+flush-179:011:20:200
3318654996965,3cyclictest3373512-21kworker/u8:2+events_unbound09:55:210
3318658996864,3cyclictest3373512-21kworker/u8:2+events_unbound10:35:191
3318654996864,3cyclictest3331640-21kworker/u8:3+flush-179:008:00:280
3318654996859,4cyclictest3384609-21kworker/u8:1+events_unbound10:30:170
3318654996762,4cyclictest3396019-21kworker/u8:1+flush-179:011:15:250
3318654996762,4cyclictest3339808-21kworker/u8:1+events_unbound08:45:240
3318654996760,4cyclictest3366572-21kworker/u8:3+flush-179:010:00:230
3318658996662,3cyclictest3373512-21kworker/u8:2+events_unbound10:50:241
3318658996661,4cyclictest3366572-21kworker/u8:3+events_unbound09:45:251
3318658996661,4cyclictest3330014-21kworker/u8:1+events_unbound08:05:151
3318658996560,4cyclictest3366572-21kworker/u8:3+events_unbound10:10:291
3318658996560,4cyclictest3314028-21kworker/u8:0+events_unbound07:10:221
3318658996558,5cyclictest3423879-21latency_hist12:30:011
3318658996558,5cyclictest3348047-21latency_hist08:40:011
3318658996557,5cyclictest3356789-21latency_hist09:05:011
3318658996557,3cyclictest3420660-21kworker/u8:2+events_unbound12:30:271
3318658996553,10cyclictest3400825-21latency_hist11:20:001
3318654996554,4cyclictest3403975-21kworker/u8:2+events_unbound11:45:160
3318654996460,3cyclictest3387274-21kworker/u8:0+flush-179:010:44:560
3318654996459,4cyclictest3373512-21kworker/u8:2+flush-179:010:50:240
3318654996459,4cyclictest3338221-21kworker/u8:2+flush-179:008:15:270
3318654996353,4cyclictest3339808-21kworker/u8:1+events_unbound08:40:190
3318658996257,4cyclictest3422271-21kworker/u8:0+events_unbound12:24:331
3318658996257,4cyclictest3366572-21kworker/u8:3+events_unbound09:58:331
3318654996258,3cyclictest3339808-21kworker/u8:1+flush-179:009:20:200
3318654996256,5cyclictest3314028-21kworker/u8:0+flush-179:007:10:270
3318658996157,3cyclictest3373512-21kworker/u8:2+events_unbound10:25:231
3318654996156,4cyclictest3314028-21kworker/u8:0+events_unbound07:15:150
3318654996152,4cyclictest3420660-21kworker/u8:2+events_unbound12:30:250
3318658996056,3cyclictest3344750-21kworker/u8:3+events_unbound08:31:311
3318658996056,3cyclictest3339808-21kworker/u8:1+events_unbound09:24:331
3318658996056,3cyclictest3339808-21kworker/u8:1+events_unbound08:45:281
3318658996054,5cyclictest3373512-21kworker/u8:2+flush-179:010:05:251
3318654996056,3cyclictest3358610-21kworker/u8:0+flush-179:009:10:260
3318654996052,6cyclictest3373477-21latency_hist09:55:000
3318654996052,6cyclictest3373477-21latency_hist09:55:000
3318654996049,4cyclictest3336373-21kworker/u8:0+events_unbound08:10:130
3318658995954,4cyclictest3407228-21kworker/u8:1+events_unbound11:45:241
3318654995955,3cyclictest3338221-21kworker/u8:2+events_unbound08:25:150
3318654995954,4cyclictest3363653-21kworker/u8:2+flush-179:009:25:110
3318654995947,4cyclictest3373512-21kworker/u8:2+events_unbound10:35:210
3318658995853,4cyclictest3405567-21kworker/u8:0+events_unbound11:54:321
3318658995748,7cyclictest510-21rs:main1
3318654995753,3cyclictest3393134-21kworker/u8:0+flush-179:010:59:560
3318658995649,6cyclictest3366572-21kworker/u8:3+flush-179:009:35:011
3318654995652,3cyclictest3420660-21kworker/u8:2+flush-179:012:19:550
3318654995646,8cyclictest3355412-21cp09:00:010
3318658995551,3cyclictest3363653-21kworker/u8:2+events_unbound09:25:191
3318658995551,3cyclictest3338221-21kworker/u8:2+events_unbound08:25:201
3318658995551,3cyclictest3317094-21kworker/u8:1+events_unbound07:24:461
3318654995551,3cyclictest3422529-21kworker/u8:3+events_unbound12:35:250
3318654995550,4cyclictest3405567-21kworker/u8:0+flush-179:011:40:210
3318654995550,4cyclictest3366572-21kworker/u8:3+events_unbound10:12:310
3318654995550,4cyclictest3366572-21kworker/u8:3+events_unbound09:45:210
3318654995550,4cyclictest3341465-21kworker/u8:0+events_unbound08:20:200
3318658995450,3cyclictest3403975-21kworker/u8:2+events_unbound11:35:141
3318658995450,3cyclictest3396019-21kworker/u8:1+events_unbound11:07:321
3318658995449,4cyclictest3344750-21kworker/u8:3+events_unbound08:41:321
3318658995444,8cyclictest3331861-21apt-get07:50:111
3318654995450,3cyclictest3405567-21kworker/u8:0+events_unbound11:34:550
3318654995450,3cyclictest3324721-21kworker/u8:0+events_unbound07:50:130
3318658995348,4cyclictest3366572-21kworker/u8:3+events_unbound10:00:321
3318658995348,4cyclictest3350441-21kworker/u8:0+events_unbound08:53:321
3318658995345,3cyclictest3373512-21kworker/u8:2+events_unbound11:00:181
3318654995349,3cyclictest3393134-21kworker/u8:0+events_unbound11:10:210
3318654995348,4cyclictest3321736-21kworker/u8:2+flush-179:007:30:010
3318658995248,3cyclictest3324721-21kworker/u8:0+events_unbound07:34:321
3318654995247,4cyclictest3344750-21kworker/u8:3+flush-179:008:55:050
3318658995147,3cyclictest3338221-21kworker/u8:2+events_unbound08:15:321
3318654995147,3cyclictest3317094-21kworker/u8:1+flush-179:007:20:470
3318654995145,4cyclictest3366572-21kworker/u8:3+events_unbound09:42:310
3318658995046,3cyclictest3341465-21kworker/u8:0+events_unbound08:22:331
3318658995042,6cyclictest3366572-21kworker/u8:3+flush-179:009:50:021
3318658995042,6cyclictest3366572-21kworker/u8:3+flush-179:009:50:011
3318654995046,3cyclictest3373512-21kworker/u8:2+events_unbound10:25:140
3318654995046,3cyclictest3321736-21kworker/u8:2+events_unbound07:35:280
3318654995040,4cyclictest3405567-21kworker/u8:0+events_unbound11:53:320
4577091490,13ptp4l441ktimers/307:10:003
3318658994944,4cyclictest3366572-21kworker/u8:3+events_unbound10:15:311
3318658994940,7cyclictest3368699-21/usr/sbin/munin09:40:241
3318658994844,3cyclictest3344750-21kworker/u8:3+events_unbound08:59:341
3318658994844,3cyclictest3324721-21kworker/u8:0+events_unbound07:40:181
3318658994839,3cyclictest3387274-21kworker/u8:0+events_unbound10:40:301
3318658994743,3cyclictest3422529-21kworker/u8:3+events_unbound12:35:021
3318658994742,4cyclictest3321736-21kworker/u8:2+events_unbound07:45:311
3318654994742,4cyclictest3366572-21kworker/u8:3+events_unbound09:36:320
3318654994738,3cyclictest3405567-21kworker/u8:0+events_unbound12:05:200
3318658994642,3cyclictest3420660-21kworker/u8:2+events_unbound12:17:011
3318658994642,3cyclictest3403975-21kworker/u8:2+events_unbound11:40:021
3318658994642,3cyclictest3393134-21kworker/u8:0+events_unbound11:20:311
3318658994635,9cyclictest3334798-21perf08:00:001
3318658994540,4cyclictest3403975-21kworker/u8:2+events_unbound12:01:321
3318658994540,4cyclictest3384609-21kworker/u8:1+events_unbound10:34:321
331865899450,43cyclictest3415678-21turbostat12:09:551
3318654994540,4cyclictest3344750-21kworker/u8:3+events_unbound08:32:320
3318659994340,2cyclictest0-21swapper/208:05:592
331865999430,41cyclictest0-21swapper/207:42:592
3318661994240,1cyclictest0-21swapper/311:35:003
3318658994238,3cyclictest3403975-21kworker/u8:2+events_unbound11:29:331
3318658994238,3cyclictest3403975-21kworker/u8:2+events_unbound11:29:331
3318654994238,3cyclictest3390352-21kworker/u8:1+flush-179:010:45:280
3318654994234,7cyclictest3352184-21hwlatdetect08:50:160
3318661994139,1cyclictest0-21swapper/311:49:003
3318661994135,4cyclictest3378276-21turbostat10:10:013
331866199410,39cyclictest3344613-21turbostat08:30:013
3318658994137,3cyclictest3338221-21kworker/u8:2+events_unbound08:13:331
3318658994137,3cyclictest3330014-21kworker/u8:1+events_unbound08:02:321
3318654994132,3cyclictest3339808-21kworker/u8:1+events_unbound09:30:230
3318661994034,5cyclictest3356806-21turbostat09:05:003
331866199400,39cyclictest3331613-21turbostat07:50:013
331866199400,38cyclictest3423896-21turbostat12:30:013
331866199400,38cyclictest3371636-21turbostat09:50:003
331866199400,38cyclictest3354929-21turbostat09:00:003
331865999400,1cyclictest0-21swapper/211:52:002
331866199390,4cyclictest3400839-21turbostat11:20:013
331866199390,4cyclictest3384643-21turbostat10:30:003
3318658993935,3cyclictest3405567-21kworker/u8:0+events_unbound12:11:321
3318658993933,5cyclictest3405567-21kworker/u8:0+flush-179:011:55:241
331865899391,36cyclictest3323881-21apt-get07:25:121
3318661993832,5cyclictest3408789-21turbostat11:45:003
3318659993835,2cyclictest0-21swapper/210:46:592
3318659993835,2cyclictest0-21swapper/208:55:592
331865999380,36cyclictest0-21swapper/211:56:592
3318658993834,3cyclictest3403975-21kworker/u8:2+events_unbound11:31:311
3318661993735,1cyclictest0-21swapper/308:20:593
3318659993734,2cyclictest0-21swapper/208:54:562
331865999370,35cyclictest0-21swapper/210:33:592
231999370,9rtkit-daemon495-21gpm07:07:161
4577091360,3ptp4l61490irq/134-eno1-TxRx-007:20:033
3318661993634,1cyclictest0-21swapper/312:12:583
3318661993634,1cyclictest0-21swapper/311:53:003
3318661993634,1cyclictest0-21swapper/309:24:553
3318661993633,2cyclictest0-21swapper/308:44:593
331866199360,35cyclictest0-21swapper/307:36:593
3318659993633,2cyclictest0-21swapper/211:33:592
4577091350,2ptp4l441ktimers/312:05:143
3318661993533,1cyclictest0-21swapper/310:49:553
3318661993533,1cyclictest0-21swapper/309:50:593
3318661993533,1cyclictest0-21swapper/309:50:593
3318659993532,2cyclictest0-21swapper/212:03:592
3318659993532,2cyclictest0-21swapper/211:03:592
3318659993532,2cyclictest0-21swapper/209:18:592
3318658993531,3cyclictest3339808-21kworker/u8:1+events_unbound09:18:001
4577091340,3ptp4l61490irq/134-eno1-TxRx-007:15:163
3318661993432,1cyclictest0-21swapper/309:15:593
3318661993432,1cyclictest0-21swapper/308:52:593
331866199340,32cyclictest0-21swapper/310:10:593
3318659993432,1cyclictest0-21swapper/209:15:002
3318659993432,1cyclictest0-21swapper/208:29:592
3318659993431,2cyclictest0-21swapper/210:15:592
3318659993431,2cyclictest0-21swapper/208:20:592
3318661993331,1cyclictest0-21swapper/310:30:583
3318659993330,2cyclictest0-21swapper/209:25:592
3318659993330,2cyclictest0-21swapper/208:19:552
3318661993230,1cyclictest0-21swapper/308:01:583
3318661993229,2cyclictest0-21swapper/311:14:593
3318661993229,2cyclictest0-21swapper/309:59:003
3318659993230,1cyclictest0-21swapper/207:54:592
3318661993130,1cyclictest0-21swapper/308:12:593
3318661993129,1cyclictest0-21swapper/311:07:593
3318661993128,2cyclictest0-21swapper/309:41:593
3318661993128,2cyclictest0-21swapper/308:07:003
3318659993128,2cyclictest0-21swapper/211:27:592
3318659993128,2cyclictest0-21swapper/211:27:582
3318659993128,2cyclictest0-21swapper/210:03:582
4577091300,8ptp4l441ktimers/312:39:553
3318661993028,1cyclictest0-21swapper/310:50:583
3318661993028,1cyclictest0-21swapper/310:44:563
3318661993028,1cyclictest0-21swapper/310:21:593
3318661993028,1cyclictest0-21swapper/309:14:563
3318661993025,4cyclictest3381446-21turbostat10:20:003
3318661993025,4cyclictest3346461-21turbostat08:35:003
331866199300,2cyclictest0-21swapper/307:56:593
331866199300,29cyclictest0-21swapper/307:12:003
3318659993028,1cyclictest0-21swapper/211:10:002
3318659993028,1cyclictest0-21swapper/210:45:002
3318659993028,1cyclictest0-21swapper/209:54:592
3318659993028,1cyclictest0-21swapper/209:54:592
3318659993027,2cyclictest0-21swapper/212:19:002
3318659993027,2cyclictest0-21swapper/211:35:142
3318659993027,2cyclictest0-21swapper/211:15:012
3318659993027,2cyclictest0-21swapper/209:35:012
3318659993027,2cyclictest0-21swapper/208:02:582
331865999300,28cyclictest0-21swapper/212:39:592
331865999300,28cyclictest0-21swapper/208:45:012
331865999300,28cyclictest0-21swapper/207:20:022
4577091290,7ptp4l441ktimers/309:35:003
4577091290,4ptp4l61490irq/134-eno1-TxRx-011:59:543
3318661992927,1cyclictest0-21swapper/310:35:593
3318661992926,2cyclictest0-21swapper/311:00:593
3318661992926,2cyclictest0-21swapper/309:06:593
331866199290,2cyclictest0-21swapper/307:40:123
331866199290,27cyclictest0-21swapper/309:25:133
331866199290,1cyclictest0-21swapper/310:55:143
3318659992927,1cyclictest0-21swapper/209:00:022
3318659992926,2cyclictest0-21swapper/212:34:002
3318659992926,2cyclictest0-21swapper/208:36:592
3318659992926,2cyclictest0-21swapper/208:30:022
3318659992926,2cyclictest0-21swapper/207:55:152
3318659992926,2cyclictest0-21swapper/207:35:152
331865999290,28cyclictest0-21swapper/207:32:582
331865999290,27cyclictest0-21swapper/211:45:102
331865999290,27cyclictest0-21swapper/210:25:112
331865999290,27cyclictest0-21swapper/209:45:112
4577091280,7ptp4l441ktimers/307:54:593
4577091280,6ptp4l441ktimers/312:35:003
3318661992826,1cyclictest0-21swapper/308:49:553
3318661992826,1cyclictest0-21swapper/307:33:593
3318661992825,2cyclictest0-21swapper/311:20:133
331866199280,26cyclictest0-21swapper/312:00:153
331866199280,26cyclictest0-21swapper/309:35:013
3318659992826,1cyclictest0-21swapper/212:25:002
3318659992825,2cyclictest0-21swapper/212:10:142
3318659992825,2cyclictest0-21swapper/210:50:592
3318659992825,2cyclictest0-21swapper/210:36:582
3318659992825,2cyclictest0-21swapper/209:44:002
331865999280,27cyclictest0-21swapper/211:10:142
331865999280,27cyclictest0-21swapper/207:45:142
331865999280,26cyclictest0-21swapper/211:20:132
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:20:003
4577091270,6ptp4l441ktimers/311:40:003
4577091270,6ptp4l441ktimers/311:29:563
4577091270,6ptp4l441ktimers/311:29:553
4577091270,6ptp4l441ktimers/310:05:003
4577091270,5ptp4l441ktimers/312:24:553
3318661992725,1cyclictest0-21swapper/308:39:593
3318659992724,2cyclictest0-21swapper/209:59:592
3318659992724,2cyclictest0-21swapper/207:10:152
331865999270,24cyclictest0-21swapper/209:22:502
4577091260,4ptp4l441ktimers/308:20:013
3318659992623,2cyclictest0-21swapper/209:05:442
3318659992623,2cyclictest0-21swapper/208:10:132
331865999260,25cyclictest0-21swapper/210:12:002
331865999260,24cyclictest0-21swapper/210:57:222
331865999260,24cyclictest0-21swapper/210:24:032
331865999260,24cyclictest0-21swapper/210:09:262
331865999260,24cyclictest0-21swapper/209:31:492
331866199250,23cyclictest0-21swapper/307:25:023
3318659992522,2cyclictest0-21swapper/207:15:142
331865999250,2cyclictest0-21swapper/208:43:262
331865999250,2cyclictest0-21swapper/207:25:162
3318654992416,6cyclictest3318556-21latency_hist07:10:020
3318659992320,2cyclictest0-21swapper/211:43:592
3318659991512,2cyclictest0-21swapper/212:30:002
3318659991411,2cyclictest0-21swapper/212:06:592
33186599930,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional