You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 23:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sun Nov 23, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2732042340,2sleep20-21swapper/209:20:302
1142712300,1sleep10-21swapper/107:15:261
105263992414,3cyclictest316068-21/usr/sbin/munin09:45:281
105262992418,2cyclictest170550irq/121-eno111:40:020
105262992416,7cyclictest581298-21kthreadcore12:15:320
105262992415,5cyclictest471830-21latency_hist11:15:010
105263992320,2cyclictest144714-21apt-key07:40:011
105263992314,3cyclictest305714-21runrttasks09:38:381
105263992311,3cyclictest455731-21/usr/sbin/munin11:05:511
105262992316,6cyclictest125814-21munin-run07:25:000
105262992315,7cyclictest499748-21kthreadcore11:30:310
105262992315,7cyclictest368229-21aten2.4-expect10:15:260
105264992219,1cyclictest0-21swapper/212:40:022
105264992219,1cyclictest0-21swapper/207:25:002
105262992211,7cyclictest342936-21ssh10:00:270
5396982210,2sleep20-21swapper/211:52:052
105264992118,1cyclictest0-21swapper/207:15:022
10526399218,3cyclictest0-21swapper/110:10:381
105263992118,2cyclictest489056-21systemd-run11:25:011
105263992118,2cyclictest254852-21/usr/sbin/munin09:10:011
10526299219,6cyclictest0-21swapper/011:55:230
105262992115,1cyclictest170550irq/121-eno109:47:490
105262992113,2cyclictest2009-21runrttasks10:47:280
105264992017,1cyclictest0-21swapper/209:20:012
10526399207,4cyclictest516207-21/usr/sbin/munin11:40:251
10526399207,3cyclictest0-21swapper/109:55:021
105263992017,2cyclictest111989-21missed_timers07:15:011
105263992017,2cyclictest105260-21cyclictest07:50:341
105263992017,2cyclictest105260-21cyclictest07:50:341
105263992013,3cyclictest105260-21cyclictest09:25:001
105263992011,3cyclictest0-21swapper/110:15:261
10526299209,7cyclictest289835-21cut09:30:240
10526299209,7cyclictest208137-21kthreadcore08:30:300
10526299209,6cyclictest0-21swapper/011:40:230
10526299209,6cyclictest0-21swapper/011:05:510
10526299204,5cyclictest175779-21aten2.4-expect08:05:240
105262992015,1cyclictest4892931systemd-run11:25:010
105262992014,5cyclictest568096-21aten2.4-expect12:10:250
105262992014,5cyclictest449156-21kthreadcore11:00:320
105262992013,6cyclictest550609-21/usr/sbin/munin12:00:300
105262992010,6cyclictest0-21swapper/009:10:020
302487291190,2phc2sys0-21swapper/312:10:463
302487291190,2phc2sys0-21swapper/310:24:093
302487291190,2phc2sys0-21swapper/309:57:203
302487291190,2phc2sys0-21swapper/309:57:203
10526499198,3cyclictest0-21swapper/207:45:252
105264991916,1cyclictest0-21swapper/210:38:072
10526399198,6cyclictest0-21swapper/108:29:341
105263991916,2cyclictest387063-21kthreadcore10:25:321
105263991916,2cyclictest338985-21diskmemload09:55:381
105263991916,2cyclictest338985-21diskmemload09:55:381
105263991916,2cyclictest308093-21fschecks_time09:40:301
10526299198,7cyclictest359226-21latency_hist10:10:020
10526299198,7cyclictest193960-21sed08:20:010
10526299194,4cyclictest169662-21aten2.4-expect08:00:230
10526299193,3cyclictest273257-21fschecks_time09:20:300
105262991916,2cyclictest480361-21latency_hist11:20:020
105262991916,2cyclictest360829-21kthreadcore10:10:330
105262991916,2cyclictest333629-21cpu09:55:250
105262991916,2cyclictest333629-21cpu09:55:250
105262991916,2cyclictest310255-21kthreadcore09:40:340
105262991916,2cyclictest245536-21kthreadcore09:00:310
105262991916,2cyclictest239470-21kthreadcore08:55:510
105262991916,2cyclictest194326-21tail08:20:260
105262991916,2cyclictest184502-21kthreadcore08:10:320
105262991916,2cyclictest166261-21kthreadcore07:55:330
105262991916,2cyclictest1631-21gmain10:39:560
105262991916,2cyclictest160181-21kthreadcore07:50:320
105262991916,2cyclictest160181-21kthreadcore07:50:320
105262991916,2cyclictest146558-21kthreadcore07:40:320
105262991916,2cyclictest127695-21kthreadcore07:25:300
105262991911,4cyclictest537702-21kthreadcore11:50:330
105262991911,4cyclictest0-21swapper/010:30:310
105262991910,5cyclictest531009-21runrttasks11:46:570
105262991910,5cyclictest329249-21kthreadcore09:50:360
302487291181,2phc2sys0-21swapper/309:15:123
302487291180,2phc2sys0-21swapper/312:36:593
302487291180,2phc2sys0-21swapper/312:24:363
302487291180,2phc2sys0-21swapper/310:15:353
10526499183,4cyclictest0-21swapper/211:10:012
105264991815,1cyclictest0-21swapper/212:20:352
105264991815,1cyclictest0-21swapper/209:30:012
105264991815,1cyclictest0-21swapper/208:25:312
105264991815,1cyclictest0-21swapper/208:20:362
105264991815,1cyclictest0-21swapper/207:40:262
10526399186,3cyclictest0-21swapper/109:32:031
105263991815,2cyclictest542386-21cstates11:55:251
105263991815,2cyclictest477707-21grep11:15:381
105263991815,2cyclictest181592-21wc08:10:011
105263991810,3cyclictest0-21swapper/110:05:361
10526399180,1cyclictest0-21swapper/112:22:391
10526299188,6cyclictest428749-21ssh10:50:090
10526299186,8cyclictest263888-21ssh09:15:230
10526299186,7cyclictest559399-21ssh12:05:240
10526299185,5cyclictest0-21swapper/010:40:300
105262991815,2cyclictest595368-21kthreadcore12:25:290
105262991815,2cyclictest588910-21kthreadcore12:20:310
105262991815,2cyclictest213723-21kthreadcore08:35:300
105262991813,4cyclictest225453-21tr08:45:310
105262991812,5cyclictest7602-21cron09:35:020
105262991810,4cyclictest0-21swapper/010:25:290
105262991810,2cyclictest835298rtkit-daemon09:25:500
10526299180,7cyclictest619257-21cron12:40:000
302487291170,2phc2sys0-21swapper/311:42:283
302487291170,2phc2sys0-21swapper/311:11:553
302487291170,2phc2sys0-21swapper/310:06:373
105264991714,1cyclictest0-21swapper/209:40:002
105264991714,1cyclictest0-21swapper/208:00:012
10526499171,13cyclictest114412-21chrt07:15:272
10526399179,1cyclictest170550irq/121-eno111:29:101
10526399174,3cyclictest76255-21kworker/u16:2+events_unbound08:35:241
10526399174,2cyclictest2009-21runrttasks10:44:201
10526399173,5cyclictest0-21swapper/110:32:421
10526399171,6cyclictest0-21swapper/110:55:291
105263991714,2cyclictest132536-21latency_hist07:30:011
105263991714,2cyclictest0-21swapper/112:15:271
10526399170,9cyclictest515532-21plymouth11:40:001
10526299178,5cyclictest438505-21ssh10:55:300
10526299178,5cyclictest241rcuc/011:25:300
105262991714,2cyclictest385169-21systemd-run10:25:020
105262991714,2cyclictest231176-21fschecks_count08:50:260
105262991714,2cyclictest201577-21kthreadcore08:25:310
105262991714,2cyclictest1700-21systemd-logind07:10:010
105262991714,2cyclictest152634-21kthreadcore07:45:320
105262991714,2cyclictest133785-21irqcore07:30:470
105262991714,2cyclictest112359-21kthreadcore07:15:020
105262991714,2cyclictest106572-21irqcore07:10:360
302487291161,6phc2sys0-21swapper/309:10:233
302487291160,3phc2sys0-21swapper/310:03:563
302487291160,2phc2sys0-21swapper/309:46:393
10526499168,5cyclictest583921-21chrt12:18:252
10526499165,4cyclictest6105492sleep212:34:492
10526499162,1cyclictest0-21swapper/209:56:382
10526499162,1cyclictest0-21swapper/209:56:382
105264991614,1cyclictest0-21swapper/212:10:012
105264991614,1cyclictest0-21swapper/209:55:022
105264991614,1cyclictest0-21swapper/208:20:022
105264991613,1cyclictest0-21swapper/211:35:002
105264991613,1cyclictest0-21swapper/211:10:242
105264991613,1cyclictest0-21swapper/210:35:012
105264991613,1cyclictest0-21swapper/210:25:372
105264991613,1cyclictest0-21swapper/209:10:012
105264991613,1cyclictest0-21swapper/208:52:122
105264991613,1cyclictest0-21swapper/207:35:282
105264991612,2cyclictest0-21swapper/211:47:472
10526399168,3cyclictest0-21swapper/109:29:501
10526399165,3cyclictest0-21swapper/110:37:501
10526399165,3cyclictest0-21swapper/108:42:491
10526399165,2cyclictest170550irq/121-eno112:05:331
10526399163,5cyclictest0-21swapper/110:22:401
105263991613,2cyclictest550962-21tr12:00:261
105263991613,2cyclictest507036-21latency_hist11:35:021
105263991613,2cyclictest212217-21cut08:35:021
105263991612,3cyclictest351ktimers/109:10:231
105263991612,3cyclictest170897-21kthreadcore08:00:291
10526299168,4cyclictest0-21swapper/009:10:540
10526299164,7cyclictest138829-21/usr/sbin/munin07:35:340
105262991613,2cyclictest603976-21kthreadcore12:30:320
105262991613,2cyclictest222347-21kthreadcore08:40:310
302487291151,4phc2sys0-21swapper/312:25:213
302487291150,3phc2sys0-21swapper/309:42:343
302487291150,2phc2sys0-21swapper/312:18:193
302487291150,2phc2sys0-21swapper/311:30:463
10526499157,4cyclictest0-21swapper/212:00:242
10526499153,4cyclictest5680052sleep212:10:242
10526499153,2cyclictest0-21swapper/210:14:142
105264991512,1cyclictest0-21swapper/211:40:422
105264991512,1cyclictest0-21swapper/210:22:322
105264991512,1cyclictest0-21swapper/210:00:542
105264991512,1cyclictest0-21swapper/209:30:342
105264991512,1cyclictest0-21swapper/209:10:372
105264991512,1cyclictest0-21swapper/209:00:002
105264991512,1cyclictest0-21swapper/208:40:292
105264991512,1cyclictest0-21swapper/208:05:352
105264991512,1cyclictest0-21swapper/207:30:012
105264991511,2cyclictest0-21swapper/210:54:292
105264991511,1cyclictest0-21swapper/212:00:012
10526399153,3cyclictest446390-21aten2.4-expect11:00:251
10526399153,2cyclictest269323-21sed09:15:381
105263991512,2cyclictest570916-21kthreadcore12:10:321
105263991512,2cyclictest528440-21kthreadcore11:45:311
105263991512,2cyclictest345360-21kthreadcore10:00:311
105263991512,2cyclictest238255-21kthreadcore08:55:501
105263991512,2cyclictest230289-21sh08:50:001
105263991512,2cyclictest181734-21acpi08:10:241
105263991512,2cyclictest1652-1atopacctd12:35:361
105263991512,2cyclictest1652-1atopacctd10:50:321
105263991512,2cyclictest151994-21cut07:45:291
105263991512,2cyclictest0-21swapper/112:25:271
105263991512,2cyclictest0-21swapper/111:50:241
105263991512,2cyclictest0-21swapper/108:20:011
302487291141,3phc2sys0-21swapper/312:00:563
302487291140,2phc2sys0-21swapper/312:30:353
302487291140,2phc2sys0-21swapper/310:10:433
10526499142,2cyclictest0-21swapper/211:24:592
10526499141,9cyclictest3073322sleep209:40:232
105264991412,1cyclictest0-21swapper/212:25:482
105264991412,1cyclictest0-21swapper/211:20:022
105264991412,1cyclictest0-21swapper/210:55:292
105264991412,1cyclictest0-21swapper/210:45:262
105264991411,2cyclictest0-21swapper/211:35:312
105264991411,1cyclictest0-21swapper/211:00:352
105264991411,1cyclictest0-21swapper/210:40:372
105264991411,1cyclictest0-21swapper/210:05:302
105264991411,1cyclictest0-21swapper/209:45:282
105264991411,1cyclictest0-21swapper/209:00:302
105264991411,1cyclictest0-21swapper/208:35:012
105264991411,1cyclictest0-21swapper/207:55:002
105264991411,1cyclictest0-21swapper/207:55:002
105264991411,1cyclictest0-21swapper/207:35:012
10526399142,3cyclictest420373-21aten2.4-expect10:45:231
10526399141,5cyclictest603456-21if_enp1s0.812:30:301
105263991411,2cyclictest464285-21grep11:10:281
105263991411,2cyclictest133334-21fschecks_count07:30:451
105263991410,3cyclictest195586-21kthreadcore08:20:311
105263991410,3cyclictest166574-21kthreadcore07:55:331
105263991410,3cyclictest150498-21unixbench-2d07:40:381
302487291131,4phc2sys0-21swapper/309:55:023
302487291130,3phc2sys0-21swapper/310:32:123
302487291130,3phc2sys0-21swapper/308:31:313
302487291130,2phc2sys0-21swapper/311:49:523
302487291130,2phc2sys0-21swapper/310:50:343
302487291130,2phc2sys0-21swapper/309:38:393
10526499131,6cyclictest0-21swapper/208:10:242
105264991311,1cyclictest0-21swapper/211:25:312
105264991310,1cyclictest0-21swapper/210:15:152
105264991310,1cyclictest0-21swapper/208:45:252
105264991310,1cyclictest0-21swapper/208:35:352
10526399135,2cyclictest170550irq/121-eno109:00:361
10526399131,2cyclictest120062-21apt-get07:20:221
105263991310,2cyclictest230716-21aten_repower_po08:50:241
302487291121,2phc2sys0-21swapper/310:38:393
302487291120,4phc2sys0-21swapper/311:29:073
302487291120,3phc2sys0-21swapper/311:55:113
302487291120,3phc2sys0-21swapper/308:15:253
302487291120,2phc2sys0-21swapper/311:24:213
302487291120,2phc2sys0-21swapper/310:49:383
302487291120,2phc2sys0-21swapper/310:40:403
302487291120,2phc2sys0-21swapper/309:09:193
302487291120,2phc2sys0-21swapper/308:27:313
302487291120,2phc2sys0-21swapper/307:10:483
302487291120,1phc2sys0-21swapper/308:51:363
105264991210,1cyclictest0-21swapper/208:00:272
302487291115,3phc2sys0-21swapper/308:40:363
302487291112,2phc2sys0-21swapper/311:00:293
302487291110,4phc2sys0-21swapper/307:25:223
302487291110,3phc2sys0-21swapper/311:00:003
302487291110,2phc2sys0-21swapper/312:09:053
302487291110,2phc2sys0-21swapper/311:53:433
302487291110,2phc2sys0-21swapper/311:07:063
302487291110,2phc2sys0-21swapper/309:30:233
302487291110,2phc2sys0-21swapper/307:54:483
302487291110,2phc2sys0-21swapper/307:54:483
302487291110,2phc2sys0-21swapper/307:21:303
302487291110,2phc2sys0-21swapper/307:05:233
10526399111,2cyclictest105097-21latency_hist07:10:011
302487291102,2phc2sys0-21swapper/307:35:293
302487291101,2phc2sys0-21swapper/311:16:363
302487291101,2phc2sys0-21swapper/308:06:553
302487291101,2phc2sys0-21swapper/307:55:363
302487291100,3phc2sys0-21swapper/311:35:553
302487291100,2phc2sys0-21swapper/310:25:333
302487291100,2phc2sys0-21swapper/309:25:343
302487291100,2phc2sys0-21swapper/309:20:373
302487291100,2phc2sys0-21swapper/309:03:513
302487291100,2phc2sys0-21swapper/308:47:033
302487291100,2phc2sys0-21swapper/308:04:503
30248729191,2phc2sys0-21swapper/308:10:363
30248729190,2phc2sys0-21swapper/308:55:523
30248729190,2phc2sys0-21swapper/308:35:173
30248729190,2phc2sys0-21swapper/308:20:263
30248729190,2phc2sys0-21swapper/307:45:273
30248729190,2phc2sys0-21swapper/307:40:343
30248729190,2phc2sys0-21swapper/307:30:443
30248729190,2phc2sys0-21swapper/307:15:373
1052649991,4cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional