You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 16:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Fri Nov 21, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37201521950,2sleep30-21swapper/308:05:293
6310702990,3sleep30-21swapper/310:52:053
5734382480,2sleep30-21swapper/310:20:313
5734382480,2sleep30-21swapper/310:20:313
3352172360,2sleep0335212-21sed07:35:330
301329992613,5cyclictest524276-21kthreadcore09:50:340
301329992612,5cyclictest260-21systemd-journal11:55:010
30132999254,8cyclictest686967-21cat11:25:330
30132999254,8cyclictest686967-21cat11:25:330
301329992515,5cyclictest746882-21apt12:00:270
301331992421,1cyclictest0-21swapper/212:00:002
301330992421,2cyclictest425435-21gpgconf08:50:001
301329992412,6cyclictest459103-21/usr/sbin/munin09:15:380
301329992412,5cyclictest651341-21/usr/sbin/munin11:05:300
301329992313,6cyclictest581577-21cpu10:25:270
301329992310,5cyclictest0-21swapper/009:50:000
301330992216,2cyclictest170550irq/121-eno111:20:321
301329992219,2cyclictest0-21swapper/008:00:010
301329992212,9cyclictest0-21swapper/011:20:370
301329992210,5cyclictest0-21swapper/010:20:000
30132999218,6cyclictest0-21swapper/012:30:420
30132999218,6cyclictest0-21swapper/012:30:420
835298200,6rtkit-daemon1629-21avahi-daemon09:56:220
30133199208,4cyclictest0-21swapper/208:55:402
301331992018,1cyclictest0-21swapper/210:20:002
30133099209,5cyclictest623439-1ssh10:48:421
301330992017,2cyclictest612694-21threads10:40:411
301330992015,1cyclictest3279642date07:30:011
301330992013,2cyclictest170550irq/121-eno110:00:321
30132999208,7cyclictest0-21swapper/012:20:020
30132999207,2cyclictest0-21swapper/009:40:050
301329992010,9cyclictest618889-21kthreadcore10:45:350
302487291190,2phc2sys0-21swapper/311:50:103
30133199191,8cyclictest0-21swapper/209:10:012
301331991917,1cyclictest0-21swapper/211:30:022
301331991917,1cyclictest0-21swapper/211:30:022
301331991916,1cyclictest0-21swapper/211:50:002
30133099199,5cyclictest579704-1ssh10:23:071
30133099199,5cyclictest579704-1ssh10:23:071
30133099198,5cyclictest806294-1ssh12:32:411
30133099198,5cyclictest806294-1ssh12:32:411
30133099198,5cyclictest675539-1ssh11:19:001
30133099195,9cyclictest477001-21aten2.4-expect09:25:271
30133099194,9cyclictest511863-21aten2.4-expect09:45:251
30133099194,7cyclictest340379-21aten2.4-expect07:40:301
30133099194,10cyclictest426081-21aten2.4-expect08:50:271
301330991916,2cyclictest652121-21kthreadcore11:05:341
301330991916,2cyclictest632854-21latency_hist10:55:011
301330991916,2cyclictest1652-1atopacctd11:04:451
301330991912,2cyclictest2009-21runrttasks11:43:471
30133099191,12cyclictest793335-21cut12:25:321
30132999195,2cyclictest0-21swapper/009:22:200
301329991914,4cyclictest425715-21kworker/u16:1+nfsiod10:42:400
30132999191,16cyclictest641598-21date11:00:010
301331991816,1cyclictest0-21swapper/212:30:012
301331991815,1cyclictest0-21swapper/211:10:002
301331991815,1cyclictest0-21swapper/210:10:012
301330991815,2cyclictest607031-21sh10:40:011
301330991815,2cyclictest520696-21head09:50:271
301330991815,2cyclictest494857-21gltestperf09:35:311
301330991815,2cyclictest1652-1atopacctd07:56:461
301330991814,3cyclictest488556-21kthreadcore09:30:491
301330991814,3cyclictest456011-21unixbench_singl09:10:381
301330991814,3cyclictest338987-21head07:35:371
301330991814,3cyclictest312727-21kthreadcore07:15:351
301330991814,3cyclictest312727-21kthreadcore07:15:351
301330991813,1cyclictest170550irq/121-eno112:35:261
301330991812,2cyclictest170550irq/121-eno112:20:351
301330991810,2cyclictest170550irq/121-eno111:50:341
30133099180,1cyclictest0-21swapper/112:05:281
30132999189,7cyclictest0-21swapper/010:35:000
30132999184,6cyclictest708091-21phc2sys-jitter11:35:360
30132999183,2cyclictest0-21swapper/010:50:280
301329991815,2cyclictest793610-21kthreadcore12:25:320
301329991815,2cyclictest667475-21cron11:15:000
301329991815,2cyclictest563458-21latency_hist10:15:010
301329991815,2cyclictest301327-21cyclictest07:10:320
302487291170,2phc2sys0-21swapper/311:27:493
302487291170,2phc2sys0-21swapper/311:27:493
302487291170,2phc2sys0-21swapper/310:07:463
301331991714,1cyclictest0-21swapper/208:35:012
301331991714,1cyclictest0-21swapper/207:50:012
301331991713,2cyclictest0-21swapper/208:50:012
30133199170,10cyclictest0-21swapper/208:20:012
30133099179,2cyclictest170550irq/121-eno109:55:261
30133099175,3cyclictest0-21swapper/110:25:361
30133099173,9cyclictest459252-21aten2.4-expect09:15:271
30133099171,8cyclictest346492-21telnet07:45:251
30133099171,5cyclictest450252-21latency_hist09:10:021
301330991714,2cyclictest743038-21phc2sys11:55:341
301330991714,2cyclictest1652-1atopacctd08:56:461
301330991714,2cyclictest1631-21gmain10:19:561
301330991714,2cyclictest0-21swapper/110:10:011
301330991714,2cyclictest0-21swapper/108:40:011
301330991712,4cyclictest686106-21cut11:25:291
301330991712,4cyclictest686106-21cut11:25:291
30133099170,11cyclictest659540-21aten2.4-expect11:10:261
30132999179,6cyclictest0-21swapper/010:35:270
30132999176,2cyclictest0-21swapper/009:35:340
301329991714,2cyclictest8351-21rtkit-daemon09:27:160
301329991714,2cyclictest746455-21latency_hist12:00:010
301329991714,2cyclictest301327-21cyclictest11:30:370
30132999171,2cyclictest426463-21diskstats08:50:290
301329991710,5cyclictest810668-21kthreadcore12:35:310
301329991710,5cyclictest767592-21kthreadcore12:10:340
30132999170,9cyclictest333936-21munin-run07:35:000
30132999170,4cyclictest437041-21python308:55:390
302487291161,4phc2sys0-21swapper/312:25:253
302487291160,3phc2sys0-21swapper/309:00:003
302487291160,3phc2sys0-21swapper/307:40:413
302487291160,2phc2sys0-21swapper/311:19:513
302487291160,2phc2sys0-21swapper/309:21:093
302487291160,2phc2sys0-21swapper/308:30:023
30133199166,2cyclictest0-21swapper/207:35:012
301331991614,1cyclictest0-21swapper/211:45:002
301331991613,1cyclictest0-21swapper/212:20:012
301331991613,1cyclictest0-21swapper/210:45:002
301331991613,1cyclictest0-21swapper/209:50:322
301331991613,1cyclictest0-21swapper/207:10:422
301331991612,2cyclictest0-21swapper/211:30:292
30133099168,4cyclictest170550irq/121-eno111:45:421
30133099167,3cyclictest402540-21cut08:30:331
30133099164,7cyclictest590746-21cut10:30:311
30133099164,7cyclictest468095-21aten2.4-expect09:20:271
30133099162,8cyclictest555928-21fschecks_count10:10:291
30133099161,3cyclictest0-21swapper/111:30:251
301330991613,2cyclictest777842-21kthreadcore12:15:351
301330991613,2cyclictest307631-21sh07:15:011
301330991612,3cyclictest637060-21kthreadcore10:55:341
301330991612,3cyclictest390522-21kthreadcore08:20:341
301330991612,3cyclictest387821-21missed_timers08:15:371
301330991612,3cyclictest372556-21kthreadcore08:05:301
301330991612,2cyclictest382960-21systemd-run08:15:011
301330991612,1cyclictest170550irq/121-eno109:40:281
30133099160,11cyclictest770954-21sh12:12:171
30132999168,6cyclictest0-21swapper/011:00:410
30132999168,6cyclictest0-21swapper/010:05:310
30132999167,7cyclictest0-21swapper/010:20:410
30132999167,7cyclictest0-21swapper/010:20:410
30132999167,2cyclictest0-21swapper/011:49:080
30132999165,3cyclictest0-21swapper/012:09:530
30132999165,2cyclictest0-21swapper/012:22:370
30132999164,2cyclictest0-21swapper/007:49:180
30132999163,6cyclictest0-21swapper/008:29:470
301329991614,1cyclictest382803-21systemd-run08:15:000
30132999161,3cyclictest0-21swapper/011:40:550
301329991613,2cyclictest1652-1atopacctd09:15:010
301329991612,3cyclictest1652-1atopacctd09:30:490
301329991612,3cyclictest1652-1atopacctd07:40:310
302487291150,3phc2sys0-21swapper/309:28:103
30133199151,9cyclictest0-21swapper/210:50:272
301331991512,1cyclictest0-21swapper/209:30:012
301331991512,1cyclictest0-21swapper/209:25:012
301331991512,1cyclictest0-21swapper/208:40:302
301331991512,1cyclictest0-21swapper/207:35:312
301331991512,1cyclictest0-21swapper/207:20:002
301331991512,1cyclictest0-21swapper/207:20:002
301331991510,1cyclictest0-21swapper/209:10:242
30133199150,6cyclictest0-21swapper/210:25:252
30133099158,1cyclictest170550irq/121-eno111:35:261
30133099157,4cyclictest170550irq/121-eno112:01:191
301330991513,1cyclictest332576-21kthreadcore07:30:331
301330991512,2cyclictest321969-21latency_hist07:25:011
301330991511,3cyclictest395450-21aten_repower_vo08:25:271
301330991510,4cyclictest413789-21cpuspeed_turbos08:40:281
30132999157,6cyclictest668043-21/usr/sbin/munin11:15:340
301329991512,2cyclictest537918-21/usr/sbin/munin10:00:270
301329991512,2cyclictest316229-21tail07:20:260
301329991512,2cyclictest1803-21gdbus07:20:010
301329991512,2cyclictest1803-21gdbus07:20:010
302487291145,4phc2sys0-21swapper/312:39:553
302487291144,2phc2sys0-21swapper/310:26:423
302487291143,2phc2sys0-21swapper/311:30:463
302487291140,2phc2sys0-21swapper/309:55:213
30133199143,3cyclictest0-21swapper/211:20:012
301331991412,1cyclictest0-21swapper/212:30:432
301331991412,1cyclictest0-21swapper/212:30:432
301331991412,1cyclictest0-21swapper/212:10:002
301331991412,1cyclictest0-21swapper/211:35:392
301331991412,1cyclictest0-21swapper/210:35:012
301331991412,1cyclictest0-21swapper/208:40:012
30133199141,1cyclictest0-21swapper/210:00:252
301331991411,1cyclictest0-21swapper/212:25:012
301331991411,1cyclictest0-21swapper/212:00:322
301331991411,1cyclictest0-21swapper/211:55:012
301331991411,1cyclictest0-21swapper/211:20:362
301331991411,1cyclictest0-21swapper/211:01:342
301331991411,1cyclictest0-21swapper/210:55:332
301331991411,1cyclictest0-21swapper/210:45:142
301331991411,1cyclictest0-21swapper/210:21:512
301331991411,1cyclictest0-21swapper/210:21:512
301331991411,1cyclictest0-21swapper/209:15:332
301331991411,1cyclictest0-21swapper/208:20:372
301331991411,1cyclictest0-21swapper/207:57:462
301331991411,1cyclictest0-21swapper/207:50:532
301331991410,2cyclictest0-21swapper/212:35:322
30133099149,1cyclictest191rcu_preempt08:00:261
30133099142,7cyclictest352580-21aten2.4-expect07:50:381
301330991411,2cyclictest438186-21aten_repower_fr09:00:261
301329991411,2cyclictest444985-21idleruntime09:05:340
301329991411,2cyclictest410798-21kthreadcore08:35:340
301329991411,2cyclictest402460-21irqrtprio08:30:330
301329991411,2cyclictest393858-21latency08:20:350
301329991411,2cyclictest371568-21fschecks_count08:05:270
301329991411,2cyclictest367686-21kthreadcore08:00:340
7187812130,2sleep30-21swapper/311:43:083
302487291131,3phc2sys0-21swapper/307:38:463
302487291131,2phc2sys0-21swapper/308:40:013
302487291130,4phc2sys0-21swapper/312:16:483
302487291130,3phc2sys0-21swapper/312:24:233
302487291130,3phc2sys0-21swapper/307:55:253
302487291130,2phc2sys0-21swapper/312:02:323
302487291130,2phc2sys0-21swapper/311:37:143
302487291130,2phc2sys0-21swapper/311:01:063
302487291130,2phc2sys0-21swapper/310:03:233
30133199139,2cyclictest0-21swapper/208:10:022
301331991311,1cyclictest0-21swapper/210:35:342
301331991311,1cyclictest0-21swapper/207:25:012
301331991310,1cyclictest0-21swapper/212:10:342
301331991310,1cyclictest0-21swapper/210:10:342
301331991310,1cyclictest0-21swapper/209:55:282
301331991310,1cyclictest0-21swapper/209:45:312
301331991310,1cyclictest0-21swapper/209:37:442
301331991310,1cyclictest0-21swapper/209:05:002
301331991310,1cyclictest0-21swapper/208:55:022
301331991310,1cyclictest0-21swapper/207:40:362
30132999139,2cyclictest0-21swapper/007:10:020
30132999135,6cyclictest323449-21tr07:25:300
30132999131,7cyclictest383179-21aten2.4-expect08:15:280
301329991310,2cyclictest440895-21kthreadcore09:00:330
301329991310,2cyclictest421414-21kthreadcore08:45:340
301329991310,2cyclictest353831-21kthreadcore07:50:490
302487291124,3phc2sys0-21swapper/307:45:383
302487291122,3phc2sys0-21swapper/307:14:463
302487291121,3phc2sys0-21swapper/310:10:313
302487291121,2phc2sys0-21swapper/311:56:153
302487291121,2phc2sys0-21swapper/310:39:003
302487291120,2phc2sys0-21swapper/311:21:443
302487291120,2phc2sys0-21swapper/308:16:053
302487291120,2phc2sys0-21swapper/307:19:233
302487291120,2phc2sys0-21swapper/307:19:233
30133199129,1cyclictest0-21swapper/211:10:292
30133199129,1cyclictest0-21swapper/209:40:282
30133199129,1cyclictest0-21swapper/208:25:322
301331991210,1cyclictest0-21swapper/208:10:322
30132999129,2cyclictest414830-21kthreadcore08:40:330
302487291111,3phc2sys0-21swapper/308:40:293
302487291111,3phc2sys0-21swapper/308:20:383
302487291111,2phc2sys0-21swapper/310:32:073
302487291110,7phc2sys491450-21chrt09:31:253
302487291110,3phc2sys0-21swapper/312:13:223
302487291110,2phc2sys0-21swapper/312:34:033
302487291110,2phc2sys0-21swapper/312:34:033
302487291110,2phc2sys0-21swapper/311:10:023
302487291110,2phc2sys0-21swapper/310:57:203
302487291110,2phc2sys0-21swapper/307:25:243
30133199119,1cyclictest0-21swapper/209:30:432
30133199119,1cyclictest0-21swapper/208:01:402
30133199119,1cyclictest0-21swapper/207:30:012
30133199119,1cyclictest0-21swapper/207:10:022
302487291103,2phc2sys0-21swapper/310:40:363
302487291101,2phc2sys0-21swapper/311:05:413
302487291101,2phc2sys0-21swapper/309:47:553
302487291101,2phc2sys0-21swapper/309:17:403
302487291100,3phc2sys0-21swapper/310:15:563
302487291100,3phc2sys0-21swapper/309:40:093
302487291100,3phc2sys0-21swapper/308:30:393
302487291100,3phc2sys0-21swapper/307:50:443
302487291100,2phc2sys0-21swapper/312:08:093
302487291100,2phc2sys0-21swapper/311:48:173
302487291100,2phc2sys0-21swapper/310:45:453
302487291100,2phc2sys0-21swapper/309:54:083
302487291100,2phc2sys0-21swapper/309:36:193
302487291100,2phc2sys0-21swapper/309:14:193
302487291100,2phc2sys0-21swapper/309:05:303
302487291100,2phc2sys0-21swapper/308:10:243
302487291100,2phc2sys0-21swapper/308:02:133
302487291100,2phc2sys0-21swapper/307:34:573
30133099103,2cyclictest170550irq/121-eno107:10:011
30248729190,3phc2sys0-21swapper/308:45:343
30248729190,2phc2sys0-21swapper/309:00:333
30248729190,2phc2sys0-21swapper/308:50:313
295464291,4sleep30-21swapper/307:05:273
30248729180,2phc2sys0-21swapper/307:20:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional