You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 12:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Mon Nov 17, 2025 00:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26258021060,2sleep30-21swapper/323:50:393
20897821020,3sleep30-21swapper/323:20:333
1020342990,2sleep30-21swapper/322:16:573
4027733992914,6cyclictest0-21swapper/022:45:340
3289252280,2sleep10-21swapper/100:28:531
3289252280,2sleep10-21swapper/100:28:531
4027734992418,5cyclictest0-21swapper/122:30:011
4027734992418,2cyclictest170550irq/121-eno100:25:001
4027733992421,2cyclictest173745-21latency_hist23:00:010
4027734992316,2cyclictest4121050-21kworker/1:0+mm_percpu_wq21:30:011
4027733992219,2cyclictest312422-21systemd00:20:010
4027735992119,1cyclictest0-21swapper/200:05:012
4027735992118,1cyclictest0-21swapper/221:45:012
4027733992118,2cyclictest1-21systemd19:15:010
1312882210,2sleep30-21swapper/322:35:373
4027735992017,1cyclictest0-21swapper/200:20:012
4027734992018,1cyclictest0-21swapper/100:40:011
4027734992017,2cyclictest173753-21dump-pmu-power23:00:011
835298190,3rtkit-daemon4027731-21cyclictest22:23:220
4027735991916,1cyclictest0-21swapper/221:10:452
4027734991916,2cyclictest4034245-21kthreadcore19:15:021
4027734991916,2cyclictest4034245-21kthreadcore19:15:021
4027733991916,2cyclictest1-21systemd20:50:000
4027733991912,5cyclictest86738-21systemd22:10:020
4027733991912,5cyclictest312982-21/usr/sbin/munin00:20:500
4027733991912,5cyclictest30839-21kthreadcore21:35:450
4027733991912,5cyclictest30839-21kthreadcore21:35:450
302487291190,2phc2sys0-21swapper/322:31:253
835298180,4rtkit-daemon170550irq/121-eno120:50:460
4027735991815,1cyclictest0-21swapper/221:35:002
4027734991815,2cyclictest4193681-21apt-key21:20:011
4027734991815,2cyclictest4033733-21idleruntime-cro19:15:001
4027734991815,2cyclictest4027731-21cyclictest22:35:021
4027734991815,2cyclictest0-21swapper/100:10:011
4027734991810,3cyclictest0-21swapper/123:30:021
402773499180,11cyclictest4052000-21kthreadcore19:25:401
402773399187,2cyclictest0-21swapper/022:35:400
4027733991816,1cyclictest0-21swapper/021:10:010
4027733991815,2cyclictest43249-21apt-key21:45:010
4027733991812,4cyclictest61358-21aten_repower_vo21:55:370
4027733991811,6cyclictest251757-21kworker/u16:0+nfsiod23:55:180
4027733991810,2cyclictest262177-21kthreadcore23:50:390
4027733991810,1cyclictest0-21swapper/023:40:320
302487291181,4phc2sys0-21swapper/300:14:493
302487291180,2phc2sys0-21swapper/322:49:093
302487291180,2phc2sys0-21swapper/319:06:033
40910262170,2sleep30-21swapper/320:00:353
4027735991715,1cyclictest0-21swapper/222:20:012
4027735991714,1cyclictest0-21swapper/220:45:012
4027735991714,1cyclictest0-21swapper/220:10:012
4027735991714,1cyclictest0-21swapper/200:35:002
4027735991714,1cyclictest0-21swapper/200:25:002
4027735991713,2cyclictest0-21swapper/223:55:002
4027735991713,2cyclictest0-21swapper/223:40:372
402773499171,7cyclictest0-21swapper/123:30:351
4027734991714,2cyclictest86558-21sh22:10:011
4027734991714,2cyclictest4027731-21cyclictest23:15:011
4027734991714,2cyclictest248488-21cut23:40:421
4027734991714,2cyclictest153261-21phc2sys22:45:431
4027734991714,2cyclictest0-21swapper/100:35:021
4027734991713,3cyclictest187938-21needreboot23:05:471
402773399178,1cyclictest0-21swapper/021:10:390
4027733991714,2cyclictest182418-21latency_hist23:05:000
4027733991711,5cyclictest205811-21grep23:15:490
4027733991711,5cyclictest2035-21sshd23:36:080
4027733991710,2cyclictest4015689-21kworker/u16:3-rpciod22:50:340
402773599168,2cyclictest0-21swapper/220:20:342
4027735991614,1cyclictest0-21swapper/200:40:012
4027735991613,1cyclictest0-21swapper/223:25:442
4027735991613,1cyclictest0-21swapper/221:45:462
4027735991613,1cyclictest0-21swapper/221:20:452
4027735991613,1cyclictest0-21swapper/200:12:302
402773599161,11cyclictest0-21swapper/222:53:202
402773499169,2cyclictest170550irq/121-eno123:45:361
402773499169,2cyclictest170550irq/121-eno123:45:361
4027734991613,2cyclictest4156812-21phc2sys20:50:431
4027734991613,2cyclictest1652-1atopacctd20:59:081
4027734991613,2cyclictest0-21swapper/120:50:001
4027734991612,3cyclictest4061932-21kernelversion19:35:401
4027734991611,3cyclictest0-21swapper/122:45:021
402773499160,14cyclictest4121013-21grep20:25:001
402773399169,5cyclictest0-21swapper/021:15:420
4027733991614,1cyclictest321289-21kworker/u16:1-ext4-rsv-conversion00:35:010
4027733991613,2cyclictest51928-21latency_hist21:50:000
4027733991613,2cyclictest4164274-21head21:00:350
4027733991613,2cyclictest4078665-21unin-run19:50:010
4027733991613,2cyclictest4043200-21head19:20:350
4027733991613,2cyclictest284073-21sshd00:01:270
4027733991613,2cyclictest221854-21kthreadcore23:25:420
4027733991613,2cyclictest1700-21systemd-logind20:35:010
4027733991613,2cyclictest114127-21grep22:25:360
4027733991612,3cyclictest156952-21kworker/u16:1+nfsiod23:21:410
4027733991610,5cyclictest1652-1atopacctd21:20:450
4027733991610,4cyclictest1635-21dbus-daemon22:00:470
302487291163,2phc2sys0-21swapper/323:43:313
302487291162,2phc2sys0-21swapper/321:55:153
302487291161,5phc2sys0-21swapper/320:25:463
302487291160,3phc2sys0-21swapper/319:55:393
302487291160,2phc2sys0-21swapper/323:06:493
302487291160,2phc2sys0-21swapper/319:20:453
4027735991513,1cyclictest0-21swapper/223:15:432
4027735991513,1cyclictest0-21swapper/220:30:352
4027735991513,1cyclictest0-21swapper/219:25:022
4027735991512,1cyclictest0-21swapper/223:56:372
4027735991512,1cyclictest0-21swapper/223:45:452
4027735991512,1cyclictest0-21swapper/223:45:452
4027735991512,1cyclictest0-21swapper/222:27:462
4027735991512,1cyclictest0-21swapper/222:20:332
4027735991512,1cyclictest0-21swapper/221:55:402
4027735991512,1cyclictest0-21swapper/221:10:002
4027735991512,1cyclictest0-21swapper/221:00:012
4027735991512,1cyclictest0-21swapper/220:14:012
4027735991511,2cyclictest0-21swapper/222:34:242
4027735991511,2cyclictest0-21swapper/200:05:362
402773499158,2cyclictest170550irq/121-eno121:10:411
402773499157,3cyclictest0-21swapper/122:18:091
402773499156,4cyclictest170550irq/121-eno120:10:351
402773499156,1cyclictest170550irq/121-eno120:40:361
402773499153,8cyclictest4027731-21cyclictest23:01:131
402773499151,9cyclictest17907-21aten2.4-expect21:30:351
402773499151,7cyclictest303787-21munin-run00:15:011
402773499151,5cyclictest201462-21irqrtprio23:15:411
4027734991512,2cyclictest52653-21aten_repower_en21:50:341
4027734991512,2cyclictest4139231-21latency_hist20:40:021
4027734991512,2cyclictest4048423-21latency_hist19:25:011
4027734991512,2cyclictest3790-21kthreadcore21:20:441
4027734991512,2cyclictest305819-21kthreadcore00:15:401
4027734991512,2cyclictest240187-21timerandwakeup23:35:461
4027734991512,2cyclictest1652-1atopacctd22:20:361
4027734991512,2cyclictest162282-21threads22:50:461
4027734991511,3cyclictest8734-21sendmail-mta19:45:421
4027734991511,3cyclictest4130217-21kthreadcore20:30:411
4027734991511,3cyclictest4086236-21kthreadcore19:55:401
4027734991511,3cyclictest4015689-21kworker/u16:3+nfsiod23:53:401
4027734991511,3cyclictest1652-1atopacctd21:45:421
4027734991511,3cyclictest135648-21pmu-power22:35:441
4027734991511,3cyclictest1-21systemd20:05:001
4027734991510,4cyclictest4172943-21kthreadcore21:05:411
402773399158,4cyclictest4175949-21diskmemload00:36:490
4027733991512,2cyclictest4096182-21timerwakeupswit20:00:480
4027733991512,2cyclictest4015689-21kworker/u16:3-events_unbound23:14:400
4027733991512,2cyclictest231026-21cat23:30:460
4027733991512,2cyclictest17142-21grep21:30:010
4027733991512,2cyclictest1700-21systemd-logind21:35:010
4027733991512,2cyclictest1-21systemd19:41:080
4027733991510,4cyclictest4115561-21cpuspeed_turbos20:20:350
4027733991510,4cyclictest33249-21kworker/u16:2-xprtiod22:34:510
4027733991510,2cyclictest4163965-21munin-run21:00:010
302487291150,6phc2sys0-21swapper/322:20:463
302487291150,2phc2sys0-21swapper/323:17:303
302487291150,2phc2sys0-21swapper/322:08:403
302487291150,2phc2sys0-21swapper/300:28:393
302487291150,2phc2sys0-21swapper/300:28:393
4027735991412,1cyclictest0-21swapper/223:05:462
4027735991412,1cyclictest0-21swapper/222:45:342
4027735991412,1cyclictest0-21swapper/219:50:012
4027735991412,1cyclictest0-21swapper/219:30:432
4027735991412,1cyclictest0-21swapper/219:30:002
4027735991412,1cyclictest0-21swapper/219:15:012
4027735991411,2cyclictest0-21swapper/221:00:412
4027735991411,1cyclictest0-21swapper/223:35:012
4027735991411,1cyclictest0-21swapper/223:20:352
4027735991411,1cyclictest0-21swapper/222:40:412
4027735991411,1cyclictest0-21swapper/222:35:362
4027735991411,1cyclictest0-21swapper/222:10:412
4027735991411,1cyclictest0-21swapper/222:05:422
4027735991411,1cyclictest0-21swapper/222:00:412
4027735991411,1cyclictest0-21swapper/221:35:452
4027735991411,1cyclictest0-21swapper/221:35:452
4027735991411,1cyclictest0-21swapper/221:25:352
4027735991411,1cyclictest0-21swapper/220:45:392
4027735991411,1cyclictest0-21swapper/219:55:422
4027735991411,1cyclictest0-21swapper/219:40:432
402773599140,5cyclictest40908612sleep220:00:032
4027734991411,2cyclictest95340-21ssh22:15:011
4027734991411,2cyclictest61283-21telnet21:55:371
4027734991411,2cyclictest4054704-21aten_repower_fr19:30:351
4027734991410,3cyclictest4123531-21kthreadcore20:25:411
4027734991410,3cyclictest251757-21kworker/u16:0+nfsiod00:00:261
4027734991410,2cyclictest2160922sleep123:23:411
4027734991410,1cyclictest170550irq/121-eno121:35:211
4027734991410,1cyclictest170550irq/121-eno121:35:211
402773499140,7cyclictest35015-21ssh21:40:341
402773499140,1cyclictest0-21swapper/119:50:341
402773399147,2cyclictest0-21swapper/023:45:400
402773399147,2cyclictest0-21swapper/023:45:400
402773399145,7cyclictest4040168-21tr19:15:400
402773399145,7cyclictest4040168-21tr19:15:400
4027733991412,1cyclictest4139509-21latency_hist20:40:020
4027733991411,2cyclictest95904-21aten_repower_fr22:15:340
4027733991411,2cyclictest4121006-21dump-pmu-power20:29:550
4027733991411,2cyclictest4099840-21kthreadcore20:05:430
4027733991411,2cyclictest4066437-21systemd-run19:40:010
4027733991411,2cyclictest4054343-21latency_hist19:30:000
4027733991411,2cyclictest4027731-21cyclictest21:52:270
4027733991411,2cyclictest296511-21hddtemp_smartct00:10:400
4027733991411,2cyclictest188454-21timerwakeupswit23:05:500
4027733991410,3cyclictest86556-21kworker/u16:0+nfsiod22:41:370
4027733991410,3cyclictest86556-21kworker/u16:0+nfsiod22:10:250
402773399140,12cyclictest4084254-21sshd19:51:070
302487291142,3phc2sys0-21swapper/321:11:333
302487291141,3phc2sys0-21swapper/319:45:343
302487291140,2phc2sys0-21swapper/322:44:003
302487291140,2phc2sys0-21swapper/321:16:043
302487291140,2phc2sys0-21swapper/300:36:123
4027735991311,1cyclictest0-21swapper/223:35:412
4027735991311,1cyclictest0-21swapper/223:00:012
4027735991311,1cyclictest0-21swapper/219:20:002
4027735991311,1cyclictest0-21swapper/219:20:002
4027735991311,1cyclictest0-21swapper/219:10:022
4027735991310,1cyclictest0-21swapper/223:00:412
4027735991310,1cyclictest0-21swapper/221:50:392
4027735991310,1cyclictest0-21swapper/221:15:412
4027735991310,1cyclictest0-21swapper/220:50:412
4027735991310,1cyclictest0-21swapper/220:35:402
4027735991310,1cyclictest0-21swapper/220:25:412
4027735991310,1cyclictest0-21swapper/220:15:392
4027735991310,1cyclictest0-21swapper/219:50:422
4027735991310,1cyclictest0-21swapper/200:25:352
4027735991310,1cyclictest0-21swapper/200:25:352
402773599130,11cyclictest0-21swapper/223:12:152
402773499139,3cyclictest70228-21cpuspeed_turbos22:00:371
402773499139,3cyclictest4069524-21kthreadcore19:40:451
402773499139,1cyclictest170550irq/121-eno121:00:351
402773499135,3cyclictest4109353-21aten2.4-expect20:15:341
4027734991310,2cyclictest4015689-21kworker/u16:3-events_unbound20:05:371
4027734991310,2cyclictest0-21swapper/123:55:351
402773399134,8cyclictest291534-21tr00:05:420
4027733991310,2cyclictest4106419-21kthreadcore20:10:410
4027733991310,2cyclictest4087697-21kthreadcore19:55:410
4027733991310,2cyclictest4055258-21cut19:30:380
4027733991310,2cyclictest322970-21irqrtprio00:25:380
4027733991310,2cyclictest322970-21irqrtprio00:25:380
4027733991310,2cyclictest0-21swapper/020:15:370
302487291130,3phc2sys0-21swapper/322:58:493
302487291130,2phc2sys0-21swapper/323:46:593
302487291130,2phc2sys0-21swapper/323:46:593
302487291130,2phc2sys0-21swapper/323:32:253
302487291130,2phc2sys0-21swapper/323:28:473
302487291130,2phc2sys0-21swapper/300:23:323
302487291130,2phc2sys0-21swapper/300:00:143
402773599129,1cyclictest0-21swapper/219:35:352
382042120,2sleep30-21swapper/321:40:423
302487291123,3phc2sys0-21swapper/323:00:393
302487291120,3phc2sys0-21swapper/322:25:323
302487291120,3phc2sys0-21swapper/319:15:333
302487291120,3phc2sys0-21swapper/319:15:333
302487291120,2phc2sys0-21swapper/323:10:323
302487291120,2phc2sys0-21swapper/321:50:103
302487291120,2phc2sys0-21swapper/321:21:533
402773399118,2cyclictest4140566-21irqcore20:40:400
302487291113,2phc2sys0-21swapper/300:06:313
302487291111,2phc2sys0-21swapper/322:50:413
302487291111,2phc2sys0-21swapper/320:30:423
302487291110,4phc2sys0-21swapper/320:45:323
302487291110,3phc2sys0-21swapper/322:11:143
302487291110,3phc2sys0-21swapper/321:29:053
302487291110,2phc2sys0-21swapper/319:10:363
302487291110,1phc2sys0-21swapper/319:52:553
402773499105,2cyclictest17450irq/132-ahci[0000:00:17.0]19:10:011
402773399108,1cyclictest0-21swapper/019:10:010
302487291103,3phc2sys0-21swapper/320:10:413
302487291101,2phc2sys0-21swapper/321:45:373
302487291101,2phc2sys0-21swapper/321:31:503
302487291100,5phc2sys0-21swapper/321:00:343
302487291100,4phc2sys0-21swapper/322:00:353
302487291100,3phc2sys0-21swapper/321:35:153
302487291100,3phc2sys0-21swapper/321:35:153
302487291100,3phc2sys0-21swapper/320:08:143
302487291100,3phc2sys0-21swapper/319:40:453
302487291100,2phc2sys0-21swapper/323:57:263
302487291100,2phc2sys0-21swapper/323:35:293
302487291100,2phc2sys0-21swapper/300:33:053
302487291100,2phc2sys0-21swapper/300:16:103
30248729191,3phc2sys0-21swapper/320:50:333
30248729191,2phc2sys0-21swapper/319:30:033
30248729191,2phc2sys0-21swapper/319:25:343
30248729190,4phc2sys41633342sleep320:55:453
30248729190,3phc2sys0-21swapper/320:40:363
30248729190,3phc2sys0-21swapper/319:35:443
30248729190,2phc2sys0-21swapper/321:05:283
30248729190,2phc2sys0-21swapper/320:35:433
30248729190,2phc2sys0-21swapper/320:20:443
30248729190,2phc2sys0-21swapper/320:19:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional