You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 10:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Wed Nov 19, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8047721520,2sleep30-21swapper/300:05:543
1291552310,2sleep20-21swapper/200:35:392
3813213992522,1cyclictest0-21swapper/222:35:002
3813210992421,2cyclictest3852600-21systemd-run19:40:011
3813207992316,6cyclictest4128613-21/usr/sbin/munin22:45:400
3813207992316,2cyclictest0-21swapper/022:15:400
3813207992213,5cyclictest4001246-21kthreadcore21:30:410
3813207992213,5cyclictest103638-21kthreadcore00:20:380
3813207992212,5cyclictest3965452-21kthreadcore21:10:370
3813210992118,2cyclictest3944805-21apt-key20:55:011
3813210992113,3cyclictest0-21swapper/120:20:001
3813207992118,2cyclictest4110735-21sh22:35:010
3813210992017,2cyclictest3926373-21apt-get20:40:011
3813210992012,3cyclictest0-21swapper/123:25:001
3813210992012,3cyclictest0-21swapper/123:20:011
3813207992017,2cyclictest4145363-21perf22:55:000
3813207992011,5cyclictest4034430-21kthreadcore21:50:390
3813207992010,5cyclictest0-21swapper/000:05:390
3813210991917,1cyclictest4049763-21dump-pmu-power22:00:001
3813210991916,2cyclictest4076058-21sh22:15:021
3813210991916,2cyclictest3876817-21latency_hist20:00:001
3813210991915,2cyclictest0-21swapper/120:35:001
3813210991911,3cyclictest0-21swapper/123:45:011
381320799197,7cyclictest0-21swapper/023:55:010
3813207991916,2cyclictest91473-21sh00:15:000
3813207991911,4cyclictest58716-21kthreadcore23:55:390
3813207991911,4cyclictest44222-21kthreadcore23:45:390
3813207991911,4cyclictest4067695-21/usr/sbin/munin22:10:350
302487291190,2phc2sys0-21swapper/323:38:433
302487291190,2phc2sys0-21swapper/322:03:283
302487291190,2phc2sys0-21swapper/321:15:553
3813213991816,1cyclictest0-21swapper/220:20:002
3813213991815,1cyclictest0-21swapper/221:30:002
3813213991815,1cyclictest0-21swapper/200:26:242
3813210991815,2cyclictest4023969-21munin-plugin-st21:45:011
3813210991814,2cyclictest13179-21grep23:30:021
3813210991810,3cyclictest0-21swapper/120:15:011
381320799189,5cyclictest118392-21aten_repower_vo00:30:330
381320799189,4cyclictest1661-21polkitd23:20:000
3813207991815,2cyclictest1629-21avahi-daemon23:32:530
3813207991812,5cyclictest4093822-21aten_repower_en22:25:310
302487291180,3phc2sys0-21swapper/322:19:343
302487291180,2phc2sys0-21swapper/322:08:213
40910472170,2sleep30-21swapper/322:21:263
3813213991715,1cyclictest0-21swapper/221:20:022
3813213991714,1cyclictest0-21swapper/223:46:492
3813213991714,1cyclictest0-21swapper/222:50:392
3813213991714,1cyclictest0-21swapper/221:55:382
3813213991714,1cyclictest0-21swapper/200:05:372
3813213991713,2cyclictest0-21swapper/223:35:412
3813213991713,1cyclictest0-21swapper/223:25:312
381321099179,3cyclictest0-21swapper/122:45:351
3813210991714,2cyclictest4163297-21systemd-run23:05:011
3813210991714,2cyclictest4163297-21systemd-run23:05:011
3813210991714,2cyclictest4093117-21idleruntime-cro22:25:011
3813210991714,2cyclictest39862-21/usr/sbin/munin23:45:441
3813210991714,2cyclictest3813203-21cyclictest23:30:351
3813210991714,2cyclictest3813203-21cyclictest00:20:381
3813210991713,3cyclictest121049-21kthreadcore00:30:401
381321099171,14cyclictest260-21systemd-journal21:03:531
3813210991710,3cyclictest4177202-21kthreadcore23:10:471
3813210991710,3cyclictest4177202-21kthreadcore23:10:471
381320799178,4cyclictest4064177-21cut22:05:430
381320799178,4cyclictest0-21swapper/000:25:320
3813207991714,2cyclictest1-21systemd20:15:010
3813207991714,2cyclictest0-21swapper/019:15:030
302487291172,2phc2sys0-21swapper/323:47:373
302487291171,2phc2sys0-21swapper/300:24:353
302487291170,2phc2sys0-21swapper/323:55:203
835298160,1rtkit-daemon0-21swapper/121:32:471
3813213991614,1cyclictest0-21swapper/221:20:392
3813213991613,1cyclictest0-21swapper/221:40:012
3813213991613,1cyclictest0-21swapper/220:50:002
381321099169,3cyclictest4110697-21apt-key22:35:001
381321099169,3cyclictest1652-1atopacctd22:35:391
381321099169,2cyclictest0-21swapper/100:20:021
381321099168,3cyclictest2035-21sshd22:02:261
381321099167,4cyclictest0-21swapper/122:15:441
3813210991613,2cyclictest70-21kcompactd023:55:021
3813210991613,2cyclictest4145426-21/usr/sbin/munin22:55:011
3813210991613,2cyclictest4027665-21kthreadcore21:45:401
3813210991613,2cyclictest0-21swapper/122:30:001
3813210991612,3cyclictest3946453-21kthreadcore20:55:371
3813210991610,2cyclictest170550irq/121-eno121:35:371
381320799168,2cyclictest0-21swapper/000:35:100
381320799167,5cyclictest24749-21kthreadcore23:35:400
381320799167,2cyclictest0-21swapper/021:45:340
381320799164,7cyclictest4120623-21fschecks_count22:40:350
381320799163,4cyclictest4165182-21irqrtprio23:05:370
381320799162,8cyclictest1-21systemd19:25:010
3813207991614,1cyclictest3907821-21idleruntime-cro20:25:000
3813207991613,2cyclictest7602-21cron20:50:000
3813207991613,2cyclictest4156153-21irqrtprio23:00:380
3813207991613,2cyclictest4156153-21irqrtprio23:00:380
3813207991613,2cyclictest3980727-21systemd-run21:20:020
3813207991613,2cyclictest3932375-21dump-pmu-power20:45:000
3813207991613,2cyclictest3926153-21gpgconf20:40:010
302487291163,2phc2sys0-21swapper/321:24:083
302487291160,2phc2sys0-21swapper/321:43:443
302487291160,2phc2sys0-21swapper/300:32:073
381321399151,8cyclictest0-21swapper/222:40:022
3813213991513,1cyclictest0-21swapper/223:00:012
3813213991513,1cyclictest0-21swapper/223:00:012
3813213991513,1cyclictest0-21swapper/222:20:392
3813213991513,1cyclictest0-21swapper/222:15:022
3813213991513,1cyclictest0-21swapper/220:35:332
3813213991512,1cyclictest0-21swapper/223:55:362
3813213991512,1cyclictest0-21swapper/223:20:422
3813213991512,1cyclictest0-21swapper/223:10:462
3813213991512,1cyclictest0-21swapper/223:10:462
3813213991512,1cyclictest0-21swapper/223:05:372
3813213991512,1cyclictest0-21swapper/221:50:362
3813213991512,1cyclictest0-21swapper/221:46:472
3813213991512,1cyclictest0-21swapper/220:35:012
3813213991512,1cyclictest0-21swapper/220:25:002
3813213991512,1cyclictest0-21swapper/220:10:372
3813213991512,1cyclictest0-21swapper/219:35:012
3813213991512,1cyclictest0-21swapper/219:20:362
3813213991512,1cyclictest0-21swapper/200:20:382
3813213991512,1cyclictest0-21swapper/200:16:572
3813213991512,1cyclictest0-21swapper/200:00:372
3813213991511,2cyclictest0-21swapper/200:10:402
381321099158,5cyclictest260-21systemd-journal20:50:001
381321099157,3cyclictest0-21swapper/121:15:381
381321099154,5cyclictest3963037-21diskmemload21:26:321
3813210991512,2cyclictest65753-21systemd-run00:00:021
3813210991512,2cyclictest4120944-21irqcore22:40:371
3813210991512,2cyclictest3828946-21fschecks_time19:20:351
3813210991512,2cyclictest3820146-21kthreadcore19:15:031
3813210991512,2cyclictest3813407-21latency_hist19:10:021
3813210991512,2cyclictest3813203-21cyclictest21:05:361
3813210991512,2cyclictest24054-21kthreadcore23:35:401
3813210991512,2cyclictest117622-21latency_hist00:30:001
3813210991511,3cyclictest4034430-21kthreadcore21:50:391
3813210991511,3cyclictest4023801-21kworker/u16:0+nfsiod23:05:261
3813210991511,3cyclictest3907320-21unixbench-2d20:20:431
3813210991511,2cyclictest0-21swapper/121:25:021
381320799157,4cyclictest0-21swapper/023:25:010
381320799156,4cyclictest0-21swapper/000:00:440
381320799155,4cyclictest3963017-21sshd21:09:530
381320799153,7cyclictest3983958-21kthreadcore21:20:380
381320799153,6cyclictest171ktimers/021:29:310
381320799152,7cyclictest3871167-21aten2.4-expect19:55:300
381320799152,6cyclictest9249-21kthreadcore23:25:400
381320799152,12cyclictest4145983-21ssh22:55:310
381320799152,12cyclictest4145983-21ssh22:55:310
3813207991513,1cyclictest0-21swapper/022:40:020
3813207991512,2cyclictest4016746-21irqcore21:40:370
3813207991512,2cyclictest3944698-21latency_hist20:55:010
3813207991512,2cyclictest1700-21systemd-logind21:05:010
3813207991512,2cyclictest1635-21dbus-daemon22:25:020
3813207991512,2cyclictest1-21systemd20:57:150
3813207991511,1cyclictest3963037-21diskmemload23:14:430
3813207991511,1cyclictest3963037-21diskmemload23:14:430
302487291153,2phc2sys0-21swapper/322:40:273
302487291150,6phc2sys0-21swapper/319:05:393
302487291150,2phc2sys0-21swapper/300:37:293
381321399141,5cyclictest0-21swapper/221:30:332
3813213991412,1cyclictest0-21swapper/223:35:012
3813213991412,1cyclictest0-21swapper/222:05:402
3813213991411,1cyclictest0-21swapper/223:54:492
3813213991411,1cyclictest0-21swapper/223:15:392
3813213991411,1cyclictest0-21swapper/223:00:332
3813213991411,1cyclictest0-21swapper/223:00:332
3813213991411,1cyclictest0-21swapper/222:00:372
3813213991411,1cyclictest0-21swapper/221:40:332
3813213991411,1cyclictest0-21swapper/220:40:422
3813213991411,1cyclictest0-21swapper/219:42:012
3813213991410,2cyclictest0-21swapper/222:45:372
381321099142,2cyclictest170550irq/121-eno119:40:351
3813210991411,2cyclictest4148338-21kthreadcore22:55:381
3813210991411,2cyclictest4148338-21kthreadcore22:55:381
3813210991411,2cyclictest4059126-21aten_repower_cu22:05:321
3813210991411,2cyclictest3966317-21kthreadcore21:10:381
3813210991411,2cyclictest3929421-21kthreadcore20:40:421
3813210991411,2cyclictest3913402-21unixbench-2d20:25:431
3813210991411,2cyclictest3834064-21dump-pmu-power19:29:561
3813210991411,2cyclictest0-21swapper/100:40:011
3813210991410,3cyclictest68675-21kthreadcore00:00:381
3813210991410,3cyclictest3877864-21gltestperf20:00:371
3813210991410,3cyclictest3826373-21kthreadcore19:15:401
3813210991410,2cyclictest0-21swapper/100:10:451
381320799148,5cyclictest4052081-21tr22:00:400
381320799146,7cyclictest3857338-21tr19:40:380
381320799143,4cyclictest4013844-21sshd21:37:530
3813207991411,2cyclictest95760-21kthreadcore00:15:400
3813207991411,2cyclictest4042367-21fschecks_time21:55:340
3813207991411,2cyclictest39414-21cut23:45:020
3813207991411,2cyclictest3909726-21kthreadcore20:25:360
3813207991411,2cyclictest3897030-21kthreadcore20:15:400
3813207991411,2cyclictest3849077-21kthreadcore19:35:380
3813207991411,2cyclictest3839837-21sshd19:26:510
3813207991411,2cyclictest3822874-21gltestperf19:15:360
302487291141,4phc2sys0-21swapper/323:50:293
302487291140,4phc2sys0-21swapper/300:27:513
302487291140,3phc2sys0-21swapper/323:08:113
302487291140,2phc2sys0-21swapper/321:48:253
381321399131,4cyclictest0-21swapper/220:10:022
381321399131,4cyclictest0-21swapper/219:20:022
3813213991311,1cyclictest0-21swapper/222:25:412
3813213991311,1cyclictest0-21swapper/222:15:402
3813213991311,1cyclictest0-21swapper/220:00:352
3813213991310,1cyclictest0-21swapper/223:40:362
3813213991310,1cyclictest0-21swapper/222:40:322
3813213991310,1cyclictest0-21swapper/221:10:312
3813213991310,1cyclictest0-21swapper/220:55:362
3813213991310,1cyclictest0-21swapper/220:50:372
3813213991310,1cyclictest0-21swapper/220:30:012
3813213991310,1cyclictest0-21swapper/219:35:322
3813213991310,1cyclictest0-21swapper/219:25:442
3813213991310,1cyclictest0-21swapper/219:10:332
3813213991310,1cyclictest0-21swapper/200:30:362
381321099136,6cyclictest3884616-21kthreadcore20:05:371
3813210991310,2cyclictest3865329-21cpuspeed_turbos19:50:331
3813210991310,2cyclictest3845568-21threads19:30:461
3813210991310,2cyclictest1652-1atopacctd00:05:121
381321099130,8cyclictest3864511-21runrttasks19:48:261
381320799134,5cyclictest3868428-21tr19:50:390
3813207991310,2cyclictest3915935-21kthreadcore20:30:370
3813207991310,2cyclictest3886242-21kthreadcore20:05:380
3813207991310,2cyclictest3842338-21kthreadcore19:30:400
3813207991310,2cyclictest0-21swapper/019:45:390
381320799130,8cyclictest3877992-21if_eno120:00:380
302487291130,3phc2sys0-21swapper/320:20:013
302487291130,2phc2sys0-21swapper/322:59:233
302487291130,2phc2sys0-21swapper/322:59:233
302487291130,2phc2sys0-21swapper/319:49:563
302487291130,2phc2sys0-21swapper/300:11:293
3813213991210,1cyclictest0-21swapper/219:55:372
3813213991210,1cyclictest0-21swapper/219:50:322
3813213991210,1cyclictest0-21swapper/219:45:382
381321399120,2cyclictest0-21swapper/221:05:322
302487291125,3phc2sys0-21swapper/323:00:113
302487291125,3phc2sys0-21swapper/323:00:113
302487291123,2phc2sys0-21swapper/319:35:443
302487291120,3phc2sys0-21swapper/321:55:303
302487291120,2phc2sys0-21swapper/322:48:333
302487291120,2phc2sys0-21swapper/321:29:453
302487291120,2phc2sys0-21swapper/320:25:303
302487291120,2phc2sys0-21swapper/319:18:133
381321399119,1cyclictest0-21swapper/219:10:022
381321399118,1cyclictest0-21swapper/221:00:382
302487291111,3phc2sys0-21swapper/323:21:403
302487291111,3phc2sys0-21swapper/322:34:583
302487291111,3phc2sys0-21swapper/300:00:433
302487291111,2phc2sys0-21swapper/323:15:143
302487291111,2phc2sys0-21swapper/323:10:383
302487291111,2phc2sys0-21swapper/323:10:383
302487291111,2phc2sys0-21swapper/322:14:063
302487291111,2phc2sys0-21swapper/320:05:383
302487291110,3phc2sys0-21swapper/321:52:023
302487291110,2phc2sys0-21swapper/322:35:023
302487291110,2phc2sys0-21swapper/319:22:213
302487291110,1phc2sys0-21swapper/320:58:123
302487291110,1phc2sys0-21swapper/320:24:343
302487291100,3phc2sys0-21swapper/323:40:073
302487291100,3phc2sys0-21swapper/323:30:013
302487291100,3phc2sys0-21swapper/322:27:003
302487291100,3phc2sys0-21swapper/321:35:393
302487291100,3phc2sys0-21swapper/321:30:583
302487291100,3phc2sys0-21swapper/321:10:303
302487291100,3phc2sys0-21swapper/321:05:333
302487291100,3phc2sys0-21swapper/320:45:013
302487291100,3phc2sys0-21swapper/320:14:563
302487291100,3phc2sys0-21swapper/319:40:293
302487291100,3phc2sys0-21swapper/319:30:433
302487291100,2phc2sys0-21swapper/323:30:133
302487291100,2phc2sys0-21swapper/321:04:563
302487291100,2phc2sys0-21swapper/320:50:023
302487291100,2phc2sys0-21swapper/300:18:423
30248729191,3phc2sys0-21swapper/322:50:453
30248729190,2phc2sys0-21swapper/320:50:263
30248729190,2phc2sys0-21swapper/320:35:323
30248729190,2phc2sys0-21swapper/320:30:313
30248729190,2phc2sys0-21swapper/320:00:093
30248729190,2phc2sys0-21swapper/319:55:323
30248729190,2phc2sys0-21swapper/319:50:403
30248729190,2phc2sys0-21swapper/319:25:383
30248729190,2phc2sys0-21swapper/319:10:433
38132079974,2cyclictest3813209-21apt-key19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional