You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-23 - 16:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Wed Apr 23, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25010913218,5phc2sys0-21swapper/322:23:473
25010912617,3phc2sys0-21swapper/300:07:583
25010912518,3phc2sys0-21swapper/323:20:493
25010912518,2phc2sys0-21swapper/321:29:323
1838694992513,3cyclictest2276029-21apt00:20:181
25010912418,2phc2sys0-21swapper/323:38:503
25010912418,2phc2sys0-21swapper/323:10:593
25010912418,2phc2sys0-21swapper/323:09:443
25010912418,2phc2sys0-21swapper/322:28:363
25010912418,2phc2sys0-21swapper/322:19:183
25010912418,2phc2sys0-21swapper/322:08:203
25010912418,2phc2sys0-21swapper/321:57:503
25010912418,2phc2sys0-21swapper/321:37:423
25010912418,2phc2sys0-21swapper/321:18:063
25010912417,3phc2sys0-21swapper/300:26:303
1838694992421,2cyclictest2244259-21latency_hist00:00:011
1838694992413,3cyclictest2042000-21runrttasks21:49:141
25010912318,3phc2sys0-21swapper/323:43:423
25010912318,3phc2sys0-21swapper/323:43:413
25010912318,3phc2sys0-21swapper/322:51:353
25010912318,3phc2sys0-21swapper/322:03:573
25010912318,3phc2sys0-21swapper/321:54:513
25010912318,3phc2sys0-21swapper/321:41:573
25010912318,3phc2sys0-21swapper/321:21:413
25010912318,3phc2sys0-21swapper/321:10:193
25010912318,3phc2sys0-21swapper/320:40:253
25010912318,3phc2sys0-21swapper/319:25:273
25010912318,3phc2sys0-21swapper/300:30:513
25010912318,3phc2sys0-21swapper/300:22:093
25010912317,3phc2sys0-21swapper/322:55:043
25010912317,2phc2sys0-21swapper/323:57:203
25010912317,2phc2sys0-21swapper/321:05:203
25010912317,2phc2sys0-21swapper/321:04:473
25010912317,2phc2sys0-21swapper/320:56:583
25010912317,2phc2sys0-21swapper/320:54:053
25010912317,2phc2sys0-21swapper/320:31:413
25010912317,2phc2sys0-21swapper/320:23:523
25010912317,2phc2sys0-21swapper/320:23:513
25010912317,2phc2sys0-21swapper/320:00:323
25010912317,2phc2sys0-21swapper/319:50:503
25010912317,2phc2sys0-21swapper/319:48:503
25010912317,2phc2sys0-21swapper/319:41:163
25010912317,2phc2sys0-21swapper/319:36:523
25010912317,2phc2sys0-21swapper/319:15:363
25010912317,2phc2sys0-21swapper/300:37:123
25010912317,2phc2sys0-21swapper/300:15:043
25010912317,2phc2sys0-21swapper/300:03:073
207357522318,3sleep30-21swapper/322:10:113
25010912217,3phc2sys0-21swapper/323:46:133
25010912217,3phc2sys0-21swapper/323:33:433
25010912217,3phc2sys0-21swapper/323:25:583
25010912217,3phc2sys0-21swapper/323:04:093
25010912217,3phc2sys0-21swapper/322:41:373
25010912217,3phc2sys0-21swapper/321:34:113
25010912217,3phc2sys0-21swapper/320:38:543
25010912217,3phc2sys0-21swapper/320:19:053
25010912217,3phc2sys0-21swapper/319:32:103
25010912217,3phc2sys0-21swapper/319:21:203
25010912217,3phc2sys0-21swapper/319:12:223
228663922218,2sleep20-21swapper/200:27:532
227183922218,2sleep20-21swapper/200:15:272
223397422218,2sleep20-21swapper/223:52:592
222522522218,2sleep20-21swapper/223:48:212
220201122218,2sleep20-21swapper/223:30:502
218230422218,2sleep30-21swapper/323:18:373
217999322218,2sleep20-21swapper/223:15:322
211224022218,2sleep20-21swapper/222:34:152
208128122218,2sleep20-21swapper/222:13:422
204149322218,2sleep30-21swapper/321:48:273
203653022218,2sleep20-21swapper/221:41:242
192004822218,2sleep20-21swapper/220:16:482
183869499221,9cyclictest1871992-21cat19:40:001
1838694992213,2cyclictest178850irq/121-eno122:35:001
25010912117,2phc2sys0-21swapper/322:48:103
25010912117,2phc2sys0-21swapper/322:33:493
25010912117,2phc2sys0-21swapper/320:29:583
25010912117,2phc2sys0-21swapper/320:06:493
25010912117,2phc2sys0-21swapper/300:10:213
228279422117,2sleep20-21swapper/200:22:292
226322522117,2sleep20-21swapper/200:10:352
225381522117,2sleep20-21swapper/200:05:252
223576722117,2sleep20-21swapper/223:55:152
221104922117,2sleep20-21swapper/223:36:042
219390022117,2sleep20-21swapper/223:27:062
219139222117,2sleep20-21swapper/223:23:442
216543422118,2sleep20-21swapper/223:10:022
216397322117,2sleep20-21swapper/223:08:102
213036322117,2sleep20-21swapper/222:44:412
212000222118,2sleep30-21swapper/322:37:293
210231722117,2sleep20-21swapper/222:27:502
209953722117,2sleep20-21swapper/222:24:052
208881722117,2sleep20-21swapper/222:16:322
207050722117,2sleep20-21swapper/222:06:022
200886822117,2sleep20-21swapper/221:25:342
199601922117,2sleep20-21swapper/221:15:322
195688922118,2sleep20-21swapper/220:49:272
1838694992118,2cyclictest2161417-21awk23:04:591
1838694992116,3cyclictest2136360-21kthreadcore22:50:271
183869399216,9cyclictest2003621-21tr21:20:270
1838693992115,5cyclictest1981499-21kworker/u16:1-rpciod21:30:240
1838693992113,4cyclictest2043366-21cstates21:50:150
25010912017,2phc2sys0-21swapper/320:47:103
25010912017,2phc2sys0-21swapper/320:12:203
25010912017,2phc2sys0-21swapper/319:58:543
229612522017,2sleep20-21swapper/200:33:472
196278922017,2sleep20-21swapper/220:52:192
195055522017,2sleep20-21swapper/220:40:402
194445422017,2sleep20-21swapper/220:38:372
193830922017,2sleep20-21swapper/220:32:352
190849122017,2sleep20-21swapper/220:10:042
190814922017,2sleep20-21swapper/220:09:112
189603222017,2sleep20-21swapper/219:59:212
188368122017,2sleep20-21swapper/219:46:222
186542922017,2sleep20-21swapper/219:30:402
185941822017,2sleep20-21swapper/219:26:312
185894822017,2sleep20-21swapper/219:24:272
184432122017,2sleep20-21swapper/219:10:492
1838694992010,3cyclictest3863153-21avahi-daemon20:35:001
183869399203,4cyclictest2293342-21phc2sys00:30:230
1838693992017,2cyclictest2038916-21cron21:45:000
1838693992017,2cyclictest1944734-21apt-key20:40:010
1838693992016,3cyclictest2195815-21cron23:30:000
1838693992016,3cyclictest0-21swapper/022:45:020
1838693992015,3cyclictest0-21swapper/000:10:030
1838693992014,2cyclictest178850irq/121-eno122:00:220
1838693992014,2cyclictest178850irq/121-eno100:35:190
1838693992010,6cyclictest2257576-21apt-get00:10:120
183869499191,9cyclictest2183350-21cat23:20:011
1838694991916,2cyclictest71-21kcompactd021:40:031
1838694991916,2cyclictest2266242-21apt-config00:15:001
1838694991916,2cyclictest2152603-21grep23:00:021
183869399199,6cyclictest2177452-21cut23:15:240
183869399199,6cyclictest2134481-21latency_hist22:50:020
183869399199,5cyclictest0-21swapper/022:35:280
183869399197,7cyclictest2232553-21diskmemload23:50:480
183869399192,5cyclictest2021336-21apt-get21:35:150
1838693991916,2cyclictest1995813-21mailstats21:15:290
1838693991913,2cyclictest178850irq/121-eno123:20:260
1838693991911,4cyclictest2217852-21kthreadcore23:40:260
1838693991911,4cyclictest2217852-21kthreadcore23:40:250
1838693991910,4cyclictest2107074-21cut22:30:270
1838695991816,1cyclictest0-21swapper/221:50:022
183869499181,8cyclictest1951085-21cat20:45:011
1838694991815,2cyclictest2130749-21apt-key22:45:001
1838694991815,2cyclictest2100442-21systemd-run22:25:011
1838694991815,2cyclictest1982337-21sort21:10:211
1838694991815,2cyclictest1838691-21cyclictest21:42:001
183869499180,9cyclictest2121898-21cat22:40:021
183869399188,5cyclictest0-21swapper/022:10:190
183869399184,8cyclictest1908701-21aten2.4-expect20:10:210
183869399182,5cyclictest1839108-21aten2.4-expect19:10:200
1838693991815,2cyclictest2144906-21irqcore22:55:210
1838693991815,2cyclictest1990260-21cut21:15:010
1838693991814,3cyclictest0-21swapper/023:05:010
1838693991814,2cyclictest1938706-21latency_hist20:35:010
1838693991812,2cyclictest178850irq/121-eno123:55:260
1838693991811,6cyclictest1838691-21cyclictest00:20:280
1838693991811,2cyclictest171ktimers/023:36:490
1838693991810,2cyclictest171ktimers/021:58:590
1838695991715,1cyclictest0-21swapper/200:40:012
1838695991714,1cyclictest0-21swapper/222:50:282
1838695991714,1cyclictest0-21swapper/221:00:002
183869499179,1cyclictest178850irq/121-eno123:21:181
1838694991714,2cyclictest2222983-21latency_hist23:45:021
1838694991714,2cyclictest2222983-21latency_hist23:45:021
1838694991714,2cyclictest1726-21systemd-logind21:10:021
1838694991714,2cyclictest1695-21dbus-daemon00:40:011
1838694991713,3cyclictest1943107-21kthreadcore20:35:261
1838694991711,4cyclictest0-21swapper/122:30:011
183869499170,8cyclictest2060635-21cat22:00:011
183869499170,15cyclictest1896122-21perf20:00:001
183869399179,4cyclictest1878365-21aten2.4-expect19:45:170
183869399176,5cyclictest2082333-21kworker/u16:4+nfsiod23:06:260
183869399175,7cyclictest2204025-21diskmemload23:34:010
183869399174,5cyclictest2213800-21kworker/u16:2+rpciod23:45:540
183869399173,9cyclictest1860172-21aten2.4-expect19:30:140
183869399172,3cyclictest2084034-21kthreadcore22:15:250
1838693991714,2cyclictest9311-21sendmail-mta19:20:250
1838693991714,2cyclictest2174446-21/usr/sbin/munin23:15:020
1838693991714,2cyclictest1963260-21latency_hist20:55:020
1838693991714,2cyclictest1901738-21unixbench_multi20:00:330
1838693991714,2cyclictest0-21swapper/022:30:010
1838693991714,2cyclictest0-21swapper/019:15:020
1838693991713,3cyclictest2140109-21mailstats22:50:320
1838693991713,3cyclictest1954177-21kthreadcore20:45:250
1838693991712,3cyclictest0-21swapper/020:25:010
1838693991712,3cyclictest0-21swapper/020:25:000
1838693991711,5cyclictest2240602-1atopacctd22:07:020
924598160,4rtkit-daemon1717-21smartd22:48:441
924598160,2rtkit-daemon1981222-21diskmemload00:28:321
1838695991614,1cyclictest0-21swapper/223:00:012
1838695991613,1cyclictest0-21swapper/223:05:002
1838695991613,1cyclictest0-21swapper/222:00:222
1838695991613,1cyclictest0-21swapper/221:35:002
1838695991613,1cyclictest0-21swapper/220:30:012
1838695991613,1cyclictest0-21swapper/219:40:002
183869499162,3cyclictest1963034-21munin-run20:55:001
1838694991613,2cyclictest2226890-21aten_repower_po23:50:131
1838694991613,2cyclictest2062402-21kthreadcore22:00:221
1838694991613,2cyclictest1927401-21tail20:25:211
1838694991613,2cyclictest1902319-21latency_hist20:05:021
1838694991613,2cyclictest1726-21systemd-logind19:55:021
1838694991611,3cyclictest1971822-21kthreadcore21:00:221
1838694991610,5cyclictest1907482-21mailstats20:05:271
1838694991610,4cyclictest2269138-21kthreadcore00:15:241
1838694991610,2cyclictest178850irq/121-eno119:29:241
183869399163,8cyclictest2041762-21diskmemload21:48:520
183869399162,9cyclictest2091836-21aten2.4-expect22:20:190
183869399161,8cyclictest2272243-21find00:15:300
1838693991613,2cyclictest1895114-21head19:55:260
1838693991613,2cyclictest1838859-21cut19:10:020
1838693991612,3cyclictest1978274-21kthreadcore21:05:260
1838693991612,3cyclictest1972205-21kthreadcore21:00:240
1838693991612,3cyclictest1966120-21kthreadcore20:55:250
1838693991612,3cyclictest1947967-21kthreadcore20:40:270
1838693991612,3cyclictest1903804-21kthreadcore20:05:230
1838695991513,1cyclictest0-21swapper/222:40:012
1838695991513,1cyclictest0-21swapper/222:00:012
1838695991512,1cyclictest0-21swapper/223:40:242
1838695991512,1cyclictest0-21swapper/223:40:232
1838695991512,1cyclictest0-21swapper/220:05:022
1838695991511,1cyclictest0-21swapper/221:15:012
183869499158,5cyclictest2226169-21sshd23:49:471
183869499157,3cyclictest17350irq/127-ahci[0000:00:17.0]20:55:301
1838694991512,2cyclictest770595-21systemd-journal19:25:021
1838694991512,2cyclictest2296909-21latency_hist00:35:021
1838694991512,2cyclictest2249934-21mailstats00:00:291
1838694991512,2cyclictest2201170-21tail23:30:231
1838694991512,2cyclictest1994802-21kthreadcore21:15:261
1838694991512,2cyclictest1707-21polkitd21:25:011
1838694991512,2cyclictest0-21swapper/119:50:011
183869499151,1cyclictest178850irq/121-eno121:29:031
1838694991511,3cyclictest1874980-21kthreadcore19:40:241
1838694991510,4cyclictest1-21systemd21:51:481
183869499150,13cyclictest2082183-21idleruntime-cro22:15:001
183869399159,5cyclictest0-21swapper/000:25:190
183869399151,4cyclictest0-21swapper/000:00:210
1838693991512,2cyclictest1981499-21kworker/u16:1-events_unbound21:30:020
1838693991511,3cyclictest1927870-21irqrtprio20:25:230
1838693991511,3cyclictest1917372-21kthreadcore20:15:260
1838693991510,2cyclictest1884495-21aten2.4-expect19:50:210
1838693991510,2cyclictest1867153-21irqcore19:35:240
1838695991411,1cyclictest0-21swapper/221:20:202
1838695991411,1cyclictest0-21swapper/221:05:202
1838695991411,1cyclictest0-21swapper/219:45:012
1838695991411,1cyclictest0-21swapper/200:00:262
183869499149,4cyclictest1981222-21diskmemload00:05:371
183869499147,5cyclictest178850irq/121-eno123:10:411
1838694991412,1cyclictest1909316-21tail20:10:241
1838694991411,2cyclictest2206737-21kthreadcore23:35:281
1838694991411,2cyclictest2015776-21kthreadcore21:30:191
1838694991411,2cyclictest1726-21systemd-logind20:25:011
1838694991411,2cyclictest1726-21systemd-logind20:25:001
1838694991410,3cyclictest2084982-21kthreadcore22:15:251
1838694991410,3cyclictest1845654-21kthreadcore19:15:021
183869599131,8cyclictest0-21swapper/221:00:152
1838695991311,1cyclictest0-21swapper/221:50:232
1838695991310,1cyclictest0-21swapper/221:37:362
1838695991310,1cyclictest0-21swapper/219:15:222
183869499139,3cyclictest1915727-21irqrtprio20:15:241
183869499138,4cyclictest2082333-21kworker/u16:4-rpciod23:27:071
1838694991310,2cyclictest2073457-21latency_hist22:10:031
1838694991310,2cyclictest1861819-21kthreadcore19:30:191
1838694991310,2cyclictest1841192-21kthreadcore19:10:261
1838694991310,2cyclictest0-21swapper/120:50:031
183869499130,10cyclictest2165276-21date23:10:011
183869399139,1cyclictest491rcuog/219:25:060
183869399138,1cyclictest178850irq/121-eno119:40:170
183869599129,1cyclictest0-21swapper/222:49:022
183869599129,1cyclictest0-21swapper/219:50:212
1838695991210,1cyclictest0-21swapper/220:21:182
1838695991210,1cyclictest0-21swapper/220:21:172
183869499129,2cyclictest1802863-21kworker/u16:1-writeback19:10:011
2501091102,2phc2sys0-21swapper/323:52:493
18386959997,1cyclictest0-21swapper/219:10:012
250109180,2phc2sys0-21swapper/319:05:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional