You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-26 - 08:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sun Oct 26, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
235912721050,2sleep30-21swapper/322:46:173
20654752880,2sleep30-21swapper/319:31:043
25197902300,1sleep10-21swapper/100:20:011
2038614992522,2cyclictest1635-21dbus-daemon23:45:011
2038614992516,4cyclictest260-21systemd-journal22:55:021
203860999250,16cyclictest2295212-21kthreadcore22:11:110
203860999249,5cyclictest0-21swapper/021:11:190
2038609992413,6cyclictest2038599-21cyclictest21:55:010
203860999239,5cyclictest1700-21systemd-logind00:40:010
203860999238,5cyclictest0-21swapper/000:30:010
203860999238,5cyclictest0-21swapper/000:30:010
2038609992310,6cyclictest2283908-21cstates22:06:090
2038614992219,2cyclictest2265089-21latency_hist21:55:021
203860999229,6cyclictest0-21swapper/023:36:110
203860999223,9cyclictest2207205-21kthreadcore21:21:110
2038609992219,2cyclictest1635-21dbus-daemon22:40:010
2038609992219,2cyclictest0-21swapper/023:05:000
2038609992213,5cyclictest2249077-21cstates21:46:060
203860999221,1cyclictest2485518-21apt-get00:01:040
2038609992210,4cyclictest2393806-21phc2sys23:06:130
2564091219,3phc2sys0-21swapper/322:31:073
2038615992118,1cyclictest0-21swapper/223:15:002
2038614992118,2cyclictest2101614-21cut20:00:001
2038614992115,2cyclictest170550irq/121-eno123:16:121
2038614992110,5cyclictest2307787-1ssh22:18:281
203860999218,5cyclictest2346463-21kthreadcore22:41:090
2038609992119,1cyclictest0-21swapper/020:50:010
2038609992118,2cyclictest0-21swapper/000:00:010
2038609992112,2cyclictest241rcuc/021:31:100
2038614992014,2cyclictest170550irq/121-eno123:37:101
2038614992010,6cyclictest2529330-21/usr/sbin/munin00:26:111
2038614992010,6cyclictest2529330-21/usr/sbin/munin00:26:111
2038614992010,5cyclictest2213363-1ssh21:25:401
203860999207,2cyclictest0-21swapper/021:27:120
2038609992011,2cyclictest0-21swapper/000:33:160
203860999200,2cyclictest2180484-21/usr/sbin/munin21:06:050
2564091191,5phc2sys0-21swapper/322:16:043
2564091190,2phc2sys0-21swapper/322:56:173
2564091190,2phc2sys0-21swapper/322:12:403
203861499199,2cyclictest170550irq/121-eno122:06:151
203861499197,7cyclictest2201761-21diskmemload21:16:341
2038614991916,2cyclictest2212630-21sh21:25:011
203861499191,10cyclictest2371045-1ssh22:55:571
2038614991910,4cyclictest2494423-21aten2.4-expect00:06:051
203860999199,4cyclictest0-21swapper/019:36:040
203860999195,3cyclictest0-21swapper/022:51:050
203860999194,7cyclictest1635-21dbus-daemon21:00:020
2038609991916,2cyclictest260-21systemd-journal23:50:000
203860999191,3cyclictest2053280-21munin-run19:20:020
203860999191,3cyclictest2053280-21munin-run19:20:020
203860999191,2cyclictest0-21swapper/023:54:150
203860999191,13cyclictest0-21swapper/023:17:080
2564091180,2phc2sys0-21swapper/322:50:193
2564091180,2phc2sys0-21swapper/300:04:423
2564091180,1phc2sys0-21swapper/321:49:433
2038615991815,1cyclictest0-21swapper/223:45:002
2038615991815,1cyclictest0-21swapper/222:50:292
2038615991815,1cyclictest0-21swapper/200:01:152
2038615991814,2cyclictest0-21swapper/223:06:162
203861499187,3cyclictest2521960-21kthreadcore00:21:121
203861499186,4cyclictest2401454-21kthreadcore23:11:141
203861499185,8cyclictest2193321-21diskmemload21:12:241
203861499185,3cyclictest0-21swapper/119:51:131
203861499184,9cyclictest2476844-21aten2.4-expect23:56:031
203861499183,4cyclictest2269113-21grep21:56:131
203861499183,10cyclictest2248615-21aten2.4-expect21:46:041
2038614991816,1cyclictest2300012-21turbostat22:15:001
2038614991815,2cyclictest2427920-21kthreadcore23:26:121
2038614991815,2cyclictest2388013-21gpgconf23:05:001
2038614991815,2cyclictest2174024-21cron21:00:001
2038614991815,2cyclictest0-21swapper/122:25:001
2038614991814,3cyclictest2462091-21kthreadcore23:46:111
2038614991814,3cyclictest2277702-21kthreadcore22:01:151
2038614991814,3cyclictest2109296-21kthreadcore20:06:091
2038614991814,3cyclictest2048627-21kthreadcore19:16:111
2038614991814,3cyclictest2048627-21kthreadcore19:16:111
2038614991812,2cyclictest17450irq/132-ahci[0000:00:17.0]22:45:001
203861499180,2cyclictest2065488-21apt-get19:31:041
203860999188,5cyclictest0-21swapper/021:19:030
203860999188,2cyclictest0-21swapper/000:09:400
203860999186,11cyclictest2282866-21cut22:05:020
2038609991815,2cyclictest2038599-21cyclictest19:45:010
2038609991815,2cyclictest1652-1atopacctd22:56:090
2564091170,3phc2sys0-21swapper/323:17:453
2564091170,1phc2sys0-21swapper/323:01:383
2038615991715,1cyclictest0-21swapper/219:40:012
2038615991714,1cyclictest0-21swapper/221:40:002
2038615991714,1cyclictest0-21swapper/221:15:012
2038615991714,1cyclictest0-21swapper/220:55:002
203861499177,1cyclictest170550irq/121-eno122:26:131
203861499175,5cyclictest0-21swapper/100:01:041
203861499173,4cyclictest2132269-21aten2.4-expect20:26:071
203861499172,5cyclictest2084018-21aten2.4-expect19:46:061
203861499172,10cyclictest351ktimers/119:41:151
203861499172,10cyclictest2144290-21aten2.4-expect20:36:051
203861499171,7cyclictest2433390-21perl23:31:071
203861499171,7cyclictest0-21swapper/123:51:141
2038614991714,2cyclictest2231208-21head21:36:031
2038614991714,2cyclictest2186137-21diskmemload00:31:121
2038614991714,2cyclictest2116792-21kthreadcore20:11:131
2038614991714,2cyclictest0-21swapper/119:10:021
2038614991713,3cyclictest2143263-21timerandwakeup20:31:171
2038614991713,3cyclictest0-21swapper/122:50:021
2038614991712,1cyclictest170550irq/121-eno120:16:051
203860999175,4cyclictest2358302-21grep22:46:120
203860999172,8cyclictest0-21swapper/022:22:250
203860999172,2cyclictest0-21swapper/020:06:040
203860999171,8cyclictest0-21swapper/020:31:050
203860999171,7cyclictest2119340-21users20:11:190
2038609991715,1cyclictest2510793-21cron00:15:010
2038609991714,2cyclictest2168113-21munin-plugin-st20:55:010
203860999171,3cyclictest0-21swapper/023:22:040
2038609991713,2cyclictest0-21swapper/000:20:020
2038609991712,2cyclictest0-21swapper/022:16:070
2038609991711,5cyclictest2453063-21kthreadcore23:41:120
2564091166,2phc2sys0-21swapper/320:10:013
2038615991613,1cyclictest0-21swapper/222:56:052
2038615991613,1cyclictest0-21swapper/222:25:002
2038615991613,1cyclictest0-21swapper/200:30:002
2038615991613,1cyclictest0-21swapper/200:30:002
2038615991612,2cyclictest0-21swapper/221:31:082
2038615991612,2cyclictest0-21swapper/220:15:002
203861499166,6cyclictest2044736-21awk19:15:001
203861499165,4cyclictest2327662-21aten2.4-expect22:31:081
203861499165,3cyclictest0-21swapper/122:36:071
203861499164,7cyclictest2546912-21aten2.4-expect00:36:061
203861499164,7cyclictest2228741-21diskmemload21:32:471
203861499164,7cyclictest2126225-21aten2.4-expect20:21:041
203861499163,7cyclictest2417809-21cat23:21:121
203861499162,9cyclictest2156448-21aten2.4-expect20:46:051
203861499162,9cyclictest2059496-21aten2.4-expect19:26:041
2038614991613,2cyclictest2073053-21kthreadcore19:36:101
2038614991612,3cyclictest2167142-21phc2sys20:51:141
203861499161,10cyclictest2389013-21aten2.4-expect23:06:031
203861499160,3cyclictest0-21swapper/121:41:051
203860999167,8cyclictest0-21swapper/022:30:010
203860999166,3cyclictest170550irq/121-eno119:46:050
203860999165,6cyclictest0-21swapper/019:53:090
203860999165,2cyclictest2059070-21munin-run19:25:000
203860999164,2cyclictest0-21swapper/021:57:480
203860999162,3cyclictest0-21swapper/021:44:130
203860999162,2cyclictest0-21swapper/023:26:560
203860999162,2cyclictest0-21swapper/022:30:550
203860999161,7cyclictest0-21swapper/023:30:340
203860999161,2cyclictest2398862-21sed23:11:120
2038609991612,3cyclictest2043270-21kthreadcore19:11:120
203860999160,9cyclictest2120029-21/usr/sbin/munin20:16:080
203860999160,8cyclictest2231103-21apt-get21:36:010
203860999160,2cyclictest2038886-21munin-run19:10:030
2564091150,2phc2sys0-21swapper/322:29:553
2564091150,2phc2sys0-21swapper/321:43:543
2564091150,1phc2sys0-21swapper/323:36:563
2564091150,1phc2sys0-21swapper/300:21:303
2038615991513,1cyclictest0-21swapper/223:30:022
2038615991512,1cyclictest0-21swapper/223:50:002
2038615991512,1cyclictest0-21swapper/223:35:012
2038615991512,1cyclictest0-21swapper/223:20:582
2038615991512,1cyclictest0-21swapper/221:16:082
2038615991512,1cyclictest0-21swapper/220:40:012
2038615991512,1cyclictest0-21swapper/219:34:102
2038615991511,2cyclictest0-21swapper/222:26:082
203861599150,5cyclictest0-21swapper/222:00:012
203861499155,4cyclictest2053485-21aten2.4-expect19:21:041
203861499154,6cyclictest2484690-21kworker/u16:2+xprtiod00:10:251
2038614991512,2cyclictest2176074-21kthreadcore21:01:121
2038614991511,3cyclictest2185461-21mailstats21:06:151
2038614991511,3cyclictest2103289-21kthreadcore20:01:111
203860999157,4cyclictest0-21swapper/020:00:530
203860999153,2cyclictest0-21swapper/000:20:570
203860999152,6cyclictest0-21swapper/020:38:100
203860999151,6cyclictest2059970-21diskstats19:26:070
2038609991512,2cyclictest2127221-21tr20:21:090
2038609991511,3cyclictest2132836-21head20:26:100
203860999150,2cyclictest0-21swapper/021:01:020
2564091141,2phc2sys0-21swapper/323:47:513
2564091140,3phc2sys0-21swapper/322:00:263
2564091140,2phc2sys0-21swapper/323:52:323
2564091140,2phc2sys0-21swapper/323:25:543
2564091140,2phc2sys0-21swapper/323:20:543
2564091140,2phc2sys0-21swapper/321:34:553
2564091140,2phc2sys0-21swapper/321:26:033
2564091140,2phc2sys0-21swapper/319:26:143
203861599147,2cyclictest0-21swapper/222:00:122
203861599141,7cyclictest0-21swapper/222:10:012
2038615991412,1cyclictest0-21swapper/222:40:022
2038615991412,1cyclictest0-21swapper/221:46:052
2038615991412,1cyclictest0-21swapper/219:15:022
2038615991412,1cyclictest0-21swapper/219:15:022
2038615991411,1cyclictest0-21swapper/223:01:052
2038615991411,1cyclictest0-21swapper/222:31:072
2038615991411,1cyclictest0-21swapper/222:11:232
2038615991411,1cyclictest0-21swapper/221:41:122
2038615991411,1cyclictest0-21swapper/221:26:062
2038615991411,1cyclictest0-21swapper/221:06:102
2038615991411,1cyclictest0-21swapper/220:31:062
2038615991411,1cyclictest0-21swapper/219:41:052
2038615991411,1cyclictest0-21swapper/200:36:142
2038615991411,1cyclictest0-21swapper/200:06:062
2038615991410,2cyclictest0-21swapper/222:46:112
2038615991410,2cyclictest0-21swapper/200:31:102
2038614991411,2cyclictest2150377-21aten_repower_en20:41:051
203860999148,2cyclictest170550irq/121-eno120:40:030
2564091131,2phc2sys0-21swapper/319:16:103
2564091131,2phc2sys0-21swapper/319:16:103
2564091130,2phc2sys0-21swapper/300:35:243
2564091130,2phc2sys0-21swapper/300:11:473
24498052130,3sleep30-21swapper/323:40:253
203861599139,2cyclictest0-21swapper/223:56:102
203861599131,5cyclictest0-21swapper/223:40:012
2038615991311,1cyclictest0-21swapper/223:20:012
2038615991311,1cyclictest0-21swapper/222:41:092
2038615991311,1cyclictest0-21swapper/221:51:112
2038615991311,1cyclictest0-21swapper/220:25:022
2038615991311,1cyclictest0-21swapper/219:51:062
2038615991311,1cyclictest0-21swapper/200:20:022
2038615991311,1cyclictest0-21swapper/200:11:192
2038615991310,1cyclictest0-21swapper/223:51:102
2038615991310,1cyclictest0-21swapper/222:16:122
2038615991310,1cyclictest0-21swapper/220:45:212
2038615991310,1cyclictest0-21swapper/220:06:072
2038615991310,1cyclictest0-21swapper/219:46:122
2038615991310,1cyclictest0-21swapper/219:26:062
2038615991310,1cyclictest0-21swapper/219:14:102
2038609991311,1cyclictest191rcu_preempt19:56:040
2038609991310,2cyclictest2065504-21aten_repower_cu19:31:050
2564091124,3phc2sys0-21swapper/323:15:013
2564091123,2phc2sys0-21swapper/319:56:113
2564091120,2phc2sys0-21swapper/322:36:213
2564091120,2phc2sys0-21swapper/321:16:413
2564091120,2phc2sys0-21swapper/319:51:063
2564091120,1phc2sys0-21swapper/320:20:113
2564091120,1phc2sys0-21swapper/320:16:463
2564091120,1phc2sys0-21swapper/319:24:293
203861599129,1cyclictest0-21swapper/221:21:072
203861599129,1cyclictest0-21swapper/220:56:102
203861599129,1cyclictest0-21swapper/220:16:102
203861599129,1cyclictest0-21swapper/220:01:052
203861599129,1cyclictest0-21swapper/219:56:112
203861599129,1cyclictest0-21swapper/219:25:022
203861599128,2cyclictest0-21swapper/221:01:122
2038615991210,1cyclictest0-21swapper/220:41:122
2038615991210,1cyclictest0-21swapper/220:26:132
2564091112,3phc2sys0-21swapper/323:06:113
2564091112,2phc2sys0-21swapper/300:28:463
2564091112,2phc2sys0-21swapper/300:28:463
2564091111,2phc2sys0-21swapper/321:11:563
2564091111,2phc2sys0-21swapper/321:06:113
2564091111,2phc2sys0-21swapper/320:31:133
2564091110,2phc2sys0-21swapper/300:16:043
2564091110,1phc2sys0-21swapper/320:52:213
203861599110,8cyclictest25199612sleep200:20:032
2564091101,2phc2sys0-21swapper/322:42:343
2564091101,2phc2sys0-21swapper/321:58:573
2564091101,2phc2sys0-21swapper/321:36:213
2564091101,2phc2sys0-21swapper/320:46:043
2564091101,2phc2sys0-21swapper/319:46:173
2564091101,2phc2sys0-21swapper/319:06:133
2564091101,2phc2sys0-21swapper/300:31:153
2564091100,2phc2sys0-21swapper/323:55:563
2564091100,2phc2sys0-21swapper/323:30:223
2564091100,2phc2sys0-21swapper/322:20:253
2564091100,2phc2sys0-21swapper/321:51:443
2564091100,2phc2sys0-21swapper/321:23:143
2564091100,2phc2sys0-21swapper/321:01:103
2564091100,2phc2sys0-21swapper/319:40:353
2564091100,2phc2sys0-21swapper/319:14:103
2564091100,2phc2sys0-21swapper/300:09:553
2564091100,1phc2sys0-21swapper/322:05:193
256409191,2phc2sys0-21swapper/320:01:073
256409190,2phc2sys0-21swapper/320:56:173
256409190,2phc2sys0-21swapper/320:41:113
256409190,2phc2sys0-21swapper/320:26:083
256409190,2phc2sys0-21swapper/320:11:133
256409190,2phc2sys0-21swapper/319:35:113
256409180,2phc2sys0-21swapper/320:35:103
20386159975,1cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional