You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 07:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Wed Jul 02, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19869002980,2sleep30-21swapper/321:56:593
21160072820,2sleep02116008-21kthreadcore23:10:230
18583072810,1sleep11858306-21munin-run20:35:021
18881032430,1sleep00-21swapper/020:55:280
17774132330,1sleep00-21swapper/019:25:230
1752397992817,6cyclictest0-21swapper/022:05:010
1752397992615,6cyclictest0-21swapper/022:50:020
175239999251,10cyclictest0-21swapper/219:20:022
25010912417,2phc2sys0-21swapper/300:39:413
25010912416,2phc2sys0-21swapper/319:10:203
175239799248,7cyclictest0-21swapper/023:40:180
175239799248,7cyclictest0-21swapper/023:40:170
1752397992421,2cyclictest1726-21systemd-logind23:50:000
1752397992413,6cyclictest0-21swapper/022:25:010
1752397992411,6cyclictest0-21swapper/023:30:020
25010912318,2phc2sys0-21swapper/323:02:303
25010912317,3phc2sys0-21swapper/323:46:213
25010912317,3phc2sys0-21swapper/322:26:133
25010912317,3phc2sys0-21swapper/321:11:513
25010912317,2phc2sys0-21swapper/323:54:483
25010912317,2phc2sys0-21swapper/323:42:583
25010912317,2phc2sys0-21swapper/323:42:573
25010912317,2phc2sys0-21swapper/323:30:283
25010912317,2phc2sys0-21swapper/323:23:263
25010912317,2phc2sys0-21swapper/322:59:453
25010912317,2phc2sys0-21swapper/322:42:463
25010912317,2phc2sys0-21swapper/322:39:133
25010912317,2phc2sys0-21swapper/322:21:263
25010912317,2phc2sys0-21swapper/322:11:003
25010912317,2phc2sys0-21swapper/322:08:563
25010912317,2phc2sys0-21swapper/322:02:213
25010912317,2phc2sys0-21swapper/321:41:253
25010912317,2phc2sys0-21swapper/321:19:533
25010912317,2phc2sys0-21swapper/321:09:273
25010912317,2phc2sys0-21swapper/320:46:033
25010912317,2phc2sys0-21swapper/319:52:333
25010912317,2phc2sys0-21swapper/319:49:493
25010912317,2phc2sys0-21swapper/319:32:093
25010912317,2phc2sys0-21swapper/319:25:483
25010912317,2phc2sys0-21swapper/300:31:523
25010912317,2phc2sys0-21swapper/300:21:063
25010912317,2phc2sys0-21swapper/300:11:443
25010912316,2phc2sys0-21swapper/300:17:203
25010912315,3phc2sys0-21swapper/300:07:423
1752398992320,2cyclictest2243747-21cat00:25:001
1752398992320,2cyclictest1797523-21systemd-run19:45:011
1752397992313,6cyclictest1919108-21cut21:20:180
1752397992313,5cyclictest0-21swapper/022:45:010
1752397992312,6cyclictest1983347-21kthreadcore21:55:240
25010912217,3phc2sys0-21swapper/323:55:393
25010912217,3phc2sys0-21swapper/323:35:483
25010912217,3phc2sys0-21swapper/323:35:473
25010912217,3phc2sys0-21swapper/323:26:293
25010912217,3phc2sys0-21swapper/323:15:513
25010912217,3phc2sys0-21swapper/323:14:363
25010912217,3phc2sys0-21swapper/322:15:483
25010912217,3phc2sys0-21swapper/321:46:493
25010912217,3phc2sys0-21swapper/321:33:393
25010912217,3phc2sys0-21swapper/321:22:533
25010912217,3phc2sys0-21swapper/321:00:293
25010912217,3phc2sys0-21swapper/320:52:473
25010912217,3phc2sys0-21swapper/320:40:333
25010912217,3phc2sys0-21swapper/320:29:513
25010912217,3phc2sys0-21swapper/320:22:013
25010912217,3phc2sys0-21swapper/320:11:113
25010912217,3phc2sys0-21swapper/320:09:233
25010912217,3phc2sys0-21swapper/319:38:013
25010912217,3phc2sys0-21swapper/319:20:383
25010912217,3phc2sys0-21swapper/319:15:533
25010912217,3phc2sys0-21swapper/300:27:453
25010912217,2phc2sys0-21swapper/320:58:013
25010912217,2phc2sys0-21swapper/320:37:173
220833122217,3sleep30-21swapper/300:04:423
175239899223,11cyclictest2171531-1ssh23:42:281
175239899223,11cyclictest2171531-1ssh23:42:281
1752398992219,2cyclictest2199645-21cron00:00:001
1752398992214,3cyclictest2203054-21kthreadcore00:00:241
175239799229,4cyclictest1900586-21diskmemload22:25:250
1752397992219,2cyclictest2240602-1atopacctd22:40:010
25010912117,2phc2sys0-21swapper/323:09:453
25010912117,2phc2sys0-21swapper/322:45:513
226890822117,2sleep20-21swapper/200:38:152
224982122117,2sleep20-21swapper/200:25:452
224191422117,2sleep20-21swapper/200:22:082
223228922117,2sleep20-21swapper/200:15:512
222435622117,2sleep20-21swapper/200:12:022
219706622117,2sleep20-21swapper/223:55:472
218881922117,2sleep20-21swapper/223:52:062
217946422117,2sleep20-21swapper/223:46:132
217274322117,2sleep20-21swapper/223:44:332
217274322117,2sleep20-21swapper/223:44:332
216279522117,2sleep20-21swapper/223:37:272
216279522117,2sleep20-21swapper/223:37:272
214429822117,2sleep20-21swapper/223:25:532
211806122117,2sleep20-21swapper/223:10:542
210355522117,2sleep20-21swapper/223:05:172
210221322117,2sleep20-21swapper/223:03:332
209214222117,2sleep20-21swapper/222:56:422
208496822117,2sleep20-21swapper/222:54:152
207571822117,2sleep20-21swapper/222:48:252
205903022117,2sleep20-21swapper/222:39:512
205028722117,2sleep20-21swapper/222:34:472
202444222117,2sleep20-21swapper/222:20:082
202179022117,2sleep20-21swapper/222:16:142
200409722117,2sleep20-21swapper/222:05:482
198780922117,2sleep20-21swapper/221:58:312
197977922117,2sleep30-21swapper/321:54:363
197843422117,2sleep20-21swapper/221:52:272
196911922117,2sleep20-21swapper/221:46:322
196134222117,2sleep20-21swapper/221:43:172
193330522117,2sleep20-21swapper/221:25:412
192464322117,2sleep20-21swapper/221:21:002
191772622117,2sleep20-21swapper/221:19:082
190799622117,2sleep20-21swapper/221:12:472
189500222117,2sleep20-21swapper/221:05:172
185788922117,2sleep20-21swapper/220:31:512
175239899219,4cyclictest2266207-21kthreadcore00:35:241
175239899219,3cyclictest0-21swapper/123:00:181
175239899213,10cyclictest1935078-1ssh21:28:271
1752398992118,2cyclictest2094638-21ssh23:00:021
1752398992116,1cyclictest924598rtkit-daemon22:33:311
1752398992116,1cyclictest178850irq/121-eno122:50:231
1752398992114,1cyclictest178850irq/121-eno121:45:181
1752398992113,3cyclictest1985225-21latency21:55:231
1752398992110,7cyclictest1869307-21tail20:40:251
175239799217,5cyclictest0-21swapper/023:00:220
1752397992114,2cyclictest1761199-21/usr/sbin/munin19:15:170
1752397992110,6cyclictest2209838-21idleruntime00:05:200
1752397992110,6cyclictest0-21swapper/021:25:280
1752397992110,4cyclictest2088778-21kthreadcore22:55:240
25010912017,2phc2sys0-21swapper/322:31:143
25010912017,2phc2sys0-21swapper/321:37:393
25010912017,2phc2sys0-21swapper/320:31:173
25010912017,2phc2sys0-21swapper/320:16:553
25010912017,2phc2sys0-21swapper/320:01:173
25010912017,2phc2sys0-21swapper/319:57:393
221524422017,2sleep20-21swapper/200:06:332
215553122017,2sleep20-21swapper/223:34:592
208305122017,2sleep30-21swapper/322:51:033
195300622017,2sleep20-21swapper/221:38:592
186450822017,2sleep20-21swapper/220:40:092
186415722017,2sleep20-21swapper/220:39:532
185151722017,2sleep20-21swapper/220:25:502
184549222017,2sleep20-21swapper/220:20:532
182195122017,2sleep20-21swapper/220:05:142
182155322017,2sleep20-21swapper/220:04:062
180318922017,2sleep20-21swapper/219:46:072
179738522017,2sleep20-21swapper/219:44:382
179733622017,2sleep30-21swapper/319:43:593
179131122017,2sleep20-21swapper/219:39:372
178512622017,2sleep20-21swapper/219:32:562
175328522017,2sleep20-21swapper/219:10:202
1752399992017,1cyclictest0-21swapper/220:19:592
175239899208,5cyclictest1864227-21sendmail-msp20:40:001
175239899208,3cyclictest0-21swapper/123:25:011
1752398992017,2cyclictest0-21swapper/122:50:021
1752398992016,3cyclictest1816553-21fschecks_time20:00:201
1752398992016,3cyclictest0-21swapper/119:15:041
1752398992014,2cyclictest178850irq/121-eno123:50:251
1752398992012,3cyclictest0-21swapper/123:50:021
175239899201,1cyclictest191rcu_preempt00:30:241
175239799209,6cyclictest1707-21polkitd23:35:020
175239799207,6cyclictest0-21swapper/021:10:160
175239799207,4cyclictest0-21swapper/022:15:280
175239799206,6cyclictest0-21swapper/000:15:010
175239799206,5cyclictest1894966-21tail21:05:160
175239799206,5cyclictest0-21swapper/023:55:220
175239799204,6cyclictest0-21swapper/022:50:290
1752397992014,2cyclictest0-21swapper/000:19:290
1752397992012,7cyclictest2007109-21apt22:10:160
1752397992010,5cyclictest0-21swapper/023:35:180
1752397992010,5cyclictest0-21swapper/023:35:180
175239799200,5cyclictest2252464-21munin-run00:30:010
25010911917,1phc2sys0-21swapper/321:29:493
175239899198,6cyclictest1902257-21irqrtprio21:10:221
175239899198,2cyclictest0-21swapper/121:50:221
175239899197,7cyclictest0-21swapper/123:36:081
175239899197,7cyclictest0-21swapper/123:36:081
175239899196,8cyclictest2004090-1ssh22:05:471
1752398991916,2cyclictest1920651-21ssh21:20:231
1752398991916,2cyclictest1779323-21cut19:30:011
1752398991915,3cyclictest1812654-21kthreadcore19:55:231
1752398991910,2cyclictest0-21swapper/122:25:201
175239799199,9cyclictest0-21swapper/000:35:000
175239799199,6cyclictest0-21swapper/019:50:270
175239799195,6cyclictest0-21swapper/023:15:230
175239799195,1cyclictest0-21swapper/022:05:170
175239799194,6cyclictest0-21swapper/021:45:260
1752397991916,2cyclictest1726-21systemd-logind20:15:010
1752397991914,1cyclictest1889990-21sed21:00:210
175239799190,15cyclictest0-21swapper/020:50:160
1752399991816,1cyclictest0-21swapper/222:05:022
175239899189,4cyclictest2244554-21cpuspeed_turbos00:25:181
175239899188,3cyclictest0-21swapper/123:15:021
175239899187,4cyclictest2061090-21kthreadcore22:40:271
175239899185,8cyclictest2022102-21diskmemload22:16:451
175239899183,5cyclictest1989643-21aten2.4-expect22:00:171
175239899183,5cyclictest1870695-21aten2.4-expect20:45:151
1752398991815,2cyclictest2138662-21aten_repower_fr23:25:191
1752398991815,2cyclictest2024618-21aten_repower_en22:20:181
1752398991815,2cyclictest1840877-21idleruntime20:20:191
1752398991815,2cyclictest1824734-21kthreadcore20:05:221
1752398991815,2cyclictest1769514-21kthreadcore19:20:221
1752398991815,2cyclictest1726-21systemd-logind20:15:011
1752398991814,3cyclictest2210859-21kthreadcore00:05:231
1752398991814,3cyclictest2124419-21kthreadcore23:15:221
1752398991814,3cyclictest1890264-21kthreadcore21:00:211
1752398991814,3cyclictest1887447-21missed_timers20:55:231
1752398991814,3cyclictest1847623-21kthreadcore20:25:221
1752398991813,4cyclictest1910722-21gltestperf21:15:201
1752398991812,2cyclictest1947642-21kthreadcore21:35:191
175239799189,4cyclictest2050555-21systemd-run22:35:010
175239799188,5cyclictest0-21swapper/021:35:080
175239799188,5cyclictest0-21swapper/021:15:200
175239799183,6cyclictest0-21swapper/023:05:270
1752397991815,2cyclictest1959244-21mailstats21:40:260
1752397991815,2cyclictest1815694-21latency_hist20:00:000
1752397991815,2cyclictest1773028-21apt-key19:25:000
175239799180,9cyclictest2133878-21cut23:20:240
175239799180,17cyclictest0-21swapper/020:05:180
924598170,10rtkit-daemon1752395-21cyclictest00:22:530
1752399991714,1cyclictest0-21swapper/223:20:012
175239899174,8cyclictest2007017-21diskmemload22:10:101
175239899174,2cyclictest2106465-21kthreadcore23:05:281
175239899173,3cyclictest1780516-21irqcore19:30:211
1752398991714,2cyclictest2230824-21kthreadcore00:15:221
1752398991714,2cyclictest2051539-21diskmemload22:35:211
1752398991714,2cyclictest1937166-21fschecks_time21:30:191
1752398991714,2cyclictest1877771-21tr20:50:191
1752398991714,2cyclictest1808524-21missed_timers19:50:241
1752398991714,2cyclictest1786668-21irqcore19:35:211
1752398991713,3cyclictest2151241-21kthreadcore23:30:261
1752398991713,3cyclictest1957071-21kthreadcore21:40:221
1752398991712,4cyclictest2221851-21kthreadcore00:10:271
1752398991712,4cyclictest1752395-21cyclictest19:45:181
175239799176,2cyclictest0-21swapper/021:30:220
175239799175,1cyclictest0-21swapper/000:00:230
1752397991714,2cyclictest1785396-21systemd-run19:35:010
1752397991714,2cyclictest1758660-21gpgconf19:15:020
1752397991714,2cyclictest1726-21systemd-logind19:10:010
1752397991714,2cyclictest0-21swapper/020:30:030
175239999161,9cyclictest0-21swapper/222:30:012
1752399991613,1cyclictest0-21swapper/221:35:012
1752398991613,2cyclictest1835338-21kthreadcore20:15:201
1752398991613,2cyclictest1761485-21cpuspeed_turbos19:15:171
1752398991612,3cyclictest1895594-21gltestperf21:05:181
175239799168,4cyclictest1900586-21diskmemload00:38:400
175239799167,4cyclictest0-21swapper/021:50:030
175239799164,4cyclictest1900586-21diskmemload23:51:070
1752397991613,2cyclictest1992-21runrttasks20:50:010
1752399991512,1cyclictest0-21swapper/200:30:202
1752397991512,2cyclictest1726-21systemd-logind20:25:010
175239799150,8cyclictest1798301-21df19:45:180
175239799150,8cyclictest1791694-21/usr/sbin/munin19:40:290
175239999141,8cyclictest0-21swapper/219:30:022
1752399991411,1cyclictest0-21swapper/220:45:222
1752399991411,1cyclictest0-21swapper/200:03:362
175239799144,2cyclictest1816639-21expr20:00:210
175239799141,6cyclictest1852620-21aten2.4-expect20:30:170
175239799141,6cyclictest1838886-21ps20:15:250
175239799141,2cyclictest2240602-1atopacctd20:35:180
1752397991411,2cyclictest1786418-21idleruntime19:35:200
1752399991311,1cyclictest0-21swapper/219:10:022
1752399991310,1cyclictest0-21swapper/222:40:272
1752399991310,1cyclictest0-21swapper/222:15:002
1752399991310,1cyclictest0-21swapper/221:05:002
1752399991310,1cyclictest0-21swapper/220:55:162
1752399991310,1cyclictest0-21swapper/220:50:192
1752399991310,1cyclictest0-21swapper/220:10:232
1752399991310,1cyclictest0-21swapper/219:55:242
1752399991310,1cyclictest0-21swapper/219:50:282
1752398991310,2cyclictest0-21swapper/119:10:011
175239799130,5cyclictest241rcuc/020:40:170
2501091120,4phc2sys0-21swapper/319:05:163
175239999126,4cyclictest0-21swapper/223:20:162
1752399991210,1cyclictest0-21swapper/219:20:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional