You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Sat Jul 19, 2025 00:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252638021840,2sleep30-21swapper/322:50:493
23638532800,2sleep1649346-1atop21:20:011
26498432710,1sleep02649846-21unixbench_multi00:00:280
25010913418,14phc2sys0-21swapper/322:12:583
2198159993111,17cyclictest1761-21gdbus20:40:020
244872622718,3sleep30-21swapper/322:06:543
2198159992719,6cyclictest2261416-21systemd20:00:020
2198159992521,3cyclictest1695-21dbus-daemon22:40:010
25010912418,3phc2sys0-21swapper/322:55:223
25010912418,2phc2sys0-21swapper/321:56:403
25010912418,2phc2sys0-21swapper/321:53:243
25010912418,2phc2sys0-21swapper/321:43:463
25010912418,2phc2sys0-21swapper/321:24:543
25010912418,2phc2sys0-21swapper/321:15:203
25010912418,2phc2sys0-21swapper/321:14:523
25010912418,2phc2sys0-21swapper/320:52:443
25010912418,2phc2sys0-21swapper/319:46:403
25010912418,2phc2sys0-21swapper/319:36:543
25010912418,2phc2sys0-21swapper/319:36:543
25010912417,3phc2sys0-21swapper/323:55:033
25010912417,3phc2sys0-21swapper/323:55:033
25010912417,2phc2sys0-21swapper/319:55:223
25010912417,2phc2sys0-21swapper/300:12:193
2198159992413,7cyclictest2528818-21systemd22:55:010
2198159992413,7cyclictest2354937-21/usr/sbin/munin21:15:020
2198159992411,8cyclictest0-21swapper/022:20:230
25010912318,3phc2sys0-21swapper/321:47:503
25010912318,3phc2sys0-21swapper/321:07:183
25010912318,3phc2sys0-21swapper/321:00:043
25010912318,3phc2sys0-21swapper/320:47:343
25010912318,3phc2sys0-21swapper/320:02:463
25010912318,3phc2sys0-21swapper/319:29:563
25010912318,3phc2sys0-21swapper/300:38:353
25010912317,3phc2sys0-21swapper/323:48:533
25010912317,3phc2sys0-21swapper/323:38:273
25010912317,3phc2sys0-21swapper/300:19:273
25010912317,2phc2sys0-21swapper/323:30:553
25010912317,2phc2sys0-21swapper/323:20:363
25010912317,2phc2sys0-21swapper/323:11:313
25010912317,2phc2sys0-21swapper/323:11:303
25010912317,2phc2sys0-21swapper/322:32:073
25010912317,2phc2sys0-21swapper/322:29:393
25010912317,2phc2sys0-21swapper/322:23:053
25010912317,2phc2sys0-21swapper/322:00:453
25010912317,2phc2sys0-21swapper/320:43:103
25010912317,2phc2sys0-21swapper/320:29:163
25010912317,2phc2sys0-21swapper/320:07:283
25010912317,2phc2sys0-21swapper/300:33:273
25010912317,2phc2sys0-21swapper/300:01:173
2198159992317,5cyclictest2696607-21dump-pmu-power00:30:000
2198159992317,5cyclictest2285438-21systemd-run20:20:010
269558722218,2sleep30-21swapper/300:28:223
265307622218,2sleep30-21swapper/300:05:133
258887222218,2sleep30-21swapper/323:27:303
255358422218,2sleep30-21swapper/323:07:173
25010912218,2phc2sys0-21swapper/319:10:303
25010912217,3phc2sys0-21swapper/323:19:513
25010912217,3phc2sys0-21swapper/322:46:123
25010912217,3phc2sys0-21swapper/322:37:393
25010912217,3phc2sys0-21swapper/322:15:473
25010912217,3phc2sys0-21swapper/320:57:363
25010912217,3phc2sys0-21swapper/320:38:003
25010912217,3phc2sys0-21swapper/320:22:383
25010912217,3phc2sys0-21swapper/319:52:123
25010912217,3phc2sys0-21swapper/319:17:423
25010912216,2phc2sys0-21swapper/321:38:173
2499691220,2getstats0-21swapper/323:44:053
238947622218,2sleep30-21swapper/321:34:393
2198160992213,4cyclictest0-21swapper/100:30:011
2198159992216,5cyclictest2240602-1atopacctd00:24:210
2198159992214,7cyclictest2531900-21kthreadcore22:55:230
2198159992210,7cyclictest0-21swapper/021:55:010
219815999220,2cyclictest2433678-21/usr/sbin/munin22:00:150
219764222217,3sleep20-21swapper/219:05:432
251123322118,2sleep30-21swapper/322:44:373
25010912117,2phc2sys0-21swapper/323:50:073
25010912117,2phc2sys0-21swapper/323:50:073
25010912117,2phc2sys0-21swapper/323:00:473
25010912117,2phc2sys0-21swapper/321:25:043
25010912117,2phc2sys0-21swapper/320:30:143
25010912117,2phc2sys0-21swapper/320:16:263
25010912117,2phc2sys0-21swapper/319:41:563
25010912117,2phc2sys0-21swapper/319:31:503
227913022118,2sleep30-21swapper/320:12:483
2198160992113,4cyclictest178850irq/121-eno100:15:051
2198160992113,3cyclictest0-21swapper/122:15:011
219815999219,7cyclictest0-21swapper/000:20:010
219815999217,9cyclictest0-21swapper/020:35:010
2198159992113,6cyclictest2382477-21sed21:30:190
2198159992110,6cyclictest2333817-21turbostat21:00:010
25010912017,2phc2sys0-21swapper/319:21:363
25010912017,2phc2sys0-21swapper/300:20:333
227902722017,2sleep20-21swapper/220:11:272
222450622017,2sleep20-21swapper/219:25:342
219815999209,7cyclictest2381266-21latency_hist21:30:020
219815999209,7cyclictest2346083-21systemd21:10:010
219815999208,8cyclictest2198157-21cyclictest21:17:100
2198159992013,6cyclictest2443532-21grep22:05:180
2198159992013,6cyclictest0-21swapper/023:35:020
2198159992011,7cyclictest0-21swapper/000:10:020
2198160991910,4cyclictest0-21swapper/123:15:001
2198160991910,4cyclictest0-21swapper/123:15:001
2198160991910,4cyclictest0-21swapper/122:20:191
219815999199,9cyclictest178850irq/121-eno122:50:000
219815999199,9cyclictest0-21swapper/023:15:210
219815999198,6cyclictest0-21swapper/023:05:140
2198159991916,2cyclictest2546252-21systemd-run23:05:010
2198159991916,2cyclictest0-21swapper/000:15:010
2198159991914,4cyclictest2267257-21munin-plugin-st20:05:010
219815999191,13cyclictest0-21swapper/021:21:440
2198159991910,7cyclictest17350irq/127-ahci[0000:00:17.0]22:35:010
251022021816,1sleep20-21swapper/222:42:562
226721821816,1sleep20-21swapper/220:04:582
2198161991816,1cyclictest0-21swapper/220:00:022
2198160991816,1cyclictest2635087-21latency_hist23:55:011
2198160991816,1cyclictest2635087-21latency_hist23:55:011
2198160991815,2cyclictest2424542-21cron21:55:001
2198160991814,3cyclictest2495948-21kthreadcore22:35:221
2198160991810,4cyclictest2614228-21switchtime23:40:261
219815999189,5cyclictest2631179-21kthreadcore23:50:240
219815999189,5cyclictest2631179-21kthreadcore23:50:240
219815999185,8cyclictest0-21swapper/023:35:150
219815999184,9cyclictest2225303-21aten2.4-expect19:30:140
219815999182,13cyclictest2198272-21systemd-run19:10:020
2198159991815,2cyclictest2560563-21tr23:10:210
2198159991815,2cyclictest2560563-21tr23:10:210
2198159991812,5cyclictest9244-21rtkit-daemon23:46:240
2198159991812,5cyclictest770595-21systemd-journal19:15:010
2198159991812,5cyclictest2581887-21latency_hist23:25:020
2198159991811,6cyclictest2626222-21kworker/u16:1+nfsiod00:36:010
2198159991810,7cyclictest2400210-21kthreadcore21:40:190
25778682170,2sleep20-21swapper/223:20:222
23116422170,2sleep016-21ksoftirqd/020:40:210
219816199174,7cyclictest0-21swapper/220:30:022
2198161991714,1cyclictest0-21swapper/220:20:012
2198161991714,1cyclictest0-21swapper/200:30:002
2198161991711,4cyclictest2676467-21chrt00:15:412
219816199171,14cyclictest0-21swapper/222:07:562
2198160991714,2cyclictest2699993-21kthreadcore00:30:221
2198160991714,2cyclictest2608764-21sh23:40:021
2198160991714,2cyclictest2450818-21sh22:10:021
2198160991714,2cyclictest2407396-21cut21:45:031
2198160991714,2cyclictest2274205-21fschecks_time20:10:161
2198160991714,2cyclictest2204295-21gpgv19:15:011
2198160991714,2cyclictest2198157-21cyclictest23:30:171
2198160991714,2cyclictest1726-21systemd-logind20:35:021
2198160991714,2cyclictest1695-21dbus-daemon20:20:021
2198160991714,2cyclictest1-21systemd23:20:251
2198160991711,2cyclictest11systemd00:05:001
2198160991710,3cyclictest2705768-21/usr/sbin/munin00:35:161
2198160991710,3cyclictest2439178-21unixbench_singl22:00:281
219815999178,8cyclictest0-21swapper/021:35:240
219815999173,9cyclictest2697205-21head00:30:160
219815999173,10cyclictest2279329-21grep20:15:010
219815999172,9cyclictest16-21ksoftirqd/020:55:020
219815999172,12cyclictest2433467-21munin-run22:00:010
2198159991714,2cyclictest2461754-21kthreadcore22:15:200
2198159991711,5cyclictest2483436-21sh22:26:420
2198159991711,5cyclictest2442355-21kworker/u16:3+nfsiod23:43:520
2198159991711,5cyclictest2291954-21aten2.4-expect20:25:170
2198159991711,5cyclictest0-21swapper/021:50:010
2198159991710,6cyclictest2352086-21kworker/u16:1+nfsiod22:11:240
2198159991710,6cyclictest2243681-21cpuspeed_turbos19:45:160
2198159991710,6cyclictest2238443-21irqcore19:40:210
2198159991710,5cyclictest2511684-21/usr/sbin/munin22:45:010
2198159991710,5cyclictest2252312-21kthreadcore19:50:210
219815999170,8cyclictest0-21swapper/019:35:160
219815999170,8cyclictest0-21swapper/019:35:160
219815999170,16cyclictest0-21swapper/020:05:150
224280121614,1sleep20-21swapper/219:41:412
219816199168,5cyclictest0-21swapper/220:40:012
219816199167,6cyclictest23611912sleep221:16:182
2198161991613,1cyclictest0-21swapper/200:24:202
2198161991611,2cyclictest0-21swapper/220:47:082
219816099168,3cyclictest0-21swapper/123:50:011
219816099165,1cyclictest178850irq/121-eno100:10:241
2198160991613,2cyclictest2321716-21cut20:50:011
2198160991613,2cyclictest2291457-21dump-pmu-power20:25:001
2198160991613,2cyclictest2240602-1atopacctd22:15:141
2198160991613,2cyclictest1726-21systemd-logind19:20:021
2198160991611,2cyclictest178850irq/121-eno123:55:581
2198160991611,2cyclictest178850irq/121-eno123:55:581
2198160991610,2cyclictest178850irq/121-eno121:45:231
219815999163,8cyclictest2635473-21aten2.4-expect23:55:160
219815999163,8cyclictest2635473-21aten2.4-expect23:55:160
219815999162,9cyclictest0-21swapper/020:20:130
2198159991613,2cyclictest2218912-21systemd-run19:25:010
2198159991613,2cyclictest0-21swapper/019:30:010
2198159991610,5cyclictest2585449-21kthreadcore23:25:210
219815999160,3cyclictest0-21swapper/019:15:570
219816199157,5cyclictest2451637-21chrt22:10:202
219816199156,6cyclictest24297402sleep221:55:212
219816199155,5cyclictest0-21swapper/223:15:152
2198161991512,1cyclictest0-21swapper/222:23:052
2198161991512,1cyclictest0-21swapper/200:00:522
2198161991511,1cyclictest0-21swapper/219:15:572
219816099151,9cyclictest2231259-21/usr/sbin/munin19:35:281
219816099151,9cyclictest2231259-21/usr/sbin/munin19:35:271
2198160991513,1cyclictest2541194-21kthreadcore23:00:201
2198160991513,1cyclictest2249032-21runrttasks19:48:581
2198160991513,1cyclictest2221964-21kthreadcore19:25:211
2198160991512,2cyclictest2477851-21cut22:25:141
2198160991512,2cyclictest2205645-21kworker/u16:2-writeback21:25:021
2198160991512,2cyclictest1734-21rs:main1
2198160991512,2cyclictest1726-21systemd-logind19:35:001
2198160991511,3cyclictest2505475-21kthreadcore22:40:221
219815999159,5cyclictest2317084-21irqrtprio20:45:200
219815999151,8cyclictest2334302-21aten_repower_vo21:00:150
219816199149,1cyclictest0-21swapper/222:32:582
219816199145,6cyclictest2396820-21chrt21:37:252
219816199145,6cyclictest23456192sleep221:06:162
219816199142,9cyclictest0-21swapper/222:16:492
219816199142,6cyclictest0-21swapper/220:10:022
2198161991412,1cyclictest0-21swapper/222:47:062
219816199140,8cyclictest0-21swapper/222:28:482
2198160991411,2cyclictest2582780-21fschecks_time23:25:171
2198160991411,2cyclictest2569476-21mailstats23:15:261
2198160991411,2cyclictest2486697-21head22:30:201
2198160991411,2cyclictest2424971-21/usr/sbin/munin21:55:211
2198160991411,2cyclictest2395152-21processes21:35:261
2198160991411,2cyclictest2383315-21kthreadcore21:30:201
2198160991411,2cyclictest2346998-21fschecks_count21:10:181
2198160991411,2cyclictest2336378-21kthreadcore21:00:211
2198160991411,2cyclictest2304478-21fschecks_time20:35:201
2198160991410,3cyclictest71-21kcompactd022:50:011
2198160991410,3cyclictest2683144-21kthreadcore00:20:221
2198160991410,3cyclictest2546956-21aten_repower_cu23:05:141
2198160991410,3cyclictest2373992-21irqrtprio21:25:181
2198160991410,2cyclictest2267429-21latency_hist20:05:021
219816199138,3cyclictest0-21swapper/223:07:522
219816199137,3cyclictest2641998-21chrt23:57:212
219816199137,3cyclictest2641998-21chrt23:57:212
219816199136,4cyclictest2562773-21chrt23:13:092
219816199136,4cyclictest2562773-21chrt23:13:092
219816199136,3cyclictest0-21swapper/221:30:132
219816199135,5cyclictest2711992-21chrt00:36:372
219816199135,2cyclictest0-21swapper/219:45:122
219816199134,5cyclictest0-21swapper/219:40:022
219816199134,5cyclictest0-21swapper/219:40:022
2198161991311,1cyclictest0-21swapper/220:22:142
2198161991310,1cyclictest0-21swapper/223:33:182
2198161991310,1cyclictest0-21swapper/223:02:552
2198161991310,1cyclictest0-21swapper/221:40:132
2198161991310,1cyclictest0-21swapper/220:50:072
219816199130,10cyclictest0-21swapper/200:05:182
219816099139,3cyclictest2311447-21kthreadcore20:40:211
219816099139,3cyclictest2272482-21sendmail_mailqu20:05:261
219816099139,3cyclictest2259794-21kthreadcore19:55:211
219816099137,5cyclictest770595-21systemd-journal19:20:541
2198160991310,2cyclictest2655990-21kthreadcore00:05:261
2198160991310,2cyclictest2342885-21kthreadcore21:05:201
2198160991310,2cyclictest2328326-21cpuspeed_turbos20:55:171
2198160991310,2cyclictest2326658-21missed_timers20:50:261
2198160991310,2cyclictest2293089-21kthreadcore20:25:221
2198160991310,2cyclictest2250129-21gltestperf19:50:181
2198160991310,2cyclictest2238091-21gltestperf19:40:191
2198160991310,1cyclictest191rcu_preempt22:55:221
219816199129,1cyclictest0-21swapper/223:43:262
219816199129,1cyclictest0-21swapper/222:55:282
219816199129,1cyclictest0-21swapper/222:50:202
219816199129,1cyclictest0-21swapper/222:37:202
219816199129,1cyclictest0-21swapper/219:15:012
219816199129,1cyclictest0-21swapper/200:15:002
219816199127,1cyclictest0-21swapper/221:45:152
219816199126,3cyclictest2370252-21chrt21:21:312
219816199125,4cyclictest23784202sleep221:25:402
219816199125,4cyclictest2354258-21chrt21:14:212
219816199123,5cyclictest0-21swapper/222:00:142
219816199122,7cyclictest2696942-21chrt00:30:032
219816199122,2cyclictest0-21swapper/223:25:132
219816199121,8cyclictest2623556-21chrt23:45:592
219816199121,8cyclictest2607443-21chrt23:38:382
219816199121,6cyclictest0-21swapper/223:50:162
219816199121,6cyclictest0-21swapper/223:50:162
219816199119,1cyclictest0-21swapper/221:50:582
219816199108,1cyclictest0-21swapper/220:35:012
219816199106,2cyclictest0-21swapper/219:51:562
219816199106,2cyclictest0-21swapper/219:30:142
219816199106,2cyclictest0-21swapper/219:20:202
21981619997,1cyclictest0-21swapper/221:00:172
21981619996,2cyclictest0-21swapper/220:40:162
21981619991,6cyclictest2332952-21chrt20:55:252
21981609991,6cyclictest1-21systemd19:10:021
250109181,2phc2sys0-21swapper/319:05:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional