You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 07:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Sat Jul 27, 2024 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265502221050,2sleep30-21swapper/322:06:393
26816442500,3sleep11394-21dbus-daemon22:25:011
25879652300,2sleep20-21swapper/221:25:502
2354291280,2ptp4l175990irq/127-enp1s0-TxRx-022:41:033
2354291270,5ptp4l175990irq/127-enp1s0-TxRx-022:37:463
2354291270,4ptp4l175990irq/127-enp1s0-TxRx-020:10:143
2354291260,5ptp4l175990irq/127-enp1s0-TxRx-023:52:013
2354291260,4ptp4l175990irq/127-enp1s0-TxRx-023:28:293
2354291260,2ptp4l0-21swapper/323:01:433
2354291260,1ptp4l0-21swapper/322:02:123
2354291250,5ptp4l175990irq/127-enp1s0-TxRx-021:35:503
2354291250,4ptp4l175990irq/127-enp1s0-TxRx-022:45:293
2354291250,3ptp4l175990irq/127-enp1s0-TxRx-021:27:003
2354291250,2ptp4l0-21swapper/323:11:213
2354291250,2ptp4l0-21swapper/300:30:093
2354291250,1ptp4l0-21swapper/319:25:173
2354291240,5ptp4l175990irq/127-enp1s0-TxRx-023:50:003
2354291240,4ptp4l175990irq/127-enp1s0-TxRx-000:11:023
2354291240,3ptp4l175990irq/127-enp1s0-TxRx-022:50:433
2354291240,3ptp4l175990irq/127-enp1s0-TxRx-021:40:213
2354291240,3ptp4l175990irq/127-enp1s0-TxRx-019:40:203
2354291240,2ptp4l0-21swapper/300:08:583
2354291240,1ptp4l0-21swapper/322:26:363
2354291240,1ptp4l0-21swapper/319:50:183
27930632230,2chrt0-21swapper/323:30:243
2354291230,4ptp4l175990irq/127-enp1s0-TxRx-023:23:203
2354291230,4ptp4l175990irq/127-enp1s0-TxRx-022:32:143
2354291230,4ptp4l175990irq/127-enp1s0-TxRx-019:05:253
2354291230,3ptp4l175990irq/127-enp1s0-TxRx-021:52:233
2354291230,3ptp4l175990irq/127-enp1s0-TxRx-021:31:033
2354291230,3ptp4l175990irq/127-enp1s0-TxRx-021:21:293
2354291230,3ptp4l175990irq/127-enp1s0-TxRx-000:23:303
2354291230,2ptp4l0-21swapper/323:40:153
2354291230,2ptp4l0-21swapper/322:20:153
2354291230,1ptp4l0-21swapper/300:37:533
290278422218,2sleep20-21swapper/200:38:182
284352422218,2sleep20-21swapper/200:00:262
281867122218,2sleep20-21swapper/223:45:232
281118422218,2sleep20-21swapper/223:40:342
280294922218,2sleep20-21swapper/223:35:332
279600422218,2sleep20-21swapper/223:32:532
277887822218,2sleep20-21swapper/223:21:262
277048722218,2sleep20-21swapper/223:16:132
273823022218,2sleep20-21swapper/222:57:382
270654722218,2sleep20-21swapper/222:40:062
270455222218,2sleep20-21swapper/222:36:572
268837822218,2sleep20-21swapper/222:27:442
265804422218,2sleep20-21swapper/222:10:162
264634122218,2sleep20-21swapper/222:00:502
263703622218,2sleep20-21swapper/221:55:242
261348822218,2sleep20-21swapper/221:42:112
260589322218,2sleep20-21swapper/221:38:262
259824022218,2sleep20-21swapper/221:34:332
256901422218,2sleep20-21swapper/221:15:212
254488022218,2sleep20-21swapper/220:57:382
251553722218,2sleep20-21swapper/220:34:412
2354291220,5ptp4l175990irq/127-enp1s0-TxRx-023:58:343
2354291220,5ptp4l175990irq/127-enp1s0-TxRx-023:18:423
2354291220,4ptp4l175990irq/127-enp1s0-TxRx-023:05:323
2354291220,4ptp4l175990irq/127-enp1s0-TxRx-022:55:463
2354291220,3ptp4l175990irq/127-enp1s0-TxRx-021:15:553
2354291220,3ptp4l175990irq/127-enp1s0-TxRx-020:55:153
2354291220,2ptp4l0-21swapper/319:10:243
2354291220,1ptp4l0-21swapper/322:17:573
2354291220,1ptp4l0-21swapper/321:59:263
2354291220,1ptp4l0-21swapper/321:49:243
288551122118,2sleep20-21swapper/200:26:272
287664122118,2sleep20-21swapper/200:20:262
278765922118,2sleep20-21swapper/223:27:362
276198722118,2sleep20-21swapper/223:10:402
273016122118,2sleep20-21swapper/222:53:212
272147922118,2sleep20-21swapper/222:48:002
267906322118,2sleep20-21swapper/222:20:342
255705522118,2sleep20-21swapper/221:08:482
255109822118,2sleep20-21swapper/221:03:072
253905522118,2sleep20-21swapper/220:53:212
253295022118,2sleep20-21swapper/220:45:402
252128122118,2sleep20-21swapper/220:37:382
250931222118,2sleep20-21swapper/220:25:322
249179222118,2sleep20-21swapper/220:12:492
248567722118,2sleep20-21swapper/220:08:372
247969722118,2sleep20-21swapper/220:02:462
247359422118,2sleep20-21swapper/219:55:382
246790822118,2sleep20-21swapper/219:53:012
246209022118,2sleep20-21swapper/219:49:172
245068022118,2sleep20-21swapper/219:40:072
245026622118,2sleep20-21swapper/219:39:032
244438122118,2sleep20-21swapper/219:34:462
241840522118,2sleep20-21swapper/219:12:462
2354291210,4ptp4l175990irq/127-enp1s0-TxRx-019:35:433
2354291210,4ptp4l175990irq/127-enp1s0-TxRx-000:04:283
2354291210,2ptp4l0-21swapper/319:15:183
2354291210,1ptp4l0-21swapper/321:00:253
2354291210,1ptp4l0-21swapper/300:26:103
2412737992017,2cyclictest2681460-21munin-plugin-st22:25:000
2354291200,5ptp4l175990irq/127-enp1s0-TxRx-020:34:343
2354291200,5ptp4l175990irq/127-enp1s0-TxRx-020:21:583
2354291200,4ptp4l175990irq/127-enp1s0-TxRx-019:32:513
2354291200,3ptp4l175990irq/127-enp1s0-TxRx-019:46:573
2354291200,2ptp4l175990irq/127-enp1s0-TxRx-023:38:083
2354291200,1ptp4l0-21swapper/321:11:283
2412738991913,5cyclictest2734346-21kthreadcore22:55:211
241273899190,18cyclictest2490685-21kthreadcore20:10:201
2412737991916,2cyclictest9107-21rtkit-daemon20:45:100
2412737991916,2cyclictest2412736-21cyclictest23:20:010
2354291190,7ptp4l175990irq/127-enp1s0-TxRx-021:06:333
2354291190,5ptp4l175990irq/127-enp1s0-TxRx-020:54:053
2354291190,5ptp4l175990irq/127-enp1s0-TxRx-020:37:423
2354291190,5ptp4l175990irq/127-enp1s0-TxRx-020:15:423
2354291190,5ptp4l175990irq/127-enp1s0-TxRx-019:57:113
2354291190,4ptp4l175990irq/127-enp1s0-TxRx-022:14:143
2354291190,4ptp4l175990irq/127-enp1s0-TxRx-020:26:443
2354291190,3ptp4l175990irq/127-enp1s0-TxRx-019:20:263
2354291190,2ptp4l0-21swapper/300:18:533
2412738991816,1cyclictest2755999-21apt-key23:10:001
2412738991815,2cyclictest2722744-21apt-config22:50:011
2412738991815,2cyclictest1403-1atopacctd20:55:261
2412738991815,2cyclictest0-21swapper/122:00:011
2412738991810,7cyclictest0-21swapper/121:40:001
2412737991816,1cyclictest2582008-21latency_hist21:25:000
2412737991815,2cyclictest2797434-21systemd-run23:35:020
2412737991815,2cyclictest2632019-21munin-plugin-st21:55:010
2412737991815,2cyclictest2503786-21cron20:25:000
2354291180,5ptp4l175990irq/127-enp1s0-TxRx-020:00:113
2354291180,3ptp4l175990irq/127-enp1s0-TxRx-020:49:213
2412739991714,1cyclictest0-21swapper/200:32:392
241273899179,5cyclictest2830405-21kworker/u8:3-rpciod00:26:231
2412738991714,2cyclictest0-21swapper/122:35:021
2412738991713,3cyclictest1456-21in:imuxsock00:10:021
2412738991711,5cyclictest2815303-21kthreadcore23:45:181
2412738991711,5cyclictest2615678-21/usr/sbin/munin21:45:191
2412737991714,2cyclictest2901278-21unixbench_singl00:35:290
2412737991714,2cyclictest2887344-21cron00:30:000
2412737991714,2cyclictest2875946-21latency00:20:200
2412737991714,2cyclictest2697940-21apt-key22:35:000
2412737991714,2cyclictest2600604-21kthreadcore21:35:190
2412737991713,3cyclictest2853729-21runrttasks00:08:210
2354291170,5ptp4l175990irq/127-enp1s0-TxRx-020:40:033
2354291170,3ptp4l175990irq/127-enp1s0-TxRx-020:06:353
2412739991614,1cyclictest0-21swapper/223:59:422
2412739991614,1cyclictest0-21swapper/222:35:002
2412739991614,1cyclictest0-21swapper/200:10:412
2412739991613,1cyclictest0-21swapper/220:17:342
2412739991613,1cyclictest0-21swapper/200:20:002
241273899168,2cyclictest481rcuop/200:35:251
241273899164,5cyclictest0-21swapper/121:53:531
2412738991613,2cyclictest2829942-21latency_hist23:55:001
2412738991613,2cyclictest2797145-21cron23:35:011
2412738991613,2cyclictest2557424-21latency_hist21:10:021
2412738991613,2cyclictest2515615-21systemd-run20:35:011
2412738991613,2cyclictest146950irq/123-eno122:52:441
2412738991613,2cyclictest0-21swapper/121:20:001
2412738991612,3cyclictest2418802-21missed_timers19:15:011
2412738991610,5cyclictest2562864-21unixbench_multi21:10:251
241273899160,3cyclictest191rcu_preempt00:20:261
241273899160,15cyclictest2586170-21grep21:25:351
241273899160,12cyclictest2839404-21smartctl00:00:171
2412737991614,1cyclictest2723035-21sort22:50:020
2412737991613,2cyclictest9107-21rtkit-daemon22:16:040
2412737991613,2cyclictest2822210-21aten_repower_fr23:50:110
2412737991613,2cyclictest2545410-21apt-key21:00:000
2412737991613,2cyclictest2474110-21munin-plugin-st20:00:020
2412737991613,2cyclictest1520-21gdbus22:15:020
2412737991613,2cyclictest1378-21avahi-daemon00:35:020
2412737991613,2cyclictest0-21swapper/022:10:010
241273799160,2cyclictest2838207-21/usr/sbin/munin00:00:010
241273799160,1cyclictest0-21swapper/019:18:480
262632721512,1sleep20-21swapper/221:50:242
2412739991513,1cyclictest0-21swapper/222:09:522
2412739991513,1cyclictest0-21swapper/220:25:012
2412739991513,1cyclictest0-21swapper/219:25:072
2412739991512,1cyclictest0-21swapper/223:04:472
2412739991512,1cyclictest0-21swapper/220:42:002
2412739991511,1cyclictest0-21swapper/221:20:082
241273899159,5cyclictest2799234-21kthreadcore23:35:171
241273899159,5cyclictest2595727-21cut21:30:571
241273899159,5cyclictest0-21swapper/123:05:011
241273899159,1cyclictest2653259-21kthreadcore22:05:241
241273899158,6cyclictest2412736-21cyclictest22:10:181
241273899158,2cyclictest481rcuop/223:26:111
241273899158,2cyclictest481rcuop/221:03:391
241273899158,2cyclictest481rcuop/220:01:351
241273899158,2cyclictest481rcuop/219:59:511
241273899158,2cyclictest481rcuop/219:41:381
241273899158,2cyclictest481rcuop/219:35:181
241273899158,2cyclictest481rcuop/219:16:351
241273899154,5cyclictest0-21swapper/123:15:041
2412738991512,2cyclictest2764364-21latency_hist23:14:591
2412738991512,2cyclictest2432682-21systemd-run19:25:011
2412738991511,3cyclictest2888989-21irqrtprio00:30:181
2412738991511,3cyclictest2645196-21kthreadcore22:00:201
2412738991511,3cyclictest2576199-21kthreadcore21:20:171
2412737991512,2cyclictest2859953-21sendmail_mailqu00:10:280
2412737991512,2cyclictest2557371-21grep21:10:010
2412737991512,2cyclictest2551412-21kworker/0:2+events_freezable_power_21:14:570
2412737991512,2cyclictest2546001-21cpuspeed_turbos21:00:150
2412737991512,2cyclictest2486036-21apt-key20:10:010
2412737991512,2cyclictest2432180-21unixbench_singl19:20:280
2412737991512,2cyclictest2412736-21cyclictest23:05:160
2412737991512,2cyclictest1-21systemd21:25:350
2412737991512,2cyclictest1-21systemd20:45:010
2412737991512,2cyclictest0-21swapper/023:00:000
2412737991512,2cyclictest0-21swapper/021:45:010
2412737991510,4cyclictest2413589-21fschecks_time19:10:180
2412739991412,1cyclictest0-21swapper/222:15:212
2412739991412,1cyclictest0-21swapper/221:45:122
2412739991412,1cyclictest0-21swapper/200:05:132
2412739991411,1cyclictest0-21swapper/221:10:232
241273899149,4cyclictest2701255-21kthreadcore22:35:241
241273899148,1cyclictest2706958-21cpuspeed_turbos22:40:121
241273899147,3cyclictest34-21ksoftirqd/120:25:011
241273899147,2cyclictest481rcuop/222:16:371
241273899147,2cyclictest481rcuop/220:50:371
241273899147,2cyclictest481rcuop/220:42:191
241273899147,2cyclictest481rcuop/220:26:441
241273899144,6cyclictest471rcuog/219:55:021
241273899142,3cyclictest2813552-21awk23:45:001
241273899141,2cyclictest933681-1atop20:50:011
2412738991412,1cyclictest2608549-21kthreadcore21:40:191
2412738991411,2cyclictest2868115-21mailstats00:15:251
2412738991411,2cyclictest2833110-21kthreadcore23:55:221
2412738991411,2cyclictest2441519-21kthreadcore19:30:191
2412738991411,2cyclictest2433625-21gltestperf19:25:171
2412738991410,3cyclictest2520307-21kthreadcore20:35:221
2412738991410,3cyclictest2492577-21cpuspeed_turbos20:15:141
241273799148,4cyclictest1394-21dbus-daemon19:45:000
241273799147,5cyclictest2700140-21tr22:35:230
2412737991411,2cyclictest2865380-21kthreadcore00:15:190
2412737991411,2cyclictest2807418-21kthreadcore23:40:160
2412737991411,2cyclictest2789074-21latency_hist23:30:010
2412737991411,2cyclictest2773684-21gltestperf23:20:170
2412737991411,2cyclictest2682399-21cstates22:25:170
2412737991411,2cyclictest2643552-21kthreadcore22:00:200
2412737991411,2cyclictest2509117-21timerwakeupswit20:25:270
2412737991411,2cyclictest2492891-21fschecks_count20:15:160
2412737991411,2cyclictest2479875-21cron20:05:010
2412737991411,2cyclictest2463241-21head19:50:150
2412737991411,2cyclictest2412736-21cyclictest19:35:000
2412737991411,2cyclictest0-21swapper/022:44:590
2412737991411,2cyclictest0-21swapper/019:30:010
2412737991410,3cyclictest2615573-21kworker/u8:1+nfsiod22:51:050
2412737991410,3cyclictest1403-1atopacctd21:55:180
2412739991310,1cyclictest0-21swapper/223:50:192
241273899139,3cyclictest2774340-21kthreadcore23:20:211
241273899139,3cyclictest1456-21in:imuxsock00:15:021
2412738991310,2cyclictest2682007-21aten_repower_po22:25:151
2412738991310,2cyclictest2485076-21mailstats20:05:251
2412737991310,2cyclictest2838557-21/usr/sbin/munin00:00:140
2412737991310,2cyclictest2815303-21kthreadcore23:45:190
2412737991310,2cyclictest2797673-21aten_repower_po23:35:100
2412737991310,2cyclictest2756873-21cpuspeed_turbos23:10:120
2412737991310,2cyclictest2617001-21irqrtprio21:45:200
2412737991310,2cyclictest2571027-21timerandwakeup21:15:260
2412737991310,2cyclictest2557157-21diskmemload23:00:250
2412737991310,2cyclictest2535959-21kthreadcore20:50:200
2412737991310,2cyclictest2487307-21irqcore20:10:170
2412737991310,2cyclictest2445946-21irqrtprio19:35:190
2412737991310,2cyclictest1454-21systemd-logind20:40:020
2412737991310,2cyclictest1403-1atopacctd21:30:270
2412739991210,1cyclictest0-21swapper/219:20:122
2412739991210,1cyclictest0-21swapper/219:15:032
241273899129,2cyclictest2462308-21systemd-run19:50:011
241273899129,2cyclictest1403-1atopacctd19:10:021
241273799129,2cyclictest2510045-21aten_repower_cu20:30:120
241273799129,2cyclictest2459867-21kthreadcore19:45:190
241273999119,1cyclictest0-21swapper/223:05:192
24127379994,4cyclictest2412809-21cat19:10:020
24127399986,1cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional