You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 12:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Wed Nov 12, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
287841722100,2sleep30-21swapper/323:45:443
28428962980,1sleep10-21swapper/123:25:421
25116862480,1sleep1918143-1atop19:50:011
24787402310,2sleep0241rcuc/019:20:470
2460424992720,2cyclictest2566944-21grep20:35:020
29086532240,1sleep00-21swapper/000:00:480
2460426992213,4cyclictest0-21swapper/223:30:012
2460425992219,2cyclictest2903056-21find00:00:011
2460425992219,2cyclictest2466473-21latency_hist19:15:011
2460424992213,5cyclictest2623129-21kthreadcore21:15:490
246042499221,17cyclictest0-21swapper/000:37:380
2460424992211,6cyclictest0-21swapper/022:05:020
2460425992114,3cyclictest2851271-21/usr/sbin/munin23:30:471
2460425992114,2cyclictest2941059-21kthreadcore00:20:491
2460424992118,2cyclictest2548076-21grep20:20:000
2460424992114,6cyclictest0-21swapper/021:00:000
2460424992112,5cyclictest1700-21systemd-logind23:45:000
302487291200,3phc2sys0-21swapper/321:26:073
2460426992018,1cyclictest0-21swapper/220:55:012
2460425992017,2cyclictest0-21swapper/123:05:511
2460424992017,2cyclictest2850733-21grep23:30:010
2460424992014,5cyclictest2829217-21kthreadcore23:15:470
2460424992012,4cyclictest2663463-21irqrtprio21:40:460
2460426991916,1cyclictest0-21swapper/223:40:002
2460426991916,1cyclictest0-21swapper/223:40:002
2460425991913,2cyclictest2644826-21/usr/sbin/munin21:30:471
2460424991915,3cyclictest2740717-21tr22:25:410
2460424991915,3cyclictest1631-21gmain21:35:000
2460424991914,3cyclictest1629-21avahi-daemon21:10:020
2460424991912,6cyclictest2460422-21cyclictest23:00:470
246042499190,17cyclictest2731086-21munin-run22:20:000
302487291181,2phc2sys0-21swapper/300:11:033
302487291180,3phc2sys0-21swapper/323:23:083
246042599188,4cyclictest0-21swapper/122:25:011
2460425991815,2cyclictest2871171-21kthreadcore23:40:461
2460425991815,2cyclictest2807181-21ls23:05:001
2460425991815,2cyclictest2547203-21proc_pri20:15:501
246042499188,6cyclictest2956583-21gltestperf00:30:450
246042499188,2cyclictest0-21swapper/022:30:390
246042499187,6cyclictest0-21swapper/022:00:010
246042499181,6cyclictest0-21swapper/000:08:210
2460424991815,2cyclictest2894380-21latency_hist23:55:000
2460424991815,2cyclictest2734460-21sh22:20:480
2460424991815,2cyclictest2661625-21munin-plugin-st21:40:010
2460424991815,2cyclictest2460422-21cyclictest00:15:530
2460424991815,2cyclictest1700-21systemd-logind20:10:010
2460424991814,3cyclictest2948508-21kthreadcore00:25:470
302487291170,3phc2sys0-21swapper/323:10:463
302487291170,2phc2sys0-21swapper/322:22:023
302487291170,2phc2sys0-21swapper/321:15:323
246042699171,8cyclictest0-21swapper/222:10:012
2460426991715,1cyclictest0-21swapper/220:35:012
2460426991714,1cyclictest0-21swapper/222:50:482
2460426991714,1cyclictest0-21swapper/219:40:422
2460426991714,1cyclictest0-21swapper/200:15:502
2460426991713,1cyclictest0-21swapper/223:05:002
2460425991714,2cyclictest2825182-21/usr/sbin/munin23:15:481
2460425991713,2cyclictest2713821-21systemd-run22:10:011
2460425991713,2cyclictest0-21swapper/122:30:011
246042499178,2cyclictest0-21swapper/000:10:420
246042499174,4cyclictest170550irq/121-eno122:47:010
2460424991714,2cyclictest2787612-21kthreadcore22:50:480
2460424991714,2cyclictest2590293-21mailstats20:50:550
2460424991714,2cyclictest2494982-21kthreadcore19:35:500
246042499170,1cyclictest0-21swapper/022:08:180
302487291161,5phc2sys0-21swapper/300:25:493
302487291160,4phc2sys0-21swapper/321:42:063
302487291160,2phc2sys0-21swapper/323:00:093
302487291160,2phc2sys0-21swapper/300:31:493
246042699162,6cyclictest0-21swapper/200:30:012
2460426991614,1cyclictest0-21swapper/223:35:022
2460426991614,1cyclictest0-21swapper/220:30:012
2460426991613,2cyclictest0-21swapper/220:05:492
2460426991613,1cyclictest0-21swapper/223:40:472
2460426991613,1cyclictest0-21swapper/220:15:012
2460426991613,1cyclictest0-21swapper/219:35:002
2460426991613,1cyclictest0-21swapper/200:35:262
2460426991612,2cyclictest0-21swapper/222:15:012
2460426991612,2cyclictest0-21swapper/221:53:052
2460426991611,3cyclictest0-21swapper/221:13:252
246042599168,3cyclictest0-21swapper/121:45:461
246042599168,3cyclictest0-21swapper/100:15:011
246042599162,7cyclictest2969217-21sed00:35:491
246042599162,6cyclictest2730402-21diskmemload22:19:081
2460425991613,2cyclictest2767340-21if_err_eno122:40:441
2460425991613,2cyclictest2637418-21grep21:25:481
2460425991613,2cyclictest2601322-21kthreadcore21:00:481
2460425991613,2cyclictest2474389-21unixbench_singl19:15:541
2460425991612,2cyclictest0-21swapper/121:45:021
2460425991610,5cyclictest0-21swapper/122:40:001
246042499168,2cyclictest0-21swapper/022:12:480
246042499167,4cyclictest0-21swapper/023:35:410
246042499167,4cyclictest0-21swapper/023:35:410
246042499167,2cyclictest0-21swapper/023:05:470
246042499166,5cyclictest0-21swapper/023:21:060
246042499165,6cyclictest2567205-21aten_repower_fr20:35:430
246042499165,6cyclictest0-21swapper/023:45:050
246042499165,4cyclictest2493222-21sshd19:34:060
246042499164,7cyclictest2796033-21diskmemload22:56:170
246042499162,12cyclictest0-21swapper/022:44:590
2460424991614,1cyclictest2946633-21/usr/sbin/munin00:25:010
2460424991613,2cyclictest8351-21rtkit-daemon19:10:300
2460424991613,2cyclictest2687793-21munin-plugin-st21:55:020
2460424991613,2cyclictest2636843-21fschecks_count21:25:450
2460424991613,2cyclictest2482218-21tail19:25:430
2460424991613,2cyclictest1635-21dbus-daemon20:25:020
2460424991612,2cyclictest0-21swapper/023:35:020
2460424991611,1cyclictest0-21swapper/020:00:470
246042499160,11cyclictest2676380-21grep21:45:530
302487291151,3phc2sys0-21swapper/320:25:393
302487291150,2phc2sys0-21swapper/322:57:593
302487291150,2phc2sys0-21swapper/322:10:213
302487291150,2phc2sys0-21swapper/300:07:483
246042699151,8cyclictest0-21swapper/221:00:012
2460426991512,1cyclictest0-21swapper/223:50:492
2460426991512,1cyclictest0-21swapper/223:19:022
2460426991512,1cyclictest0-21swapper/222:35:012
2460426991512,1cyclictest0-21swapper/222:00:452
2460426991512,1cyclictest0-21swapper/221:30:022
2460426991512,1cyclictest0-21swapper/221:05:002
2460426991511,1cyclictest0-21swapper/222:20:012
2460426991511,1cyclictest0-21swapper/221:50:012
246042699150,13cyclictest0-21swapper/221:18:392
246042699150,12cyclictest0-21swapper/222:40:422
246042599158,3cyclictest2885536-21runrttasks23:49:451
246042599157,4cyclictest2955897-21aten2.4-expect00:30:411
246042599151,5cyclictest2578931-21idleruntime-cro20:45:001
2460425991512,2cyclictest2783893-21head22:50:401
2460425991512,2cyclictest2693244-21open_inodes21:55:501
2460425991512,2cyclictest2566606-21apt-key20:35:011
2460425991512,2cyclictest2535899-21/usr/sbin/munin20:10:001
2460425991512,2cyclictest2517490-21kworker/u16:1-rpciod21:15:471
2460425991512,2cyclictest2505537-21systemd-run19:45:011
2460425991512,2cyclictest2460422-21cyclictest22:10:411
2460425991512,2cyclictest2460422-21cyclictest00:20:011
2460425991512,2cyclictest1652-1atopacctd00:05:511
2460425991511,3cyclictest2863189-21kthreadcore23:35:481
2460425991511,3cyclictest2863189-21kthreadcore23:35:481
2460425991511,3cyclictest2850798-21kworker/u16:1+nfsiod23:53:241
2460425991511,3cyclictest2779045-21kthreadcore22:45:491
2460425991511,3cyclictest2654238-21sort21:35:461
246042499159,5cyclictest2764597-21runrttasks22:38:060
246042499157,2cyclictest0-21swapper/023:12:370
2460424991512,2cyclictest2460422-21cyclictest20:10:490
2460424991512,2cyclictest2460422-21cyclictest19:55:470
2460424991512,2cyclictest2460422-21cyclictest19:55:470
2460424991512,2cyclictest1700-21systemd-logind21:25:010
2460424991512,2cyclictest1700-21systemd-logind19:20:010
2460424991511,3cyclictest2517490-21kworker/u16:1+nfsiod21:14:370
246042499150,2cyclictest2517614-21apt19:55:000
302487291143,2phc2sys0-21swapper/320:44:433
302487291140,3phc2sys0-21swapper/322:05:353
302487291140,3phc2sys0-21swapper/321:11:063
302487291140,2phc2sys0-21swapper/322:49:033
302487291140,2phc2sys0-21swapper/321:03:333
302487291140,2phc2sys0-21swapper/320:20:463
246042699141,5cyclictest0-21swapper/219:20:012
2460426991412,1cyclictest0-21swapper/222:45:432
2460426991412,1cyclictest0-21swapper/219:55:012
2460426991412,1cyclictest0-21swapper/219:15:022
2460426991412,1cyclictest0-21swapper/200:05:022
2460426991411,1cyclictest0-21swapper/223:49:002
2460426991411,1cyclictest0-21swapper/223:20:442
2460426991411,1cyclictest0-21swapper/222:38:152
2460426991411,1cyclictest0-21swapper/222:20:442
2460426991411,1cyclictest0-21swapper/221:40:482
2460426991411,1cyclictest0-21swapper/221:10:012
2460426991411,1cyclictest0-21swapper/220:35:492
2460426991411,1cyclictest0-21swapper/220:05:022
2460426991411,1cyclictest0-21swapper/220:00:002
2460426991411,1cyclictest0-21swapper/220:00:002
2460426991411,1cyclictest0-21swapper/200:32:132
2460426991411,1cyclictest0-21swapper/200:11:052
246042599148,4cyclictest2492482-21cut19:30:501
246042599147,3cyclictest2697099-21tail22:00:391
2460425991412,1cyclictest1635-21dbus-daemon20:15:011
2460425991411,2cyclictest2952346-21threads00:25:531
2460425991411,2cyclictest2596664-21mailstats20:55:511
2460425991411,2cyclictest2588107-21kthreadcore20:50:511
2460425991411,2cyclictest2512639-21gltestperf19:50:421
2460425991411,2cyclictest2498476-21phc2sys19:35:531
2460425991411,2cyclictest2460422-21cyclictest23:24:081
2460425991411,2cyclictest2460422-21cyclictest21:10:511
2460425991411,2cyclictest1702-21in:imuxsock20:25:011
2460425991411,2cyclictest0-21swapper/123:10:461
2460425991410,3cyclictest2680758-21irqcore21:50:451
2460425991410,2cyclictest0-21swapper/120:30:021
246042599140,9cyclictest2791137-21cut22:55:421
2460424991411,2cyclictest2580378-21irqrtprio20:45:460
2460424991411,2cyclictest2574594-21kthreadcore20:40:520
2460424991411,2cyclictest2560230-21sh20:30:010
2460424991411,2cyclictest2510719-21proc_pri19:45:530
2460424991411,2cyclictest2501257-21kthreadcore19:40:470
302487291130,3phc2sys0-21swapper/320:15:453
302487291130,3phc2sys0-21swapper/300:17:493
302487291130,2phc2sys0-21swapper/323:50:103
302487291130,2phc2sys0-21swapper/323:39:043
302487291130,2phc2sys0-21swapper/323:39:043
302487291130,2phc2sys0-21swapper/322:50:353
302487291130,2phc2sys0-21swapper/322:29:333
302487291130,2phc2sys0-21swapper/322:03:303
302487291130,2phc2sys0-21swapper/321:54:213
302487291130,2phc2sys0-21swapper/321:21:453
246042699139,2cyclictest0-21swapper/219:25:462
246042699139,1cyclictest0-21swapper/220:19:162
2460426991311,1cyclictest0-21swapper/222:00:022
2460426991311,1cyclictest0-21swapper/220:45:442
2460426991310,2cyclictest0-21swapper/221:33:222
2460426991310,1cyclictest0-21swapper/223:55:422
2460426991310,1cyclictest0-21swapper/223:10:482
2460426991310,1cyclictest0-21swapper/223:05:472
2460426991310,1cyclictest0-21swapper/222:57:252
2460426991310,1cyclictest0-21swapper/220:41:582
2460426991310,1cyclictest0-21swapper/219:35:482
246042599139,3cyclictest2568421-21kthreadcore20:35:491
246042599136,5cyclictest260-21systemd-journal21:25:001
2460425991310,2cyclictest2904825-21irqcore00:00:451
2460425991310,2cyclictest2749972-21irqcore22:30:451
2460425991310,2cyclictest2482183-21gltestperf19:25:431
2460425991310,2cyclictest2477917-21kthreadcore19:20:471
246042499139,3cyclictest2896306-21irqrtprio23:55:450
246042499131,7cyclictest2460272-21latency_hist19:10:010
2460424991310,2cyclictest2599006-21irqrtprio21:00:460
302487291123,2phc2sys0-21swapper/300:38:203
302487291121,3phc2sys0-21swapper/300:00:533
302487291121,2phc2sys0-21swapper/322:16:493
302487291120,2phc2sys0-21swapper/323:08:363
302487291120,2phc2sys0-21swapper/321:30:403
302487291120,2phc2sys0-21swapper/320:34:253
302487291120,2phc2sys0-21swapper/320:12:053
302487291120,2phc2sys0-21swapper/319:57:263
302487291120,2phc2sys0-21swapper/319:57:263
2460426991210,1cyclictest0-21swapper/221:35:462
2460426991210,1cyclictest0-21swapper/221:20:402
2460426991210,1cyclictest0-21swapper/219:20:462
2460426991210,1cyclictest0-21swapper/200:05:482
246042699120,6cyclictest0-21swapper/222:25:392
246042599129,2cyclictest2525224-21irqrtprio20:00:491
246042599128,3cyclictest2580309-21irqcore20:45:461
246042599126,5cyclictest2605082-21cut21:05:491
246042599126,5cyclictest2520807-21tr19:55:481
246042599126,5cyclictest2520807-21tr19:55:481
302487291111,3phc2sys0-21swapper/321:37:133
302487291111,2phc2sys0-21swapper/319:05:413
302487291110,5phc2sys0-21swapper/319:25:393
302487291110,3phc2sys0-21swapper/321:57:253
302487291110,3phc2sys0-21swapper/319:50:453
302487291110,3phc2sys0-21swapper/319:20:483
302487291110,2phc2sys0-21swapper/323:30:393
246042699119,1cyclictest0-21swapper/219:45:402
246042699119,1cyclictest0-21swapper/200:20:062
246042699118,1cyclictest0-21swapper/220:20:482
246042699111,5cyclictest0-21swapper/219:10:012
246042599111,6cyclictest0-21swapper/119:10:021
302487291103,2phc2sys0-21swapper/323:25:493
302487291101,3phc2sys0-21swapper/323:57:133
302487291101,2phc2sys0-21swapper/319:40:433
302487291101,2phc2sys0-21swapper/300:20:053
302487291100,3phc2sys0-21swapper/322:35:243
302487291100,3phc2sys0-21swapper/319:45:443
302487291100,2phc2sys0-21swapper/323:44:013
302487291100,2phc2sys0-21swapper/323:16:083
302487291100,2phc2sys0-21swapper/322:40:253
302487291100,2phc2sys0-21swapper/322:30:073
302487291100,2phc2sys0-21swapper/321:50:003
302487291100,2phc2sys0-21swapper/320:50:523
30248729190,2phc2sys0-21swapper/321:05:463
30248729190,2phc2sys0-21swapper/321:00:013
30248729190,2phc2sys0-21swapper/320:45:433
30248729190,2phc2sys0-21swapper/320:35:493
30248729190,2phc2sys0-21swapper/320:08:483
30248729190,2phc2sys0-21swapper/320:00:433
30248729190,2phc2sys0-21swapper/319:36:383
30248729190,2phc2sys0-21swapper/319:30:333
30248729190,2phc2sys0-21swapper/319:15:033
30248729190,2phc2sys0-21swapper/319:10:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional