You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 11:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4.osadl.org (updated Tue Nov 25, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36228542227169,18sleep50-21swapper/519:05:485
36250652226171,17sleep40-21swapper/419:09:414
36250402220183,24sleep70-21swapper/719:09:207
36249492219189,19sleep30-21swapper/319:08:033
36250332218189,18sleep00-21swapper/019:09:130
36250192217163,17sleep60-21swapper/619:09:036
36249472217189,17sleep10-21swapper/119:08:011
36248352213179,22sleep20-21swapper/219:06:262
3625301993612,24cyclictest0-21swapper/422:16:094
3625307993529,5cyclictest0-21swapper/623:25:006
362528799354,30cyclictest3650357-21idleruntime-cro19:55:001
362528799342,31cyclictest3729329-21cron22:20:001
3625287993329,3cyclictest3805056-21idleruntime-cro00:40:001
362530399320,28cyclictest3680790-21apt-get20:50:565
362528799322,29cyclictest0-21swapper/120:25:561
362530999310,30cyclictest3677623-21idleruntime-cro20:45:007
3625287993129,2cyclictest3758974-21idleruntime-cro23:15:001
362528699310,29cyclictest0-21swapper/020:35:560
362530799300,29cyclictest3721000-21sh22:05:006
3625303993028,1cyclictest3653312-21cron20:00:005
362530399300,29cyclictest3820478-21systemd-journal21:25:005
362530399300,29cyclictest3796985-21sh00:25:005
362530199300,29cyclictest3710217-21sh21:45:004
3625287993028,1cyclictest3632000-21apt-get19:20:571
362528799300,29cyclictest0-21swapper/120:00:571
3625309992927,1cyclictest3735217-21apt-get22:30:557
3625309992927,1cyclictest3735217-21apt-get22:30:557
362530999290,28cyclictest3713390-21apt-get21:50:547
362530999290,28cyclictest0-21swapper/723:55:577
362530999290,28cyclictest0-21swapper/700:35:567
3625307992927,1cyclictest0-21swapper/621:00:006
3625307992926,2cyclictest1-21systemd22:40:006
362530799290,28cyclictest0-21swapper/623:35:586
362530799290,28cyclictest0-21swapper/623:00:576
3625303992928,1cyclictest0-21swapper/500:15:575
3625303992927,1cyclictest3691839-21apt-get21:10:575
3625303992927,1cyclictest0-21swapper/500:30:585
362530399290,28cyclictest0-21swapper/523:55:565
362530399290,28cyclictest0-21swapper/523:10:555
362530199290,28cyclictest0-21swapper/423:10:554
362530199290,28cyclictest0-21swapper/422:05:564
362529799290,28cyclictest0-21swapper/300:25:563
362529799290,28cyclictest0-21swapper/300:20:013
362529299290,28cyclictest0-21swapper/222:20:552
362529299290,28cyclictest0-21swapper/222:20:552
362529299290,28cyclictest0-21swapper/219:35:592
362529299290,1cyclictest0-21swapper/221:55:572
362528799290,28cyclictest0-21swapper/121:10:571
362528799290,28cyclictest0-21swapper/119:10:571
362528799290,1cyclictest3820478-21systemd-journal23:10:001
362528799290,1cyclictest3732043-21sh22:25:001
362528799290,1cyclictest3732043-21sh22:25:001
362528799290,1cyclictest0-21swapper/120:25:001
362528699290,28cyclictest3800163-21apt-get00:30:570
362528699290,28cyclictest3781007-21apt-get23:55:570
362528699290,28cyclictest0-21swapper/021:50:540
362528699290,28cyclictest0-21swapper/021:45:570
362528699290,28cyclictest0-21swapper/021:40:570
362528699290,28cyclictest0-21swapper/021:00:550
3625309992826,1cyclictest3625660-21apt-get19:10:577
3625309992825,2cyclictest3666684-21apt-get20:23:227
362530999280,0cyclictest0-21swapper/700:05:577
3625307992826,1cyclictest3786433-21apt-get00:05:576
3625303992826,1cyclictest0-21swapper/520:45:005
362530399280,27cyclictest0-21swapper/521:15:575
3625301992827,1cyclictest0-21swapper/422:30:554
3625301992827,1cyclictest0-21swapper/422:30:554
3625301992827,1cyclictest0-21swapper/422:00:554
3625301992827,1cyclictest0-21swapper/421:55:574
362530199280,27cyclictest0-21swapper/420:20:574
362530199280,27cyclictest0-21swapper/420:15:004
3625292992828,0cyclictest0-21swapper/219:55:562
362529299280,27cyclictest0-21swapper/200:05:012
362529299280,0cyclictest0-21swapper/223:35:582
362528799280,27cyclictest0-21swapper/119:45:561
362528799280,0cyclictest0-21swapper/123:25:571
3625286992827,1cyclictest3777839-21latency_hist23:50:010
3625286992826,1cyclictest3645463-21apt-get19:45:560
362528699280,28cyclictest3748211-21munin-run22:55:000
362528699280,28cyclictest0-21swapper/000:20:590
3625309992727,0cyclictest0-21swapper/722:10:567
3625307992727,0cyclictest0-21swapper/622:05:566
3625307992727,0cyclictest0-21swapper/621:05:566
3625307992727,0cyclictest0-21swapper/619:35:596
3625307992725,1cyclictest3772942-21apt-get23:40:566
3625307992725,1cyclictest3678104-21apt-get20:45:586
3625303992727,0cyclictest0-21swapper/523:35:585
3625303992727,0cyclictest0-21swapper/522:30:555
3625303992727,0cyclictest0-21swapper/522:30:555
3625301992727,0cyclictest0-21swapper/423:20:564
3625301992726,1cyclictest3781007-21apt-get23:55:574
3625301992726,1cyclictest0-21swapper/420:45:574
362530199270,0cyclictest0-21swapper/419:10:574
3625297992727,0cyclictest0-21swapper/322:25:573
3625297992727,0cyclictest0-21swapper/322:25:573
3625297992727,0cyclictest0-21swapper/322:15:003
3625297992727,0cyclictest0-21swapper/321:00:553
362529799270,0cyclictest0-21swapper/320:20:573
362529799270,0cyclictest0-21swapper/319:35:593
3625292992727,0cyclictest0-21swapper/221:40:572
3625292992727,0cyclictest0-21swapper/221:35:582
3625292992727,0cyclictest0-21swapper/220:15:582
3625292992725,1cyclictest3769764-21munin-run23:35:012
3625292992725,1cyclictest3637379-21apt-get19:30:572
3625287992727,0cyclictest0-21swapper/123:40:011
3625287992727,0cyclictest0-21swapper/122:10:561
3625287992727,0cyclictest0-21swapper/121:15:571
3625287992727,0cyclictest0-21swapper/120:30:571
3625287992726,1cyclictest0-21swapper/120:40:571
3625287992723,3cyclictest3710255-21awk21:45:001
3625286992727,0cyclictest0-21swapper/023:40:560
3625286992727,0cyclictest0-21swapper/022:40:560
3625286992727,0cyclictest0-21swapper/020:40:560
3625286992726,1cyclictest3750887-21sh23:00:000
3625307992626,0cyclictest0-21swapper/620:15:586
3625307992624,1cyclictest3702617-21apt-get21:30:576
3625303992625,1cyclictest0-21swapper/500:00:575
3625301992626,0cyclictest0-21swapper/420:30:574
3625301992625,1cyclictest0-21swapper/400:00:574
3625301992625,0cyclictest0-21swapper/422:25:564
3625301992625,0cyclictest0-21swapper/422:25:564
3625297992626,0cyclictest0-21swapper/323:05:563
3625297992626,0cyclictest0-21swapper/300:20:593
3625297992625,1cyclictest3778317-21apt-get23:50:573
3625292992626,0cyclictest0-21swapper/223:45:562
3625292992626,0cyclictest0-21swapper/219:15:562
3625292992625,1cyclictest0-21swapper/222:10:562
3625292992624,1cyclictest3772942-21apt-get23:40:562
3625287992626,0cyclictest0-21swapper/123:15:581
3625287992626,0cyclictest0-21swapper/121:55:561
3625287992626,0cyclictest0-21swapper/121:50:541
3625287992626,0cyclictest0-21swapper/121:05:001
3625286992626,0cyclictest0-21swapper/023:50:570
3625286992626,0cyclictest0-21swapper/020:00:570
3625286992626,0cyclictest0-21swapper/000:15:010
3625309992522,0cyclictest0-21swapper/720:30:567
3625307992525,0cyclictest0-21swapper/620:10:576
3625307992523,1cyclictest3764855-21apt-get23:25:576
3625303992525,0cyclictest3629025-21apt-get19:15:565
3625303992524,1cyclictest0-21swapper/521:50:545
3625303992523,1cyclictest3674915-21dump-pmu-power20:40:005
3625301992525,0cyclictest0-21swapper/423:25:574
3625301992525,0cyclictest0-21swapper/421:40:004
3625301992524,1cyclictest3664099-21munin-run20:20:004
3625301992524,1cyclictest0-21swapper/420:25:564
3625297992525,0cyclictest0-21swapper/323:40:563
3625297992525,0cyclictest0-21swapper/322:35:563
3625297992525,0cyclictest0-21swapper/322:20:553
3625297992525,0cyclictest0-21swapper/322:20:553
3625297992525,0cyclictest0-21swapper/321:45:573
3625297992525,0cyclictest0-21swapper/320:55:573
3625292992524,1cyclictest0-21swapper/219:45:562
3625292992523,1cyclictest0-21swapper/220:55:002
3625287992522,2cyclictest3753599-21turbostat.cron23:05:001
3625286992525,0cyclictest0-21swapper/021:05:560
3625286992525,0cyclictest0-21swapper/020:25:570
3625286992524,1cyclictest3669622-21kworker/0:2+i915-unordered22:16:090
3625309992424,0cyclictest0-21swapper/721:10:587
3625309992424,0cyclictest0-21swapper/719:15:567
3625309992422,1cyclictest3748682-21apt-get22:55:567
3625307992424,0cyclictest0-21swapper/623:50:576
3625307992424,0cyclictest0-21swapper/622:45:576
3625307992424,0cyclictest0-21swapper/620:00:006
3625307992424,0cyclictest0-21swapper/600:30:586
3625303992424,0cyclictest0-21swapper/500:05:575
3625301992424,0cyclictest0-21swapper/423:45:564
3625301992423,1cyclictest0-21swapper/421:45:574
3625301992422,1cyclictest3802848-21apt-get00:35:554
3625301992422,1cyclictest3775145-21cron23:45:014
3625301992422,1cyclictest3672704-21apt-get20:35:564
3625297992424,0cyclictest0-21swapper/321:55:563
3625297992424,0cyclictest0-21swapper/319:55:563
3625297992423,1cyclictest0-21swapper/322:10:003
3625292992424,0cyclictest0-21swapper/222:15:572
3625292992424,0cyclictest0-21swapper/221:10:582
3625287992424,0cyclictest0-21swapper/120:35:561
3625287992424,0cyclictest0-21swapper/100:00:571
3625287992422,1cyclictest3634689-21apt-get19:25:571
3625309992322,0cyclictest0-21swapper/722:40:567
3625309992321,1cyclictest3762165-21apt-get23:20:567
3625309992321,1cyclictest3723688-21apt22:10:007
3625309992321,1cyclictest0-21swapper/720:35:567
3625307992323,0cyclictest0-21swapper/620:05:556
3625307992323,0cyclictest0-21swapper/619:25:566
3625303992323,0cyclictest0-21swapper/500:35:565
3625303992322,1cyclictest0-21swapper/522:00:555
3625301992322,1cyclictest1-21systemd20:55:004
3625301992322,1cyclictest0-21swapper/420:00:574
3625297992323,0cyclictest0-21swapper/321:40:583
3625297992323,0cyclictest0-21swapper/320:15:583
3625297992322,1cyclictest0-21swapper/322:55:573
3625297992320,2cyclictest3820478-21systemd-journal19:50:013
3625297992319,3cyclictest3694037-21sh21:15:003
3625292992318,4cyclictest3634239-21awk19:25:012
3625287992323,0cyclictest0-21swapper/123:55:561
3625287992323,0cyclictest0-21swapper/122:35:561
3625287992323,0cyclictest0-21swapper/100:30:581
3625287992322,1cyclictest3734733-21sh22:30:001
3625287992322,1cyclictest3734733-21sh22:30:001
3625287992322,1cyclictest0-21swapper/119:15:561
362528799231,14cyclictest0-21swapper/123:20:551
3625286992323,0cyclictest0-21swapper/022:45:570
3625286992323,0cyclictest0-21swapper/022:30:550
3625286992323,0cyclictest0-21swapper/022:30:550
3625286992323,0cyclictest0-21swapper/019:10:570
3625286992322,1cyclictest3802848-21apt-get00:35:560
3625286992322,1cyclictest3697239-21apt-get21:20:570
3625286992322,1cyclictest3694528-21apt-get21:15:570
3625286992322,1cyclictest0-21swapper/022:15:000
3625307992222,0cyclictest0-21swapper/621:10:586
3625307992222,0cyclictest0-21swapper/619:20:026
3625301992222,0cyclictest0-21swapper/400:10:564
3625297992222,0cyclictest0-21swapper/322:00:553
3625292992222,0cyclictest0-21swapper/221:00:552
3625292992220,1cyclictest3799678-21sh00:30:002
3625286992222,0cyclictest0-21swapper/022:25:560
3625286992222,0cyclictest0-21swapper/022:25:560
3625286992222,0cyclictest0-21swapper/019:40:580
3625286992222,0cyclictest0-21swapper/000:05:570
3625309992121,0cyclictest0-21swapper/720:45:577
3625309992119,1cyclictest0-21swapper/719:55:557
3625309992119,1cyclictest0-21swapper/719:50:587
3625307992121,0cyclictest0-21swapper/621:45:576
3625307992121,0cyclictest0-21swapper/620:50:566
3625307992121,0cyclictest0-21swapper/620:45:006
3625307992121,0cyclictest0-21swapper/619:30:586
3625307992121,0cyclictest0-21swapper/619:20:016
3625307992120,1cyclictest0-21swapper/622:10:566
3625307992118,2cyclictest3702136-21latency_hist21:30:006
3625303992121,0cyclictest0-21swapper/522:10:565
3625303992119,2cyclictest0-21swapper/520:23:225
3625303992116,1cyclictest0-21swapper/520:30:565
3625301992119,2cyclictest3631327-21dpkg19:20:014
3625297992121,0cyclictest0-21swapper/321:20:573
3625297992118,2cyclictest3820478-21systemd-journal20:55:003
3625292992120,1cyclictest0-21swapper/220:20:572
3625287992121,0cyclictest0-21swapper/123:30:581
3625287992121,0cyclictest0-21swapper/122:30:551
3625287992121,0cyclictest0-21swapper/122:30:551
3625287992121,0cyclictest0-21swapper/121:25:571
3625286992120,1cyclictest0-21swapper/000:20:010
3625309992020,0cyclictest0-21swapper/721:20:577
3625307992020,0cyclictest0-21swapper/622:50:566
3625303992019,0cyclictest0-21swapper/519:10:575
3625301992020,0cyclictest0-21swapper/423:05:564
3625301992020,0cyclictest0-21swapper/422:45:574
3625301992019,1cyclictest0-21swapper/421:10:574
3625297992020,0cyclictest0-21swapper/319:40:573
3625292992020,0cyclictest0-21swapper/221:05:562
3625287992020,0cyclictest0-21swapper/123:50:571
3625286992020,0cyclictest0-21swapper/023:05:560
3625309991919,0cyclictest0-21swapper/722:15:577
3625309991919,0cyclictest0-21swapper/721:30:577
3625307991919,0cyclictest0-21swapper/621:35:576
3625303991916,2cyclictest3820478-21systemd-journal22:10:005
3625301991919,0cyclictest0-21swapper/423:15:574
3625301991919,0cyclictest0-21swapper/419:55:554
3625301991917,1cyclictest581rcuc/419:55:004
3625297991919,0cyclictest0-21swapper/319:15:563
3625292991919,0cyclictest0-21swapper/223:50:562
3625292991919,0cyclictest0-21swapper/223:00:572
3625292991918,1cyclictest3658739-21awk20:10:002
3625286991919,0cyclictest0-21swapper/022:05:560
3625286991919,0cyclictest0-21swapper/019:50:580
3625309991818,0cyclictest0-21swapper/720:00:577
3625307991817,1cyclictest3656051-21awk20:05:006
3625301991817,1cyclictest60-21ksoftirqd/400:20:014
3625297991816,1cyclictest3775630-21apt-get23:45:563
3625292991818,0cyclictest0-21swapper/200:30:582
3625287991818,0cyclictest0-21swapper/121:05:561
3625309991717,0cyclictest0-21swapper/720:50:567
3625309991717,0cyclictest0-21swapper/719:30:587
3625309991717,0cyclictest0-21swapper/700:10:567
362530999170,16cyclictest3657203-21fschecks_time20:05:587
3625301991717,0cyclictest0-21swapper/419:40:014
3625301991717,0cyclictest0-21swapper/400:25:564
3625297991714,2cyclictest3767513-21/usr/sbin/munin23:31:073
3625292991717,0cyclictest0-21swapper/200:15:572
3625292991714,2cyclictest3698272-21memory21:21:012
362529299170,16cyclictest876-21snmpd19:10:062
3625287991716,1cyclictest0-21swapper/121:00:001
3625286991717,0cyclictest0-21swapper/021:10:570
3625286991716,1cyclictest3756764-21apt-get23:10:550
3625309991616,0cyclictest0-21swapper/722:25:007
3625309991616,0cyclictest0-21swapper/722:25:007
3625309991616,0cyclictest0-21swapper/721:10:007
3625309991615,1cyclictest0-21swapper/720:55:597
362530999160,15cyclictest0-21swapper/723:50:017
362530999160,15cyclictest0-21swapper/723:34:577
362530999160,15cyclictest0-21swapper/721:57:367
3625307991616,0cyclictest0-21swapper/623:10:556
362530799160,15cyclictest3668353-21/usr/sbin/munin20:26:016
3625303991616,0cyclictest0-21swapper/522:55:565
3625303991616,0cyclictest0-21swapper/522:40:565
3625303991614,1cyclictest3768442-21irqstats23:31:015
3625303991614,1cyclictest0-21swapper/522:15:575
3625303991614,1cyclictest0-21swapper/521:30:575
3625303991614,1cyclictest0-21swapper/500:10:575
362530399160,15cyclictest3799381-21users00:26:065
362530399160,15cyclictest0-21swapper/523:40:585
3625301991615,0cyclictest0-21swapper/421:50:554
3625301991614,1cyclictest3732045-21cron22:25:004
3625301991614,1cyclictest3732045-21cron22:25:004
3625297991616,0cyclictest0-21swapper/323:00:573
3625297991616,0cyclictest0-21swapper/321:05:563
3625297991616,0cyclictest0-21swapper/320:30:563
3625297991615,1cyclictest3714541-21strings21:50:593
3625292991615,1cyclictest0-21swapper/221:50:002
3625292991614,1cyclictest3791327-21sh00:15:012
3625287991616,0cyclictest0-21swapper/100:15:101
3625287991614,2cyclictest0-21swapper/122:50:061
3625287991614,1cyclictest0-21swapper/119:35:581
3625309991515,0cyclictest0-21swapper/723:09:017
3625309991515,0cyclictest0-21swapper/722:00:557
3625309991515,0cyclictest0-21swapper/700:33:457
3625309991515,0cyclictest0-21swapper/700:20:587
362530999150,15cyclictest0-21swapper/723:15:017
362530999150,15cyclictest0-21swapper/722:29:107
362530999150,15cyclictest0-21swapper/722:29:107
362530999150,15cyclictest0-21swapper/721:41:327
362530999150,15cyclictest0-21swapper/720:16:007
362530999150,15cyclictest0-21swapper/719:20:057
362530999150,14cyclictest0-21swapper/723:17:147
362530999150,14cyclictest0-21swapper/722:38:147
362530999150,14cyclictest0-21swapper/721:01:327
362530999150,14cyclictest0-21swapper/719:47:177
362530999150,14cyclictest0-21swapper/719:36:037
3625307991515,0cyclictest0-21swapper/623:30:586
3625307991515,0cyclictest0-21swapper/622:16:066
3625307991515,0cyclictest0-21swapper/600:10:566
3625307991514,1cyclictest0-21swapper/623:16:026
362530799150,15cyclictest0-21swapper/621:41:046
362530799150,14cyclictest0-21swapper/623:45:586
362530799150,14cyclictest0-21swapper/621:55:206
362530799150,14cyclictest0-21swapper/619:40:366
362530799150,14cyclictest0-21swapper/600:20:236
3625303991515,0cyclictest0-21swapper/523:20:565
3625303991515,0cyclictest0-21swapper/520:45:575
362530399150,14cyclictest0-21swapper/523:46:015
362530399150,14cyclictest0-21swapper/523:19:245
362530399150,14cyclictest0-21swapper/523:06:035
362530399150,14cyclictest0-21swapper/522:39:355
362530399150,14cyclictest0-21swapper/521:40:545
362530399150,14cyclictest0-21swapper/521:25:255
362530399150,14cyclictest0-21swapper/521:06:225
362530399150,14cyclictest0-21swapper/520:26:375
362530399150,14cyclictest0-21swapper/520:11:055
362530399150,14cyclictest0-21swapper/519:38:115
362530399150,14cyclictest0-21swapper/519:30:425
362530399150,0cyclictest0-21swapper/520:55:105
362530399150,0cyclictest0-21swapper/520:05:585
3625301991515,0cyclictest0-21swapper/421:05:554
3625301991514,1cyclictest0-21swapper/420:40:574
362530199150,14cyclictest0-21swapper/421:04:184
362530199150,14cyclictest0-21swapper/419:25:384
3625297991515,0cyclictest0-21swapper/322:17:583
3625297991515,0cyclictest0-21swapper/320:41:283
3625297991515,0cyclictest0-21swapper/320:25:573
3625297991515,0cyclictest0-21swapper/319:20:413
3625297991515,0cyclictest0-21swapper/319:10:033
3625297991515,0cyclictest0-21swapper/300:35:563
3625297991515,0cyclictest0-21swapper/300:00:273
362529799150,15cyclictest0-21swapper/322:52:553
362529799150,15cyclictest0-21swapper/322:45:583
362529799150,14cyclictest0-21swapper/323:36:213
362529799150,14cyclictest0-21swapper/323:20:483
362529799150,14cyclictest0-21swapper/322:42:513
362529799150,14cyclictest0-21swapper/321:15:303
362529799150,14cyclictest0-21swapper/320:11:043
362529799150,14cyclictest0-21swapper/320:00:423
362529799150,14cyclictest0-21swapper/300:05:113
3625292991515,0cyclictest0-21swapper/222:43:042
3625292991515,0cyclictest0-21swapper/222:30:552
3625292991515,0cyclictest0-21swapper/222:30:552
3625292991515,0cyclictest0-21swapper/222:05:002
3625292991515,0cyclictest0-21swapper/220:10:562
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional