You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-07 - 14:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4.osadl.org (updated Fri Nov 07, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19535402226189,24sleep40-21swapper/419:06:444
19537032225195,18sleep50-21swapper/519:09:025
19537082224171,17sleep10-21swapper/119:09:061
19537402223190,21sleep30-21swapper/319:09:323
19536032223190,21sleep20-21swapper/219:07:382
19537352218184,21sleep70-21swapper/719:09:287
19536072217186,20sleep60-21swapper/619:07:436
19515432213185,18sleep00-21swapper/019:05:520
1953975993428,2cyclictest0-21swapper/321:55:013
195396699330,30cyclictest3820478-21systemd-journal21:55:010
1953980993232,0cyclictest0-21swapper/419:45:594
195398099322,29cyclictest0-21swapper/422:40:014
1953966993128,2cyclictest1978780-21sh19:55:000
195398999300,2cyclictest2085172-21apt23:10:006
195398999300,29cyclictest3820478-21systemd-journal00:10:006
195398999300,29cyclictest2006258-21sh20:45:006
195398499300,29cyclictest2123429-21turbostat.cron00:20:005
195398499300,28cyclictest2082966-21apt-get23:05:595
195397599300,29cyclictest3820478-21systemd-journal23:15:003
1953971993027,2cyclictest2077080-21sh22:55:002
1953966993027,3cyclictest2104330-21awk23:45:000
195399199290,28cyclictest0-21swapper/722:50:007
195398999290,28cyclictest1957710-21apt-get19:15:576
195398999290,28cyclictest0-21swapper/622:05:586
195398999290,1cyclictest2044982-21apt-get21:55:596
1953984992927,1cyclictest1968019-21munin-run19:35:005
1953984992927,1cyclictest0-21swapper/520:55:005
1953984992927,1cyclictest0-21swapper/520:55:005
1953984992926,2cyclictest1989550-21sh20:15:005
195398499290,28cyclictest0-21swapper/522:50:005
195398499290,28cyclictest0-21swapper/521:40:025
195398499290,28cyclictest0-21swapper/500:21:025
195398499290,1cyclictest2030514-21sh21:30:005
1953980992927,1cyclictest3820478-21systemd-journal00:15:004
1953980992927,1cyclictest2052586-21idleruntime-cro22:10:014
1953980992927,1cyclictest2017517-21apt-get21:05:584
195398099290,28cyclictest1965804-21apt-get19:31:024
195398099290,28cyclictest0-21swapper/423:00:584
195398099290,28cyclictest0-21swapper/421:30:594
195397599290,1cyclictest2035905-21munin-run21:40:003
1953971992929,0cyclictest0-21swapper/222:20:012
1953971992914,15cyclictest0-21swapper/200:05:012
195397199290,29cyclictest0-21swapper/220:55:002
195397199290,29cyclictest0-21swapper/220:55:002
195397199290,28cyclictest2128829-21latency_hist00:30:002
195397199290,28cyclictest0-21swapper/223:05:592
195397199290,28cyclictest0-21swapper/222:30:592
195397199290,1cyclictest0-21swapper/223:00:582
195397199290,1cyclictest0-21swapper/222:20:592
195396999290,28cyclictest0-21swapper/122:50:591
195396999290,28cyclictest0-21swapper/121:55:011
195396999290,28cyclictest0-21swapper/120:41:021
195396999290,28cyclictest0-21swapper/120:21:001
195396999290,28cyclictest0-21swapper/120:06:031
195396999290,28cyclictest0-21swapper/119:21:001
195396999290,28cyclictest0-21swapper/100:01:031
1953966992928,1cyclictest1995221-21debian-sa120:25:000
1953966992927,1cyclictest2039349-21apt-get21:46:020
1953966992927,1cyclictest0-21swapper/019:21:000
195396699290,29cyclictest2003555-21apt20:40:000
195396699290,28cyclictest0-21swapper/022:25:590
195396699290,28cyclictest0-21swapper/021:26:010
1953991992828,0cyclictest0-21swapper/723:05:597
1953991992828,0cyclictest0-21swapper/720:21:007
1953991992827,1cyclictest0-21swapper/723:45:597
1953991992827,1cyclictest0-21swapper/722:15:597
1953991992827,1cyclictest0-21swapper/721:40:027
1953991992826,1cyclictest2052617-21awk22:10:017
1953989992827,1cyclictest0-21swapper/600:01:036
1953984992826,1cyclictest2004059-21apt-get20:41:035
195398499280,27cyclictest0-21swapper/519:36:005
1953980992826,1cyclictest2077569-21apt-get22:56:004
195398099280,27cyclictest0-21swapper/420:45:594
195398099280,27cyclictest0-21swapper/420:45:594
195398099280,27cyclictest0-21swapper/400:16:034
1953975992828,0cyclictest0-21swapper/319:11:003
1953975992825,2cyclictest2003554-21idleruntime-cro20:40:003
1953975992824,3cyclictest1-21systemd00:00:003
195397599280,28cyclictest0-21swapper/320:31:013
195397599280,28cyclictest0-21swapper/320:31:013
1953971992828,0cyclictest0-21swapper/222:25:592
1953971992827,1cyclictest0-21swapper/219:56:012
1953971992826,1cyclictest430088-21rs:main2
1953971992826,1cyclictest0-21swapper/223:40:002
195397199280,27cyclictest0-21swapper/221:05:582
1953969992824,3cyclictest3820478-21systemd-journal19:15:001
195396999280,0cyclictest0-21swapper/122:20:591
1953966992827,1cyclictest0-21swapper/023:30:590
1953966992826,1cyclictest2035885-21sh21:40:000
1953966992826,1cyclictest0-21swapper/021:45:000
1953966992825,2cyclictest1976097-21apt19:50:000
1953966992824,1cyclictest201rcu_preempt20:06:030
195396699280,28cyclictest0-21swapper/020:26:000
195396699280,0cyclictest0-21swapper/019:11:000
1953989992725,1cyclictest1976106-21munin-run19:50:006
195398999270,0cyclictest0-21swapper/600:36:006
1953984992726,1cyclictest2041550-21turbostat.cron21:50:005
195398499270,0cyclictest0-21swapper/523:45:595
1953980992724,2cyclictest2049933-21basename22:05:014
1953980992724,2cyclictest1965319-21latency_hist19:30:004
1953975992727,0cyclictest0-21swapper/319:51:003
1953975992727,0cyclictest0-21swapper/319:21:003
1953971992725,1cyclictest0-21swapper/220:15:002
195397199270,0cyclictest0-21swapper/219:45:592
1953969992727,0cyclictest0-21swapper/122:46:011
1953969992727,0cyclictest0-21swapper/122:05:581
1953969992727,0cyclictest0-21swapper/121:55:021
195396999270,0cyclictest0-21swapper/121:20:591
1953966992727,0cyclictest0-21swapper/020:00:590
1953966992726,1cyclictest0-21swapper/023:51:000
1953966992725,1cyclictest0-21swapper/019:31:020
195396699270,27cyclictest0-21swapper/000:25:580
1953991992626,0cyclictest0-21swapper/719:51:007
1953991992626,0cyclictest0-21swapper/719:36:007
1953991992626,0cyclictest0-21swapper/700:21:027
1953991992624,1cyclictest1989553-21sh20:15:007
1953989992626,0cyclictest0-21swapper/623:25:596
1953989992626,0cyclictest0-21swapper/620:36:016
1953989992625,1cyclictest0-21swapper/619:15:006
1953984992626,0cyclictest0-21swapper/500:31:035
1953984992625,1cyclictest0-21swapper/523:10:595
1953984992625,1cyclictest0-21swapper/520:21:005
1953984992625,0cyclictest0-21swapper/519:56:015
1953980992626,0cyclictest0-21swapper/422:10:594
1953980992626,0cyclictest0-21swapper/420:35:014
1953975992626,0cyclictest0-21swapper/323:00:003
1953975992626,0cyclictest0-21swapper/321:05:583
1953975992626,0cyclictest0-21swapper/320:45:593
1953975992626,0cyclictest0-21swapper/320:45:593
1953971992625,1cyclictest0-21swapper/223:51:002
1953971992625,1cyclictest0-21swapper/220:35:012
1953969992626,0cyclictest0-21swapper/122:55:591
1953969992626,0cyclictest0-21swapper/119:31:101
1953969992626,0cyclictest0-21swapper/119:26:021
1953969992625,1cyclictest0-21swapper/121:26:011
1953969992624,1cyclictest2009433-21apt-get20:51:021
1953969992624,1cyclictest2009433-21apt-get20:51:021
1953966992626,0cyclictest0-21swapper/019:26:020
1953966992625,1cyclictest2017029-21sh21:05:000
1953991992525,0cyclictest0-21swapper/720:56:007
1953991992525,0cyclictest0-21swapper/719:35:007
1953991992524,1cyclictest2129315-21apt-get00:31:037
1953991992524,1cyclictest2011630-21sh20:55:007
1953991992524,1cyclictest2011630-21sh20:55:007
1953989992525,0cyclictest0-21swapper/622:40:586
1953989992524,1cyclictest0-21swapper/619:56:016
1953984992525,0cyclictest0-21swapper/519:40:595
1953984992524,1cyclictest1995705-21apt-get20:26:005
1953984992524,1cyclictest0-21swapper/523:41:005
1953984992524,1cyclictest0-21swapper/522:40:585
1953984992524,1cyclictest0-21swapper/500:25:595
1953984992523,1cyclictest0-21swapper/523:35:005
1953984992522,2cyclictest2082476-21sh23:05:005
1953980992525,0cyclictest0-21swapper/422:50:594
1953980992525,0cyclictest0-21swapper/422:30:594
1953980992525,0cyclictest0-21swapper/400:05:014
1953975992525,0cyclictest0-21swapper/323:45:593
1953975992525,0cyclictest0-21swapper/322:25:593
1953975992525,0cyclictest0-21swapper/320:26:003
1953971992525,0cyclictest0-21swapper/221:46:022
1953971992525,0cyclictest0-21swapper/221:00:592
1953971992524,1cyclictest0-21swapper/223:41:002
1953971992524,1cyclictest0-21swapper/223:10:592
1953969992525,0cyclictest0-21swapper/119:35:591
1953969992524,1cyclictest0-21swapper/122:10:591
1953966992525,0cyclictest0-21swapper/021:10:590
1953966992524,0cyclictest0-21swapper/000:31:030
1953991992424,0cyclictest0-21swapper/720:41:037
1953991992423,1cyclictest2041551-21idleruntime-cro21:50:007
1953991992422,1cyclictest2077119-21awk22:55:007
1953989992422,1cyclictest1960425-21apt-get19:21:006
1953984992424,0cyclictest0-21swapper/522:55:005
1953980992424,0cyclictest0-21swapper/420:51:024
1953980992424,0cyclictest0-21swapper/420:51:024
1953980992424,0cyclictest0-21swapper/420:06:034
1953980992424,0cyclictest0-21swapper/400:25:584
1953980992424,0cyclictest0-21swapper/400:00:004
1953980992421,2cyclictest2074397-21idleruntime-cro22:50:004
1953975992424,0cyclictest0-21swapper/321:55:593
1953975992424,0cyclictest0-21swapper/321:26:013
1953975992422,1cyclictest1995220-21idleruntime-cro20:25:003
1953975992422,1cyclictest1981978-21apt-get20:00:593
1953971992424,0cyclictest0-21swapper/219:30:002
1953971992423,1cyclictest0-21swapper/220:00:592
1953969992424,0cyclictest0-21swapper/122:40:581
1953969992423,1cyclictest2047696-21apt-get22:01:001
1953969992423,1cyclictest0-21swapper/120:26:001
1953969992422,1cyclictest2033203-21debian-sa121:35:001
1953966992423,1cyclictest1981470-21cron20:00:000
1953966992423,1cyclictest0-21swapper/023:40:000
1953966992421,2cyclictest2014327-21dump-pmu-power21:00:000
1953991992323,0cyclictest0-21swapper/719:56:017
1953989992323,0cyclictest0-21swapper/622:46:006
1953984992321,1cyclictest0-21swapper/500:36:005
1953980992323,0cyclictest0-21swapper/421:40:594
1953980992323,0cyclictest0-21swapper/419:20:004
1953980992321,1cyclictest2006293-21awk20:45:004
1953975992323,0cyclictest0-21swapper/300:25:583
1953975992322,0cyclictest0-21swapper/323:30:593
1953975992320,2cyclictest3820478-21systemd-journal19:50:003
1953971992323,0cyclictest0-21swapper/221:40:592
1953971992323,0cyclictest0-21swapper/220:21:002
1953971992321,1cyclictest2025618-21apt-get21:20:592
1953966992323,0cyclictest0-21swapper/022:10:590
1953966992322,1cyclictest2050380-21apt-get22:05:580
1953991992222,0cyclictest0-21swapper/723:41:007
1953991992222,0cyclictest0-21swapper/723:10:597
1953991992222,0cyclictest0-21swapper/722:40:587
1953991992222,0cyclictest0-21swapper/719:40:597
1953991992222,0cyclictest0-21swapper/700:25:597
1953991992222,0cyclictest0-21swapper/700:16:037
1953989992222,0cyclictest0-21swapper/622:01:006
1953989992222,0cyclictest0-21swapper/620:45:596
1953989992222,0cyclictest0-21swapper/620:45:596
1953989992220,1cyclictest2091055-21apt-get23:21:006
1953984992222,0cyclictest0-21swapper/521:05:585
1953984992222,0cyclictest0-21swapper/519:51:005
1953984992220,1cyclictest2101339-21munin-run23:40:005
1953980992222,0cyclictest0-21swapper/423:36:004
1953975992222,0cyclictest0-21swapper/323:45:003
1953975992222,0cyclictest0-21swapper/321:46:023
1953975992222,0cyclictest0-21swapper/320:20:003
1953975992221,1cyclictest0-21swapper/319:26:023
1953975992220,1cyclictest2017033-21latency_hist21:05:003
1953975992220,1cyclictest0-21swapper/321:45:003
1953975992220,1cyclictest0-21swapper/321:10:593
1953971992222,0cyclictest0-21swapper/221:00:002
1953971992222,0cyclictest0-21swapper/219:51:002
1953969992222,0cyclictest0-21swapper/123:30:591
1953969992222,0cyclictest0-21swapper/123:20:591
1953969992222,0cyclictest0-21swapper/121:15:001
1953969992222,0cyclictest0-21swapper/120:00:591
1953969992222,0cyclictest0-21swapper/119:40:591
1953969992221,1cyclictest0-21swapper/119:45:591
1953969992220,1cyclictest2058525-21sed22:20:011
1953966992222,0cyclictest0-21swapper/023:10:590
1953966992221,1cyclictest0-21swapper/023:05:590
1953966992219,2cyclictest2134194-21cron00:40:000
1953991992121,0cyclictest0-21swapper/723:35:007
1953991992121,0cyclictest0-21swapper/720:26:007
1953991992120,1cyclictest0-21swapper/723:05:007
1953989992121,0cyclictest0-21swapper/623:56:006
1953984992121,0cyclictest0-21swapper/522:20:025
1953984992120,1cyclictest0-21swapper/523:56:005
1953984992120,1cyclictest0-21swapper/523:21:005
1953984992119,1cyclictest2047696-21apt-get22:01:015
1953984992119,1cyclictest0-21swapper/500:01:035
1953980992121,0cyclictest0-21swapper/423:30:594
1953980992121,0cyclictest0-21swapper/420:10:594
1953980992120,1cyclictest2039349-21apt-get21:46:024
1953975992121,0cyclictest0-21swapper/323:51:003
1953975992121,0cyclictest0-21swapper/319:31:023
1953971992121,0cyclictest0-21swapper/223:45:592
1953971992121,0cyclictest0-21swapper/222:05:582
1953971992120,1cyclictest1960425-21apt-get19:20:592
1953971992120,1cyclictest0-21swapper/221:55:582
1953966992121,0cyclictest0-21swapper/022:30:590
1953966992121,0cyclictest0-21swapper/021:30:590
1953991992020,0cyclictest0-21swapper/721:05:587
1953991992018,1cyclictest0-21swapper/721:50:597
1953984992020,0cyclictest0-21swapper/521:50:595
1953984992020,0cyclictest0-21swapper/521:01:005
1953984992020,0cyclictest0-21swapper/519:15:575
1953984992018,1cyclictest2118060-21munin-run00:10:005
1953980992020,0cyclictest0-21swapper/422:15:594
1953980992018,1cyclictest2082966-21apt-get23:05:594
1953975992018,2cyclictest1984670-21apt-get20:06:033
1953975992018,1cyclictest1981467-21sh20:00:003
1953971992020,0cyclictest0-21swapper/219:15:572
1953966992020,0cyclictest0-21swapper/021:05:580
1953966992019,1cyclictest2072195-21apt-get22:46:000
1953966992019,1cyclictest16-21ksoftirqd/019:15:570
1953966992016,3cyclictest2112363-21sh00:00:000
1953991991918,1cyclictest2101384-21http23:40:007
1953991991918,1cyclictest0-21swapper/722:20:027
1953989991919,0cyclictest0-21swapper/619:40:596
1953984991919,0cyclictest0-21swapper/521:20:595
1953980991919,0cyclictest0-21swapper/422:45:014
1953980991916,2cyclictest3820478-21systemd-journal21:25:004
1953975991919,0cyclictest0-21swapper/322:10:593
1953969991918,1cyclictest0-21swapper/120:15:011
1953966991918,1cyclictest2093262-21sh23:25:000
1953991991818,0cyclictest0-21swapper/700:36:007
1953991991817,1cyclictest2014828-21apt-get21:01:007
1953991991817,1cyclictest0-21swapper/721:20:597
1953991991817,1cyclictest0-21swapper/719:15:577
195399199180,17cyclictest2111183-21cat23:56:037
1953989991818,0cyclictest0-21swapper/620:00:596
1953989991814,3cyclictest1969519-21cat19:36:046
1953980991818,0cyclictest0-21swapper/420:05:004
1953975991818,0cyclictest0-21swapper/323:40:003
1953975991817,1cyclictest0-21swapper/300:15:003
1953975991816,1cyclictest2014323-21idleruntime-cro21:00:003
1953975991813,2cyclictest51-21ksoftirqd/319:15:573
1953971991816,2cyclictest2091055-21apt-get23:20:592
1953969991818,0cyclictest0-21swapper/121:46:021
1953969991818,0cyclictest0-21swapper/100:05:011
1953966991818,0cyclictest0-21swapper/023:16:000
1953966991818,0cyclictest0-21swapper/021:55:580
1953966991818,0cyclictest0-21swapper/021:16:010
1953991991717,0cyclictest0-21swapper/723:21:007
1953991991717,0cyclictest0-21swapper/722:01:017
1953991991717,0cyclictest0-21swapper/700:01:037
1953989991717,0cyclictest0-21swapper/622:36:016
1953989991715,1cyclictest1987353-21apt-get20:10:596
1953984991717,0cyclictest0-21swapper/523:30:005
1953984991717,0cyclictest0-21swapper/520:31:025
1953984991717,0cyclictest0-21swapper/520:31:025
1953984991716,1cyclictest0-21swapper/520:50:005
1953984991716,1cyclictest0-21swapper/520:50:005
1953980991717,0cyclictest0-21swapper/421:26:014
1953980991717,0cyclictest0-21swapper/421:10:594
1953975991717,0cyclictest0-21swapper/323:05:593
1953975991717,0cyclictest0-21swapper/321:30:593
1953975991716,1cyclictest491rcuc/300:31:033
1953975991716,0cyclictest0-21swapper/300:36:003
1953971991717,0cyclictest0-21swapper/221:10:592
1953971991717,0cyclictest0-21swapper/220:15:012
1953971991717,0cyclictest0-21swapper/200:36:002
1953971991716,1cyclictest0-21swapper/200:20:002
1953971991715,1cyclictest0-21swapper/223:25:592
1953969991717,0cyclictest0-21swapper/121:00:591
1953969991717,0cyclictest0-21swapper/119:55:001
195396999170,16cyclictest1988218-21/usr/sbin/munin20:11:021
1953966991717,0cyclictest0-21swapper/020:31:010
1953966991717,0cyclictest0-21swapper/020:31:010
1953991991615,1cyclictest0-21swapper/723:30:007
1953991991614,2cyclictest2116058-21cpuspeed_turbos00:06:007
1953991991614,1cyclictest0-21swapper/720:31:027
1953991991614,1cyclictest0-21swapper/720:31:027
195399199160,16cyclictest2063042-21cat22:26:077
1953989991615,0cyclictest0-21swapper/622:10:596
1953989991614,1cyclictest2123936-21apt-get00:21:026
1953989991614,1cyclictest2033683-21apt-get21:35:576
195398999160,15cyclictest0-21swapper/622:15:136
195398999160,15cyclictest0-21swapper/621:40:096
195398999160,15cyclictest0-21swapper/621:18:386
195398999160,15cyclictest0-21swapper/600:26:036
1953984991616,0cyclictest0-21swapper/522:36:025
1953984991616,0cyclictest0-21swapper/519:11:005
1953984991614,1cyclictest2064106-21apt-get22:30:595
195398499160,1cyclictest0-21swapper/521:40:015
1953980991616,0cyclictest0-21swapper/421:50:594
1953980991616,0cyclictest0-21swapper/420:56:004
1953980991614,1cyclictest0-21swapper/423:16:104
1953980991614,1cyclictest0-21swapper/421:35:584
195398099160,1cyclictest0-21swapper/420:30:004
195398099160,15cyclictest0-21swapper/423:24:354
1953975991616,0cyclictest0-21swapper/322:05:583
195397599160,16cyclictest0-21swapper/320:51:423
195397599160,16cyclictest0-21swapper/320:51:423
195397199160,1cyclictest2072899-21grep22:46:032
1953969991616,0cyclictest0-21swapper/123:45:591
1953969991616,0cyclictest0-21swapper/120:00:001
1953969991614,1cyclictest2025108-21sh21:20:001
195396999160,1cyclictest0-21swapper/122:38:021
1953966991616,0cyclictest0-21swapper/000:25:000
195396699160,1cyclictest1989258-21users20:11:080
1953991991514,1cyclictest0-21swapper/719:11:007
195399199150,15cyclictest0-21swapper/722:36:317
195399199150,15cyclictest0-21swapper/720:06:437
195399199150,15cyclictest0-21swapper/700:12:057
195399199150,14cyclictest0-21swapper/723:15:217
195399199150,14cyclictest0-21swapper/722:30:267
195399199150,14cyclictest0-21swapper/720:35:517
195399199150,0cyclictest0-21swapper/723:00:007
195399199150,0cyclictest0-21swapper/722:12:087
1953989991515,0cyclictest0-21swapper/622:59:596
1953989991514,1cyclictest1990306-21apt-get20:16:016
1953989991514,1cyclictest0-21swapper/620:21:026
1953989991513,1cyclictest2123094-21unixbench_singl00:16:136
195398999150,15cyclictest0-21swapper/623:46:096
195398999150,14cyclictest0-21swapper/623:40:536
195398999150,14cyclictest0-21swapper/623:35:216
195398999150,14cyclictest0-21swapper/623:30:126
195398999150,14cyclictest0-21swapper/622:31:056
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional