You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 19:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue Dec 02, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32002993213,0cyclictest0-21swapper/207:48:032
3200299270,26cyclictest0-21swapper/211:03:032
3200299270,21cyclictest4270-21apt-get08:28:092
3200199260,5cyclictest0-21swapper/107:38:031
3200199250,24cyclictest4473-21perf11:45:001
3200199250,24cyclictest0-21swapper/111:28:051
3200099250,24cyclictest313-21systemd-journal09:45:000
3200299240,23cyclictest24867-21basename11:20:002
32001992422,1cyclictest0-21swapper/108:55:001
3200199240,0cyclictest0-21swapper/107:18:061
32003992323,0cyclictest20481-21apt-get11:13:043
3200399231,21cyclictest1-21systemd12:00:003
3200399230,2cyclictest31366-21idleruntime-cro08:15:003
32001992320,2cyclictest13830-21awk08:45:001
3200199230,22cyclictest28927-21cron12:35:001
3200199230,22cyclictest0-21swapper/109:18:051
3200199230,0cyclictest19787-21apt-get07:53:031
3200199230,0cyclictest0-21swapper/110:15:011
3200099230,0cyclictest668-21apt-get09:25:010
32003992221,1cyclictest18412-21apt-get10:03:033
32003992220,1cyclictest18635-21munin-run08:54:593
3200399220,21cyclictest5689-21apt-get10:43:033
3200399220,21cyclictest31331-21idleruntime-cro12:40:003
3200399220,21cyclictest18900-21apt-get07:50:013
3200399220,21cyclictest0-21swapper/310:33:033
3200399220,21cyclictest0-21swapper/307:18:053
32002992221,1cyclictest0-21swapper/210:15:012
32002992220,1cyclictest30149-21apt-get11:33:052
3200299220,21cyclictest24662-21apt-get08:03:052
3200299220,21cyclictest11441-21munin-run08:40:002
3200299220,21cyclictest0-21swapper/209:33:042
3200299220,1cyclictest23498-21munin-run09:05:002
32001992220,1cyclictest2781-21perf10:35:001
32001992220,1cyclictest22757-21awk10:10:001
32001992220,1cyclictest17587-21apt11:05:001
32001992220,1cyclictest0-21swapper/112:30:011
32001992220,1cyclictest0-21swapper/112:15:001
3200199220,21cyclictest668-21apt09:24:591
3200199220,21cyclictest30868-21apt-get10:28:021
3200199220,21cyclictest16236-21munin-run08:50:001
3200199220,21cyclictest14595-21apt-get07:43:021
3200199220,21cyclictest0-21swapper/108:58:031
3200199220,1cyclictest4882-21apt07:23:011
32000992220,1cyclictest24149-21munin-plugin-st12:25:010
32000992220,1cyclictest15689-21apt-get11:03:020
32000992220,1cyclictest0-21swapper/010:18:040
32000992219,2cyclictest5181-21idleruntime-cro10:40:000
3200099221,0cyclictest0-21swapper/012:03:040
3200099220,21cyclictest9507-21apt-get08:38:060
3200099220,21cyclictest31362-21sendmail-msp12:39:590
3200099220,21cyclictest14079-21cron07:40:010
3200099220,21cyclictest13816-21sh08:45:000
3200099220,21cyclictest10877-21apt-get10:53:030
3200099220,21cyclictest0-21swapper/010:28:020
32003992120,0cyclictest14314-21apt-get08:48:013
32003992119,1cyclictest593-21dbus-daemon07:35:013
32003992119,1cyclictest23261-21apt-get10:13:033
32003992119,1cyclictest0-21swapper/309:20:003
3200399210,20cyclictest0-21swapper/312:03:033
3200399210,20cyclictest0-21swapper/310:28:023
3200399210,20cyclictest0-21swapper/309:40:003
3200399210,0cyclictest0-21swapper/308:28:093
32002992120,1cyclictest29432-21apt-get12:38:062
32002992117,3cyclictest13599-21apt-get09:53:022
3200299210,20cyclictest9682-21apt-get07:33:052
3200299210,20cyclictest28272-21cron09:15:012
3200299210,20cyclictest0-21swapper/209:28:062
3200299210,0cyclictest0-21swapper/212:18:042
3200199210,4cyclictest0-21swapper/110:13:031
3200199210,21cyclictest0-21swapper/109:58:031
3200199210,20cyclictest8809-21apt-get09:43:051
3200199210,20cyclictest17410-21df_inode07:48:031
3200199210,20cyclictest0-21swapper/109:15:011
3200199210,1cyclictest12176-21apt-get12:03:041
3200199210,0cyclictest0-21swapper/110:23:031
3200199210,0cyclictest0-21swapper/110:03:021
3200199210,0cyclictest0-21swapper/107:28:021
32000992121,0cyclictest0-21swapper/011:33:050
32000992121,0cyclictest0-21swapper/008:08:050
32000992120,0cyclictest3991-21apt-get09:33:040
3200099210,20cyclictest0-21swapper/011:43:060
32003992020,0cyclictest22186-21apt-get07:58:023
32003992020,0cyclictest0-21swapper/311:43:063
32003992020,0cyclictest0-21swapper/311:03:033
32003992020,0cyclictest0-21swapper/310:15:013
32003992020,0cyclictest0-21swapper/309:33:043
32003992020,0cyclictest0-21swapper/308:38:063
32003992020,0cyclictest0-21swapper/307:38:043
32003992019,1cyclictest7282-21apt-get07:28:023
32003992018,1cyclictest21014-21tr09:00:003
3200399200,20cyclictest0-21swapper/310:38:043
3200399200,20cyclictest0-21swapper/309:58:023
3200399200,20cyclictest0-21swapper/309:48:043
3200399200,0cyclictest18087-21apt-get11:08:053
3200399200,0cyclictest0-21swapper/308:08:053
3200399200,0cyclictest0-21swapper/307:48:023
32002992020,0cyclictest0-21swapper/212:13:072
32002992020,0cyclictest0-21swapper/211:25:002
32002992020,0cyclictest0-21swapper/211:24:592
32002992020,0cyclictest0-21swapper/211:13:042
32002992020,0cyclictest0-21swapper/210:38:042
32002992020,0cyclictest0-21swapper/210:33:022
32002992020,0cyclictest0-21swapper/210:03:032
32002992020,0cyclictest0-21swapper/209:43:042
32002992020,0cyclictest0-21swapper/209:08:042
32002992020,0cyclictest0-21swapper/207:43:012
32002992020,0cyclictest0-21swapper/207:28:032
32002992019,0cyclictest0-21swapper/212:03:042
32002992019,0cyclictest0-21swapper/211:48:042
32002992018,1cyclictest2566-21apt-get11:43:062
32002992016,3cyclictest4883-21apt-get07:23:012
32002992015,4cyclictest0-21swapper/210:13:032
3200299200,20cyclictest0-21swapper/207:58:032
3200299200,0cyclictest27026-21apt-get12:33:022
3200299200,0cyclictest0-21swapper/211:53:032
3200299200,0cyclictest0-21swapper/210:53:032
3200299200,0cyclictest0-21swapper/210:08:042
32001992020,0cyclictest0-21swapper/111:53:031
32001992020,0cyclictest0-21swapper/107:33:051
32001992019,1cyclictest0-21swapper/110:50:021
3200199200,20cyclictest0-21swapper/108:13:101
3200199200,19cyclictest5689-21apt-get10:43:041
3200199200,19cyclictest0-21swapper/108:08:071
3200199200,15cyclictest0-21swapper/112:38:061
3200199200,0cyclictest21529-21apt-get09:03:021
3200199200,0cyclictest0-21swapper/112:20:021
3200199200,0cyclictest0-21swapper/109:53:031
3200199200,0cyclictest0-21swapper/107:58:031
32000992020,0cyclictest8085-21apt-get10:48:040
32000992020,0cyclictest0-21swapper/012:33:020
32000992020,0cyclictest0-21swapper/012:13:070
32000992020,0cyclictest0-21swapper/012:10:000
32000992020,0cyclictest0-21swapper/010:03:030
32000992020,0cyclictest0-21swapper/008:58:030
32000992020,0cyclictest0-21swapper/007:58:030
32000992020,0cyclictest0-21swapper/007:23:010
32000992019,0cyclictest0-21swapper/010:58:050
32000992018,1cyclictest11202-21apt-get09:48:040
3200099200,20cyclictest0-21swapper/008:53:020
32003991919,0cyclictest0-21swapper/312:08:053
32003991919,0cyclictest0-21swapper/308:33:023
32003991919,0cyclictest0-21swapper/308:23:003
32003991918,1cyclictest16971-21apt-get12:13:063
32003991917,1cyclictest25877-21turbostat09:10:013
32002991919,0cyclictest0-21swapper/209:38:022
32002991919,0cyclictest0-21swapper/209:23:042
32002991919,0cyclictest0-21swapper/209:18:052
32002991919,0cyclictest0-21swapper/208:48:022
32002991919,0cyclictest0-21swapper/208:43:032
32002991919,0cyclictest0-21swapper/207:53:022
32002991918,1cyclictest32477-21apt-get07:13:032
32002991918,1cyclictest29451-21apt-get08:13:022
32002991915,4cyclictest0-21swapper/211:08:052
3200299190,0cyclictest0-21swapper/211:58:022
32001991919,0cyclictest0-21swapper/111:38:051
32001991919,0cyclictest0-21swapper/108:23:001
3200199190,18cyclictest9724-21cat08:38:071
3200199190,18cyclictest0-21swapper/112:08:051
3200199190,18cyclictest0-21swapper/111:33:091
3200199190,18cyclictest0-21swapper/109:33:071
32000991919,0cyclictest19366-21apt-get12:18:040
32000991919,0cyclictest0-21swapper/011:23:040
32000991919,0cyclictest0-21swapper/011:23:040
32000991919,0cyclictest0-21swapper/010:23:040
32000991919,0cyclictest0-21swapper/009:23:040
32000991919,0cyclictest0-21swapper/009:13:040
32000991919,0cyclictest0-21swapper/009:03:020
32000991919,0cyclictest0-21swapper/007:53:030
32000991919,0cyclictest0-21swapper/007:33:040
32000991917,1cyclictest22401-21perf11:15:000
32003991818,0cyclictest0-21swapper/311:33:043
32003991818,0cyclictest0-21swapper/311:18:033
32003991818,0cyclictest0-21swapper/310:08:043
32003991818,0cyclictest0-21swapper/308:43:043
32003991818,0cyclictest0-21swapper/307:13:033
32003991817,0cyclictest0-21swapper/309:53:023
32003991817,0cyclictest0-21swapper/308:03:053
32003991816,1cyclictest6859-21cron11:50:003
32002991818,0cyclictest0-21swapper/210:43:042
32002991816,1cyclictest593-21dbus-daemon12:30:012
32002991816,1cyclictest0-21swapper/211:40:012
32002991815,2cyclictest21037-21ls09:00:002
32001991818,0cyclictest0-21swapper/110:58:051
32001991818,0cyclictest0-21swapper/109:48:041
32001991818,0cyclictest0-21swapper/107:13:031
3200199180,18cyclictest0-21swapper/111:18:111
3200199180,17cyclictest0-21swapper/111:08:071
32000991818,0cyclictest20810-21apt-get10:08:040
32000991818,0cyclictest0-21swapper/009:53:030
32000991818,0cyclictest0-21swapper/007:13:030
32000991817,0cyclictest0-21swapper/011:48:030
3200099180,17cyclictest18913-21munin-run07:50:000
32003991717,0cyclictest28474-21apt-get10:23:033
32003991715,1cyclictest21262-21apt-get12:19:593
32002991717,0cyclictest6662-21apt-get08:33:022
32002991717,0cyclictest0-21swapper/212:20:022
32002991717,0cyclictest0-21swapper/209:48:042
32002991716,1cyclictest2472-21apt-get07:18:052
32002991715,1cyclictest16471-21sh12:09:592
3200299170,14cyclictest0-21swapper/210:20:082
3200299170,14cyclictest0-21swapper/208:24:402
32001991717,0cyclictest0-21swapper/110:50:011
32001991717,0cyclictest0-21swapper/109:25:011
32001991716,1cyclictest0-21swapper/111:13:031
32001991714,3cyclictest0-21swapper/108:03:051
3200199170,16cyclictest7962-21gzip08:33:081
32000991717,0cyclictest851-21apt-get10:33:030
32000991717,0cyclictest23980-21apt-get09:08:030
32000991717,0cyclictest0-21swapper/010:43:040
32000991717,0cyclictest0-21swapper/009:58:030
32000991717,0cyclictest0-21swapper/009:38:030
32000991717,0cyclictest0-21swapper/007:43:020
32000991715,1cyclictest9186-21munin-plugin-st07:30:000
32003991616,0cyclictest1581-21apt-get09:28:063
32003991616,0cyclictest0-21swapper/310:48:043
32003991615,0cyclictest9993-21apt-get10:50:023
32002991616,0cyclictest0-21swapper/210:48:042
32002991616,0cyclictest0-21swapper/210:28:022
32002991615,0cyclictest0-21swapper/208:53:022
3200299160,15cyclictest14078-21cron07:40:012
32001991616,0cyclictest0-21swapper/112:18:041
3200199161,14cyclictest5231-21cat08:28:131
3200199161,14cyclictest4740-21ssh10:38:131
3200199160,14cyclictest0-21swapper/109:39:451
3200199160,0cyclictest0-21swapper/111:55:321
32000991616,0cyclictest24633-21apt-get12:28:040
32000991616,0cyclictest0-21swapper/008:33:020
32000991615,1cyclictest0-21swapper/011:18:040
32000991614,1cyclictest25167-21ls10:15:000
32000991614,1cyclictest0-21swapper/008:30:000
3200099160,15cyclictest0-21swapper/011:08:090
32003991515,0cyclictest13274-21apt-get10:58:053
32003991515,0cyclictest0-21swapper/312:33:013
32003991515,0cyclictest0-21swapper/312:28:043
32003991515,0cyclictest0-21swapper/311:38:053
32003991515,0cyclictest0-21swapper/309:43:053
32003991515,0cyclictest0-21swapper/307:43:013
32003991512,2cyclictest593-21dbus-daemon11:25:003
32003991512,2cyclictest593-21dbus-daemon11:25:003
3200399150,1cyclictest21529-21apt-get09:03:023
3200399150,14cyclictest5308-21diskstats07:23:023
3200399150,14cyclictest31195-21apt-get09:23:033
32002991514,0cyclictest27059-21apt-get08:08:052
3200299150,14cyclictest0-21swapper/208:18:062
32001991515,0cyclictest0-21swapper/109:10:011
32000991515,0cyclictest0-21swapper/008:23:000
32000991515,0cyclictest0-21swapper/008:13:020
3200099150,9cyclictest578-21irqbalance08:18:580
3200399143,7cyclictest1778-21sendmail-mta08:15:053
3200399140,14cyclictest0-21swapper/312:20:343
3200399140,14cyclictest0-21swapper/311:50:113
3200399140,14cyclictest0-21swapper/311:26:523
3200299140,14cyclictest0-21swapper/210:55:352
3200299140,0cyclictest0-21swapper/211:28:122
3200199140,14cyclictest0-21swapper/111:48:071
3200199140,14cyclictest0-21swapper/108:15:091
3200199140,0cyclictest0-21swapper/111:20:031
3200199140,0cyclictest0-21swapper/111:20:031
32000991414,0cyclictest0-21swapper/007:15:400
3200099140,14cyclictest0-21swapper/011:57:550
3200099140,14cyclictest0-21swapper/009:15:050
3200099140,14cyclictest0-21swapper/008:03:130
3200099140,0cyclictest0-21swapper/011:36:140
3200099140,0cyclictest0-21swapper/011:27:300
32003991313,0cyclictest0-21swapper/309:12:533
32002991313,0cyclictest0-21swapper/209:55:552
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional