You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 20:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Thu Jan 08, 2026 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332824199781,6cyclictest1-21systemd08:20:000
332824199773,69cyclictest238-21systemd-journal12:30:000
332824199711,37cyclictest3331307-21unin-run08:10:020
332824199711,10cyclictest3341126-21modprobe11:20:000
332824199701,2cyclictest0-21swapper/010:14:590
332824199671,4cyclictest3332821-21cron08:39:590
332824199662,5cyclictest3340842-21modprobe11:11:190
332824199651,2cyclictest0-21swapper/011:10:020
332824199651,2cyclictest0-21swapper/011:10:020
3328244996426,34cyclictest275-21dbus-daemon12:10:021
332824199643,55cyclictest0-21swapper/012:40:000
332824199642,58cyclictest3341926-21munin-run11:35:010
332824199642,57cyclictest3330264-21munin-run07:50:000
3328241996423,36cyclictest3334166-21cat09:05:010
332824199641,59cyclictest3344480-21sshd12:20:550
3328244996321,36cyclictest238-21systemd-journal08:34:551
332824199633,56cyclictest3329199-21sshd07:25:240
3328241996327,31cyclictest1-21systemd10:55:020
332824199632,56cyclictest3339036-21modprobe10:38:550
332824199632,56cyclictest0-21swapper/007:20:020
332824199632,56cyclictest0-21swapper/007:20:010
332824499623,13cyclictest3340864-21modprobe11:15:001
332824199623,55cyclictest3344212-21sshd12:17:550
332824199623,54cyclictest3334929-21munin-run09:20:000
3328241996233,25cyclictest238-21systemd-journal10:20:010
3328241996233,25cyclictest238-21systemd-journal10:20:000
332824199622,56cyclictest3338781-21sshd10:32:550
332824199622,56cyclictest3332097-21munin-run08:25:020
332824199622,55cyclictest3330027-21munin-run07:45:010
332824199622,13cyclictest3343161-21sshd11:55:560
332824199621,3cyclictest0-21swapper/011:45:010
332824199613,54cyclictest3335532-21cat09:30:020
332824199612,54cyclictest3333126-21munin-run08:45:020
332824199611,55cyclictest3329704-21sshd07:35:550
332824199602,52cyclictest309-21in:imuxsock07:15:000
332824199601,5cyclictest0-21swapper/012:10:020
332824199601,2cyclictest0-21swapper/009:49:560
332824199601,19cyclictest3337009-21sendmail-msp10:00:000
3328255995937,15cyclictest3344247-21systemctl12:20:003
332824499595,48cyclictest3335447-21munin-plugin-st09:29:591
332824499595,47cyclictest3328247-21latency_hist07:10:011
332824499593,8cyclictest3329722-21cron07:40:001
3328244995922,33cyclictest3340649-21latency_hist11:10:021
3328244995922,33cyclictest3340649-21latency_hist11:10:011
332824199593,50cyclictest3334385-21cron09:09:590
332824199592,53cyclictest364-21snmpd11:03:310
332824199592,52cyclictest3343958-21sendmail-mta12:14:330
332824199591,54cyclictest3338532-21sshd10:27:550
332824199591,53cyclictest3335164-21modprobe09:20:540
3328251995819,30cyclictest30-21ksoftirqd/209:50:012
332824499584,9cyclictest3331794-21modprobe08:20:001
332824499582,8cyclictest3335688-21cron09:35:001
332824499582,17cyclictest3339333-21latency_hist10:44:591
3328244995810,43cyclictest0-21swapper/107:54:561
3328244995810,43cyclictest0-21swapper/107:54:551
332824199583,50cyclictest364-21snmpd08:12:500
3328241995831,24cyclictest3330823-21sed08:00:010
332824199581,52cyclictest364-21snmpd07:20:150
3328251995729,22cyclictest3330507-21modprobe07:55:012
3328251995729,22cyclictest3330507-21modprobe07:55:002
332824499573,7cyclictest3341647-21cron11:30:011
332824499573,21cyclictest3334383-21cron09:10:001
3328244995717,35cyclictest3338909-21latency_hist10:35:011
3328244995713,39cyclictest309-21in:imuxsock09:57:561
332824199573,49cyclictest3336278-21cat09:45:010
332824199571,52cyclictest3333831-21sshd08:55:560
332824199571,4cyclictest3341394-21sshd11:24:550
332824199571,2cyclictest0-21swapper/011:55:000
3328251995628,23cyclictest3342443-21/usr/sbin/munin11:45:012
3328251995627,25cyclictest3335959-21modprobe09:40:002
3328251995627,25cyclictest3335959-21modprobe09:40:002
332824499568,41cyclictest0-21swapper/111:50:011
332824499563,7cyclictest3345255-21cron12:40:011
332824499562,14cyclictest3344045-21latency_hist12:15:011
332824199563,49cyclictest3333363-21munin-run08:50:010
332824199562,50cyclictest364-21snmpd11:37:050
332824199562,50cyclictest364-21snmpd10:44:530
332824199562,49cyclictest3333584-21sshd08:51:000
332824199562,49cyclictest3330493-21sshd07:53:560
332824199562,49cyclictest3330493-21sshd07:53:550
332824199562,49cyclictest3329497-21munin-run07:35:020
332824199561,2cyclictest0-21swapper/011:45:030
3328244995522,28cyclictest1-21systemd09:15:001
332824499552,16cyclictest3330807-21munin-run08:00:001
332824499552,12cyclictest3339089-21modprobe10:40:001
332824499552,11cyclictest3331072-21latency_hist08:05:021
332824199552,50cyclictest3345030-21munin-run12:35:010
332824199552,49cyclictest3337263-21munin-run10:05:010
332824199552,48cyclictest3335924-21sshd09:36:560
332824199552,48cyclictest3335924-21sshd09:36:550
332824199552,48cyclictest3331010-21sshd08:00:450
332824199552,48cyclictest0-21swapper/010:25:010
332824199551,49cyclictest1-21systemd08:30:010
332824199551,49cyclictest1-21systemd08:30:010
332824199551,2cyclictest0-21swapper/010:10:020
3328251995446,4cyclictest3334423-21munin-run09:10:002
3328251995428,21cyclictest3339451-21latency_hist10:45:022
3328251995427,22cyclictest3335617-21latency_hist09:30:022
3328244995423,27cyclictest1-21systemd08:25:001
332824499542,13cyclictest238-21systemd-journal09:51:081
332824499541,14cyclictest3337525-21unin-run10:10:001
332824499541,12cyclictest3340397-21latency_hist11:05:021
332824199543,45cyclictest3328249-21latency_hist07:10:020
332824199542,48cyclictest364-21snmpd11:26:320
332824199542,47cyclictest364-21snmpd09:53:300
3328251995329,20cyclictest3333376-21munin-run08:50:022
332824499533,8cyclictest3331711-21latency_hist08:15:021
332824499533,6cyclictest3342150-21cron11:39:591
332824499533,14cyclictest238-21systemd-journal11:20:011
332824499532,7cyclictest3337269-21true10:05:011
332824499532,19cyclictest3330362-21grep07:50:011
332824499532,11cyclictest3328468-21latency_hist07:15:011
332824499532,10cyclictest3329491-21true07:35:001
332824499532,10cyclictest1-21systemd08:55:011
3328244995313,34cyclictest309-21in:imuxsock07:17:551
3328244995313,34cyclictest309-21in:imuxsock07:17:541
3328255995226,17cyclictest275-21dbus-daemon11:50:013
3328255995220,23cyclictest238-21systemd-journal07:39:593
3328251995235,13cyclictest3343694-21sshd12:06:282
3328251995233,14cyclictest3344490-21sshd12:22:542
3328251995231,17cyclictest3331281-21cron08:10:002
3328251995229,19cyclictest3331857-21latency_hist08:20:012
3328251995228,19cyclictest3344293-21latency_hist12:20:022
3328251995227,17cyclictest238-21systemd-journal08:34:592
3328251995225,22cyclictest3334639-21sshd09:13:552
332824499524,5cyclictest0-21swapper/108:45:011
332824499523,7cyclictest3344243-21munin-run12:20:011
332824499522,12cyclictest3338556-21munin-run10:30:001
332824499522,10cyclictest238-21systemd-journal10:15:541
332824499522,10cyclictest238-21systemd-journal10:15:541
3328244995215,31cyclictest3332320-21cron08:30:011
3328244995215,31cyclictest3332320-21cron08:30:001
3328244995214,33cyclictest1-21systemd12:05:021
3328244995214,33cyclictest1-21systemd12:05:011
332824499521,14cyclictest3332906-21cut08:40:021
332824499521,12cyclictest3329978-21sshd07:40:261
3328241995223,24cyclictest3340090-21latency_hist11:00:020
332824199521,47cyclictest364-21snmpd09:32:310
332824199521,47cyclictest3343452-21sshd12:03:560
332824199521,47cyclictest3343452-21sshd12:03:550
3328255995142,7cyclictest37-21ksoftirqd/309:15:023
3328255995123,20cyclictest275-21dbus-daemon07:45:013
3328251995137,10cyclictest3334121-21sshd09:02:562
3328251995135,12cyclictest3332317-21sshd08:29:552
3328251995135,12cyclictest3332317-21sshd08:29:542
3328251995129,17cyclictest3341954-21cat11:35:002
3328251995127,20cyclictest3339792-21latency_hist10:50:032
3328251995127,20cyclictest3330873-21latency_hist08:00:022
3328251995127,19cyclictest3343574-21latency_hist12:05:022
3328251995127,19cyclictest3343574-21latency_hist12:05:022
3328251995124,23cyclictest3340090-21latency_hist11:00:022
332824499515,6cyclictest3338497-21latency_hist10:25:021
332824499512,8cyclictest3342973-21latency_hist11:55:001
332824499512,16cyclictest275-21dbus-daemon09:00:001
332824499511,7cyclictest3328967-21cron07:24:591
3328244995111,35cyclictest3343183-21cron12:00:001
332824199511,46cyclictest364-21snmpd09:12:530
3328255995028,12cyclictest3342152-21cron11:39:593
3328251995036,10cyclictest3338282-21sshd10:22:552
3328251995035,11cyclictest3333575-21modprobe08:50:022
3328251995030,15cyclictest3338728-21latency_hist10:30:022
3328251995029,17cyclictest3329121-21latency_hist07:25:032
332824499508,5cyclictest275-21dbus-daemon10:55:021
332824499507,37cyclictest0-21swapper/111:25:001
332824499504,6cyclictest238-21systemd-journal09:36:561
332824499504,6cyclictest238-21systemd-journal09:36:551
332824499504,38cyclictest3329226-21modprobe07:30:011
332824499503,9cyclictest0-21swapper/109:05:011
332824499502,17cyclictest3331314-21latency_hist08:10:011
332824499502,14cyclictest3339566-21modprobe10:47:561
3328244995020,26cyclictest23-21ksoftirqd/109:20:011
332824199501,6cyclictest3339555-21sshd10:45:550
332824199501,13cyclictest364-21snmpd08:32:270
3328255994929,15cyclictest275-21dbus-daemon07:50:003
3328251994934,11cyclictest3337496-21sshd10:09:562
3328251994933,13cyclictest3333846-21sshd08:58:542
3328251994930,14cyclictest3338058-21sh10:20:012
3328251994930,14cyclictest3338058-21sh10:20:002
3328251994928,16cyclictest3340854-21sshd11:14:552
3328251994927,18cyclictest3338543-21cron10:30:032
3328251994927,17cyclictest3339953-21latency_hist10:55:022
3328251994925,20cyclictest3336770-21latency_hist09:55:022
3328251994925,19cyclictest3328668-21cron07:17:002
3328251994925,19cyclictest3328668-21cron07:17:002
3328251994923,22cyclictest3341620-21latency_hist11:25:032
332824499498,5cyclictest3344771-21true12:30:001
332824499493,7cyclictest3336484-21grep09:50:001
332824499493,7cyclictest0-21swapper/112:24:551
332824499491,12cyclictest3342052-21grep11:35:011
3328255994831,12cyclictest37-21ksoftirqd/307:59:593
3328251994832,12cyclictest3337230-21sshd10:01:092
3328251994832,11cyclictest3329205-21sshd07:26:542
3328251994831,13cyclictest3331021-21sshd08:02:552
3328251994828,15cyclictest3345177-21latency_hist12:35:012
3328251994826,18cyclictest275-21dbus-daemon08:25:002
3328251994826,17cyclictest3331519-21sshd08:12:562
3328251994825,18cyclictest3330010-21latency_hist07:45:002
332824499488,33cyclictest0-21swapper/109:25:011
332825599475,30cyclictest238-21systemd-journal10:00:003
3328255994722,16cyclictest275-21dbus-daemon08:30:003
3328255994722,16cyclictest275-21dbus-daemon08:30:003
3328251994739,5cyclictest3335199-21munin-run09:25:002
3328251994739,5cyclictest0-21swapper/207:10:012
3328251994734,10cyclictest3337744-21sshd10:13:552
3328251994733,11cyclictest3336198-21sshd09:41:082
3328251994729,15cyclictest3344772-21sh12:30:012
3328251994729,11cyclictest3329721-21cron07:40:002
3328251994724,18cyclictest670-21sendmail-mta07:34:332
332824499473,6cyclictest3333424-21grep08:50:011
332824499472,9cyclictest3340090-21latency_hist10:59:591
332824499472,13cyclictest3342455-21unin-run11:45:011
332824499472,10cyclictest284-21systemd-logind09:45:001
332824499471,10cyclictest3337738-21sshd10:11:561
3328255994610,22cyclictest3332823-21modprobe08:39:593
3328251994635,8cyclictest0-21swapper/211:55:552
3328251994634,9cyclictest3342909-21sshd11:50:552
3328251994633,10cyclictest3334881-21sshd09:16:052
3328251994630,12cyclictest0-21swapper/208:40:012
3328251994629,13cyclictest3335687-21cron09:35:012
3328251994625,16cyclictest3333135-21wc08:45:012
3328251994623,20cyclictest3345306-21/usr/sbin/munin12:40:012
3328251994623,19cyclictest238-21systemd-journal10:00:012
3328251994623,18cyclictest3330467-21latency_hist07:50:032
3328251994619,22cyclictest3342764-21cut11:50:012
332824499462,8cyclictest3345012-21sh12:35:001
332825599458,19cyclictest3334389-21modprobe09:09:593
3328255994527,14cyclictest275-21dbus-daemon11:25:013
3328255994527,12cyclictest309-21in:imuxsock09:00:013
3328251994530,11cyclictest3343939-21sshd12:10:552
3328251994530,10cyclictest284-21systemd-logind11:05:012
3328251994529,11cyclictest3342147-21sshd11:39:552
3328251994524,17cyclictest3341632-21sshd11:26:222
3328251994519,22cyclictest3339236-21cat10:40:012
332825599445,26cyclictest3328711-21cut07:20:013
332825599445,26cyclictest3328711-21cut07:20:003
3328251994430,10cyclictest3328417-21sshd07:12:562
3328251994429,11cyclictest3340620-21/usr/sbin/munin11:10:012
3328251994429,11cyclictest3340620-21/usr/sbin/munin11:10:002
3328251994427,14cyclictest414-21sshd11:15:542
3328255994328,11cyclictest37-21ksoftirqd/311:20:013
3328255994325,12cyclictest1-21systemd08:45:013
3328255994320,14cyclictest275-21dbus-daemon12:40:003
3328255994228,11cyclictest37-21ksoftirqd/307:35:013
3328255994220,16cyclictest275-21dbus-daemon12:25:013
332825599415,25cyclictest3334148-21munin-plugin-st09:05:003
332825599415,23cyclictest238-21systemd-journal09:40:013
332825599415,23cyclictest238-21systemd-journal09:40:003
3328255994130,6cyclictest3343974-21munin-plugin-st12:15:003
3328255994124,11cyclictest275-21dbus-daemon10:20:013
3328255994124,11cyclictest275-21dbus-daemon10:20:003
3328255994110,21cyclictest3333618-21munin-plugin-st08:54:593
3328255994030,7cyclictest3337482-21sshd10:06:113
3328255994018,14cyclictest238-21systemd-journal12:00:013
3328255994017,17cyclictest275-21dbus-daemon08:20:003
332825599397,4cyclictest410-21lldpd09:20:303
332825599397,18cyclictest3339052-21modprobe10:40:003
3328255993926,11cyclictest37-21ksoftirqd/310:30:023
3328255993924,11cyclictest238-21systemd-journal10:49:543
3328255993919,12cyclictest3334910-21modprobe09:20:003
332825599385,24cyclictest3343862-21cat12:10:033
332825599383,24cyclictest3338309-21munin-plugin-st10:24:593
3328255993828,8cyclictest37-21ksoftirqd/307:10:023
3328255993815,15cyclictest1-21systemd12:30:003
332825599375,21cyclictest3330515-21munin-run07:55:013
332825599375,21cyclictest3330515-21munin-run07:55:003
332825599373,23cyclictest3332085-21grep08:25:013
3328255993727,8cyclictest37-21ksoftirqd/307:27:483
3328255993726,8cyclictest3328976-21cron07:24:593
3328255993726,7cyclictest3341900-21cron11:35:003
3328255993724,11cyclictest37-21ksoftirqd/311:05:003
3328255993724,10cyclictest37-21ksoftirqd/310:45:023
3328255993723,11cyclictest37-21ksoftirqd/310:15:013
3328255993720,8cyclictest309-21in:imuxsock09:30:003
332825599363,24cyclictest3338985-21grep10:35:023
332825599363,23cyclictest3331546-21munin-plugin-st08:15:003
332825599362,4cyclictest131rcu_preempt12:35:003
3328255993623,10cyclictest3340844-21sshd11:11:543
3328255993623,10cyclictest3332596-21systemd-run08:35:013
3328255993619,11cyclictest3341672-21systemd-run11:30:013
3328255993618,12cyclictest238-21systemd-journal11:00:013
3328255993524,8cyclictest37-21ksoftirqd/309:35:003
3328255993523,8cyclictest238-21systemd-journal08:05:563
3328255993520,10cyclictest238-21systemd-journal12:05:013
3328255993520,10cyclictest238-21systemd-journal12:05:003
3328255993518,11cyclictest309-21in:imuxsock11:40:023
332825599343,24cyclictest3340621-21munin-plugin-st11:10:013
332825599343,24cyclictest3340621-21munin-plugin-st11:10:013
3328255993419,10cyclictest275-21dbus-daemon08:05:013
3328255993418,12cyclictest37-21ksoftirqd/310:05:013
3328255993326,4cyclictest3336212-21kworker/u8:109:45:033
332825599332,3cyclictest131rcu_preempt09:55:003
3328255993314,14cyclictest1-21systemd08:50:023
3328255993214,12cyclictest3342931-21cron11:54:593
332825599313,13cyclictest3336244-21unin-run09:45:003
3328255993112,14cyclictest3339842-21munin-plugin-st10:55:013
3328255992921,6cyclictest37-21ksoftirqd/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional