You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 14:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Mon May 25, 2026 12:43:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3981322996942,3cyclictest0-21swapper/110:41:011
3981322996452,8cyclictest421-21dbus-daemon11:36:011
3981322996237,3cyclictest0-21swapper/109:41:071
3981323995244,4cyclictest0-21swapper/210:06:042
3981321995221,26cyclictest4110039-21ssh11:06:030
3981322995142,6cyclictest3987329-21systemd-run07:30:011
398132199516,37cyclictest4098012-21ssh10:51:000
3981321995133,15cyclictest1-21systemd09:45:020
3981323995039,7cyclictest4168272-21systemd-run12:20:012
3981323995024,23cyclictest4047094-21unixbench_multi09:46:182
3981323995023,23cyclictest4162277-21grep12:11:112
3981322994941,5cyclictest3989293-21/usr/sbin/munin07:35:491
398132199497,36cyclictest4090169-21sshd10:41:050
3981323994839,6cyclictest439-21systemd-logind09:45:012
3981322994842,3cyclictest0-21swapper/110:50:011
3981322994840,5cyclictest4011297-21basename08:50:011
3981323994739,4cyclictest0-21swapper/210:01:002
3981323994720,22cyclictest0-21swapper/212:36:142
3981323994624,19cyclictest0-21swapper/211:10:002
398132199462,35cyclictest4001821-21modprobe08:16:050
3981323994537,5cyclictest261-21systemd-journal11:15:002
398132399453,36cyclictest4169572-21ssh12:21:022
3981323994522,19cyclictest0-21swapper/211:26:052
3981323994522,19cyclictest0-21swapper/211:26:052
3981323994519,23cyclictest4129500-21kernelversion11:30:532
3981322994536,6cyclictest1-21systemd10:55:011
3981321994535,8cyclictest439-21systemd-logind12:05:020
3981321994535,8cyclictest439-21systemd-logind12:05:020
3981323994419,17cyclictest1-21systemd07:29:592
398132399441,12cyclictest3983781-21ntpq07:16:022
3981322994436,5cyclictest4029295-21systemd-run09:25:011
3981321994437,4cyclictest4144370-21latency_hist11:50:020
398132399434,31cyclictest4006259-21ntpq08:31:012
3981323994335,5cyclictest4080726-21systemd-run10:30:022
3981323994335,5cyclictest4080726-21systemd-run10:30:022
3981323994334,6cyclictest4178120-21unixbench_multi12:31:112
3981323994334,6cyclictest4015816-21systemd-run09:05:012
398132399431,7cyclictest4139934-21sh11:44:122
398132399431,6cyclictest4066159-21ntpq10:10:582
398132399421,6cyclictest4117838-21ntpq11:15:572
398132399421,6cyclictest4117838-21ntpq11:15:572
398132399421,5cyclictest3995669-21ntpq07:55:542
3981322994236,3cyclictest0-21swapper/110:00:001
3981322994233,6cyclictest1-21systemd12:40:021
3981321994235,4cyclictest4041264-21munin-plugin-st09:40:010
3981321994234,5cyclictest4011311-21true08:50:010
3981321994229,9cyclictest3179076-21cups-browsed11:26:070
3981321994229,9cyclictest3179076-21cups-browsed11:26:070
3981321994229,9cyclictest261-21systemd-journal12:21:050
3981321994228,11cyclictest12350irq/32-eth011:21:040
3981321994228,11cyclictest12350irq/32-eth011:21:040
3981323994133,5cyclictest4000818-21systemd-run08:15:012
398132399413,34cyclictest3982223-21ntpq07:10:582
398132399412,5cyclictest3992787-21ntpq07:46:032
398132399412,5cyclictest3992787-21ntpq07:46:032
398132399412,3cyclictest4016768-21ntpq09:06:022
3981323994123,15cyclictest4034369-21latency09:30:532
3981323994120,17cyclictest0-21swapper/211:49:382
398132399411,37cyclictest4001670-21ntpq08:15:592
398132399411,10cyclictest4151021-21ssh11:57:292
398132399411,10cyclictest3988231-21ntpq07:31:002
398132299413,32cyclictest4022696-21ssh09:16:021
398132299412,31cyclictest4125778-21ssh11:25:551
398132299412,31cyclictest4125778-21ssh11:25:551
398132399408,29cyclictest4094867-21ssh10:46:352
3981323994032,5cyclictest3997833-21systemd-run08:05:012
398132399402,34cyclictest4050382-21ntpq09:51:012
398132399402,34cyclictest4050382-21ntpq09:51:012
398132399402,34cyclictest3994157-21ntpq07:50:582
398132399402,34cyclictest3994157-21ntpq07:50:582
398132399402,33cyclictest4012269-21ntpq08:51:042
398132399402,32cyclictest3989696-21ntpq07:35:582
3981323994019,18cyclictest0-21swapper/210:36:062
398132399401,7cyclictest4146756-21sh11:51:562
3981323994017,20cyclictest4023771-21kworker/u8:9-xprtiod09:22:052
3981323994017,19cyclictest0-21swapper/209:00:002
398132399401,4cyclictest4038672-21ntpq09:36:012
3981323994013,22cyclictest4017294-21diskmemload09:18:082
398132399401,10cyclictest4101059-21ssh10:55:302
398132399401,10cyclictest4081104-21ssh10:30:222
398132399401,10cyclictest3998713-21ntpq08:06:022
3981322994032,5cyclictest1051-21mta-sts-daemon10:20:181
3981322994032,5cyclictest0-21swapper/112:21:021
3981321994033,4cyclictest4052877-21systemd-run09:55:020
3981321994033,4cyclictest4052877-21systemd-run09:55:020
3981321994029,8cyclictest4146322-21unixbench_singl11:51:100
3981321994021,17cyclictest151ktimers/009:16:040
398132399393,30cyclictest428-21mta-sts-daemon12:25:412
3981323993932,3cyclictest0-21swapper/210:45:002
3981323993929,6cyclictest1-21systemd10:50:592
398132399392,32cyclictest4004695-21ntpq08:25:592
3981323993919,17cyclictest0-21swapper/209:25:552
398132399391,5cyclictest4003202-21ntpq08:20:552
398132399391,4cyclictest4018737-21ntpq09:11:012
398132399391,3cyclictest4070063-21ntpq10:15:582
3981323993912,24cyclictest4054126-21netstat09:55:562
3981323993911,24cyclictest421-21dbus-daemon07:40:472
398132399391,11cyclictest4104915-21ssh11:00:132
398132399391,11cyclictest4104915-21ssh11:00:132
398132399391,10cyclictest4134586-21ssh11:36:312
398132399391,10cyclictest3985192-21ntpq07:20:572
3981322993932,4cyclictest0-21swapper/111:45:521
3981322993930,5cyclictest1056-21mta-sts-daemon11:16:001
3981322993930,5cyclictest1056-21mta-sts-daemon11:16:001
3981322993929,7cyclictest4002296-21munin-run08:20:011
3981321993930,4cyclictest0-21swapper/010:00:010
3981321993924,12cyclictest4085627-21fschecks_time10:35:520
398132199392,23cyclictest4062311-21ssh10:06:040
398132399383,29cyclictest4010696-21ntpq08:45:582
3981323993822,12cyclictest0-21swapper/210:20:562
398132399381,9cyclictest4121087-21ssh11:20:432
398132399381,9cyclictest4121087-21ssh11:20:432
398132399381,4cyclictest4009155-21ntpq08:40:552
398132399381,10cyclictest4156691-21ssh12:05:182
398132399381,10cyclictest4152803-21ssh12:00:292
398132399381,10cyclictest4152803-21ssh12:00:292
398132399380,9cyclictest4007696-21ntpq08:36:002
3981322993831,3cyclictest0-21swapper/110:35:581
3981322993828,7cyclictest4072749-21sendmail10:20:011
398132199384,28cyclictest4026659-21ssh09:21:010
3981321993829,6cyclictest4184060-21munin-plugin-st12:40:010
3981321993828,6cyclictest3179076-21cups-browsed10:12:290
3981321993822,9cyclictest12350irq/32-eth012:15:580
398132299373,27cyclictest4034583-21ssh09:30:581
3981322993731,3cyclictest4100625-21kworker/u8:11+rpciod11:00:011
3981322993730,4cyclictest1055-21mta-sts-daemon09:13:001
3981322993729,5cyclictest4122250-21switchtime11:21:091
3981322993729,5cyclictest4122250-21switchtime11:21:091
3981322993729,5cyclictest4011814-21fschecks_count08:50:521
3981322993727,7cyclictest4161986-21switchtime12:11:081
3981322993726,8cyclictest4061428-21/usr/sbin/munin10:06:101
3981322993725,9cyclictest4046398-21needreboot09:46:031
3981322993723,8cyclictest4030650-21sh09:26:021
3981321993730,5cyclictest3179076-21cups-browsed09:26:100
3981322993628,4cyclictest0-21swapper/111:11:011
3981322993627,6cyclictest4176882-21aten_r2power_fr12:30:491
3981322993626,6cyclictest421-21dbus-daemon11:45:011
398132199363,23cyclictest659-21snmpd12:06:020
3981321993629,4cyclictest4114083-21proc_pri11:11:050
3981321993629,4cyclictest4072779-21systemd-run10:20:020
3981321993627,5cyclictest4148962-21aten_r2power_cu11:55:460
3981321993625,8cyclictest4073362-21/usr/sbin/munin10:21:100
3981321993625,7cyclictest420-21avahi-daemon09:34:490
398132399351,4cyclictest3981275-21munin-run07:10:012
3981322993527,6cyclictest4005319-21kworker/u8:4+rpciod10:05:011
3981322993527,5cyclictest4082633-21unixbench_multi10:31:101
3981322993527,5cyclictest3985576-21timerandwakeup07:21:081
3981322993526,4cyclictest0-21swapper/112:05:561
3981322993524,7cyclictest3179076-21cups-browsed10:25:311
3981322993524,7cyclictest3179076-21cups-browsed10:25:311
3981322993523,5cyclictest0-21swapper/111:56:011
3981321993526,6cyclictest4136390-21sh11:40:010
3981321993525,4cyclictest12450irq/33-eth011:41:040
3981321993523,9cyclictest3984194-21unixbench_multi07:16:090
398132199352,25cyclictest4082029-21ssh10:30:570
3981322993429,3cyclictest0-21swapper/111:55:011
3981322993427,4cyclictest0-21swapper/111:31:041
3981322993427,4cyclictest0-21swapper/111:06:051
3981322993426,3cyclictest0-21swapper/112:00:571
3981322993426,3cyclictest0-21swapper/112:00:571
3981322993425,6cyclictest4173100-21fschecks_count12:25:521
3981321993426,5cyclictest261-21systemd-journal08:50:530
3981321993425,6cyclictest4132515-21latency_hist11:35:020
3981321993423,7cyclictest12350irq/32-eth010:01:000
3981321993419,9cyclictest0-21swapper/011:16:000
3981321993419,9cyclictest0-21swapper/011:16:000
3981322993327,4cyclictest3981320-21cyclictest08:40:501
3981322993325,5cyclictest4066567-21threads10:11:081
3981321993324,6cyclictest548-21gdbus09:12:140
3981321993324,6cyclictest3999820-21fschecks_count08:10:520
3981321993320,8cyclictest151ktimers/007:21:030
3981322993225,4cyclictest3982337-21proc_pri07:11:031
3981322993223,5cyclictest4003999-21latency_hist08:25:031
3981322993223,4cyclictest0-21swapper/107:50:011
3981322993223,4cyclictest0-21swapper/107:50:011
3981322993222,7cyclictest420-21avahi-daemon12:15:061
3981322993222,6cyclictest4106505-21grep11:01:101
3981322993222,6cyclictest4106505-21grep11:01:101
398132299322,20cyclictest4050412-21ssh09:51:021
398132299322,20cyclictest4050412-21ssh09:51:021
3981321993226,4cyclictest4108779-21latency_hist11:05:030
3981321993226,4cyclictest4108779-21latency_hist11:05:030
3981321993225,4cyclictest1-21systemd09:10:010
398132199320,29cyclictest151ktimers/008:06:000
3981322993125,3cyclictest0-21swapper/109:40:011
3981321993125,4cyclictest3990301-21grep07:40:010
3981321993125,3cyclictest0-21swapper/010:55:480
3981321993125,3cyclictest0-21swapper/010:30:010
3981321993125,3cyclictest0-21swapper/010:30:010
3981321993115,11cyclictest4161691-21rm12:11:000
3981322993023,4cyclictest1051-21mta-sts-daemon07:42:261
3981322993022,4cyclictest0-21swapper/109:10:001
3981322993021,6cyclictest439-21systemd-logind07:35:011
398132199304,8cyclictest4046476-21ssh09:46:050
3981321993023,4cyclictest0-21swapper/012:26:340
3981321993022,5cyclictest4096605-21munin-plugin-st10:50:010
3981321993014,11cyclictest12350irq/32-eth008:01:010
398132299295,17cyclictest428-21mta-sts-daemon08:01:091
3981322992921,5cyclictest439-21systemd-logind08:15:011
398132199297,14cyclictest1056-21mta-sts-daemon07:46:010
398132199297,14cyclictest1056-21mta-sts-daemon07:46:010
3981321992923,4cyclictest4008286-21ls08:40:010
3981321992917,10cyclictest151ktimers/007:55:560
3981321992915,12cyclictest151ktimers/008:30:590
3981321992915,11cyclictest151ktimers/007:30:570
398132299282,18cyclictest659-21snmpd08:36:011
3981321992822,4cyclictest3994798-21grep07:55:000
3981321992822,4cyclictest3994798-21grep07:55:000
3981321992820,5cyclictest0-21swapper/009:00:010
398132199281,23cyclictest4177645-21ssh12:31:050
3981322992720,4cyclictest4005319-21kworker/u8:4-xprtiod09:05:011
3981322992719,5cyclictest421-21dbus-daemon08:56:061
3981322992719,5cyclictest4006810-21systemd-run08:35:011
398132199273,18cyclictest659-21snmpd08:26:010
3981321992720,4cyclictest3179076-21cups-browsed08:41:250
3981322992619,4cyclictest3996237-21unixbench_singl07:56:061
3981321992622,2cyclictest0-21swapper/007:11:000
3981322992518,5cyclictest3983930-21kworker/u8:9+nfsiod08:05:571
3981322992517,5cyclictest421-21dbus-daemon08:30:011
3981322992517,5cyclictest421-21dbus-daemon07:20:021
3981321992517,6cyclictest12450irq/33-eth007:26:050
3981322992416,5cyclictest3994787-21cron07:55:001
3981322992416,5cyclictest3994787-21cron07:55:001
398132199243,10cyclictest4015374-21/usr/sbin/munin09:01:050
3981321992416,5cyclictest4003805-21sh08:25:010
398132199227,12cyclictest151ktimers/007:41:030
3981322992014,3cyclictest0-21swapper/107:10:021
398132499172,7cyclictest0-21swapper/311:10:593
398132499162,9cyclictest0-21swapper/310:41:053
398132499162,8cyclictest0-21swapper/312:36:043
398132499162,8cyclictest0-21swapper/311:06:053
398132499161,8cyclictest0-21swapper/310:26:033
398132499161,8cyclictest0-21swapper/310:26:033
398132199164,8cyclictest0-21swapper/007:10:010
398132499153,6cyclictest0-21swapper/307:11:033
398132499152,8cyclictest0-21swapper/312:26:003
398132499152,6cyclictest0-21swapper/308:01:083
398132499152,6cyclictest0-21swapper/307:20:573
398132499151,8cyclictest0-21swapper/311:30:573
398132499143,6cyclictest0-21swapper/312:31:033
398132499143,6cyclictest0-21swapper/312:00:573
398132499143,6cyclictest0-21swapper/312:00:573
398132499143,6cyclictest0-21swapper/311:40:003
398132499143,6cyclictest0-21swapper/309:40:013
398132499143,5cyclictest0-21swapper/311:50:573
398132499142,8cyclictest0-21swapper/311:25:563
398132499142,8cyclictest0-21swapper/311:25:563
398132499142,7cyclictest0-21swapper/312:21:143
398132499142,7cyclictest0-21swapper/309:51:013
398132499142,7cyclictest0-21swapper/309:51:013
398132499142,7cyclictest0-21swapper/309:40:493
398132499142,7cyclictest0-21swapper/309:21:053
398132499142,7cyclictest0-21swapper/309:20:013
398132499141,8cyclictest0-21swapper/311:45:573
398132499141,6cyclictest0-21swapper/308:11:033
398132499133,4cyclictest0-21swapper/308:16:043
398132499132,7cyclictest0-21swapper/311:00:563
398132499132,7cyclictest0-21swapper/311:00:563
398132499132,7cyclictest0-21swapper/310:05:533
398132499132,7cyclictest0-21swapper/309:30:563
398132499132,6cyclictest0-21swapper/312:10:503
398132499132,6cyclictest0-21swapper/311:15:523
398132499132,6cyclictest0-21swapper/311:15:523
398132499132,6cyclictest0-21swapper/310:50:523
398132499131,8cyclictest0-21swapper/311:20:543
398132499131,8cyclictest0-21swapper/311:20:543
398132499131,7cyclictest0-21swapper/311:40:513
398132499131,7cyclictest0-21swapper/310:55:513
398132499131,7cyclictest0-21swapper/310:36:053
398132499131,7cyclictest0-21swapper/310:30:593
398132499131,7cyclictest0-21swapper/310:21:013
398132499131,7cyclictest0-21swapper/310:15:593
398132499131,7cyclictest0-21swapper/310:00:573
398132499131,7cyclictest0-21swapper/309:56:023
398132499131,7cyclictest0-21swapper/308:50:023
398132499131,7cyclictest0-21swapper/307:30:563
398132499131,6cyclictest0-21swapper/309:05:573
398132499131,6cyclictest0-21swapper/308:30:583
398132499131,3cyclictest0-21swapper/307:40:593
398132499123,5cyclictest0-21swapper/309:46:023
398132499122,6cyclictest0-21swapper/312:15:593
398132499122,6cyclictest0-21swapper/312:05:593
398132499122,6cyclictest0-21swapper/309:10:473
398132499122,5cyclictest0-21swapper/309:00:013
398132499122,5cyclictest0-21swapper/307:26:053
398132499121,7cyclictest0-21swapper/310:45:563
398132499121,7cyclictest0-21swapper/310:10:573
398132499121,6cyclictest0-21swapper/308:40:513
398132499121,6cyclictest0-21swapper/307:50:583
398132499121,6cyclictest0-21swapper/307:50:583
398132499113,5cyclictest0-21swapper/309:01:013
398132499112,6cyclictest0-21swapper/309:25:553
398132499112,6cyclictest0-21swapper/307:20:013
398132499112,5cyclictest0-21swapper/307:45:573
398132499112,5cyclictest0-21swapper/307:45:573
398132499111,7cyclictest0-21swapper/311:55:473
398132499111,6cyclictest0-21swapper/308:36:053
398132499111,5cyclictest0-21swapper/308:50:553
398132499111,5cyclictest0-21swapper/308:20:493
398132499101,5cyclictest0-21swapper/308:05:493
39813249996,2cyclictest421rcuc/307:10:013
39813249994,3cyclictest0-21swapper/308:26:023
39813249991,6cyclictest0-21swapper/307:55:463
39813249991,5cyclictest0-21swapper/307:35:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional