You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 15:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Sat May 30, 2026 12:42:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
87939399564,28cyclictest1034627-21ssh12:15:592
87939399564,28cyclictest1034627-21ssh12:15:592
87939399552,24cyclictest1041164-21ssh12:26:062
87939399552,24cyclictest1041164-21ssh12:26:062
87939399544,23cyclictest916584-21ssh09:11:022
879393995326,3cyclictest0-21swapper/209:30:012
87939399504,25cyclictest990052-21ssh11:06:042
879393995031,10cyclictest915385-21diskmemload12:35:032
87939299496,38cyclictest926261-21sh09:26:031
879393994824,5cyclictest891572-21latency_hist07:50:022
87939299484,36cyclictest1006029-21ssh11:31:051
87939299484,36cyclictest1006029-21ssh11:31:051
879391994832,5cyclictest1009763-21sh11:36:130
879391994832,5cyclictest1009763-21sh11:36:130
87939299473,35cyclictest1009229-21ssh11:36:051
87939299473,35cyclictest1009229-21ssh11:36:051
879392994436,5cyclictest1037681-21latency12:21:001
879392994436,5cyclictest1037681-21latency12:21:001
879391994437,5cyclictest439-21systemd-logind07:25:010
879393994333,6cyclictest1-21systemd07:35:022
879393994235,3cyclictest0-21swapper/207:20:002
879393994234,5cyclictest915289-21tail09:06:122
879393994233,6cyclictest882910-21/usr/sbin/munin07:20:542
87939399423,34cyclictest441-21gpm08:01:062
879392994236,3cyclictest0-21swapper/112:35:021
87939299422,31cyclictest967774-21sh10:31:041
879391994236,4cyclictest879390-21cyclictest08:46:040
87939299413,30cyclictest1028306-21ssh12:06:011
87939299413,30cyclictest1028306-21ssh12:06:011
879393994031,5cyclictest0-21swapper/210:16:022
879393994031,5cyclictest0-21swapper/210:16:022
879392994031,4cyclictest0-21swapper/109:51:001
879392994029,4cyclictest0-21swapper/110:11:001
879392994029,4cyclictest0-21swapper/110:11:001
879391994034,3cyclictest0-21swapper/012:21:130
879391994034,3cyclictest0-21swapper/012:21:130
879393993931,5cyclictest1-21systemd12:00:022
879393993931,5cyclictest1-21systemd12:00:022
879393993930,6cyclictest439-21systemd-logind11:11:072
879393993930,4cyclictest0-21swapper/209:51:012
879392993931,5cyclictest964990-21unixbench-2d10:26:121
879392993931,5cyclictest964990-21unixbench-2d10:26:121
87939199392,31cyclictest977170-21ssh10:45:590
879391993918,16cyclictest12350irq/32-eth012:06:060
879391993918,16cyclictest12350irq/32-eth012:06:060
87939199391,31cyclictest926313-21ssh09:26:060
87939399385,27cyclictest753-21ntpd10:11:012
87939399385,27cyclictest753-21ntpd10:11:012
879393993833,2cyclictest0-21swapper/209:00:012
87939399382,31cyclictest951744-21ssh10:06:032
879392993832,2cyclictest0-21swapper/111:00:011
879392993828,7cyclictest420-21avahi-daemon11:06:031
87939299381,25cyclictest1031621-21ssh12:11:061
87939299381,25cyclictest1031621-21ssh12:11:061
879391993831,5cyclictest940938-21systemd09:50:020
879393993730,4cyclictest1056-21mta-sts-daemon07:36:032
879393993729,5cyclictest972790-21awk10:40:002
879393993729,5cyclictest972790-21awk10:40:002
87939399372,26cyclictest983528-21ssh10:55:592
879392993730,4cyclictest944894-21fschecks_count09:55:541
879392993729,5cyclictest903915-21fschecks_count08:30:531
879392993729,5cyclictest1-21systemd08:10:011
879392993727,7cyclictest892890-21sh07:55:011
87939299371,29cyclictest1018814-21ssh11:51:051
879391993724,9cyclictest12350irq/32-eth008:21:060
87939199371,31cyclictest989995-21ssh11:06:020
87939199371,27cyclictest1044357-21ssh12:31:110
879393993630,3cyclictest0-21swapper/208:35:012
879393993629,4cyclictest949070-21grep10:01:112
879393993629,4cyclictest1000123-21grep11:21:112
879393993629,4cyclictest1000123-21grep11:21:112
879393993629,3cyclictest0-21swapper/210:21:072
879393993629,3cyclictest0-21swapper/210:21:072
879393993629,3cyclictest0-21swapper/209:21:052
879393993628,5cyclictest903406-21systemd-run08:30:012
879393993628,5cyclictest86535-21cups-browsed11:01:062
87939299364,23cyclictest1012446-21ssh11:41:051
87939299364,23cyclictest1012446-21ssh11:41:051
87939299363,27cyclictest935767-21ssh09:41:011
879392993630,3cyclictest0-21swapper/111:56:021
879392993630,3cyclictest0-21swapper/111:56:021
879392993628,5cyclictest0-21swapper/107:40:011
879391993630,4cyclictest1047045-21fschecks_time12:35:540
879391993624,9cyclictest0-21swapper/011:55:020
879393993527,5cyclictest921739-21cron09:20:012
879392993529,3cyclictest0-21swapper/108:20:001
879392993529,3cyclictest0-21swapper/108:20:001
879392993528,4cyclictest261-21systemd-journal10:45:501
879392993528,3cyclictest0-21swapper/109:31:061
879392993527,5cyclictest882370-21cron07:20:001
879392993527,4cyclictest0-21swapper/111:00:591
879392993526,6cyclictest421-21dbus-daemon10:21:101
879392993526,6cyclictest421-21dbus-daemon10:21:101
879392993525,8cyclictest921749-21grep09:20:021
879392993524,8cyclictest889205-21needreboot07:40:571
87939299352,15cyclictest171rcu_preempt09:46:021
879391993529,4cyclictest992754-21fschecks_count11:10:530
879391993520,11cyclictest12350irq/32-eth011:41:000
879391993520,11cyclictest12350irq/32-eth011:41:000
879393993429,2cyclictest0-21swapper/211:20:012
879393993426,5cyclictest906372-21cron08:40:012
879393993426,5cyclictest516-21in:imuxsock10:50:012
879393993425,6cyclictest879396-21systemd-run07:10:012
87939299343,24cyclictest932607-21ssh09:36:041
879392993420,10cyclictest1041106-21ssh12:26:051
879392993420,10cyclictest1041106-21ssh12:26:051
879391993424,4cyclictest913825-21unixbench_singl09:01:160
87939199342,25cyclictest659-21snmpd10:16:070
87939199342,25cyclictest659-21snmpd10:16:070
879391993416,14cyclictest0-21swapper/011:31:070
879391993416,14cyclictest0-21swapper/011:31:070
879391993416,11cyclictest151ktimers/010:06:020
879393993328,3cyclictest0-21swapper/208:00:012
879393993327,4cyclictest879390-21cyclictest12:01:572
879393993327,4cyclictest879390-21cyclictest12:01:572
879393993326,4cyclictest0-21swapper/212:31:112
879393993325,5cyclictest963837-21sshd10:25:502
879393993325,5cyclictest963837-21sshd10:25:502
879393993325,5cyclictest1015730-21mailstats11:46:052
87939399332,27cyclictest1002700-21ssh11:25:582
87939399332,27cyclictest1002700-21ssh11:25:582
879392993328,2cyclictest0-21swapper/111:20:541
879392993328,2cyclictest0-21swapper/111:20:541
879392993326,4cyclictest0-21swapper/109:10:021
87939299332,24cyclictest624-21lldpd08:41:011
879392993320,10cyclictest421-21dbus-daemon08:01:001
879391993326,4cyclictest1043167-21sort12:30:020
879391993326,4cyclictest1043167-21sort12:30:020
87939199332,23cyclictest659-21snmpd08:01:060
879391993317,7cyclictest12350irq/32-eth010:26:060
879391993317,7cyclictest12350irq/32-eth010:26:060
879393993225,4cyclictest1011933-21fschecks_time11:40:532
879393993225,4cyclictest1011933-21fschecks_time11:40:532
879393993224,5cyclictest967192-21df10:30:492
879393993224,5cyclictest1-21systemd11:35:012
879393993224,5cyclictest1-21systemd11:35:012
879392993226,3cyclictest0-21swapper/112:35:591
879392993224,5cyclictest996268-21needreboot11:15:571
879392993223,6cyclictest980224-21missed_timers10:50:581
879392993223,6cyclictest898902-21systemd-run08:15:011
879392993223,6cyclictest898902-21systemd-run08:15:011
87939299322,24cyclictest86535-21cups-browsed11:46:041
879391993227,2cyclictest0-21swapper/007:40:010
879391993226,4cyclictest886880-21ls07:35:010
879393993125,3cyclictest0-21swapper/210:00:012
879393993124,4cyclictest913842-21unixbench_singl09:01:162
879393993122,6cyclictest1031383-21needreboot12:10:572
879393993122,6cyclictest1031383-21needreboot12:10:572
879392993125,3cyclictest0-21swapper/109:15:031
879392993123,5cyclictest901817-21unixbench_singl08:21:131
879392993123,5cyclictest882937-21fschecks_time07:20:541
879392993122,6cyclictest86535-21cups-browsed10:17:371
879392993122,6cyclictest86535-21cups-browsed10:17:371
87939299312,22cyclictest993276-21ssh11:11:051
879392993120,8cyclictest1036681-21ssh12:20:011
879392993120,8cyclictest1036681-21ssh12:20:011
879392993120,7cyclictest912910-21fschecks_count09:00:531
879392993117,9cyclictest1051-21mta-sts-daemon10:36:001
879392993117,9cyclictest1051-21mta-sts-daemon10:36:001
879391993125,4cyclictest894255-21unixbench_multi07:56:120
879391993125,4cyclictest421-21dbus-daemon07:30:010
879391993125,3cyclictest0-21swapper/009:40:540
879391993124,4cyclictest151ktimers/011:56:050
879391993124,4cyclictest151ktimers/011:56:050
879391993122,6cyclictest0-21swapper/009:15:010
879391993121,8cyclictest1034519-21missed_timers12:15:570
879391993121,8cyclictest1034519-21missed_timers12:15:570
879391993120,9cyclictest0-21swapper/010:51:420
879391993119,4cyclictest889789-21unixbench_multi07:41:100
879393993022,5cyclictest884969-21systemctl07:26:072
87939299303,21cyclictest923053-21rm09:21:051
879392993023,4cyclictest1054-21mta-sts-daemon07:26:061
879392993022,5cyclictest421-21dbus-daemon10:10:011
879392993022,4cyclictest950492-21idleruntime-cro10:05:011
879391993024,3cyclictest0-21swapper/012:00:580
879391993024,3cyclictest0-21swapper/012:00:580
879391993023,4cyclictest904880-21sh08:35:010
879391993023,4cyclictest0-21swapper/010:11:080
879391993023,4cyclictest0-21swapper/010:11:080
879391993020,8cyclictest261-21systemd-journal10:40:000
879391993020,8cyclictest261-21systemd-journal10:40:000
879391993017,10cyclictest12350irq/32-eth010:21:090
879391993017,10cyclictest12350irq/32-eth010:21:090
879393992924,2cyclictest0-21swapper/209:41:112
879393992923,3cyclictest0-21swapper/209:46:132
879393992922,3cyclictest0-21swapper/209:36:052
879392992923,3cyclictest0-21swapper/111:25:521
879392992923,3cyclictest0-21swapper/111:25:521
879392992921,4cyclictest975978-21munin-run10:45:001
87939199293,20cyclictest923043-21ssh09:21:050
879391992924,2cyclictest0-21swapper/011:00:010
879391992922,5cyclictest1056-21mta-sts-daemon10:44:160
87939199292,21cyclictest996349-21ssh11:16:000
879391992921,6cyclictest945759-21ssh09:56:110
879391992910,11cyclictest151ktimers/008:25:580
879393992820,5cyclictest898871-21cron08:15:002
879393992820,5cyclictest898871-21cron08:15:002
879393992820,5cyclictest548-21gdbus08:25:012
879393992820,5cyclictest1011086-21sh11:40:002
879393992820,5cyclictest1011086-21sh11:40:002
879393992819,7cyclictest929628-21mailstats09:31:092
879392992822,3cyclictest895908-21kworker/u8:1-nfsiod08:29:031
87939299282,19cyclictest1025227-21ssh12:01:051
87939299282,19cyclictest1025227-21ssh12:01:051
879392992821,3cyclictest0-21swapper/108:00:011
879392992814,11cyclictest912388-21idleruntime-cro09:00:011
879391992819,5cyclictest12350irq/32-eth009:50:590
879391992817,7cyclictest967723-21sh10:31:010
879391992817,6cyclictest12450irq/33-eth009:31:030
879391992816,8cyclictest151ktimers/008:15:580
879391992816,8cyclictest151ktimers/008:15:580
879393992722,2cyclictest0-21swapper/210:55:012
879393992720,4cyclictest1018615-21needreboot11:50:582
879393992719,5cyclictest880809-21unixbench_singl07:11:132
879393992719,5cyclictest86535-21cups-browsed08:50:262
87939299273,17cyclictest428-21mta-sts-daemon07:46:011
879391992723,2cyclictest0-21swapper/011:05:000
879391992722,3cyclictest151ktimers/011:26:020
879391992722,3cyclictest151ktimers/011:26:020
879391992721,4cyclictest86535-21cups-browsed12:10:500
879391992721,4cyclictest86535-21cups-browsed12:10:500
879391992719,6cyclictest891225-21unixbench-2d07:46:110
879391992719,5cyclictest897388-21munin-plugin-st08:10:000
879391992715,7cyclictest12350irq/32-eth011:45:510
879393992620,3cyclictest0-21swapper/208:20:012
879393992620,3cyclictest0-21swapper/208:20:012
879393992620,3cyclictest0-21swapper/208:10:012
879393992619,4cyclictest1039821-21sh12:25:002
879393992619,4cyclictest1039821-21sh12:25:002
879393992618,5cyclictest86535-21cups-browsed10:42:012
879393992618,5cyclictest1054-21mta-sts-daemon07:40:592
87939299263,17cyclictest86535-21cups-browsed08:36:061
879392992618,5cyclictest886814-21unixbench_singl07:31:111
87939199263,17cyclictest151ktimers/008:36:020
879391992622,2cyclictest0-21swapper/007:20:000
87939199262,19cyclictest999547-21ntpq11:20:590
87939199262,19cyclictest999547-21ntpq11:20:590
879391992620,3cyclictest910499-21mailstats08:51:100
879391992619,5cyclictest0-21swapper/009:35:570
879391992619,3cyclictest12350irq/32-eth009:16:020
87939399252,18cyclictest1028381-21ssh12:06:032
87939399252,18cyclictest1028381-21ssh12:06:032
879393992517,5cyclictest86535-21cups-browsed08:44:102
879391992519,4cyclictest912300-21head08:56:100
879391992519,4cyclictest151ktimers/008:41:040
879391992517,6cyclictest892865-21cron07:55:010
879391992517,6cyclictest879344-21munin-plugin-st07:10:020
879391992516,7cyclictest1055-21mta-sts-daemon07:12:460
87939199251,18cyclictest948554-21ssh10:01:010
879393992415,4cyclictest1056-21mta-sts-daemon08:46:582
879392992419,2cyclictest0-21swapper/108:51:131
879391992412,10cyclictest0-21swapper/009:05:560
879393992316,4cyclictest1056-21mta-sts-daemon07:51:072
879392992315,5cyclictest880876-21munin-plugin-st07:15:011
879392992315,4cyclictest0-21swapper/107:10:031
87939299221,15cyclictest908746-21ntpq08:46:021
87939199201,13cyclictest151ktimers/008:11:010
87939199201,13cyclictest151ktimers/008:11:010
87939499192,9cyclictest0-21swapper/311:10:583
87939499183,8cyclictest0-21swapper/310:26:023
87939499183,8cyclictest0-21swapper/310:26:023
87939499172,8cyclictest0-21swapper/311:41:023
87939499172,8cyclictest0-21swapper/311:41:023
87939499163,6cyclictest0-21swapper/311:31:053
87939499163,6cyclictest0-21swapper/311:31:053
87939499162,7cyclictest0-21swapper/310:46:033
87939499161,9cyclictest0-21swapper/308:29:043
87939499161,3cyclictest0-21swapper/312:35:033
87939499153,7cyclictest0-21swapper/312:01:043
87939499153,7cyclictest0-21swapper/312:01:043
87939499153,7cyclictest0-21swapper/310:00:013
87939499152,7cyclictest0-21swapper/310:11:003
87939499152,7cyclictest0-21swapper/310:11:003
87939499152,7cyclictest0-21swapper/309:11:023
87939499152,6cyclictest0-21swapper/311:01:003
87939499151,8cyclictest0-21swapper/310:40:583
87939499151,7cyclictest0-21swapper/307:40:593
87939499151,6cyclictest0-21swapper/311:45:573
87939499143,8cyclictest0-21swapper/310:21:023
87939499143,8cyclictest0-21swapper/310:21:023
87939499143,6cyclictest0-21swapper/312:21:073
87939499143,6cyclictest0-21swapper/312:21:073
87939499143,6cyclictest0-21swapper/307:51:073
87939499142,8cyclictest0-21swapper/309:51:003
87939499142,7cyclictest0-21swapper/311:36:073
87939499142,7cyclictest0-21swapper/311:36:073
87939499142,7cyclictest0-21swapper/310:56:083
87939499142,7cyclictest0-21swapper/309:26:003
87939499142,6cyclictest0-21swapper/312:10:593
87939499142,6cyclictest0-21swapper/312:10:593
87939499142,6cyclictest0-21swapper/310:16:103
87939499142,6cyclictest0-21swapper/310:16:103
87939499133,7cyclictest0-21swapper/309:31:023
87939499133,6cyclictest0-21swapper/308:55:013
87939499132,6cyclictest0-21swapper/311:56:023
87939499132,6cyclictest0-21swapper/311:56:023
87939499132,6cyclictest0-21swapper/311:06:043
87939499132,6cyclictest0-21swapper/310:36:023
87939499132,6cyclictest0-21swapper/310:36:023
87939499132,6cyclictest0-21swapper/310:06:013
87939499131,8cyclictest0-21swapper/312:31:023
87939499131,6cyclictest0-21swapper/311:51:003
87939499131,6cyclictest0-21swapper/309:41:003
87939499131,6cyclictest0-21swapper/309:16:003
87939499131,6cyclictest0-21swapper/308:31:013
87939499131,6cyclictest0-21swapper/308:21:033
87939499124,4cyclictest0-21swapper/308:46:073
87939499122,7cyclictest0-21swapper/310:01:003
87939499122,6cyclictest0-21swapper/312:06:013
87939499122,6cyclictest0-21swapper/312:06:013
87939499122,6cyclictest0-21swapper/311:25:583
87939499122,6cyclictest0-21swapper/311:25:583
87939499122,6cyclictest0-21swapper/309:46:013
87939499122,6cyclictest0-21swapper/308:56:003
87939499122,5cyclictest0-21swapper/310:30:573
87939499122,5cyclictest0-21swapper/309:06:003
87939499122,5cyclictest0-21swapper/307:30:003
87939499121,7cyclictest0-21swapper/309:01:013
87939499121,7cyclictest0-21swapper/308:41:033
87939499121,7cyclictest0-21swapper/308:16:043
87939499121,7cyclictest0-21swapper/308:16:043
87939499121,6cyclictest0-21swapper/312:26:003
87939499121,6cyclictest0-21swapper/312:26:003
87939499121,6cyclictest0-21swapper/307:56:003
87939499121,6cyclictest0-21swapper/307:46:013
87939499121,6cyclictest0-21swapper/307:35:583
87939499121,5cyclictest0-21swapper/307:30:593
87939499121,5cyclictest0-21swapper/307:16:003
87939499112,5cyclictest0-21swapper/312:16:003
87939499112,5cyclictest0-21swapper/312:16:003
87939499112,5cyclictest0-21swapper/309:35:573
87939499111,7cyclictest0-21swapper/310:51:013
87939499111,7cyclictest0-21swapper/308:11:023
87939499111,7cyclictest0-21swapper/308:11:023
87939499111,6cyclictest0-21swapper/311:20:503
87939499111,6cyclictest0-21swapper/311:20:503
87939499111,6cyclictest0-21swapper/309:21:033
87939499111,6cyclictest0-21swapper/307:21:003
87939499111,5cyclictest0-21swapper/308:06:003
87939499104,4cyclictest0-21swapper/308:36:053
87939499102,5cyclictest0-21swapper/308:01:003
87939499102,4cyclictest0-21swapper/311:15:503
87939499100,5cyclictest0-21swapper/307:11:013
8793949982,4cyclictest0-21swapper/307:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional