You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 17:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri Jun 05, 2026 12:42:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3768624997353,15cyclictest3777594-40mandb07:41:070
3768624997156,12cyclictest3777594-40mandb07:40:010
3768626997057,6cyclictest0-21swapper/207:41:092
3768625995445,4cyclictest0-21swapper/107:40:561
3768626995028,4cyclictest3923995-21cron12:20:012
376862699502,24cyclictest3777667-21latency_hist07:40:022
3768624995042,5cyclictest2965634-21cups-browsed08:21:060
3768626994925,4cyclictest3867448-21cron10:50:012
3768625994941,4cyclictest0-21swapper/110:16:021
3768626994825,19cyclictest0-21swapper/211:21:032
376862699482,23cyclictest3874960-21ssh11:01:022
3768626994639,3cyclictest0-21swapper/207:46:142
3768626994639,3cyclictest0-21swapper/207:46:142
376862699463,33cyclictest3837330-21ssh10:01:082
3768625994633,9cyclictest2965634-21cups-browsed11:23:091
3768624994536,4cyclictest0-21swapper/012:21:010
3768626994435,5cyclictest3877499-21aten2.4-expect11:05:532
376862599443,34cyclictest3843578-21ssh10:11:031
3768626994335,5cyclictest3908264-21cron11:55:012
3768625994337,3cyclictest0-21swapper/112:16:021
3768625994337,3cyclictest0-21swapper/111:35:011
3768624994335,5cyclictest3822142-21tail09:36:150
3768624994324,12cyclictest12350irq/32-eth009:21:020
3768626994233,5cyclictest3810887-21ssh09:20:012
3768626994227,9cyclictest3903246-21sh11:46:042
3768625994235,5cyclictest3777610-21sendmail07:40:011
3768625994234,5cyclictest3900758-21unixbench_singl11:41:251
3768624994224,14cyclictest12350irq/32-eth008:51:020
376862599413,28cyclictest3824859-21sshd09:41:091
3768624994134,5cyclictest439-21systemd-logind12:20:020
3768624994129,9cyclictest3881450-21sshd11:11:090
3768624994129,7cyclictest0-21swapper/012:06:090
3768626994031,5cyclictest3774633-21systemd-run07:30:012
3768625994031,5cyclictest1-21systemd09:25:011
3768624994031,6cyclictest3859391-21ssh10:36:100
3768626993919,14cyclictest3827900-21ssh09:46:062
3768625993931,5cyclictest3880118-21latency_hist11:10:021
3768625993930,6cyclictest3821176-21fschecks_time09:35:571
3768625993929,7cyclictest2965631-21cupsd09:31:031
3768625993928,9cyclictest3856614-21unixbench-2d10:31:141
3768624993931,5cyclictest1055-21mta-sts-daemon09:48:030
3768626993830,5cyclictest3783604-21cut08:00:012
3768626993828,6cyclictest3851779-21systemd-run10:25:012
3768625993830,5cyclictest3795621-21awk08:40:011
3768624993832,4cyclictest3858038-21systemd-run10:35:010
3768624993831,4cyclictest3820363-21systemd-run09:35:010
3768626993730,3cyclictest0-21swapper/212:15:012
3768626993729,5cyclictest3794642-21fschecks_time08:35:582
3768626993727,6cyclictest3773116-21cron07:25:012
376862699371,22cyclictest3821534-21ssh09:36:022
3768625993731,3cyclictest0-21swapper/111:01:041
376862499373,26cyclictest3906330-21ssh11:51:020
3768624993730,3cyclictest0-21swapper/010:25:520
3768624993727,8cyclictest0-21swapper/012:00:010
3768626993629,3cyclictest0-21swapper/207:55:002
3768626993626,7cyclictest421-21dbus-daemon10:35:012
376862699361,26cyclictest3862456-21ssh10:41:052
376862699361,26cyclictest3834170-21ssh09:56:092
376862699361,26cyclictest3834170-21ssh09:56:092
3768625993632,2cyclictest0-21swapper/110:51:031
3768625993628,4cyclictest1054-21mta-sts-daemon10:55:141
3768625993627,6cyclictest3880905-21gltestperf11:10:571
3768625993627,6cyclictest3832946-21latency_hist09:55:021
376862599362,16cyclictest3804611-21diskmemload12:31:041
3768624993628,5cyclictest516-21in:imuxsock11:30:010
3768624993628,5cyclictest420-21avahi-daemon07:51:110
3768624993628,5cyclictest3848591-21munin-run10:20:010
3768624993627,6cyclictest3788108-21munin-plugin-st08:15:010
3768624993620,11cyclictest151ktimers/008:16:030
376862699353,25cyclictest3928463-21ssh12:26:062
3768626993528,4cyclictest3788632-21fschecks_time08:15:562
3768626993527,5cyclictest3830681-21if_eth009:50:562
3768626993526,6cyclictest421-21dbus-daemon09:25:012
3768626993526,6cyclictest3933444-21systemd-run12:35:012
3768626993525,6cyclictest2965634-21cups-browsed12:01:212
3768625993528,4cyclictest3936620-21latency_hist12:40:021
3768625993527,5cyclictest3920884-21systemd-run12:15:021
3768625993526,6cyclictest3828445-21grep09:46:161
3768625993526,6cyclictest2965634-21cups-browsed12:20:261
376862599352,26cyclictest3815466-21ssh09:26:101
3768625993522,5cyclictest1054-21mta-sts-daemon09:01:081
3768624993529,4cyclictest1-21systemd07:10:010
3768624993528,4cyclictest0-21swapper/009:15:560
3768624993526,6cyclictest2965634-21cups-browsed10:48:070
3768624993524,8cyclictest3936567-21grep12:40:010
3768624993520,12cyclictest3928335-21sh12:26:020
3768626993428,3cyclictest0-21swapper/211:16:022
3768626993427,4cyclictest3917760-21latency_hist12:10:022
376862699342,23cyclictest3871830-21ssh10:56:042
3768625993428,3cyclictest0-21swapper/110:26:061
3768625993426,5cyclictest3803646-21fschecks_time09:05:561
3768625993425,6cyclictest1-21systemd07:20:011
376862599341,27cyclictest3909472-21ssh11:56:011
3768624993428,3cyclictest0-21swapper/011:15:570
3768624993428,3cyclictest0-21swapper/010:00:580
3768624993426,3cyclictest0-21swapper/011:46:030
3768624993424,8cyclictest3806070-21sshd09:11:090
3768624993422,8cyclictest12350irq/32-eth011:36:070
3768626993325,5cyclictest1055-21mta-sts-daemon11:11:152
3768625993326,3cyclictest0-21swapper/109:16:111
3768625993325,5cyclictest3886346-21sendmail11:20:011
3768625993325,5cyclictest3865455-21needreboot10:46:001
3768625993325,5cyclictest3807749-21latency_hist09:15:021
3768625993325,5cyclictest3799133-21fschecks_time08:50:561
3768625993325,5cyclictest3794099-21cron08:35:001
3768624993324,6cyclictest439-21systemd-logind11:05:010
3768624993324,6cyclictest3804619-21sh09:10:010
3768624993323,7cyclictest3840725-21cat10:06:140
3768624993322,6cyclictest3911939-21/usr/sbin/munin12:00:550
3768624993320,5cyclictest3889497-21ssh11:25:010
3768624993320,10cyclictest0-21swapper/011:00:020
376862499331,26cyclictest3824842-21ssh09:41:090
3768626993225,3cyclictest0-21swapper/209:15:012
3768626993222,8cyclictest3818325-21needreboot09:30:592
376862699321,23cyclictest3909528-21ssh11:56:032
3768625993224,5cyclictest3842310-21cut10:10:001
376862599322,26cyclictest3912617-21ssh12:01:001
3768624993222,6cyclictest0-21swapper/008:00:010
376862499321,25cyclictest3843519-21ssh10:11:000
376862699314,22cyclictest3897060-21ssh11:36:102
3768626993125,3cyclictest3867483-21kworker/u8:2-xprtiod10:50:532
3768626993124,4cyclictest3844140-21unixbench_singl10:11:122
3768626993124,4cyclictest1055-21mta-sts-daemon08:56:042
3768626993120,8cyclictest3798360-21timerandwakeup08:46:142
3768625993123,5cyclictest3896343-21aten_r2power_cu11:35:541
3768625993123,4cyclictest3786834-21kworker/u8:1-xprtiod10:05:021
376862599312,19cyclictest3834179-21ssh09:56:091
376862599312,19cyclictest3834179-21ssh09:56:091
3768625993121,7cyclictest421-21dbus-daemon11:54:551
3768625993120,8cyclictest3915639-21missed_timers12:05:591
376862499313,5cyclictest171rcu_preempt12:31:040
3768624993126,2cyclictest0-21swapper/010:21:040
3768624993125,3cyclictest0-21swapper/009:26:030
376862499312,24cyclictest3834085-21ssh09:56:050
376862499312,24cyclictest3834085-21ssh09:56:050
3768624993119,8cyclictest12350irq/32-eth012:11:050
3768624993111,14cyclictest3893966-21ssh11:31:080
376862699303,21cyclictest3900227-21ssh11:41:152
3768626993024,3cyclictest1051-21mta-sts-daemon08:51:012
3768626993024,3cyclictest0-21swapper/210:36:102
3768626993022,5cyclictest3890639-21needreboot11:26:002
3768626993020,6cyclictest0-21swapper/212:25:012
376862699301,23cyclictest3815372-21ssh09:26:072
3768625993026,2cyclictest0-21swapper/108:01:091
3768625993025,3cyclictest0-21swapper/107:55:001
3768625993024,3cyclictest0-21swapper/111:45:581
3768625993022,5cyclictest421-21dbus-daemon12:25:351
3768625993022,5cyclictest3890899-21grep11:26:091
3768625993022,5cyclictest3791114-21cron08:25:011
376862599301,23cyclictest3862351-21ssh10:41:011
3768624993025,3cyclictest0-21swapper/011:06:080
3768624993025,2cyclictest0-21swapper/007:50:000
3768624993025,2cyclictest0-21swapper/007:50:000
3768626992922,4cyclictest3771607-21idleruntime-cro07:20:012
3768626992922,4cyclictest1056-21mta-sts-daemon08:41:022
376862699292,21cyclictest3846678-21ssh10:16:022
376862699292,20cyclictest3840437-21ssh10:06:062
3768626992919,5cyclictest0-21swapper/210:26:052
3768625992924,2cyclictest0-21swapper/108:00:021
3768625992922,4cyclictest1051-21mta-sts-daemon08:10:011
3768625992922,4cyclictest0-21swapper/110:36:111
3768625992921,5cyclictest3776000-21unixbench_multi07:31:131
3768625992921,5cyclictest3776000-21unixbench_multi07:31:131
3768625992919,7cyclictest3773126-21/usr/sbin/munin07:25:021
3768624992924,2cyclictest0-21swapper/010:50:100
3768624992922,4cyclictest3793146-21fschecks_time08:30:560
3768624992919,7cyclictest3772526-21ntp_kernel_pll_07:21:070
3768624992918,8cyclictest3862921-21unixbench-2d10:41:160
376862499291,6cyclictest171rcu_preempt08:41:040
3768624992915,3cyclictest0-21swapper/009:00:560
3768626992822,3cyclictest0-21swapper/209:45:012
3768626992819,6cyclictest3775143-21fschecks_time07:30:552
3768626992819,6cyclictest3775143-21fschecks_time07:30:552
3768626992819,4cyclictest0-21swapper/208:06:032
3768626992818,7cyclictest3935269-21unixbench_singl12:36:152
376862699281,21cyclictest3893994-21sh11:31:092
3768625992821,3cyclictest0-21swapper/108:16:091
3768624992821,4cyclictest3830593-21fschecks_count09:50:550
3768626992720,4cyclictest1051-21mta-sts-daemon09:06:152
3768626992719,5cyclictest3793542-21ntp_offset08:31:052
3768626992718,5cyclictest0-21swapper/208:26:092
3768625992722,2cyclictest0-21swapper/108:45:011
3768625992721,3cyclictest0-21swapper/107:15:011
3768625992719,4cyclictest0-21swapper/108:26:041
3768625992718,6cyclictest2965634-21cups-browsed07:26:241
3768624992721,3cyclictest0-21swapper/008:36:070
3768624992720,5cyclictest0-21swapper/007:15:010
3768624992717,5cyclictest3899514-21ssh11:40:530
3768626992616,4cyclictest1056-21mta-sts-daemon08:12:592
3768625992620,4cyclictest0-21swapper/107:10:021
3768625992620,3cyclictest0-21swapper/109:00:011
3768625992616,7cyclictest1-21systemd07:50:011
3768625992616,7cyclictest1-21systemd07:50:011
376862499263,17cyclictest3785119-21latency_hist08:05:010
3768624992618,6cyclictest3774488-21unixbench_multi07:26:160
3768624992611,12cyclictest261-21systemd-journal08:50:010
3768626992517,5cyclictest3803107-21cron09:05:012
376862599253,15cyclictest428-21mta-sts-daemon08:46:051
3768625992517,6cyclictest3849188-21aten_r2power_en10:20:531
376862799242,14cyclictest0-21swapper/307:41:113
3768624992417,4cyclictest1056-21mta-sts-daemon08:58:560
376862499241,19cyclictest3792804-21grep08:30:020
3768626992314,6cyclictest3783924-21tail08:00:522
3768626992314,6cyclictest1051-21mta-sts-daemon08:23:412
3768625992317,3cyclictest0-21swapper/108:11:051
3768624992314,7cyclictest3786365-21timerandwakeup08:06:140
376862499231,17cyclictest1054-21mta-sts-daemon07:31:060
376862499231,17cyclictest1054-21mta-sts-daemon07:31:060
376862799223,12cyclictest0-21swapper/309:46:103
376862799222,9cyclictest0-21swapper/311:21:023
376862799222,12cyclictest0-21swapper/309:11:063
376862699222,15cyclictest3769492-21ntpq07:11:032
376862499221,9cyclictest3770372-21aten_r2power_cu07:15:520
376862799214,9cyclictest0-21swapper/311:51:063
376862799213,11cyclictest0-21swapper/312:36:053
376862799213,11cyclictest0-21swapper/312:31:043
376862799213,11cyclictest0-21swapper/309:36:043
376862799212,12cyclictest0-21swapper/311:11:033
376862799203,11cyclictest0-21swapper/309:16:063
376862799203,10cyclictest0-21swapper/310:16:023
376862799202,11cyclictest0-21swapper/312:26:023
376862799202,11cyclictest0-21swapper/311:06:083
376862799202,11cyclictest0-21swapper/307:40:003
376862799195,9cyclictest0-21swapper/309:21:023
376862799195,8cyclictest0-21swapper/312:16:023
376862799193,9cyclictest0-21swapper/310:36:033
376862799193,9cyclictest0-21swapper/310:26:023
376862799193,7cyclictest0-21swapper/310:56:033
376862799193,7cyclictest0-21swapper/308:51:043
376862799192,14cyclictest0-21swapper/311:56:053
376862799192,10cyclictest0-21swapper/311:36:163
376862799192,10cyclictest0-21swapper/311:16:043
376862799192,10cyclictest0-21swapper/310:06:073
376862799192,10cyclictest0-21swapper/309:26:023
376862799184,7cyclictest0-21swapper/307:46:133
376862799184,7cyclictest0-21swapper/307:46:133
376862799183,9cyclictest0-21swapper/309:51:033
376862799183,9cyclictest0-21swapper/309:31:013
376862799183,9cyclictest0-21swapper/307:21:093
376862799182,9cyclictest0-21swapper/310:46:023
376862799182,11cyclictest0-21swapper/311:26:013
376862799182,11cyclictest0-21swapper/310:51:033
376862799182,10cyclictest0-21swapper/310:20:593
376862799181,11cyclictest0-21swapper/308:41:103
376862799174,8cyclictest0-21swapper/311:46:113
376862799173,9cyclictest0-21swapper/310:10:503
376862799173,8cyclictest0-21swapper/311:01:023
376862799173,7cyclictest0-21swapper/309:01:023
376862799172,9cyclictest0-21swapper/309:41:013
376862799172,9cyclictest0-21swapper/307:16:033
376862799172,8cyclictest0-21swapper/311:41:003
376862799172,8cyclictest0-21swapper/310:30:573
376862799172,10cyclictest0-21swapper/312:11:073
376862799171,11cyclictest0-21swapper/312:06:023
376862799164,8cyclictest0-21swapper/309:10:013
376862799163,9cyclictest0-21swapper/312:21:163
376862799163,8cyclictest0-21swapper/310:01:053
376862799163,8cyclictest0-21swapper/308:06:153
376862799162,9cyclictest0-21swapper/310:40:523
376862799162,9cyclictest0-21swapper/308:01:013
376862799162,10cyclictest0-21swapper/309:56:053
376862799162,10cyclictest0-21swapper/309:56:053
376862799161,9cyclictest0-21swapper/311:31:033
376862799161,8cyclictest0-21swapper/308:31:043
376862799161,8cyclictest0-21swapper/307:51:093
376862799153,8cyclictest0-21swapper/307:56:083
376862799153,7cyclictest0-21swapper/308:16:093
376862799152,8cyclictest0-21swapper/312:00:533
376862799152,7cyclictest0-21swapper/308:56:013
376862799152,7cyclictest0-21swapper/307:31:043
376862799152,7cyclictest0-21swapper/307:31:043
376862799151,8cyclictest0-21swapper/308:21:053
376862699159,3cyclictest0-21swapper/207:10:012
376862799143,7cyclictest0-21swapper/308:46:073
376862799143,5cyclictest0-21swapper/308:26:093
376862799142,7cyclictest0-21swapper/308:11:013
376862799142,7cyclictest0-21swapper/307:11:023
376862799141,7cyclictest0-21swapper/308:36:043
376862799134,6cyclictest0-21swapper/307:26:103
376862799102,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional