You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 22:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Sep 19, 2026 12:42:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324680996448,13cyclictest391253-21systemctl10:00:000
324682995545,5cyclictest356233-21kworker/u8:4-rpciod09:06:492
324681995532,3cyclictest0-21swapper/110:25:011
324681995530,6cyclictest427667-21cron11:00:011
324681995530,5cyclictest3734659-21cups-browsed11:05:181
324682995041,5cyclictest470284-21grep12:10:012
32468299496,33cyclictest410726-21ssh10:31:162
324680994725,16cyclictest12650irq/32-eth010:41:180
32468299462,34cyclictest374309-21ssh09:31:202
324681994638,5cyclictest360843-21latency_hist09:10:021
324681994539,3cyclictest0-21swapper/112:35:011
324682994435,6cyclictest474739-21proc_pri12:16:262
324682994435,6cyclictest474739-21proc_pri12:16:262
324682994435,6cyclictest1-21systemd11:30:012
324680994436,4cyclictest1002-21mta-sts-daemon12:32:110
324681994336,4cyclictest476355-21kthreadd12:20:011
324681994336,4cyclictest476355-21kthreadd12:20:011
324680994328,12cyclictest421-21dbus-daemon11:55:010
32468299425,31cyclictest401672-21ssh10:16:212
324682994234,5cyclictest427667-21cron11:00:012
324682994228,9cyclictest366854-21idleruntime-cro09:20:012
32468299422,31cyclictest480629-21ssh12:26:152
32468299422,31cyclictest480629-21ssh12:26:152
324682994223,13cyclictest351ktimers/212:31:162
32468099424,32cyclictest425980-21ssh10:56:190
324680994229,10cyclictest435625-21unixbench_singl11:11:280
324682994130,8cyclictest452003-21sh11:40:012
324682994130,8cyclictest345747-21idleruntime-cro08:20:012
324681994133,5cyclictest401803-21proc_pri10:16:261
324680994133,5cyclictest442974-21latency_hist11:25:020
324680994126,12cyclictest444171-21ntp_kernel_pll_11:26:160
324682994031,6cyclictest421-21dbus-daemon12:15:022
324682994030,6cyclictest420-21avahi-daemon09:48:412
324682994030,6cyclictest420-21avahi-daemon09:48:412
324681994034,3cyclictest0-21swapper/107:30:011
324681994032,5cyclictest416866-21ntp_kernel_pll_10:41:231
324680994022,11cyclictest151ktimers/012:26:140
324680994022,11cyclictest151ktimers/012:26:140
324682993931,5cyclictest466042-21grep12:01:302
324682993931,5cyclictest377193-21needreboot09:36:132
32468199397,20cyclictest627-21lldpd08:06:151
32468199397,20cyclictest627-21lldpd08:06:151
324681993931,4cyclictest0-21swapper/112:36:101
324680993932,4cyclictest379091-21awk09:40:010
324680993927,10cyclictest0-21swapper/012:20:010
324680993927,10cyclictest0-21swapper/012:20:010
324680993911,21cyclictest453295-21sshd11:41:140
324681993833,2cyclictest0-21swapper/110:05:011
324680993831,3cyclictest0-21swapper/010:16:170
32468099382,28cyclictest410800-21rm10:31:180
324680993822,13cyclictest360703-40mandb09:06:510
32468099381,19cyclictest456441-21ssh11:46:200
324682993731,3cyclictest0-21swapper/211:25:022
324682993729,5cyclictest406458-21systemd-run10:25:012
324682993728,6cyclictest391269-21sendmail10:00:002
324680993728,7cyclictest341674-21sshd08:06:060
324680993728,7cyclictest341674-21sshd08:06:060
324680993727,4cyclictest439840-21ssh11:20:010
32468299363,24cyclictest413794-21ssh10:36:182
324682993629,4cyclictest0-21swapper/210:46:062
324682993628,3cyclictest0-21swapper/210:41:232
324681993628,3cyclictest0-21swapper/110:06:141
324681993627,6cyclictest379091-21idleruntime-cro09:40:011
324681993626,6cyclictest3734659-21cups-browsed12:11:231
324681993615,17cyclictest404638-21kworker/u8:12+events_unbound10:26:221
32468199361,24cyclictest422902-21sh10:51:171
324680993626,4cyclictest488532-21systemd12:40:020
324680993622,8cyclictest12650irq/32-eth010:21:210
324682993525,6cyclictest3734659-21cups-browsed09:41:212
324682993525,6cyclictest3734659-21cups-browsed09:41:212
324682993524,8cyclictest335177-21sh07:45:012
324681993529,3cyclictest0-21swapper/109:26:231
324681993527,5cyclictest389393-21cut09:56:141
324681993526,6cyclictest452074-21latency_hist11:40:021
324681993526,6cyclictest347235-21/usr/sbin/munin08:25:021
324681993526,5cyclictest443922-21kernelversion11:26:121
324681993522,8cyclictest0-21swapper/112:00:021
32468099351,26cyclictest374288-21ssh09:31:190
324682993429,2cyclictest0-21swapper/207:55:012
324682993427,4cyclictest448975-21cron11:35:012
324682993427,4cyclictest399207-21unixbench_singl10:11:312
324682993426,5cyclictest477515-21needreboot12:21:142
324682993426,5cyclictest477515-21needreboot12:21:142
324682993426,5cyclictest332572-21aten_r2power_vo07:36:042
324682993426,5cyclictest1-21systemd08:10:012
324682993426,5cyclictest1-21systemd08:10:012
324682993426,4cyclictest0-21swapper/209:51:142
324682993426,4cyclictest0-21swapper/209:51:142
324682993424,6cyclictest3734657-21cupsd10:29:512
324681993429,2cyclictest0-21swapper/108:15:001
324681993428,3cyclictest0-21swapper/109:50:021
324681993428,3cyclictest0-21swapper/109:50:021
324681993426,5cyclictest434377-21aten_r2power_en11:11:051
324680993427,4cyclictest394286-21ssh10:05:010
324680993426,3cyclictest0-21swapper/009:46:140
324680993426,3cyclictest0-21swapper/009:46:140
324680993424,7cyclictest369907-21ssh09:25:010
324680993424,7cyclictest364848-21latency09:16:120
324680993424,4cyclictest330431-21timerandwakeup07:26:280
32468099341,25cyclictest419792-21sh10:46:150
324682993328,2cyclictest0-21swapper/207:15:022
324682993327,3cyclictest0-21swapper/212:00:012
324682993327,3cyclictest0-21swapper/208:00:002
324682993325,5cyclictest432592-21unixbench_singl11:06:262
324682993325,3cyclictest0-21swapper/212:38:552
32468299332,26cyclictest3734659-21cups-browsed09:26:192
32468199334,21cyclictest419819-21ssh10:46:161
324681993325,5cyclictest466093-21unixbench_singl12:01:301
324681993325,5cyclictest1-21systemd08:05:011
324680993327,4cyclictest398619-21ssh10:11:200
324680993327,3cyclictest363798-21grep09:15:010
324680993325,5cyclictest350209-21cron08:35:010
324680993321,9cyclictest0-21swapper/008:30:010
324680993321,8cyclictest1-21systemd12:21:060
324680993321,8cyclictest1-21systemd12:21:060
32468299323,23cyclictest328536-21sshd07:21:142
324682993226,3cyclictest0-21swapper/211:51:132
324682993224,5cyclictest439875-21idleruntime-cro11:20:012
324682993223,6cyclictest1001-21mta-sts-daemon09:10:532
324682993221,7cyclictest420-21avahi-daemon11:10:372
324682993221,6cyclictest341rcuc/208:01:202
32468199324,24cyclictest357105-21sshd08:56:161
32468199323,23cyclictest459467-21rm11:51:201
324681993227,2cyclictest0-21swapper/107:40:011
324681993226,3cyclictest0-21swapper/111:01:071
324681993225,4cyclictest412685-21latency_hist10:35:031
324681993225,3cyclictest0-21swapper/112:26:181
324681993225,3cyclictest0-21swapper/112:26:181
324680993225,5cyclictest345754-21kworker/u8:12+xprtiod09:01:110
324680993225,4cyclictest0-21swapper/007:20:020
324680993224,5cyclictest420-21avahi-daemon07:45:010
324680993223,7cyclictest335989-21needreboot07:46:130
324682993124,4cyclictest1002-21mta-sts-daemon11:48:192
324681993126,2cyclictest0-21swapper/109:51:151
324681993126,2cyclictest0-21swapper/109:51:151
324681993125,3cyclictest0-21swapper/111:20:021
324681993124,3cyclictest0-21swapper/111:41:171
324681993123,5cyclictest420-21avahi-daemon09:43:451
324681993123,5cyclictest420-21avahi-daemon09:43:451
324681993123,5cyclictest1002-21mta-sts-daemon11:47:051
324681993121,8cyclictest365026-21ntp_kernel_err09:16:151
32468099313,22cyclictest447205-21ssh11:31:180
324680993124,4cyclictest0-21swapper/011:36:140
324680993114,14cyclictest151ktimers/007:51:180
32468099311,22cyclictest395575-21ssh10:06:150
324682993023,4cyclictest393100-21tail10:01:292
324682993023,4cyclictest335706-21fschecks_time07:46:082
324682993023,3cyclictest0-21swapper/211:01:072
324682993022,5cyclictest422764-21needreboot10:51:132
324682993022,5cyclictest347251-21systemd-run08:25:022
324682993022,5cyclictest329707-21fschecks_count07:26:092
324682993022,4cyclictest0-21swapper/208:51:162
324681993024,3cyclictest0-21swapper/111:25:011
324681993023,4cyclictest0-21swapper/107:25:011
324681993022,5cyclictest367728-21fschecks_count09:21:091
324681993022,5cyclictest354744-21systemd-run08:50:011
324681993022,5cyclictest345762-21systemd-run08:20:021
324681993021,5cyclictest3734659-21cups-browsed09:14:451
324681993018,8cyclictest3734659-21cups-browsed08:41:221
32468199301,23cyclictest349609-21sshd08:31:141
324680993024,3cyclictest0-21swapper/009:41:250
324680993024,3cyclictest0-21swapper/009:41:250
324680993022,4cyclictest0-21swapper/012:06:270
324680993022,3cyclictest0-21swapper/010:36:070
324680993021,7cyclictest465403-21needreboot12:01:160
324680993016,11cyclictest0-21swapper/012:11:150
324682992922,4cyclictest1001-21mta-sts-daemon08:41:192
324682992922,4cyclictest0-21swapper/207:16:142
324682992920,5cyclictest348729-21idleruntime-cro08:30:012
324681992923,3cyclictest0-21swapper/108:40:011
324681992922,4cyclictest339444-21timerwakeupswit07:56:251
324681992921,5cyclictest348747-21systemd-run08:30:021
324681992921,4cyclictest0-21swapper/112:21:231
324681992921,4cyclictest0-21swapper/112:21:231
32468099295,16cyclictest428-21mta-sts-daemon11:01:200
324680992922,4cyclictest431620-21gltestperf11:06:080
32468299288,16cyclictest3734659-21cups-browsed10:08:012
324682992822,3cyclictest0-21swapper/208:40:012
324682992821,4cyclictest347250-21kworker/u8:14-events_unbound08:30:212
324682992821,4cyclictest1002-21mta-sts-daemon09:20:422
324682992816,6cyclictest452585-21/usr/sbin/munin11:41:112
324681992821,3cyclictest0-21swapper/112:06:271
324681992819,6cyclictest0-21swapper/109:31:131
32468099288,15cyclictest371181-21sh09:26:170
324680992823,3cyclictest424633-21munin-run10:55:010
32468099282,22cyclictest386454-21ssh09:51:140
32468099282,22cyclictest386454-21ssh09:51:140
324680992821,5cyclictest3734659-21cups-browsed08:01:080
32468099281,3cyclictest0-21swapper/011:56:180
324680992810,7cyclictest421-21dbus-daemon08:20:020
324682992720,4cyclictest359224-21cron09:05:012
324682992719,5cyclictest356553-21aten_r2power_fr08:56:062
324681992719,5cyclictest335173-21cron07:45:011
324681992719,4cyclictest1000-21mta-sts-daemon07:16:161
32468099272,6cyclictest171rcu_preempt10:26:260
324680992722,2cyclictest0-21swapper/007:40:010
324680992714,3cyclictest0-21swapper/008:46:070
32468299262,18cyclictest343587-21ntpq08:11:142
324681992621,2cyclictest0-21swapper/111:35:011
324681992619,4cyclictest414287-21unixbench-2d10:36:281
324680992622,2cyclictest211irq_work/008:21:160
324680992621,2cyclictest0-21swapper/008:51:140
324680992614,4cyclictest0-21swapper/008:00:010
32468199256,13cyclictest428-21mta-sts-daemon07:11:201
324681992520,2cyclictest0-21swapper/108:55:011
324681992519,3cyclictest0-21swapper/110:11:201
324680992520,3cyclictest0-21swapper/007:10:010
324680992516,6cyclictest0-21swapper/007:24:140
324680992515,7cyclictest357717-21grep09:00:010
324682992415,5cyclictest332159-21cron07:35:012
324681992419,2cyclictest0-21swapper/107:35:011
324681992418,2cyclictest0-21swapper/107:46:081
324681992416,5cyclictest358265-21fschecks_time09:01:061
324681992313,7cyclictest337727-21ps07:51:221
32468099232,12cyclictest151ktimers/007:31:130
324680992318,3cyclictest1003-21mta-sts-daemon08:12:260
324682992215,4cyclictest353584-21aten_r2power_po08:46:072
324681992217,2cyclictest0-21swapper/107:10:031
324680992217,3cyclictest325005-21aten_r2power_fr07:11:040
32468099221,15cyclictest351142-21ntpq08:36:170
324680992115,5cyclictest324679-21cyclictest08:40:520
32468399193,10cyclictest0-21swapper/309:41:143
32468399193,10cyclictest0-21swapper/309:41:143
324682991911,5cyclictest439-21systemd-logind07:10:022
32468399183,8cyclictest0-21swapper/309:16:213
32468399173,9cyclictest0-21swapper/310:16:203
32468399172,9cyclictest0-21swapper/312:36:173
32468399172,9cyclictest0-21swapper/311:26:223
32468399172,9cyclictest0-21swapper/310:36:193
32468399172,9cyclictest0-21swapper/309:26:193
32468399172,8cyclictest0-21swapper/312:07:143
32468399172,5cyclictest0-21swapper/307:56:143
32468399171,8cyclictest0-21swapper/308:11:173
32468399164,7cyclictest0-21swapper/310:51:063
32468399163,8cyclictest0-21swapper/312:31:143
32468399162,9cyclictest0-21swapper/309:07:033
32468399162,8cyclictest0-21swapper/311:41:183
32468399162,8cyclictest0-21swapper/311:36:153
32468399162,8cyclictest0-21swapper/311:16:153
32468399162,8cyclictest0-21swapper/310:56:153
32468399162,8cyclictest0-21swapper/310:01:153
32468399162,8cyclictest0-21swapper/309:51:133
32468399162,8cyclictest0-21swapper/309:51:133
32468399161,8cyclictest0-21swapper/312:16:203
32468399161,8cyclictest0-21swapper/312:16:203
32468399153,8cyclictest0-21swapper/311:31:213
32468399153,7cyclictest0-21swapper/309:21:203
32468399152,8cyclictest0-21swapper/312:01:323
32468399152,7cyclictest0-21swapper/312:11:183
32468399152,7cyclictest0-21swapper/311:46:153
32468399152,7cyclictest0-21swapper/308:35:013
32468399151,7cyclictest0-21swapper/308:36:173
32468399151,7cyclictest0-21swapper/307:31:123
32468399144,6cyclictest0-21swapper/309:36:173
32468399143,7cyclictest0-21swapper/311:56:223
32468399143,6cyclictest0-21swapper/311:01:143
32468399143,6cyclictest0-21swapper/309:56:163
32468399142,8cyclictest0-21swapper/310:41:223
32468399142,7cyclictest0-21swapper/311:06:173
32468399142,5cyclictest0-21swapper/309:01:123
32468399141,8cyclictest0-21swapper/312:26:143
32468399141,8cyclictest0-21swapper/312:26:143
32468399141,8cyclictest0-21swapper/310:21:143
32468399141,8cyclictest0-21swapper/309:11:123
32468399141,7cyclictest0-21swapper/308:46:203
32468399141,6cyclictest0-21swapper/307:46:143
32468399140,7cyclictest0-21swapper/310:46:053
32468399134,6cyclictest0-21swapper/312:21:223
32468399134,6cyclictest0-21swapper/312:21:223
32468399132,7cyclictest0-21swapper/310:31:053
32468399132,7cyclictest0-21swapper/310:26:123
32468399132,6cyclictest0-21swapper/310:06:033
32468399132,6cyclictest0-21swapper/307:36:213
32468399131,9cyclictest0-21swapper/311:25:023
32468399131,7cyclictest0-21swapper/308:16:073
32468399131,6cyclictest0-21swapper/307:41:133
32468399122,7cyclictest0-21swapper/311:51:223
32468399122,7cyclictest0-21swapper/311:11:163
32468399122,7cyclictest0-21swapper/309:46:033
32468399122,7cyclictest0-21swapper/309:46:033
32468399122,6cyclictest0-21swapper/309:31:113
32468399122,6cyclictest0-21swapper/308:26:103
32468399122,5cyclictest0-21swapper/308:21:083
32468399121,7cyclictest0-21swapper/307:21:153
32468399121,6cyclictest0-21swapper/308:01:123
32468399114,4cyclictest0-21swapper/308:06:153
32468399114,4cyclictest0-21swapper/308:06:153
32468399113,6cyclictest0-21swapper/310:11:073
32468399111,7cyclictest0-21swapper/307:16:183
32468399111,6cyclictest0-21swapper/308:56:153
32468399111,6cyclictest0-21swapper/308:51:153
32468399111,6cyclictest0-21swapper/308:41:153
32468399111,6cyclictest0-21swapper/307:26:093
32468399111,5cyclictest0-21swapper/307:51:063
32468399111,5cyclictest0-21swapper/307:11:073
32468399101,6cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional