You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 09:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Sep 22, 2026 00:42:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
778320995548,4cyclictest878593-21kworker/u8:3-rpciod23:41:140
778321995344,7cyclictest917986-21kworker/u8:15-xprtiod00:34:041
778321995344,7cyclictest917986-21kworker/u8:15-xprtiod00:34:041
778321995242,6cyclictest869264-21idleruntime-cro22:40:011
778321995242,6cyclictest869264-21idleruntime-cro22:40:011
778320995143,6cyclictest936274-21kworker/u8:6+nfsiod00:34:070
778320995143,6cyclictest936274-21kworker/u8:6+nfsiod00:34:070
778321995040,6cyclictest567-21gdbus23:11:051
778321995040,6cyclictest567-21gdbus23:11:051
778320995041,5cyclictest0-21swapper/021:36:180
778322994739,5cyclictest891175-21aten_r2power_en23:16:062
778321994737,6cyclictest796325-21systemd-run20:10:011
778320994738,6cyclictest1-21systemd21:50:020
778320994637,5cyclictest793333-21systemd-run20:00:010
778321994537,5cyclictest794836-21systemd-run20:05:011
778320994437,4cyclictest803814-21systemd-run20:35:010
778320994437,4cyclictest803814-21systemd-run20:35:010
778322994335,5cyclictest803801-21munin-plugin-st20:35:002
778322994335,5cyclictest803801-21munin-plugin-st20:35:002
77832199433,31cyclictest843237-21ssh21:56:211
778320994324,16cyclictest0-21swapper/023:30:020
77832099431,38cyclictest779279-21sshd19:11:210
77832099431,38cyclictest779279-21sshd19:11:210
778322994234,5cyclictest844909-21ssh22:00:012
778322994232,7cyclictest1-21systemd23:35:022
778321994233,6cyclictest1-21systemd20:30:011
778320994232,4cyclictest806817-21idleruntime-cro20:45:000
778321994131,7cyclictest788827-21sh19:45:011
778320994128,10cyclictest858479-21ntpq22:21:230
77832099412,24cyclictest861422-21ssh22:26:180
778322994032,5cyclictest922192-21needreboot00:06:132
77832099408,23cyclictest840143-21sh21:51:170
778320994029,5cyclictest0-21swapper/022:01:180
778320994029,5cyclictest0-21swapper/022:01:180
778320994025,6cyclictest420-21avahi-daemon21:33:550
77832299393,26cyclictest834029-21ssh21:41:172
778321993931,5cyclictest823502-21cron21:25:001
778321993931,5cyclictest809800-21grep20:55:011
778321993924,12cyclictest934457-21sh00:26:171
77832099399,22cyclictest931381-21ssh00:21:150
778320993932,4cyclictest851027-21systemd-run22:10:010
778320993930,6cyclictest919887-21vmstat00:01:300
778322993831,4cyclictest814305-21diskmemload23:11:102
778322993831,4cyclictest814305-21diskmemload23:11:102
77832299382,28cyclictest928511-21ssh00:16:242
778321993832,3cyclictest0-21swapper/100:00:011
778321993832,3cyclictest0-21swapper/100:00:011
778321993830,5cyclictest910217-21ps23:46:221
77832099383,30cyclictest811300-21idleruntime-cro21:00:010
778320993830,4cyclictest0-21swapper/020:01:220
778320993826,9cyclictest567-21gdbus22:46:150
77832099382,29cyclictest824843-21ssh21:26:180
778320993817,14cyclictest151ktimers/020:51:210
778320993816,15cyclictest0-21swapper/022:31:210
778322993729,5cyclictest878383-21systemd-run22:55:022
778321993729,5cyclictest933191-21cron00:25:011
77832099374,26cyclictest885784-21ssh23:06:200
77832099374,26cyclictest885784-21ssh23:06:200
778320993722,10cyclictest3242255-21cups-browsed23:54:280
778322993628,6cyclictest782834-21true19:25:012
778322993628,5cyclictest863173-21grep22:30:012
778322993628,5cyclictest811281-21cron21:00:012
778322993624,6cyclictest0-21swapper/222:56:202
778321993629,3cyclictest0-21swapper/121:15:021
778321993627,6cyclictest918591-21aten_r2power_en00:01:071
778321993627,5cyclictest1000-21mta-sts-daemon22:06:161
778321993626,7cyclictest879506-21missed_timers22:56:131
77832199362,30cyclictest907062-21ssh23:41:191
778320993630,3cyclictest0-21swapper/022:56:100
778320993629,4cyclictest1000-21mta-sts-daemon22:11:190
778320993629,4cyclictest1000-21mta-sts-daemon22:11:190
778320993628,5cyclictest832753-21kworker/u8:16+xprtiod22:00:010
778320993628,4cyclictest0-21swapper/023:56:170
778320993628,4cyclictest0-21swapper/023:56:170
778320993627,6cyclictest0-21swapper/021:06:180
778320993622,11cyclictest12650irq/32-eth023:01:210
778320993621,10cyclictest870508-21rm22:41:150
778322993524,7cyclictest927268-21latency_hist00:15:022
778321993528,4cyclictest857093-21idleruntime-cro22:20:001
778321993528,4cyclictest847976-21cron22:05:001
778321993528,4cyclictest847976-21cron22:05:001
778321993527,5cyclictest1002-21mta-sts-daemon22:29:401
778321993526,6cyclictest1002-21mta-sts-daemon23:06:111
778321993526,6cyclictest1002-21mta-sts-daemon23:06:111
77832099355,21cyclictest428-21mta-sts-daemon20:26:250
778320993526,5cyclictest0-21swapper/023:40:010
778320993526,5cyclictest0-21swapper/023:40:010
778320993526,4cyclictest0-21swapper/023:46:220
778320993518,13cyclictest0-21swapper/023:11:280
778320993518,13cyclictest0-21swapper/023:11:280
778322993429,2cyclictest0-21swapper/222:25:012
778322993429,2cyclictest0-21swapper/220:20:012
778322993429,2cyclictest0-21swapper/220:01:222
778322993428,3cyclictest0-21swapper/222:15:002
778322993428,3cyclictest0-21swapper/222:15:002
778322993428,3cyclictest0-21swapper/200:36:132
778322993426,5cyclictest894962-21/usr/sbin/munin23:21:232
778322993425,5cyclictest823501-21cron21:25:002
77832199345,18cyclictest428-21mta-sts-daemon22:41:221
778321993427,4cyclictest1000-21mta-sts-daemon19:16:161
778321993427,4cyclictest1000-21mta-sts-daemon19:16:161
778321993426,5cyclictest922876-21unixbench_singl00:06:281
778321993425,6cyclictest1-21systemd21:20:021
778321993425,6cyclictest1-21systemd21:20:021
778320993426,5cyclictest869431-21latency_hist22:40:030
778320993426,5cyclictest869431-21latency_hist22:40:030
778320993425,6cyclictest420-21avahi-daemon00:10:040
778320993425,6cyclictest3242255-21cups-browsed21:19:360
778320993425,6cyclictest3242255-21cups-browsed21:19:360
778320993425,4cyclictest0-21swapper/000:09:220
778320993423,7cyclictest835781-21munin-plugin-st21:45:010
77832099342,26cyclictest891889-21ssh23:16:200
77832099342,25cyclictest900920-21ssh23:31:170
778320993417,9cyclictest12650irq/32-eth021:21:190
778322993327,3cyclictest0-21swapper/221:31:222
778322993325,5cyclictest849639-21timerandwakeup22:06:292
778322993325,5cyclictest838828-21munin-plugin-st21:50:012
778322993325,4cyclictest0-21swapper/223:41:152
77832299332,23cyclictest855292-21ssh22:16:162
77832299332,22cyclictest913135-21ssh23:51:192
778321993326,4cyclictest828197-21switchtime21:31:311
778321993326,3cyclictest0-21swapper/119:10:011
778321993326,3cyclictest0-21swapper/119:10:011
778321993325,5cyclictest894318-21aten_r2power_po23:21:081
778321993324,5cyclictest0-21swapper/123:26:261
77832099334,24cyclictest876589-21ssh22:51:160
778320993325,4cyclictest0-21swapper/000:26:290
778320993324,6cyclictest797801-21cut20:15:020
778320993324,6cyclictest3242255-21cups-browsed21:11:320
77832099332,22cyclictest940699-21ssh00:36:230
778322993226,4cyclictest1001-21mta-sts-daemon21:11:522
778322993226,3cyclictest0-21swapper/220:55:012
778322993225,5cyclictest0-21swapper/223:56:232
778322993225,5cyclictest0-21swapper/223:56:232
778322993224,6cyclictest882548-21missed_timers23:01:112
778322993224,5cyclictest567-21gdbus19:41:222
778322993223,6cyclictest3242255-21cups-browsed21:26:452
778322993223,5cyclictest832708-21cron21:40:002
778321993224,5cyclictest882286-21fschecks_count23:01:071
778321993223,5cyclictest903303-21aten_r2power_cu23:36:041
778321993223,5cyclictest903303-21aten_r2power_cu23:36:041
778321993223,5cyclictest1003-21mta-sts-daemon00:20:011
778321993222,7cyclictest808319-21systemd-run20:50:011
778321993222,6cyclictest0-21swapper/120:40:001
778320993219,10cyclictest750-21ntpd22:16:060
778322993125,3cyclictest0-21swapper/222:01:102
778322993125,3cyclictest0-21swapper/222:01:102
778322993125,3cyclictest0-21swapper/200:05:012
778322993123,5cyclictest787338-21systemd-run19:40:022
778322993122,6cyclictest1002-21mta-sts-daemon00:26:212
778322993121,7cyclictest421-21dbus-daemon23:30:012
778321993125,3cyclictest0-21swapper/122:55:011
778321993124,4cyclictest838815-21cron21:50:011
778321993124,3cyclictest814324-21kworker/u8:2-nfsiod22:21:061
778321993123,5cyclictest811291-21munin-run21:00:011
778321993122,5cyclictest799339-21systemd-run20:20:011
77832199312,22cyclictest891958-21ssh23:16:231
778321993119,9cyclictest941068-21timerwakeupswit00:36:281
778321993119,4cyclictest0-21swapper/121:39:241
778320993125,4cyclictest786263-21cpuspeed19:36:080
778320993124,5cyclictest0-21swapper/021:05:010
778320993120,8cyclictest800802-21cron20:25:010
778320993119,4cyclictest782805-21cron19:25:000
77832299306,12cyclictest1002-21mta-sts-daemon19:46:162
77832299303,22cyclictest931525-21ssh00:21:212
778322993023,4cyclictest1001-21mta-sts-daemon21:51:052
778322993022,5cyclictest885774-21ntp_kernel_pll_23:06:202
778322993022,5cyclictest885774-21ntp_kernel_pll_23:06:202
778322993022,5cyclictest421-21dbus-daemon19:10:012
778322993022,5cyclictest421-21dbus-daemon19:10:012
778322993019,8cyclictest818572-21needreboot21:16:162
778322993019,8cyclictest818572-21needreboot21:16:162
77832299301,8cyclictest903961-21ntpq23:36:182
77832299301,8cyclictest903961-21ntpq23:36:182
778322993015,7cyclictest1001-21mta-sts-daemon23:46:152
778321993025,2cyclictest0-21swapper/122:50:011
778321993024,2cyclictest0-21swapper/120:00:011
778321993023,3cyclictest0-21swapper/119:21:121
778321993022,5cyclictest854033-21cron22:15:001
778321993022,5cyclictest854033-21cron22:15:001
77832099304,17cyclictest428-21mta-sts-daemon20:46:180
77832099304,15cyclictest151ktimers/023:21:240
778320993024,3cyclictest0-21swapper/000:20:020
778320993013,14cyclictest780448-21kernelversion19:16:100
778320993013,14cyclictest780448-21kernelversion19:16:100
77832099301,23cyclictest151ktimers/020:06:160
778322992923,3cyclictest0-21swapper/222:41:172
778322992922,4cyclictest936274-21kworker/u8:6-rpciod00:34:062
778322992922,4cyclictest936274-21kworker/u8:6-rpciod00:34:062
778322992922,4cyclictest795838-21proc_pri20:06:242
77832299292,21cyclictest864456-21ssh22:31:192
778322992921,5cyclictest800813-21idleruntime-cro20:25:012
778321992923,3cyclictest0-21swapper/120:11:051
778321992921,5cyclictest840567-21timerwakeupswit21:51:261
77832099292,5cyclictest171rcu_preempt19:26:210
778322992822,3cyclictest0-21swapper/220:50:002
778322992821,4cyclictest873535-21collect222:46:182
778322992821,4cyclictest812818-21grep21:05:012
778322992821,4cyclictest1000-21mta-sts-daemon19:52:002
778322992820,5cyclictest792864-21/usr/sbin/munin19:56:202
778322992820,5cyclictest778840-21fschecks_time19:11:102
778322992820,5cyclictest778840-21fschecks_time19:11:102
77832199282,19cyclictest265-21systemd-journal20:21:221
778321992821,4cyclictest865028-21unixbench_multi22:31:311
778321992821,4cyclictest1003-21mta-sts-daemon21:25:331
778321992821,4cyclictest1002-21mta-sts-daemon00:14:201
77832099282,18cyclictest798722-21modprobe20:16:210
778320992813,9cyclictest151ktimers/020:36:160
77832299276,14cyclictest428-21mta-sts-daemon19:31:232
778322992721,3cyclictest0-21swapper/219:20:002
778322992721,3cyclictest0-21swapper/219:20:002
778322992720,4cyclictest1001-21mta-sts-daemon20:41:172
77832199277,16cyclictest421-21dbus-daemon23:33:521
778321992719,5cyclictest787504-21latency_hist19:40:031
778320992722,3cyclictest0-21swapper/019:46:190
778320992720,4cyclictest788744-21head19:41:270
778322992621,2cyclictest0-21swapper/222:36:152
778322992621,2cyclictest0-21swapper/222:36:152
778322992620,3cyclictest0-21swapper/220:26:222
778322992619,3cyclictest0-21swapper/220:36:212
778322992618,5cyclictest814308-21munin-plugin-st21:10:012
778321992619,4cyclictest0-21swapper/119:35:011
778321992618,4cyclictest811846-21fschecks_time21:01:101
778321992618,4cyclictest0-21swapper/119:11:211
778321992618,4cyclictest0-21swapper/119:11:211
778321992617,4cyclictest0-21swapper/121:41:171
77832299258,5cyclictest62750lldpd20:12:302
778322992517,5cyclictest784171-21unixbench-2d19:26:272
778321992519,3cyclictest0-21swapper/119:55:011
778320992516,5cyclictest785799-21idleruntime-cro19:35:010
778321992418,3cyclictest0-21swapper/119:26:091
778321992417,5cyclictest778319-21cyclictest20:41:111
778321992417,4cyclictest1003-21mta-sts-daemon20:32:551
778321992417,4cyclictest1003-21mta-sts-daemon20:32:551
778321992415,6cyclictest789755-21ntpq19:46:171
778320992413,8cyclictest0-21swapper/019:51:040
778321992318,2cyclictest0-21swapper/123:55:011
778320992316,3cyclictest0-21swapper/019:10:010
778320992316,3cyclictest0-21swapper/019:10:010
77832199211,15cyclictest813863-21ps21:06:211
77832399161,7cyclictest0-21swapper/322:01:173
77832399161,7cyclictest0-21swapper/322:01:173
77832399161,6cyclictest0-21swapper/319:21:173
77832399152,7cyclictest0-21swapper/321:41:163
77832399152,7cyclictest0-21swapper/300:36:203
77832399151,7cyclictest0-21swapper/323:51:203
77832399151,7cyclictest0-21swapper/320:31:203
77832399151,7cyclictest0-21swapper/320:31:203
77832399151,7cyclictest0-21swapper/300:06:163
77832399151,3cyclictest0-21swapper/319:16:143
77832399151,3cyclictest0-21swapper/319:16:143
77832399142,6cyclictest0-21swapper/323:56:113
77832399142,6cyclictest0-21swapper/323:56:113
77832399142,5cyclictest0-21swapper/323:26:203
77832399141,7cyclictest0-21swapper/323:21:203
77832399141,7cyclictest0-21swapper/323:01:213
77832399141,7cyclictest0-21swapper/322:41:223
77832399141,7cyclictest0-21swapper/300:34:043
77832399141,7cyclictest0-21swapper/300:34:043
77832399141,6cyclictest0-21swapper/322:56:223
77832399141,6cyclictest0-21swapper/322:36:153
77832399141,6cyclictest0-21swapper/322:36:153
77832399141,6cyclictest0-21swapper/320:11:183
77832399141,6cyclictest0-21swapper/320:01:223
77832399141,5cyclictest0-21swapper/319:31:193
77832399132,4cyclictest0-21swapper/321:06:133
77832399131,7cyclictest0-21swapper/322:16:193
77832399131,7cyclictest0-21swapper/321:56:073
77832399131,6cyclictest0-21swapper/323:31:163
77832399131,6cyclictest0-21swapper/323:06:173
77832399131,6cyclictest0-21swapper/323:06:173
77832399131,6cyclictest0-21swapper/322:46:123
77832399131,6cyclictest0-21swapper/321:11:203
77832399131,6cyclictest0-21swapper/320:41:183
77832399131,6cyclictest0-21swapper/319:11:233
77832399131,6cyclictest0-21swapper/319:11:233
77832399131,5cyclictest0-21swapper/320:56:173
77832399131,5cyclictest0-21swapper/319:26:193
77832399125,5cyclictest0-21swapper/321:16:183
77832399125,5cyclictest0-21swapper/321:16:183
77832399122,6cyclictest0-21swapper/322:11:093
77832399122,6cyclictest0-21swapper/322:11:093
77832399121,7cyclictest0-21swapper/323:46:223
77832399121,7cyclictest0-21swapper/300:21:073
77832399121,6cyclictest0-21swapper/322:51:303
77832399121,6cyclictest0-21swapper/322:26:103
77832399121,6cyclictest0-21swapper/322:06:063
77832399121,6cyclictest0-21swapper/321:46:123
77832399121,6cyclictest0-21swapper/321:31:103
77832399121,6cyclictest0-21swapper/320:36:213
77832399121,5cyclictest0-21swapper/320:46:163
77832399120,5cyclictest0-21swapper/319:46:133
77832399112,7cyclictest0-21swapper/321:26:043
77832399112,6cyclictest0-21swapper/319:36:163
77832399112,5cyclictest0-21swapper/300:11:193
77832399111,6cyclictest0-21swapper/323:36:043
77832399111,6cyclictest0-21swapper/323:36:043
77832399111,6cyclictest0-21swapper/323:16:223
77832399111,6cyclictest0-21swapper/321:51:083
77832399111,6cyclictest0-21swapper/321:36:183
77832399111,6cyclictest0-21swapper/321:21:173
77832399111,6cyclictest0-21swapper/320:25:013
77832399111,6cyclictest0-21swapper/320:16:213
77832399111,6cyclictest0-21swapper/300:26:063
77832399111,5cyclictest0-21swapper/321:01:163
77832399102,6cyclictest0-21swapper/300:05:023
77832399102,5cyclictest0-21swapper/319:56:073
77832399101,6cyclictest0-21swapper/323:11:103
77832399101,6cyclictest0-21swapper/323:11:103
77832399101,6cyclictest0-21swapper/322:31:193
77832399101,6cyclictest0-21swapper/300:16:103
77832399101,5cyclictest0-21swapper/323:41:053
77832399101,5cyclictest0-21swapper/320:55:013
77832399101,5cyclictest0-21swapper/320:06:203
77832399101,5cyclictest0-21swapper/319:41:143
7783239993,4cyclictest0-21swapper/322:21:173
7783239993,4cyclictest0-21swapper/319:51:123
7783239991,5cyclictest0-21swapper/320:26:213
7783239981,4cyclictest0-21swapper/319:10:023
7783239971,4cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional