You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 03:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Mon Dec 01, 2025 00:39:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3662301995039,8cyclictest1780552-21cups-browsed22:59:221
3662302994840,5cyclictest3689269-21sh20:40:012
3662302994840,5cyclictest3689269-21sh20:40:012
3662302994738,5cyclictest1-21systemd00:15:012
3662302994638,5cyclictest3766422-21munin-plugin-st22:40:012
3662302994538,4cyclictest3796863-21grep23:20:012
3662300994538,4cyclictest3784044-21cpuspeed23:04:090
3662302994338,2cyclictest0-21swapper/223:34:172
3662301994335,5cyclictest3686301-21systemd-run20:30:021
3662302994234,5cyclictest491-21gdbus23:00:012
3662301994234,5cyclictest3793031-21debian-sa123:15:011
3662301994232,5cyclictest0-21swapper/121:39:171
3662302994133,5cyclictest3717114-21unixbench_singl21:34:302
3662302994133,5cyclictest3668314-21systemd-run19:30:012
3662302994133,5cyclictest3668314-21systemd-run19:30:012
3662302994031,6cyclictest422-21dbus-daemon22:04:102
3662301994033,4cyclictest3837336-21sh00:15:011
3662301994032,5cyclictest3680296-21idleruntime-cro20:10:011
3662300994032,5cyclictest1-21systemd23:20:010
3662302993930,6cyclictest1780552-21cups-browsed21:19:562
3662302993929,7cyclictest3727106-21aten2.4-expect21:49:072
366230199396,28cyclictest3735258-21ssh21:59:221
366230199396,28cyclictest3735258-21ssh21:59:221
3662301993930,5cyclictest0-21swapper/120:20:011
3662301993930,5cyclictest0-21swapper/120:20:011
3662301993930,3cyclictest0-21swapper/122:04:211
3662300993931,5cyclictest1780552-21cups-browsed23:59:110
3662302993833,2cyclictest0-21swapper/200:29:172
3662302993831,3cyclictest0-21swapper/221:24:152
3662302993830,5cyclictest3777802-21unin-run22:55:012
3662302993830,5cyclictest3758337-21timerandwakeup22:29:292
3662302993830,5cyclictest3713638-21ssh21:30:022
3662302993829,6cyclictest3662305-21systemd-run19:10:012
3662301993830,5cyclictest3765963-21timerandwakeup22:39:351
3662301993827,6cyclictest0-21swapper/122:44:211
3662300993833,2cyclictest0-21swapper/019:55:020
3662300993831,3cyclictest0-21swapper/000:19:140
3662300993830,5cyclictest474-21in:imuxsock21:10:010
3662302993729,5cyclictest3698280-21diskmemload23:40:022
3662302993729,5cyclictest3695262-21sendmail21:00:012
3662302993729,5cyclictest3683288-21awk20:20:012
3662302993729,5cyclictest3683288-21awk20:20:012
3662301993732,2cyclictest0-21swapper/121:00:011
3662301993731,3cyclictest0-21swapper/120:40:011
3662301993731,3cyclictest0-21swapper/120:40:011
3662301993728,6cyclictest1-21systemd21:10:021
3662301993727,5cyclictest0-21swapper/122:14:111
3662300993730,5cyclictest3804002-21timerwakeupswit23:29:290
3662300993730,4cyclictest3766428-21systemctl22:40:010
3662300993722,3cyclictest0-21swapper/023:00:010
3662302993629,4cyclictest3770294-21latency_hist22:45:022
3662301993628,4cyclictest0-21swapper/100:04:171
3662300993631,2cyclictest0-21swapper/023:55:020
3662300993630,4cyclictest3755012-21sh22:25:010
3662300993626,8cyclictest3666872-21latency_hist19:25:020
3662300993626,7cyclictest3704600-21aten_r2power_vo21:19:090
3662300993626,7cyclictest0-21swapper/022:05:010
3662302993529,3cyclictest0-21swapper/200:04:232
3662302993527,5cyclictest421-21avahi-daemon00:33:262
3662302993527,4cyclictest0-21swapper/219:35:012
3662302993523,9cyclictest422-21dbus-daemon00:23:312
3662301993529,3cyclictest0-21swapper/100:39:221
3662301993528,4cyclictest3826971-21unixbench_singl23:59:291
3662301993528,4cyclictest3672881-21latency_hist19:45:021
3662301993528,3cyclictest0-21swapper/122:09:211
3662301993527,5cyclictest959-21mta-sts-daemon22:34:171
3662301993527,5cyclictest3687772-21cron20:35:011
3662301993524,8cyclictest3840464-21mailstats00:19:241
3662300993515,17cyclictest1780552-21cups-browsed22:49:290
3662302993428,3cyclictest0-21swapper/222:34:232
3662302993426,5cyclictest3815862-21idleruntime-cro23:45:012
3662302993426,5cyclictest3702020-21/usr/sbin/munin21:14:302
3662302993426,5cyclictest1780552-21cups-browsed20:24:092
3662302993424,7cyclictest3827309-40invoke-rc.d00:00:022
3662302993422,9cyclictest3772741-21sh22:49:162
3662301993426,5cyclictest3772483-21aten_r2power_fr22:49:081
3662301993424,5cyclictest0-21swapper/123:39:181
3662300993428,4cyclictest422-21dbus-daemon23:40:020
3662300993428,3cyclictest0-21swapper/020:20:010
3662300993428,3cyclictest0-21swapper/020:20:010
3662300993428,3cyclictest0-21swapper/019:19:180
3662300993426,5cyclictest421-21avahi-daemon20:44:190
3662300993426,5cyclictest1780552-21cups-browsed21:50:020
3662300993425,6cyclictest1780552-21cups-browsed21:11:190
3662302993327,3cyclictest0-21swapper/222:20:012
3662302993326,3cyclictest0-21swapper/223:49:182
3662302993326,3cyclictest0-21swapper/222:00:012
3662302993326,3cyclictest0-21swapper/222:00:012
3662302993324,6cyclictest3678787-21cron20:05:012
3662302993324,5cyclictest266-21systemd-journal22:10:012
3662302993322,8cyclictest3745731-21/usr/sbin/munin22:14:102
366230199333,23cyclictest3784625-21ssh23:04:221
3662301993326,4cyclictest3807939-21unixbench_singl23:34:291
3662301993326,4cyclictest3727629-21needreboot21:49:151
3662301993325,5cyclictest3683836-21fschecks_count20:24:111
3662301993324,6cyclictest3815889-21latency_hist23:45:021
3662301993324,5cyclictest3705819-21unixbench_singl21:19:311
3662300993327,4cyclictest3762285-21unixbench-2d22:34:310
3662300993327,4cyclictest3678190-21ntp_kernel_pll_20:04:200
3662300993325,5cyclictest0-21swapper/023:15:010
3662300993324,6cyclictest12450irq/32-eth023:24:160
3662300993316,13cyclictest3672235-21ntpq19:44:200
3662302993226,3cyclictest0-21swapper/223:54:132
3662302993226,3cyclictest0-21swapper/220:35:012
3662302993225,4cyclictest3800673-21cron23:25:012
3662302993225,3cyclictest0-21swapper/223:04:212
3662301993224,5cyclictest955-21mta-sts-daemon22:26:001
3662301993224,5cyclictest3844473-21timerwakeupswit00:24:271
3662301993224,5cyclictest3799136-21aten_r2power_fr23:24:071
3662301993223,6cyclictest3788320-21ssh23:09:181
3662301993221,7cyclictest3833792-21latency_hist00:10:031
366230199321,27cyclictest3701554-21ssh21:14:231
3662300993226,4cyclictest3680302-21systemd-run20:10:010
3662300993224,5cyclictest1780552-21cups-browsed22:28:440
3662300993224,5cyclictest0-21swapper/021:35:010
3662300993219,9cyclictest1690079-21ntpd21:29:170
3662302993125,3cyclictest0-21swapper/200:07:062
3662302993124,4cyclictest3774012-21kworker/u8:3-xprtiod23:09:322
3662302993123,5cyclictest3752249-21ssh22:21:462
3662302993123,5cyclictest3682013-21kworker/u8:0+xprtiod20:49:282
3662301993125,3cyclictest0-21swapper/121:34:301
3662301993125,3cyclictest0-21swapper/100:29:161
3662301993124,4cyclictest3754326-21mailstats22:24:241
3662301993124,3cyclictest0-21swapper/121:29:161
3662301993123,5cyclictest3850972-21latency00:34:171
3662301993123,5cyclictest3804421-21idleruntime-cro23:30:011
366230199311,24cyclictest3750258-21ssh22:19:201
366230199311,20cyclictest3795906-21ssh23:19:171
366230099315,22cyclictest3731594-21diskmemload21:54:240
3662300993125,3cyclictest0-21swapper/000:40:010
3662300993124,5cyclictest0-21swapper/000:10:020
3662300993124,4cyclictest3844928-21munin-plugin-st00:25:010
3662300993123,4cyclictest266-21systemd-journal00:14:170
3662300993121,7cyclictest3692810-21uniq20:54:130
3662300993114,5cyclictest171rcu_preempt19:59:160
3662300993112,15cyclictest3776994-21ssh22:54:250
3662302993024,4cyclictest955-21mta-sts-daemon21:44:122
3662302993024,3cyclictest0-21swapper/223:29:162
3662302993023,4cyclictest433-21polkitd23:15:002
3662302993022,5cyclictest3677309-21systemd-run20:00:012
3662302993022,5cyclictest3675510-21threads19:54:322
3662302993021,6cyclictest422-21dbus-daemon21:38:282
3662301993022,5cyclictest3692271-21cron20:50:011
366230199302,21cyclictest3731422-21ssh21:54:171
366230199302,21cyclictest3709047-21ssh21:24:221
3662300993025,3cyclictest3695396-21latency_hist21:00:020
3662300993023,4cyclictest3720844-21unixbench_singl21:39:300
3662300993023,4cyclictest12450irq/32-eth022:00:010
3662300993023,4cyclictest12450irq/32-eth022:00:010
3662300993022,5cyclictest453-21systemd-logind00:35:020
3662300993021,7cyclictest3848221-21timerwakeupswit00:29:290
3662300993020,8cyclictest3709468-21unixbench-2d21:24:290
3662300993019,8cyclictest0-21swapper/022:14:220
366230099301,5cyclictest171rcu_preempt23:49:180
366230299298,19cyclictest959-21mta-sts-daemon20:09:192
366230299293,7cyclictest3840239-21ntpq00:19:172
3662301992922,4cyclictest3724901-21cron21:45:011
3662301992921,5cyclictest3823097-21tail23:54:301
3662301992921,5cyclictest3668026-21threads19:29:261
3662301992921,5cyclictest3668026-21threads19:29:261
3662301992921,5cyclictest3662361-21latency_hist19:10:021
3662301992921,5cyclictest0-21swapper/123:49:071
366230099292,25cyclictest3807278-21rm23:34:160
3662300992922,5cyclictest12450irq/32-eth000:04:230
366230099292,23cyclictest3788365-21ssh23:09:200
366230099292,22cyclictest3750395-21ssh22:19:260
3662300992920,6cyclictest3740846-21kworker/u8:2+nfsiod22:09:230
3662300992918,8cyclictest422-21dbus-daemon20:24:090
3662300992918,4cyclictest3671221-21unixbench_singl19:39:290
3662302992820,5cyclictest3665850-21fschecks_time19:24:122
3662302992820,5cyclictest3665288-21cut19:20:012
3662302992819,3cyclictest0-21swapper/219:39:232
3662301992821,4cyclictest3678787-21cron20:05:011
3662300992821,4cyclictest422-21dbus-daemon21:05:010
3662300992820,5cyclictest3766467-21kworker/u8:9+nfsiod22:44:190
3662300992820,5cyclictest3692139-21unixbench-2d20:49:280
3662300992817,8cyclictest12450irq/32-eth023:44:220
366230299272,21cyclictest1780552-21cups-browsed20:44:192
3662302992721,3cyclictest3674528-21kworker/u8:1-nfsiod21:05:012
3662302992721,3cyclictest0-21swapper/220:54:152
3662302992719,5cyclictest3853923-21acpi00:39:082
3662302992719,4cyclictest0-21swapper/221:10:032
3662302992718,5cyclictest3731501-21sh21:54:202
3662301992722,2cyclictest0-21swapper/120:00:011
3662301992721,3cyclictest0-21swapper/122:54:321
3662301992720,4cyclictest3693686-21grep20:54:311
3662301992720,4cyclictest3664028-21kworker/u8:4-rpciod19:40:031
3662300992721,3cyclictest0-21swapper/020:39:120
3662300992721,3cyclictest0-21swapper/020:39:120
3662300992720,4cyclictest1780552-21cups-browsed19:10:560
3662300992715,3cyclictest0-21swapper/020:34:100
3662302992618,5cyclictest0-21swapper/220:25:262
3662301992618,5cyclictest955-21mta-sts-daemon20:40:511
3662301992618,5cyclictest3696791-21cut21:05:011
3662300992621,3cyclictest3681749-21unixbench_singl20:14:300
3662300992621,3cyclictest3681749-21unixbench_singl20:14:300
3662300992619,5cyclictest0-21swapper/019:30:010
3662300992619,5cyclictest0-21swapper/019:30:010
3662300992615,2cyclictest0-21swapper/020:29:290
366230099261,20cyclictest3723984-21ssh21:44:170
3662302992517,5cyclictest3672682-21unixbench_multi19:44:292
3662301992520,2cyclictest0-21swapper/119:50:021
3662301992517,5cyclictest3666823-21systemd-run19:25:011
3662300992519,4cyclictest3673272-21cpuspeed19:49:070
3662302992414,7cyclictest3681771-21cron20:15:012
3662302992414,7cyclictest3681771-21cron20:15:012
366230199243,14cyclictest421-21avahi-daemon19:19:201
3662301992419,2cyclictest0-21swapper/120:14:261
3662301992419,2cyclictest0-21swapper/120:14:261
3662301992416,5cyclictest3669155-21sed19:34:161
366230099241,12cyclictest657-21snmpd19:34:280
366230299232,16cyclictest3673783-21ntp_states19:49:212
366230399227,6cyclictest0-21swapper/323:09:233
366230399227,6cyclictest0-21swapper/319:59:163
3662302992217,3cyclictest957-21mta-sts-daemon19:14:162
3662301992216,3cyclictest0-21swapper/119:54:261
3662300992217,3cyclictest0-21swapper/019:10:020
366230399209,6cyclictest0-21swapper/320:44:203
366230399206,7cyclictest0-21swapper/323:29:193
366230199201,14cyclictest3663278-21ntp_states19:14:241
366230399197,6cyclictest0-21swapper/323:04:233
366230399197,6cyclictest0-21swapper/322:44:183
366230399197,6cyclictest0-21swapper/300:24:183
366230399197,5cyclictest0-21swapper/321:54:163
366230399197,5cyclictest0-21swapper/321:29:173
366230399196,7cyclictest0-21swapper/300:34:293
366230399189,6cyclictest0-21swapper/321:44:173
366230399188,5cyclictest0-21swapper/321:14:203
366230399184,9cyclictest0-21swapper/323:49:213
366230399179,4cyclictest0-21swapper/321:19:243
366230399178,5cyclictest0-21swapper/321:49:223
366230399177,6cyclictest0-21swapper/321:39:153
366230399177,6cyclictest0-21swapper/319:24:233
366230399177,5cyclictest0-21swapper/323:59:193
366230399177,5cyclictest0-21swapper/323:54:163
366230399176,6cyclictest0-21swapper/322:19:243
366230399169,4cyclictest0-21swapper/323:14:233
366230399169,4cyclictest0-21swapper/319:19:223
366230399168,5cyclictest0-21swapper/321:34:223
366230399168,4cyclictest0-21swapper/321:59:183
366230399168,4cyclictest0-21swapper/321:59:183
366230399168,4cyclictest0-21swapper/320:54:253
366230399168,4cyclictest0-21swapper/320:14:213
366230399168,4cyclictest0-21swapper/320:14:213
366230399168,4cyclictest0-21swapper/319:14:193
366230399167,6cyclictest0-21swapper/323:39:253
366230399167,5cyclictest0-21swapper/322:49:223
366230399167,5cyclictest0-21swapper/322:34:183
366230399167,5cyclictest0-21swapper/322:14:163
366230399167,5cyclictest0-21swapper/320:29:163
366230399167,5cyclictest0-21swapper/319:54:203
366230399167,5cyclictest0-21swapper/319:34:173
366230399167,5cyclictest0-21swapper/300:39:203
366230399167,5cyclictest0-21swapper/300:29:183
366230399167,5cyclictest0-21swapper/300:14:123
366230399167,4cyclictest0-21swapper/320:19:153
366230399167,4cyclictest0-21swapper/320:19:153
366230399167,4cyclictest0-21swapper/319:39:183
366230399166,6cyclictest0-21swapper/321:24:183
366230399165,7cyclictest0-21swapper/300:15:513
366230399163,9cyclictest0-21swapper/322:58:163
366230399162,9cyclictest0-21swapper/323:34:213
366230399162,7cyclictest0-21swapper/300:00:163
366230399161,8cyclictest0-21swapper/320:39:203
366230399161,8cyclictest0-21swapper/320:39:203
366230399161,10cyclictest0-21swapper/322:04:253
366230399159,4cyclictest0-21swapper/320:34:213
366230399159,4cyclictest0-21swapper/320:09:153
366230399158,4cyclictest0-21swapper/320:49:193
366230399157,4cyclictest0-21swapper/323:19:183
366230399157,4cyclictest0-21swapper/322:20:353
366230399157,4cyclictest0-21swapper/321:04:113
366230399157,4cyclictest0-21swapper/320:24:183
366230399157,4cyclictest0-21swapper/320:04:143
366230399156,6cyclictest0-21swapper/322:50:423
366230399156,5cyclictest0-21swapper/323:41:393
366230399156,5cyclictest0-21swapper/323:20:163
366230399156,5cyclictest0-21swapper/321:09:173
366230399156,5cyclictest0-21swapper/320:59:173
366230399155,6cyclictest0-21swapper/322:35:173
366230399147,4cyclictest0-21swapper/322:26:293
366230399147,4cyclictest0-21swapper/319:44:183
366230399146,5cyclictest0-21swapper/319:29:143
366230399146,5cyclictest0-21swapper/319:29:143
366230399141,8cyclictest0-21swapper/322:09:193
366230399137,4cyclictest0-21swapper/300:05:243
366230399136,4cyclictest0-21swapper/319:49:063
366230399135,5cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional