You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 05:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Wed Nov 19, 2025 00:39:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
573629995545,7cyclictest738322-21systemd00:00:021
573630995345,5cyclictest759754-21munin-plugin-st00:30:012
573630995042,5cyclictest596126-21grep20:25:012
573630995042,5cyclictest596126-21grep20:25:012
573628995042,5cyclictest666694-21cron22:25:010
573628994842,3cyclictest745820-21cron00:10:010
573630994737,4cyclictest0-21swapper/223:04:182
573629994740,3cyclictest0-21swapper/123:14:311
573629994739,5cyclictest752957-21idleruntime-cro00:20:011
573629994636,5cyclictest0-21swapper/122:44:191
573628994639,4cyclictest613665-21systemd-run21:15:010
573630994535,5cyclictest0-21swapper/221:34:112
573629994537,5cyclictest766604-21sendmail00:40:011
573629994536,6cyclictest578143-21systemd-run19:25:011
573629994536,6cyclictest421-21avahi-daemon21:45:021
573629994536,6cyclictest266-21systemd-journal23:50:021
573628994537,5cyclictest588643-21systemd-run20:00:020
573630994436,5cyclictest651373-21sh22:05:002
573630994436,5cyclictest651373-21sh22:05:002
573629994437,3cyclictest0-21swapper/122:30:001
573628994430,12cyclictest597687-21latency_hist20:30:020
573628994330,11cyclictest766600-21ssh00:40:010
573630994234,5cyclictest632413-21basename21:40:012
573630994233,4cyclictest0-21swapper/200:19:152
573630994231,7cyclictest741416-21mailstats00:04:212
57363099422,29cyclictest638951-21ssh21:49:142
573628994231,8cyclictest596127-21cut20:25:010
573628994231,8cyclictest596127-21cut20:25:010
573628994219,17cyclictest12450irq/32-eth022:34:170
573630994135,3cyclictest0-21swapper/221:44:152
573630994133,5cyclictest693037-21grep23:00:012
573629994132,6cyclictest2942247-21cups-browsed21:14:211
573629994131,6cyclictest2942247-21cups-browsed23:01:541
573628994134,5cyclictest708155-21systemd-run23:20:010
573628994132,7cyclictest657-21snmpd23:00:010
573628994128,10cyclictest647542-21tr22:00:010
573630994034,4cyclictest0-21swapper/223:24:182
573630994030,4cyclictest0-21swapper/223:14:182
573629994033,4cyclictest608151-21latency_hist21:05:021
573629994032,5cyclictest609614-21diskmemload23:09:071
573629994031,6cyclictest738385-21cups-browsed00:04:161
573628994019,14cyclictest12450irq/32-eth000:24:150
573630993931,5cyclictest957-21mta-sts-daemon22:15:382
573630993930,6cyclictest748941-21timerandwakeup00:14:252
573630993928,7cyclictest422-21dbus-daemon21:29:122
573629993931,5cyclictest651394-21systemd-run22:05:011
573629993931,5cyclictest651394-21systemd-run22:05:011
573629993931,5cyclictest574165-21fschecks_time19:14:021
573629993929,4cyclictest0-21swapper/122:09:161
573628993932,5cyclictest453-21systemd-logind23:35:010
573628993929,7cyclictest0-21swapper/000:35:030
573630993830,5cyclictest738282-21ssh00:00:012
573630993830,5cyclictest689305-21systemd-run22:55:022
573630993830,5cyclictest668966-21aten_r2power_vo22:29:022
573629993830,5cyclictest422-21dbus-daemon21:30:021
573629993830,4cyclictest0-21swapper/121:49:171
573629993829,6cyclictest579633-21systemd-run19:30:011
57362999382,26cyclictest2942226-21cupsd22:34:191
57362899383,30cyclictest12450irq/32-eth021:49:140
573628993831,4cyclictest606608-21idleruntime-cro21:00:010
573628993830,6cyclictest696304-21timerandwakeup23:04:240
573628993830,5cyclictest738385-21cups-browsed00:10:320
573628993830,5cyclictest710377-21aten_r2power_vo23:24:020
573628993830,5cyclictest491-21gdbus23:49:200
573628993830,5cyclictest421-21avahi-daemon00:17:430
573628993828,6cyclictest662906-21systemd-run22:20:010
573628993822,13cyclictest600655-21latency_hist20:40:020
57363099372,27cyclictest722294-21ssh23:39:142
57363099372,27cyclictest722294-21ssh23:39:142
57363099371,28cyclictest765700-21sh00:39:132
573629993729,5cyclictest581103-21cron19:35:011
573629993728,6cyclictest632498-21latency_hist21:40:021
573628993722,13cyclictest474-21in:imuxsock21:30:590
573630993628,5cyclictest422-21dbus-daemon22:15:012
573630993628,4cyclictest0-21swapper/223:44:162
573630993627,6cyclictest422-21dbus-daemon23:50:012
573629993627,6cyclictest723415-21latency_hist23:40:031
573629993627,6cyclictest723415-21latency_hist23:40:031
573629993626,6cyclictest422-21dbus-daemon22:21:521
57362999362,27cyclictest733604-21ssh23:54:151
573628993629,4cyclictest474-21in:imuxsock22:55:010
573628993629,3cyclictest608343-21kworker/u8:13-xprtiod21:40:010
573628993628,5cyclictest594534-21sed20:19:260
573628993627,4cyclictest0-21swapper/019:44:110
573628993622,10cyclictest680268-21aten2.4-expect22:44:030
573630993529,3cyclictest0-21swapper/220:40:012
573630993527,5cyclictest2942247-21cups-browsed22:23:312
573629993528,3cyclictest0-21swapper/122:14:221
573629993525,6cyclictest957-21mta-sts-daemon23:22:341
57362999352,27cyclictest616454-21ssh21:19:131
573628993527,5cyclictest2942247-21cups-browsed23:06:090
573630993427,5cyclictest708107-21ssh23:20:012
573630993427,4cyclictest957-21mta-sts-daemon00:09:112
573630993427,3cyclictest0-21swapper/223:34:232
573630993426,5cyclictest673139-21latency22:34:072
573630993426,5cyclictest647579-21latency_hist22:00:022
573630993426,4cyclictest959-21mta-sts-daemon19:24:102
573630993425,5cyclictest587257-21latency_hist19:55:032
573630993425,5cyclictest0-21swapper/200:34:142
573630993424,7cyclictest421-21avahi-daemon22:45:332
573630993422,9cyclictest574442-21needreboot19:14:062
573629993426,5cyclictest745440-21unixbench_multi00:09:241
573629993425,5cyclictest603718-21latency_hist20:50:021
573629993423,7cyclictest421-21avahi-daemon23:28:321
57362999342,26cyclictest620282-21ssh21:24:141
573628993427,5cyclictest658084-21ssh22:14:160
573628993427,5cyclictest422-21dbus-daemon21:20:010
573628993425,6cyclictest738254-21dpkg-db-backup00:00:010
57362899342,26cyclictest684692-21ssh22:49:160
573630993324,6cyclictest588637-21systemd-run20:00:012
573629993327,3cyclictest0-21swapper/120:00:011
573629993325,5cyclictest582483-21unixbench-2d19:39:221
573629993323,6cyclictest693086-21unin-run23:00:011
573628993327,3cyclictest0-21swapper/023:40:030
573628993327,3cyclictest0-21swapper/023:40:030
573628993326,3cyclictest0-21swapper/022:10:010
573628993324,5cyclictest12450irq/32-eth021:24:110
573630993226,4cyclictest955-21mta-sts-daemon23:09:162
573629993226,3cyclictest0-21swapper/123:20:011
573629993226,3cyclictest0-21swapper/122:54:141
573629993226,3cyclictest0-21swapper/100:14:211
573629993225,4cyclictest756429-21cron00:25:011
573629993223,6cyclictest422-21dbus-daemon22:40:011
573628993225,4cyclictest593130-21systemd-run20:15:020
573628993225,4cyclictest593130-21systemd-run20:15:020
573628993224,3cyclictest0-21swapper/020:09:130
573628993223,6cyclictest602976-21ntp_kernel_err20:49:100
573628993223,6cyclictest453-21systemd-logind19:10:010
573628993216,10cyclictest635218-21ssh21:44:140
573628993211,4cyclictest171rcu_preempt23:44:120
573630993124,3cyclictest0-21swapper/222:39:162
573630993123,5cyclictest2942247-21cups-browsed23:51:072
573630993123,5cyclictest2942247-21cups-browsed22:41:302
573630993122,6cyclictest654891-21head22:09:252
57363099311,23cyclictest616562-21ssh21:19:182
573629993125,3cyclictest956-21mta-sts-daemon22:16:061
573629993124,3cyclictest0-21swapper/100:29:191
573629993123,5cyclictest606587-21cron21:00:011
573629993123,5cyclictest597619-21munin-plugin-st20:30:001
573629993123,5cyclictest584233-21latency_hist19:45:021
573629993122,6cyclictest0-21swapper/122:00:031
573628993123,4cyclictest575258-21latency_hist19:15:020
57362899312,24cyclictest642691-21ssh21:54:110
57362899312,22cyclictest669622-21ssh22:29:160
573628993119,10cyclictest0-21swapper/022:40:010
573628993116,13cyclictest731171-21sshd23:50:310
573630993022,5cyclictest603542-21grep20:49:232
57363099301,24cyclictest755670-21ssh00:24:162
573629993022,5cyclictest643697-21sh21:55:011
57362999302,22cyclictest718744-21sh23:34:181
573628993024,4cyclictest651372-21sh22:05:000
573628993024,4cyclictest651372-21sh22:05:000
573628993021,7cyclictest12450irq/32-eth023:14:200
573628993018,10cyclictest740925-21sh00:04:070
573630992919,7cyclictest491-21gdbus20:15:022
573630992919,7cyclictest491-21gdbus20:15:022
57362899294,16cyclictest758953-21ssh00:29:170
573628992923,3cyclictest0-21swapper/023:28:100
573628992922,5cyclictest578023-21unixbench_multi19:24:240
573628992919,8cyclictest582575-21unixbench_singl19:39:220
573628992913,10cyclictest12450irq/32-eth021:29:150
57363099289,10cyclictest351ktimers/219:29:032
57363099284,17cyclictest620212-21ssh21:24:122
573630992822,3cyclictest0-21swapper/220:55:012
573630992821,3cyclictest0-21swapper/223:29:112
573630992820,5cyclictest590055-21unixbench_singl20:04:252
573630992820,5cyclictest2942226-21cupsd19:39:082
57362999286,16cyclictest726006-21ssh23:44:121
573629992821,4cyclictest422-21dbus-daemon20:00:351
573629992821,4cyclictest0-21swapper/100:34:151
573629992821,3cyclictest0-21swapper/122:47:341
573629992820,5cyclictest2942247-21cups-browsed21:06:261
57362899284,6cyclictest171rcu_preempt19:49:120
573628992822,3cyclictest957-21mta-sts-daemon21:04:160
573628992821,4cyclictest601165-21fschecks_time20:44:070
573630992722,3cyclictest599125-21kworker/u8:1-xprtiod21:04:042
573630992720,5cyclictest0-21swapper/221:13:592
573630992719,5cyclictest609160-21proc_pri21:09:182
57363099271,21cyclictest642690-21sh21:54:112
573629992722,2cyclictest0-21swapper/119:55:021
573629992719,5cyclictest598170-21gltestperf20:34:041
573629992719,5cyclictest594648-21systemd-run20:20:011
573629992719,5cyclictest591562-21head20:09:261
573629992719,5cyclictest2942247-21cups-browsed20:40:461
573629992718,6cyclictest2942247-21cups-browsed20:38:451
573628992721,3cyclictest0-21swapper/019:20:010
573630992620,3cyclictest0-21swapper/220:45:012
573630992620,3cyclictest0-21swapper/219:20:012
573630992619,4cyclictest0-21swapper/220:19:152
573630992617,7cyclictest698-21cron21:00:012
57362999264,11cyclictest609614-21diskmemload21:32:261
573629992618,5cyclictest2942247-21cups-browsed19:45:321
573629992615,8cyclictest604467-21ntp_kernel_err20:54:101
57362899262,4cyclictest171rcu_preempt19:54:130
573630992519,3cyclictest957-21mta-sts-daemon19:49:182
573629992517,5cyclictest595161-21fschecks_count20:24:041
573629992517,5cyclictest595161-21fschecks_count20:24:041
573628992518,3cyclictest0-21swapper/021:10:010
573628992512,2cyclictest0-21swapper/019:34:210
57363099244,3cyclictest171rcu_preempt20:29:122
573630992419,2cyclictest0-21swapper/219:10:012
573629992414,7cyclictest576076-21ntp_offset19:19:151
573628992413,8cyclictest599141-21latency_hist20:35:020
573630992318,2cyclictest0-21swapper/219:44:172
573629992316,4cyclictest573641-21systemd19:10:021
573629992316,4cyclictest2942247-21cups-browsed20:12:111
573629992316,4cyclictest2942247-21cups-browsed20:12:111
573628992318,2cyclictest0-21swapper/020:54:100
57363099222,15cyclictest591094-21ntpq20:09:182
573630992216,3cyclictest0-21swapper/219:35:012
57362899221,5cyclictest579043-21ntpq19:29:130
573628992214,5cyclictest0-21swapper/020:04:160
57363099211,15cyclictest598529-21ntpq20:34:122
57363199183,9cyclictest0-21swapper/323:09:183
57363199183,9cyclictest0-21swapper/323:04:183
57363199162,9cyclictest0-21swapper/321:14:103
57363199162,8cyclictest0-21swapper/300:24:103
57363199158,3cyclictest0-21swapper/319:10:013
57363199152,7cyclictest0-21swapper/322:09:113
57363199151,8cyclictest0-21swapper/323:34:043
57363199151,8cyclictest0-21swapper/322:29:103
57363199151,7cyclictest0-21swapper/322:24:113
573631991510,3cyclictest0-21swapper/322:04:563
573631991510,3cyclictest0-21swapper/322:04:563
573631991510,3cyclictest0-21swapper/321:20:383
573631991510,3cyclictest0-21swapper/300:25:463
57363199149,3cyclictest0-21swapper/320:38:343
57363199149,3cyclictest0-21swapper/300:33:523
57363199149,3cyclictest0-21swapper/300:10:023
57363199148,4cyclictest0-21swapper/320:04:373
57363199148,4cyclictest0-21swapper/319:45:003
57363199148,4cyclictest0-21swapper/319:13:013
57363199147,4cyclictest0-21swapper/323:43:293
57363199147,4cyclictest0-21swapper/322:56:503
57363199147,4cyclictest0-21swapper/321:51:513
57363199147,4cyclictest0-21swapper/321:17:423
57363199146,4cyclictest0-21swapper/322:30:113
57363199146,4cyclictest0-21swapper/319:30:013
57363199142,7cyclictest0-21swapper/323:29:053
57363199142,7cyclictest0-21swapper/323:24:113
57363199142,7cyclictest0-21swapper/321:56:023
57363199142,7cyclictest0-21swapper/321:29:123
57363199142,7cyclictest0-21swapper/300:39:133
57363199142,7cyclictest0-21swapper/300:00:023
57363199141,7cyclictest0-21swapper/323:14:133
57363199141,7cyclictest0-21swapper/322:19:133
57363199141,7cyclictest0-21swapper/320:54:123
57363199141,7cyclictest0-21swapper/300:04:183
57363199138,3cyclictest0-21swapper/323:51:003
57363199138,3cyclictest0-21swapper/323:18:413
57363199138,3cyclictest0-21swapper/322:39:203
57363199138,3cyclictest0-21swapper/321:49:093
57363199138,3cyclictest0-21swapper/320:59:283
57363199137,4cyclictest0-21swapper/322:50:443
57363199137,4cyclictest0-21swapper/322:10:363
57363199137,4cyclictest0-21swapper/320:27:453
57363199136,4cyclictest0-21swapper/322:41:383
57363199136,4cyclictest0-21swapper/320:35:013
57363199136,4cyclictest0-21swapper/320:09:143
57363199135,4cyclictest0-21swapper/321:35:283
57363199132,7cyclictest0-21swapper/323:47:493
57363199132,7cyclictest0-21swapper/322:49:043
57363199132,6cyclictest0-21swapper/320:19:173
57363199131,6cyclictest0-21swapper/321:44:063
57363199131,6cyclictest0-21swapper/319:49:023
57363199127,3cyclictest0-21swapper/321:03:303
57363199127,3cyclictest0-21swapper/320:43:203
57363199127,3cyclictest0-21swapper/319:30:043
57363199127,3cyclictest0-21swapper/319:23:173
57363199127,3cyclictest0-21swapper/319:19:233
57363199126,4cyclictest0-21swapper/319:50:073
57363199126,4cyclictest0-21swapper/300:14:133
57363199126,3cyclictest0-21swapper/323:35:293
57363199126,3cyclictest0-21swapper/323:35:293
57363199126,3cyclictest0-21swapper/321:10:023
57363199125,4cyclictest0-21swapper/300:16:103
57363199122,6cyclictest0-21swapper/321:34:033
57363199121,6cyclictest0-21swapper/320:24:153
57363199121,6cyclictest0-21swapper/320:24:153
57363199121,6cyclictest0-21swapper/320:14:153
57363199121,6cyclictest0-21swapper/320:14:153
57363199121,5cyclictest0-21swapper/320:49:123
57363199121,5cyclictest0-21swapper/319:39:093
57363199115,3cyclictest0-21swapper/319:56:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional