You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 21:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Thu Dec 11, 2025 12:39:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3841222996355,5cyclictest3910975-21cron10:00:012
3841220995935,20cyclictest3974502-40mandb11:34:370
3841222995445,6cyclictest3860711-21true08:15:012
384122099541,40cyclictest3933892-21ssh10:34:240
3841221995143,5cyclictest3938256-21sshd10:40:021
3841221995143,5cyclictest3938256-21sshd10:40:021
3841222995040,6cyclictest956-21mta-sts-daemon11:24:352
3841222995040,6cyclictest956-21mta-sts-daemon11:24:352
3841220994819,24cyclictest0-21swapper/011:19:160
3841220994728,13cyclictest12450irq/32-eth009:54:230
3841221994640,4cyclictest0-21swapper/111:34:391
3841221994638,5cyclictest422-21dbus-daemon11:45:011
3841222994534,6cyclictest0-21swapper/212:14:272
3841221994537,5cyclictest3866715-21systemd-run08:35:011
3841220994532,9cyclictest3937445-21ssh10:39:290
3841220994532,9cyclictest3937445-21ssh10:39:290
3841220994435,5cyclictest3949109-21sshd10:56:290
3841220994415,9cyclictest3977582-21ssh11:39:270
3841220994415,9cyclictest3977582-21ssh11:39:270
3841222994336,4cyclictest3968498-21kworker/u8:0-xprtiod11:34:332
3841222994334,6cyclictest422-21dbus-daemon11:40:012
3841222994334,6cyclictest422-21dbus-daemon11:40:012
384122199433,32cyclictest3917009-21ssh10:09:241
3841222994232,7cyclictest422-21dbus-daemon09:50:012
3841221994233,6cyclictest1-21systemd12:30:021
3841221994232,6cyclictest3998016-21ntp_kernel_pll_12:09:271
3841220994221,13cyclictest3984987-21unixbench_multi11:49:400
3841220994215,7cyclictest3854092-21ntpq07:54:250
3841222994132,6cyclictest3897294-21tail09:39:372
3841220994125,9cyclictest3849615-21ntpq07:39:250
3841222994032,5cyclictest3958596-21cron11:10:012
3841222994032,5cyclictest3884508-21sh09:20:012
384122299401,31cyclictest3872184-21sshd08:54:282
3841221994032,5cyclictest3978439-21systemctl11:40:001
3841221994032,5cyclictest3978439-21systemctl11:40:001
3841221994031,6cyclictest2986655-21cups-browsed09:59:341
3841221994031,5cyclictest3962047-21idleruntime-cro11:15:011
3841221994027,8cyclictest3930570-21sh10:29:351
384122099408,12cyclictest3916968-21ntpq10:09:230
3841220994033,4cyclictest3904273-21latency_hist09:50:010
3841220994032,6cyclictest12450irq/32-eth011:54:280
3841220994021,15cyclictest421-21avahi-daemon12:17:360
3841220994015,4cyclictest3843681-21ntpq07:19:280
3841220994012,17cyclictest0-21swapper/009:34:270
3841220994011,20cyclictest0-21swapper/008:04:210
3841222993931,5cyclictest3881161-21latency_hist09:15:022
3841222993931,5cyclictest3877198-21diskmemload10:24:342
3841221993933,3cyclictest0-21swapper/111:00:021
3841221993932,3cyclictest0-21swapper/110:14:161
3841221993929,7cyclictest4021162-21sendmail12:40:011
3841220993929,7cyclictest3968218-21cut11:25:010
3841220993929,7cyclictest3968218-21cut11:25:010
3841220993925,8cyclictest4012334-21ntpq12:29:250
3841222993830,5cyclictest3877199-21ls09:10:012
3841221993830,5cyclictest3945023-21cron10:50:001
3841221993830,5cyclictest3945023-21cron10:50:001
3841221993830,5cyclictest3907623-21rm09:55:011
3841221993829,6cyclictest422-21dbus-daemon12:22:231
3841221993829,6cyclictest3894602-21systemd-run09:35:011
3841221993829,6cyclictest3880095-21missed_timers09:14:231
3841220993831,4cyclictest453-21systemd-logind08:40:020
3841220993830,5cyclictest422-21dbus-daemon07:45:020
3841220993829,6cyclictest2986626-21cupsd11:44:040
3841220993813,8cyclictest3999096-21sh12:10:130
3841220993810,10cyclictest3896862-21open_inodes09:39:320
3841222993732,2cyclictest0-21swapper/210:40:002
3841222993732,2cyclictest0-21swapper/210:40:002
3841222993729,5cyclictest4005816-21latency_hist12:20:022
3841222993729,5cyclictest266-21systemd-journal12:05:012
3841222993728,6cyclictest4017209-21latency_hist12:35:022
3841222993728,6cyclictest3848704-21munin-plugin-st07:35:002
3841222993726,7cyclictest2986655-21cups-browsed10:27:142
3841221993729,5cyclictest3941597-21cron10:45:001
3841221993729,5cyclictest3941597-21cron10:45:001
3841221993729,5cyclictest3874737-21fschecks_count09:04:151
384122199371,6cyclictest171rcu_preempt08:14:291
3841220993731,4cyclictest3863612-21tail08:24:340
3841220993730,4cyclictest3971500-21unixbench_singl11:29:370
3841220993729,3cyclictest0-21swapper/010:44:240
3841220993729,3cyclictest0-21swapper/010:44:240
3841220993727,6cyclictest12450irq/32-eth010:19:280
3841220993711,9cyclictest3890653-21grep09:29:330
3841220993710,8cyclictest3872157-21ntp_states08:54:260
384122299363,25cyclictest3917089-21ssh10:09:272
3841222993627,6cyclictest3950537-21uname10:59:172
3841221993630,3cyclictest0-21swapper/111:54:281
3841221993630,3cyclictest0-21swapper/109:20:011
3841221993630,3cyclictest0-21swapper/108:25:011
3841221993628,5cyclictest3850200-21cut07:40:011
384122099364,26cyclictest591-21sshd08:44:280
3841220993628,5cyclictest2986655-21cups-browsed10:01:580
3841220993627,6cyclictest3961447-21proc_pri11:14:320
3841220993626,6cyclictest3845158-21ntpq07:24:250
3841220993625,7cyclictest3852648-21ntpq07:49:250
3841220993622,10cyclictest3876702-21ntpq09:09:330
3841220993620,12cyclictest3994605-21ntpq12:04:250
3841220993613,7cyclictest3846247-21fschecks_count07:29:170
3841220993613,7cyclictest3846247-21fschecks_count07:29:170
3841220993612,8cyclictest3866742-21cat08:35:010
384122099361,18cyclictest3883600-21ssh09:19:220
384122299353,23cyclictest3940728-21ssh10:44:232
384122299353,23cyclictest3940728-21ssh10:44:232
3841222993529,3cyclictest0-21swapper/209:29:192
3841222993529,3cyclictest0-21swapper/208:09:292
3841222993528,4cyclictest0-21swapper/208:34:282
3841222993527,5cyclictest3971488-21unixbench_singl11:29:372
3841222993527,5cyclictest3850198-21munin-run07:40:012
3841222993526,6cyclictest2986655-21cups-browsed12:05:512
3841222993525,7cyclictest3991082-21needreboot11:59:222
3841222993523,9cyclictest3954737-21timerandwakeup11:04:352
3841221993527,5cyclictest3842704-21munin-run07:15:011
3841221993526,6cyclictest453-21systemd-logind09:30:011
3841220993526,6cyclictest4020837-21sed12:39:380
3841220993522,8cyclictest3848703-21/usr/sbin/munin07:35:010
3841220993521,9cyclictest3861567-21ntpq08:19:220
3841220993521,8cyclictest3910186-21ntpq09:59:250
3841220993521,8cyclictest3870691-21ntpq08:49:350
3841220993519,6cyclictest421-21avahi-daemon12:21:270
3841220993510,8cyclictest3873873-21sed08:59:370
3841222993427,4cyclictest0-21swapper/209:00:012
3841222993426,5cyclictest3921078-21unixbench_singl10:14:352
3841222993426,5cyclictest3893526-21kernelversion09:34:192
3841222993426,5cyclictest3857703-21cron08:05:012
3841222993423,8cyclictest3984263-21missed_timers11:49:252
384122199344,21cyclictest3984507-21ssh11:49:321
3841221993428,3cyclictest0-21swapper/112:15:011
3841221993428,3cyclictest0-21swapper/110:20:011
3841221993427,4cyclictest957-21mta-sts-daemon11:28:001
3841221993427,4cyclictest3853738-21fschecks_time07:54:181
3841221993426,5cyclictest3948271-21idleruntime-cro10:55:011
3841221993426,5cyclictest3900996-21munin-plugin-st09:45:011
3841221993426,5cyclictest3841231-21systemd-run07:10:011
3841221993425,5cyclictest3927934-21ls10:25:011
3841221993422,9cyclictest3887449-21switchtime09:24:341
3841221993421,9cyclictest3912147-21sshd10:02:281
384122099348,7cyclictest3929095-21ssh10:27:250
3841220993422,8cyclictest3855596-21ntpq07:59:260
384122099342,25cyclictest3998071-21ssh12:09:300
3841220993422,5cyclictest3927108-21ntpq10:24:240
3841220993413,7cyclictest4014648-21ssh12:32:250
3841220993410,7cyclictest3958474-21ssh11:09:390
3841220993410,7cyclictest3947372-21ssh10:54:200
3841222993328,2cyclictest0-21swapper/211:19:152
3841222993328,2cyclictest0-21swapper/210:20:012
3841222993324,6cyclictest3383474-21kworker/u8:1-nfsiod07:19:292
3841221993327,3cyclictest0-21swapper/107:30:021
3841221993327,3cyclictest0-21swapper/107:30:021
3841221993326,3cyclictest0-21swapper/109:49:311
3841221993325,5cyclictest3872574-21unixbench_multi08:54:341
3841221993324,6cyclictest3874219-21true09:00:011
3841220993327,3cyclictest0-21swapper/010:15:020
3841220993322,7cyclictest3880443-21processes09:14:340
3841220993322,5cyclictest3864566-21ntpq08:29:240
3841220993318,11cyclictest3941891-21ssh10:45:100
3841220993318,11cyclictest3941891-21ssh10:45:100
3841222993226,3cyclictest0-21swapper/209:24:172
3841222993225,4cyclictest3914376-21debian-sa110:05:012
3841222993223,6cyclictest4009449-21latency_hist12:25:032
3841221993226,3cyclictest0-21swapper/111:20:011
3841221993226,2cyclictest0-21swapper/108:20:011
3841221993225,4cyclictest956-21mta-sts-daemon12:04:261
3841221993224,5cyclictest4005702-21sendmail12:20:011
3841221993224,5cyclictest3896023-21ssh09:39:121
3841221993221,8cyclictest3864460-21missed_timers08:29:221
384122199321,27cyclictest3934077-21ssh10:34:311
3841220993224,4cyclictest3858453-21memory08:09:160
3841220993221,8cyclictest3875112-21ntpq09:04:230
3841220993221,7cyclictest3860159-21ntpq08:14:310
3841220993220,7cyclictest3842144-21ntpq07:14:300
3841220993219,10cyclictest3989196-21ssh11:56:160
3841220993219,10cyclictest3898592-21ssh09:42:060
3841220993210,7cyclictest3952783-21ssh11:02:050
3841222993123,4cyclictest0-21swapper/210:34:322
3841222993122,5cyclictest3869588-21tail08:44:352
3841221993123,5cyclictest3968012-21unixbench_singl11:24:351
3841221993123,5cyclictest3968012-21unixbench_singl11:24:351
3841221993123,5cyclictest3855782-21systemctl07:59:321
3841220993123,6cyclictest3884894-21ssh09:20:240
3841222993024,3cyclictest0-21swapper/209:55:022
3841222993024,3cyclictest0-21swapper/209:05:012
3841222993022,5cyclictest4020914-21unixbench_singl12:39:382
3841221993024,3cyclictest0-21swapper/107:20:011
384122199302,25cyclictest3869191-21sshd08:44:281
3841221993022,4cyclictest0-21swapper/111:09:341
384122199302,23cyclictest3991172-21ssh11:59:241
3841221993016,9cyclictest2986655-21cups-browsed12:32:311
3841222992922,4cyclictest3961654-21threads11:14:352
3841222992922,3cyclictest0-21swapper/210:49:232
3841222992922,3cyclictest0-21swapper/210:49:232
384122299292,19cyclictest2986655-21cups-browsed09:44:232
3841222992921,5cyclictest0-21swapper/207:45:022
384122299291,23cyclictest4012348-21ssh12:29:262
3841221992922,5cyclictest0-21swapper/109:10:011
3841221992921,5cyclictest3914404-21kworker/u8:3-xprtiod11:04:161
3841220992917,7cyclictest3841174-21/usr/sbin/munin07:10:020
3841222992821,4cyclictest955-21mta-sts-daemon08:49:262
3841222992820,4cyclictest0-21swapper/211:44:272
3841222992720,4cyclictest959-21mta-sts-daemon11:51:212
3841221992721,3cyclictest0-21swapper/108:05:011
3841221992719,5cyclictest3848637-21head07:34:341
3841222992620,3cyclictest959-21mta-sts-daemon07:24:482
3841222992620,3cyclictest0-21swapper/207:15:012
3841222992617,7cyclictest3861802-21mailstats08:19:312
3841221992618,5cyclictest3844465-21/usr/sbin/munin07:24:331
3841221992617,6cyclictest3871208-21systemd-run08:50:011
384122299253,17cyclictest2986655-21cups-browsed07:29:222
384122299253,17cyclictest2986655-21cups-browsed07:29:222
384122299251,19cyclictest3947422-21ssh10:54:232
3841222992418,4cyclictest3856135-21unixbench_singl07:59:372
3841222992416,5cyclictest3868135-21unixbench_singl08:39:362
3841222992410,3cyclictest171rcu_preempt07:49:192
3841221992416,4cyclictest0-21swapper/107:44:241
3841221992415,6cyclictest491-21gdbus08:05:081
3841222992317,3cyclictest956-21mta-sts-daemon07:54:482
3841221992318,2cyclictest0-21swapper/108:40:011
3841221992211,8cyclictest422-21dbus-daemon07:50:021
3841222992114,4cyclictest3864536-21needreboot08:29:232
3841222992114,4cyclictest3860710-21kworker/u8:8-xprtiod08:24:162
3841222992110,8cyclictest422-21dbus-daemon07:10:012
384122399193,11cyclictest0-21swapper/311:34:373
384122399172,8cyclictest0-21swapper/312:34:243
384122399172,8cyclictest0-21swapper/309:54:293
384122399172,7cyclictest0-21swapper/310:14:273
384122399171,10cyclictest0-21swapper/309:34:313
384122399164,8cyclictest0-21swapper/310:24:273
384122399162,9cyclictest0-21swapper/311:04:283
384122399162,8cyclictest0-21swapper/312:14:233
384122399161,8cyclictest0-21swapper/312:19:213
384122399161,8cyclictest0-21swapper/310:39:253
384122399161,8cyclictest0-21swapper/310:39:253
384122399153,7cyclictest0-21swapper/310:34:263
384122399152,8cyclictest0-21swapper/311:54:293
384122399152,8cyclictest0-21swapper/311:49:333
384122399152,8cyclictest0-21swapper/311:44:273
384122399152,8cyclictest0-21swapper/311:24:183
384122399152,8cyclictest0-21swapper/311:24:183
384122399152,8cyclictest0-21swapper/310:19:293
384122399152,8cyclictest0-21swapper/309:49:243
384122399152,8cyclictest0-21swapper/309:14:283
384122399152,7cyclictest0-21swapper/309:40:103
384122399152,7cyclictest0-21swapper/309:10:033
384122399152,7cyclictest0-21swapper/307:19:293
384122399151,8cyclictest0-21swapper/311:59:243
384122399151,7cyclictest0-21swapper/309:39:243
384122399151,7cyclictest0-21swapper/307:29:293
384122399151,7cyclictest0-21swapper/307:29:293
384122399151,6cyclictest0-21swapper/307:14:293
384122399151,5cyclictest0-21swapper/308:09:193
384122399143,6cyclictest0-21swapper/311:39:293
384122399143,6cyclictest0-21swapper/311:39:293
384122399143,5cyclictest0-21swapper/307:24:293
384122399142,8cyclictest0-21swapper/312:29:253
384122399142,8cyclictest0-21swapper/311:19:153
384122399142,8cyclictest0-21swapper/309:24:253
384122399142,6cyclictest0-21swapper/310:04:223
384122399141,8cyclictest0-21swapper/312:09:303
384122399141,7cyclictest0-21swapper/310:49:293
384122399141,7cyclictest0-21swapper/310:49:293
384122399141,7cyclictest0-21swapper/309:19:223
384122399141,6cyclictest0-21swapper/309:04:263
384122399140,7cyclictest0-21swapper/310:54:223
384122399134,5cyclictest0-21swapper/310:44:233
384122399134,5cyclictest0-21swapper/310:44:233
384122399133,4cyclictest0-21swapper/308:14:273
384122399132,7cyclictest0-21swapper/312:24:243
384122399132,7cyclictest0-21swapper/310:59:243
384122399132,7cyclictest0-21swapper/309:59:233
384122399132,7cyclictest0-21swapper/308:19:233
384122399132,6cyclictest0-21swapper/312:04:233
384122399132,6cyclictest0-21swapper/311:10:293
384122399132,5cyclictest0-21swapper/308:54:233
384122399132,5cyclictest0-21swapper/307:59:253
384122399131,9cyclictest0-21swapper/311:09:373
384122399131,7cyclictest0-21swapper/312:39:283
384122399131,6cyclictest0-21swapper/308:44:263
384122399131,5cyclictest0-21swapper/308:04:213
384122399123,5cyclictest0-21swapper/307:49:283
384122399122,7cyclictest0-21swapper/310:29:443
384122399122,6cyclictest0-21swapper/307:45:023
384122399122,5cyclictest0-21swapper/309:29:123
384122399121,7cyclictest0-21swapper/311:29:173
384122399121,7cyclictest0-21swapper/310:09:153
384122399121,7cyclictest0-21swapper/307:34:243
384122399121,6cyclictest0-21swapper/308:49:293
384122399121,6cyclictest0-21swapper/308:34:283
384122399121,6cyclictest0-21swapper/307:54:313
384122399111,5cyclictest0-21swapper/308:59:253
384122399101,6cyclictest0-21swapper/308:24:143
384122399101,6cyclictest0-21swapper/307:39:163
38412239991,5cyclictest0-21swapper/308:39:183
38412239991,5cyclictest0-21swapper/308:29:153
38412239990,4cyclictest0-21swapper/307:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional