You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 03:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 15, 2026 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3618172996456,5cyclictest3782589-21diskmemload00:35:310
3618174995851,3cyclictest0-21swapper/200:15:292
3618174995341,8cyclictest1863115-21cups-browsed20:25:262
361817499526,40cyclictest3708141-21ssh22:35:242
3618174995045,2cyclictest0-21swapper/223:20:312
3618174995033,10cyclictest36-21ksoftirqd/223:25:232
3618174995025,21cyclictest3669970-21latency_hist21:35:012
361817499501,28cyclictest3672446-21ssh21:38:032
3618172995035,12cyclictest1-21systemd00:10:010
3618174994931,16cyclictest0-21swapper/223:20:012
3618172994942,5cyclictest1863115-21cups-browsed23:50:380
3618172994935,12cyclictest3744364-21cron23:35:010
3618174994723,4cyclictest3697718-21kworker/u8:4+rpciod23:00:022
3618174994721,3cyclictest0-21swapper/223:40:252
3618173994739,5cyclictest3759889-21ssh00:00:021
3618174994622,2cyclictest0-21swapper/220:10:012
3618174994516,7cyclictest3714163-21latency22:45:202
3618173994539,3cyclictest0-21swapper/123:30:271
361817499448,10cyclictest0-21swapper/222:00:302
3618174994433,7cyclictest3784576-21idleruntime-cro00:40:012
361817499443,16cyclictest1001-21mta-sts-daemon22:30:292
361817499442,37cyclictest3723811-21ssh23:00:302
3618174994418,3cyclictest0-21swapper/200:00:192
3618174994417,4cyclictest0-21swapper/222:15:332
3618172994436,5cyclictest420-21avahi-daemon23:05:290
3618172994431,11cyclictest151ktimers/021:10:240
3618174994335,4cyclictest0-21swapper/222:10:262
3618174994321,4cyclictest3769145-21munin-plugin-st00:15:012
3618174994318,3cyclictest0-21swapper/222:55:022
361817399434,31cyclictest3654163-21diskmemload00:15:261
3618172994336,4cyclictest1000-21mta-sts-daemon21:00:270
361817499422,31cyclictest3689720-21ssh22:05:322
3618172994236,3cyclictest0-21swapper/023:10:200
3618172994235,4cyclictest3757975-21grep23:55:340
3618172994235,4cyclictest3670339-21aten_r2power_en21:35:170
3618172994211,25cyclictest3773456-21ssh00:20:400
3618172994211,25cyclictest3773456-21ssh00:20:400
361817499414,30cyclictest3661477-21ssh21:20:232
3618173994129,9cyclictest3763605-21fschecks_time00:05:241
3618172994133,6cyclictest3775777-21aten_r2power_po00:25:190
3618172994133,6cyclictest3775777-21aten_r2power_po00:25:190
361817299413,33cyclictest3695797-21ssh22:15:260
3618172994131,8cyclictest3639155-21sendmail20:20:000
3618172994131,8cyclictest3639155-21sendmail20:20:000
3618172994120,13cyclictest3667861-21ssh21:30:290
3618174994032,5cyclictest3781508-21systemd-run00:35:012
3618174994032,5cyclictest3637175-21proc_pri20:10:302
3618174994030,6cyclictest3728915-21latency_hist23:10:022
3618172994032,5cyclictest265-21systemd-journal00:15:010
361817499391,17cyclictest3702147-21ssh22:25:322
3618173993933,3cyclictest0-21swapper/123:10:361
3618173993933,3cyclictest0-21swapper/100:30:311
361817299393,28cyclictest1863115-21cups-browsed20:05:270
3618172993929,4cyclictest3710262-21cron22:40:010
3618172993925,11cyclictest0-21swapper/021:45:010
361817299392,29cyclictest3705195-21sshd22:30:320
3618174993830,5cyclictest3713370-21cron22:45:012
3618173993832,3cyclictest0-21swapper/123:25:281
3618173993831,4cyclictest3697890-21munin-plugin-st22:20:011
3618173993830,5cyclictest3660459-21ssh21:20:011
3618173993830,5cyclictest3624185-21systemd-run19:30:021
3618173993829,7cyclictest3720446-21missed_timers22:55:221
361817299387,7cyclictest171rcu_preempt21:15:280
3618172993830,5cyclictest3716470-21ssh22:50:010
361817299382,27cyclictest3739230-21rm23:25:270
3618172993818,11cyclictest151ktimers/020:45:240
3618173993731,3cyclictest3643639-21kworker/u8:1-xprtiod22:55:011
3618173993731,3cyclictest0-21swapper/122:00:011
3618173993730,3cyclictest0-21swapper/100:35:161
3618173993728,6cyclictest421-21dbus-daemon22:05:021
3618172993730,4cyclictest3735063-21sendmail23:20:010
3618172993730,4cyclictest3634737-21latency_hist20:05:020
3618172993729,6cyclictest421-21dbus-daemon20:00:010
361817499364,26cyclictest3754653-21ssh23:50:262
3618174993630,3cyclictest3643641-21kworker/u8:8-xprtiod22:00:012
3618173993631,2cyclictest0-21swapper/123:15:251
3618173993631,2cyclictest0-21swapper/121:40:011
3618173993628,5cyclictest3707243-21latency_hist22:35:021
3618173993627,6cyclictest1863115-21cups-browsed23:35:361
3618173993625,8cyclictest3702068-21grep22:25:291
361817299363,27cyclictest3680279-21ssh21:50:260
3618172993627,4cyclictest0-21swapper/022:40:310
3618174993530,2cyclictest0-21swapper/219:40:012
3618173993529,3cyclictest0-21swapper/123:00:281
3618173993527,5cyclictest3666821-21systemd-run21:30:011
3618173993527,5cyclictest3621165-21idleruntime-cro19:20:001
3618173993526,6cyclictest420-21avahi-daemon22:35:441
3618173993526,6cyclictest3690184-21grep22:05:401
3618172993529,4cyclictest3651183-21systemd-run21:00:010
3618172993528,4cyclictest3677239-21ssh21:45:290
3618172993527,5cyclictest421-21dbus-daemon19:20:010
3618172993526,6cyclictest3761273-21threads00:00:380
3618174993428,4cyclictest3618171-21cyclictest23:50:022
3618174993427,3cyclictest0-21swapper/221:15:312
3618174993424,6cyclictest1-21systemd21:45:012
3618173993429,2cyclictest0-21swapper/100:15:031
3618172993427,4cyclictest3738342-21latency_hist23:25:030
3618172993427,3cyclictest0-21swapper/022:05:350
3618172993425,7cyclictest3745164-21latency23:35:250
361817499336,20cyclictest3677202-21ssh21:45:282
3618174993326,4cyclictest3744376-21munin-plugin-st23:35:012
3618174993326,4cyclictest1003-21mta-sts-daemon00:06:332
3618174993326,3cyclictest0-21swapper/223:35:252
3618174993325,5cyclictest3633181-21systemd-run20:00:012
361817499331,27cyclictest3619135-21sshd19:10:302
3618173993328,2cyclictest0-21swapper/123:45:031
3618173993325,5cyclictest1863115-21cups-browsed21:51:101
3618173993325,5cyclictest1-21systemd20:50:021
3618173993325,4cyclictest2925899-21kworker/u8:0-xprtiod19:15:011
361817299333,22cyclictest3748571-21sh23:40:310
3618172993326,5cyclictest421-21dbus-daemon22:05:010
3618172993326,3cyclictest0-21swapper/022:20:160
3618174993226,3cyclictest0-21swapper/219:20:002
361817499322,23cyclictest3643125-21sshd20:30:302
3618173993226,3cyclictest0-21swapper/121:50:011
3618173993225,3cyclictest0-21swapper/123:05:321
3618173993225,3cyclictest0-21swapper/100:05:011
3618173993224,5cyclictest3669957-21cron21:35:011
3618173993224,5cyclictest3654152-21cron21:10:011
3618173993224,5cyclictest3634656-21cron20:05:011
3618173993224,5cyclictest1863115-21cups-browsed19:31:101
3618173993220,9cyclictest3630963-21needreboot19:50:231
3618172993227,3cyclictest627-21lldpd22:27:250
3618172993223,6cyclictest151ktimers/020:50:260
361817499313,23cyclictest3699004-21ssh22:20:302
3618174993125,3cyclictest0-21swapper/221:00:012
3618174993124,4cyclictest3648534-21aten_r2power_vo20:50:162
3618174993123,5cyclictest420-21avahi-daemon19:28:362
3618174993123,5cyclictest3729490-21fschecks_time23:10:182
3618173993125,3cyclictest0-21swapper/123:45:311
3618173993125,3cyclictest0-21swapper/120:25:001
3618173993124,5cyclictest0-21swapper/121:15:021
3618173993124,4cyclictest3639150-21sh20:20:001
3618173993124,4cyclictest3639150-21sh20:20:001
3618173993124,3cyclictest0-21swapper/123:50:371
3618173993123,5cyclictest3654163-21diskmemload23:25:011
3618173993121,7cyclictest265-21systemd-journal21:25:011
361817299318,13cyclictest265-21systemd-journal22:10:320
3618172993125,3cyclictest3772235-21cron00:20:010
3618172993125,3cyclictest3640639-21kworker/u8:14-nfsiod21:30:020
361817299312,24cyclictest12650irq/32-eth023:00:230
3618174993024,3cyclictest0-21swapper/221:55:012
3618174993023,4cyclictest0-21swapper/220:15:332
3618174993023,4cyclictest0-21swapper/220:15:332
3618174993023,3cyclictest0-21swapper/221:13:272
3618174993021,5cyclictest0-21swapper/220:35:282
361817399303,23cyclictest3632611-21sshd19:55:301
3618173993025,3cyclictest3643641-21kworker/u8:8-xprtiod22:40:191
3618173993024,3cyclictest1000-21mta-sts-daemon22:10:251
3618173993023,4cyclictest3636085-21unixbench_singl20:05:391
3618173993022,5cyclictest3651145-21ls21:00:011
3618173993021,4cyclictest0-21swapper/121:40:461
3618172993026,2cyclictest0-21swapper/023:50:020
3618172993025,3cyclictest151ktimers/019:45:270
3618172993024,4cyclictest151ktimers/019:30:270
3618172993024,3cyclictest0-21swapper/019:10:010
3618172993024,3cyclictest0-21swapper/019:10:010
3618172993023,5cyclictest3610346-21kworker/u8:5+xprtiod19:10:190
3618172993023,3cyclictest0-21swapper/022:50:190
3618172993021,7cyclictest3661096-21sh21:20:180
3618174992924,2cyclictest0-21swapper/219:45:012
3618174992922,4cyclictest3621400-21/usr/sbin/munin19:20:382
3618174992918,8cyclictest1003-21mta-sts-daemon00:23:402
3618174992918,8cyclictest1003-21mta-sts-daemon00:23:402
3618173992923,3cyclictest0-21swapper/119:25:011
3618173992922,3cyclictest0-21swapper/122:45:251
3618173992922,3cyclictest0-21swapper/122:20:251
3618173992922,3cyclictest0-21swapper/119:35:301
3618173992922,3cyclictest0-21swapper/100:25:171
3618173992922,3cyclictest0-21swapper/100:25:171
3618173992920,6cyclictest3636696-21gltestperf20:10:181
3618172992921,5cyclictest3637396-21wc20:10:350
3618172992919,5cyclictest0-21swapper/000:30:300
3618172992916,10cyclictest421-21dbus-daemon20:25:260
3618172992916,10cyclictest0-21swapper/020:30:370
3618174992821,4cyclictest3654154-21cron21:10:012
3618174992819,6cyclictest3618128-21munin-run19:10:022
3618174992819,6cyclictest3618128-21munin-run19:10:022
3618173992820,5cyclictest3643663-21munin-plugin-st20:35:011
3618173992820,5cyclictest0-21swapper/120:40:011
3618172992822,4cyclictest3627151-21sendmail19:40:010
3618172992822,3cyclictest151ktimers/022:55:290
3618172992821,4cyclictest485-21in:imuxsock19:45:010
3618172992820,4cyclictest1001-21mta-sts-daemon19:25:280
361817299281,13cyclictest3682976-21diskstats21:55:180
3618174992720,4cyclictest1001-21mta-sts-daemon00:00:022
3618173992722,2cyclictest0-21swapper/100:20:341
3618173992722,2cyclictest0-21swapper/100:20:341
361817299275,15cyclictest428-21mta-sts-daemon19:50:290
3618172992718,6cyclictest3645467-21aten_r2power_en20:40:160
3618172992716,5cyclictest12650irq/32-eth019:20:300
361817499262,17cyclictest443-21gpm19:30:262
3618174992613,10cyclictest566-21gmain21:00:262
361817499261,20cyclictest3776379-21ssh00:25:302
361817499261,20cyclictest3776379-21ssh00:25:302
361817499261,19cyclictest3664642-21ssh21:25:262
361817399263,19cyclictest265-21systemd-journal21:00:311
3618173992620,3cyclictest1002-21mta-sts-daemon19:45:191
3618173992620,3cyclictest0-21swapper/120:25:161
361817299262,20cyclictest3654159-21latency_hist21:10:010
3618172992621,3cyclictest1003-21mta-sts-daemon20:35:300
3618174992517,5cyclictest3630686-21fschecks_time19:50:192
3618173992516,7cyclictest3649669-21sh20:55:011
3618173992419,2cyclictest0-21swapper/119:40:361
3618173992418,3cyclictest0-21swapper/119:10:021
3618173992418,3cyclictest0-21swapper/119:10:021
3618172992420,2cyclictest12650irq/32-eth020:20:240
3618174992317,3cyclictest3624187-21kworker/u8:2-nfsiod20:45:022
3618174992317,3cyclictest0-21swapper/220:20:292
3618173992318,2cyclictest0-21swapper/120:40:311
361817499221,15cyclictest3634140-21ntpq20:00:322
361817499212,15cyclictest3629627-21sshd19:45:302
3618174992112,6cyclictest3647580-21awk20:45:252
361817599203,8cyclictest0-21swapper/321:55:233
361817599202,9cyclictest0-21swapper/323:20:303
361817599192,9cyclictest0-21swapper/322:40:323
361817599192,9cyclictest0-21swapper/322:00:313
361817599192,8cyclictest0-21swapper/322:05:313
361817599192,8cyclictest0-21swapper/300:05:293
361817599185,8cyclictest0-21swapper/323:55:273
361817599183,8cyclictest0-21swapper/321:15:283
361817599183,7cyclictest0-21swapper/321:25:313
361817599183,6cyclictest0-21swapper/319:50:303
361817599174,10cyclictest0-21swapper/322:35:243
361817599172,8cyclictest0-21swapper/323:15:293
361817599172,7cyclictest0-21swapper/322:25:253
361817599172,7cyclictest0-21swapper/300:15:253
361817599172,7cyclictest0-21swapper/300:00:273
361817599172,6cyclictest0-21swapper/321:20:293
361817599171,8cyclictest0-21swapper/300:30:313
361817599171,7cyclictest0-21swapper/323:35:273
361817599171,7cyclictest0-21swapper/322:50:233
361817599171,7cyclictest0-21swapper/322:30:313
361817599163,7cyclictest0-21swapper/321:35:343
361817599162,8cyclictest0-21swapper/323:05:293
361817599162,7cyclictest0-21swapper/319:35:263
361817599162,6cyclictest0-21swapper/320:10:293
361817599162,6cyclictest0-21swapper/319:20:273
361817599162,6cyclictest0-21swapper/319:15:273
361817599161,7cyclictest0-21swapper/322:15:283
361817599153,6cyclictest0-21swapper/321:40:333
361817599152,7cyclictest0-21swapper/322:45:303
361817599152,6cyclictest0-21swapper/323:50:253
361817599152,6cyclictest0-21swapper/300:20:293
361817599152,6cyclictest0-21swapper/300:20:293
361817599152,5cyclictest0-21swapper/320:20:263
361817599151,8cyclictest0-21swapper/300:10:303
361817599151,7cyclictest0-21swapper/321:10:283
361817599151,7cyclictest0-21swapper/319:30:253
361817599151,7cyclictest0-21swapper/300:25:353
361817599151,7cyclictest0-21swapper/300:25:353
361817599143,5cyclictest0-21swapper/323:10:263
361817599142,6cyclictest0-21swapper/322:10:263
361817599142,6cyclictest0-21swapper/320:45:273
361817599142,6cyclictest0-21swapper/320:25:283
361817599141,8cyclictest0-21swapper/323:30:253
361817599141,6cyclictest0-21swapper/320:55:303
361817599141,6cyclictest0-21swapper/320:30:283
361817599133,5cyclictest0-21swapper/322:55:313
361817599131,7cyclictest0-21swapper/323:25:283
361817599131,7cyclictest0-21swapper/321:50:263
361817599131,6cyclictest0-21swapper/320:40:273
361817599131,6cyclictest0-21swapper/319:10:253
361817599123,6cyclictest0-21swapper/319:55:243
361817599123,5cyclictest0-21swapper/322:20:273
361817599122,6cyclictest0-21swapper/320:15:333
361817599122,6cyclictest0-21swapper/320:15:333
361817599122,6cyclictest0-21swapper/320:05:273
361817599122,6cyclictest0-21swapper/300:35:163
361817599122,5cyclictest0-21swapper/323:40:273
361817599121,7cyclictest0-21swapper/323:00:203
361817599112,6cyclictest0-21swapper/319:25:233
361817599112,5cyclictest0-21swapper/320:35:313
361817599112,4cyclictest0-21swapper/323:45:273
361817599111,7cyclictest0-21swapper/321:30:283
361817599111,6cyclictest0-21swapper/321:00:253
361817599111,6cyclictest0-21swapper/320:50:233
361817599111,5cyclictest0-21swapper/320:00:243
361817599102,5cyclictest0-21swapper/321:05:263
361817599101,6cyclictest0-21swapper/321:45:273
361817599101,6cyclictest0-21swapper/319:45:243
361817599101,5cyclictest0-21swapper/319:40:233
36181759982,5cyclictest0-21swapper/319:10:023
36181759982,5cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional