You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 06:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Wed Jun 24, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3812420995045,2cyclictest0-21swapper/219:45:032
3812420994840,5cyclictest3825960-21systemd-run19:55:022
3812419994838,5cyclictest0-21swapper/121:35:351
3812418994824,17cyclictest151ktimers/023:50:360
3812419994630,12cyclictest421-21dbus-daemon19:50:311
3812420994539,3cyclictest0-21swapper/223:05:332
3812420994436,5cyclictest3898133-21systemd-run22:30:012
3812420994435,5cyclictest3873352-21idleruntime-cro21:50:012
3812419994436,5cyclictest1000-21mta-sts-daemon21:20:351
3812419994436,4cyclictest0-21swapper/100:00:011
3812418994431,11cyclictest3941300-21cron23:40:010
3812420994337,3cyclictest0-21swapper/200:00:012
381241999435,19cyclictest3848455-21diskmemload23:15:341
3812418994320,12cyclictest151ktimers/019:55:310
3812420994234,4cyclictest3777907-21kworker/u8:9-rpciod19:30:012
3812418994227,12cyclictest421-21dbus-daemon20:05:020
3812420994134,4cyclictest1002-21mta-sts-daemon22:36:022
3812420994133,5cyclictest3839475-21systemd-run20:40:012
3812420994131,6cyclictest441-21thd23:35:302
3812420994032,5cyclictest3972229-21ssh00:30:012
3812420993932,3cyclictest0-21swapper/219:55:292
3812420993931,5cyclictest3919728-21awk23:05:012
3812420993930,6cyclictest420-21avahi-daemon23:11:042
3812418993929,5cyclictest0-21swapper/019:50:310
3812420993832,3cyclictest0-21swapper/221:35:472
3812420993829,3cyclictest0-21swapper/220:25:342
3812420993827,7cyclictest1-21systemd23:00:012
3812420993826,9cyclictest3861984-21ntp_kernel_pll_21:30:362
3812419993831,4cyclictest3919724-21munin-run23:05:011
3812419993827,8cyclictest3975329-21latency_hist00:35:021
3812419993827,8cyclictest3975329-21latency_hist00:35:021
3812418993829,7cyclictest3888810-21cron22:15:000
381242099374,29cyclictest3963968-21ssh00:15:302
3812420993729,3cyclictest0-21swapper/221:25:012
3812420993728,6cyclictest421-21dbus-daemon21:28:182
3812420993727,7cyclictest3843955-21sh20:55:012
3812419993729,5cyclictest3882664-21systemd-run22:05:011
3812419993729,5cyclictest3882664-21systemd-run22:05:011
3812418993731,4cyclictest3969144-21ssh00:25:010
3812418993730,4cyclictest3926385-21aten_r2power_po23:15:200
3812418993714,19cyclictest3976400-21ssh00:35:350
3812418993714,19cyclictest3976400-21ssh00:35:350
3812420993631,2cyclictest0-21swapper/219:40:012
3812420993628,5cyclictest3891919-21cron22:20:012
3812420993628,5cyclictest3851563-21systemd-run21:15:012
3812420993628,5cyclictest3816911-21idleruntime-cro19:25:002
3812420993628,5cyclictest3816911-21idleruntime-cro19:25:002
3812420993627,6cyclictest420-21avahi-daemon21:43:322
3812419993628,5cyclictest3976542-21proc_pri00:35:401
3812419993628,5cyclictest3976542-21proc_pri00:35:401
381241999362,30cyclictest3822952-21munin-run19:45:021
3812418993624,5cyclictest0-21swapper/021:55:330
3812418993623,10cyclictest3852288-21if_wlan021:15:260
3812418993616,10cyclictest151ktimers/021:35:380
3812420993527,5cyclictest694-21cron20:25:012
3812420993526,6cyclictest420-21avahi-daemon00:00:582
3812419993527,5cyclictest3910957-21aten_r2power_vo22:50:221
3812418993529,4cyclictest3910468-21systemd-run22:50:010
3812418993529,4cyclictest3904271-21sendmail22:40:010
3812418993528,5cyclictest3831959-21true20:15:010
3812418993523,8cyclictest2060917-21cups-browsed21:31:030
3812418993521,11cyclictest3899144-21ntp_kernel_pll_22:30:330
381241899351,29cyclictest3951629-21ssh23:55:310
381242099343,8cyclictest3930044-21ssh23:20:362
3812420993428,3cyclictest0-21swapper/223:50:332
3812420993427,4cyclictest3876426-21cron21:55:012
3812420993427,3cyclictest0-21swapper/223:18:352
3812420993426,5cyclictest3937384-21ssh23:32:292
3812420993426,5cyclictest3933098-21/usr/sbin/munin23:25:362
3812420993426,4cyclictest0-21swapper/221:15:432
3812420993425,6cyclictest3958420-21unixbench_singl00:05:482
3812420993425,6cyclictest3881195-21sed22:00:432
3812420993425,6cyclictest3881195-21sed22:00:432
3812419993427,4cyclictest3899324-21ps22:30:401
3812419993427,4cyclictest3864018-21latency_hist21:35:031
3812419993427,4cyclictest3848427-21kworker/u8:14-xprtiod21:41:311
3812419993427,4cyclictest1002-21mta-sts-daemon00:10:301
3812419993425,6cyclictest3969169-21systemd-run00:25:011
3812419993425,5cyclictest0-21swapper/122:45:341
3812418993428,4cyclictest3972240-21grep00:30:010
381241899341,25cyclictest3868156-21ssh21:40:290
3812420993324,6cyclictest3884201-21unixbench-2d22:05:412
3812419993327,3cyclictest0-21swapper/123:15:011
3812419993326,4cyclictest3813823-21head19:10:421
3812419993324,7cyclictest3938240-21sh23:35:011
3812419993324,5cyclictest3824471-21systemd-run19:50:011
3812419993324,5cyclictest1003-21mta-sts-daemon21:56:201
3812419993324,4cyclictest0-21swapper/123:40:281
3812418993327,3cyclictest0-21swapper/021:50:550
3812418993326,4cyclictest3932426-21aten_r2power_cu23:25:200
3812418993320,9cyclictest0-21swapper/023:05:360
381242099326,20cyclictest3886925-21ps22:10:362
381242099325,22cyclictest3893010-21ssh22:20:332
3812420993226,3cyclictest0-21swapper/223:45:332
3812420993226,3cyclictest0-21swapper/200:35:012
3812420993226,3cyclictest0-21swapper/200:35:012
3812420993225,4cyclictest3913014-21sshd22:53:252
3812420993225,3cyclictest0-21swapper/222:45:342
3812420993223,6cyclictest2060917-21cups-browsed20:15:182
3812420993223,5cyclictest3899771-21unixbench_singl22:30:472
3812420993223,5cyclictest3840944-21cron20:45:002
3812420993222,7cyclictest3845108-21switchtime20:55:422
3812420993214,14cyclictest421-21dbus-daemon21:59:512
3812420993211,16cyclictest351ktimers/219:30:362
3812419993224,5cyclictest2060917-21cups-browsed20:57:511
3812419993223,6cyclictest3837862-21grep20:30:431
3812418993227,3cyclictest0-21swapper/019:50:010
3812418993226,3cyclictest3855317-21fschecks_count21:20:230
3812418993225,5cyclictest265-21systemd-journal22:20:000
3812418993225,4cyclictest3973007-21kernelversion00:30:260
3812418993225,4cyclictest3973007-21kernelversion00:30:260
3812418993224,6cyclictest3880187-21fschecks_time22:00:230
3812418993224,6cyclictest3880187-21fschecks_time22:00:230
3812418993220,4cyclictest3812417-21cyclictest20:55:430
381241899321,26cyclictest665-21snmpd20:30:300
381242199316,6cyclictest0-21swapper/323:25:363
3812420993124,4cyclictest1002-21mta-sts-daemon19:15:352
3812420993124,3cyclictest0-21swapper/223:40:222
381242099312,26cyclictest3967135-21ssh00:20:342
3812420993119,10cyclictest3823763-21needreboot19:45:272
3812419993124,4cyclictest1001-21mta-sts-daemon21:45:221
3812419993123,6cyclictest3941304-21sh23:40:011
3812419993123,5cyclictest2060917-21cups-browsed21:10:201
3812419993122,7cyclictest3890651-21sh22:16:111
3812419993122,6cyclictest1-21systemd22:10:011
381241999311,22cyclictest3858913-21ssh21:25:341
3812418993126,3cyclictest3919761-21latency_hist23:05:020
3812418993123,5cyclictest3959967-21latency_hist00:10:020
3812418993122,6cyclictest3916805-21latency_hist23:00:020
3812420993022,5cyclictest3829880-21ntp_offset20:05:322
3812420993022,5cyclictest1-21systemd20:15:022
381242099301,23cyclictest3960958-21ssh00:10:322
3812419993024,4cyclictest1002-21mta-sts-daemon23:28:041
3812419993024,3cyclictest0-21swapper/120:20:011
3812419993023,4cyclictest3831870-21unixbench_singl20:10:421
3812419993023,4cyclictest1003-21mta-sts-daemon00:05:011
3812419993023,3cyclictest0-21swapper/123:45:311
3812419993023,3cyclictest0-21swapper/122:40:321
3812419993022,5cyclictest441-21thd00:08:461
3812419993022,4cyclictest1003-21mta-sts-daemon20:25:011
3812419993021,7cyclictest3964267-21sh00:15:401
3812419993021,7cyclictest3828950-21cron20:05:011
3812419993018,9cyclictest428-21mta-sts-daemon23:24:241
3812418993024,3cyclictest0-21swapper/022:05:410
3812418993024,3cyclictest0-21swapper/000:15:010
3812418993021,7cyclictest3823118-21latency_hist19:45:030
3812420992922,4cyclictest1001-21mta-sts-daemon00:37:582
3812420992922,4cyclictest1001-21mta-sts-daemon00:37:582
381241999299,17cyclictest271ktimers/123:05:331
3812419992924,2cyclictest0-21swapper/121:20:011
3812419992923,3cyclictest0-21swapper/122:10:291
3812419992922,4cyclictest2060917-21cups-browsed20:38:351
3812419992921,5cyclictest3817723-21needreboot19:25:291
381241999291,21cyclictest3874490-21ssh21:50:471
381241899293,22cyclictest3942335-21sshd23:40:280
381241899292,22cyclictest421-21dbus-daemon19:30:320
3812418992920,6cyclictest3873169-21sh21:49:320
381242099283,7cyclictest0-21swapper/220:00:372
3812420992821,3cyclictest0-21swapper/222:40:232
3812419992821,4cyclictest3815749-21aten_r2power_fr19:20:201
3812419992821,4cyclictest3815749-21aten_r2power_fr19:20:201
3812419992821,3cyclictest0-21swapper/123:50:291
3812419992820,4cyclictest0-21swapper/122:35:331
381241899283,20cyclictest3923875-21ssh23:10:330
3812418992822,4cyclictest3895233-21latency_hist22:25:020
3812418992822,4cyclictest3843932-21cron20:55:000
3812418992822,3cyclictest1001-21mta-sts-daemon22:53:410
3812418992822,3cyclictest0-21swapper/021:10:400
3812418992822,3cyclictest0-21swapper/019:25:010
3812418992822,3cyclictest0-21swapper/019:25:010
3812418992821,4cyclictest1003-21mta-sts-daemon23:30:100
3812418992819,6cyclictest3955185-21timerandwakeup00:00:550
381241899281,22cyclictest2060914-21cupsd20:15:260
3812420992720,3cyclictest0-21swapper/220:35:012
3812420992719,3cyclictest0-21swapper/220:50:012
3812420992716,7cyclictest567-21gdbus21:05:222
3812419992721,3cyclictest0-21swapper/100:25:321
3812419992719,5cyclictest3821398-21sendmail19:40:011
3812419992718,6cyclictest567-21gdbus20:45:371
3812419992716,7cyclictest3914759-21grep22:55:391
3812418992721,4cyclictest3930039-21ntp_kernel_pll_23:20:340
3812418992719,5cyclictest3859445-21unixbench_singl21:25:420
3812420992621,2cyclictest0-21swapper/221:05:022
3812419992620,3cyclictest0-21swapper/121:10:021
3812419992620,3cyclictest0-21swapper/119:15:421
3812419992617,6cyclictest0-21swapper/122:25:251
3812418992622,2cyclictest0-21swapper/019:20:010
3812418992621,2cyclictest0-21swapper/022:30:010
3812418992620,3cyclictest0-21swapper/022:40:200
3812418992620,3cyclictest0-21swapper/000:15:280
3812418992618,5cyclictest3834949-21kworker/u8:10+xprtiod20:45:000
381241899261,6cyclictest3945566-21ntpq23:45:360
3812420992511,11cyclictest1002-21mta-sts-daemon19:10:302
3812419992518,4cyclictest3843962-21systemd-run20:55:011
3812419992518,3cyclictest0-21swapper/122:23:471
3812419992516,6cyclictest3827436-21idleruntime-cro20:00:011
3812418992511,11cyclictest0-21swapper/020:20:490
3812419992419,2cyclictest0-21swapper/120:45:011
3812418992417,4cyclictest3817424-21fschecks_count19:25:240
3812418992415,6cyclictest3830442-21cron20:10:010
3812418992415,5cyclictest3801482-21kworker/u8:16-xprtiod21:01:280
381241999232,15cyclictest3829852-21ntpq20:05:311
3812419992317,4cyclictest3846945-21cron21:05:011
3812419992316,2cyclictest0-21swapper/120:25:341
3812418992318,2cyclictest0-21swapper/019:10:420
3812418992317,4cyclictest3838474-21fschecks_time20:35:240
3812418992312,9cyclictest0-21swapper/019:35:270
381241899231,19cyclictest3841800-21ntpq20:45:290
3812419992216,3cyclictest1002-21mta-sts-daemon19:32:331
381241899222,15cyclictest3835926-21ntp_states20:25:380
3812418992210,2cyclictest0-21swapper/021:05:330
381242199192,10cyclictest0-21swapper/323:30:323
3812419991912,3cyclictest0-21swapper/119:10:021
381242199182,10cyclictest0-21swapper/321:50:453
381242199181,10cyclictest0-21swapper/323:05:333
381242199173,7cyclictest0-21swapper/319:15:293
381242199172,9cyclictest0-21swapper/323:50:283
381242199172,9cyclictest0-21swapper/323:40:203
381242199172,9cyclictest0-21swapper/300:15:333
381242199172,8cyclictest0-21swapper/323:35:283
381242199172,8cyclictest0-21swapper/322:30:393
381242199172,8cyclictest0-21swapper/321:15:323
381242199172,8cyclictest0-21swapper/300:05:393
381242199171,10cyclictest0-21swapper/322:25:343
381242199164,5cyclictest0-21swapper/300:30:353
381242199164,5cyclictest0-21swapper/300:30:353
381242199162,9cyclictest0-21swapper/321:35:383
381242199162,8cyclictest0-21swapper/323:15:343
381242199162,7cyclictest0-21swapper/322:15:323
381242199161,8cyclictest0-21swapper/321:10:393
381242199160,8cyclictest0-21swapper/319:50:313
3812420991611,3cyclictest3812417-21cyclictest19:10:012
3812418991612,2cyclictest0-21swapper/019:10:010
381242199153,8cyclictest0-21swapper/322:05:203
381242199153,7cyclictest0-21swapper/300:00:433
381242199153,4cyclictest0-21swapper/320:30:293
381242199152,8cyclictest0-21swapper/321:55:353
381242199152,7cyclictest0-21swapper/323:00:363
381242199152,7cyclictest0-21swapper/322:50:263
381242199152,7cyclictest0-21swapper/320:35:303
381242199152,6cyclictest0-21swapper/321:30:223
381242199151,9cyclictest0-21swapper/321:25:303
381242199151,8cyclictest0-21swapper/323:55:323
381242199151,8cyclictest0-21swapper/321:20:293
381242199151,8cyclictest0-21swapper/300:25:313
381242199151,8cyclictest0-21swapper/300:20:353
381242199151,7cyclictest0-21swapper/320:15:293
381242199151,6cyclictest0-21swapper/321:00:303
381242199151,6cyclictest0-21swapper/320:50:323
381242199151,6cyclictest0-21swapper/319:55:283
381242199145,6cyclictest0-21swapper/323:10:313
381242199142,8cyclictest0-21swapper/323:20:283
381242199142,7cyclictest0-21swapper/322:10:403
381242199142,7cyclictest0-21swapper/300:10:313
381242199142,6cyclictest0-21swapper/320:05:013
381242199141,9cyclictest0-21swapper/322:20:433
381242199141,9cyclictest0-21swapper/321:40:243
381242199141,8cyclictest0-21swapper/319:25:313
381242199141,6cyclictest0-21swapper/320:55:313
381242199134,5cyclictest0-21swapper/321:10:013
381242199133,7cyclictest0-21swapper/322:00:433
381242199133,7cyclictest0-21swapper/322:00:433
381242199133,6cyclictest0-21swapper/320:25:343
381242199132,7cyclictest0-21swapper/322:45:243
381242199132,7cyclictest0-21swapper/319:45:013
381242199132,6cyclictest0-21swapper/300:35:203
381242199132,6cyclictest0-21swapper/300:35:203
381242199131,8cyclictest0-21swapper/323:45:363
381242199131,8cyclictest0-21swapper/322:35:233
381242199131,7cyclictest0-21swapper/321:45:263
381242199131,6cyclictest0-21swapper/319:35:303
381242199131,5cyclictest0-21swapper/320:40:293
381242199123,6cyclictest0-21swapper/322:55:213
381242199122,7cyclictest0-21swapper/322:40:193
381242199121,6cyclictest0-21swapper/320:45:293
381242199121,6cyclictest0-21swapper/320:20:433
381242199121,6cyclictest0-21swapper/319:20:303
381242199121,6cyclictest0-21swapper/319:20:303
381242199112,6cyclictest0-21swapper/320:10:203
381242199111,6cyclictest0-21swapper/320:05:193
381242199111,6cyclictest0-21swapper/319:30:323
381242199102,4cyclictest0-21swapper/319:10:233
38124219991,5cyclictest0-21swapper/319:45:293
38124219981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional