You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 14:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Jul 09, 2026 12:43:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3605031995931,24cyclictest3626042-21sh08:20:012
3605031995630,22cyclictest3647188-21sendmail09:20:012
360502999542,49cyclictest3651308-21ssh09:25:390
3605031995025,21cyclictest0-21swapper/209:30:512
3605031994925,20cyclictest0-21swapper/212:15:322
3605031994827,18cyclictest0-21swapper/210:10:292
3605031994827,18cyclictest0-21swapper/210:10:292
3605031994739,5cyclictest3707669-21munin-plugin-st11:00:012
3605031994738,6cyclictest3665533-21latency_hist09:50:022
3605031994724,20cyclictest421-21dbus-daemon12:00:012
3605031994619,6cyclictest3708749-21ntpq11:00:392
3605031994619,5cyclictest0-21swapper/211:15:412
360503199461,21cyclictest3660412-21sh09:40:382
3605030994638,5cyclictest3668471-21systemd-run09:55:011
3605031994537,5cyclictest3765122-21debian-sa112:35:002
360503199453,18cyclictest3693613-21ssh10:35:392
3605031994520,4cyclictest0-21swapper/209:25:512
3605029994536,6cyclictest3653960-21gltestperf09:30:310
3605031994433,7cyclictest3698598-21cron10:45:012
3605031994423,18cyclictest0-21swapper/210:20:482
3605030994429,12cyclictest3711160-21aten_r2power_fr11:05:281
360502999443,35cyclictest3675563-21ssh10:05:370
3605031994335,5cyclictest3615539-21systemd-run07:45:022
3605031994318,3cyclictest0-21swapper/210:25:512
3605030994335,4cyclictest0-21swapper/110:30:401
360502999436,6cyclictest171rcu_preempt10:20:430
3605029994332,7cyclictest2803590-21cups-browsed10:00:320
3605029994332,7cyclictest2803590-21cups-browsed10:00:320
3605031994215,11cyclictest351ktimers/211:40:372
3605030994234,5cyclictest3715364-21unixbench_multi11:10:521
3605030994233,5cyclictest2803590-21cups-browsed12:10:011
3605030994233,5cyclictest1001-21mta-sts-daemon10:00:251
3605030994233,5cyclictest1001-21mta-sts-daemon10:00:251
360502999424,34cyclictest3757278-21ssh12:20:440
3605029994236,4cyclictest3731876-21systemctl11:40:010
3605029994234,5cyclictest3763108-21needreboot12:30:390
3605029994228,12cyclictest421-21dbus-daemon11:45:020
3605029994228,11cyclictest151ktimers/007:35:450
3605031994131,6cyclictest1-21systemd10:15:542
3605031994120,4cyclictest3622582-21sendmail_mailqu08:05:472
3605031994119,2cyclictest0-21swapper/212:40:022
3605031994118,8cyclictest3757499-21switchtime12:20:492
3605031994118,3cyclictest0-21swapper/209:20:292
3605030994132,5cyclictest3757309-21proc_pri12:20:451
3605030994131,6cyclictest420-21avahi-daemon09:46:491
3605030994131,6cyclictest265-21systemd-journal10:25:581
3605030994130,7cyclictest420-21avahi-daemon09:38:331
3605030994130,7cyclictest420-21avahi-daemon09:38:331
3605029994123,11cyclictest151ktimers/011:10:400
3605031994032,4cyclictest0-21swapper/210:30:522
3605031994027,10cyclictest3669836-21switchtime09:55:482
3605030994032,5cyclictest3669676-21proc_pri09:55:441
3605030994032,4cyclictest1003-21mta-sts-daemon10:56:201
3605029994018,12cyclictest12650irq/32-eth011:15:420
360503199394,25cyclictest3714835-21ssh11:10:422
3605031993930,5cyclictest2803590-21cups-browsed12:05:372
3605030993931,5cyclictest3724472-21unixbench_singl11:25:501
3605030993931,4cyclictest3638006-21idleruntime-cro09:00:011
3605030993930,6cyclictest3651593-21sshd09:25:491
3605030993930,5cyclictest3734894-21ssh11:45:011
3605030993928,8cyclictest3650231-21sh09:25:011
3605029993933,4cyclictest3740921-21debian-sa111:55:010
3605031993831,4cyclictest3644110-21idleruntime-cro09:15:012
3605031993828,6cyclictest3712180-21timerandwakeup11:05:532
3605031993826,8cyclictest3720905-21ntp_offset11:20:392
3605031993826,8cyclictest3720905-21ntp_offset11:20:392
3605030993831,3cyclictest0-21swapper/111:50:451
3605030993830,5cyclictest487-21rs:main1
3605030993830,5cyclictest3768187-21systemd-run12:40:011
3605030993830,5cyclictest3632531-21fschecks_count08:40:341
3605030993829,5cyclictest3626010-21munin-run08:20:011
360503199375,25cyclictest3736076-21ssh11:45:442
3605031993728,6cyclictest3728834-21cron11:35:012
3605031993728,6cyclictest3699080-21aten_r2power_fr10:45:292
360503099374,30cyclictest3635007-21munin-plugin-st08:50:011
3605030993729,5cyclictest3728832-21cron11:35:011
3605030993727,6cyclictest420-21avahi-daemon11:36:341
3605030993726,8cyclictest2901878-21munin-node10:20:581
3605029993726,8cyclictest0-21swapper/011:45:510
3605029993722,11cyclictest0-21swapper/012:25:330
360502999371,32cyclictest3678697-21diskmemload10:10:420
360502999371,32cyclictest3678697-21diskmemload10:10:420
3605031993629,4cyclictest1002-21mta-sts-daemon09:37:092
3605031993629,4cyclictest1002-21mta-sts-daemon09:37:092
3605031993628,5cyclictest3608049-21systemd-run07:20:012
3605030993630,3cyclictest0-21swapper/110:20:001
3605030993629,4cyclictest3704636-21cron10:55:001
3605030993629,4cyclictest1002-21mta-sts-daemon12:33:011
3605030993629,4cyclictest1000-21mta-sts-daemon11:20:361
3605030993629,4cyclictest1000-21mta-sts-daemon11:20:361
3605030993628,5cyclictest3694242-21grep10:35:521
3605030993627,4cyclictest1001-21mta-sts-daemon09:10:151
3605030993625,8cyclictest3635898-21ntp_kernel_pll_08:50:401
3605029993628,5cyclictest3721013-21proc_pri11:20:430
3605029993628,5cyclictest3721013-21proc_pri11:20:430
3605029993626,7cyclictest3645655-21timerwakeupswit09:15:510
3605029993621,4cyclictest3704647-21grep10:55:010
360503099354,28cyclictest3678685-21ssh10:10:411
360503099354,28cyclictest3678685-21ssh10:10:411
360502999353,19cyclictest3708707-21ssh11:00:380
3605029993528,4cyclictest0-21swapper/009:25:020
3605029993526,7cyclictest2803590-21cups-browsed09:45:420
3605029993524,8cyclictest3623820-21needreboot08:10:340
3605031993428,4cyclictest3605028-21cyclictest12:10:382
3605031993428,3cyclictest0-21swapper/211:40:012
3605030993429,2cyclictest0-21swapper/112:15:421
3605030993427,4cyclictest1003-21mta-sts-daemon10:44:361
3605029993428,4cyclictest3700221-21grep10:45:510
360502999342,26cyclictest3690616-21sh10:30:390
3605029993417,13cyclictest151ktimers/008:05:380
3605029993413,14cyclictest151ktimers/010:25:410
360503199334,18cyclictest3666588-21ssh09:50:442
3605031993326,4cyclictest3629520-21fschecks_count08:30:332
3605031993324,6cyclictest265-21systemd-journal07:35:492
360503099333,14cyclictest3660390-21ssh09:40:381
3605030993325,5cyclictest3742426-21timerwakeupswit11:55:471
3605030993325,5cyclictest3644658-21aten_r2power_vo09:15:301
3605030993325,5cyclictest3631991-21cron08:40:011
3605030993325,5cyclictest3629033-21systemd-run08:30:011
3605030993325,5cyclictest1-21systemd12:15:011
3605030993324,6cyclictest443-21gpm07:15:311
3605030993323,8cyclictest3760702-21unixbench-2d12:25:511
3605029993325,5cyclictest3698600-21cron10:45:010
3605031993222,8cyclictest3626836-21needreboot08:20:352
3605031993222,7cyclictest2803590-21cups-browsed09:05:362
360503099323,21cyclictest3654336-21ssh09:30:381
3605030993225,3cyclictest0-21swapper/111:45:321
3605030993222,7cyclictest435-21rsyslogd08:00:401
3605030993222,7cyclictest3719805-21sh11:20:011
3605030993218,8cyclictest0-21swapper/108:05:381
3605029993224,6cyclictest3609304-21timerwakeupswit07:20:490
3605029993224,3cyclictest0-21swapper/009:11:590
3605029993222,8cyclictest0-21swapper/009:40:270
3605031993125,3cyclictest0-21swapper/208:40:012
3605030993123,5cyclictest3677531-21cron10:10:001
3605030993123,4cyclictest3629547-21gltestperf08:30:331
3605029993125,4cyclictest3753034-21latency_hist12:15:010
3605029993125,4cyclictest3706691-21sh10:56:550
3605029993124,5cyclictest0-21swapper/012:05:480
3605029993113,13cyclictest12650irq/32-eth007:25:380
3605029993113,13cyclictest12650irq/32-eth007:25:380
360502999311,21cyclictest3669519-21ssh09:55:390
3605031993023,4cyclictest3609525-21idleruntime-cro07:25:002
360503199302,20cyclictest3702732-21ssh10:50:412
360503099305,15cyclictest428-21mta-sts-daemon11:00:411
3605030993024,3cyclictest0-21swapper/108:15:011
3605030993022,5cyclictest3612504-21cron07:35:001
3605030993020,7cyclictest3609044-21proc_pri07:20:441
3605029993024,4cyclictest3657836-21diskmemload09:35:520
3605029993024,4cyclictest3657836-21diskmemload09:35:520
3605029993022,4cyclictest0-21swapper/010:17:090
3605031992922,4cyclictest1001-21mta-sts-daemon08:40:262
3605031992921,5cyclictest3760700-21unixbench-2d12:25:512
3605031992921,5cyclictest3638047-21latency_hist09:00:022
3605031992921,5cyclictest3617527-21fschecks_count07:50:312
3605031992920,5cyclictest3629033-21systemd-run08:30:012
3605031992920,5cyclictest0-21swapper/207:25:362
3605031992920,5cyclictest0-21swapper/207:25:362
3605031992918,8cyclictest1000-21mta-sts-daemon08:10:312
360503199291,22cyclictest3675539-21ssh10:05:362
3605030992921,5cyclictest3640036-21fschecks_time09:05:311
3605030992921,5cyclictest3611032-21systemd-run07:30:011
3605030992921,5cyclictest3611032-21systemd-run07:30:011
360503099291,6cyclictest171rcu_preempt10:45:381
3605029992923,4cyclictest3608015-21munin-plugin-st07:20:000
3605029992923,4cyclictest2803590-21cups-browsed10:35:380
3605029992922,4cyclictest3743953-21munin-run12:00:010
360502999292,22cyclictest3726891-21ssh11:30:380
3605029992921,6cyclictest3619900-21unixbench_multi07:55:510
3605029992920,6cyclictest0-21swapper/011:25:330
3605029992918,8cyclictest0-21swapper/012:05:010
3605029992918,4cyclictest3612401-21sed07:30:490
3605031992821,4cyclictest3618973-21cpuspeed07:55:302
3605031992820,5cyclictest3724396-21unixbench-2d11:25:502
3605031992819,6cyclictest3739021-21ntp_offset11:50:412
3605030992821,4cyclictest3613401-21ntp_kernel_pll_07:35:381
3605030992821,4cyclictest0-21swapper/107:10:411
3605029992824,2cyclictest0-21swapper/008:40:010
3605029992822,3cyclictest0-21swapper/007:40:380
3605029992821,4cyclictest1002-21mta-sts-daemon12:38:490
3605029992814,9cyclictest151ktimers/008:15:380
360502999281,23cyclictest3754135-21ntpq12:15:410
360503199279,12cyclictest421-21dbus-daemon09:00:412
360503199274,15cyclictest3745063-21ssh12:00:382
3605031992718,6cyclictest1-21systemd08:50:022
360503199271,22cyclictest3672664-21ssh10:00:442
360503199271,22cyclictest3672664-21ssh10:00:442
3605030992721,3cyclictest0-21swapper/109:05:011
3605030992720,4cyclictest1003-21mta-sts-daemon08:20:421
3605030992717,8cyclictest3619405-21ntp_kernel_pll_07:55:411
3605029992721,4cyclictest3617016-21munin-plugin-st07:50:010
3605029992716,8cyclictest0-21swapper/011:05:540
3605029992711,12cyclictest12650irq/32-eth008:25:430
3605029992710,12cyclictest151ktimers/009:00:370
360503199266,14cyclictest421-21dbus-daemon08:00:402
360502999268,15cyclictest151ktimers/008:45:430
360502999262,5cyclictest171rcu_preempt09:50:410
3605029992517,5cyclictest12650irq/32-eth007:10:360
3605029992516,7cyclictest3635842-21ntp_kernel_err08:50:370
360502999251,11cyclictest3641013-21ls09:10:010
360503199244,12cyclictest428-21mta-sts-daemon07:45:422
3605031992418,3cyclictest0-21swapper/208:55:012
360503099242,17cyclictest3616472-21ntp_states07:45:411
3605030992418,3cyclictest0-21swapper/107:45:011
360502999245,14cyclictest428-21mta-sts-daemon07:50:380
3605029992416,3cyclictest3605028-21cyclictest08:00:500
3605030992317,3cyclictest0-21swapper/107:55:011
3605030992310,3cyclictest171rcu_preempt07:10:011
360502999237,10cyclictest151ktimers/008:55:380
360502999231,17cyclictest3632932-21sshd08:40:500
3605029992311,7cyclictest12650irq/32-eth008:30:400
3605031992218,2cyclictest0-21swapper/207:35:012
3605029992217,3cyclictest3627439-21unixbench_singl08:20:490
3605031992116,2cyclictest0-21swapper/207:10:482
3605031992014,3cyclictest0-21swapper/207:10:012
360503299182,7cyclictest0-21swapper/310:15:413
360502999188,7cyclictest421-21dbus-daemon07:10:010
360503299172,8cyclictest0-21swapper/310:45:463
360503299172,8cyclictest0-21swapper/310:35:403
360503299171,8cyclictest0-21swapper/309:25:433
360503299164,6cyclictest0-21swapper/310:25:523
360503299164,5cyclictest0-21swapper/309:10:403
360503299163,8cyclictest0-21swapper/311:25:503
360503299163,7cyclictest0-21swapper/308:45:443
360503299163,6cyclictest0-21swapper/312:20:403
360503299163,6cyclictest0-21swapper/307:10:483
360503299163,5cyclictest0-21swapper/309:05:403
360503299162,8cyclictest0-21swapper/311:10:463
360503299162,6cyclictest0-21swapper/307:40:403
360503299161,6cyclictest0-21swapper/307:50:363
360503299153,5cyclictest0-21swapper/307:25:013
360503299152,8cyclictest0-21swapper/310:10:393
360503299152,8cyclictest0-21swapper/310:10:393
360503299152,8cyclictest0-21swapper/310:00:323
360503299152,8cyclictest0-21swapper/310:00:323
360503299152,8cyclictest0-21swapper/309:40:403
360503299152,7cyclictest0-21swapper/311:05:353
360503299152,6cyclictest0-21swapper/308:35:373
360503299152,5cyclictest0-21swapper/308:10:393
360503299151,6cyclictest0-21swapper/308:05:463
360503299151,6cyclictest0-21swapper/307:55:423
360503299143,7cyclictest0-21swapper/309:20:013
360503299143,6cyclictest0-21swapper/311:30:413
360503299143,6cyclictest0-21swapper/310:40:303
360503299143,4cyclictest0-21swapper/309:00:383
360503299142,8cyclictest0-21swapper/312:15:433
360503299142,7cyclictest0-21swapper/311:45:393
360503299142,6cyclictest0-21swapper/310:05:373
360503299141,8cyclictest0-21swapper/311:35:273
360503299141,7cyclictest0-21swapper/312:35:423
360503299141,6cyclictest0-21swapper/308:50:383
360503299141,6cyclictest0-21swapper/308:40:453
360503299141,6cyclictest0-21swapper/308:30:423
360503299141,6cyclictest0-21swapper/308:00:403
360503299141,6cyclictest0-21swapper/307:35:373
360503299141,5cyclictest0-21swapper/308:15:373
360503299140,8cyclictest0-21swapper/312:05:353
360503299133,6cyclictest0-21swapper/312:10:363
360503299133,5cyclictest0-21swapper/310:20:343
360503299132,7cyclictest0-21swapper/311:00:373
360503299132,6cyclictest0-21swapper/311:50:343
360503299132,6cyclictest0-21swapper/310:50:283
360503299132,6cyclictest0-21swapper/309:45:393
360503299132,5cyclictest0-21swapper/312:00:263
360503299132,5cyclictest0-21swapper/308:55:363
360503299131,7cyclictest0-21swapper/311:00:023
360503299131,7cyclictest0-21swapper/309:20:383
360503299131,7cyclictest0-21swapper/308:25:373
360503299131,5cyclictest0-21swapper/307:15:363
360503299123,6cyclictest0-21swapper/309:55:333
360503299122,6cyclictest0-21swapper/312:30:333
360503299122,6cyclictest0-21swapper/311:40:283
360503299122,6cyclictest0-21swapper/311:15:333
360503299122,6cyclictest0-21swapper/309:50:293
360503299122,6cyclictest0-21swapper/309:35:383
360503299122,6cyclictest0-21swapper/309:35:383
360503299122,6cyclictest0-21swapper/308:20:373
360503299121,7cyclictest0-21swapper/312:25:283
360503299121,7cyclictest0-21swapper/310:30:313
360503299121,7cyclictest0-21swapper/309:30:273
360503299121,6cyclictest0-21swapper/311:55:353
360503299121,6cyclictest0-21swapper/307:45:393
360503299114,4cyclictest431ktimers/307:10:013
360503299112,6cyclictest0-21swapper/311:20:303
360503299112,6cyclictest0-21swapper/311:20:303
360503299111,6cyclictest0-21swapper/307:35:003
360503299105,3cyclictest0-21swapper/307:25:273
360503299105,3cyclictest0-21swapper/307:25:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional