You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 18:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Sat Jul 11, 2026 12:43:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3199265995533,18cyclictest0-21swapper/110:15:431
3199266995238,10cyclictest3253532-21munin-plugin-st09:40:012
3199265995228,5cyclictest3235242-21diskmemload12:35:011
3199265995227,5cyclictest3306608-21unixbench_multi11:05:521
319926499512,29cyclictest3254657-21ssh09:40:420
3199264995026,21cyclictest3288452-21unixbench_multi10:35:510
3199265994938,6cyclictest3211478-21/usr/sbin/munin07:50:291
3199266994840,5cyclictest1000-21mta-sts-daemon09:10:022
3199265994838,6cyclictest420-21avahi-daemon12:10:481
3199265994829,3cyclictest0-21swapper/112:20:011
3199265994823,8cyclictest3332572-21aten_r2power_en11:50:281
3199265994738,6cyclictest3315648-21unixbench-2d11:20:511
3199265994722,7cyclictest3285349-21timerwakeupswit10:30:511
3199264994718,4cyclictest0-21swapper/011:45:400
3199264994718,4cyclictest0-21swapper/011:45:400
3199265994637,5cyclictest3209762-21idleruntime-cro07:45:011
3199264994625,18cyclictest0-21swapper/011:00:010
3199264994624,19cyclictest3295909-21systemd-run10:50:020
319926699455,32cyclictest3342352-21ssh12:05:442
3199266994534,7cyclictest3259629-21unin-run09:50:022
3199266994435,5cyclictest0-21swapper/209:20:012
3199266994435,5cyclictest0-21swapper/209:20:012
319926699434,25cyclictest1001-21mta-sts-daemon09:30:452
3199266994336,3cyclictest0-21swapper/210:40:012
319926699431,34cyclictest3321188-21ssh11:30:432
3199264994325,11cyclictest12650irq/32-eth012:15:420
3199264994319,4cyclictest3226134-21unixbench_multi08:35:490
3199264994319,4cyclictest3226134-21unixbench_multi08:35:490
3199266994234,5cyclictest421-21dbus-daemon08:15:012
3199266994234,5cyclictest3265617-21ssh10:00:012
3199265994234,5cyclictest1-21systemd09:25:011
3199265994234,5cyclictest1-21systemd09:25:011
3199265994232,7cyclictest421-21dbus-daemon12:20:461
319926599422,31cyclictest3299975-21ssh10:55:401
319926499426,6cyclictest421-21dbus-daemon12:20:460
3199264994220,4cyclictest427-21polkitd07:46:040
3199266994133,5cyclictest3338229-21latency_hist12:00:022
3199266994130,7cyclictest2395397-21cups-browsed12:34:312
3199264994131,7cyclictest12750irq/33-eth010:30:390
319926499412,32cyclictest3262284-21kworker/u8:1+rpciod10:15:460
319926499412,31cyclictest3290888-21ssh10:40:380
3199264994120,5cyclictest2395397-21cups-browsed11:10:170
3199264994117,3cyclictest1000-21mta-sts-daemon07:50:380
3199266994032,5cyclictest3229766-21fschecks_time08:50:322
3199266994032,5cyclictest3206661-21unixbench_singl07:30:522
3199265994033,4cyclictest3241324-21sh09:20:011
3199265994033,4cyclictest3241324-21sh09:20:011
3199265994031,7cyclictest3265630-21sendmail10:00:011
3199265994031,5cyclictest3323832-21if_eth011:35:371
3199264994034,4cyclictest3323111-21systemd-run11:35:020
3199266993931,5cyclictest3304976-21cut11:05:012
3199266993927,8cyclictest420-21avahi-daemon09:54:092
3199265993930,6cyclictest439-21systemd-logind10:30:021
3199264993929,4cyclictest3298930-21systemd-run10:55:010
3199264993929,4cyclictest3298930-21systemd-run10:55:010
3199264993924,12cyclictest3257103-21aten2.4-expect09:45:310
3199266993830,5cyclictest3226241-21sh08:40:002
3199266993830,5cyclictest3226241-21sh08:40:002
3199266993830,5cyclictest2395397-21cups-browsed10:20:442
3199266993828,7cyclictest2395397-21cups-browsed12:39:502
3199266993827,7cyclictest2395393-21cupsd11:41:072
3199266993827,7cyclictest2395393-21cupsd11:41:072
3199265993831,4cyclictest3215774-21kworker/u8:12-xprtiod09:45:321
3199265993830,5cyclictest3318366-21sendmail_mailqu11:25:531
3199265993827,8cyclictest3356296-21cut12:30:021
3199264993831,4cyclictest3265652-21tr10:00:010
3199264993818,3cyclictest0-21swapper/009:17:360
3199264993818,3cyclictest0-21swapper/009:17:360
3199264993815,6cyclictest12750irq/33-eth011:15:300
3199265993729,5cyclictest0-21swapper/108:40:001
3199265993729,5cyclictest0-21swapper/108:40:001
3199265993728,6cyclictest3336776-21grep11:55:541
3199265993728,5cyclictest485-21in:imuxsock07:50:021
3199265993728,5cyclictest2395397-21cups-browsed12:01:181
3199264993729,6cyclictest2395397-21cups-browsed10:25:420
3199264993729,5cyclictest3304998-21systemd-run11:05:010
3199264993727,4cyclictest0-21swapper/012:40:020
3199264993723,11cyclictest0-21swapper/008:20:010
3199264993715,5cyclictest12650irq/32-eth009:35:020
319926699366,20cyclictest428-21mta-sts-daemon09:20:402
319926699366,20cyclictest428-21mta-sts-daemon09:20:402
3199266993630,3cyclictest0-21swapper/211:00:002
3199266993629,4cyclictest1000-21mta-sts-daemon07:10:412
3199266993629,4cyclictest1000-21mta-sts-daemon07:10:412
319926599367,6cyclictest3235242-21diskmemload12:35:391
3199265993628,5cyclictest3220284-21systemd-run08:20:011
3199264993629,4cyclictest3261317-21vmstat09:50:520
3199264993628,5cyclictest2395397-21cups-browsed11:59:490
3199266993529,3cyclictest0-21swapper/209:00:012
3199266993527,5cyclictest3298935-21ssh10:55:022
3199266993527,5cyclictest3298935-21ssh10:55:022
3199266993526,6cyclictest421-21dbus-daemon11:10:282
3199266993525,6cyclictest2395393-21cupsd09:13:572
3199266993515,14cyclictest351ktimers/210:30:442
3199265993530,2cyclictest0-21swapper/111:15:011
319926499358,10cyclictest12650irq/32-eth012:25:430
3199264993530,3cyclictest3264968-21kworker/u8:4-xprtiod11:10:010
3199264993528,5cyclictest420-21avahi-daemon07:40:340
3199264993527,6cyclictest0-21swapper/012:05:020
3199264993523,7cyclictest151ktimers/007:35:430
3199264993520,2cyclictest0-21swapper/011:35:550
3199264993517,2cyclictest0-21swapper/011:43:560
3199264993517,2cyclictest0-21swapper/011:43:560
3199266993428,4cyclictest3199263-21cyclictest08:15:322
3199266993426,5cyclictest3205151-21grep07:25:492
3199266993426,5cyclictest0-21swapper/211:55:002
3199266993425,5cyclictest3289868-21kworker/u8:5-xprtiod11:16:532
3199266993424,6cyclictest2395397-21cups-browsed10:01:402
3199266993424,6cyclictest2395397-21cups-browsed10:01:402
3199266993424,6cyclictest2395393-21cupsd12:12:192
319926699342,26cyclictest3269824-21ssh10:05:432
3199265993428,3cyclictest0-21swapper/111:20:011
3199265993428,3cyclictest0-21swapper/109:15:011
3199264993429,3cyclictest0-21swapper/011:25:010
3199264993425,7cyclictest3236599-21mailstats09:10:490
3199264993425,6cyclictest2395397-21cups-browsed10:20:110
319926699334,15cyclictest428-21mta-sts-daemon07:15:462
319926699334,15cyclictest428-21mta-sts-daemon07:15:462
3199266993326,3cyclictest0-21swapper/212:15:492
3199266993323,7cyclictest3208237-21latency_hist07:40:012
319926699332,25cyclictest3306203-21ssh11:05:472
3199265993327,3cyclictest0-21swapper/107:40:011
3199265993325,5cyclictest3247518-21latency_hist09:30:021
3199265993325,4cyclictest3303698-21kworker/u8:11-rpciod11:45:011
3199265993325,4cyclictest3303698-21kworker/u8:11-rpciod11:45:011
3199265993324,6cyclictest265-21systemd-journal08:35:011
3199265993324,6cyclictest2395397-21cups-browsed11:33:031
3199264993328,2cyclictest0-21swapper/007:30:010
3199264993317,11cyclictest12650irq/32-eth012:05:420
3199266993226,3cyclictest2501263-21kworker/u8:5-nfsiod08:00:402
3199266993222,8cyclictest3222522-21missed_timers08:25:352
3199266993222,8cyclictest3222522-21missed_timers08:25:352
3199266993222,7cyclictest3277735-21sendmail10:20:012
3199265993227,3cyclictest0-21swapper/107:10:001
3199265993227,3cyclictest0-21swapper/107:10:001
3199265993226,3cyclictest0-21swapper/109:00:011
3199265993225,5cyclictest3215772-21systemd-run08:05:011
3199265993225,4cyclictest1000-21mta-sts-daemon10:07:401
3199265993225,3cyclictest0-21swapper/110:50:501
3199265993225,3cyclictest0-21swapper/110:50:501
3199265993225,3cyclictest0-21swapper/108:45:421
3199265993224,6cyclictest3261121-21timerwakeupswit09:50:511
3199265993224,5cyclictest3342808-21unixbench-2d12:05:531
3199265993224,5cyclictest3233766-21systemd-run09:05:011
3199265993223,5cyclictest1003-21mta-sts-daemon11:48:581
3199265993223,5cyclictest1003-21mta-sts-daemon11:48:581
3199266993126,2cyclictest0-21swapper/211:40:012
3199266993124,3cyclictest0-21swapper/211:45:452
3199266993124,3cyclictest0-21swapper/211:45:452
3199266993124,3cyclictest0-21swapper/209:45:012
3199265993123,5cyclictest439-21systemd-logind10:50:021
3199265993121,7cyclictest2395393-21cupsd10:35:041
3199265993121,6cyclictest3266314-21fschecks_count10:00:331
3199265993121,6cyclictest3266314-21fschecks_count10:00:331
3199265993120,7cyclictest2395397-21cups-browsed09:42:361
3199264993125,3cyclictest0-21swapper/012:30:340
3199264993124,4cyclictest3229316-21latency_hist08:50:010
319926499311,23cyclictest3266846-21ssh10:00:460
319926499311,23cyclictest3266846-21ssh10:00:460
3199266993023,4cyclictest1002-21mta-sts-daemon12:01:352
319926699302,23cyclictest2395397-21cups-browsed10:14:302
319926699302,19cyclictest3281961-21ssh10:25:462
3199265993025,2cyclictest0-21swapper/107:20:011
3199265993025,2cyclictest0-21swapper/107:20:011
3199265993023,4cyclictest3252081-21grep09:35:521
3199265993023,3cyclictest0-21swapper/109:35:011
3199264993024,4cyclictest3347292-21latency_hist12:15:020
319926699298,11cyclictest3293960-21ssh10:45:402
3199266992923,3cyclictest0-21swapper/207:10:012
3199266992923,3cyclictest0-21swapper/207:10:012
3199266992919,8cyclictest3221072-21needreboot08:20:372
3199266992918,8cyclictest3203137-21ntp_kernel_pll_07:20:392
3199265992924,2cyclictest0-21swapper/110:25:011
3199265992923,3cyclictest0-21swapper/111:05:011
3199265992922,4cyclictest1002-21mta-sts-daemon07:30:431
3199265992921,5cyclictest3230730-21cron08:55:011
3199265992921,5cyclictest3214158-21head07:55:511
3199265992921,5cyclictest2395397-21cups-browsed08:23:531
3199265992919,7cyclictest3218082-21ntp_kernel_err08:10:391
3199264992922,5cyclictest420-21avahi-daemon08:10:500
3199264992921,6cyclictest3227720-21sshd08:40:530
3199264992921,3cyclictest0-21swapper/008:25:400
3199264992921,3cyclictest0-21swapper/008:25:400
3199264992917,9cyclictest3206482-21timerandwakeup07:30:510
319926499291,20cyclictest3269872-21diskmemload10:05:460
319926699288,6cyclictest171rcu_preempt12:25:442
319926699282,4cyclictest171rcu_preempt10:40:392
3199266992822,3cyclictest1000-21mta-sts-daemon09:28:522
3199266992822,3cyclictest0-21swapper/207:40:512
3199266992821,4cyclictest3211092-21unixbench-2d07:45:522
3199266992815,10cyclictest3211471-21/usr/sbin/munin07:50:312
319926599285,14cyclictest2494265-21munin-node07:10:391
319926599285,14cyclictest2494265-21munin-node07:10:391
319926599281,20cyclictest2395397-21cups-browsed08:05:431
3199265992811,12cyclictest3272333-21df_inode10:10:331
3199264992822,3cyclictest3303698-21kworker/u8:11-rpciod11:25:510
3199264992820,6cyclictest3273365-21unixbench_singl10:10:530
3199264992819,7cyclictest3217262-21systemd-run08:10:010
3199264992818,7cyclictest0-21swapper/007:25:000
3199264992818,4cyclictest3233669-21unixbench_singl09:00:510
3199266992721,3cyclictest0-21swapper/209:05:012
3199266992720,4cyclictest3351896-21unixbench_multi12:20:542
3199266992719,5cyclictest3224267-21proc_pri08:30:442
3199266992719,5cyclictest1001-21mta-sts-daemon07:55:452
3199264992721,4cyclictest3231259-21fschecks_time08:55:330
3199264992721,4cyclictest3230730-21cron08:55:010
3199264992721,3cyclictest0-21swapper/011:55:000
3199264992721,3cyclictest0-21swapper/009:20:500
3199264992721,3cyclictest0-21swapper/009:20:500
3199264992719,6cyclictest2395397-21cups-browsed07:15:360
3199264992719,6cyclictest2395397-21cups-browsed07:15:360
319926699262,18cyclictest3315079-21ntpq11:20:372
319926699262,17cyclictest3318113-21ntpq11:25:442
3199266992618,5cyclictest0-21swapper/208:45:002
3199265992618,5cyclictest421-21dbus-daemon10:40:341
3199265992617,6cyclictest3235236-21cron09:10:011
3199264992620,3cyclictest3146685-21kworker/u8:10-xprtiod08:35:010
3199264992618,6cyclictest3245396-21needreboot09:25:380
3199264992618,6cyclictest3218762-21kworker/u8:18+events_unbound08:20:480
3199264992616,7cyclictest151ktimers/008:00:370
3199264992614,10cyclictest3200698-21head07:10:520
3199264992614,10cyclictest3200698-21head07:10:520
319926499261,21cyclictest627-21lldpd09:39:300
3199266992518,4cyclictest1000-21mta-sts-daemon08:50:012
319926599254,16cyclictest665-21snmpd08:25:401
319926599254,16cyclictest665-21snmpd08:25:401
3199265992516,7cyclictest3204300-21gltestperf07:25:321
319926699242,17cyclictest3216725-21ntp_states08:05:482
3199265992315,5cyclictest3203753-21cron07:25:001
319926499232,16cyclictest3213692-21ntp_states07:55:440
3199264992211,8cyclictest3234480-21memory09:05:350
3199265992114,3cyclictest0-21swapper/108:40:381
319926799201,7cyclictest0-21swapper/307:45:403
319926799192,9cyclictest0-21swapper/310:25:393
319926799192,9cyclictest0-21swapper/309:45:403
319926499197,9cyclictest12750irq/33-eth007:10:000
319926499197,9cyclictest12750irq/33-eth007:10:000
319926799183,8cyclictest0-21swapper/312:15:423
319926799183,8cyclictest0-21swapper/307:50:403
319926799182,9cyclictest0-21swapper/310:20:383
319926799174,7cyclictest0-21swapper/312:35:423
319926799173,7cyclictest0-21swapper/309:25:353
319926799172,9cyclictest0-21swapper/310:55:463
319926799172,9cyclictest0-21swapper/309:10:323
319926799172,8cyclictest0-21swapper/311:45:393
319926799172,8cyclictest0-21swapper/311:45:393
319926799172,8cyclictest0-21swapper/310:35:403
319926799172,8cyclictest0-21swapper/309:59:503
319926799172,7cyclictest0-21swapper/310:30:323
319926799172,7cyclictest0-21swapper/308:05:413
319926799171,8cyclictest0-21swapper/311:40:443
319926799171,8cyclictest0-21swapper/311:40:443
319926799164,7cyclictest0-21swapper/311:35:503
319926799164,5cyclictest0-21swapper/308:55:433
319926799163,8cyclictest0-21swapper/307:40:453
319926799163,7cyclictest0-21swapper/311:20:393
319926799162,9cyclictest0-21swapper/312:00:483
319926799162,9cyclictest0-21swapper/310:00:463
319926799162,9cyclictest0-21swapper/310:00:463
319926799162,7cyclictest0-21swapper/311:05:403
319926799162,10cyclictest0-21swapper/310:15:453
319926799161,8cyclictest0-21swapper/310:40:313
319926799156,6cyclictest0-21swapper/310:45:393
319926799153,8cyclictest0-21swapper/312:25:343
319926799153,7cyclictest0-21swapper/309:50:303
319926799153,7cyclictest0-21swapper/309:40:393
319926799153,4cyclictest0-21swapper/308:25:373
319926799153,4cyclictest0-21swapper/308:25:373
319926799152,8cyclictest0-21swapper/312:30:443
319926799152,8cyclictest0-21swapper/312:05:483
319926799152,8cyclictest0-21swapper/311:25:453
319926799152,8cyclictest0-21swapper/310:10:413
319926799152,7cyclictest0-21swapper/312:10:363
319926799152,7cyclictest0-21swapper/311:10:293
319926799152,7cyclictest0-21swapper/310:50:393
319926799152,7cyclictest0-21swapper/310:50:393
319926799152,7cyclictest0-21swapper/308:15:373
319926799152,6cyclictest0-21swapper/308:35:373
319926799152,6cyclictest0-21swapper/308:35:373
319926799152,5cyclictest0-21swapper/309:00:393
319926799151,8cyclictest0-21swapper/311:55:403
319926799151,8cyclictest0-21swapper/311:30:413
319926799151,6cyclictest0-21swapper/307:10:413
319926799151,6cyclictest0-21swapper/307:10:413
319926799143,7cyclictest0-21swapper/309:35:333
319926799143,6cyclictest0-21swapper/308:50:403
319926799143,6cyclictest0-21swapper/308:10:403
319926799142,8cyclictest0-21swapper/311:50:333
319926799142,7cyclictest0-21swapper/310:05:333
319926799142,7cyclictest0-21swapper/308:50:013
319926799142,6cyclictest0-21swapper/307:55:423
319926799141,9cyclictest0-21swapper/307:30:393
319926799141,8cyclictest0-21swapper/312:20:423
319926799141,8cyclictest0-21swapper/311:15:403
319926799141,6cyclictest0-21swapper/309:30:293
319926799141,6cyclictest0-21swapper/307:35:413
319926799141,5cyclictest0-21swapper/309:05:383
319926799133,7cyclictest0-21swapper/311:00:323
319926799133,5cyclictest0-21swapper/309:15:303
319926799133,5cyclictest0-21swapper/309:15:303
319926799132,7cyclictest0-21swapper/309:20:293
319926799132,7cyclictest0-21swapper/309:20:293
319926799132,6cyclictest0-21swapper/308:40:453
319926799132,6cyclictest0-21swapper/307:30:003
319926799131,7cyclictest0-21swapper/307:25:003
319926799131,6cyclictest0-21swapper/308:20:363
319926799122,6cyclictest0-21swapper/307:15:453
319926799122,6cyclictest0-21swapper/307:15:453
319926799122,5cyclictest0-21swapper/308:00:343
319926799114,6cyclictest0-21swapper/307:10:013
319926799114,6cyclictest0-21swapper/307:10:013
319926799102,5cyclictest0-21swapper/308:30:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional