You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 13:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Jul 14, 2026 12:43:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
466866996251,8cyclictest3850238-21cups-browsed08:05:010
466867995944,9cyclictest0-21swapper/111:30:541
466868994940,5cyclictest566485-21latency_hist10:55:022
466867994839,5cyclictest518103-21ssh09:35:021
466866994738,6cyclictest421-21dbus-daemon12:20:340
466867994631,7cyclictest1003-21mta-sts-daemon10:25:481
466868994538,5cyclictest551379-21kworker/u8:5-xprtiod12:25:462
466868994533,6cyclictest0-21swapper/209:35:452
466868994533,6cyclictest0-21swapper/209:35:452
466867994533,7cyclictest3850238-21cups-browsed10:45:081
466868994435,6cyclictest554362-21cron10:35:012
466867994435,6cyclictest468365-21true07:15:011
466867994435,6cyclictest468365-21true07:15:011
466867994435,5cyclictest599995-21aten_r2power_po11:50:361
466867994335,5cyclictest421-21dbus-daemon07:40:021
466868994234,5cyclictest501378-21systemd-run09:05:012
466868994232,6cyclictest600349-21latency11:50:432
466867994234,5cyclictest478872-21systemd-run07:50:011
466867994232,6cyclictest552987-21unixbench_multi10:30:531
466868994133,5cyclictest612484-21ntp_kernel_err12:10:402
466868994132,6cyclictest596529-21munin-run11:45:012
466867994133,5cyclictest617401-21grep12:20:011
466867994133,5cyclictest474345-21cron07:35:011
466867994129,6cyclictest0-21swapper/110:20:431
466868994033,4cyclictest0-21swapper/211:10:412
466867994024,11cyclictest512996-21needreboot09:25:401
466867994013,6cyclictest171rcu_preempt11:05:401
466866994034,4cyclictest506594-21fschecks_time09:15:340
466866994031,7cyclictest581527-21ssh11:20:010
466868993928,7cyclictest0-21swapper/211:45:432
466867993926,10cyclictest628055-21unixbench_singl12:35:531
466867993926,10cyclictest628055-21unixbench_singl12:35:531
466866993932,5cyclictest1003-21mta-sts-daemon11:30:520
466866993919,13cyclictest12650irq/32-eth012:25:430
46686799383,24cyclictest606487-21ssh12:00:401
466867993830,4cyclictest0-21swapper/111:25:011
466867993827,7cyclictest1000-21mta-sts-daemon09:15:221
466866993829,3cyclictest1000-21mta-sts-daemon10:08:180
46686699381,32cyclictest525321-21sh09:45:430
466868993729,4cyclictest0-21swapper/209:45:002
466868993728,6cyclictest548359-21systemd10:25:022
466868993728,6cyclictest351ktimers/207:50:452
466868993727,6cyclictest1000-21mta-sts-daemon11:30:482
466868993725,9cyclictest504393-21timerwakeupswit09:10:512
466868993725,3cyclictest171rcu_preempt11:05:412
46686799373,29cyclictest534292-21ssh10:00:401
466867993729,5cyclictest469855-21munin-plugin-st07:20:001
466867993729,5cyclictest469855-21munin-plugin-st07:20:001
466867993728,5cyclictest528768-21unixbench-2d09:50:521
466867993728,4cyclictest0-21swapper/109:40:441
466866993729,5cyclictest596731-21latency_hist11:45:020
466866993727,8cyclictest505893-21cron09:15:010
466866993718,12cyclictest543349-21sh10:15:410
46686899367,22cyclictest510223-21ssh09:20:502
466868993629,4cyclictest605660-21latency_hist12:00:022
466868993628,5cyclictest549276-21missed_timers10:25:372
46686899361,27cyclictest558630-21ssh10:40:482
46686899361,27cyclictest558630-21ssh10:40:482
466867993628,5cyclictest603235-21if_wlan011:55:361
466867993628,3cyclictest0-21swapper/110:40:431
466867993628,3cyclictest0-21swapper/110:40:431
466867993627,4cyclictest0-21swapper/111:00:361
466867993625,7cyclictest420-21avahi-daemon10:10:151
466866993631,2cyclictest0-21swapper/012:15:540
466866993628,5cyclictest421-21dbus-daemon11:05:010
466866993627,6cyclictest420-21avahi-daemon11:25:220
466866993625,8cyclictest0-21swapper/007:25:010
466868993529,3cyclictest0-21swapper/210:20:012
466868993527,5cyclictest488383-21fschecks_count08:20:322
466868993527,5cyclictest488383-21fschecks_count08:20:322
466868993526,5cyclictest531351-21sh09:55:452
466868993525,6cyclictest502852-21munin-plugin-st09:10:012
466868993524,5cyclictest0-21swapper/210:10:412
466868993522,6cyclictest0-21swapper/212:20:442
46686899351,28cyclictest561579-21ssh10:45:432
466867993528,4cyclictest545279-21cron10:20:011
466867993528,3cyclictest0-21swapper/112:30:021
466867993526,5cyclictest624677-21sendmail_mailst12:30:481
466867993526,5cyclictest509669-21gltestperf09:20:341
466866993529,4cyclictest608471-21systemd-run12:05:010
466866993529,3cyclictest0-21swapper/010:50:430
466866993527,6cyclictest0-21swapper/007:45:010
466866993527,5cyclictest420-21avahi-daemon09:56:070
466866993526,7cyclictest609963-21timerandwakeup12:05:510
466866993525,4cyclictest0-21swapper/009:40:400
466866993512,10cyclictest14-21ksoftirqd/011:35:410
466866993512,10cyclictest14-21ksoftirqd/011:35:410
466866993511,11cyclictest14-21ksoftirqd/010:40:330
466866993511,11cyclictest14-21ksoftirqd/010:40:330
466868993428,3cyclictest0-21swapper/208:20:012
466868993427,3cyclictest536268-21kworker/u8:13-xprtiod10:05:022
466868993427,3cyclictest487891-21kworker/u8:4+rpciod08:45:012
46686899342,5cyclictest0-21swapper/210:35:382
466868993425,6cyclictest1001-21mta-sts-daemon08:10:342
466868993424,7cyclictest525567-21switchtime09:45:502
466868993424,6cyclictest420-21avahi-daemon10:07:302
466868993410,7cyclictest36-21ksoftirqd/212:20:012
466867993426,5cyclictest487744-21unixbench_multi08:15:531
466867993426,4cyclictest0-21swapper/111:15:371
466867993425,5cyclictest527162-21cron09:50:001
466867993424,6cyclictest420-21avahi-daemon10:07:081
466867993421,8cyclictest592097-21timerwakeupswit11:35:561
466867993421,8cyclictest592097-21timerwakeupswit11:35:561
466866993428,4cyclictest605425-21cron12:00:010
466866993427,4cyclictest466887-21latency_hist07:10:010
466866993427,4cyclictest466887-21latency_hist07:10:010
466866993412,5cyclictest14-21ksoftirqd/010:45:450
466868993326,4cyclictest1003-21mta-sts-daemon11:15:512
466868993324,6cyclictest420-21avahi-daemon09:15:562
466868993322,7cyclictest3850238-21cups-browsed11:04:592
46686899332,24cyclictest609678-21ssh12:05:472
466868993317,3cyclictest171rcu_preempt12:31:232
466868993311,3cyclictest171rcu_preempt10:55:452
466867993327,3cyclictest0-21swapper/108:10:011
466867993325,5cyclictest565128-21unixbench_singl10:50:571
466867993324,5cyclictest3850238-21cups-browsed08:02:321
46686699339,6cyclictest14-21ksoftirqd/010:13:530
466866993323,7cyclictest547007-21unixbench_singl10:20:520
46686699332,25cyclictest3850238-21cups-browsed09:20:420
466866993311,5cyclictest14-21ksoftirqd/010:35:060
46686899326,13cyclictest351ktimers/207:40:012
46686899325,9cyclictest36-21ksoftirqd/207:10:412
46686899325,9cyclictest36-21ksoftirqd/207:10:412
466868993225,4cyclictest1002-21mta-sts-daemon12:35:492
466868993225,4cyclictest1002-21mta-sts-daemon12:35:492
466868993224,5cyclictest512921-21cat09:25:392
466868993220,3cyclictest171rcu_preempt08:35:012
466867993224,5cyclictest609388-21missed_timers12:05:361
466867993224,5cyclictest531484-21sendmail_mailqu09:55:491
466867993224,3cyclictest0-21swapper/111:45:361
466867993224,3cyclictest0-21swapper/109:10:341
466866993227,2cyclictest0-21swapper/009:00:010
466866993213,4cyclictest14-21ksoftirqd/009:50:380
466866993212,5cyclictest14-21ksoftirqd/010:55:520
466866993211,5cyclictest14-21ksoftirqd/007:45:410
466868993121,7cyclictest3850238-21cups-browsed11:35:582
466868993121,7cyclictest3850238-21cups-browsed11:35:582
46686899311,22cyclictest582760-21ssh11:20:512
46686799313,20cyclictest594660-21ssh11:40:441
466867993124,5cyclictest470386-21fschecks_count07:20:351
466867993124,4cyclictest620402-21munin-plugin-st12:25:011
466867993123,5cyclictest499690-21unixbench-2d08:55:521
466867993123,5cyclictest471888-21fschecks_time07:25:351
466867993122,6cyclictest577142-21unixbench_multi11:10:541
466867993119,7cyclictest0-21swapper/110:35:481
46686699319,5cyclictest14-21ksoftirqd/011:11:160
46686699318,6cyclictest14-21ksoftirqd/012:39:410
46686699318,6cyclictest14-21ksoftirqd/012:39:410
466866993124,5cyclictest612730-21wc12:10:490
466866993124,4cyclictest519126-21sshd09:35:430
466866993124,4cyclictest519126-21sshd09:35:430
466866993124,4cyclictest474346-21cron07:35:010
466866993123,5cyclictest549927-21grep10:25:520
466866993122,6cyclictest599522-21systemd11:50:010
466866993113,4cyclictest14-21ksoftirqd/012:30:430
466866993110,4cyclictest14-21ksoftirqd/011:05:370
46686899306,14cyclictest428-21mta-sts-daemon08:00:462
46686899305,9cyclictest36-21ksoftirqd/211:25:482
466868993023,4cyclictest341rcuc/209:00:012
466868993022,5cyclictest496848-21idleruntime-cro08:50:012
466868993020,7cyclictest421-21dbus-daemon12:00:242
466867993022,5cyclictest521095-21latency_hist09:40:001
466867993022,5cyclictest521095-21latency_hist09:40:001
46686799301,25cyclictest585754-21ssh11:25:461
46686699309,5cyclictest14-21ksoftirqd/008:30:450
46686699309,3cyclictest14-21ksoftirqd/009:00:440
46686699303,9cyclictest472934-21latency_hist07:30:010
466866993022,5cyclictest420-21avahi-daemon09:34:170
466866993018,9cyclictest498218-21grep08:50:510
466866993012,5cyclictest14-21ksoftirqd/010:03:370
466866993011,6cyclictest14-21ksoftirqd/011:20:490
466866993011,4cyclictest14-21ksoftirqd/009:25:370
466866993010,5cyclictest14-21ksoftirqd/011:54:490
466866993010,4cyclictest14-21ksoftirqd/007:10:440
466866993010,4cyclictest14-21ksoftirqd/007:10:440
46686899297,6cyclictest36-21ksoftirqd/207:25:442
46686899295,7cyclictest36-21ksoftirqd/208:00:022
46686899294,9cyclictest36-21ksoftirqd/207:30:382
46686899294,11cyclictest478992-21sed07:50:022
466868992921,6cyclictest469854-21munin-run07:20:012
466868992921,6cyclictest469854-21munin-run07:20:012
466868992921,5cyclictest471351-21sshd07:24:442
466868992920,5cyclictest351ktimers/209:51:362
466868992916,3cyclictest171rcu_preempt08:50:372
466868992915,3cyclictest171rcu_preempt09:33:002
466868992912,7cyclictest171rcu_preempt08:35:322
466867992921,5cyclictest493842-21munin-run08:40:011
466867992917,9cyclictest421-21dbus-daemon08:20:521
466867992917,9cyclictest421-21dbus-daemon08:20:521
46686699298,5cyclictest14-21ksoftirqd/010:30:330
46686699298,4cyclictest14-21ksoftirqd/007:15:450
46686699298,4cyclictest14-21ksoftirqd/007:15:450
466866992912,5cyclictest0-21swapper/007:50:340
466868992814,6cyclictest171rcu_preempt07:40:402
46686699289,5cyclictest14-21ksoftirqd/007:35:340
46686699289,4cyclictest14-21ksoftirqd/007:55:400
46686699288,4cyclictest14-21ksoftirqd/008:40:350
46686699287,4cyclictest14-21ksoftirqd/008:10:010
46686699287,10cyclictest14-21ksoftirqd/008:25:380
46686699287,10cyclictest14-21ksoftirqd/008:15:410
466866992821,5cyclictest1001-21mta-sts-daemon08:45:390
46686899273,8cyclictest36-21ksoftirqd/208:05:442
466868992720,5cyclictest1002-21mta-sts-daemon08:25:322
466867992721,3cyclictest0-21swapper/112:10:351
466867992717,7cyclictest480990-21kernelversion07:55:351
466867992712,10cyclictest3850238-21cups-browsed10:59:521
46686699277,5cyclictest14-21ksoftirqd/008:20:520
46686699277,5cyclictest14-21ksoftirqd/008:20:520
46686699277,4cyclictest14-21ksoftirqd/009:05:410
466867992618,5cyclictest421-21dbus-daemon08:30:011
466867992616,7cyclictest480287-21unixbench_singl07:50:531
466867992615,8cyclictest1003-21mta-sts-daemon08:10:391
466866992622,2cyclictest0-21swapper/008:15:010
46686899255,6cyclictest36-21ksoftirqd/207:10:012
46686899255,6cyclictest36-21ksoftirqd/207:10:012
466867992518,4cyclictest500373-21fschecks_time09:00:341
466867992514,8cyclictest491744-21ntp_kernel_pll_08:30:431
466867992514,6cyclictest502846-21latency_hist09:10:031
46686699257,4cyclictest14-21ksoftirqd/008:35:420
466867992313,7cyclictest495235-21grep08:40:521
46686999229,7cyclictest0-21swapper/312:25:463
466867992216,3cyclictest0-21swapper/108:50:441
466867992216,3cyclictest0-21swapper/108:50:011
466867992211,8cyclictest3850238-21cups-browsed07:40:311
46686999199,7cyclictest0-21swapper/311:15:443
46686999198,7cyclictest0-21swapper/309:45:313
46686999193,9cyclictest0-21swapper/311:00:433
46686999193,9cyclictest0-21swapper/310:10:403
46686999193,10cyclictest0-21swapper/311:25:443
46686999193,10cyclictest0-21swapper/310:45:443
46686999192,12cyclictest0-21swapper/312:00:423
46686999192,11cyclictest0-21swapper/312:35:423
46686999192,11cyclictest0-21swapper/312:35:423
46686999192,10cyclictest0-21swapper/312:20:443
46686999189,6cyclictest0-21swapper/310:20:403
46686999183,9cyclictest0-21swapper/311:45:423
46686999183,11cyclictest0-21swapper/312:10:433
46686999183,10cyclictest0-21swapper/312:05:413
46686999182,11cyclictest0-21swapper/310:50:433
466869991810,6cyclictest0-21swapper/312:30:433
46686999178,6cyclictest0-21swapper/310:00:403
46686999175,10cyclictest0-21swapper/309:10:393
46686999172,9cyclictest0-21swapper/311:25:023
46686999172,9cyclictest0-21swapper/310:30:363
46686999172,10cyclictest0-21swapper/309:35:453
46686999172,10cyclictest0-21swapper/309:35:453
466869991711,4cyclictest0-21swapper/309:20:413
46686999171,12cyclictest0-21swapper/311:05:473
46686999171,11cyclictest0-21swapper/310:40:403
46686999171,11cyclictest0-21swapper/310:40:403
46686999171,11cyclictest0-21swapper/307:40:393
46686999171,10cyclictest0-21swapper/310:35:383
466869991710,5cyclictest0-21swapper/311:40:433
466867991711,3cyclictest4193703-21kworker/u8:2-xprtiod07:10:021
466867991711,3cyclictest4193703-21kworker/u8:2-xprtiod07:10:021
46686999165,7cyclictest0-21swapper/309:40:433
46686999163,8cyclictest0-21swapper/311:30:353
46686999163,7cyclictest0-21swapper/311:35:443
46686999163,7cyclictest0-21swapper/311:35:443
46686999162,9cyclictest0-21swapper/312:15:433
46686999162,8cyclictest0-21swapper/309:30:313
46686999161,11cyclictest0-21swapper/311:10:443
46686999161,11cyclictest0-21swapper/310:05:403
46686999161,11cyclictest0-21swapper/309:15:483
46686999161,11cyclictest0-21swapper/308:45:423
46686999161,11cyclictest0-21swapper/308:15:413
46686999161,10cyclictest0-21swapper/311:50:313
46686999160,12cyclictest0-21swapper/309:00:393
46686999160,11cyclictest0-21swapper/307:10:393
46686999160,11cyclictest0-21swapper/307:10:393
46686999154,8cyclictest0-21swapper/309:50:343
46686999152,9cyclictest0-21swapper/311:55:393
46686999152,8cyclictest0-21swapper/310:55:443
46686999151,9cyclictest0-21swapper/310:15:413
46686999151,10cyclictest0-21swapper/310:25:323
46686999151,10cyclictest0-21swapper/309:55:393
46686999151,10cyclictest0-21swapper/309:05:363
46686999151,10cyclictest0-21swapper/308:35:383
46686999151,10cyclictest0-21swapper/308:25:363
46686999151,10cyclictest0-21swapper/308:10:403
46686999151,10cyclictest0-21swapper/307:50:443
46686999151,10cyclictest0-21swapper/307:45:483
46686999151,10cyclictest0-21swapper/307:35:433
46686999151,10cyclictest0-21swapper/307:15:423
46686999151,10cyclictest0-21swapper/307:15:423
46686999150,11cyclictest0-21swapper/308:00:403
46686999150,11cyclictest0-21swapper/307:30:393
46686999150,10cyclictest0-21swapper/308:05:393
46686999142,8cyclictest0-21swapper/309:25:313
46686999141,9cyclictest0-21swapper/308:50:403
46686999141,9cyclictest0-21swapper/308:30:413
46686999141,9cyclictest0-21swapper/307:55:293
46686999141,9cyclictest0-21swapper/307:25:333
46686999141,10cyclictest0-21swapper/309:00:013
46686999141,10cyclictest0-21swapper/308:40:433
46686999140,11cyclictest0-21swapper/307:10:013
46686999140,11cyclictest0-21swapper/307:10:013
46686999140,10cyclictest0-21swapper/307:20:483
46686999121,9cyclictest0-21swapper/308:20:383
46686999121,9cyclictest0-21swapper/308:20:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional