You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 05:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Jul 11, 2026 00:43:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2256288995028,19cyclictest0-21swapper/221:45:012
2256287994938,7cyclictest420-21avahi-daemon23:20:321
2256287994938,7cyclictest420-21avahi-daemon23:20:321
2256286994929,14cyclictest12650irq/32-eth021:00:420
2256287994827,18cyclictest0-21swapper/122:50:001
2256286994841,5cyclictest2275793-21systemd-run20:15:010
2256286994841,5cyclictest2275793-21systemd-run20:15:010
2256287994638,5cyclictest2368306-21munin-run23:15:011
225628699466,37cyclictest2402381-21ssh00:10:360
2256286994632,7cyclictest12650irq/32-eth022:05:420
2256288994538,4cyclictest2266774-21cron19:45:012
2256288994537,5cyclictest2274293-21systemd-run20:10:012
2256288994529,13cyclictest2393907-21unixbench-2d23:55:502
2256288994524,17cyclictest420-21avahi-daemon23:40:322
225628899452,23cyclictest2330077-21ntpq22:10:472
2256288994520,20cyclictest2292140-21unixbench_multi21:05:492
2256287994535,7cyclictest1003-21mta-sts-daemon00:00:011
2256286994524,4cyclictest171rcu_preempt00:00:410
225628699450,6cyclictest0-21swapper/021:45:440
225628699450,6cyclictest0-21swapper/021:45:440
2256288994435,6cyclictest2347059-21sendmail22:40:002
225628799445,28cyclictest2314867-21ssh21:45:411
225628799445,28cyclictest2314867-21ssh21:45:411
2256286994431,11cyclictest2419390-21munin-run00:40:000
2256288994322,19cyclictest0-21swapper/223:40:022
2256287994336,4cyclictest2371330-21ssh23:20:011
225628799432,34cyclictest2273684-21ntpq20:05:421
2256286994331,9cyclictest2372764-21switchtime23:20:490
2256286994331,9cyclictest2372764-21switchtime23:20:490
2256288994232,7cyclictest2298399-21munin-plugin-st21:20:012
2256288994221,17cyclictest2274539-21aten_r2power_cu20:10:322
2256288994221,17cyclictest2274539-21aten_r2power_cu20:10:322
2256287994233,5cyclictest1000-21mta-sts-daemon21:38:151
2256287994232,7cyclictest2298402-21sendmail21:20:011
225628799422,33cyclictest2357353-21ssh22:55:441
225628799422,33cyclictest2278262-21ntpq20:20:441
225628799421,35cyclictest2288669-21ntpq20:55:391
2256286994235,4cyclictest2292271-21diskmemload00:15:520
2256286994234,5cyclictest421-21dbus-daemon22:20:010
2256288994133,4cyclictest1003-21mta-sts-daemon22:05:392
2256287994135,3cyclictest0-21swapper/119:30:421
2256287994131,7cyclictest2413513-21sort00:30:021
2256286994126,5cyclictest421-21dbus-daemon00:25:350
2256286994126,12cyclictest2309002-21sh21:35:490
225628899409,27cyclictest421-21dbus-daemon21:47:532
225628899409,27cyclictest421-21dbus-daemon21:47:532
2256288994030,7cyclictest510950-21cups-browsed23:20:012
2256288994025,11cyclictest0-21swapper/200:00:472
2256288994019,18cyclictest0-21swapper/222:25:022
2256287994032,5cyclictest2292270-21idleruntime-cro21:10:011
2256287994031,6cyclictest420-21avahi-daemon21:40:461
225628799402,32cyclictest2392326-21/usr/sbin/munin23:55:021
2256287994021,16cyclictest0-21swapper/122:45:021
2256287994019,19cyclictest0-21swapper/122:25:031
2256287994019,18cyclictest0-21swapper/100:15:021
225628799401,35cyclictest2281153-21ntpq20:30:381
2256286994026,10cyclictest0-21swapper/021:05:490
2256288993931,5cyclictest1002-21mta-sts-daemon23:10:422
2256288993922,8cyclictest0-21swapper/221:25:412
225628899392,26cyclictest2305675-21ssh21:30:432
2256288993922,14cyclictest510950-21cups-browsed23:01:162
225628799392,31cyclictest2287127-21ntpq20:50:361
225628799391,34cyclictest2290154-21ntpq21:00:391
225628799391,30cyclictest2275289-21ps20:10:501
225628799391,30cyclictest2275289-21ps20:10:501
2256286993928,8cyclictest2289294-21sh21:00:010
2256286993928,5cyclictest0-21swapper/023:00:430
2256288993826,8cyclictest1001-21mta-sts-daemon23:49:472
2256288993823,13cyclictest0-21swapper/223:30:542
2256288993823,13cyclictest0-21swapper/223:30:542
2256288993818,14cyclictest0-21swapper/220:35:352
225628799384,29cyclictest2302596-21sshd21:25:421
2256287993830,5cyclictest2323486-21fschecks_time22:00:321
2256287993829,7cyclictest2307598-21sh21:35:011
2256287993829,6cyclictest420-21avahi-daemon23:26:131
2256287993829,6cyclictest420-21avahi-daemon23:26:131
2256287993829,6cyclictest2386365-21wc23:45:021
2256287993813,21cyclictest2399103-21ssh00:05:331
225628799381,31cyclictest2381465-21ntpq23:35:401
225628799381,11cyclictest2330762-21ssh22:11:251
225628899373,29cyclictest2348171-21ntpq22:40:412
225628899372,30cyclictest2288613-21ntpq20:55:362
2256288993715,16cyclictest0-21swapper/221:50:252
2256288993715,16cyclictest0-21swapper/221:50:252
225628899371,33cyclictest2284335-21/usr/sbin/munin20:40:452
225628899371,31cyclictest2277439-21latency_hist20:20:022
225628899371,31cyclictest2277439-21latency_hist20:20:022
225628899371,31cyclictest2261625-21ntpq19:25:372
225628799376,28cyclictest2333335-21grep22:15:551
225628799373,29cyclictest2279625-21ntpq20:25:361
2256287993729,5cyclictest2345672-21unixbench_multi22:35:501
225628799372,31cyclictest2363260-21ntpq23:05:371
225628799372,31cyclictest2326973-21ntpq22:05:421
225628799372,30cyclictest2320894-21ntpq21:55:411
225628799371,33cyclictest2284151-21ntpq20:40:381
225628799371,33cyclictest2267736-21ntpq19:45:441
225628799371,31cyclictest2264631-21ntpq19:35:381
225628799371,31cyclictest2258653-21ntpq19:15:391
225628799371,31cyclictest2258653-21ntpq19:15:391
225628799371,11cyclictest2379153-21ssh23:31:011
225628799371,11cyclictest2379153-21ssh23:31:011
2256286993731,3cyclictest0-21swapper/000:00:020
2256286993730,4cyclictest2353150-21ssh22:50:010
2256286993727,5cyclictest2374421-21kworker/u8:15-rpciod23:35:280
2256286993726,8cyclictest2369651-21mailstats23:15:470
2256286993719,12cyclictest12650irq/32-eth023:40:420
225628899368,25cyclictest2418993-21sh00:38:472
2256288993631,2cyclictest0-21swapper/221:40:012
225628899362,30cyclictest2356159-21/usr/sbin/munin22:55:012
225628899362,29cyclictest2414470-21ntpq00:30:402
225628899362,29cyclictest2414470-21ntpq00:30:402
225628899362,28cyclictest2260128-21ntpq19:20:382
2256288993617,16cyclictest2402281-21missed_timers00:10:332
225628899361,31cyclictest2399459-21ntpq00:05:412
225628899361,30cyclictest2374655-21ssh23:25:082
225628899361,30cyclictest2374655-21ssh23:25:082
225628899361,30cyclictest2269251-21ntpq19:50:432
225628899361,29cyclictest2342165-21ntpq22:30:432
225628899361,29cyclictest2342165-21ntpq22:30:432
2256288993612,20cyclictest2357269-21ntpq22:55:412
225628799363,28cyclictest2257124-21ntpq19:10:361
225628799363,28cyclictest2257124-21ntpq19:10:361
2256287993629,4cyclictest2410398-21basename00:25:011
2256287993628,4cyclictest0-21swapper/120:00:371
225628799362,29cyclictest2260137-21ntpq19:20:381
225628799362,27cyclictest421-21dbus-daemon21:10:031
2256287993622,11cyclictest0-21swapper/100:40:011
2256287993618,11cyclictest2332139-21kworker/u8:11-xprtiod23:00:281
225628799361,32cyclictest2276748-21ntpq20:15:431
225628799361,32cyclictest2276748-21ntpq20:15:431
225628799361,32cyclictest2270708-21ntpq19:55:411
225628799361,32cyclictest2265928-21/usr/sbin/munin19:40:321
225628799361,30cyclictest2342067-21ntpq22:30:391
225628799361,30cyclictest2342067-21ntpq22:30:391
225628799361,13cyclictest2404994-21ssh00:15:311
225628799361,10cyclictest2282683-21ntpq20:35:391
2256286993613,15cyclictest12650irq/32-eth000:20:400
2256288993527,5cyclictest2324497-21grep22:00:522
2256288993526,6cyclictest2410756-21acpi00:25:272
2256288993515,17cyclictest0-21swapper/200:25:012
225628899351,30cyclictest2339674-21ssh22:25:502
225628899351,30cyclictest2257750-21sshd19:13:412
225628899351,30cyclictest2257750-21sshd19:13:412
225628899351,29cyclictest2390422-21ntpq23:50:402
225628899351,29cyclictest2351283-21ntpq22:45:442
225628899351,29cyclictest2299525-21ntpq21:20:402
225628899351,29cyclictest2270661-21ntpq19:55:392
225628899351,28cyclictest2281140-21modprobe20:30:372
2256287993528,4cyclictest2388013-21unixbench_singl23:45:501
2256287993527,5cyclictest2317258-21aten_r2power_vo21:50:271
2256287993527,5cyclictest2317258-21aten_r2power_vo21:50:271
2256287993521,11cyclictest0-21swapper/119:55:011
225628799351,31cyclictest2414548-21ntp_states00:30:431
225628799351,31cyclictest2414548-21ntp_states00:30:431
225628799351,31cyclictest2285733-21ntpq20:45:431
225628799351,29cyclictest2261662-21ntpq19:25:391
225628799351,28cyclictest2338988-21ntpq22:25:351
225628799351,12cyclictest2397103-21ssh00:00:591
225628699356,21cyclictest623-21sshd22:25:420
2256286993529,4cyclictest2277813-21fschecks_time20:20:310
2256286993529,4cyclictest2265311-21systemd-run19:40:020
2256286993528,4cyclictest1002-21mta-sts-daemon22:22:030
2256286993526,6cyclictest420-21avahi-daemon23:11:440
2256286993525,7cyclictest510950-21cups-browsed22:32:500
2256286993525,7cyclictest510950-21cups-browsed22:32:500
2256286993524,8cyclictest2390308-21needreboot23:50:360
2256286993518,13cyclictest2293440-21sh21:10:420
225628899342,28cyclictest2332957-21ntpq22:15:422
225628899342,28cyclictest2272186-21ntpq20:00:402
225628899342,27cyclictest2263201-21ntpq19:30:422
2256288993421,9cyclictest0-21swapper/200:15:412
225628899341,30cyclictest2293383-21ntpq21:10:392
225628899341,29cyclictest2362586-21ssh23:05:242
225628899341,29cyclictest2278147-21ntpq20:20:372
225628899341,28cyclictest2372155-21ssh23:20:342
225628899341,28cyclictest2372155-21ssh23:20:342
225628899341,28cyclictest2264746-21ntpq19:35:442
225628899341,28cyclictest2258306-21/usr/sbin/munin19:15:322
225628899341,28cyclictest2258306-21/usr/sbin/munin19:15:322
225628899341,27cyclictest2320221-21aten2.4-expect21:55:272
225628899341,27cyclictest2287291-21ps20:50:432
225628799341,30cyclictest2354499-21ssh22:50:501
2256286993423,8cyclictest0-21swapper/022:00:510
225628699341,27cyclictest2354254-21ssh22:50:420
2256288993324,6cyclictest2286273-21idleruntime-cro20:50:012
225628899331,28cyclictest2290257-21ntpq21:00:442
225628899331,27cyclictest2279130-21aten_r2power_po20:25:282
225628799331,29cyclictest2299002-21grep21:20:291
2256286993326,3cyclictest0-21swapper/021:20:420
2256286993325,5cyclictest485-21in:imuxsock23:50:010
2256286993324,7cyclictest2298399-21cut21:20:020
2256286993321,4cyclictest14-21ksoftirqd/022:10:450
2256286993320,10cyclictest2287713-21unixbench_singl20:50:490
225628899321,28cyclictest2267078-21aten2.4-expect19:45:302
225628799321,28cyclictest2256299-21munin-run19:10:011
225628799321,28cyclictest2256299-21munin-run19:10:011
2256286993227,2cyclictest0-21swapper/021:35:010
2256286993223,7cyclictest2260790-21cut19:25:000
2256286993219,10cyclictest2277185-21unixbench_singl20:15:500
2256286993219,10cyclictest2277185-21unixbench_singl20:15:500
2256286993124,3cyclictest0-21swapper/021:30:010
2256286993123,5cyclictest2413753-21/usr/sbin/munin00:30:460
2256286993123,5cyclictest2413753-21/usr/sbin/munin00:30:460
2256286993122,6cyclictest2347433-21/usr/sbin/munin22:40:520
2256286993115,14cyclictest57-21kcompactd022:56:490
225628999302,10cyclictest0-21swapper/321:15:423
225628899300,24cyclictest420-21avahi-daemon19:10:012
225628899300,24cyclictest420-21avahi-daemon19:10:012
2256286993024,3cyclictest2319793-21latency_hist21:55:010
2256286993024,3cyclictest2319793-21latency_hist21:55:010
2256286993022,5cyclictest2363041-21kernelversion23:05:340
2256286993021,6cyclictest2375643-21processes23:25:440
2256286993021,6cyclictest2375643-21processes23:25:440
225628699301,24cyclictest510947-21cupsd20:40:420
225628699292,20cyclictest2311722-21ssh21:40:380
225628999283,9cyclictest0-21swapper/323:35:413
225628999283,8cyclictest0-21swapper/323:40:433
225628999282,7cyclictest0-21swapper/322:50:403
225628999282,10cyclictest0-21swapper/300:05:423
2256286992823,3cyclictest2268176-21unixbench_multi19:45:520
2256286992822,4cyclictest421-21dbus-daemon23:35:010
2256286992822,4cyclictest421-21dbus-daemon23:35:010
2256286992821,4cyclictest2401357-21ssh00:10:010
2256286992821,4cyclictest0-21swapper/019:50:420
225628999273,6cyclictest0-21swapper/319:45:393
225628999273,10cyclictest0-21swapper/300:00:453
225628999271,6cyclictest0-21swapper/321:55:383
225628999271,10cyclictest0-21swapper/323:20:433
225628999271,10cyclictest0-21swapper/323:20:433
2256286992722,3cyclictest2262163-21unixbench_multi19:25:510
2256286992721,4cyclictest2280204-21unixbench_singl20:25:510
2256286992719,3cyclictest0-21swapper/019:15:010
2256286992719,3cyclictest0-21swapper/019:15:010
2256286992713,12cyclictest1001-21mta-sts-daemon19:19:060
2256286992713,12cyclictest1001-21mta-sts-daemon19:19:060
225628999263,9cyclictest0-21swapper/321:45:423
225628999263,9cyclictest0-21swapper/321:45:423
225628999263,8cyclictest0-21swapper/323:55:403
225628999263,8cyclictest0-21swapper/300:15:393
225628999262,7cyclictest0-21swapper/321:50:253
225628999262,7cyclictest0-21swapper/321:50:253
225628999262,7cyclictest0-21swapper/321:25:393
225628999261,8cyclictest0-21swapper/322:25:383
225628699262,6cyclictest171rcu_preempt19:55:400
2256286992618,6cyclictest2345638-21unixbench_multi22:35:500
225628999254,5cyclictest0-21swapper/322:05:413
225628999253,6cyclictest0-21swapper/322:10:473
225628999252,9cyclictest0-21swapper/322:55:393
225628999252,8cyclictest0-21swapper/320:15:403
225628999252,8cyclictest0-21swapper/320:15:403
225628999252,6cyclictest0-21swapper/319:30:423
225628999252,10cyclictest0-21swapper/320:55:393
225628999251,9cyclictest0-21swapper/323:05:443
225628999251,9cyclictest0-21swapper/322:35:393
225628999251,9cyclictest0-21swapper/319:25:423
225628999251,8cyclictest0-21swapper/322:45:393
225628699252,18cyclictest665-21snmpd20:35:380
225628699252,10cyclictest171rcu_preempt21:55:380
2256286992518,5cyclictest2273313-21cut20:05:340
225628699250,7cyclictest171rcu_preempt20:30:370
225628999243,7cyclictest0-21swapper/322:20:413
225628999243,15cyclictest0-21swapper/323:30:503
225628999243,15cyclictest0-21swapper/323:30:503
225628999242,8cyclictest0-21swapper/323:15:453
225628999242,7cyclictest0-21swapper/323:45:443
225628999242,7cyclictest0-21swapper/323:10:393
225628999242,7cyclictest0-21swapper/323:00:383
225628999242,7cyclictest0-21swapper/322:40:383
225628999242,6cyclictest0-21swapper/321:10:273
225628999242,6cyclictest0-21swapper/300:25:423
225628999241,8cyclictest0-21swapper/300:20:313
2256286992418,4cyclictest12650irq/32-eth019:40:420
225628999234,5cyclictest0-21swapper/320:05:403
225628999233,6cyclictest0-21swapper/323:25:423
225628999233,6cyclictest0-21swapper/323:25:423
225628999233,6cyclictest0-21swapper/300:35:293
225628999232,9cyclictest0-21swapper/300:30:453
225628999232,9cyclictest0-21swapper/300:30:453
225628999232,8cyclictest0-21swapper/322:30:413
225628999232,8cyclictest0-21swapper/322:30:413
225628999232,8cyclictest0-21swapper/322:00:373
225628999232,7cyclictest0-21swapper/323:50:393
225628999232,7cyclictest0-21swapper/322:15:423
225628999232,7cyclictest0-21swapper/321:20:323
225628999232,6cyclictest0-21swapper/321:35:403
225628999232,6cyclictest0-21swapper/321:30:403
225628999232,6cyclictest0-21swapper/300:10:373
225628999232,5cyclictest0-21swapper/320:50:403
225628999231,8cyclictest0-21swapper/321:40:283
225628999231,7cyclictest0-21swapper/320:10:453
225628999231,7cyclictest0-21swapper/320:10:453
225628699232,16cyclictest2272235-21ntpq20:00:420
2256286992317,4cyclictest567-21gdbus19:30:460
2256286992317,3cyclictest0-21swapper/020:45:320
225628999212,9cyclictest0-21swapper/319:50:383
225628999203,8cyclictest0-21swapper/320:35:423
225628999202,12cyclictest0-21swapper/319:20:423
225628999201,5cyclictest0-21swapper/320:40:383
225628999193,9cyclictest0-21swapper/319:15:423
225628999193,9cyclictest0-21swapper/319:15:423
225628999192,9cyclictest0-21swapper/321:05:373
2256286991912,3cyclictest0-21swapper/019:10:010
2256286991912,3cyclictest0-21swapper/019:10:010
225628999173,7cyclictest0-21swapper/320:30:403
225628999172,9cyclictest0-21swapper/320:20:463
225628999163,9cyclictest0-21swapper/320:25:413
225628999162,7cyclictest0-21swapper/319:10:373
225628999162,7cyclictest0-21swapper/319:10:373
225628999152,8cyclictest0-21swapper/320:00:373
225628999152,7cyclictest0-21swapper/321:00:393
225628999152,7cyclictest0-21swapper/319:35:383
225628999144,7cyclictest0-21swapper/319:55:423
225628999133,7cyclictest0-21swapper/319:40:363
225628999132,7cyclictest0-21swapper/320:45:383
225628999122,8cyclictest0-21swapper/319:10:013
225628999122,8cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional