You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 07:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Jul 09, 2026 00:43:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2664001996655,7cyclictest2803590-21cups-browsed00:10:361
2664002996253,4cyclictest0-21swapper/200:25:532
2664000996142,15cyclictest2819899-40mandb00:26:000
2664001995645,7cyclictest2820018-21cat00:25:491
2664000995447,4cyclictest2759117-21modprobe22:45:400
2664002995137,11cyclictest2807624-21sh00:05:372
2664001995142,5cyclictest2787050-21unixbench_multi23:30:491
2664001995126,22cyclictest2718395-21idleruntime-cro21:40:011
2664000994927,19cyclictest2727518-21cron21:55:010
2664000994920,3cyclictest0-21swapper/022:40:390
2664002994833,9cyclictest36-21ksoftirqd/219:55:372
2664002994833,8cyclictest0-21swapper/223:35:402
2664002994739,3cyclictest0-21swapper/221:10:012
266400199478,24cyclictest2699988-21diskmemload21:28:291
2664001994739,5cyclictest2815585-21ssh00:20:011
2664002994633,8cyclictest2782401-21munin-plugin-st23:25:012
2664000994637,6cyclictest421-21dbus-daemon00:10:470
2664002994534,4cyclictest0-21swapper/200:00:022
2664002994527,12cyclictest2813635-21sh00:15:382
2664001994530,12cyclictest0-21swapper/123:38:471
2664001994524,18cyclictest0-21swapper/100:00:001
2664001994523,18cyclictest0-21swapper/121:10:011
2664000994536,6cyclictest2803590-21cups-browsed00:17:450
2664002994432,6cyclictest0-21swapper/222:55:432
266400199441,17cyclictest2666499-21ps19:15:451
2664000994424,17cyclictest0-21swapper/019:55:010
2664000994421,17cyclictest12650irq/32-eth022:50:400
2664000994420,4cyclictest2663999-21cyclictest21:11:000
266400099441,14cyclictest2788862-21basename23:35:260
2664001994335,5cyclictest2818575-21ssh00:25:011
266400199432,6cyclictest2777449-21ntpq23:15:431
2664002994235,3cyclictest0-21swapper/222:40:012
2664002994235,3cyclictest0-21swapper/222:25:422
266400199425,5cyclictest271ktimers/121:15:391
2664001994237,2cyclictest0-21swapper/122:00:371
2664001994230,8cyclictest1-21systemd00:40:021
2664001994220,19cyclictest0-21swapper/122:50:361
2664000994236,4cyclictest2691014-21systemd-run20:40:020
2664000994221,17cyclictest2697198-21latency_hist21:00:030
266400099421,24cyclictest2777401-21ntpq23:15:410
2664002994132,6cyclictest2724473-21ssh21:50:012
266400199413,5cyclictest2684391-21ntpq20:15:381
2664001994127,11cyclictest0-21swapper/122:15:481
2664001994127,11cyclictest0-21swapper/122:15:481
2664001994122,17cyclictest0-21swapper/122:40:461
2664001994116,22cyclictest0-21swapper/120:20:361
2664001994116,22cyclictest0-21swapper/120:20:361
2664000994132,6cyclictest1002-21mta-sts-daemon22:21:450
2664000994122,2cyclictest0-21swapper/021:40:020
2664000994121,17cyclictest0-21swapper/020:35:010
2664000994115,8cyclictest12650irq/32-eth022:55:370
2664002994033,3cyclictest0-21swapper/219:45:012
2664002994030,6cyclictest2758651-21gltestperf22:45:302
2664002994025,11cyclictest1-21systemd23:20:022
266400199402,9cyclictest2669413-21ntpq19:25:381
266400199402,6cyclictest2678456-21ntpq19:55:411
2664001994015,21cyclictest0-21swapper/119:20:351
2664001994015,21cyclictest0-21swapper/119:20:351
2664001994012,25cyclictest2771820-21sed23:05:501
266400199401,13cyclictest2691975-21ntpq20:40:411
2664000994033,4cyclictest439-21systemd-logind22:10:010
266400099402,19cyclictest2673978-21modprobe19:40:440
2664000994017,3cyclictest0-21swapper/022:10:400
266400099401,20cyclictest2771259-21ssh23:05:370
266400099401,19cyclictest2804780-21awk00:00:460
2664002993932,4cyclictest0-21swapper/220:20:402
2664002993932,4cyclictest0-21swapper/220:20:402
2664002993932,3cyclictest0-21swapper/200:40:022
2664002993930,6cyclictest265-21systemd-journal19:50:012
2664002993930,5cyclictest2672994-21idleruntime-cro19:40:012
2664002993927,8cyclictest420-21avahi-daemon22:06:172
266400199393,29cyclictest2697958-21ntpq21:00:421
2664001993931,5cyclictest2673025-21systemd-run19:40:021
266400199392,6cyclictest2728634-21ntpq21:55:381
2664001993922,14cyclictest2749856-21ntp_kernel_err22:30:371
266400199392,14cyclictest2720712-21sshd21:42:451
266400199391,4cyclictest2768218-21ntpq23:00:371
266400199391,14cyclictest2804651-21ntpq00:00:391
266400199391,11cyclictest2676854-21ntpq19:50:361
266400199390,12cyclictest2781671-21ssh23:22:451
266400099392,19cyclictest2749902-21ssh22:30:390
266400299384,27cyclictest2743930-21ssh22:20:412
2664002993830,5cyclictest2800512-21cron23:55:012
2664002993830,5cyclictest2697005-21systemd-run21:00:012
2664002993827,8cyclictest2713677-21switchtime21:30:492
266400299381,30cyclictest2710230-21ssh21:25:372
2664001993832,3cyclictest0-21swapper/100:30:411
266400199382,8cyclictest2682834-21ntpq20:10:361
266400199382,13cyclictest2807221-21diskstats00:05:291
2664001993817,16cyclictest2695830-21aten_r2power_po20:55:281
2664001993816,19cyclictest0-21swapper/120:30:431
266400199381,4cyclictest2774314-21ntpq23:10:371
2664001993814,21cyclictest0-21swapper/121:30:511
266400199381,18cyclictest2665005-21ps19:10:481
266400199381,12cyclictest2746883-21ntpq22:25:421
266400199381,11cyclictest2766178-21ssh22:56:581
266400199381,10cyclictest2693443-21ntpq20:45:411
266400199381,10cyclictest2673850-21ntpq19:40:361
2664000993829,6cyclictest2665505-21systemd-run19:15:010
2664000993818,4cyclictest1001-21mta-sts-daemon20:10:350
2664000993815,8cyclictest2768435-21uname23:00:450
2664000993811,10cyclictest12650irq/32-eth000:30:360
2664002993729,5cyclictest2703029-21cron21:15:012
2664002993722,10cyclictest421-21dbus-daemon22:10:402
266400199373,28cyclictest2701053-21ntpq21:10:381
266400199372,7cyclictest2687408-21ntpq20:25:391
266400199372,6cyclictest2725662-21ntpq21:50:431
266400199372,5cyclictest2679869-21ntpq20:00:391
266400199371,9cyclictest2792736-21ntpq23:40:551
2664001993718,16cyclictest0-21swapper/123:55:011
266400199371,7cyclictest2734690-21ntpq22:05:371
2664001993717,16cyclictest0-21swapper/123:25:251
2664001993716,18cyclictest0-21swapper/120:50:391
266400199371,11cyclictest2737744-21ntpq22:10:381
266400199371,10cyclictest2675445-21ntpq19:45:391
266400199370,9cyclictest908625-21cups-browsed22:35:561
266400199370,8cyclictest2723135-21/usr/sbin/munin21:45:501
266400199370,13cyclictest2794759-21ssh23:45:071
2664000993726,6cyclictest151ktimers/021:45:390
266400099372,18cyclictest2800517-21munin-run23:55:010
2664000993721,3cyclictest0-21swapper/021:15:280
266400199362,5cyclictest2743797-21ntpq22:20:361
266400199361,4cyclictest2690341-21ntpq20:35:361
2664001993613,20cyclictest0-21swapper/119:30:331
266400199361,16cyclictest2707151-21ssh21:20:371
266400199361,11cyclictest2681370-21ntpq20:05:381
266400099363,12cyclictest1000-21mta-sts-daemon19:20:440
266400099363,12cyclictest1000-21mta-sts-daemon19:20:440
2664000993627,6cyclictest2712260-21ssh21:30:020
2664000993619,5cyclictest2732608-21kworker/u8:5+xprtiod22:05:010
2664000993614,4cyclictest2679064-21latency_hist20:00:020
266400099361,18cyclictest2740824-21ntpq22:15:380
266400099361,18cyclictest2740824-21ntpq22:15:380
2664002993528,4cyclictest2822266-21fschecks_time00:30:312
2664002993526,6cyclictest2784079-21unixbench_singl23:25:482
2664002993526,4cyclictest0-21swapper/223:00:322
2664002993523,7cyclictest2727973-21aten_r2power_fr21:55:262
266400299352,29cyclictest2750083-21ssh22:30:462
266400299352,23cyclictest2704230-21ssh21:15:452
2664001993527,5cyclictest1002-21mta-sts-daemon22:48:311
2664000993529,4cyclictest2666981-21latency_hist19:20:010
2664002993426,4cyclictest0-21swapper/223:40:522
2664002993424,4cyclictest0-21swapper/222:00:442
2664002993423,7cyclictest420-21avahi-daemon23:46:302
266400299342,24cyclictest908625-21cups-browsed21:00:362
266400299342,24cyclictest2816848-21ps00:20:472
266400299342,23cyclictest2762136-21ssh22:50:392
266400099342,26cyclictest2780398-21ssh23:20:370
2664002993324,6cyclictest2669016-21fschecks_count19:25:292
2664002993324,5cyclictest0-21swapper/220:30:442
2664002993324,4cyclictest0-21swapper/200:10:372
2664000993327,4cyclictest2730558-21cron22:00:010
2664000993326,5cyclictest2788593-21latency_hist23:35:020
2664000993326,4cyclictest1002-21mta-sts-daemon00:24:360
2664000993324,7cyclictest2673017-21sh19:40:020
266400299327,20cyclictest2786627-21ssh23:30:432
266400299322,22cyclictest2771259-21ssh23:05:372
2664000993227,3cyclictest1002-21mta-sts-daemon23:48:030
2664000993226,4cyclictest2825127-21aten_r2power_vo00:35:270
2664002993124,3cyclictest0-21swapper/221:20:402
2664002993123,5cyclictest2692379-21unixbench_multi20:40:472
2664002993121,6cyclictest421-21dbus-daemon20:20:012
266400199311,4cyclictest421-21dbus-daemon19:10:011
266400099313,22cyclictest2707176-21ssh21:20:380
2664000993125,4cyclictest2775252-21sshd23:11:460
2664000993123,6cyclictest2792641-21ntp_kernel_pll_23:40:520
2664000993122,6cyclictest420-21avahi-daemon22:25:530
2664000993116,10cyclictest2694929-21sshd20:50:440
2664002993024,3cyclictest0-21swapper/221:40:012
2664002993023,3cyclictest0-21swapper/222:15:482
2664002993023,3cyclictest0-21swapper/222:15:482
2664002993022,3cyclictest0-21swapper/221:40:362
2664002993021,6cyclictest566-21gmain19:21:192
2664002993021,6cyclictest566-21gmain19:21:192
266400099303,11cyclictest12650irq/32-eth000:05:390
2664000993023,5cyclictest2718736-21/usr/sbin/munin21:40:440
2664000993022,5cyclictest265-21systemd-journal22:35:460
2664000993020,8cyclictest2699357-21ntp_kernel_pll_21:05:360
2664000993020,7cyclictest2675890-21unixbench_multi19:45:460
2664002992924,3cyclictest2663999-21cyclictest19:10:362
266400299292,19cyclictest2804608-21ssh00:00:372
2664002992921,5cyclictest0-21swapper/223:11:272
2664000992918,7cyclictest12650irq/32-eth020:45:430
2664002992821,4cyclictest2670975-21sshd19:30:442
2664002992821,4cyclictest0-21swapper/221:50:352
2664002992817,8cyclictest2690322-21ntp_kernel_err20:35:362
2664000992823,2cyclictest0-21swapper/000:00:000
2664000992822,3cyclictest151ktimers/021:30:370
2664000992822,3cyclictest0-21swapper/023:25:420
2664000992821,4cyclictest2691451-21/usr/sbin/munin20:40:270
2664000992821,4cyclictest2684996-21idleruntime-cro20:20:010
2664000992821,4cyclictest2671380-21unixbench_multi19:30:490
2664000992819,4cyclictest0-21swapper/020:20:360
2664000992819,4cyclictest0-21swapper/020:20:360
2664002992720,4cyclictest2679635-21kernelversion20:00:342
2664002992719,5cyclictest2677510-21latency_hist19:55:022
2664002992719,5cyclictest2666350-21ntp_kernel_pll_19:15:382
2664002992718,6cyclictest1-21systemd19:10:022
2664002992717,4cyclictest341rcuc/220:10:402
2664002992716,8cyclictest2687990-21/usr/sbin/munin20:30:012
2664000992719,5cyclictest908625-21cups-browsed20:27:040
266400299268,13cyclictest351ktimers/220:45:402
2664002992619,3cyclictest0-21swapper/222:40:402
2664000992620,3cyclictest0-21swapper/020:05:280
266400399251,9cyclictest0-21swapper/300:05:413
2664000992512,9cyclictest421-21dbus-daemon21:05:020
266400399242,6cyclictest0-21swapper/322:45:353
266400399241,5cyclictest0-21swapper/300:25:413
2664002992418,3cyclictest1003-21mta-sts-daemon20:50:452
2664000992410,11cyclictest0-21swapper/019:25:460
2664000992315,5cyclictest1-21systemd20:01:440
266400399223,5cyclictest0-21swapper/323:30:423
266400399223,4cyclictest0-21swapper/319:20:373
266400399223,4cyclictest0-21swapper/319:20:373
266400399222,7cyclictest0-21swapper/323:50:373
266400399222,5cyclictest0-21swapper/322:39:473
266400399221,5cyclictest0-21swapper/322:30:453
2664002992216,3cyclictest1002-21mta-sts-daemon20:05:282
266400399213,5cyclictest0-21swapper/323:25:423
266400399212,6cyclictest0-21swapper/322:55:373
266400399212,5cyclictest0-21swapper/323:15:443
266400399212,5cyclictest0-21swapper/322:05:503
266400399212,5cyclictest0-21swapper/300:15:463
266400399212,4cyclictest0-21swapper/321:35:373
266400399212,4cyclictest0-21swapper/300:10:363
266400399211,6cyclictest0-21swapper/323:00:413
266400399211,6cyclictest0-21swapper/321:30:423
266400399211,6cyclictest0-21swapper/319:50:383
266400399211,5cyclictest0-21swapper/322:40:393
266400399211,5cyclictest0-21swapper/321:40:383
266400399211,5cyclictest0-21swapper/321:20:393
266400399211,5cyclictest0-21swapper/320:50:443
266400399211,4cyclictest0-21swapper/323:40:503
266400399211,4cyclictest0-21swapper/322:50:323
266400399211,4cyclictest0-21swapper/321:55:343
266400399211,4cyclictest0-21swapper/320:30:433
266400399211,3cyclictest0-21swapper/320:45:443
266400399202,5cyclictest0-21swapper/322:15:363
266400399202,5cyclictest0-21swapper/322:15:363
266400399202,5cyclictest0-21swapper/300:00:443
266400399202,4cyclictest0-21swapper/300:30:293
266400399202,3cyclictest0-21swapper/319:10:363
266400399201,5cyclictest0-21swapper/323:20:263
266400399201,5cyclictest0-21swapper/323:10:363
266400399201,5cyclictest0-21swapper/322:25:533
266400399201,5cyclictest0-21swapper/322:10:373
266400399201,5cyclictest0-21swapper/319:15:413
266400399201,5cyclictest0-21swapper/300:20:443
266400399201,4cyclictest0-21swapper/323:05:443
266400399201,4cyclictest0-21swapper/322:00:393
266400399201,4cyclictest0-21swapper/321:10:383
266400399201,3cyclictest0-21swapper/321:15:433
266400399192,8cyclictest0-21swapper/323:45:383
266400399192,4cyclictest0-21swapper/323:55:373
266400399191,4cyclictest0-21swapper/321:45:393
266400399191,4cyclictest0-21swapper/321:25:383
2664000991910,6cyclictest421-21dbus-daemon19:10:010
266400399182,4cyclictest0-21swapper/321:50:303
266400399181,5cyclictest0-21swapper/323:35:273
266400399181,5cyclictest0-21swapper/300:35:263
266400399181,4cyclictest0-21swapper/319:55:353
266400399173,3cyclictest0-21swapper/320:40:023
266400399171,4cyclictest0-21swapper/319:30:393
266400399162,7cyclictest0-21swapper/320:20:373
266400399162,7cyclictest0-21swapper/320:20:373
266400399122,6cyclictest0-21swapper/321:00:263
266400399115,4cyclictest0-21swapper/320:05:403
266400399104,4cyclictest0-21swapper/322:20:373
266400399103,5cyclictest0-21swapper/320:00:383
266400399101,7cyclictest0-21swapper/319:25:383
26640039994,3cyclictest0-21swapper/320:15:393
26640039992,6cyclictest0-21swapper/320:30:013
26640039992,5cyclictest0-21swapper/321:00:023
26640039991,5cyclictest0-21swapper/321:05:393
26640039991,4cyclictest0-21swapper/319:45:423
26640039991,3cyclictest0-21swapper/319:35:343
26640039981,5cyclictest0-21swapper/320:40:343
26640039981,5cyclictest0-21swapper/320:10:353
26640039981,5cyclictest0-21swapper/319:40:373
26640039981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional