You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 02:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Tue May 19, 2026 00:43:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3714629995241,8cyclictest3776782-21unixbench-2d21:41:052
3714629995042,5cyclictest1-21systemd23:30:012
3714627994930,15cyclictest3856041-21latency_hist23:20:010
3714627994731,14cyclictest3920605-21latency_hist00:40:020
3714629994637,6cyclictest421-21dbus-daemon21:11:022
3714629994537,5cyclictest3737148-21systemd-run20:25:012
3714629994536,5cyclictest3722136-21systemd-run19:35:012
3714629994534,8cyclictest3774931-21rm21:40:022
3714628994539,3cyclictest0-21swapper/123:10:591
3714628994537,5cyclictest3740112-21grep20:35:001
3714627994534,8cyclictest3818551-21sshd22:32:570
3714629994436,5cyclictest3823716-21run-parts22:40:012
3714629994435,5cyclictest3845833-21unixbench_multi23:06:102
3714629994433,8cyclictest3717648-21sh19:20:012
3714628994436,6cyclictest421-21dbus-daemon00:10:011
3714627994415,23cyclictest3833409-21ssh22:51:050
3714627994335,5cyclictest151ktimers/021:05:590
3714629994234,5cyclictest0-21swapper/221:25:012
3714629994234,5cyclictest0-21swapper/221:25:012
3714628994234,5cyclictest3856122-21latency_hist23:20:021
3714627994235,4cyclictest3774869-21latency_hist21:40:000
371462799421,35cyclictest3901755-21ssh00:15:580
371462999414,31cyclictest3788449-21ssh21:55:562
3714629994135,3cyclictest0-21swapper/223:20:002
3714629994134,4cyclictest3750615-21diskmemload22:35:012
3714629994134,3cyclictest0-21swapper/200:15:462
3714629994133,5cyclictest3839905-21systemd-run23:00:012
3714629994133,5cyclictest3740639-21fschecks_time20:35:492
3714629994127,10cyclictest1883891-21cups-browsed22:42:552
3714629994127,10cyclictest1883891-21cups-browsed22:42:552
3714628994135,4cyclictest3791118-21basename22:00:011
3714628994131,6cyclictest3884788-21aten_r2power_en23:55:411
3714627994133,5cyclictest421-21dbus-daemon23:05:010
3714627994132,7cyclictest1883891-21cups-browsed19:45:530
3714627994131,7cyclictest3795213-21munin-plugin-st22:05:020
3714627994131,7cyclictest3795213-21munin-plugin-st22:05:020
3714627994126,12cyclictest3807425-21munin-run22:20:010
3714629994032,5cyclictest3900471-21latency_hist00:15:022
3714629994032,5cyclictest3864927-21grep23:30:482
3714629994031,6cyclictest659-21snmpd23:10:592
3714629994031,6cyclictest439-21systemd-logind21:50:012
3714629994028,9cyclictest3877283-21missed_timers23:45:552
3714628994032,5cyclictest3722105-21sh19:35:001
3714629993933,3cyclictest0-21swapper/200:35:592
3714629993931,5cyclictest3872025-21cron23:40:012
3714629993930,6cyclictest1883891-21cups-browsed22:18:542
3714629993925,10cyclictest421-21dbus-daemon00:21:392
371462999392,33cyclictest3808735-21sh22:20:532
371462899393,30cyclictest3845390-21ssh23:06:041
3714627993923,12cyclictest3872828-21aten_r2power_vo23:40:450
371462999385,6cyclictest171rcu_preempt19:56:042
371462999385,27cyclictest3857297-21ssh23:20:542
3714629993834,3cyclictest3714626-21cyclictest19:45:542
3714629993830,5cyclictest3767426-21aten_r2power_fr21:30:432
3714629993829,6cyclictest1-21systemd19:25:022
371462999382,28cyclictest3796638-21ssh22:05:582
3714628993832,4cyclictest3888206-21kworker/u8:6+rpciod00:40:011
3714628993832,3cyclictest0-21swapper/122:50:591
3714628993829,6cyclictest421-21dbus-daemon21:51:011
3714628993829,6cyclictest420-21avahi-daemon21:21:061
3714628993829,6cyclictest420-21avahi-daemon21:21:061
3714628993829,6cyclictest3898249-21unixbench_multi00:11:071
371462899381,30cyclictest3821025-21sh22:35:571
3714627993828,4cyclictest3898294-21unixbench_singl00:11:080
3714627993826,8cyclictest3812578-21kernelversion22:25:500
3714629993730,4cyclictest1055-21mta-sts-daemon21:17:252
3714629993729,5cyclictest3746102-21latency_hist20:55:012
3714629993728,4cyclictest0-21swapper/223:02:442
371462899373,25cyclictest3816948-21ssh22:30:571
3714628993731,3cyclictest0-21swapper/120:00:011
3714628993728,6cyclictest3774862-21cron21:40:001
3714627993731,4cyclictest3791097-21cron22:00:010
3714627993731,4cyclictest3750615-21diskmemload00:05:460
3714627993731,3cyclictest0-21swapper/023:10:590
3714627993730,4cyclictest3864028-21sh23:30:010
3714627993729,5cyclictest3778981-21ssh21:45:010
3714627993728,5cyclictest151ktimers/019:56:010
371462999363,24cyclictest3784401-21ssh21:50:562
3714629993629,4cyclictest3835839-21munin-run22:55:002
3714629993628,5cyclictest3888198-21cups-browsed00:28:162
3714629993628,5cyclictest3872930-21/usr/sbin/munin23:40:462
3714629993628,4cyclictest0-21swapper/221:00:012
3714629993625,7cyclictest1051-21mta-sts-daemon22:25:582
3714628993630,4cyclictest3714626-21cyclictest19:30:001
3714628993628,5cyclictest3888198-21cups-browsed00:29:111
3714628993627,6cyclictest3869245-21needreboot23:35:511
3714627993631,3cyclictest3868001-21munin-run23:35:000
3714627993630,4cyclictest3877679-21ssh23:46:060
371462799361,26cyclictest3760038-21ssh21:20:540
371462799361,26cyclictest3760038-21ssh21:20:540
371462999353,23cyclictest3885569-21sh23:55:562
3714629993529,4cyclictest1051-21mta-sts-daemon23:53:092
3714629993527,5cyclictest3750635-21systemd-run21:10:012
3714629993527,5cyclictest3740134-21systemd-run20:35:012
3714629993526,6cyclictest1883891-21cups-browsed19:50:502
3714629993525,5cyclictest3896337-21systemd-run00:10:012
3714628993529,3cyclictest0-21swapper/123:45:011
3714628993528,4cyclictest3754628-21cron21:15:011
3714628993528,3cyclictest0-21swapper/123:55:011
3714628993527,5cyclictest3775514-21sh21:40:421
3714628993527,5cyclictest1-21systemd00:03:261
3714628993527,5cyclictest1-21systemd00:03:261
3714628993526,6cyclictest3717665-21latency_hist19:20:021
3714628993524,8cyclictest3905534-21latency00:20:511
3714628993524,8cyclictest3747611-21systemctl21:00:011
3714627993524,4cyclictest3829267-21ssh22:46:000
3714629993428,3cyclictest0-21swapper/222:15:012
3714629993427,3cyclictest0-21swapper/220:20:002
3714628993428,3cyclictest0-21swapper/121:20:021
3714628993428,3cyclictest0-21swapper/121:10:011
3714628993426,5cyclictest261-21systemd-journal22:30:021
3714628993425,6cyclictest3901945-21mailstats00:16:031
3714628993422,8cyclictest3767880-21latency21:30:491
3714627993426,6cyclictest3795954-21aten_r2power_po22:05:450
3714627993422,10cyclictest3738633-21systemd-run20:30:010
371462799341,23cyclictest3756114-21ssh21:16:020
3714629993326,4cyclictest1056-21mta-sts-daemon21:28:382
3714629993325,5cyclictest1056-21mta-sts-daemon22:47:092
3714629993325,4cyclictest0-21swapper/200:30:492
3714629993316,12cyclictest548-21gdbus22:00:112
3714629993316,12cyclictest548-21gdbus22:00:112
3714628993327,4cyclictest3714626-21cyclictest23:30:001
3714628993326,4cyclictest1054-21mta-sts-daemon22:56:331
3714628993325,5cyclictest3733139-21fschecks_time20:10:481
3714628993325,5cyclictest1883891-21cups-browsed22:18:541
3714627993327,3cyclictest0-21swapper/022:40:010
3714627993327,3cyclictest0-21swapper/021:50:010
3714627993326,3cyclictest0-21swapper/000:21:040
3714627993323,7cyclictest3857649-21mailstats23:21:050
3714627993323,7cyclictest3766732-21ssh21:30:000
3714628993227,2cyclictest0-21swapper/123:05:011
3714628993225,4cyclictest1054-21mta-sts-daemon22:44:121
3714628993225,4cyclictest1054-21mta-sts-daemon22:44:121
3714628993224,5cyclictest3735612-21munin-run20:20:001
3714628993224,5cyclictest3725120-21debian-sa119:45:011
3714628993223,6cyclictest1051-21mta-sts-daemon23:32:101
3714628993223,5cyclictest421-21dbus-daemon22:07:431
3714627993227,2cyclictest0-21swapper/000:05:010
3714627993227,2cyclictest0-21swapper/000:05:010
3714627993226,4cyclictest3913895-21ssh00:30:580
3714627993225,5cyclictest3735656-21unin-run20:20:010
3714627993225,4cyclictest3888235-21sendmail00:00:010
3714627993219,4cyclictest3717604-21cron19:20:010
371462799321,26cyclictest3881567-21ssh23:51:000
3714629993124,3cyclictest0-21swapper/200:00:562
3714629993124,3cyclictest0-21swapper/200:00:562
371462899313,7cyclictest3750615-21diskmemload21:45:571
3714628993121,5cyclictest0-21swapper/100:30:571
371462899311,24cyclictest3829235-21ssh22:45:581
371462799313,23cyclictest3837280-21ssh22:56:010
3714627993125,4cyclictest3845695-21timerandwakeup23:06:090
3714628993023,5cyclictest0-21swapper/122:11:051
3714628993022,5cyclictest3737639-21fschecks_count20:25:471
3714628993022,5cyclictest3729955-21aten_r2power_fr20:00:441
3714628993021,6cyclictest0-21swapper/123:20:491
371462799303,21cyclictest3909673-21ssh00:25:510
3714627993023,4cyclictest3811666-21latency_hist22:25:020
3714627993021,7cyclictest3752672-21sh21:11:120
3714627993018,9cyclictest0-21swapper/021:30:430
3714629992921,5cyclictest3716099-21cron19:15:012
3714628992923,3cyclictest0-21swapper/119:40:001
3714628992923,3cyclictest0-21swapper/119:40:001
3714628992922,4cyclictest3744612-21idleruntime-cro20:50:011
3714628992922,4cyclictest1056-21mta-sts-daemon21:29:071
3714628992922,4cyclictest1055-21mta-sts-daemon20:20:501
3714628992921,6cyclictest3879144-21sshd23:48:091
371462899291,24cyclictest3808836-21ssh22:20:561
3714627992923,4cyclictest3721144-21fschecks_time19:30:480
3714627992923,3cyclictest0-21swapper/022:40:510
3714627992923,3cyclictest0-21swapper/022:40:510
3714627992921,6cyclictest3728122-21sh19:55:010
3714629992820,5cyclictest3723854-21/usr/sbin/munin19:40:592
3714629992811,8cyclictest421-21dbus-daemon19:10:012
3714628992820,5cyclictest1883891-21cups-browsed19:51:561
3714628992819,6cyclictest1883891-21cups-browsed20:53:121
3714627992822,4cyclictest3783713-21aten_r2power_po21:50:430
3714627992817,8cyclictest3722922-21needreboot19:35:580
3714627992817,8cyclictest3722922-21needreboot19:35:580
371462799281,18cyclictest3800612-21ssh22:10:550
3714629992719,5cyclictest0-21swapper/220:15:002
3714629992718,6cyclictest1-21systemd20:10:022
3714628992719,5cyclictest1883891-21cups-browsed19:47:101
3714628992719,4cyclictest1056-21mta-sts-daemon22:00:471
3714628992719,4cyclictest1056-21mta-sts-daemon22:00:471
3714627992722,3cyclictest3719078-21unixbench_singl19:21:050
3714627992722,2cyclictest0-21swapper/020:56:060
3714627992721,4cyclictest3729987-21aten_r2power_po20:00:450
3714627992717,7cyclictest3748435-21needreboot21:00:540
3714627992713,6cyclictest151ktimers/023:36:000
3714629992621,3cyclictest0-21swapper/220:46:032
3714629992619,4cyclictest3729757-21kworker/u8:11-xprtiod20:05:012
3714629992618,5cyclictest351ktimers/220:40:562
3714628992618,5cyclictest3731454-21aten_r2power_fr20:05:441
3714627992620,4cyclictest3734048-21unixbench_singl20:11:070
3714627992618,5cyclictest3725137-21kworker/u8:7-xprtiod20:35:580
3714629992517,5cyclictest3723619-21awk19:40:002
3714629992517,5cyclictest3723619-21awk19:40:002
3714628992519,3cyclictest0-21swapper/120:40:011
3714628992517,5cyclictest3743054-21head20:41:061
3714627992520,3cyclictest3732615-21munin-plugin-st20:10:010
3714627992519,4cyclictest3725145-21systemd-run19:45:010
3714627992517,6cyclictest3737150-21kworker/u8:14+xprtiod20:30:520
3714629992419,2cyclictest0-21swapper/221:01:072
3714629992418,3cyclictest0-21swapper/219:26:052
3714627992420,3cyclictest3714626-21cyclictest19:25:480
3714627992419,3cyclictest3744637-21unin-run20:50:010
3714627992418,4cyclictest0-21swapper/019:10:490
3714629992316,3cyclictest0-21swapper/220:30:012
3714628992315,5cyclictest3748155-21fschecks_time21:00:501
3714628992315,5cyclictest3717934-21head19:20:441
3714628992315,5cyclictest3716033-21unixbench_singl19:11:051
3714627992318,3cyclictest3737092-21vmstat20:21:040
3714627992216,4cyclictest3746101-21cron20:55:010
371462799212,6cyclictest421-21dbus-daemon19:10:010
371462799211,15cyclictest1883891-21cups-browsed20:40:550
371462899190,4cyclictest1-21systemd19:10:011
371463099182,9cyclictest0-21swapper/323:25:593
371463099182,10cyclictest0-21swapper/323:11:013
371463099164,7cyclictest0-21swapper/323:55:573
371463099163,6cyclictest0-21swapper/323:46:043
371463099161,9cyclictest0-21swapper/321:41:003
371463099161,8cyclictest0-21swapper/322:00:563
371463099161,8cyclictest0-21swapper/322:00:563
371463099161,8cyclictest0-21swapper/321:10:583
371463099153,7cyclictest0-21swapper/300:15:553
371463099152,7cyclictest0-21swapper/322:05:573
371463099152,7cyclictest0-21swapper/321:35:563
371463099151,7cyclictest0-21swapper/320:25:563
371463099142,8cyclictest0-21swapper/321:50:563
371463099142,8cyclictest0-21swapper/300:20:583
371463099142,7cyclictest0-21swapper/322:50:593
371463099142,7cyclictest0-21swapper/321:15:573
371463099142,6cyclictest0-21swapper/322:20:533
371463099142,6cyclictest0-21swapper/300:05:543
371463099141,8cyclictest0-21swapper/323:36:003
371463099141,7cyclictest0-21swapper/323:05:583
371463099141,7cyclictest0-21swapper/322:40:533
371463099141,7cyclictest0-21swapper/322:40:533
371463099141,7cyclictest0-21swapper/321:25:563
371463099141,7cyclictest0-21swapper/321:20:523
371463099141,7cyclictest0-21swapper/321:20:523
371463099141,6cyclictest0-21swapper/320:40:533
371463099141,6cyclictest0-21swapper/319:36:033
371463099141,6cyclictest0-21swapper/319:36:033
371463099140,8cyclictest0-21swapper/321:46:013
371463099133,7cyclictest0-21swapper/319:15:583
371463099133,6cyclictest0-21swapper/300:35:583
371463099133,6cyclictest0-21swapper/300:00:563
371463099133,6cyclictest0-21swapper/300:00:563
371463099132,7cyclictest0-21swapper/322:45:543
371463099132,7cyclictest0-21swapper/322:10:583
371463099132,6cyclictest0-21swapper/323:40:483
371463099132,6cyclictest0-21swapper/323:31:013
371463099132,6cyclictest0-21swapper/322:55:573
371463099132,6cyclictest0-21swapper/322:35:533
371463099132,6cyclictest0-21swapper/321:30:543
371463099132,6cyclictest0-21swapper/320:55:553
371463099132,4cyclictest0-21swapper/319:25:523
371463099131,8cyclictest0-21swapper/322:25:553
371463099131,7cyclictest0-21swapper/322:30:543
371463099131,7cyclictest0-21swapper/321:55:533
371463099131,7cyclictest0-21swapper/300:30:503
371463099131,6cyclictest0-21swapper/320:30:533
371463099131,6cyclictest0-21swapper/320:15:563
371463099131,6cyclictest0-21swapper/319:40:593
371463099131,5cyclictest0-21swapper/320:10:533
371463099130,7cyclictest0-21swapper/319:30:543
371463099122,6cyclictest0-21swapper/323:20:453
371463099122,6cyclictest0-21swapper/323:00:543
371463099122,5cyclictest0-21swapper/319:55:593
371463099121,7cyclictest0-21swapper/300:10:453
371463099121,6cyclictest0-21swapper/323:50:503
371463099121,6cyclictest0-21swapper/323:15:483
371463099121,6cyclictest0-21swapper/321:02:443
371463099121,6cyclictest0-21swapper/300:25:513
371463099121,5cyclictest0-21swapper/320:45:583
371463099112,5cyclictest0-21swapper/319:20:553
371463099111,6cyclictest0-21swapper/322:15:513
371463099111,6cyclictest0-21swapper/320:40:023
371463099111,6cyclictest0-21swapper/320:05:523
371463099111,6cyclictest0-21swapper/319:45:563
371463099111,5cyclictest0-21swapper/319:50:533
371463099101,5cyclictest0-21swapper/321:05:533
371463099101,5cyclictest0-21swapper/320:00:543
371463099101,5cyclictest0-21swapper/319:10:523
37146309991,5cyclictest0-21swapper/320:50:503
37146309991,5cyclictest0-21swapper/320:20:503
37146309971,3cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional