You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 03:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Aug 15, 2026 00:43:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319352994940,6cyclictest0-21swapper/122:16:061
319352994537,5cyclictest325366-21systemd-run19:30:011
319351994537,6cyclictest383043-21wc21:55:020
319351994537,6cyclictest383043-21wc21:55:020
319353994438,3cyclictest0-21swapper/222:15:552
319353994437,4cyclictest459307-21run-parts00:00:012
319353994435,6cyclictest485-21in:imuxsock20:01:012
319352994437,4cyclictest0-21swapper/120:00:011
319352994436,5cyclictest338854-21systemd-run20:15:021
319353994335,5cyclictest265-21systemd-journal00:40:012
319351994335,5cyclictest1-21systemd22:00:010
319351994335,5cyclictest1-21systemd22:00:010
319353994234,5cyclictest431845-21latency_hist23:15:022
319352994234,4cyclictest1001-21mta-sts-daemon23:52:331
319352994233,6cyclictest2799158-21cups-browsed23:58:321
319353994132,6cyclictest344854-21systemd-run20:35:012
319351994131,7cyclictest456268-21ssh23:55:010
31935399403,7cyclictest171rcu_preempt23:50:562
319353994034,3cyclictest0-21swapper/223:40:012
319352994033,4cyclictest370712-21debian-sa121:35:011
319352994032,5cyclictest349348-21systemd-run20:50:011
319352994032,5cyclictest1-21systemd23:50:011
31935299401,26cyclictest472808-21ssh00:20:591
319353993931,5cyclictest439-21systemd-logind20:40:022
319351993932,4cyclictest376879-21systemd-run21:45:010
319351993931,4cyclictest0-21swapper/000:30:550
31935399383,29cyclictest411671-21ssh22:41:002
319353993830,5cyclictest401318-21cron22:25:012
319353993829,6cyclictest420-21avahi-daemon22:10:362
319353993818,14cyclictest351ktimers/200:10:562
319353993818,14cyclictest351ktimers/200:10:562
319352993831,4cyclictest387115-21ssh22:00:551
319352993830,5cyclictest441711-21diskstats23:30:481
319352993829,6cyclictest471700-21latency_hist00:20:021
31935199383,28cyclictest430123-21awk23:11:020
319351993824,11cyclictest459389-21cups-browsed00:22:510
319351993823,5cyclictest347834-21cron20:45:010
319353993729,5cyclictest421110-21threads22:56:052
319353993728,5cyclictest381630-21unixbench_multi21:51:082
319353993728,5cyclictest381630-21unixbench_multi21:51:082
319352993730,4cyclictest437913-21cron23:25:001
319352993730,4cyclictest353914-21latency_hist21:05:021
319352993730,4cyclictest341850-21munin-plugin-st20:25:011
319351993730,4cyclictest389131-21latency_hist22:05:020
319353993628,5cyclictest372446-21unixbench_multi21:36:092
319353993628,5cyclictest0-21swapper/222:25:572
319353993627,6cyclictest421-21dbus-daemon00:00:502
319353993627,6cyclictest421-21dbus-daemon00:00:502
319353993626,7cyclictest2799121-21cupsd23:17:022
319353993623,9cyclictest2799158-21cups-browsed22:32:592
319352993629,4cyclictest465609-21latency_hist00:10:021
319352993629,4cyclictest465609-21latency_hist00:10:021
319352993629,4cyclictest328330-21idleruntime-cro19:40:001
319352993628,5cyclictest392213-21latency_hist22:10:021
319352993627,6cyclictest420-21avahi-daemon00:26:331
319351993630,3cyclictest0-21swapper/023:01:010
319351993628,5cyclictest328282-21unixbench_singl19:36:080
319351993618,12cyclictest151ktimers/020:30:520
319351993618,12cyclictest12650irq/32-eth022:50:560
31935199361,30cyclictest393481-21ssh22:11:030
31935399358,8cyclictest36-21ksoftirqd/221:40:572
31935399353,25cyclictest478948-21ssh00:31:002
319353993529,3cyclictest0-21swapper/223:50:022
319353993528,4cyclictest437926-21munin-plugin-st23:25:002
319353993518,12cyclictest421-21dbus-daemon20:25:582
319352993529,4cyclictest1003-21mta-sts-daemon21:20:571
319352993528,4cyclictest340343-21systemctl20:20:011
319352993526,6cyclictest2898839-21munin-node22:46:591
319351993530,2cyclictest0-21swapper/022:20:010
319351993528,4cyclictest1000-21mta-sts-daemon22:55:500
319351993525,8cyclictest0-21swapper/019:16:090
31935199352,27cyclictest2799158-21cups-browsed21:21:010
319353993428,3cyclictest417060-21aten2.4-expect22:50:462
319353993428,3cyclictest0-21swapper/200:05:462
319353993428,3cyclictest0-21swapper/200:05:462
319353993427,4cyclictest355258-21unixbench_singl21:06:082
319353993427,4cyclictest1000-21mta-sts-daemon22:45:502
319353993426,5cyclictest366271-21ssh21:26:062
319352993428,3cyclictest0-21swapper/123:00:581
319352993428,3cyclictest0-21swapper/120:40:011
319352993424,7cyclictest2799121-21cupsd19:41:001
319352993424,7cyclictest2799121-21cupsd19:41:001
319351993426,6cyclictest343359-21systemd-run20:30:010
319351993426,5cyclictest366905-21sshd21:27:470
319351993424,7cyclictest151ktimers/023:35:560
31935399337,20cyclictest428-21mta-sts-daemon19:50:582
319353993327,3cyclictest0-21swapper/223:06:032
319353993327,3cyclictest0-21swapper/221:20:012
319353993325,5cyclictest448816-21grep23:41:082
319353993325,5cyclictest439329-21mailstats23:26:022
319353993325,5cyclictest409117-21unixbench-2d22:36:142
31935399332,25cyclictest356525-21ssh21:10:572
31935399331,24cyclictest384261-21sh21:56:032
31935399331,24cyclictest384261-21sh21:56:032
319352993326,4cyclictest445443-21mailstats23:36:051
319352993326,4cyclictest1002-21mta-sts-daemon22:31:061
319352993325,5cyclictest376864-21munin-plugin-st21:45:011
31935199333,23cyclictest436004-21ssh23:20:550
319351993326,4cyclictest471607-21systemd-run00:20:010
319351993326,4cyclictest421-21dbus-daemon21:14:580
319351993315,13cyclictest151ktimers/020:05:560
31935399324,21cyclictest351ktimers/221:20:572
31935399323,24cyclictest368889-21ssh21:30:582
319353993227,3cyclictest0-21swapper/200:26:002
319353993224,5cyclictest1001-21mta-sts-daemon23:01:222
319353993223,6cyclictest421-21dbus-daemon23:35:012
319353993223,6cyclictest2799158-21cups-browsed22:03:152
319353993223,6cyclictest265-21systemd-journal20:10:012
319353993223,5cyclictest349277-21head20:46:072
319353993222,7cyclictest472564-21latency00:20:522
319353993221,8cyclictest323200-21ntp_kernel_err19:20:552
319353993217,10cyclictest470835-21sshd00:17:462
31935299326,8cyclictest62750lldpd21:10:561
319352993226,3cyclictest0-21swapper/123:20:001
319352993226,3cyclictest0-21swapper/121:55:591
319352993226,3cyclictest0-21swapper/121:55:591
319352993224,5cyclictest430090-21ps23:11:021
319352993224,5cyclictest401340-21systemd-run22:25:011
319352993224,5cyclictest355336-21diskmemload23:05:521
319352993223,4cyclictest0-21swapper/122:36:031
319352993222,8cyclictest351666-21ntp_kernel_err20:55:541
319352993222,7cyclictest365583-21missed_timers21:25:511
319351993226,3cyclictest0-21swapper/000:06:080
319351993226,3cyclictest0-21swapper/000:06:080
319351993225,4cyclictest323730-21unixbench_multi19:21:080
31935399314,12cyclictest355336-21diskmemload21:49:592
319353993124,4cyclictest328228-21unixbench_multi19:36:082
319353993124,3cyclictest0-21swapper/220:20:542
319353993123,5cyclictest352330-21systemctl21:00:012
31935299316,18cyclictest371987-21ssh21:36:011
319352993125,3cyclictest0-21swapper/100:31:081
319352993125,3cyclictest0-21swapper/100:11:061
319352993125,3cyclictest0-21swapper/100:11:061
319352993124,3cyclictest0-21swapper/122:55:471
319351993124,4cyclictest457435-21ntp_kernel_pll_23:55:550
319351993123,5cyclictest0-21swapper/021:35:480
319351993122,7cyclictest330378-21fschecks_time19:45:460
319351993116,11cyclictest12650irq/32-eth021:05:590
319353993025,2cyclictest0-21swapper/220:00:012
319353993022,5cyclictest567-21gdbus19:30:552
319353993020,6cyclictest421-21dbus-daemon22:05:492
319353993013,14cyclictest265-21systemd-journal20:15:012
319352993024,3cyclictest0-21swapper/122:10:501
319352993023,4cyclictest346805-21cpuspeed20:40:481
319352993023,4cyclictest335528-21switchtime20:01:071
319352993023,4cyclictest0-21swapper/120:55:011
319352993022,4cyclictest1001-21mta-sts-daemon22:41:321
31935299302,23cyclictest417677-21ssh22:50:561
319352993020,8cyclictest360143-21sed21:16:091
31935199306,15cyclictest151ktimers/023:06:020
31935199304,4cyclictest171rcu_preempt23:30:560
319351993024,3cyclictest0-21swapper/022:50:010
319351993022,5cyclictest151ktimers/022:20:570
31935199302,23cyclictest448350-21ntpq23:41:000
319351993019,8cyclictest378360-21switchtime21:46:060
319351993014,14cyclictest0-21swapper/020:53:140
31935199301,26cyclictest359750-21ssh21:16:040
319351993011,13cyclictest12650irq/32-eth000:35:570
319353992923,3cyclictest0-21swapper/221:01:002
319353992923,3cyclictest0-21swapper/220:20:012
31935399292,21cyclictest665-21snmpd19:26:012
319352992923,3cyclictest0-21swapper/123:26:061
319352992922,4cyclictest1002-21mta-sts-daemon19:31:051
319352992922,3cyclictest0-21swapper/123:40:491
319352992921,5cyclictest567-21gdbus19:51:041
319351992924,2cyclictest0-21swapper/019:11:070
319351992923,4cyclictest477765-21latency_hist00:30:020
319351992923,4cyclictest462413-21idleruntime-cro00:05:000
319351992923,4cyclictest462413-21idleruntime-cro00:05:000
319351992923,4cyclictest1000-21mta-sts-daemon19:27:250
319351992923,3cyclictest0-21swapper/000:15:000
319351992923,3cyclictest0-21swapper/000:15:000
319351992921,6cyclictest402405-21needreboot22:25:540
319351992921,5cyclictest390481-21sendmail_mailst22:06:030
319351992917,8cyclictest439174-21sh23:25:580
319353992816,8cyclictest1001-21mta-sts-daemon20:41:012
319353992815,9cyclictest421-21dbus-daemon19:45:012
319353992815,9cyclictest421-21dbus-daemon19:45:012
31935299284,18cyclictest428-21mta-sts-daemon21:50:101
31935299284,18cyclictest428-21mta-sts-daemon21:50:101
319352992823,2cyclictest0-21swapper/122:30:031
319352992823,2cyclictest0-21swapper/119:25:011
319352992823,2cyclictest0-21swapper/100:36:021
31935299282,12cyclictest460493-21ntpq00:00:561
31935299282,12cyclictest460493-21ntpq00:00:561
319351992822,4cyclictest338754-21head20:11:070
319351992822,4cyclictest151ktimers/020:01:020
319351992820,5cyclictest453222-21systemd-run23:50:010
319351992820,5cyclictest265-21systemd-journal23:20:000
319351992819,3cyclictest334327-21grep20:00:010
319351992817,9cyclictest0-21swapper/021:05:020
319353992718,7cyclictest319369-21latency_hist19:10:022
31935299275,16cyclictest428-21mta-sts-daemon20:25:561
319352992721,3cyclictest0-21swapper/121:10:011
319351992721,2cyclictest0-21swapper/022:41:150
319351992719,6cyclictest1000-21mta-sts-daemon21:31:070
319351992714,9cyclictest408728-21ssh22:36:080
319353992620,3cyclictest0-21swapper/219:16:042
319353992618,5cyclictest320855-21systemd-run19:15:012
31935299264,17cyclictest344386-21ps20:31:001
319352992619,4cyclictest0-21swapper/121:46:031
31935199262,20cyclictest406112-21sed22:31:080
319351992618,6cyclictest326040-21latency19:30:490
319353992517,5cyclictest420-21avahi-daemon20:55:012
319352992517,5cyclictest320711-21unixbench_multi19:11:061
319351992516,7cyclictest346117-21timerwakeupswit20:36:100
319353992419,2cyclictest0-21swapper/219:45:482
31935199241,20cyclictest351435-21awk20:55:500
31935299231,16cyclictest665-21snmpd19:15:561
319351992317,3cyclictest1002-21mta-sts-daemon19:50:340
319351992311,9cyclictest0-21swapper/020:15:460
319351992310,10cyclictest0-21swapper/020:20:510
319352992211,8cyclictest336756-21ntpq20:05:581
319352992114,4cyclictest1001-21mta-sts-daemon19:48:331
319351992115,4cyclictest0-21swapper/020:46:070
31935199211,17cyclictest329240-21ntpq19:40:570
31935199211,17cyclictest329240-21ntpq19:40:570
31935499201,8cyclictest0-21swapper/321:50:593
31935499201,8cyclictest0-21swapper/321:50:593
319352991913,3cyclictest0-21swapper/119:10:021
31935499185,10cyclictest0-21swapper/323:30:593
31935499182,9cyclictest0-21swapper/300:16:003
31935199183,9cyclictest0-21swapper/019:10:010
31935499172,8cyclictest0-21swapper/300:30:563
31935499172,7cyclictest0-21swapper/322:26:023
31935499171,6cyclictest0-21swapper/320:40:563
31935499163,6cyclictest0-21swapper/323:40:583
31935499162,9cyclictest0-21swapper/300:01:013
31935499162,9cyclictest0-21swapper/300:01:013
31935499162,8cyclictest0-21swapper/300:25:583
31935499161,8cyclictest0-21swapper/323:45:583
31935499161,8cyclictest0-21swapper/322:15:553
31935499161,5cyclictest0-21swapper/320:35:583
31935499152,6cyclictest0-21swapper/322:35:583
31935499151,8cyclictest0-21swapper/300:20:553
31935499151,7cyclictest0-21swapper/322:51:023
31935499151,7cyclictest0-21swapper/320:10:573
31935499151,6cyclictest0-21swapper/319:55:533
31935499143,8cyclictest0-21swapper/320:25:583
31935499143,7cyclictest0-21swapper/322:06:003
31935499141,8cyclictest0-21swapper/323:36:003
31935499141,7cyclictest0-21swapper/323:55:583
31935499141,7cyclictest0-21swapper/323:50:583
31935499141,7cyclictest0-21swapper/322:01:033
31935499141,7cyclictest0-21swapper/321:55:593
31935499141,7cyclictest0-21swapper/321:55:593
31935499141,7cyclictest0-21swapper/321:10:593
31935499141,6cyclictest0-21swapper/323:15:523
31935499141,6cyclictest0-21swapper/321:00:553
31935499141,6cyclictest0-21swapper/319:40:553
31935499141,6cyclictest0-21swapper/319:40:553
31935499141,6cyclictest0-21swapper/300:05:563
31935499141,6cyclictest0-21swapper/300:05:563
31935499132,7cyclictest0-21swapper/322:14:143
31935499132,5cyclictest0-21swapper/323:00:573
31935499131,7cyclictest0-21swapper/323:20:553
31935499131,7cyclictest0-21swapper/323:10:553
31935499131,7cyclictest0-21swapper/322:40:553
31935499131,7cyclictest0-21swapper/300:35:583
31935499131,6cyclictest0-21swapper/321:35:593
31935499131,6cyclictest0-21swapper/321:15:553
31935499131,6cyclictest0-21swapper/320:50:563
31935499131,6cyclictest0-21swapper/319:50:583
31935499131,6cyclictest0-21swapper/319:30:533
31935499131,6cyclictest0-21swapper/319:25:563
31935499131,6cyclictest0-21swapper/300:10:543
31935499131,6cyclictest0-21swapper/300:10:543
31935499130,6cyclictest0-21swapper/322:20:543
31935499122,7cyclictest0-21swapper/320:30:523
31935499122,6cyclictest0-21swapper/322:45:543
31935499122,5cyclictest0-21swapper/321:20:553
31935499121,7cyclictest0-21swapper/322:30:543
31935499121,7cyclictest0-21swapper/321:25:543
31935499121,6cyclictest0-21swapper/320:21:023
31935499121,6cyclictest0-21swapper/320:00:563
31935499121,6cyclictest0-21swapper/319:16:043
31935499120,8cyclictest0-21swapper/319:11:013
31935499112,5cyclictest0-21swapper/323:25:493
31935499112,5cyclictest0-21swapper/322:55:493
31935499112,5cyclictest0-21swapper/321:30:523
31935499111,7cyclictest0-21swapper/321:50:013
31935499111,7cyclictest0-21swapper/321:41:013
31935499111,5cyclictest0-21swapper/323:05:513
31935499111,5cyclictest0-21swapper/320:55:573
31935499111,5cyclictest0-21swapper/320:45:543
31935499111,5cyclictest0-21swapper/320:15:463
31935499111,5cyclictest0-21swapper/320:05:553
31935499101,5cyclictest0-21swapper/319:45:563
31935499100,5cyclictest0-21swapper/319:35:543
3193549991,6cyclictest0-21swapper/319:10:023
3193549991,5cyclictest0-21swapper/321:05:143
3193549990,5cyclictest0-21swapper/319:20:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional