You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 16:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Mon Aug 17, 2026 12:43:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
808279995535,17cyclictest1000-21mta-sts-daemon10:18:482
808279995235,13cyclictest0-21swapper/212:00:012
808279995225,5cyclictest833808-21debian-sa108:35:002
808279995225,23cyclictest905825-21aten_r2power_cu10:50:482
808279995027,19cyclictest0-21swapper/211:25:012
808279994922,5cyclictest1003-21mta-sts-daemon10:11:482
808279994822,4cyclictest814206-21unixbench_multi07:26:082
808277994741,3cyclictest0-21swapper/011:51:060
808277994739,5cyclictest926605-21idleruntime-cro11:25:010
808279994638,4cyclictest0-21swapper/208:55:572
808279994524,2cyclictest0-21swapper/209:55:022
808279994520,4cyclictest0-21swapper/211:45:582
808279994434,6cyclictest421-21dbus-daemon11:05:542
808279994433,3cyclictest0-21swapper/210:36:042
80827999443,15cyclictest970366-21sshd12:35:592
808279994419,3cyclictest878648-21kworker/u8:2-xprtiod10:20:542
808278994337,3cyclictest0-21swapper/112:05:581
808277994338,3cyclictest0-21swapper/012:30:590
808277994338,3cyclictest0-21swapper/012:30:590
808279994218,4cyclictest0-21swapper/212:11:052
808279994218,4cyclictest0-21swapper/212:11:052
808278994234,5cyclictest946599-21unixbench_singl11:56:081
808278994234,4cyclictest862698-21idleruntime-cro09:40:001
808278994234,4cyclictest0-21swapper/110:16:011
808278994233,6cyclictest420-21avahi-daemon09:11:221
808277994236,4cyclictest923538-21cron11:20:010
808279994135,2cyclictest0-21swapper/208:10:012
808279993931,5cyclictest893940-21fschecks_count10:30:522
808279993931,5cyclictest893940-21fschecks_count10:30:522
808279993930,6cyclictest921874-21proc_pri11:16:092
808279993831,5cyclictest808276-21cyclictest12:16:012
808279993824,3cyclictest171rcu_preempt10:00:012
808278993831,3cyclictest0-21swapper/110:11:041
808278993829,6cyclictest421-21dbus-daemon08:00:011
808277993832,4cyclictest911384-21ssh11:00:010
808279993728,6cyclictest969342-21latency_hist12:35:022
808279993728,6cyclictest969342-21latency_hist12:35:022
808279993727,8cyclictest854161-21aten_r2power_vo09:25:492
808278993729,5cyclictest811274-21idleruntime-cro07:20:011
808278993729,4cyclictest890135-21ssh10:25:011
808277993726,8cyclictest866990-21grep09:46:000
808277993723,11cyclictest0-21swapper/010:25:500
808277993723,11cyclictest0-21swapper/010:25:500
808279993629,4cyclictest944857-21kthreadd11:55:012
808279993629,3cyclictest0-21swapper/210:45:502
808278993630,3cyclictest0-21swapper/110:25:491
808278993630,3cyclictest0-21swapper/110:25:491
808278993630,3cyclictest0-21swapper/110:00:011
808278993629,4cyclictest0-21swapper/111:26:031
808278993629,4cyclictest0-21swapper/111:26:031
808278993629,4cyclictest0-21swapper/109:10:011
808278993629,3cyclictest0-21swapper/107:25:021
808278993628,5cyclictest870473-21unixbench-2d09:51:071
808277993632,2cyclictest0-21swapper/012:20:010
808277993632,2cyclictest0-21swapper/009:00:010
80827799362,29cyclictest894421-21ssh10:31:020
80827799362,29cyclictest894421-21ssh10:31:020
808277993612,20cyclictest869948-21ssh09:50:550
808279993527,5cyclictest876609-21unixbench-2d10:01:102
808278993529,3cyclictest0-21swapper/112:01:021
808278993528,4cyclictest1002-21mta-sts-daemon09:24:161
808278993527,5cyclictest912677-21ssh11:01:011
808278993527,5cyclictest843006-21latency_hist09:05:031
808278993527,5cyclictest1002-21mta-sts-daemon11:41:091
808277993528,4cyclictest914455-21ssh11:05:010
808277993528,4cyclictest824932-21latency_hist08:05:020
808277993528,4cyclictest1002-21mta-sts-daemon11:44:560
808277993526,6cyclictest818837-21kthreadd07:45:010
80827799352,28cyclictest915597-21ssh11:05:560
808277993522,10cyclictest0-21swapper/010:06:110
808277993514,17cyclictest151ktimers/012:36:020
808279993429,2cyclictest0-21swapper/207:20:012
808279993426,5cyclictest952721-21unixbench_singl12:06:122
808279993426,5cyclictest912488-21needreboot11:00:542
808279993426,5cyclictest878775-21/usr/sbin/munin10:05:522
808279993425,7cyclictest845739-21mailstats09:11:062
808279993425,6cyclictest860105-21/usr/sbin/munin09:36:082
808279993425,6cyclictest1003-21mta-sts-daemon11:25:492
808279993425,6cyclictest1003-21mta-sts-daemon11:25:492
808279993423,7cyclictest14482-21cups-browsed10:29:232
808279993423,7cyclictest14482-21cups-browsed10:29:232
808278993428,3cyclictest0-21swapper/111:11:141
808278993428,3cyclictest0-21swapper/108:40:001
808278993427,4cyclictest855125-21timerandwakeup09:26:091
808278993427,4cyclictest824727-21unixbench_multi08:01:101
808278993426,5cyclictest863516-21ssh09:40:541
808278993426,5cyclictest0-21swapper/108:50:021
808278993424,7cyclictest879455-21switchtime10:06:091
808278993422,8cyclictest857229-21cpu09:30:481
808277993426,5cyclictest847834-21/usr/sbin/munin09:16:080
808277993426,5cyclictest847834-21/usr/sbin/munin09:16:080
80827799342,17cyclictest939931-21ssh11:45:580
808277993420,10cyclictest12650irq/32-eth010:36:000
80827799341,30cyclictest151ktimers/011:31:030
80827799341,30cyclictest151ktimers/011:31:030
808279993326,3cyclictest0-21swapper/211:00:012
808279993322,8cyclictest857681-21needreboot09:30:552
808278993327,3cyclictest0-21swapper/111:20:591
808278993327,3cyclictest0-21swapper/111:20:011
80827899332,6cyclictest171rcu_preempt07:45:591
808278993325,5cyclictest906551-21awk10:51:011
808278993325,4cyclictest814264-21head07:26:081
808278993324,6cyclictest421-21dbus-daemon11:05:211
808278993322,8cyclictest897282-21needreboot10:35:581
808278993322,8cyclictest849020-21timerwakeupswit09:16:091
808278993322,8cyclictest849020-21timerwakeupswit09:16:091
808277993328,2cyclictest0-21swapper/012:25:590
808277993327,4cyclictest833755-21head08:31:100
808277993326,4cyclictest861357-21grep09:36:100
808277993325,5cyclictest952455-21sed12:06:110
808277993325,5cyclictest14482-21cups-browsed11:37:200
808277993320,8cyclictest12650irq/32-eth010:11:010
80827999323,22cyclictest964257-21ssh12:26:002
80827999323,21cyclictest918715-21ssh11:11:032
808279993225,4cyclictest963079-21cron12:25:012
808279993225,4cyclictest1002-21mta-sts-daemon12:01:172
808279993225,4cyclictest0-21swapper/209:41:062
808279993223,6cyclictest850496-21munin-run09:20:022
808279993223,6cyclictest850496-21munin-run09:20:022
808279993223,4cyclictest812811-21apt-get07:25:022
808278993226,3cyclictest0-21swapper/112:31:011
808278993226,3cyclictest0-21swapper/112:31:011
808278993225,4cyclictest902793-21aten_r2power_cu10:45:471
808278993225,3cyclictest0-21swapper/109:46:031
808278993224,5cyclictest836711-21sed08:41:101
808278993224,5cyclictest0-21swapper/112:16:111
80827799328,14cyclictest151ktimers/009:10:580
808277993226,4cyclictest1002-21mta-sts-daemon08:11:020
808277993224,5cyclictest14482-21cups-browsed12:10:560
808277993224,5cyclictest14482-21cups-browsed12:10:560
808277993223,6cyclictest0-21swapper/010:25:020
808277993223,4cyclictest12650irq/32-eth010:41:030
808277993216,12cyclictest421-21dbus-daemon10:50:390
808277993210,16cyclictest151ktimers/008:16:000
808279993126,2cyclictest0-21swapper/208:00:012
808279993114,14cyclictest351ktimers/207:51:032
808278993124,4cyclictest876528-21timerwakeupswit10:01:101
808278993124,4cyclictest820774-21cpuspeed07:50:491
808278993124,4cyclictest1003-21mta-sts-daemon12:29:561
808278993124,3cyclictest0-21swapper/111:30:561
808278993124,3cyclictest0-21swapper/111:30:561
808278993117,10cyclictest421-21dbus-daemon08:55:571
808277993125,4cyclictest487-21rs:main0
808277993125,3cyclictest0-21swapper/012:20:580
808277993123,5cyclictest485-21in:imuxsock09:45:010
808277993122,6cyclictest850922-21/usr/sbin/munin09:21:070
80827799312,24cyclictest876034-21sh10:00:570
808279993023,4cyclictest839819-21systemd-run08:55:012
808279993023,4cyclictest818770-21unixbench_singl07:41:152
808279993023,4cyclictest809757-21idleruntime-cro07:15:012
808279993023,3cyclictest0-21swapper/211:45:012
808279993021,6cyclictest815682-21unixbench_multi07:31:082
808279993021,6cyclictest439-21systemd-logind07:10:012
808279993021,6cyclictest0-21swapper/209:45:572
80827899303,23cyclictest894344-21ssh10:30:591
80827899303,23cyclictest894344-21ssh10:30:591
808278993025,3cyclictest0-21swapper/111:00:021
808278993023,4cyclictest0-21swapper/110:41:121
808278993020,7cyclictest832003-21switchtime08:26:081
808278993020,7cyclictest832003-21switchtime08:26:081
808277993025,2cyclictest0-21swapper/009:05:020
808277993024,3cyclictest948059-21latency_hist12:00:030
808277993024,3cyclictest0-21swapper/011:10:540
808277993024,3cyclictest0-21swapper/010:15:530
808277993024,3cyclictest0-21swapper/007:50:490
808277993023,3cyclictest826536-21kworker/u8:0-xprtiod10:50:010
808277993021,6cyclictest421-21dbus-daemon09:25:400
808279992923,2cyclictest0-21swapper/211:35:582
808279992919,7cyclictest824811-21cron08:05:012
808278992922,5cyclictest0-21swapper/111:40:011
80827899292,24cyclictest955154-21sh12:11:031
80827899292,24cyclictest955154-21sh12:11:031
808278992922,4cyclictest1001-21mta-sts-daemon08:51:031
808278992921,5cyclictest960737-21cpu12:20:481
808278992921,5cyclictest808289-21systemd-run07:10:021
808278992921,5cyclictest14482-21cups-browsed11:49:491
808278992920,6cyclictest830723-21grep08:21:091
808277992924,2cyclictest0-21swapper/008:40:000
808277992923,4cyclictest838324-21systemd-run08:50:010
808279992822,3cyclictest0-21swapper/210:41:022
808279992822,3cyclictest0-21swapper/208:20:012
808279992821,4cyclictest835348-21kworker/u8:7-xprtiod09:20:492
808279992819,7cyclictest831590-21missed_timers08:25:552
808279992819,7cyclictest831590-21missed_timers08:25:552
808279992819,5cyclictest826852-21fschecks_time08:10:542
808279992817,8cyclictest842286-21ntpq09:01:012
80827999281,22cyclictest14482-21cups-browsed08:46:022
808278992820,4cyclictest0-21swapper/111:52:021
808278992818,8cyclictest833591-21timerwakeupswit08:31:091
80827799285,20cyclictest949213-21sh12:01:040
808277992822,3cyclictest0-21swapper/007:30:000
808277992822,2cyclictest0-21swapper/007:11:030
808277992810,12cyclictest884058-21kworker/u8:10+xprtiod11:26:040
808277992810,12cyclictest884058-21kworker/u8:10+xprtiod11:26:040
808279992720,4cyclictest843692-21ntpq09:05:562
80827899273,20cyclictest14482-21cups-browsed08:06:041
808278992723,2cyclictest0-21swapper/112:35:571
808278992719,5cyclictest439-21systemd-logind08:15:011
808277992721,4cyclictest830717-21tail08:21:090
808277992721,3cyclictest811431-21latency_hist07:20:030
808277992720,3cyclictest0-21swapper/009:58:230
808277992710,13cyclictest857038-21/usr/sbin/munin09:31:130
808279992617,7cyclictest930163-21aten_r2power_en11:30:472
808279992617,7cyclictest930163-21aten_r2power_en11:30:472
808278992620,3cyclictest0-21swapper/107:31:081
808278992619,4cyclictest828270-21cpuspeed08:15:501
808278992618,5cyclictest817238-21sed07:36:081
808277992620,3cyclictest1000-21mta-sts-daemon07:45:590
808279992519,3cyclictest824949-21kworker/u8:13-nfsiod08:40:572
808279992519,3cyclictest0-21swapper/208:40:002
808279992519,3cyclictest0-21swapper/207:50:012
808279992513,9cyclictest420-21avahi-daemon08:25:012
808278992511,9cyclictest421-21dbus-daemon07:45:011
80827799258,14cyclictest812772-21cron07:25:010
80827799253,16cyclictest151ktimers/009:06:010
808277992518,5cyclictest826497-21latency_hist08:10:020
808277992515,4cyclictest816341-21fschecks_time07:35:500
808279992419,2cyclictest0-21swapper/207:40:012
808278992417,3cyclictest0-21swapper/107:11:031
808277992418,4cyclictest832219-21unixbench_multi08:26:090
808277992418,4cyclictest832219-21unixbench_multi08:26:090
808277992418,3cyclictest0-21swapper/008:50:560
80827799222,15cyclictest815235-21ntpq07:30:590
808277992216,4cyclictest1003-21mta-sts-daemon08:40:580
808277991912,3cyclictest0-21swapper/007:10:010
80828099162,8cyclictest0-21swapper/309:10:593
80828099162,7cyclictest0-21swapper/308:55:573
80828099152,7cyclictest0-21swapper/312:35:593
80828099152,7cyclictest0-21swapper/311:25:573
80828099152,7cyclictest0-21swapper/311:25:573
80828099151,8cyclictest0-21swapper/309:46:003
80828099151,7cyclictest0-21swapper/311:36:013
80828099143,6cyclictest0-21swapper/311:45:583
80828099142,6cyclictest0-21swapper/312:26:003
80828099142,6cyclictest0-21swapper/312:00:573
80828099141,7cyclictest0-21swapper/311:41:003
80828099141,7cyclictest0-21swapper/309:30:573
80828099141,6cyclictest0-21swapper/310:51:013
80828099141,6cyclictest0-21swapper/310:25:593
80828099141,6cyclictest0-21swapper/310:25:593
80828099141,6cyclictest0-21swapper/308:26:003
80828099141,6cyclictest0-21swapper/308:26:003
80828099141,6cyclictest0-21swapper/307:25:033
80828099141,5cyclictest0-21swapper/309:00:553
80828099141,5cyclictest0-21swapper/307:15:563
80828099132,8cyclictest0-21swapper/312:16:063
80828099132,6cyclictest0-21swapper/312:20:523
80828099132,6cyclictest0-21swapper/310:20:483
80828099131,7cyclictest0-21swapper/311:30:593
80828099131,7cyclictest0-21swapper/311:30:593
80828099131,7cyclictest0-21swapper/311:05:593
80828099131,6cyclictest0-21swapper/312:30:563
80828099131,6cyclictest0-21swapper/312:30:563
80828099131,6cyclictest0-21swapper/310:45:593
80828099131,6cyclictest0-21swapper/310:06:013
80828099131,6cyclictest0-21swapper/309:25:573
80828099131,6cyclictest0-21swapper/307:45:573
80828099123,5cyclictest0-21swapper/309:20:463
80828099122,6cyclictest0-21swapper/310:30:523
80828099122,6cyclictest0-21swapper/310:30:523
80828099122,5cyclictest0-21swapper/310:40:573
80828099122,5cyclictest0-21swapper/307:41:043
80828099121,6cyclictest0-21swapper/311:50:583
80828099121,6cyclictest0-21swapper/310:15:563
80828099121,6cyclictest0-21swapper/309:41:023
80828099121,6cyclictest0-21swapper/308:50:583
80828099121,6cyclictest0-21swapper/308:10:543
80828099121,5cyclictest0-21swapper/308:30:583
80828099113,5cyclictest0-21swapper/310:35:553
80828099112,5cyclictest0-21swapper/311:15:583
80828099112,4cyclictest0-21swapper/308:40:563
80828099111,6cyclictest0-21swapper/312:11:013
80828099111,6cyclictest0-21swapper/312:11:013
80828099111,6cyclictest0-21swapper/312:05:533
80828099111,6cyclictest0-21swapper/311:55:503
80828099111,6cyclictest0-21swapper/310:55:563
80828099111,6cyclictest0-21swapper/310:00:483
80828099111,6cyclictest0-21swapper/309:56:023
80828099111,6cyclictest0-21swapper/308:06:093
80828099111,6cyclictest0-21swapper/307:55:553
80828099111,5cyclictest0-21swapper/308:20:563
80828099111,5cyclictest0-21swapper/308:00:583
80828099111,5cyclictest0-21swapper/307:30:483
80828099111,3cyclictest0-21swapper/307:50:593
80828099103,5cyclictest0-21swapper/310:11:003
80828099102,4cyclictest0-21swapper/309:35:533
80828099102,4cyclictest0-21swapper/309:05:513
80828099101,6cyclictest0-21swapper/311:20:473
80828099101,6cyclictest0-21swapper/311:00:593
80828099101,6cyclictest0-21swapper/309:15:523
80828099101,6cyclictest0-21swapper/309:15:523
80828099100,6cyclictest0-21swapper/311:11:013
8082809991,5cyclictest0-21swapper/308:45:523
8082809991,5cyclictest0-21swapper/308:35:523
8082809991,2cyclictest0-21swapper/307:10:033
8082809990,5cyclictest0-21swapper/309:50:473
8082809983,3cyclictest0-21swapper/308:15:573
8082809981,5cyclictest0-21swapper/307:30:003
8082809981,4cyclictest0-21swapper/307:35:553
8082809971,3cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional