You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 02:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon May 11, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90104322000,3sleep375-21kworker/3:1+events20:06:033
90104322000,3sleep375-21kworker/3:1+events20:06:033
94736821970,2sleep3481ktimers/320:51:053
842651996253,7cyclictest1142845-21/usr/sbin/munin00:11:111
842646995546,6cyclictest1033171-21latency_hist22:20:010
842646995446,6cyclictest919197-21apt-get20:25:520
842646995142,6cyclictest280-21systemd-journal22:37:070
842651995041,7cyclictest917990-21ntpq20:21:061
842646995041,6cyclictest1068015-21latency_hist22:55:010
842646995038,9cyclictest859954-21diskstats19:25:560
842651994931,15cyclictest962745-21ntpq21:06:091
842646994941,6cyclictest884088-21latency_hist19:50:010
842651994837,9cyclictest280-21systemd-journal22:00:011
842651994737,8cyclictest903187-21ntpq20:06:061
842651994737,8cyclictest903187-21ntpq20:06:061
842646994737,7cyclictest280-21systemd-journal23:10:000
842651994636,8cyclictest987581-21ntpq21:31:071
842646994641,3cyclictest878878-21kworker/u8:2+flush-8:020:51:120
842646994639,5cyclictest1107972-21apt-get23:35:530
842655994541,3cyclictest1032860-21kworker/u8:1+flush-8:022:26:152
842651994537,5cyclictest874201-21latency_hist19:40:011
842651994438,4cyclictest1028539-21apt-get22:15:521
842651994437,5cyclictest1157934-21apt-get00:25:521
842646994440,3cyclictest924319-21kworker/u8:3+events_unbound21:20:010
842646994437,5cyclictest924319-21kworker/u8:3+flush-8:021:05:580
842651994334,7cyclictest280-21systemd-journal22:50:011
842655994236,4cyclictest1117226-21kworker/u8:2+flush-8:023:56:132
842651994132,6cyclictest978529-21latency_hist21:25:011
842651994128,11cyclictest1122906-21grep23:50:571
842651994123,15cyclictest280-21systemd-journal23:15:001
842646994136,4cyclictest1082208-21kworker/u8:1+events_unbound23:20:580
842646994136,3cyclictest878878-21kworker/u8:2+flush-8:020:11:030
842646994134,5cyclictest280-21systemd-journal21:22:300
842646994131,7cyclictest280-21systemd-journal00:15:000
8900592400,2sleep239-21ksoftirqd/219:55:582
842651994023,15cyclictest280-21systemd-journal21:51:081
842651994011,21cyclictest0-21swapper/121:17:491
842646994034,4cyclictest963823-21kworker/u8:2+events_unbound21:55:570
842646994029,7cyclictest8118-21kworker/u8:1+events_unbound20:46:080
842655993933,4cyclictest1013414-21kworker/u8:0+flush-8:022:16:122
842646993934,4cyclictest1052878-21kworker/u8:3+flush-8:023:11:130
842646993931,5cyclictest1122509-21latency_hist23:50:000
842651993823,13cyclictest280-21systemd-journal00:01:081
842646993833,4cyclictest1013414-21kworker/u8:0+events_unbound22:06:120
842646993832,4cyclictest280-21systemd-journal22:42:450
842646993832,3cyclictest1132424-21kworker/u8:0+events_unbound00:31:140
842646993829,7cyclictest1072052-21ntpq22:56:070
842646993827,7cyclictest924319-21kworker/u8:3+flush-8:021:26:080
842651993732,4cyclictest963823-21kworker/u8:2+flush-8:022:56:131
842651993728,7cyclictest280-21systemd-journal00:20:011
842651993723,12cyclictest0-21swapper/119:50:001
842651993717,17cyclictest933971-21latency_hist20:40:011
842646993728,7cyclictest1043862-21diskstats22:30:570
842651993628,6cyclictest280-21systemd-journal19:55:001
842651993618,15cyclictest913055-21ntpq20:16:051
842651993614,19cyclictest280-21systemd-journal19:13:081
842651993613,11cyclictest0-21swapper/100:07:311
842646993631,3cyclictest8118-21kworker/u8:1+flush-8:019:36:130
842646993629,5cyclictest924319-21kworker/u8:3+flush-8:020:35:580
842655993530,4cyclictest8118-21kworker/u8:1+flush-8:020:16:022
842655993529,4cyclictest1167079-21kworker/u8:1+events_unbound00:31:162
842651993525,8cyclictest868405-21ntpq19:31:081
842651993519,15cyclictest998205-21unixbench_multi21:41:131
842651993517,16cyclictest0-21swapper/123:06:011
842646993530,4cyclictest8118-21kworker/u8:1+flush-8:020:01:130
842646993530,3cyclictest924319-21kworker/u8:3+flush-8:021:11:130
842646993528,4cyclictest993360-21apt-get21:40:000
842646993524,8cyclictest280-21systemd-journal21:34:590
842655993429,4cyclictest963823-21kworker/u8:2+events_unbound22:41:122
842655993428,4cyclictest1082208-21kworker/u8:1+events_unbound23:41:142
84265199347,2cyclictest0-21swapper/122:44:211
84265199343,6cyclictest0-21swapper/123:35:541
842651993426,6cyclictest1038689-21apt-get22:25:551
842651993425,6cyclictest280-21systemd-journal21:13:071
842651993422,9cyclictest0-21swapper/122:10:011
842651993420,13cyclictest1064733-21kthreadcore22:51:011
842651993418,14cyclictest880-21mta-sts-daemon22:35:001
842651993417,15cyclictest0-21swapper/121:40:001
842646993425,7cyclictest963823-21kworker/u8:2+flush-8:022:21:080
842646993425,7cyclictest1151759-21ntpq00:16:060
842646993424,7cyclictest280-21systemd-journal20:06:070
842646993424,7cyclictest280-21systemd-journal20:06:060
8536012330,4sleep00-21swapper/019:16:080
842655993327,4cyclictest1097943-21kworker/u8:0+flush-8:023:30:582
842655993327,4cyclictest1097943-21kworker/u8:0+flush-8:023:30:582
842651993325,5cyclictest280-21systemd-journal23:25:071
842651993318,14cyclictest0-21swapper/121:26:031
842651993318,13cyclictest0-21swapper/120:31:041
842651993318,13cyclictest0-21swapper/120:25:581
842651993316,15cyclictest0-21swapper/120:56:101
842651993314,16cyclictest0-21swapper/122:21:121
842651993312,19cyclictest998884-21/usr/sbin/munin21:46:051
842651993312,19cyclictest998884-21/usr/sbin/munin21:46:041
842646993326,5cyclictest963830-21kworker/u8:4+flush-8:021:51:110
842646993326,5cyclictest924319-21kworker/u8:3+events_unbound20:40:560
842655993228,3cyclictest8118-21kworker/u8:1+flush-8:019:31:152
842655993228,3cyclictest1052878-21kworker/u8:3+flush-8:000:11:092
842651993219,11cyclictest0-21swapper/122:01:001
842651993216,14cyclictest0-21swapper/123:16:121
842651993216,14cyclictest0-21swapper/120:46:061
842651993215,15cyclictest0-21swapper/123:46:111
842651993215,15cyclictest0-21swapper/123:31:031
842651993215,15cyclictest0-21swapper/123:31:021
842651993215,15cyclictest0-21swapper/122:11:001
842651993214,16cyclictest0-21swapper/123:41:121
842651993214,16cyclictest0-21swapper/119:40:591
842646993225,5cyclictest889567-21apt-get19:55:520
8422952323,8sleep10-21swapper/119:07:511
842655993127,3cyclictest963830-21kworker/u8:4+flush-8:021:52:392
842655993126,4cyclictest924319-21kworker/u8:3+events_unbound20:41:072
842655993125,4cyclictest8118-21kworker/u8:1+flush-8:019:21:112
842651993124,6cyclictest963823-21kworker/u8:2+events_unbound23:21:091
842651993124,5cyclictest944139-21apt-get20:50:541
842651993116,13cyclictest0-21swapper/100:21:011
842651993116,13cyclictest0-21swapper/100:00:011
842651993115,14cyclictest0-21swapper/120:40:561
842651993112,2cyclictest0-21swapper/121:01:061
842651993112,2cyclictest0-21swapper/119:28:071
842651993111,2cyclictest0-21swapper/123:00:551
842646993126,4cyclictest8118-21kworker/u8:1+flush-8:019:41:120
842646993126,4cyclictest8118-21kworker/u8:1+events_unbound19:30:570
842646993126,4cyclictest1167079-21kworker/u8:1+events_unbound00:35:550
842646993126,4cyclictest1082208-21kworker/u8:1+flush-8:000:01:020
842646993126,3cyclictest924319-21kworker/u8:3+flush-8:020:31:120
842646993125,4cyclictest924319-21kworker/u8:3+events_unbound20:56:090
842646993124,5cyclictest8118-21kworker/u8:1+flush-8:019:21:120
842646993124,5cyclictest1052878-21kworker/u8:3+events_unbound23:16:130
842646993123,6cyclictest878878-21kworker/u8:2+events_unbound20:20:580
842646993123,6cyclictest8118-21kworker/u8:1+events_unbound19:51:070
842646993119,9cyclictest1082208-21kworker/u8:1+events_unbound23:30:520
842646993119,9cyclictest1082208-21kworker/u8:1+events_unbound23:30:520
842651993015,13cyclictest0-21swapper/100:31:141
842646993026,2cyclictest1113458-21irqcore23:41:020
842646993025,3cyclictest1162573-21systemd-run00:30:010
842655992925,3cyclictest998238-21unixbench_singl21:41:132
842655992925,3cyclictest924319-21kworker/u8:3+flush-8:020:36:122
842655992924,4cyclictest8118-21kworker/u8:1+flush-8:020:01:082
842655992924,3cyclictest1167079-21kworker/u8:1+events_unbound00:36:002
84265199293,5cyclictest0-21swapper/119:15:541
84265199292,12cyclictest1048549-21apt-get22:35:561
842651992912,2cyclictest0-21swapper/100:36:131
842651992912,15cyclictest0-21swapper/120:10:561
842651992911,4cyclictest0-21swapper/119:20:571
842651992910,2cyclictest0-21swapper/120:00:591
842646992924,3cyclictest963830-21kworker/u8:4+events_unbound22:00:560
842646992923,4cyclictest1132424-21kworker/u8:0+events_unbound00:21:080
842655992823,4cyclictest878878-21kworker/u8:2+flush-8:020:06:092
842655992823,4cyclictest878878-21kworker/u8:2+flush-8:020:06:092
842655992822,4cyclictest878878-21kworker/u8:2+events_unbound20:50:082
842651992810,2cyclictest0-21swapper/119:55:551
842646992822,4cyclictest963823-21kworker/u8:2+events_unbound22:45:550
842646992822,4cyclictest842499-21kworker/u8:3+events_unbound19:11:080
842646992822,4cyclictest1097943-21kworker/u8:0+events_unbound23:26:090
842655992723,3cyclictest1117226-21kworker/u8:2+events_unbound23:46:102
842655992722,4cyclictest1082208-21kworker/u8:1+flush-8:023:51:142
842655992722,3cyclictest849796-21aten2_r5power_c19:15:552
842655992720,5cyclictest8118-21kworker/u8:1+events_unbound20:20:052
842655992718,6cyclictest884471-21cat19:50:012
842646992722,3cyclictest993840-21kworker/u8:1+flush-8:021:41:080
842646992722,3cyclictest0-21swapper/000:00:010
842646992721,4cyclictest948971-21kworker/u8:0+events_unbound21:01:120
83839422720,3sleep0838465-21irqcore19:06:000
842655992617,7cyclictest280-21systemd-journal22:11:072
842655992617,7cyclictest280-21systemd-journal21:39:592
842655992519,4cyclictest928618-21unixbench_multi20:31:152
842655992519,4cyclictest1142183-21unixbench_multi00:06:152
84265599250,8cyclictest8620861kthreadcore19:26:012
842646992519,4cyclictest993840-21kworker/u8:1+events_unbound21:50:000
842646992519,4cyclictest993840-21kworker/u8:1+events_unbound21:49:590
842646992518,5cyclictest963823-21kworker/u8:2+flush-8:023:01:050
842655992421,2cyclictest1132836-21aten2_r5power_v00:00:552
842655992421,2cyclictest1098345-21fschecks_time23:25:582
842655992420,2cyclictest869636-21aten2_r5power_e19:35:562
842655992420,2cyclictest1148367-21fschecks_time00:15:582
842655992420,2cyclictest0-21swapper/223:20:002
84265599241,11cyclictest974233-21perl21:21:002
842646992420,3cyclictest1024194-21sort22:11:010
842646992417,5cyclictest1137849-21kworker/u8:2+events_unbound00:06:120
842655992320,2cyclictest1048663-21aten2_r5power_v22:35:562
84265599231,9cyclictest9844902cut21:31:002
842655992318,3cyclictest0-21swapper/221:30:002
842655992317,4cyclictest1022942-21unixbench_singl22:06:142
842655992315,6cyclictest877087-21tr19:41:042
842646992319,3cyclictest1013414-21kworker/u8:0+flush-8:022:26:080
84265599227,2cyclictest10092202cat21:56:002
842655992218,3cyclictest948971-21kworker/u8:0+events_unbound20:56:142
842655992218,2cyclictest1158284-21fschecks_time00:25:562
842655992218,2cyclictest1068364-21aten2_r5power_c22:55:562
842646992219,2cyclictest0-21swapper/023:51:120
84265599218,9cyclictest904394-21apt-get20:10:532
842655992117,3cyclictest878878-21kworker/u8:2+events_unbound19:51:152
842655992114,3cyclictest1081115-21kthreadcore23:06:032
842655992017,2cyclictest1014003-21fschecks_count22:00:582
842655992016,2cyclictest0-21swapper/222:31:082
842655992015,3cyclictest0-21swapper/219:11:132
842655992013,5cyclictest923844-21apt-get20:30:012
842646992016,3cyclictest8118-21kworker/u8:1+flush-8:020:16:390
8421632204,9sleep20-21swapper/219:06:152
842655991916,2cyclictest1033997-21fschecks_count22:20:582
842655991915,3cyclictest963823-21kworker/u8:2+events_unbound22:54:592
842655991915,2cyclictest0-21swapper/222:45:542
842655991914,4cyclictest1013414-21kworker/u8:0+flush-8:023:00:362
842655991914,3cyclictest0-21swapper/200:21:152
842655991913,4cyclictest280-21systemd-journal23:22:072
8383132193,9sleep30-21swapper/319:06:003
842655991814,3cyclictest0-21swapper/221:10:582
842655991814,2cyclictest999023-21aten2_r5power_v21:45:562
842655991814,2cyclictest999023-21aten2_r5power_v21:45:562
10786522180,2sleep3471rcuc/323:06:003
84265599171,11cyclictest972723-21ntpq21:16:062
84265599170,5cyclictest9428522sed20:46:042
842655991612,3cyclictest0-21swapper/223:36:012
842655991612,2cyclictest0-21swapper/223:11:052
842655991612,2cyclictest0-21swapper/221:06:142
84265599161,11cyclictest954027-21apt-get21:00:532
11315252154,7sleep30-21swapper/323:56:093
11618152145,5sleep30-21swapper/300:26:113
11550722140,2sleep375-21kworker/3:1+events00:21:043
8693412132,6sleep30-21swapper/319:35:023
11431132132,7sleep30-21swapper/300:10:573
11324622132,6sleep30-21swapper/300:00:023
9936592122,5sleep30-21swapper/321:40:023
9896252122,6sleep30-21swapper/321:36:043
9858772122,6sleep30-21swapper/321:31:033
9793892122,6sleep30-21swapper/321:26:013
9685952122,5sleep30-21swapper/321:15:023
9641672122,6sleep30-21swapper/321:11:003
9490552122,6sleep30-21swapper/320:55:563
9429652122,6sleep30-21swapper/320:46:083
9334282122,6sleep30-21swapper/320:36:133
9282312122,6sleep30-21swapper/320:31:113
9188972122,5sleep30-21swapper/320:25:023
9166632122,6sleep30-21swapper/320:21:043
8943872122,6sleep30-21swapper/320:00:023
8933982122,6sleep30-21swapper/319:56:093
8791382122,5sleep30-21swapper/319:45:003
8749042122,6sleep30-21swapper/319:41:003
8663542122,6sleep30-21swapper/319:31:043
8643092120,8sleep30-21swapper/319:30:003
8497802122,6sleep30-21swapper/319:15:563
8428302122,6sleep30-21swapper/319:10:543
11674992122,5sleep30-21swapper/300:35:013
11628712122,6sleep30-21swapper/300:30:563
11524252122,6sleep30-21swapper/300:17:083
11379192122,6sleep30-21swapper/300:05:563
11218882122,6sleep30-21swapper/323:46:143
11175102122,5sleep30-21swapper/323:45:013
11088692122,6sleep30-21swapper/323:36:033
10980342122,6sleep30-21swapper/323:25:543
10927802122,5sleep30-21swapper/323:20:013
10778672122,6sleep30-21swapper/323:05:013
10680402122,5sleep30-21swapper/322:55:013
10638912122,6sleep30-21swapper/322:51:003
10583932122,5sleep30-21swapper/322:45:023
10433112122,5sleep30-21swapper/322:30:023
10424042122,6sleep30-21swapper/322:26:083
10374662122,6sleep30-21swapper/322:21:063
10248712123,5sleep30-21swapper/322:11:033
10137162122,6sleep30-21swapper/322:00:563
10007892122,5sleep30-21swapper/321:46:043
10007892122,5sleep30-21swapper/321:46:043
9779962112,5sleep30-21swapper/321:21:153
9588932112,5sleep30-21swapper/321:05:013
9577382112,5sleep30-21swapper/321:01:053
9342102112,5sleep30-21swapper/320:40:023
9093312112,5sleep30-21swapper/320:15:543
9040912112,5sleep30-21swapper/320:10:013
8850122112,5sleep30-21swapper/319:50:593
8554792112,5sleep30-21swapper/319:21:013
11266592112,5sleep30-21swapper/323:51:113
11047702112,5sleep30-21swapper/323:31:013
11047702112,5sleep30-21swapper/323:31:013
10880372112,6sleep30-21swapper/323:15:323
10830392112,5sleep30-21swapper/323:10:013
10535782112,6sleep30-21swapper/322:40:573
10528092112,5sleep30-21swapper/322:36:163
10290612112,5sleep30-21swapper/322:16:013
10222242112,5sleep30-21swapper/322:06:053
10087282112,6sleep30-21swapper/321:55:353
10034912112,5sleep30-21swapper/321:50:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional