You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 07:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun May 10, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136237521950,2sleep3481ktimers/300:35:563
136237521950,2sleep3481ktimers/300:35:563
11937032730,3sleep375-21kworker/3:1-events21:46:013
1037201996556,7cyclictest1237745-21cp22:30:001
1037205995953,4cyclictest1182503-21kworker/u8:3+events_unbound21:36:152
1037205995853,4cyclictest1182503-21kworker/u8:3+events_unbound22:16:172
10742782560,3sleep1281rcuc/119:45:561
1037201995547,6cyclictest1212702-21latency_hist22:05:011
1037205995344,5cyclictest1044235-21kworker/u8:3+flush-8:019:21:132
1037201995344,6cyclictest1257691-21latency_hist22:50:011
1037199995344,7cyclictest1182745-21latency_hist21:35:010
1037199995342,9cyclictest1113832-21diskstats20:25:570
1037199995248,3cyclictest1240937-21kworker/u8:3+flush-8:022:36:110
1037199995144,5cyclictest1153297-21kworker/u8:1+flush-8:021:11:000
1037205995041,7cyclictest280-21systemd-journal22:40:002
1037199995044,4cyclictest1128577-21kworker/u8:3+flush-8:021:16:080
1037205994943,4cyclictest984377-21kworker/u8:1+events_unbound19:15:022
1037199994939,7cyclictest1226860-21ntpq22:16:080
1037199994844,3cyclictest1312244-21kworker/u8:0+flush-8:000:06:120
1037199994842,5cyclictest1167908-21kworker/u8:2+flush-8:021:56:060
1037201994740,5cyclictest1187744-21gpgv21:39:591
1037201994739,6cyclictest1049323-21/usr/sbin/munin19:21:111
1037201994739,5cyclictest1356854-21apt-get00:30:011
1037201994739,5cyclictest1356854-21apt-get00:30:011
1037201994639,5cyclictest1128097-21apt-get20:40:001
1037199994534,8cyclictest1337367-21/usr/sbin/munin00:11:050
11607432440,1sleep11160748-21cut21:11:041
1037199994436,6cyclictest1054255-21kworker/u8:1+flush-8:020:11:110
1037199994434,8cyclictest1231843-21ntpq22:21:070
1037199994432,8cyclictest280-21systemd-journal00:29:590
1037205994334,7cyclictest280-21systemd-journal21:19:062
1037201994337,4cyclictest1312244-21kworker/u8:0+flush-8:000:05:001
1037201994337,4cyclictest1143459-21apt-get20:55:541
1037201994336,5cyclictest1122858-21kworker/u8:0+flush-8:020:46:121
1037201994335,6cyclictest1103378-21latency_hist20:15:011
1037199994339,3cyclictest1044235-21kworker/u8:3+events_unbound20:06:110
1037199994336,5cyclictest1153297-21kworker/u8:1+flush-8:023:31:130
1037199994335,4cyclictest1122858-21kworker/u8:0+events_unbound20:45:010
1037199994329,11cyclictest1321873-21kworker/u8:2+events_unbound23:56:070
11212562420,3sleep20-21swapper/220:31:042
1037201994235,5cyclictest1307470-21apt-get23:40:531
1037201994234,6cyclictest1202807-21latency_hist21:55:001
1037199994235,5cyclictest280-21systemd-journal19:11:060
1037199994233,7cyclictest1118767-21diskstats20:30:570
1037205994137,3cyclictest1016940-21kworker/u8:2+events_unbound19:15:012
1037201994133,6cyclictest280-21systemd-journal22:45:001
1037201994133,6cyclictest280-21systemd-journal22:44:591
1037199994121,16cyclictest280-21systemd-journal19:31:070
103719999411,38cyclictest1-21systemd20:18:060
134607724029,6sleep30-21swapper/300:16:063
1037201994028,9cyclictest280-21systemd-journal23:22:061
1037199994033,5cyclictest1064174-21/usr/sbin/munin19:36:050
1037199994031,6cyclictest1282385-21latency_hist23:15:010
1037199994030,8cyclictest1263189-21diskstats22:55:560
1037205993933,4cyclictest1054255-21kworker/u8:1+flush-8:020:16:162
1037201993932,5cyclictest280-21systemd-journal20:08:071
1037201993931,6cyclictest1347307-21apt-get00:20:541
1037199993934,4cyclictest1128577-21kworker/u8:3+flush-8:021:05:590
1037199993934,3cyclictest1173086-21kworker/u8:0+flush-8:021:26:120
1037201993834,3cyclictest1167908-21kworker/u8:2+events_unbound22:36:041
1037201993831,5cyclictest280-21systemd-journal22:58:061
1037199993832,4cyclictest1362345-21apt-get00:35:540
1037199993832,4cyclictest1362345-21apt-get00:35:530
1037199993832,4cyclictest1073059-21kworker/u8:0+flush-8:019:46:120
1037199993832,4cyclictest1044235-21kworker/u8:3+events_unbound19:26:100
1037201993731,4cyclictest1153297-21kworker/u8:1+flush-8:021:30:571
1037199993730,5cyclictest1167908-21kworker/u8:2+flush-8:021:40:580
1037199993728,7cyclictest1072879-21ntpq19:41:070
1037205993628,6cyclictest1317286-21awk23:50:002
1037201993629,5cyclictest280-21systemd-journal23:33:521
1037201993628,5cyclictest1282701-21apt-get23:15:531
1037199993628,5cyclictest1153297-21kworker/u8:1+flush-8:021:21:130
1037205993531,3cyclictest1167908-21kworker/u8:2+flush-8:023:26:042
1037205993530,4cyclictest1044235-21kworker/u8:3+events_unbound19:30:012
1037201993526,7cyclictest1113582-21apt-get20:25:531
1037199993525,8cyclictest1261731-21ntpq22:51:080
10323962353,9sleep10-21swapper/119:05:091
1037205993430,3cyclictest1054255-21kworker/u8:1+flush-8:019:31:042
1037205993428,5cyclictest1153297-21kworker/u8:1+events_unbound21:25:012
1037201993428,4cyclictest1143010-21journal-offline20:53:281
1037199993427,4cyclictest1302400-21kworker/u8:3+events_unbound23:40:580
1037199993426,6cyclictest1198464-21diskstats21:50:590
1037205993329,3cyclictest1153297-21kworker/u8:1+flush-8:022:30:582
1037201993326,5cyclictest280-21systemd-journal21:20:001
1037201993324,7cyclictest280-21systemd-journal19:37:061
1037199993328,4cyclictest1122858-21kworker/u8:0+flush-8:020:51:370
1037199993327,4cyclictest1327224-21kworker/u8:3+flush-8:000:01:130
1037199993327,4cyclictest1153297-21kworker/u8:1+events_unbound23:01:160
1037199993326,5cyclictest1122858-21kworker/u8:0+events_unbound21:01:070
1037201993225,5cyclictest1267600-21kworker/u8:0+flush-8:023:26:141
1037201993224,6cyclictest1044235-21kworker/u8:3+flush-8:019:26:131
1037201993223,7cyclictest1173141-21/usr/sbin/munin21:26:061
1037199993227,3cyclictest280-21systemd-journal21:00:010
1037199993226,4cyclictest1153297-21kworker/u8:1+events_unbound23:21:000
103697423224,3sleep00-21swapper/019:09:210
1037205993126,4cyclictest1267156-21unixbench_multi22:56:112
1037201993124,5cyclictest1228096-21apt-get22:20:551
1037201993122,7cyclictest280-21systemd-journal20:41:061
1037199993127,2cyclictest1187927-21latency_hist21:40:010
1037199993126,4cyclictest1044235-21kworker/u8:3+flush-8:019:56:030
1037199993125,3cyclictest1293348-21irqrtprio23:26:030
1037199993124,5cyclictest1212699-21apt-get22:05:030
1037205993026,3cyclictest1153297-21kworker/u8:1+flush-8:021:06:182
1037205993023,5cyclictest1327192-40logrotate00:00:002
1037201993024,4cyclictest1332480-21apt-get00:05:541
1037199993024,4cyclictest1321873-21kworker/u8:2+flush-8:000:16:080
1037199993023,5cyclictest1302493-21apt-get23:35:540
1037199993023,5cyclictest1240937-21kworker/u8:3+flush-8:022:46:010
1037201992925,2cyclictest1069354-21cpuspeed_turbos19:40:571
1037201992923,4cyclictest1073059-21kworker/u8:0+flush-8:019:50:591
1037201992920,7cyclictest280-21systemd-journal21:56:071
1037199992922,4cyclictest1227459-21kworker/u8:0+flush-8:022:26:120
1037199992922,3cyclictest0-21swapper/020:05:000
1037205992823,4cyclictest1153297-21kworker/u8:1+events_unbound23:20:032
10672442270,4sleep30-21swapper/319:36:043
1037205992723,2cyclictest1273052-21cpuspeed_turbos23:05:572
1037205992723,2cyclictest1079616-21irqcore19:51:012
1037201992724,2cyclictest1327181-21munin-run23:59:591
1037201992723,3cyclictest1154072-21irqrtprio21:06:011
1037201992722,3cyclictest1272891-21aten2_r5power_e23:05:561
1037201992721,4cyclictest1153297-21kworker/u8:1+flush-8:023:45:371
1037201992718,7cyclictest280-21systemd-journal00:29:061
103720199271,24cyclictest1148678-21fschecks_count21:01:001
1037199992723,3cyclictest1302400-21kworker/u8:3+events_unbound23:46:110
1037199992723,3cyclictest1153297-21kworker/u8:1+flush-8:023:16:370
1037199992723,3cyclictest1153297-21kworker/u8:1+flush-8:021:49:370
1037199992720,5cyclictest1054255-21kworker/u8:1+flush-8:019:51:090
1037199992719,5cyclictest1044235-21kworker/u8:3+events_unbound19:25:010
1037205992622,2cyclictest1366956-21idleruntime-cro00:40:002
1037205992622,2cyclictest1366956-21idleruntime-cro00:40:002
1037205992622,2cyclictest1352509-21fschecks_count00:25:592
1037201992621,3cyclictest1306543-21wc23:36:141
1037201992615,3cyclictest421rcuog/220:21:101
1037199992622,3cyclictest1167908-21kworker/u8:2+flush-8:022:01:120
1037199992622,3cyclictest1153297-21kworker/u8:1+flush-8:022:44:370
1037199992622,3cyclictest1153297-21kworker/u8:1+flush-8:022:44:370
1037199992619,5cyclictest1016940-21kworker/u8:2+flush-8:019:15:060
1037199992615,8cyclictest280-21systemd-journal22:15:000
1037205992522,2cyclictest1258068-21aten2_r5power_e22:50:572
1037205992521,3cyclictest1153297-21kworker/u8:1+events_unbound23:20:012
1037205992519,4cyclictest1237904-21gpgv22:30:002
1037205992516,7cyclictest280-21systemd-journal21:15:002
1037201992521,3cyclictest1016940-21kworker/u8:2+flush-8:019:34:121
1037201992520,4cyclictest1044235-21kworker/u8:3+flush-8:019:16:081
1037201992517,6cyclictest1272509-21latency_hist23:05:011
1037201992517,6cyclictest1054255-21kworker/u8:1+flush-8:020:00:581
1037199992521,3cyclictest1122858-21kworker/u8:0+flush-8:020:46:070
1037199992521,2cyclictest1123722-21cut20:35:590
1037199992520,4cyclictest1088825-21kworker/u8:2+flush-8:020:21:150
1037199992520,3cyclictest880-21mta-sts-daemon23:50:580
1037199992520,3cyclictest1337091-21kworker/u8:1+events_unbound00:21:060
1037199992519,4cyclictest0-21swapper/022:31:010
1037205992421,2cyclictest1307760-21fschecks_count23:40:582
1037201992420,3cyclictest1267600-21kworker/u8:0+flush-8:023:13:371
1037201992420,2cyclictest0-21swapper/122:16:071
1037201992420,2cyclictest0-21swapper/121:46:101
1037201992420,2cyclictest0-21swapper/120:31:111
1037201992419,3cyclictest0-21swapper/122:55:001
1037199992420,3cyclictest1167908-21kworker/u8:2+events_unbound23:06:100
10928412230,8sleep3451irq_work/320:01:123
1037205992319,2cyclictest1113640-21aten2_r5power_e20:25:562
1037205992318,4cyclictest1016940-21kworker/u8:2+flush-8:019:36:432
1037205992318,3cyclictest1336682-21unixbench_multi00:06:152
1037201992319,2cyclictest0-21swapper/121:21:111
1037201992319,2cyclictest0-21swapper/120:16:121
1037201992319,2cyclictest0-21swapper/119:11:001
1037201992318,4cyclictest1338531-21kthreadcore00:11:031
1037201992318,3cyclictest0-21swapper/122:06:051
1037201992318,3cyclictest0-21swapper/100:40:011
1037201992318,3cyclictest0-21swapper/100:40:001
103720599223,2cyclictest12044051kthreadcore21:56:012
1037205992219,2cyclictest1347599-21fschecks_count00:20:582
1037205992219,2cyclictest1108965-21fschecks_time20:20:582
1037205992219,2cyclictest1083991-21aten2_r5power_c19:55:562
1037205992217,4cyclictest1044235-21kworker/u8:3+events_unbound20:10:052
1037205992215,5cyclictest1282501-21sort23:15:002
1037205992211,8cyclictest1255616-21tr22:46:032
1037201992218,2cyclictest0-21swapper/122:10:591
1037201992218,2cyclictest0-21swapper/121:41:091
1037201992218,2cyclictest0-21swapper/119:56:111
1037199992218,3cyclictest1361701-21unixbench_singl00:31:160
1037199992218,3cyclictest1361701-21unixbench_singl00:31:160
12679742210,10sleep375-21kworker/3:1+mm_percpu_wq23:00:573
11270772210,6sleep20-21swapper/220:36:052
1037205992118,2cyclictest1321872-21unixbench_singl23:51:142
1037205992117,2cyclictest1346611-21unixbench_singl00:16:122
1037205992117,2cyclictest1297641-21aten2_r5power_p23:30:572
1037205992116,4cyclictest1173086-21kworker/u8:0+flush-8:021:25:162
1037205992116,3cyclictest0-21swapper/222:05:012
1037205992115,4cyclictest0-21swapper/221:31:042
1037201992117,2cyclictest0-21swapper/123:50:591
1037201992110,3cyclictest0-21swapper/100:19:391
10327282214,10sleep20-21swapper/219:05:582
1037205992017,2cyclictest1138635-21aten2_r5power_p20:50:562
10323542202,9sleep30-21swapper/319:05:023
103720599197,4cyclictest0-21swapper/200:01:012
1037205991916,2cyclictest1193368-21aten2_r5power_p21:45:582
1037205991915,3cyclictest1321873-21kworker/u8:2+events_unbound00:14:082
1037205991915,2cyclictest1089230-21fschecks_time20:00:592
1037205991914,3cyclictest1153147-21taskset21:05:012
103720599187,2cyclictest0-21swapper/223:35:572
103720599182,12cyclictest1361200-21ntpq00:31:102
103720599182,12cyclictest1361200-21ntpq00:31:092
1037205991814,2cyclictest1147686-21unixbench_multi20:56:152
1037205991814,2cyclictest0-21swapper/222:05:552
103720599181,12cyclictest1218205-21apt-get22:10:542
1037201991814,2cyclictest0-21swapper/122:30:571
103720599177,8cyclictest1228752-21sed22:21:022
103720599172,12cyclictest1188276-21apt-get21:40:552
103720599171,12cyclictest1267977-21aten2_r5power_p23:00:572
11237432166,6sleep30-21swapper/320:36:003
103720599162,2cyclictest0-21swapper/220:40:532
103720599162,2cyclictest0-21swapper/219:41:192
1037205991613,2cyclictest1074419-21fschecks_time19:45:592
1037205991613,2cyclictest0-21swapper/220:06:472
1037205991612,2cyclictest0-21swapper/222:40:142
1037205991612,2cyclictest0-21swapper/222:40:142
103720599152,2cyclictest0-21swapper/221:51:142
103720599152,12cyclictest0-21swapper/220:46:132
12431112142,8sleep30-21swapper/322:35:543
13561662132,7sleep30-21swapper/300:26:143
13120972132,7sleep30-21swapper/323:45:003
12281292132,7sleep30-21swapper/322:20:583
11382182132,6sleep30-21swapper/320:50:003
10876812132,7sleep30-21swapper/319:56:073
13614232122,6sleep30-21swapper/300:31:153
13614232122,6sleep30-21swapper/300:31:153
13412032122,6sleep30-21swapper/300:11:093
13272172122,5sleep30-21swapper/300:00:003
13021812122,5sleep30-21swapper/323:35:013
12979072122,6sleep30-21swapper/323:31:003
12952272122,6sleep30-21swapper/323:26:063
12873082121,7sleep30-21swapper/323:20:003
12728372122,6sleep30-21swapper/323:05:563
12574112122,6sleep30-21swapper/322:46:343
12505242122,6sleep30-21swapper/322:41:043
12505242122,6sleep30-21swapper/322:41:033
12269722122,6sleep30-21swapper/322:16:123
12222582122,6sleep30-21swapper/322:11:143
12136282122,6sleep30-21swapper/322:06:013
12028242122,5sleep30-21swapper/321:55:003
12020302122,6sleep30-21swapper/321:51:123
11887602123,5sleep30-21swapper/321:41:003
11746932122,6sleep30-21swapper/321:26:033
11679602122,6sleep30-21swapper/321:20:023
11571492122,6sleep30-21swapper/321:06:103
11399242122,6sleep30-21swapper/320:51:053
11327002122,6sleep30-21swapper/320:41:143
11184912122,6sleep30-21swapper/320:30:543
10987862122,6sleep30-21swapper/320:10:563
10949902122,6sleep30-21swapper/320:06:013
10787222122,5sleep30-21swapper/319:50:003
10744412122,6sleep30-21swapper/319:46:003
10689482122,6sleep30-21swapper/319:40:023
10601492122,6sleep30-21swapper/319:31:033
10581282122,6sleep30-21swapper/319:26:103
13472272112,6sleep30-21swapper/300:20:123
13333642111,6sleep30-21swapper/300:06:033
13174982112,5sleep30-21swapper/323:50:023
12914412112,5sleep30-21swapper/323:21:093
12777622112,5sleep30-21swapper/323:10:543
12666602112,5sleep30-21swapper/322:56:043
12579822112,5sleep30-21swapper/322:50:553
12381712112,5sleep30-21swapper/322:30:533
12332842112,5sleep30-21swapper/322:25:593
12091512111,6sleep30-21swapper/322:01:033
11830372112,5sleep30-21swapper/321:35:553
11777942112,5sleep30-21swapper/321:30:013
11632532112,5sleep30-21swapper/321:15:573
11585592112,5sleep30-21swapper/321:10:583
11522542112,5sleep30-21swapper/321:01:123
11431692112,5sleep30-21swapper/320:55:013
11140602112,5sleep30-21swapper/320:26:013
11034032112,5sleep30-21swapper/320:15:013
10495992112,6sleep30-21swapper/319:21:003
10437702112,5sleep30-21swapper/319:15:063
10414922112,5sleep30-21swapper/319:11:133
13224402102,5sleep30-21swapper/323:55:043
13125782102,5sleep30-21swapper/323:45:073
11129782102,5sleep30-21swapper/320:21:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional