You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 11:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Aug 01, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114100923190,2sleep3575-21kworker/3:2+events21:18:023
12825452730,5chrt451irq_work/323:42:583
12083032630,16chrt575-21kworker/3:2+events22:27:593
101130599550,33cyclictest1019052-21sshd19:17:580
1011308995448,4cyclictest1092793-21kworker/u8:3+events_unbound20:52:571
1011308995447,5cyclictest195620-21kworker/u8:0+flush-8:019:13:121
1011308995243,6cyclictest1291523-21latency_hist23:50:011
1011308995146,4cyclictest1127720-21kworker/u8:0+flush-8:021:38:101
1011308995146,3cyclictest1132904-21kworker/u8:1+events_unbound21:15:011
1011308995044,4cyclictest1092793-21kworker/u8:3+events_unbound20:48:111
1011308994944,3cyclictest1336791-21latency_hist00:40:011
1011308994944,3cyclictest1132904-21kworker/u8:1+events_unbound22:08:121
1011305994826,6cyclictest1057723-21latency_hist19:55:010
1011305994826,6cyclictest1057723-21latency_hist19:55:000
1011305994821,9cyclictest1295702-21ntpq23:53:050
1011308994539,4cyclictest979851-21kworker/u8:3+flush-8:019:22:571
1011308994439,3cyclictest1217344-21kworker/u8:2+events_unbound00:30:001
1011308994437,5cyclictest1212334-21kworker/u8:0+flush-8:022:33:091
1011305994422,6cyclictest1182075-21latency_hist22:00:000
12782122430,3chrt575-21kworker/3:2-events23:38:003
1011308994339,3cyclictest195620-21kworker/u8:0+events_unbound19:53:001
1011308994339,3cyclictest195620-21kworker/u8:0+events_unbound19:53:001
1011308994338,4cyclictest1217344-21kworker/u8:2+events_unbound23:30:011
1011308994232,8cyclictest1077722-21latency_hist20:15:011
1011308994138,2cyclictest1236878-21kworker/u8:3+events_unbound23:45:011
1011308994137,3cyclictest1236878-21kworker/u8:3+events_unbound23:07:571
1011310994033,5cyclictest275-21systemd-journal00:15:002
1011308994035,4cyclictest1132904-21kworker/u8:1+events_unbound21:22:561
1011308994035,4cyclictest1016325-21kworker/u8:2+events_unbound19:37:531
1011308994031,7cyclictest1052745-21latency_hist19:50:001
1011308993934,4cyclictest1016325-21kworker/u8:2+events_unbound20:43:051
1011308993934,3cyclictest1266355-21kworker/u8:0+events_unbound23:37:591
1011308993933,4cyclictest1217344-21kworker/u8:2+flush-8:023:58:111
1011308993932,5cyclictest1217344-21kworker/u8:2+flush-8:022:48:091
1011310993827,9cyclictest1057728-21apt-get19:55:012
1011310993827,9cyclictest1057728-21apt-get19:55:002
1011308993834,3cyclictest195620-21kworker/u8:0+events_unbound19:28:061
1011308993833,3cyclictest1132904-21kworker/u8:1+events_unbound22:52:581
1011308993832,5cyclictest195620-21kworker/u8:0+flush-8:019:32:581
1011308993832,5cyclictest1016325-21kworker/u8:2+flush-8:019:43:101
1011308993832,4cyclictest1132904-21kworker/u8:1+flush-8:021:33:101
1011310993729,6cyclictest1301422-40logrotate00:00:012
1011308993732,4cyclictest1266355-21kworker/u8:0+flush-8:023:33:041
1011308993729,6cyclictest275-21systemd-journal23:53:131
1011308993632,3cyclictest1052760-21kworker/u8:1+events_unbound20:57:581
10110782364,11sleep20-21swapper/219:09:232
10066062363,10sleep10-21swapper/119:07:101
1011308993531,3cyclictest1016325-21kworker/u8:2+events_unbound20:28:061
101130599358,25cyclictest1062957-21kworker/0:2+events21:52:560
1011310993424,8cyclictest1152408-21awk21:30:002
1011308993430,3cyclictest979851-21kworker/u8:3+events_unbound19:18:001
1011308993430,3cyclictest195620-21kworker/u8:0+events_unbound20:18:031
1011308993429,3cyclictest1083880-21irqrtprio20:22:581
1011310993328,3cyclictest1112678-21unin-run20:50:002
1011308993329,3cyclictest1132904-21kworker/u8:1+events_unbound21:18:011
1011308993328,4cyclictest1016325-21kworker/u8:2+events_unbound19:58:131
1011308993328,4cyclictest1016325-21kworker/u8:2+events_unbound19:58:131
1011308993327,5cyclictest1197067-21kworker/u8:4+flush-8:022:18:111
101130599339,22cyclictest1006255-21kworker/0:1+events19:27:560
101130599332,30cyclictest1062957-21kworker/0:2+events21:29:440
1011308993228,3cyclictest1132904-21kworker/u8:1+events_unbound22:22:561
1011308993227,4cyclictest195620-21kworker/u8:0+events_unbound20:03:001
1011308993227,3cyclictest1132904-21kworker/u8:1+events_unbound23:13:091
1011308993227,3cyclictest1132904-21kworker/u8:1+events_unbound23:13:091
1011308993226,5cyclictest1162566-21kworker/u8:3+flush-8:021:53:061
1011308993222,8cyclictest1260856-21ntpq23:18:061
101130899320,30cyclictest1222083-21unin-run22:40:001
1011305993223,6cyclictest1251697-21latency_hist23:10:000
101130599322,28cyclictest1062957-21kworker/0:2+events21:38:020
1011310993124,5cyclictest1033658-21tr19:32:562
1011310993122,7cyclictest1162311-21awk21:40:012
1011308993126,4cyclictest1289590-21kworker/u8:1+events_unbound00:17:511
1011308993125,5cyclictest1016325-21kworker/u8:2+flush-8:020:33:021
1011308993125,4cyclictest1266879-21latency_hist23:25:011
1011305993123,6cyclictest1197001-21grep22:13:130
1011305993123,6cyclictest1197001-21grep22:13:120
101130599311,28cyclictest1062957-21kworker/0:2+events20:48:100
1011310993026,2cyclictest1162868-21aten2_r5power_p21:42:532
1011310993021,6cyclictest1266947-21cp23:25:012
1011308993026,3cyclictest1182114-21kworker/u8:2+events_unbound22:12:581
1011308993026,3cyclictest1182114-21kworker/u8:2+events_unbound22:12:581
1011308993024,4cyclictest1217344-21kworker/u8:2+events_unbound00:22:541
1011308993023,6cyclictest1127720-21kworker/u8:0+flush-8:021:43:071
1011308993023,5cyclictest1289590-21kworker/u8:1+events_unbound00:03:061
1011308993022,6cyclictest1072784-21latency_hist20:10:011
1011305993026,3cyclictest1126919-21needreboot21:03:030
1011305993020,7cyclictest275-21systemd-journal20:25:000
101130599301,27cyclictest1062957-21kworker/0:2+events22:22:560
1011305993011,17cyclictest1212098-21kworker/0:0+events22:42:580
1011305993011,16cyclictest1062957-21kworker/0:2+events22:17:520
1011310992925,2cyclictest1058546-21aten2_r5power_v19:57:592
1011310992925,2cyclictest1058546-21aten2_r5power_v19:57:592
1011308992925,3cyclictest1132904-21kworker/u8:1+events_unbound22:03:121
1011308992925,3cyclictest1132904-21kworker/u8:1+events_unbound22:03:121
1011305992924,3cyclictest1231732-21unixbench_singl22:48:100
1011305992924,3cyclictest1155053-21kthreadcore21:33:010
101130599291,27cyclictest1236896-21kworker/0:1+events23:23:020
101130599291,27cyclictest1006255-21kworker/0:1+events19:38:000
101130599291,26cyclictest275-21systemd-journal22:05:010
101130599291,26cyclictest275-21systemd-journal22:05:000
101130599291,26cyclictest1062957-21kworker/0:2+events20:13:020
1011305992910,17cyclictest1276670-21kworker/0:0+events23:58:020
1011308992822,4cyclictest1217344-21kworker/u8:2+events_unbound00:07:551
101130599288,18cyclictest1236896-21kworker/0:1+events23:12:520
101130599288,18cyclictest1236896-21kworker/0:1+events23:12:520
1011305992823,4cyclictest1147313-21unixbench_singl21:23:130
1011305992823,3cyclictest1236861-21munin-plugin-st22:55:000
1011305992810,16cyclictest1006255-21kworker/0:1+events19:58:110
1011305992810,16cyclictest1006255-21kworker/0:1+events19:58:100
1011308992722,3cyclictest1241840-21turbostat.cron23:00:001
1011308992715,7cyclictest0-21swapper/121:47:541
101130599278,17cyclictest1276670-21kworker/0:0+events00:18:000
101130599278,17cyclictest1062957-21kworker/0:2+events20:08:020
1011305992722,4cyclictest979851-21kworker/u8:3+events_unbound19:23:120
1011305992722,3cyclictest1257137-21aten2_r5power_e23:17:550
1011305992721,4cyclictest1107730-21latency_hist20:45:010
1011305992719,6cyclictest275-21systemd-journal21:15:000
10575412260,5sleep3451irq_work/319:53:123
10575412260,5sleep3451irq_work/319:53:123
1011310992623,2cyclictest1133197-21aten2_r5power_p21:12:552
1011310992622,3cyclictest1153160-21fschecks_count21:32:562
1011310992621,3cyclictest1192025-21sh22:10:002
1011308992621,4cyclictest1016325-21kworker/u8:2+flush-8:021:03:101
1011308992620,5cyclictest1132904-21kworker/u8:1+flush-8:021:28:051
1011308992619,5cyclictest1097990-21apt-get20:37:511
1011308992615,9cyclictest1246046-21ntpq23:03:041
101130599267,17cyclictest1276670-21kworker/0:0+events00:23:020
101130599267,15cyclictest1236896-21kworker/0:1+events23:02:360
101130599262,23cyclictest1062957-21kworker/0:2+events21:18:020
101130599262,19cyclictest1006255-21kworker/0:1+events19:40:220
1011305992619,5cyclictest1101754-21ntpq20:38:040
1011305992619,5cyclictest1037160-21needreboot19:33:040
1011305992610,14cyclictest1276670-21kworker/0:0+events00:03:040
1011310992521,2cyclictest1048327-21aten2_r5power_c19:47:532
1011308992522,2cyclictest1327456-21aten2_r5power_v00:32:551
1011308992520,4cyclictest1132904-21kworker/u8:1+flush-8:021:58:471
1011308992520,3cyclictest1092793-21kworker/u8:3+events_unbound21:08:021
101130599258,15cyclictest1062957-21kworker/0:2+events21:42:560
101130599257,16cyclictest1006255-21kworker/0:1+events19:48:000
101130599253,20cyclictest1062957-21kworker/0:2+events22:09:340
1011305992520,4cyclictest0-21swapper/000:40:000
1011305992516,7cyclictest1291513-21cron23:50:000
101131099247,2cyclictest11043142grep20:43:012
1011310992420,2cyclictest1227830-21fschecks_time22:47:552
1011310992419,3cyclictest1216834-21unixbench_multi22:33:102
1011308992419,3cyclictest1312006-21idleruntime-cro00:15:001
101130599249,13cyclictest1062957-21kworker/0:2+events20:16:480
101130599248,15cyclictest1062957-21kworker/0:2+events20:53:120
101130599247,15cyclictest1062957-21kworker/0:2+events20:57:520
101130599247,15cyclictest1062957-21kworker/0:2+events20:02:520
101130599247,15cyclictest1006255-21kworker/0:1+events19:13:080
101130599246,17cyclictest1276670-21kworker/0:0+events23:38:000
101130599246,16cyclictest1212098-21kworker/0:0+events22:58:020
101130599245,17cyclictest1276670-21kworker/0:0+events00:08:000
101130599243,14cyclictest571-21snmpd23:27:520
1011305992419,3cyclictest1327374-21aten2_r5power_c00:32:540
1011305992419,3cyclictest1222026-21cron22:40:000
1011305992419,3cyclictest1091776-21needreboot20:27:590
1011305992418,4cyclictest1211893-21unixbench_singl22:28:110
1011305992417,5cyclictest1283046-21kthreadcore23:43:000
101130599241,16cyclictest1128172-21chrt21:07:520
1011310992320,2cyclictest1242410-21aten2_r5power_p23:02:542
1011310992319,2cyclictest1267468-21fschecks_count23:27:562
1011310992318,3cyclictest844-21mta-sts-daemon00:32:552
1011310992318,3cyclictest1232678-21fschecks_count22:52:542
1011310992313,8cyclictest1286595-21cat23:45:012
1011308992319,3cyclictest1217344-21kworker/u8:2+events_unbound22:41:121
101130599239,13cyclictest1062957-21kworker/0:2+events21:49:370
1011305992317,4cyclictest1272498-21fschecks_time23:32:560
1011310992219,2cyclictest1138150-21aten2_r5power_e21:17:542
1011310992218,2cyclictest1290715-21tail23:48:032
1011310992212,8cyclictest1132640-21awk21:09:592
1011308992218,2cyclictest0-21swapper/122:27:541
101130599226,14cyclictest1276670-21kworker/0:0+events00:28:020
101130599224,17cyclictest1062957-21kworker/0:2+events20:32:580
101131099219,9cyclictest1326881-21awk00:29:592
101131099219,8cyclictest1207606-21apt-get22:27:532
101131099219,4cyclictest0-21swapper/220:29:272
1011310992117,3cyclictest1042859-21munin-plugin-st19:40:002
1011310992117,2cyclictest0-21swapper/223:08:022
1011310992117,2cyclictest0-21swapper/219:28:012
101131099210,11cyclictest13027512cut00:03:002
1011310992016,2cyclictest0-21swapper/223:00:002
1011310992015,4cyclictest20823-21cron00:20:002
1011310992014,4cyclictest1132904-21kworker/u8:1+flush-8:022:43:072
1011310992010,8cyclictest1100403-21tr20:38:012
101130599203,16cyclictest1062957-21kworker/0:2+events22:33:100
101131099196,8cyclictest1192689-21apt-get22:12:542
101131099196,8cyclictest1192689-21apt-get22:12:532
101131099192,12cyclictest1073248-21apt-get20:12:562
1011310991910,7cyclictest1219060-21tr22:38:002
1011310991910,7cyclictest1117863-21grep20:55:002
10069322193,9sleep30-21swapper/319:07:553
101131099189,7cyclictest1085848-21tr20:23:012
101131099182,11cyclictest1272183-21apt-get23:32:532
1011310991814,3cyclictest0-21swapper/200:25:002
1011310991814,2cyclictest1123242-21aten2_r5power_c21:02:542
1011310991814,2cyclictest0-21swapper/222:02:562
1011310991814,2cyclictest0-21swapper/222:02:552
1011310991814,2cyclictest0-21swapper/221:47:572
1011310991814,2cyclictest0-21swapper/219:15:052
1011310991813,3cyclictest1067368-21mailstats20:03:092
1011310991813,3cyclictest0-21swapper/200:38:112
1011310991812,4cyclictest0-21swapper/220:08:022
101131099179,6cyclictest1-21systemd22:25:012
101131099178,7cyclictest1292870-21sed23:52:592
101131099177,8cyclictest1120004-21cut20:58:012
101131099172,11cyclictest1093032-21apt-get20:32:542
1011310991713,3cyclictest1197894-21cpuspeed_turbos22:17:542
101130599179,5cyclictest0-21swapper/019:10:010
11980162167,6sleep30-21swapper/322:17:573
101131099168,6cyclictest1277477-21seq23:37:572
101131099167,7cyclictest1258374-21cut23:18:012
1011310991613,2cyclictest1043559-21cpuspeed_turbos19:42:562
1011310991613,2cyclictest0-21swapper/223:13:082
1011310991613,2cyclictest0-21swapper/223:13:082
1011310991612,2cyclictest1078939-21irqrtprio20:18:062
1011310991612,2cyclictest0-21swapper/221:57:552
1011310991612,2cyclictest0-21swapper/221:53:002
1011310991612,2cyclictest0-21swapper/221:22:552
13223932152,8sleep30-21swapper/300:27:563
101131099158,5cyclictest1013047-21cut19:13:032
101131099152,8cyclictest1023535-21apt-get19:22:532
1011310991510,3cyclictest0-21swapper/200:08:012
101130599154,10cyclictest1276670-21kworker/0:0+events00:11:120
12908952133,7sleep30-21swapper/323:48:083
12420242132,6sleep30-21swapper/323:00:023
12372492132,7sleep30-21swapper/322:57:133
12263002135,5sleep30-21swapper/322:43:043
12172752132,6sleep30-21swapper/322:35:023
11967352132,7sleep30-21swapper/322:13:113
11967352132,7sleep30-21swapper/322:13:113
11528442132,7sleep30-21swapper/321:32:513
11474762133,5sleep30-21swapper/321:25:013
10977312132,6sleep30-21swapper/320:35:033
10527292133,6sleep30-21swapper/319:50:003
13310632123,6sleep30-21swapper/300:33:063
13119092122,6sleep30-21swapper/300:14:003
13106872122,6sleep30-21swapper/300:08:063
13027462120,2sleep3575-21kworker/3:2+events00:03:003
12919922122,6sleep30-21swapper/323:52:543
12724282122,6sleep30-21swapper/323:32:563
12574632122,6sleep30-21swapper/323:17:593
12525462122,6sleep30-21swapper/323:12:583
12525462122,6sleep30-21swapper/323:12:583
12361342122,6sleep30-21swapper/322:53:033
12270242122,5sleep30-21swapper/322:45:023
12129832122,6sleep30-21swapper/322:32:583
11883842122,6sleep30-21swapper/322:08:023
11773782122,6sleep30-21swapper/321:55:143
11730442122,6sleep30-21swapper/321:52:573
11660022122,6sleep30-21swapper/321:43:023
11483272122,6sleep30-21swapper/321:27:583
11281422123,6sleep30-21swapper/321:07:523
11228932123,6sleep30-21swapper/321:00:013
11225162122,6sleep30-21swapper/320:58:133
11137482122,6sleep30-21swapper/320:52:593
11029642122,6sleep30-21swapper/320:42:523
10930072122,6sleep30-21swapper/320:32:533
10886152122,6sleep30-21swapper/320:27:563
10836372122,6sleep30-21swapper/320:22:583
10686572120,8sleep30-21swapper/320:07:583
10676832122,6sleep30-21swapper/320:03:123
10429002122,5sleep30-21swapper/319:40:013
10384112122,6sleep30-21swapper/319:37:533
10323312122,6sleep30-21swapper/319:28:113
10244192122,6sleep30-21swapper/319:23:003
10121302123,5sleep30-21swapper/319:13:023
13320312112,5sleep30-21swapper/300:35:023
13172262112,6sleep30-21swapper/300:20:183
13140252111,6sleep30-21swapper/300:17:573
12966742112,5sleep30-21swapper/323:55:023
12670632113,5sleep30-21swapper/323:26:223
12618912113,5sleep30-21swapper/323:21:043
12471232112,6sleep30-21swapper/323:06:443
12024672112,6sleep30-21swapper/322:20:503
11676912112,6sleep30-21swapper/321:47:163
11576092113,5sleep30-21swapper/321:35:043
11326222112,5sleep30-21swapper/321:10:003
11080662112,6sleep30-21swapper/320:47:013
10780012112,6sleep30-21swapper/320:15:523
10730042111,6sleep30-21swapper/320:10:023
10588042112,5sleep30-21swapper/319:58:033
10588042112,5sleep30-21swapper/319:58:033
10331872112,5sleep30-21swapper/319:30:023
10162022110,6sleep30-21swapper/319:15:023
11823192102,5sleep30-21swapper/322:00:043
11823192102,5sleep30-21swapper/322:00:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional