You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 11:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Aug 17, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
986941997153,16cyclictest954685-21kworker/u8:2+flush-8:022:10:000
986944996054,4cyclictest1253458-21kworker/u8:3+events_unbound23:57:591
986944995751,5cyclictest1203170-21kworker/u8:2+flush-8:023:32:561
986944995751,4cyclictest1203170-21kworker/u8:2+events_unbound22:57:571
986941995650,4cyclictest1196290-21kworker/u8:1+flush-8:022:52:590
986944995550,3cyclictest1073674-21kworker/u8:1+events_unbound21:25:001
986944995549,4cyclictest1158766-21kworker/u8:0+events_unbound22:22:561
986944995445,7cyclictest1208260-21latency_hist22:50:011
986944995348,4cyclictest1273122-21kworker/u8:1+events_unbound00:02:591
986944995347,4cyclictest954685-21kworker/u8:2+flush-8:020:17:581
986944995347,4cyclictest954685-21kworker/u8:2+events_unbound20:47:431
986944995347,4cyclictest1158766-21kworker/u8:0+events_unbound23:12:571
986944995247,3cyclictest1129002-21kworker/u8:0+flush-8:021:37:551
986944995247,3cyclictest1129002-21kworker/u8:0+flush-8:021:37:551
986941995147,3cyclictest1073674-21kworker/u8:1+flush-8:021:00:010
986944995045,4cyclictest954685-21kworker/u8:2+events_unbound20:27:471
986944995045,3cyclictest954685-21kworker/u8:2+events_unbound22:12:471
986944995044,4cyclictest954685-21kworker/u8:2+events_unbound22:07:441
986941995038,9cyclictest1132993-21ntpq21:32:550
986944994944,3cyclictest1073674-21kworker/u8:1+events_unbound21:03:001
986944994943,4cyclictest1273122-21kworker/u8:1+flush-8:000:07:581
986944994941,6cyclictest1273122-21kworker/u8:1+flush-8:000:12:551
986944994938,8cyclictest1073674-21kworker/u8:1+flush-8:020:57:541
986944994938,4cyclictest1203170-21kworker/u8:2+events_unbound23:07:501
986948994843,4cyclictest1158766-21kworker/u8:0+flush-8:022:40:002
986944994838,3cyclictest1019459-21kworker/u8:3+flush-8:019:52:431
986944994741,4cyclictest954685-21kworker/u8:2+flush-8:019:57:521
986944994741,4cyclictest137619-21kworker/u8:0+flush-8:019:17:551
986944994739,6cyclictest1198346-21latency_hist22:40:011
986941994738,6cyclictest1223358-21latency_hist23:05:010
986941994736,8cyclictest275-21systemd-journal22:35:000
986944994642,3cyclictest954685-21kworker/u8:2+events_unbound20:32:471
986944994640,5cyclictest1081422-21kworker/u8:3+events_unbound20:42:551
986944994639,5cyclictest943956-21kworker/u8:3+flush-8:019:12:531
986941994636,8cyclictest1088036-21ntpq20:47:540
986941994636,7cyclictest1153531-21latency_hist21:55:010
98694199461,41cyclictest1-21systemd22:55:550
98694199460,43cyclictest1-21systemd20:40:000
986944994541,3cyclictest1158766-21kworker/u8:0+events_unbound23:22:551
986944994540,4cyclictest1273122-21kworker/u8:1+flush-8:000:32:481
986944994540,4cyclictest1258467-21kworker/u8:0+events_unbound00:22:441
986944994539,4cyclictest1019459-21kworker/u8:3+events_unbound20:02:541
986944994537,6cyclictest954685-21kworker/u8:2+flush-8:021:32:471
986944994536,7cyclictest986777-21latency_hist19:10:001
986941994538,5cyclictest1248319-21latency_hist23:30:010
986944994439,4cyclictest1081422-21kworker/u8:3+flush-8:020:52:441
986944994439,3cyclictest954685-21kworker/u8:2+events_unbound19:27:511
986944994439,3cyclictest954685-21kworker/u8:2+events_unbound19:27:501
986944994338,4cyclictest954685-21kworker/u8:2+events_unbound22:17:431
986944994337,4cyclictest1073674-21kworker/u8:1+flush-8:021:27:471
986944994335,6cyclictest1253458-21kworker/u8:3+flush-8:023:37:551
986944994335,6cyclictest1183962-21apt-get22:27:391
986944994335,6cyclictest1108769-21latency_hist21:10:011
986948994234,6cyclictest1293186-21turbostat.cron00:15:012
986944994237,4cyclictest137619-21kworker/u8:0+events_unbound19:45:031
986944994236,5cyclictest1019459-21kworker/u8:3+events_unbound20:12:431
986944994236,4cyclictest1138513-21kworker/u8:3+flush-8:021:47:471
986944994235,5cyclictest1293599-21kworker/u8:2+flush-8:000:17:581
986948994034,4cyclictest1093687-21apt-get20:55:002
986944994036,3cyclictest954685-21kworker/u8:2+events_unbound19:20:071
986944994036,3cyclictest1293599-21kworker/u8:2+flush-8:000:38:001
986944994035,4cyclictest1019459-21kworker/u8:3+flush-8:020:22:461
986944994031,7cyclictest1262561-21ntpq23:42:561
986941994032,5cyclictest1019391-21wc19:40:010
986941994031,7cyclictest1112992-21ntpq21:12:540
986944993935,3cyclictest1258467-21kworker/u8:0+events_unbound23:47:591
986944993933,4cyclictest1218663-21kworker/u8:3+flush-8:023:17:571
10599752390,1sleep01059979-21sed20:22:460
986944993833,4cyclictest137619-21kworker/u8:0+events_unbound19:42:531
986941993829,6cyclictest1228300-21latency_hist23:10:000
986944993731,4cyclictest1168850-21kworker/u8:3+events_unbound22:42:521
986941993729,6cyclictest1312257-21ntpq00:32:540
986944993628,6cyclictest1153958-21/usr/sbin/munin21:57:511
986941993631,4cyclictest954685-21kworker/u8:2+flush-8:019:20:000
986941993628,6cyclictest1008613-21latency_hist19:30:000
986941993628,6cyclictest1008613-21latency_hist19:30:000
986941993625,8cyclictest1093687-21apt-get20:55:000
98694199361,30cyclictest944618-21kworker/0:1+events19:10:000
98694199361,28cyclictest1113727-21kworker/0:2+events22:47:380
12106062360,5sleep30-21swapper/322:52:493
986944993531,3cyclictest1158766-21kworker/u8:0+events_unbound23:27:501
986944993530,3cyclictest954685-21kworker/u8:2+flush-8:022:32:511
986944993529,4cyclictest275-21systemd-journal21:15:001
986944993528,5cyclictest1196290-21kworker/u8:1+events_unbound22:52:581
986944993527,6cyclictest275-21systemd-journal19:38:551
98694199351,32cyclictest1268169-21kworker/0:0+events00:27:540
986944993430,3cyclictest1203170-21kworker/u8:2+events_unbound23:52:481
986944993429,4cyclictest1258467-21kworker/u8:0+events_unbound00:27:491
986944993429,3cyclictest1151218-21kthreadcore21:52:491
98694199343,28cyclictest1113727-21kworker/0:2+events22:12:400
986941993430,3cyclictest1083555-21munin-plugin-st20:45:000
986941993428,4cyclictest1282550-21ntpq00:02:540
986941993427,4cyclictest1313415-21apt-get00:37:420
986941993424,8cyclictest1162695-21ntpq22:02:500
10248612340,4chrt0-21swapper/319:47:423
986948993321,10cyclictest1138645-21cat21:40:002
986948993321,10cyclictest1138645-21cat21:40:002
986944993328,3cyclictest1073674-21kworker/u8:1+events_unbound21:17:441
98694199339,22cyclictest944618-21kworker/0:1+events20:32:400
98694199338,23cyclictest1113727-21kworker/0:2+events23:17:560
98694199332,29cyclictest1113727-21kworker/0:2+events22:37:540
98694199332,28cyclictest1268169-21kworker/0:0+events00:22:400
98694199331,30cyclictest944618-21kworker/0:1+events19:12:400
98694199331,27cyclictest1253266-21kworker/0:1+events23:45:040
986948993228,3cyclictest1158766-21kworker/u8:0+flush-8:022:30:012
986944993228,3cyclictest1019459-21kworker/u8:3+events_unbound20:08:011
986944993226,5cyclictest1129002-21kworker/u8:0+flush-8:021:43:291
98694199322,28cyclictest944618-21kworker/0:1+events21:07:400
98694199321,29cyclictest1268169-21kworker/0:0+events00:07:400
9860542324,10sleep20-21swapper/219:07:542
986948993127,3cyclictest954685-21kworker/u8:2+events_unbound19:52:572
986948993126,4cyclictest954685-21kworker/u8:2+flush-8:021:07:592
986948993126,4cyclictest1203170-21kworker/u8:2+flush-8:023:35:012
986948993121,8cyclictest1213524-21cat22:55:022
98694199316,21cyclictest1268169-21kworker/0:0+events00:16:340
98694199312,27cyclictest944618-21kworker/0:1+events19:52:560
98694199312,27cyclictest944618-21kworker/0:1+events19:32:480
98694199312,27cyclictest1268169-21kworker/0:0+events23:51:240
98694199311,29cyclictest944618-21kworker/0:1+events20:03:440
98694199311,28cyclictest1268169-21kworker/0:0+events00:12:440
98694199311,28cyclictest1253266-21kworker/0:1+events23:37:520
986948993024,4cyclictest1053611-21unixbench_multi20:12:592
986944993025,4cyclictest1158766-21kworker/u8:0+flush-8:022:02:471
98694199302,27cyclictest944618-21kworker/0:1+events20:27:480
98694199302,27cyclictest1268169-21kworker/0:0+events23:57:500
98694199302,26cyclictest944618-21kworker/0:1+events21:02:440
98694199302,26cyclictest944618-21kworker/0:1+events20:07:520
98694199302,26cyclictest944618-21kworker/0:1+events19:40:020
98694199302,26cyclictest1113727-21kworker/0:2+events21:22:480
986941993021,6cyclictest1233230-21latency_hist23:15:000
986948992925,3cyclictest1019459-21kworker/u8:3+flush-8:020:30:002
986948992921,6cyclictest999925-21irqrtprio19:22:452
986948992919,8cyclictest1083288-21unixbench_multi20:42:592
986941992925,3cyclictest1138513-21kworker/u8:3+events_unbound21:57:570
986941992922,5cyclictest275-21systemd-journal21:39:550
986941992922,5cyclictest275-21systemd-journal21:39:550
98694199291,26cyclictest1113727-21kworker/0:2+events22:17:580
986941992911,16cyclictest1113727-21kworker/0:2+events22:22:400
98694199290,27cyclictest1113727-21kworker/0:2+events23:32:580
986948992822,4cyclictest998520-21unixbench_singl19:18:002
986948992822,4cyclictest1138513-21kworker/u8:3+flush-8:021:58:002
986948992820,6cyclictest1288048-21unixbench_singl00:08:022
986948992819,7cyclictest1014271-21cp19:35:012
98694199288,18cyclictest1253266-21kworker/0:1+events23:42:500
98694199287,16cyclictest1113727-21kworker/0:2+events22:41:440
98694199285,19cyclictest944618-21kworker/0:1+events20:16:540
98694199281,26cyclictest944618-21kworker/0:1+events19:58:000
986941992811,15cyclictest1113727-21kworker/0:2+events21:47:520
986948992723,3cyclictest1158766-21kworker/u8:0+events_unbound23:15:002
986948992723,3cyclictest1109279-21aten2_r5power_e21:12:422
986948992723,2cyclictest1303767-21cpuspeed_turbos00:27:442
986948992723,2cyclictest1144202-21aten2_r5power_v21:47:402
986944992721,4cyclictest1203170-21kworker/u8:2+events_unbound23:03:001
986944992721,3cyclictest0-21swapper/119:30:021
98694199277,19cyclictest1113727-21kworker/0:2+events21:40:240
98694199277,15cyclictest1113727-21kworker/0:2+events21:25:320
98694199272,23cyclictest1098893-21kworker/0:0+events21:17:420
98694199272,20cyclictest1113727-21kworker/0:2+events22:26:420
986948992622,2cyclictest1044530-21aten2_r5power_v20:07:432
986948992621,3cyclictest1224077-21fschecks_count23:07:452
986948992620,4cyclictest1297957-21unixbench_singl00:18:002
986948992617,7cyclictest1014116-21cat19:35:012
986941992610,15cyclictest944618-21kworker/0:1+events20:12:430
986948992521,2cyclictest1203994-21cpuspeed_turbos22:47:412
986948992518,6cyclictest1217582-21needreboot22:57:512
986948992516,7cyclictest1024186-21awk19:45:002
986944992519,4cyclictest954685-21kworker/u8:2+flush-8:020:38:011
98694199256,15cyclictest944618-21kworker/0:1+events19:20:040
986948992419,4cyclictest20823-21cron00:05:002
986948992419,4cyclictest1203170-21kworker/u8:2+flush-8:023:27:002
986948992419,4cyclictest1168850-21kworker/u8:3+events_unbound22:31:572
986948992417,5cyclictest1159275-21fschecks_time22:02:422
986948992416,6cyclictest1119402-21fschecks_count21:22:432
98694199244,18cyclictest944618-21kworker/0:1+events19:45:120
986941992420,2cyclictest0-21swapper/023:25:010
986948992320,2cyclictest1139375-21fschecks_count21:42:432
986948992319,3cyclictest954685-21kworker/u8:2+flush-8:020:22:492
986948992319,3cyclictest943956-21kworker/u8:3+flush-8:019:12:582
98694899230,7cyclictest1308760-21fschecks_count00:32:452
98694899223,2cyclictest421rcuog/221:17:562
986948992218,3cyclictest1267932-21unixbench_singl23:47:592
986948992218,3cyclictest1103573-21unixbench_multi21:03:002
986948992218,2cyclictest1149289-21cpuspeed_turbos21:52:422
986948992217,3cyclictest0-21swapper/219:28:002
986948992217,3cyclictest0-21swapper/219:28:002
986948992214,6cyclictest0-21swapper/221:27:472
98694899220,10cyclictest1055213-21irqrtprio20:17:472
986948992117,3cyclictest1203170-21kworker/u8:2+flush-8:023:42:262
11549172210,5sleep3451irq_work/321:57:483
98694899202,9cyclictest0-21swapper/222:22:492
98694899202,10cyclictest0-21swapper/223:57:512
98694899202,10cyclictest0-21swapper/219:57:462
986948992016,3cyclictest1173351-21unixbench_singl22:13:002
986948992016,3cyclictest1158766-21kworker/u8:0+flush-8:023:03:202
986948992016,3cyclictest1069220-21aten2_r5power_e20:32:422
986948992016,2cyclictest0-21swapper/223:25:012
986948992011,7cyclictest1167497-21grep22:07:512
98694899193,3cyclictest0-21swapper/220:37:472
98694899192,5cyclictest0-21swapper/223:17:532
986948991914,3cyclictest0-21swapper/220:02:492
98694899189,7cyclictest1201700-21tr22:42:492
98694899189,7cyclictest1087742-21cut20:47:512
98694899182,2cyclictest0-21swapper/223:37:562
98694899182,10cyclictest0-21swapper/223:52:412
986948991814,2cyclictest0-21swapper/222:17:432
986948991814,2cyclictest0-21swapper/220:56:152
986948991814,2cyclictest0-21swapper/200:38:022
98694899180,16cyclictest1025347-21ps19:47:472
9821242183,9sleep30-21swapper/319:05:183
986948991713,2cyclictest0-21swapper/200:22:582
98694899171,12cyclictest1129222-21apt-get21:32:422
13084802162,9sleep30-21swapper/300:32:423
11679442155,6sleep30-21swapper/322:08:003
12874992142,8sleep30-21swapper/300:07:543
11702712145,5sleep30-21swapper/322:12:493
10580542142,8sleep30-21swapper/320:17:533
9885892133,7sleep30-21swapper/319:12:483
13040282132,7sleep30-21swapper/300:27:483
12981852132,6sleep30-21swapper/300:20:023
12731292132,6sleep30-21swapper/323:55:023
12636632132,7sleep30-21swapper/323:47:393
12188282132,7sleep30-21swapper/323:02:413
11129882132,7sleep30-21swapper/321:12:543
10730422132,7sleep30-21swapper/320:32:583
13179012120,7sleep30-21swapper/300:40:003
12945202122,6sleep30-21swapper/300:17:493
12787312122,6sleep30-21swapper/300:02:403
12722032122,6sleep30-21swapper/323:52:493
12565032122,6sleep30-21swapper/323:37:523
12483382122,6sleep30-21swapper/323:30:023
12435972122,6sleep30-21swapper/323:25:163
12386552122,6sleep30-21swapper/323:22:433
12340072122,6sleep30-21swapper/323:17:463
12252582123,5sleep30-21swapper/323:07:513
12138712122,6sleep30-21swapper/322:57:393
12037742122,6sleep30-21swapper/322:47:403
11889062122,6sleep30-21swapper/322:32:443
11835272122,5sleep30-21swapper/322:25:013
11747362124,5sleep30-21swapper/322:17:473
11592042123,5sleep30-21swapper/322:02:423
11338402122,6sleep30-21swapper/321:35:013
11338402122,6sleep30-21swapper/321:35:013
11278732123,5sleep30-21swapper/321:27:513
11217722122,6sleep30-21swapper/321:22:493
10981182122,6sleep30-21swapper/320:57:543
10926432122,6sleep30-21swapper/320:52:533
10837982122,5sleep30-21swapper/320:45:013
10834062122,6sleep30-21swapper/320:43:173
10644682122,6sleep30-21swapper/320:27:443
10588632122,6sleep30-21swapper/320:20:023
10499642122,6sleep30-21swapper/320:12:473
10402922122,6sleep30-21swapper/320:02:483
10341232122,5sleep30-21swapper/319:55:023
10298332122,6sleep30-21swapper/319:52:453
10233822123,6sleep30-21swapper/319:42:503
10090702122,6sleep30-21swapper/319:30:073
10029122122,6sleep30-21swapper/319:22:513
9918582112,5sleep30-21swapper/319:15:013
12884682112,5sleep30-21swapper/300:10:023
12590292112,6sleep30-21swapper/323:42:463
12285292112,6sleep30-21swapper/323:10:113
11985872112,5sleep30-21swapper/322:40:023
11941142112,5sleep30-21swapper/322:37:453
11789432112,6sleep30-21swapper/322:22:123
11487022112,5sleep30-21swapper/321:50:023
11445602112,5sleep30-21swapper/321:47:453
11399942112,5sleep30-21swapper/321:42:483
11290082112,6sleep30-21swapper/321:30:163
11140722112,6sleep30-21swapper/321:16:563
11041112112,6sleep30-21swapper/321:05:483
10990962112,4sleep30-21swapper/321:00:023
10738702111,5sleep30-21swapper/320:35:023
10481282111,6sleep30-21swapper/320:07:543
10143482113,5sleep30-21swapper/319:35:563
10082982112,5sleep30-21swapper/319:28:013
10082982112,5sleep30-21swapper/319:28:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional