You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 10:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Dec 17, 2025 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
118746121570,5sleep30-21swapper/321:19:043
13793822710,3chrt0-21swapper/000:34:050
1059397995951,5cyclictest1049746-21kworker/u8:1+flush-8:019:10:010
12611752530,4chrt0-21swapper/122:34:051
10602562530,3sleep3575-21kworker/3:2+mm_percpu_wq19:14:033
1059397995244,5cyclictest1111019-21latency_hist20:00:000
1059397995244,5cyclictest1111019-21latency_hist20:00:000
12042372510,6sleep30-21swapper/321:34:093
1059400994941,6cyclictest1135677-21latency_hist20:25:011
1059400994843,4cyclictest1100938-21kworker/u8:0+flush-8:019:54:151
1059400994841,5cyclictest1075431-21kworker/u8:1+flush-8:020:39:141
1059400994741,4cyclictest221735-21kworker/u8:3+flush-8:019:14:011
1059400994640,5cyclictest1155263-21kworker/u8:0+flush-8:020:45:001
1059397994634,9cyclictest1064302-21latency_hist19:15:010
1059400994541,3cyclictest1075431-21kworker/u8:1+events_unbound19:45:001
1059400994540,4cyclictest1185346-21kworker/u8:0+flush-8:022:04:021
1059400994540,4cyclictest1185346-21kworker/u8:0+flush-8:022:04:011
1059400994537,6cyclictest1229534-21latency_hist22:00:001
1059397994536,6cyclictest1328536-21latency_hist23:40:010
1059400994437,5cyclictest1234711-21kworker/u8:2+flush-8:023:34:111
1059400994435,6cyclictest1249251-21latency_hist22:20:021
1059400994237,3cyclictest1263943-21kworker/u8:3+events_unbound23:39:041
1059400994237,3cyclictest1160694-21kworker/u8:1+flush-8:021:49:151
1059400994237,3cyclictest1075431-21kworker/u8:1+events_unbound19:49:171
1059400994236,4cyclictest1263943-21kworker/u8:3+flush-8:022:59:151
1059400994134,5cyclictest1160694-21kworker/u8:1+flush-8:021:04:181
1059397994132,6cyclictest1313466-21latency_hist23:25:010
1059400994031,7cyclictest1165887-21kworker/u8:3+flush-8:021:54:111
1059400994031,6cyclictest1076057-21latency_hist19:25:021
1059400993935,3cyclictest1155263-21kworker/u8:0+flush-8:020:48:581
1059400993934,4cyclictest1263943-21kworker/u8:3+flush-8:023:54:141
1059400993933,4cyclictest1263943-21kworker/u8:3+flush-8:023:19:151
1059400993933,4cyclictest1160694-21kworker/u8:1+flush-8:022:29:021
1059397993928,8cyclictest1120918-21latency_hist20:10:010
12503022380,3sleep3575-21kworker/3:2+events22:24:053
11343652380,2sleep3471rcuc/320:24:073
1059400993832,5cyclictest1348297-21kworker/u8:1+flush-8:000:19:091
1059400993832,5cyclictest1348297-21kworker/u8:1+flush-8:000:19:091
1059400993733,3cyclictest1160694-21kworker/u8:1+flush-8:022:09:181
1059400993731,4cyclictest1001827-21kworker/u8:2+flush-8:019:34:091
1059400993730,6cyclictest1100938-21kworker/u8:0+flush-8:020:14:131
1059400993729,6cyclictest1234711-21kworker/u8:2+flush-8:023:14:011
1059400993729,6cyclictest1075431-21kworker/u8:1+flush-8:019:59:101
1059400993729,6cyclictest1075431-21kworker/u8:1+flush-8:019:59:101
1059400993725,9cyclictest1348271-21awk00:00:001
1059397993710,22cyclictest1140599-21kworker/0:0+events22:48:590
1059400993632,2cyclictest1373133-21kworker/u8:3+flush-8:000:39:061
1059400993630,5cyclictest1348297-21kworker/u8:1+flush-8:000:14:151
1059400993629,5cyclictest1348297-21kworker/u8:1+flush-8:000:04:141
105939799367,24cyclictest1140599-21kworker/0:0+events21:03:000
10591982363,9sleep10-21swapper/119:09:371
10950692350,2sleep3575-21kworker/3:2-events19:44:073
1059400993531,3cyclictest1160694-21kworker/u8:1+flush-8:021:19:031
1059400993530,3cyclictest1379346-21irqrtprio00:34:051
1059400993529,5cyclictest1234711-21kworker/u8:2+flush-8:023:49:011
1059400993526,6cyclictest278-21systemd-journal21:30:011
1059400993524,8cyclictest1283978-21latency_hist22:55:011
1059400993524,8cyclictest1091105-21latency_hist19:40:011
105939799357,24cyclictest1140599-21kworker/0:0+events20:36:550
1059397993528,4cyclictest1185346-21kworker/u8:0+events_unbound22:54:240
1059397993526,7cyclictest1160327-21cp20:50:010
1059397993524,8cyclictest278-21systemd-journal22:55:520
1059400993430,3cyclictest1185346-21kworker/u8:0+events_unbound21:40:001
1059400993429,4cyclictest1075431-21kworker/u8:1+flush-8:020:04:031
105939799348,21cyclictest1140599-21kworker/0:0+events00:06:150
1059397993429,3cyclictest1293819-21systemd-run23:05:000
1059397993427,5cyclictest1125823-21latency_hist20:15:010
105939799342,31cyclictest1076081-21kworker/0:1+events20:29:510
105939799341,27cyclictest1140599-21kworker/0:0+events20:43:270
1059405993325,6cyclictest278-21systemd-journal20:05:002
1059400993329,2cyclictest1318386-21kworker/u8:1+flush-8:023:44:011
1059400993328,4cyclictest1001827-21kworker/u8:2+flush-8:020:34:061
1059400993326,5cyclictest1313341-21unixbench_singl23:24:151
1059397993327,4cyclictest1258953-21grep22:29:170
1059397993325,6cyclictest1263984-21apt-get22:35:000
105939799332,29cyclictest1140599-21kworker/0:0+events22:18:590
1059405993228,2cyclictest1141171-21aten2_r5power_e20:33:592
1059400993226,4cyclictest221735-21kworker/u8:3+flush-8:019:29:141
1059400993226,4cyclictest1348297-21kworker/u8:1+events_unbound00:09:061
1059400993225,5cyclictest1130654-21kworker/u8:3+flush-8:020:29:101
105939799329,22cyclictest1140599-21kworker/0:0+events21:59:150
105939799329,18cyclictest1140599-21kworker/0:0+events21:35:150
105939799328,22cyclictest1076081-21kworker/0:1+events20:24:110
105939799323,27cyclictest1140599-21kworker/0:0+events21:33:590
1059397993222,7cyclictest1264424-21base6422:35:010
1059400993127,2cyclictest1290163-21irqrtprio23:04:061
1059400993124,5cyclictest1160694-21kworker/u8:1+events_unbound22:14:141
1059400993123,6cyclictest1160694-21kworker/u8:1+flush-8:021:43:581
1059400993121,8cyclictest1169655-21ntpq20:59:101
105939799317,22cyclictest1076081-21kworker/0:1+events19:34:110
105939799317,20cyclictest1140599-21kworker/0:0+events00:10:590
105939799312,27cyclictest1140599-21kworker/0:0+events21:49:070
105939799311,28cyclictest1140599-21kworker/0:0+events22:04:110
105939799311,28cyclictest1140599-21kworker/0:0+events22:04:110
1059400993025,4cyclictest1234711-21kworker/u8:2+events_unbound23:09:001
1059400993025,3cyclictest1196464-21irqrtprio21:29:041
1059400993025,3cyclictest1160694-21kworker/u8:1+flush-8:022:24:081
1059400993024,4cyclictest1001827-21kworker/u8:2+flush-8:020:08:591
1059400993023,5cyclictest1318455-21cp23:30:011
1059400993020,8cyclictest1130724-21latency_hist20:20:011
105939799307,21cyclictest1140599-21kworker/0:0+events23:14:110
105939799303,21cyclictest1076081-21kworker/0:1+events19:50:470
105939799302,27cyclictest1076081-21kworker/0:1+events19:42:550
105939799301,28cyclictest1076081-21kworker/0:1+events20:19:070
105939799301,27cyclictest1140599-21kworker/0:0+events22:24:070
105939799300,28cyclictest1140599-21kworker/0:0+events21:44:110
12138482290,3sleep3471rcuc/321:44:083
1059405992924,4cyclictest1349145-21fschecks_time00:04:022
1059405992924,3cyclictest1372952-21unixbench_multi00:24:172
1059400992924,4cyclictest1060232-21kworker/u8:0+events_unbound19:15:011
1059400992922,5cyclictest1001827-21kworker/u8:2+flush-8:020:54:131
105939799297,21cyclictest1140599-21kworker/0:0+events23:33:190
105939799297,18cyclictest1140599-21kworker/0:0+events20:55:270
105939799294,24cyclictest1076081-21kworker/0:1+events19:47:110
1059397992924,3cyclictest1071150-21turbostat.cron19:20:000
1059405992824,3cyclictest1348268-21idleruntime-cro00:00:002
1059405992824,2cyclictest1136537-21fschecks_time20:29:012
1059405992823,3cyclictest1204854-21unixbench_multi21:34:172
1059405992822,4cyclictest1278857-21unixbench_multi22:49:162
1059405992820,5cyclictest278-21systemd-journal23:45:002
1059400992823,3cyclictest1279018-21turbostat.cron22:50:011
1059400992821,5cyclictest1358272-21kworker/u8:0+flush-8:000:29:131
105939799289,15cyclictest1140599-21kworker/0:0+events21:06:070
105939799286,21cyclictest1140599-21kworker/0:0+events22:13:390
105939799286,18cyclictest1076081-21kworker/0:1+events19:35:470
1059397992824,2cyclictest1-21systemd23:45:010
1059397992810,16cyclictest1044444-21kworker/0:0+events19:23:590
105939799280,27cyclictest1140599-21kworker/0:0+events22:07:590
1059405992723,3cyclictest1176057-21aten2_r5power_c21:08:582
1059405992722,3cyclictest1186193-21fschecks_time21:19:002
1059405992721,4cyclictest1363155-21unixbench_singl00:14:162
1059400992723,3cyclictest1001827-21kworker/u8:2+events_unbound21:14:011
1059400992723,2cyclictest0-21swapper/100:24:141
1059397992721,4cyclictest1372955-21unixbench_multi00:24:170
1059397992719,4cyclictest0-21swapper/021:18:570
105939799271,25cyclictest1140599-21kworker/0:0+events21:28:510
1059405992622,3cyclictest1338957-21aten2_r5power_c23:53:572
1059405992622,3cyclictest1155308-21cron20:45:002
1059405992622,2cyclictest1293783-21cron23:05:002
1059405992621,3cyclictest1106670-21aten2_r5power_c19:58:582
1059405992621,3cyclictest1106670-21aten2_r5power_c19:58:582
1059400992622,3cyclictest1160694-21kworker/u8:1+flush-8:021:23:591
1059400992622,3cyclictest1160694-21kworker/u8:1+events_unbound22:44:011
1059400992620,4cyclictest1234711-21kworker/u8:2+flush-8:022:39:131
105939799268,17cyclictest1140599-21kworker/0:0+events23:08:590
105939799268,16cyclictest1140599-21kworker/0:0+events00:39:030
105939799267,18cyclictest1140599-21kworker/0:0+events21:22:270
105939799267,15cyclictest1140599-21kworker/0:0+events00:00:190
105939799266,19cyclictest1140599-21kworker/0:0+events23:46:190
105939799265,20cyclictest1076081-21kworker/0:1+events20:03:310
105939799262,22cyclictest0-21swapper/023:54:140
105939799261,24cyclictest1140599-21kworker/0:0+events21:53:470
105939799261,23cyclictest1140599-21kworker/0:0+events20:50:010
1059405992522,2cyclictest1288694-21unixbench_multi22:59:162
1059405992521,2cyclictest1131876-21irqcore20:24:052
1059405992521,2cyclictest1087047-21fschecks_time19:39:032
1059405992520,3cyclictest1303611-21sh23:15:002
1059405992517,6cyclictest1170429-21cp21:00:002
105939799256,17cyclictest1140599-21kworker/0:0+events21:14:110
105939799256,14cyclictest1140599-21kworker/0:0+events23:15:070
105939799252,22cyclictest1140599-21kworker/0:0+events22:43:590
105939799252,22cyclictest1140599-21kworker/0:0+events00:17:230
105939799252,22cyclictest1140599-21kworker/0:0+events00:17:230
105939799251,23cyclictest1140599-21kworker/0:0+events20:33:240
1059405992421,2cyclictest1309190-21aten2_r5power_p23:23:582
1059405992420,2cyclictest1245082-21cpuspeed_turbos22:18:592
1059405992419,3cyclictest1105889-21dpkg19:55:002
1059400992419,3cyclictest0-21swapper/121:09:061
105939799249,14cyclictest1140599-21kworker/0:0+events00:28:510
105939799240,23cyclictest1140599-21kworker/0:0+events23:28:350
13047952230,2sleep2371rcuc/223:19:042
1059405992320,2cyclictest1250038-21cpuspeed_turbos22:24:012
1059405992319,2cyclictest1071317-21cat19:20:012
105939799238,14cyclictest1140599-21kworker/0:0+events23:56:150
105939799233,19cyclictest1044444-21kworker/0:0+events19:25:030
1059405992219,2cyclictest1263971-21cron22:35:002
105940599221,19cyclictest1242984-21cut22:14:062
1059405992117,2cyclictest0-21swapper/219:35:002
1059405992116,3cyclictest0-21swapper/200:40:012
1059405992017,2cyclictest1378658-21aten2_r5power_c00:34:002
1059405992017,2cyclictest1092022-21fschecks_time19:44:022
1059405992012,6cyclictest1122015-21sed20:14:052
1059405992012,6cyclictest1097018-21awk19:49:032
1059405992012,6cyclictest1081144-21sed19:30:012
1059405992012,5cyclictest1130415-21threads20:19:172
10592192204,10sleep20-21swapper/219:09:532
1059405991915,3cyclictest1225225-21aten2_r5power_c21:58:592
1059405991915,2cyclictest0-21swapper/223:10:002
1059405991914,3cyclictest1222364-21kthreadcore21:54:072
1059405991914,3cyclictest0-21swapper/200:10:002
1059405991912,5cyclictest0-21swapper/220:54:062
1059405991911,6cyclictest1258337-21sed22:29:082
105940599190,17cyclictest1230851-21sed22:04:042
105940599190,17cyclictest1230851-21sed22:04:042
10547512193,9sleep30-21swapper/319:06:493
105940599183,3cyclictest421rcuog/219:23:572
1059405991815,2cyclictest1334074-21aten2_r5power_e23:49:002
1059405991814,2cyclictest0-21swapper/223:39:142
1059405991814,2cyclictest0-21swapper/223:30:002
1059405991814,2cyclictest0-21swapper/221:50:002
1059405991814,2cyclictest0-21swapper/219:15:002
1059405991813,3cyclictest0-21swapper/221:15:002
1059405991810,6cyclictest1175225-21cat21:04:172
105940599178,7cyclictest1198818-21tr21:29:072
1059405991713,2cyclictest0-21swapper/223:34:152
1059405991713,2cyclictest0-21swapper/221:24:012
1059405991713,2cyclictest0-21swapper/200:29:012
1059405991713,2cyclictest0-21swapper/200:19:142
1059405991713,2cyclictest0-21swapper/200:19:142
1059405991711,4cyclictest1270450-21tr22:44:042
10965812162,9sleep30-21swapper/319:48:583
105940599168,6cyclictest1155970-21cut20:48:572
105940599162,2cyclictest0-21swapper/222:06:442
105940599162,13cyclictest0-21swapper/221:41:162
105940599162,13cyclictest0-21swapper/221:35:472
1059405991613,2cyclictest0-21swapper/222:51:492
1059405991613,2cyclictest0-21swapper/222:35:012
1059405991611,3cyclictest0-21swapper/220:39:052
1059405991611,3cyclictest0-21swapper/220:09:062
13682382132,6sleep30-21swapper/300:20:013
13433242132,6sleep30-21swapper/323:55:013
13241672132,7sleep30-21swapper/323:38:563
12639702132,7sleep30-21swapper/322:35:003
12148682133,6sleep30-21swapper/321:45:013
11659542132,7sleep30-21swapper/320:58:593
11246102132,7sleep30-21swapper/320:14:093
11110862132,6sleep30-21swapper/320:00:013
11065292132,7sleep30-21swapper/319:57:523
11065292132,7sleep30-21swapper/319:57:523
13835202122,6sleep30-21swapper/300:38:583
13823832122,6sleep30-21swapper/300:34:133
13740952122,6sleep30-21swapper/300:29:033
13538652122,6sleep30-21swapper/300:07:533
13531732120,8sleep30-21swapper/300:05:003
13401582122,6sleep30-21swapper/323:54:053
13183712122,5sleep30-21swapper/323:30:013
12891712122,6sleep30-21swapper/323:00:523
12373932122,6sleep30-21swapper/322:09:103
12338822122,6sleep30-21swapper/322:04:113
12338822122,6sleep30-21swapper/322:04:113
12092652122,6sleep30-21swapper/321:39:113
11908162122,6sleep30-21swapper/321:23:593
11809822122,6sleep30-21swapper/321:14:003
11755012122,6sleep30-21swapper/321:05:013
11652242123,5sleep30-21swapper/320:54:183
11602172122,7sleep30-21swapper/320:50:003
11535632122,6sleep30-21swapper/320:44:113
11376642121,7sleep30-21swapper/320:29:063
10858252122,6sleep30-21swapper/319:34:173
10721002122,6sleep30-21swapper/319:24:023
10650112123,6sleep30-21swapper/319:15:033
13675642112,5sleep30-21swapper/300:19:093
13675642112,5sleep30-21swapper/300:19:083
13588102112,6sleep30-21swapper/300:13:193
13338062112,6sleep30-21swapper/323:46:343
13289732112,5sleep30-21swapper/323:42:373
13138622112,6sleep30-21swapper/323:27:163
13088192112,6sleep30-21swapper/323:20:343
13039972112,5sleep30-21swapper/323:17:013
13034062112,5sleep30-21swapper/323:14:163
12943522112,5sleep30-21swapper/323:09:003
12842002112,6sleep30-21swapper/322:55:033
12790362112,5sleep30-21swapper/322:50:023
12784652112,5sleep30-21swapper/322:49:133
12695402112,6sleep30-21swapper/322:41:553
12644542112,6sleep30-21swapper/322:35:133
12445602112,5sleep30-21swapper/322:15:223
12394232112,5sleep30-21swapper/322:10:013
12200052112,6sleep30-21swapper/321:50:433
12000602112,5sleep30-21swapper/321:29:533
11710802112,6sleep30-21swapper/321:03:533
11458442112,6sleep30-21swapper/320:36:563
11450832112,5sleep30-21swapper/320:34:163
11262652112,6sleep30-21swapper/320:17:513
11162032112,6sleep30-21swapper/320:05:033
11013232112,6sleep30-21swapper/319:52:233
10866572112,5sleep30-21swapper/319:38:513
10763562112,5sleep30-21swapper/319:26:003
12544472102,5sleep30-21swapper/322:25:543
12248942102,5sleep30-21swapper/321:55:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional