You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 19:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Dec 02, 2025 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17369672800,3chrt0-21swapper/012:30:010
14501012770,5sleep30-21swapper/307:41:133
1417146996660,5cyclictest1538384-21kworker/u8:2+flush-8:009:11:261
1417146996358,3cyclictest1463813-21kworker/u8:3+flush-8:008:31:241
1417146996157,3cyclictest1498015-21kworker/u8:0+flush-8:008:51:211
1417144996150,4cyclictest1741723-21kworker/u8:0+events_unbound12:36:220
1417144995953,4cyclictest32602-21kworker/u8:1+events_unbound07:36:310
1417146995853,3cyclictest1617272-21kworker/u8:2+events_unbound11:11:261
1417144995853,3cyclictest1463813-21kworker/u8:3+events_unbound08:00:010
1417144995852,4cyclictest1691952-21kworker/u8:1+events_unbound12:06:220
1417144995852,4cyclictest1503715-21kworker/u8:2+events_unbound08:41:210
1417146995752,4cyclictest32602-21kworker/u8:1+flush-8:008:36:251
1417146995752,3cyclictest1375309-21kworker/u8:2+events_unbound07:15:051
1417144995752,3cyclictest1691952-21kworker/u8:1+events_unbound11:56:250
1417144995752,3cyclictest1617272-21kworker/u8:2+events_unbound12:31:080
1417144995751,4cyclictest1707275-21kworker/u8:0+events_unbound12:01:200
1417144995748,3cyclictest1617272-21kworker/u8:2+events_unbound11:06:100
1417144995651,4cyclictest1412045-21kworker/u8:0+flush-8:007:41:220
16050982550,5sleep30-21swapper/310:16:163
1417144995551,3cyclictest32602-21kworker/u8:1+flush-8:007:16:240
1417144995550,3cyclictest32602-21kworker/u8:1+events_unbound07:26:200
1417144995544,8cyclictest1641635-21ntpq10:51:180
1417146995450,3cyclictest1412045-21kworker/u8:0+events_unbound07:41:211
1417144995449,4cyclictest1523533-21kworker/u8:1+events_unbound09:01:220
1417144995442,4cyclictest1547797-21kworker/u8:1+events_unbound10:46:220
1417146995346,5cyclictest1558377-21kworker/u8:2+events_unbound09:41:271
1417146995346,4cyclictest1453902-21kworker/u8:2+flush-8:007:51:171
1417146995346,3cyclictest1667737-21kworker/u8:0+events_unbound11:41:261
1417144995350,2cyclictest1617272-21kworker/u8:2+flush-8:012:21:260
1417144995346,5cyclictest1617272-21kworker/u8:2+flush-8:010:56:220
1417146995248,3cyclictest32602-21kworker/u8:1+events_unbound07:11:131
1417146995248,3cyclictest32602-21kworker/u8:1+events_unbound07:11:131
1417146995247,4cyclictest1412045-21kworker/u8:0+events_unbound07:21:211
1417146995246,4cyclictest1741723-21kworker/u8:0+events_unbound12:36:271
1417146995245,5cyclictest1547797-21kworker/u8:1+flush-8:010:11:191
1417144995246,4cyclictest1412045-21kworker/u8:0+events_unbound08:01:240
1417146995147,2cyclictest1617272-21kworker/u8:2+events_unbound10:56:191
1417146995145,5cyclictest1691952-21kworker/u8:1+flush-8:012:01:171
1417144995146,4cyclictest1652131-21kworker/u8:3+flush-8:011:16:250
1417144995146,4cyclictest1547797-21kworker/u8:1+flush-8:010:26:270
1417144995146,4cyclictest1547797-21kworker/u8:1+events_unbound10:06:230
1417144995146,4cyclictest1463813-21kworker/u8:3+flush-8:010:21:270
1417144995143,7cyclictest1691952-21kworker/u8:1+flush-8:011:51:200
1417146995046,3cyclictest1488597-21kworker/u8:2+flush-8:008:21:221
1417146995045,4cyclictest1547797-21kworker/u8:1+flush-8:010:26:251
1417146995044,4cyclictest1652131-21kworker/u8:3+flush-8:011:16:261
1417146995044,3cyclictest1617272-21kworker/u8:2+flush-8:012:11:191
1417146995040,4cyclictest1667737-21kworker/u8:0+flush-8:011:31:221
1417144995046,3cyclictest1498015-21kworker/u8:0+flush-8:008:56:270
1417144995045,4cyclictest1523533-21kworker/u8:1+flush-8:009:06:190
1417144995045,3cyclictest1498015-21kworker/u8:0+flush-8:009:21:120
1417144995044,4cyclictest1538384-21kworker/u8:2+events_unbound09:11:210
1417146994945,3cyclictest1547797-21kworker/u8:1+flush-8:011:21:261
1417144994944,3cyclictest1547797-21kworker/u8:1+flush-8:011:21:150
1417146994844,3cyclictest32602-21kworker/u8:1+events_unbound08:01:061
1417146994844,3cyclictest1691952-21kworker/u8:1+flush-8:012:06:211
1417146994843,4cyclictest1498015-21kworker/u8:0+events_unbound09:21:251
1417146994842,5cyclictest1547797-21kworker/u8:1+flush-8:009:51:251
1417146994842,5cyclictest1463813-21kworker/u8:3+events_unbound09:46:241
1417146994841,6cyclictest1463813-21kworker/u8:3+flush-8:010:21:171
1417144994844,3cyclictest32602-21kworker/u8:1+flush-8:008:16:130
1417144994843,4cyclictest1538384-21kworker/u8:2+events_unbound09:16:150
1417144994843,4cyclictest1412045-21kworker/u8:0+flush-8:007:21:130
1417144994843,3cyclictest1617272-21kworker/u8:2+flush-8:011:11:280
1417144994842,5cyclictest1498015-21kworker/u8:0+events_unbound08:51:210
1417146994743,3cyclictest1375309-21kworker/u8:2+events_unbound07:31:241
1417146994742,3cyclictest1498015-21kworker/u8:0+flush-8:009:31:221
1417146994741,4cyclictest1617272-21kworker/u8:2+flush-8:011:36:221
1417146994739,5cyclictest282-21systemd-journal12:26:121
1417146994642,3cyclictest1727289-21kworker/u8:3+events_unbound12:21:101
1417146994641,4cyclictest1503715-21kworker/u8:2+flush-8:008:41:221
1417144994642,3cyclictest1667737-21kworker/u8:0+events_unbound11:41:220
1417144994639,5cyclictest1492457-21ntpq08:21:170
1417146994540,4cyclictest1412045-21kworker/u8:0+events_unbound08:16:231
1417144994541,3cyclictest1617272-21kworker/u8:2+flush-8:011:26:170
1417144994541,3cyclictest1547797-21kworker/u8:1+flush-8:009:46:140
1417144994541,3cyclictest1498015-21kworker/u8:0+events_unbound08:46:260
1417144994540,4cyclictest1677118-21kworker/u8:3+flush-8:011:46:140
1417144994539,4cyclictest1617272-21kworker/u8:2+flush-8:012:16:250
1417144994539,4cyclictest1547797-21kworker/u8:1+events_unbound10:05:010
1417144994539,4cyclictest1498015-21kworker/u8:0+events_unbound09:36:220
1417144994538,5cyclictest1412045-21kworker/u8:0+events_unbound07:46:200
1417146994438,4cyclictest1617272-21kworker/u8:2+flush-8:011:46:221
1417146994438,4cyclictest1547797-21kworker/u8:1+flush-8:010:31:271
1417146994435,5cyclictest1463813-21kworker/u8:3+events_unbound09:26:201
1417144994440,3cyclictest1547797-21kworker/u8:1+flush-8:010:31:270
1417144994439,4cyclictest1547797-21kworker/u8:1+events_unbound10:11:210
1417144994438,4cyclictest32602-21kworker/u8:1+events_unbound08:36:270
1417144994433,8cyclictest1582026-21ntpq09:51:190
1417146994338,4cyclictest1596956-21kworker/u8:0+flush-8:010:36:211
1417146994337,4cyclictest1463813-21kworker/u8:3+flush-8:009:56:171
1417144994339,3cyclictest1667737-21kworker/u8:0+flush-8:011:31:240
1417144994339,3cyclictest1617272-21kworker/u8:2+flush-8:011:01:200
1417144994339,3cyclictest1547797-21kworker/u8:1+events_unbound09:41:340
1417144994339,2cyclictest1617272-21kworker/u8:2+events_unbound12:11:230
1417144994337,4cyclictest1558377-21kworker/u8:2+flush-8:009:31:180
1417144994335,6cyclictest1463813-21kworker/u8:3+events_unbound08:31:040
1417146994236,4cyclictest1513976-21apt-get08:46:071
1417144994238,3cyclictest32602-21kworker/u8:1+events_unbound08:06:150
1417144994238,3cyclictest1596956-21kworker/u8:0+flush-8:010:36:150
1417144994238,3cyclictest1498015-21kworker/u8:0+flush-8:009:26:180
1417144994236,5cyclictest1488597-21kworker/u8:2+events_unbound08:26:190
15724502410,2sleep3471rcuc/309:41:333
1417146994136,4cyclictest1691952-21kworker/u8:1+events_unbound11:56:131
1417146994136,4cyclictest1498015-21kworker/u8:0+flush-8:009:36:141
1417146994135,4cyclictest1547797-21kworker/u8:1+flush-8:010:46:231
1417146994035,4cyclictest32602-21kworker/u8:1+events_unbound08:06:231
1417146994035,3cyclictest1617272-21kworker/u8:2+flush-8:011:01:111
1417146994035,3cyclictest1463813-21kworker/u8:3+flush-8:010:16:161
1417144994036,3cyclictest1596956-21kworker/u8:0+events_unbound10:41:230
1417146993935,3cyclictest1617272-21kworker/u8:2+flush-8:011:26:221
1417146993934,4cyclictest1596956-21kworker/u8:0+flush-8:010:41:191
1417146993934,4cyclictest1488597-21kworker/u8:2+flush-8:008:26:181
1417144993935,3cyclictest32602-21kworker/u8:1+events_unbound07:11:210
1417144993935,3cyclictest32602-21kworker/u8:1+events_unbound07:11:200
1417146993834,3cyclictest32602-21kworker/u8:1+flush-8:007:36:221
1417146993833,4cyclictest1463813-21kworker/u8:3+flush-8:010:06:161
1417146993732,4cyclictest32602-21kworker/u8:1+flush-8:007:56:291
1417146993732,4cyclictest1523533-21kworker/u8:1+flush-8:009:01:141
1417146993729,6cyclictest282-21systemd-journal07:48:121
1417144993733,3cyclictest1617272-21kworker/u8:2+events_unbound11:36:250
1417144993733,3cyclictest1463813-21kworker/u8:3+events_unbound09:56:210
1417144993732,3cyclictest1412045-21kworker/u8:0+events_unbound07:31:320
1417149993629,5cyclictest1529111-21cut09:01:102
1417144993632,3cyclictest1463813-21kworker/u8:3+flush-8:010:16:260
14167862364,9sleep10-21swapper/107:08:051
14167862364,9sleep10-21swapper/107:08:051
1417146993530,4cyclictest32602-21kworker/u8:1+flush-8:007:26:091
1417146993526,6cyclictest1727044-21latency_hist12:20:011
1417144993529,4cyclictest1412045-21kworker/u8:0+events_unbound08:11:100
15650452340,6sleep3451irq_work/309:36:153
1417146993429,3cyclictest1617272-21kworker/u8:2+events_unbound11:06:281
1417146993428,4cyclictest1498015-21kworker/u8:0+flush-8:008:56:211
1417149993328,3cyclictest1678300-21sed11:31:132
1417149993327,4cyclictest32602-21kworker/u8:1+flush-8:008:21:212
1417146993329,3cyclictest1463813-21kworker/u8:3+events_unbound10:01:261
1417146993227,3cyclictest1596956-21kworker/u8:0+events_unbound10:53:491
1417149993122,7cyclictest282-21systemd-journal11:00:122
1417144993127,3cyclictest1453902-21kworker/u8:2+flush-8:007:51:140
1417149993021,7cyclictest282-21systemd-journal11:51:122
1417146993025,4cyclictest1727289-21kworker/u8:3+flush-8:012:31:591
1417144993013,12cyclictest1416949-21latency_hist07:10:000
1417144993013,12cyclictest1416949-21latency_hist07:10:000
1417149992925,3cyclictest405-21dbus-daemon08:00:002
1417146992925,3cyclictest1617272-21kworker/u8:2+flush-8:011:51:151
1417149992823,3cyclictest1428517-21unixbench_singl07:16:242
1417149992821,5cyclictest1493654-21apt-get08:26:042
1417149992820,6cyclictest1747083-21gpgv12:40:012
1417146992824,3cyclictest32602-21kworker/u8:1+events_unbound08:11:141
1417149992723,2cyclictest1478838-21aten2_r5power_c08:11:082
1417149992722,3cyclictest1607341-21unixbench_singl10:16:272
1417149992716,9cyclictest1731224-21ntpq12:21:222
1417149992619,5cyclictest1613162-21tr10:26:102
1417149992522,2cyclictest1429243-21aten2_r5power_c07:21:072
1417146992521,3cyclictest1538384-21kworker/u8:2+flush-8:009:16:191
16670092240,0sleep2371rcuc/211:16:272
1417149992421,2cyclictest1444050-21aten2_r5power_c07:36:092
1417149992420,2cyclictest1538728-21aten2_r5power_c09:11:082
1417149992418,4cyclictest1512782-21journal-offline08:41:192
1417146992420,3cyclictest1523533-21kworker/u8:1+flush-8:009:06:151
15423552230,2sleep3481ktimers/309:11:193
1417149992320,2cyclictest1618152-21fschecks_count10:31:132
1417149992320,2cyclictest1572721-21unixbench_singl09:41:342
1417149992320,2cyclictest1454320-21fschecks_time07:46:082
1417149992319,3cyclictest0-21swapper/212:20:002
1417149992319,2cyclictest1633215-21cpuspeed_turbos10:46:082
1417149992318,4cyclictest1602359-21unixbench_multi10:11:262
1417149992310,10cyclictest1712032-21awk12:05:002
141714999222,14cyclictest1702444-21apt-get11:56:072
1417149992219,2cyclictest1533868-21aten2_r5power_v09:06:082
1417149992218,2cyclictest1712390-21aten2_r5power_c12:06:092
1417149992218,2cyclictest1638022-21aten2_r5power_p10:51:072
1417149992218,2cyclictest1593186-21aten2_r5power_e10:06:082
1417149992218,2cyclictest1499151-21fschecks_time08:31:092
1417149992218,2cyclictest0-21swapper/211:26:122
1417149992214,5cyclictest282-21systemd-journal11:20:012
1417149992213,6cyclictest1657803-21base6411:10:002
1417149992213,6cyclictest1508866-21cp08:40:002
1417149992116,3cyclictest1588545-21tune2fs10:01:082
1417149992115,4cyclictest1612600-21cron10:25:002
1417149992112,7cyclictest282-21systemd-journal10:00:002
14122922219,9sleep20-21swapper/207:05:332
14122922219,9sleep20-21swapper/207:05:322
141714999207,4cyclictest0-21swapper/209:46:222
1417149992016,2cyclictest1483799-21aten2_r5power_e08:16:072
1417149992012,6cyclictest1691340-21awk11:41:202
141714999200,18cyclictest1555170-21tr09:26:142
141714999192,13cyclictest1417344-21apt-get07:11:052
141714999192,13cyclictest1417344-21apt-get07:11:052
1417149991915,2cyclictest0-21swapper/208:55:002
1417149991915,2cyclictest0-21swapper/208:06:152
1417149991915,2cyclictest0-21swapper/207:51:072
1417149991914,4cyclictest1632644-21idleruntime-cro10:45:002
1417149991913,4cyclictest1741524-21unixbench_singl12:31:242
1417149991911,6cyclictest282-21systemd-journal09:35:002
141714999191,12cyclictest1543653-21apt-get09:16:072
1417149991815,2cyclictest1548644-21aten2_r5power_e09:21:062
1417149991815,2cyclictest0-21swapper/211:11:292
1417149991813,4cyclictest0-21swapper/207:41:252
1417149991813,3cyclictest1721004-21ntpq12:11:192
1417149991813,3cyclictest0-21swapper/211:46:162
14159422183,8sleep30-21swapper/307:06:183
14159422183,8sleep30-21swapper/307:06:183
141714999178,7cyclictest1565350-21tr09:36:152
141714999177,8cyclictest1578764-21awk09:51:122
141714999177,2cyclictest0-21swapper/210:56:212
141714999173,8cyclictest1437994-21ntpq07:26:212
1417149991713,2cyclictest0-21swapper/212:26:082
1417149991712,3cyclictest0-21swapper/210:36:112
141714999170,16cyclictest405-21dbus-daemon11:40:002
16239832167,5sleep30-21swapper/310:36:153
141714999162,13cyclictest0-21swapper/208:56:102
141714999162,13cyclictest0-21swapper/208:04:462
1417149991612,2cyclictest0-21swapper/207:31:392
14936282152,8sleep30-21swapper/308:26:053
141714999156,7cyclictest1514757-21sed08:46:162
15270642140,3sleep3586-21kworker/3:2+events08:56:173
16773942132,6sleep30-21swapper/311:30:013
16716162132,7sleep30-21swapper/311:21:223
16514932132,7sleep30-21swapper/311:01:203
16466452132,7sleep30-21swapper/310:56:223
16285442132,7sleep30-21swapper/310:41:133
15193782132,7sleep30-21swapper/308:51:133
15094712132,7sleep30-21swapper/308:41:143
15040422132,7sleep30-21swapper/308:36:163
14921142132,7sleep30-21swapper/308:21:153
14398842133,7sleep30-21swapper/307:31:263
17377952122,6sleep30-21swapper/312:31:133
17323292122,6sleep30-21swapper/312:26:083
17270752122,6sleep30-21swapper/312:20:023
17267922122,6sleep30-21swapper/312:17:003
17208612122,6sleep30-21swapper/312:11:193
17161832122,6sleep30-21swapper/312:06:253
17120122121,6sleep30-21swapper/312:05:013
17021392122,6sleep30-21swapper/311:55:013
17019622122,6sleep30-21swapper/311:53:133
16912162122,6sleep30-21swapper/311:41:213
16649092122,6sleep30-21swapper/311:16:173
16579952122,6sleep30-21swapper/311:11:113
16552622122,6sleep30-21swapper/311:06:173
16379692122,6sleep30-21swapper/310:51:083
16368542123,5sleep30-21swapper/310:46:233
16138312122,6sleep30-21swapper/310:26:163
16119052122,6sleep30-21swapper/310:21:263
16019972122,6sleep30-21swapper/310:11:233
15784142122,6sleep30-21swapper/309:51:093
15733762122,6sleep30-21swapper/309:46:073
15621972122,6sleep30-21swapper/309:31:213
15536372122,6sleep30-21swapper/309:26:093
15523942122,6sleep30-21swapper/309:21:193
15440812122,6sleep30-21swapper/309:16:173
15144042122,6sleep30-21swapper/308:46:153
14776422122,6sleep30-21swapper/308:06:213
14731242122,6sleep30-21swapper/308:01:253
14685062120,8sleep30-21swapper/308:00:003
14588892122,6sleep30-21swapper/307:50:133
14382332123,5sleep30-21swapper/307:26:253
14292172122,6sleep30-21swapper/307:21:083
14281232123,5sleep30-21swapper/307:16:223
17421592112,6sleep30-21swapper/312:36:073
16964162112,5sleep30-21swapper/311:46:223
16829112112,6sleep30-21swapper/311:36:113
16730132112,6sleep30-21swapper/311:26:073
16175672111,5sleep30-21swapper/310:30:013
15971392112,5sleep30-21swapper/310:06:263
15916112112,5sleep30-21swapper/310:01:163
15836202112,5sleep30-21swapper/309:56:103
15346402112,6sleep30-21swapper/309:06:143
15292462112,5sleep30-21swapper/309:01:123
14991832112,5sleep30-21swapper/308:31:113
14834262112,5sleep30-21swapper/308:15:013
14791902112,5sleep30-21swapper/308:11:123
14568182112,5sleep30-21swapper/307:46:163
14442792112,5sleep30-21swapper/307:36:133
14219462112,6sleep30-21swapper/307:14:293
14219462112,6sleep30-21swapper/307:14:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional