You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-14 - 23:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Jul 14, 2025 12:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1057722510,1sleep30-21swapper/312:25:203
1490699181179,1cyclictest0-21swapper/207:15:002
1490499175171,2cyclictest0-21swapper/107:10:031
1976221290,1sleep119765-21sed08:40:201
146192118104,10sleep20-21swapper/207:08:412
145112118104,10sleep30-21swapper/307:07:163
148999910899,8cyclictest0-21swapper/007:15:000
14622210794,9sleep00-21swapper/007:08:430
14432210694,9sleep10-21swapper/107:06:151
14904996966,2cyclictest7330-21kworker/u16:0+events_unbound11:35:271
14904995539,11cyclictest7330-21kworker/u16:0+events_unbound08:20:371
14904994835,11cyclictest7330-21kworker/u16:0+events_unbound09:30:191
14906994742,3cyclictest20819-21kworker/u16:2+events_unbound07:20:312
14904994440,3cyclictest7330-21kworker/u16:0+events_unbound10:40:211
14904994333,7cyclictest7330-21kworker/u16:0+events_unbound09:20:211
14904994314,13cyclictest15483-21kworker/u16:1+events_unbound07:47:551
14906994036,3cyclictest15483-21kworker/u16:1+events_unbound07:15:032
14906993934,3cyclictest15483-21kworker/u16:1+events_unbound09:45:262
14904993935,3cyclictest15483-21kworker/u16:1+events_unbound09:10:351
14904993910,10cyclictest7330-21kworker/u16:0+events_unbound08:27:431
1490499390,6cyclictest0-21swapper/108:49:221
14906993834,3cyclictest15483-21kworker/u16:1+events_unbound08:00:012
14904993833,4cyclictest7330-21kworker/u16:0+events_unbound09:55:181
14904993833,4cyclictest15483-21kworker/u16:1+events_unbound12:10:201
1490499374,8cyclictest0-21swapper/108:00:061
1490499374,5cyclictest0-21swapper/107:58:431
1490499371,5cyclictest0-21swapper/110:48:311
1490499370,6cyclictest0-21swapper/112:16:351
14906993632,3cyclictest7330-21kworker/u16:0+events_unbound11:00:262
1490499364,7cyclictest0-21swapper/109:39:511
1490499364,5cyclictest0-21swapper/111:07:271
1490499364,5cyclictest0-21swapper/110:31:311
1490499364,10cyclictest7330-21kworker/u16:0+events_unbound12:33:471
1490499363,5cyclictest0-21swapper/109:44:151
1490499363,5cyclictest0-21swapper/109:04:111
1490499363,5cyclictest0-21swapper/108:50:311
1490499363,5cyclictest0-21swapper/108:17:431
1490499363,5cyclictest0-21swapper/108:11:111
14904993613,7cyclictest15483-21kworker/u16:1+events_unbound09:06:071
14904993610,13cyclictest15483-21kworker/u16:1+events_unbound07:39:231
14906993531,3cyclictest15483-21kworker/u16:1+events_unbound10:20:252
1490499354,3cyclictest0-21swapper/107:24:111
1490499353,5cyclictest0-21swapper/111:57:191
1490499353,5cyclictest0-21swapper/111:52:031
1490499353,5cyclictest0-21swapper/110:55:511
14904993532,2cyclictest7330-21kworker/u16:0+events_unbound11:30:281
14904993531,3cyclictest15483-21kworker/u16:1+events_unbound07:15:051
1490499352,8cyclictest0-21swapper/112:29:071
1490499352,8cyclictest0-21swapper/111:19:031
1490499352,8cyclictest0-21swapper/110:17:391
1490499352,8cyclictest0-21swapper/108:30:591
1490499352,8cyclictest0-21swapper/108:08:271
1490499352,8cyclictest0-21swapper/107:42:031
1490499352,5cyclictest0-21swapper/112:22:391
1490499352,5cyclictest0-21swapper/111:14:431
1490499352,5cyclictest0-21swapper/111:02:231
1490499352,5cyclictest0-21swapper/109:29:341
1490499352,5cyclictest0-21swapper/108:55:031
1490499352,5cyclictest0-21swapper/107:26:421
1490499352,10cyclictest271ktimers/107:33:381
1490499351,6cyclictest0-21swapper/111:20:511
1490499351,6cyclictest0-21swapper/111:20:501
1490499351,6cyclictest0-21swapper/110:08:431
1490499351,6cyclictest0-21swapper/109:47:191
1489999353,7cyclictest0-21swapper/009:41:550
1489999351,6cyclictest24151-21kthreadcore10:10:220
1490499344,5cyclictest0-21swapper/111:46:151
1490499344,5cyclictest0-21swapper/110:25:551
1490499344,5cyclictest0-21swapper/107:51:511
1490499342,7cyclictest0-21swapper/112:07:031
1490499342,5cyclictest0-21swapper/112:00:311
1490499342,5cyclictest0-21swapper/111:27:551
1490499341,8cyclictest0-21swapper/112:35:501
1490499341,8cyclictest0-21swapper/110:23:391
1490499341,8cyclictest0-21swapper/110:00:551
1490499341,8cyclictest0-21swapper/108:36:191
1490499341,5cyclictest0-21swapper/111:40:111
1490499341,5cyclictest0-21swapper/110:35:511
1490499341,5cyclictest0-21swapper/109:51:431
1490499340,6cyclictest0-21swapper/110:50:101
1490499340,6cyclictest0-21swapper/110:12:381
1489999344,6cyclictest13075-21munin-run08:35:000
1489999344,5cyclictest0-21swapper/011:03:420
1489999344,5cyclictest0-21swapper/010:57:430
1489999344,5cyclictest0-21swapper/010:49:530
1489999344,5cyclictest0-21swapper/010:20:560
1489999344,5cyclictest0-21swapper/009:36:090
14899993430,3cyclictest7330-21kworker/u16:0+events_unbound11:30:240
1489999341,8cyclictest30229-21users09:45:280
14906993329,3cyclictest7330-21kworker/u16:0+events_unbound10:50:252
1490499330,5cyclictest0-21swapper/109:16:071
1489999333,6cyclictest30369-21perl08:50:170
1489999333,5cyclictest0-21swapper/012:00:200
1489999333,5cyclictest0-21swapper/011:50:430
1489999333,5cyclictest0-21swapper/010:52:410
1489999333,5cyclictest0-21swapper/009:50:340
14906993228,3cyclictest7330-21kworker/u16:0+events_unbound10:40:262
14906993228,3cyclictest20819-21kworker/u16:2+events_unbound07:45:212
1489999324,5cyclictest0-21swapper/011:45:030
1489999324,5cyclictest0-21swapper/007:25:210
1489999322,5cyclictest0-21swapper/011:18:060
1489999322,5cyclictest0-21swapper/008:10:200
1489999320,16cyclictest0-21swapper/010:35:160
14906993127,3cyclictest15483-21kworker/u16:1+events_unbound10:35:242
14906993127,3cyclictest15483-21kworker/u16:1+events_unbound08:10:202
1489999314,5cyclictest0-21swapper/011:59:550
1489999314,5cyclictest0-21swapper/009:22:510
1489999314,5cyclictest0-21swapper/008:35:260
1489999314,5cyclictest0-21swapper/007:56:370
1489999314,5cyclictest0-21swapper/007:31:570
1489999313,5cyclictest0-21swapper/011:41:210
1489999313,5cyclictest0-21swapper/010:08:110
1489999313,5cyclictest0-21swapper/008:02:440
1489999310,8cyclictest23121-21idleruntime-cro07:45:000
14906993026,3cyclictest15483-21kworker/u16:1+events_unbound11:15:312
14906993026,3cyclictest15483-21kworker/u16:1+events_unbound08:20:042
1489999303,5cyclictest0-21swapper/011:14:450
1489999303,5cyclictest0-21swapper/010:32:560
1489999303,5cyclictest0-21swapper/010:28:590
1489999303,5cyclictest0-21swapper/008:41:050
1489999303,3cyclictest0-21swapper/007:38:100
14906992925,3cyclictest15483-21kworker/u16:1+events_unbound09:30:292
14906992925,3cyclictest15483-21kworker/u16:1+events_unbound09:15:262
14906992924,3cyclictest15483-21kworker/u16:1+events_unbound07:25:262
1489999292,5cyclictest0-21swapper/012:29:020
1489999291,8cyclictest0-21swapper/007:48:110
14906992824,3cyclictest20819-21kworker/u16:2+events_unbound07:50:242
14906992824,3cyclictest15483-21kworker/u16:1+events_unbound10:55:022
14906992824,3cyclictest15483-21kworker/u16:1+events_unbound10:30:322
1489999284,5cyclictest0-21swapper/011:07:150
1489999284,5cyclictest0-21swapper/010:16:490
1489999284,5cyclictest0-21swapper/009:55:180
1489999284,5cyclictest0-21swapper/009:10:060
1489999284,5cyclictest0-21swapper/009:05:150
1489999284,5cyclictest0-21swapper/007:24:400
1489999283,6cyclictest0-21swapper/012:36:470
1489999283,6cyclictest0-21swapper/011:23:110
1489999283,6cyclictest0-21swapper/011:23:110
14906992725,1cyclictest15483-21kworker/u16:1+events_unbound11:50:282
14906992723,3cyclictest20819-21kworker/u16:2+events_unbound07:35:272
14906992723,3cyclictest15483-21kworker/u16:1+events_unbound08:50:272
1489999273,5cyclictest0-21swapper/011:38:150
1489999272,5cyclictest0-21swapper/008:07:010
14906992622,3cyclictest7330-21kworker/u16:0+events_unbound11:33:012
14906992622,3cyclictest7330-21kworker/u16:0+events_unbound08:40:202
14906992621,4cyclictest7330-21kworker/u16:0+events_unbound12:25:232
1489999264,5cyclictest0-21swapper/012:32:500
1489999264,5cyclictest0-21swapper/010:44:440
1489999262,5cyclictest0-21swapper/012:17:250
1489999262,5cyclictest0-21swapper/009:03:180
14906992521,3cyclictest7330-21kworker/u16:0+events_unbound12:05:252
14906992521,3cyclictest7330-21kworker/u16:0+events_unbound08:45:182
14906992520,3cyclictest7330-21kworker/u16:0+events_unbound08:05:152
14906992520,3cyclictest15483-21kworker/u16:1+events_unbound09:50:212
1489999254,5cyclictest0-21swapper/009:26:060
1489999254,5cyclictest0-21swapper/008:23:380
1489999253,5cyclictest0-21swapper/008:25:080
14906992420,3cyclictest15483-21kworker/u16:1+events_unbound12:20:012
14906992420,3cyclictest15483-21kworker/u16:1+events_unbound09:25:362
1489999242,5cyclictest0-21swapper/012:05:550
1489999242,5cyclictest0-21swapper/009:18:450
14906992319,3cyclictest7330-21kworker/u16:0+events_unbound11:35:292
14906992319,3cyclictest7330-21kworker/u16:0+events_unbound09:20:262
14906992319,3cyclictest7330-21kworker/u16:0+events_unbound08:25:152
14906992319,3cyclictest15483-21kworker/u16:1+events_unbound10:45:232
14906992319,3cyclictest15483-21kworker/u16:1+events_unbound08:55:262
14906992218,3cyclictest7330-21kworker/u16:0+events_unbound12:00:162
14906992218,3cyclictest15483-21kworker/u16:1+events_unbound09:10:272
1489999223,5cyclictest0-21swapper/012:10:220
14906992117,3cyclictest7330-21kworker/u16:0+events_unbound11:10:192
14906992117,3cyclictest7330-21kworker/u16:0+events_unbound09:35:202
14906992117,3cyclictest15483-21kworker/u16:1+events_unbound08:35:232
14906992115,3cyclictest15483-21kworker/u16:1+events_unbound11:25:292
1489999212,5cyclictest0-21swapper/012:20:460
14906992016,3cyclictest7330-21kworker/u16:0+events_unbound12:11:542
14906992016,3cyclictest7330-21kworker/u16:0+events_unbound08:30:172
14906992016,3cyclictest15483-21kworker/u16:1+events_unbound12:35:172
1489999204,5cyclictest0-21swapper/011:25:080
1489999204,5cyclictest0-21swapper/009:31:080
1489999204,5cyclictest0-21swapper/007:19:520
14899992017,2cyclictest14588-21idleruntime-cro10:05:000
14906991915,3cyclictest7330-21kworker/u16:0+events_unbound09:40:292
14906991814,3cyclictest7330-21kworker/u16:0+events_unbound09:00:022
14906991814,3cyclictest15483-21kworker/u16:1+events_unbound11:45:022
14906991814,3cyclictest15483-21kworker/u16:1+events_unbound11:20:012
14906991814,3cyclictest15483-21kworker/u16:1+events_unbound11:20:002
1489999182,5cyclictest0-21swapper/008:47:050
1489999182,5cyclictest0-21swapper/008:16:440
14906991713,3cyclictest15483-21kworker/u16:1+events_unbound10:10:272
14906991713,3cyclictest15483-21kworker/u16:1+events_unbound08:15:222
14906991612,3cyclictest15483-21kworker/u16:1+events_unbound11:55:022
14906991612,3cyclictest15483-21kworker/u16:1+events_unbound09:05:162
14906991512,2cyclictest9531-21turbostat10:30:002
14906991511,3cyclictest15483-21kworker/u16:1+events_unbound12:15:332
14906991410,3cyclictest7330-21kworker/u16:0+events_unbound10:05:192
1489999143,6cyclictest1613-21munin-run07:55:000
1490699139,3cyclictest15483-21kworker/u16:1+events_unbound11:05:272
1489999132,5cyclictest0-21swapper/008:55:320
1490699128,3cyclictest7330-21kworker/u16:0+events_unbound12:30:172
1490699128,3cyclictest7330-21kworker/u16:0+events_unbound10:15:162
1490699128,3cyclictest20819-21kworker/u16:2+events_unbound07:55:272
1490699128,3cyclictest20819-21kworker/u16:2+events_unbound07:40:472
1490699128,3cyclictest20819-21kworker/u16:2+events_unbound07:35:012
1490699117,3cyclictest7330-21kworker/u16:0+events_unbound11:40:202
1490699101,7cyclictest8183-21ntp_states09:55:232
1490699100,8cyclictest12645-21cut10:00:202
21676290,2sleep30-21swapper/311:10:183
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
15178270,6sleep30-21swapper/311:02:093
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
6621260,1sleep30-21swapper/308:55:233
4527263,2sleep30-21swapper/311:20:523
4527263,2sleep30-21swapper/311:20:523
29752260,4sleep30-21swapper/308:50:143
2932260,2sleep30-21swapper/309:22:573
27629260,4sleep30-21swapper/311:45:133
27321260,5sleep30-21swapper/311:44:253
27216260,5sleep30-21swapper/309:45:213
2720260,4sleep30-21swapper/309:50:263
25884263,2sleep30-21swapper/310:44:053
20146260,2sleep30-21swapper/307:13:063
16529260,4sleep30-21swapper/311:35:153
15838260,4sleep30-21swapper/311:32:353
15661260,4sleep30-21swapper/311:05:133
1486260,6sleep30-21swapper/312:20:083
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
9768250,2sleep30-21swapper/310:30:063
9761250,2sleep30-21swapper/310:58:043
8863250,3sleep30-21swapper/309:30:063
7852250,3sleep30-21swapper/308:30:133
6896250,4sleep30-21swapper/307:57:553
29777253,1sleep30-21swapper/309:17:193
28311250,2sleep30-21swapper/307:46:453
23728250,2sleep30-21swapper/308:41:043
22827250,4sleep30-21swapper/307:41:283
17571250,3sleep30-21swapper/307:40:003
15249250,3sleep30-21swapper/310:35:143
12408250,4sleep30-21swapper/308:03:013
11039250,4sleep30-21swapper/311:56:203
10521251,2sleep30-21swapper/310:00:203
1036250,2sleep30-21swapper/312:17:443
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
9963241,2sleep30-21swapper/311:25:333
973240,2sleep30-21swapper/307:25:013
9087240,2sleep30-21swapper/309:59:553
8314240,3sleep30-21swapper/309:26:133
4442240,2sleep30-21swapper/310:54:553
27878240,3sleep30-21swapper/307:19:313
25856240,2sleep30-21swapper/310:15:153
24604240,2sleep30-21swapper/308:15:233
24407240,3sleep30-21swapper/309:40:283
24032240,2sleep30-21swapper/308:45:013
2082240,2sleep30-21swapper/308:25:013
19265240,3sleep30-21swapper/309:10:023
19103240,2sleep30-21swapper/312:35:203
18517240,3sleep30-21swapper/308:10:183
18005240,3sleep30-21swapper/308:09:183
1768240,3sleep30-21swapper/308:20:563
16814240,2sleep30-21swapper/312:05:013
16472240,3sleep30-21swapper/312:00:373
1589240,2sleep30-21swapper/307:54:543
15554240,2sleep30-21swapper/309:35:233
15008240,3sleep30-21swapper/310:05:173
14463240,2sleep30-21swapper/308:35:223
13536240,2sleep30-21swapper/309:05:013
13329240,3sleep30-21swapper/309:02:203
12856241,2sleep3401irq_work/312:30:193
6672230,2sleep30-21swapper/307:30:023
642230,2sleep30-21swapper/311:50:063
4215230,2sleep30-21swapper/310:25:013
31241230,2sleep30-21swapper/310:20:043
28185230,2sleep30-21swapper/307:20:033
26574230,2sleep30-21swapper/311:15:023
26085230,2sleep30-21swapper/310:45:013
22527230,2sleep30-21swapper/312:10:023
20291230,2sleep30-21swapper/310:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional