You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-20 - 04:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 18, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
414799142140,1cyclictest0-21swapper/207:13:302
414799133130,2cyclictest4276-21latency_hist07:10:002
3626210792,9sleep30-21swapper/307:05:303
3804210694,9sleep10-21swapper/107:07:401
3659210491,10sleep00-21swapper/007:05:470
256672990,0sleep20-21swapper/211:20:202
4145997469,4cyclictest0-21swapper/107:13:301
4147995754,2cyclictest29278-21kworker/u16:2+events_unbound12:00:002
4147995451,2cyclictest29278-21kworker/u16:2+events_unbound09:20:022
4147995350,2cyclictest6285-21kworker/u16:3+events_unbound09:30:012
4147995148,2cyclictest29278-21kworker/u16:2+events_unbound08:40:012
4147995148,2cyclictest29278-21kworker/u16:2+events_unbound08:40:012
4147994946,2cyclictest6285-21kworker/u16:3+events_unbound09:55:012
4147994946,2cyclictest29278-21kworker/u16:2+events_unbound10:15:002
4147994946,2cyclictest29278-21kworker/u16:2+events_unbound08:00:012
4147994846,2cyclictest29278-21kworker/u16:2+events_unbound08:30:002
4147994845,2cyclictest6285-21kworker/u16:3+events_unbound10:55:002
4147994845,2cyclictest6285-21kworker/u16:3+events_unbound10:55:002
4147994745,2cyclictest6285-21kworker/u16:3+events_unbound11:05:012
4147994744,2cyclictest6285-21kworker/u16:3+events_unbound11:15:012
4147994744,2cyclictest6285-21kworker/u16:3+events_unbound10:35:012
4147994744,2cyclictest29278-21kworker/u16:2+events_unbound09:50:022
4147994643,2cyclictest6285-21kworker/u16:3+events_unbound10:25:012
4147994643,2cyclictest6285-21kworker/u16:3+events_unbound08:10:012
4147994643,2cyclictest29278-21kworker/u16:2+events_unbound09:05:022
4145994642,3cyclictest6285-21kworker/u16:3+events_unbound10:10:241
4147994543,2cyclictest6285-21kworker/u16:3+events_unbound10:00:022
4147994542,2cyclictest29278-21kworker/u16:2+events_unbound07:50:002
4147994442,2cyclictest6285-21kworker/u16:3+events_unbound07:40:002
144092440,0sleep00-21swapper/007:45:180
4147994340,2cyclictest29278-21kworker/u16:2+events_unbound12:05:002
4140994135,4cyclictest6285-21kworker/u16:3+events_unbound10:20:010
4140994134,7cyclictest0-21swapper/007:13:300
4140993933,4cyclictest6285-21kworker/u16:3+events_unbound08:20:010
4145993733,3cyclictest6285-21kworker/u16:3+events_unbound09:30:281
4147993633,2cyclictest29278-21kworker/u16:2+events_unbound07:32:182
414599364,7cyclictest0-21swapper/107:49:081
4145993633,3cyclictest6285-21kworker/u16:3+events_unbound11:05:281
4145993631,4cyclictest29278-21kworker/u16:2+events_unbound12:05:261
414599356,7cyclictest0-21swapper/109:12:031
414599356,7cyclictest0-21swapper/108:48:161
414599355,7cyclictest0-21swapper/109:16:351
414599355,5cyclictest0-21swapper/111:27:121
414599355,5cyclictest0-21swapper/109:08:591
414599355,5cyclictest0-21swapper/108:28:231
414599354,7cyclictest0-21swapper/108:51:281
414599354,6cyclictest0-21swapper/107:38:411
414599353,8cyclictest0-21swapper/108:43:401
414599353,8cyclictest0-21swapper/108:43:391
414599353,7cyclictest0-21swapper/112:30:041
414599353,5cyclictest0-21swapper/111:53:241
414599352,8cyclictest0-21swapper/112:29:081
414599352,8cyclictest0-21swapper/112:04:161
414599352,7cyclictest0-21swapper/109:20:241
414599352,5cyclictest0-21swapper/112:15:591
414599352,5cyclictest0-21swapper/111:32:271
414599352,5cyclictest0-21swapper/108:30:431
414599352,5cyclictest0-21swapper/108:09:171
414599352,5cyclictest0-21swapper/107:53:481
414099354,5cyclictest0-21swapper/007:34:490
414599345,5cyclictest0-21swapper/111:01:351
414599345,5cyclictest0-21swapper/110:50:321
414599345,5cyclictest0-21swapper/110:27:311
414599345,5cyclictest0-21swapper/108:37:151
414599344,5cyclictest0-21swapper/112:12:351
414599344,5cyclictest0-21swapper/111:17:241
414599344,5cyclictest0-21swapper/110:48:121
414599344,5cyclictest0-21swapper/110:04:481
414599344,5cyclictest0-21swapper/109:53:031
414599344,5cyclictest0-21swapper/109:27:001
414599344,5cyclictest0-21swapper/108:55:511
414599344,5cyclictest0-21swapper/108:11:331
414599344,5cyclictest0-21swapper/108:01:161
414599344,5cyclictest0-21swapper/107:58:471
414599344,5cyclictest0-21swapper/107:19:521
414599343,7cyclictest0-21swapper/110:41:361
414599343,6cyclictest0-21swapper/110:34:361
4145993431,3cyclictest6285-21kworker/u16:3+events_unbound09:43:481
4145993430,3cyclictest29278-21kworker/u16:2+events_unbound07:25:291
4145993429,4cyclictest29278-21kworker/u16:2+events_unbound10:05:271
414599342,8cyclictest0-21swapper/110:21:271
414099343,6cyclictest1608-21df10:30:140
4147993330,2cyclictest29278-21kworker/u16:2+events_unbound09:17:182
414599339,5cyclictest0-21swapper/108:23:561
414599335,6cyclictest0-21swapper/110:57:471
414599335,6cyclictest0-21swapper/110:57:471
414599335,6cyclictest0-21swapper/108:15:331
414599334,5cyclictest0-21swapper/111:22:441
414599334,5cyclictest0-21swapper/109:57:441
414599333,5cyclictest0-21swapper/112:36:561
414599333,5cyclictest0-21swapper/109:45:591
414599333,5cyclictest0-21swapper/107:30:091
414599332,8cyclictest0-21swapper/111:40:171
414599332,6cyclictest0-21swapper/111:46:321
414599332,6cyclictest0-21swapper/109:00:151
414599332,5cyclictest0-21swapper/107:43:591
414599330,8cyclictest0-21swapper/111:11:401
414599330,8cyclictest0-21swapper/109:36:151
414599330,5cyclictest0-21swapper/110:15:151
414099332,5cyclictest0-21swapper/008:34:010
414099332,5cyclictest0-21swapper/008:15:190
414599324,6cyclictest0-21swapper/110:35:041
414599324,3cyclictest0-21swapper/111:39:551
414599321,6cyclictest0-21swapper/107:21:201
414599320,5cyclictest0-21swapper/111:55:451
414099324,5cyclictest0-21swapper/012:35:490
414099324,5cyclictest0-21swapper/009:32:490
414099322,5cyclictest0-21swapper/011:56:270
414099321,6cyclictest0-21swapper/010:11:350
414099321,6cyclictest0-21swapper/009:28:580
4147993129,2cyclictest29278-21kworker/u16:2+events_unbound12:39:182
414599310,6cyclictest0-21swapper/112:22:151
414099313,5cyclictest0-21swapper/008:00:490
414099311,6cyclictest0-21swapper/009:07:020
414099310,5cyclictest0-21swapper/010:41:270
414099310,5cyclictest0-21swapper/009:02:240
414099310,5cyclictest0-21swapper/008:59:480
4147993028,2cyclictest29278-21kworker/u16:2+events_unbound09:00:072
414099302,6cyclictest6837-21turbostat11:05:000
4140993026,3cyclictest29278-21kworker/u16:2+events_unbound07:15:010
414099302,5cyclictest0-21swapper/012:29:180
4140993025,4cyclictest6285-21kworker/u16:3+events_unbound11:25:260
414099300,6cyclictest0-21swapper/012:03:540
414099300,6cyclictest0-21swapper/007:37:100
4147992927,2cyclictest6285-21kworker/u16:3+events_unbound11:59:172
4147992927,2cyclictest29278-21kworker/u16:2+events_unbound09:11:162
414099291,6cyclictest4617-21irqstats12:30:190
414099291,5cyclictest0-21swapper/007:20:180
4147992826,2cyclictest6285-21kworker/u16:3+events_unbound12:12:172
4147992825,2cyclictest6285-21kworker/u16:3+events_unbound10:10:112
414099281,6cyclictest0-21swapper/008:12:140
414099275,5cyclictest0-21swapper/011:33:380
414099272,6cyclictest0-21swapper/009:37:040
414099272,6cyclictest0-21swapper/007:40:190
414099270,6cyclictest0-21swapper/009:12:030
4147992623,2cyclictest29278-21kworker/u16:2+events_unbound07:38:462
4147992523,2cyclictest29278-21kworker/u16:2+events_unbound10:07:182
414099250,7cyclictest18187-21munin-run11:45:000
4147992422,2cyclictest29278-21kworker/u16:2+events_unbound08:23:172
414099242,6cyclictest0-21swapper/008:05:550
414099242,5cyclictest0-21swapper/010:29:170
414099240,6cyclictest0-21swapper/011:11:000
4147992321,2cyclictest6285-21kworker/u16:3+events_unbound12:16:202
4147992321,2cyclictest6285-21kworker/u16:3+events_unbound10:53:182
4147992321,2cyclictest6285-21kworker/u16:3+events_unbound09:29:192
4147992321,2cyclictest29278-21kworker/u16:2+events_unbound07:49:562
4140992319,3cyclictest6285-21kworker/u16:3+events_unbound12:15:010
4140992319,3cyclictest29278-21kworker/u16:2+events_unbound09:20:170
414099231,6cyclictest0-21swapper/011:08:480
414099231,6cyclictest0-21swapper/010:50:310
4147992220,2cyclictest6285-21kworker/u16:3+events_unbound10:45:302
4147992220,2cyclictest6285-21kworker/u16:3+events_unbound10:20:362
4140992217,4cyclictest6285-21kworker/u16:3+events_unbound09:40:180
414099221,6cyclictest0-21swapper/007:29:330
414099220,6cyclictest0-21swapper/008:25:530
4147992119,2cyclictest6285-21kworker/u16:3+events_unbound11:29:552
4147992119,2cyclictest29278-21kworker/u16:2+events_unbound08:39:562
414099212,6cyclictest0-21swapper/009:53:250
414099212,5cyclictest0-21swapper/011:48:050
4147992018,2cyclictest6285-21kworker/u16:3+events_unbound12:24:552
414099203,5cyclictest0-21swapper/008:52:480
414099201,6cyclictest0-21swapper/010:45:180
4147991917,2cyclictest6285-21kworker/u16:3+events_unbound12:31:142
4147991917,2cyclictest6285-21kworker/u16:3+events_unbound07:25:532
414099190,2cyclictest16876-21taskset10:15:130
414099190,16cyclictest0-21swapper/007:55:130
4147991816,2cyclictest6285-21kworker/u16:3+events_unbound08:55:592
4147991816,2cyclictest29278-21kworker/u16:2+events_unbound11:39:552
4147991816,2cyclictest29278-21kworker/u16:2+events_unbound07:59:562
4147991816,2cyclictest29278-21kworker/u16:2+events_unbound07:15:072
414099182,11cyclictest22974-21needreboot07:50:210
414099181,5cyclictest0-21swapper/009:15:240
4140991813,4cyclictest6285-21kworker/u16:3+events_unbound11:50:270
4147991715,2cyclictest6285-21kworker/u16:3+events_unbound10:30:122
4147991715,2cyclictest6285-21kworker/u16:3+events_unbound08:49:252
4147991715,2cyclictest29278-21kworker/u16:2+events_unbound08:18:152
4140991713,3cyclictest4543-21irqrtprio08:35:190
4147991614,2cyclictest29278-21kworker/u16:2+events_unbound09:38:532
414099162,6cyclictest0-21swapper/008:50:000
4140991612,3cyclictest12710-21readlink11:40:000
414099160,6cyclictest0-21swapper/010:38:290
4147991513,2cyclictest6285-21kworker/u16:3+events_unbound11:51:142
4147991513,2cyclictest6285-21kworker/u16:3+events_unbound11:49:562
4147991513,2cyclictest29278-21kworker/u16:2+events_unbound11:32:512
4147991513,2cyclictest29278-21kworker/u16:2+events_unbound07:24:152
414099156,8cyclictest0-21swapper/011:25:010
414099154,6cyclictest16594-21sshd09:45:160
414099152,6cyclictest0-21swapper/012:24:270
4140991510,4cyclictest6285-21kworker/u16:3+events_unbound10:55:170
4140991510,4cyclictest6285-21kworker/u16:3+events_unbound10:55:160
4147991412,2cyclictest6285-21kworker/u16:3+events_unbound12:25:532
4147991412,2cyclictest6285-21kworker/u16:3+events_unbound11:00:352
4147991412,2cyclictest6285-21kworker/u16:3+events_unbound08:53:462
4147991412,2cyclictest6285-21kworker/u16:3+events_unbound08:26:012
4147991412,2cyclictest29278-21kworker/u16:2+events_unbound11:44:552
4147991412,2cyclictest29278-21kworker/u16:2+events_unbound09:41:532
414799140,14cyclictest0-21swapper/210:40:162
414099147,2cyclictest1133-21gltestperf10:00:160
414099143,6cyclictest8298-21df_inode12:05:150
4147991311,2cyclictest6285-21kworker/u16:3+events_unbound08:09:242
4147991311,2cyclictest29278-21kworker/u16:2+events_unbound11:11:102
4147991311,2cyclictest29278-21kworker/u16:2+events_unbound09:47:032
414099124,6cyclictest0-21swapper/011:15:250
414099124,3cyclictest0-21swapper/010:06:500
414099121,6cyclictest0-21swapper/012:13:150
414099120,7cyclictest0-21swapper/008:40:050
414099120,7cyclictest0-21swapper/008:40:050
414099111,6cyclictest0-21swapper/009:55:010
723290,3sleep30-21swapper/309:30:193
18596284,2sleep30-21swapper/310:15:203
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
none09:02:467
2833270,6sleep30-21swapper/312:29:123
16261270,2sleep30-21swapper/310:10:313
15362270,6sleep30-21swapper/309:11:203
1424270,6sleep30-21swapper/311:26:063
10567270,6sleep30-21swapper/309:38:493
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
none09:02:466
8229260,4sleep30-21swapper/308:10:113
7813260,4sleep30-21swapper/307:40:133
6373260,2sleep30-21swapper/310:34:373
31676260,1sleep30-21swapper/309:55:213
29344260,4sleep30-21swapper/311:55:083
28551260,4sleep30-21swapper/310:55:133
28551260,4sleep30-21swapper/310:55:123
28406260,2sleep30-21swapper/311:21:223
26021260,4sleep30-21swapper/308:55:123
24246260,4sleep30-21swapper/307:55:133
23597260,2sleep30-21swapper/311:49:363
22641260,4sleep30-21swapper/310:20:023
18650260,4sleep30-21swapper/312:15:013
18216260,6sleep30-21swapper/307:45:583
16428260,4sleep30-21swapper/309:45:153
13696260,4sleep30-21swapper/308:15:123
12947260,5sleep30-21swapper/312:08:193
12171260,4sleep30-21swapper/310:40:133
10895260,5sleep30-21swapper/310:06:473
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
none09:02:465
8487250,2sleep30-21swapper/308:36:463
7177250,3sleep30-21swapper/307:37:173
7080250,3sleep30-21swapper/311:05:153
4246252,2sleep30-21swapper/309:03:423
28803250,2sleep30-21swapper/311:51:213
27684250,3sleep30-21swapper/307:25:273
27377250,3sleep30-21swapper/310:50:233
25423250,4sleep30-21swapper/308:54:283
18667250,4sleep30-21swapper/310:45:183
17822250,3sleep30-21swapper/307:20:143
1745250,3sleep30-21swapper/308:00:263
14427251,2sleep30-21swapper/312:10:193
13997250,2sleep30-21swapper/312:37:253
11416250,3sleep30-21swapper/311:35:253
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
none09:02:464
9941240,2sleep30-21swapper/308:40:223
9941240,2sleep30-21swapper/308:40:223
9828240,2sleep30-21swapper/309:09:553
9398240,2sleep30-21swapper/307:10:273
873240,3sleep30-21swapper/310:29:163
8333240,2sleep30-21swapper/312:30:283
6844240,2sleep30-21swapper/308:05:233
6404240,2sleep30-21swapper/310:35:013
5367240,2sleep30-21swapper/311:00:223
31980240,3sleep30-21swapper/309:28:073
30196240,3sleep30-21swapper/307:30:193
29671241,2sleep30-21swapper/312:22:433
26820240,3sleep30-21swapper/309:50:403
25587240,2sleep30-21swapper/308:25:183
21444240,2sleep30-21swapper/309:20:143
19492240,2sleep30-21swapper/308:20:133
18190240,2sleep30-21swapper/309:15:213
17670241,2sleep30-21swapper/311:14:053
17244240,2sleep30-21swapper/307:16:173
17023240,2sleep30-21swapper/311:40:223
14914240,3sleep30-21swapper/308:45:183
12126240,2sleep30-21swapper/309:40:213
421230,2sleep30-21swapper/310:00:023
30463230,2sleep30-21swapper/308:30:073
2390230,2sleep30-21swapper/312:00:013
1974230,2sleep30-21swapper/311:30:033
18774230,2sleep30-21swapper/307:50:033
17745230,1sleep30-21swapper/311:15:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional