You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 13:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 12, 2025 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1393899148139,8cyclictest0-21swapper/019:10:020
1394799141139,1cyclictest0-21swapper/219:10:022
136632116102,10sleep20-21swapper/219:08:432
1394299114110,1cyclictest0-21swapper/119:10:021
134932113104,6sleep30-21swapper/319:06:313
8995210894,10sleep00-21swapper/019:05:150
13486210895,10sleep10-21swapper/119:06:251
20712680,1sleep30-21swapper/323:20:163
1394299343,6cyclictest15196-21munin-run22:35:011
1394299330,6cyclictest0-21swapper/123:43:061
1394299330,6cyclictest0-21swapper/122:29:161
1394299330,6cyclictest0-21swapper/119:59:281
1394299330,6cyclictest0-21swapper/100:30:471
1394299322,6cyclictest0-21swapper/123:38:111
1394299322,6cyclictest0-21swapper/122:48:581
1394299322,6cyclictest0-21swapper/121:55:281
1394299321,8cyclictest0-21swapper/100:06:221
1394299311,7cyclictest0-21swapper/119:27:081
1394299311,6cyclictest0-21swapper/123:00:021
1394299310,6cyclictest0-21swapper/123:49:131
1394299302,5cyclictest0-21swapper/120:05:191
1394299301,5cyclictest0-21swapper/121:33:081
1394299300,6cyclictest0-21swapper/122:20:191
1394299300,6cyclictest0-21swapper/122:12:001
1394299300,6cyclictest0-21swapper/122:12:001
1394299300,6cyclictest0-21swapper/119:30:231
1394299300,6cyclictest0-21swapper/119:22:451
1394299292,6cyclictest0-21swapper/100:37:291
1394299280,8cyclictest0-21swapper/121:19:331
1393899287,5cyclictest28631-21sensors00:10:260
1393899284,10cyclictest0-21swapper/020:10:170
1393899281,7cyclictest0-21swapper/022:38:110
1393899281,5cyclictest0-21swapper/019:33:440
1394299270,6cyclictest0-21swapper/120:58:011
1393899273,8cyclictest0-21swapper/023:25:170
1393899273,7cyclictest0-21swapper/023:58:340
1393899273,10cyclictest0-21swapper/022:26:570
1393899272,8cyclictest0-21swapper/021:22:000
1393899272,8cyclictest0-21swapper/020:58:400
1393899272,8cyclictest0-21swapper/000:30:200
1394299261,6cyclictest0-21swapper/100:12:491
1394299261,5cyclictest0-21swapper/123:58:581
1394299261,5cyclictest0-21swapper/122:38:351
1393899264,8cyclictest17188-21sshd20:08:210
1393899264,8cyclictest0-21swapper/021:25:470
1393899264,8cyclictest0-21swapper/000:35:180
1393899264,5cyclictest0-21swapper/023:18:110
1393899264,5cyclictest0-21swapper/022:23:100
1393899264,5cyclictest0-21swapper/019:28:420
1393899261,6cyclictest18849-21/usr/sbin/munin21:35:230
1393899261,6cyclictest0-21swapper/000:00:200
1394299253,5cyclictest0-21swapper/121:22:171
1394299251,7cyclictest0-21swapper/120:51:581
1394299251,6cyclictest0-21swapper/121:36:411
1394299251,3cyclictest0-21swapper/121:29:501
1393899254,7cyclictest0-21swapper/023:32:230
1393899254,5cyclictest0-21swapper/022:40:200
1393899254,5cyclictest0-21swapper/021:57:130
1393899254,5cyclictest0-21swapper/021:53:370
1393899254,5cyclictest0-21swapper/021:44:000
1393899254,5cyclictest0-21swapper/021:03:560
1393899254,5cyclictest0-21swapper/020:53:400
1393899254,5cyclictest0-21swapper/019:45:200
1393899254,5cyclictest0-21swapper/019:45:200
1393899254,5cyclictest0-21swapper/019:18:120
1393899253,6cyclictest0-21swapper/022:57:310
1393899253,5cyclictest0-21swapper/023:50:480
1393899253,5cyclictest0-21swapper/021:07:440
1393899253,5cyclictest0-21swapper/020:32:230
1393899251,5cyclictest0-21swapper/023:14:420
1393899250,9cyclictest3398-21kthreadcore20:25:190
1393899250,8cyclictest0-21swapper/000:23:340
1393899245,5cyclictest0-21swapper/023:21:000
1393899245,5cyclictest0-21swapper/023:00:170
1393899245,5cyclictest0-21swapper/022:54:070
1393899245,5cyclictest0-21swapper/022:09:310
1393899245,5cyclictest0-21swapper/019:55:220
1393899243,7cyclictest0-21swapper/020:23:160
1393899243,5cyclictest0-21swapper/022:33:310
1393899243,5cyclictest0-21swapper/020:44:110
1393899243,5cyclictest0-21swapper/020:36:170
1393899243,5cyclictest0-21swapper/000:08:430
1393899242,5cyclictest0-21swapper/023:05:190
1393899242,5cyclictest0-21swapper/022:00:040
1393899242,5cyclictest0-21swapper/020:17:210
1393899240,10cyclictest0-21swapper/022:18:100
1394299234,5cyclictest0-21swapper/122:50:201
1394299234,5cyclictest0-21swapper/100:00:201
1394299232,6cyclictest0-21swapper/120:04:091
1394299231,11cyclictest22671-21apt-get19:45:151
1394299231,11cyclictest22671-21apt-get19:45:141
1393899234,5cyclictest0-21swapper/021:13:570
1393899234,5cyclictest0-21swapper/020:45:180
1393899234,5cyclictest0-21swapper/019:24:540
1393899234,5cyclictest0-21swapper/000:25:180
1393899234,5cyclictest0-21swapper/000:16:100
1393899232,5cyclictest0-21swapper/023:46:150
1393899232,5cyclictest0-21swapper/019:39:380
1394299221,5cyclictest17517-21awk23:34:591
1394299221,14cyclictest0-21swapper/123:50:141
1394299220,6cyclictest0-21swapper/122:07:151
1394299220,6cyclictest0-21swapper/120:23:041
1394299220,6cyclictest0-21swapper/100:25:191
1393899224,5cyclictest0-21swapper/021:46:570
1393899223,5cyclictest0-21swapper/021:15:190
1393899223,5cyclictest0-21swapper/019:53:430
1394299212,6cyclictest0-21swapper/122:44:461
1394299212,5cyclictest0-21swapper/121:52:281
13947992016,3cyclictest30713-21kworker/u16:0+events_unbound20:50:012
13947992014,5cyclictest8633-21kworker/u16:3+events_unbound22:35:022
1394299204,5cyclictest0-21swapper/123:05:171
1394299202,8cyclictest0-21swapper/121:00:041
1394299202,6cyclictest0-21swapper/123:14:571
1394299202,6cyclictest0-21swapper/122:55:181
1394299202,6cyclictest0-21swapper/120:31:471
1394299201,6cyclictest0-21swapper/123:29:231
1394299201,5cyclictest0-21swapper/123:17:241
13942992010,2cyclictest6755-21cron20:30:011
1393899204,6cyclictest0-21swapper/022:48:520
1393899204,5cyclictest0-21swapper/023:40:570
1394299191,7cyclictest0-21swapper/122:19:481
1394299191,6cyclictest0-21swapper/100:19:011
1394299190,8cyclictest0-21swapper/122:01:071
1394299190,6cyclictest0-21swapper/121:05:061
1394299181,6cyclictest0-21swapper/119:51:071
1394299180,6cyclictest0-21swapper/121:42:081
1394299180,10cyclictest18152-21fschecks_time20:10:151
1393899182,5cyclictest0-21swapper/020:00:040
1394299172,6cyclictest0-21swapper/119:15:481
1394299170,8cyclictest0-21swapper/119:44:351
1394299170,6cyclictest0-21swapper/120:41:101
1393899174,5cyclictest0-21swapper/023:35:470
1393899174,5cyclictest0-21swapper/022:10:190
1393899174,5cyclictest0-21swapper/022:10:190
13947991613,2cyclictest0-21swapper/223:39:592
1394299160,6cyclictest0-21swapper/120:18:001
13947991511,3cyclictest11439-21apt19:35:002
1394799148,4cyclictest19847-21systemctl21:40:002
1394299144,8cyclictest16037-21/usr/sbin/munin19:35:231
1394299144,5cyclictest0-21swapper/121:12:571
1394299143,6cyclictest25767-21kthreadcore20:45:201
1394299140,10cyclictest2842-21cp00:20:001
1394299130,6cyclictest0-21swapper/123:23:271
1393899133,5cyclictest0-21swapper/019:40:210
1394799129,2cyclictest0-21swapper/222:00:012
1394799128,3cyclictest16676-21grep20:35:222
1394799126,4cyclictest316-21systemd-journal21:24:592
1394799123,7cyclictest25916-21kthreadcore21:15:202
1394799122,9cyclictest22081-21cut22:10:202
1394799122,9cyclictest22081-21cut22:10:202
1394799121,9cyclictest31006-21cut23:15:202
1394799120,8cyclictest18389-21kthreadcore19:40:232
1394799120,10cyclictest16937-21munin-run19:40:002
1394799120,10cyclictest0-21swapper/220:20:002
1394299122,6cyclictest0-21swapper/121:45:211
1393899128,3cyclictest14170-21apt-key21:35:000
1394799118,2cyclictest15698-21ps00:00:212
1394799118,2cyclictest0-21swapper/223:45:232
1394799118,2cyclictest0-21swapper/223:10:002
1394799116,4cyclictest716-21snmpd22:23:012
1394799116,4cyclictest716-21snmpd20:33:382
1394799114,5cyclictest22252-21cut21:10:212
1394799114,2cyclictest0-21swapper/223:20:142
1394799111,9cyclictest3436-21cpuspeed_turbos21:25:152
1394799111,9cyclictest30381-21tr22:45:202
1394799111,9cyclictest13044-21cut21:30:242
1394799111,8cyclictest2190-21grep20:25:162
1394799110,6cyclictest26629-21awk22:45:002
1394799110,1cyclictest0-21swapper/223:50:162
1394299114,5cyclictest0-21swapper/120:37:411
1394799107,2cyclictest0-21swapper/220:05:212
1394799104,4cyclictest4074-21irqcore00:20:182
1394799104,4cyclictest31108-21cut00:15:202
1394799104,4cyclictest29771-21cut22:15:252
1394799104,4cyclictest29676-21sed20:20:222
1394799104,4cyclictest27040-21cut00:10:202
1394799104,4cyclictest10341-21kthreadcore21:00:222
1394799103,5cyclictest19146-21kthreadcore20:40:212
1394799103,5cyclictest11567-21cut22:30:202
1394799101,7cyclictest724-21cut19:25:132
1394799100,9cyclictest0-21swapper/223:30:162
1394799100,8cyclictest9645-21cut20:00:212
1394799100,8cyclictest9463-21irqcore00:25:202
1394799100,8cyclictest8478-21tr23:55:202
1394799100,8cyclictest5382-21seq19:55:242
1394799100,8cyclictest5063-21fschecks_time22:25:162
1394799100,8cyclictest27497-21grep23:10:302
1394799100,8cyclictest21331-21kthreadcore20:10:202
1394799100,8cyclictest20699-21cut00:35:202
1394799100,8cyclictest19013-21cstates00:05:132
1394799100,8cyclictest14584-21tune2fs00:30:182
1394799100,8cyclictest13351-21cut21:05:132
1394799100,8cyclictest1106-21if_enp0s2522:50:192
1394799100,8cyclictest10047-21cut23:25:192
1394799100,5cyclictest7346-21chrt20:57:152
1394799100,5cyclictest26882-21needreboot19:45:252
1394799100,5cyclictest26882-21needreboot19:45:252
119692100,2sleep30-21swapper/323:29:593
7839291,5sleep30-21swapper/321:00:143
139479994,4cyclictest32208-21sed21:50:232
139479994,4cyclictest24930-21cut23:40:182
139479994,3cyclictest26036-21cut21:45:162
139479993,4cyclictest27503-21apt-key19:20:002
139479990,9cyclictest0-21swapper/223:00:122
139479990,8cyclictest9584-21chrt22:00:072
139479990,8cyclictest5954-21aten2_r5power_v22:55:152
139479990,8cyclictest24842-21grep21:40:272
139479990,8cyclictest23430-21apt-get20:45:122
139479990,8cyclictest21072-21sort19:15:022
139479990,7cyclictest15124-21cut22:05:132
139479990,4cyclictest28113-21taskset19:50:062
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
none10:07:547
27163270,5sleep30-21swapper/322:45:023
17230270,5sleep30-21swapper/323:05:033
17014270,6sleep30-21swapper/320:06:103
16376270,2sleep30-21swapper/323:02:233
11684270,5sleep30-21swapper/319:35:123
11341270,6sleep30-21swapper/319:33:563
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
none10:07:546
9965260,4sleep30-21swapper/322:30:113
9590260,4sleep30-21swapper/322:00:133
7266260,4sleep30-21swapper/323:55:133
2963260,4sleep30-21swapper/300:20:023
25594260,2sleep30-21swapper/322:13:213
25594260,2sleep30-21swapper/322:13:203
22099260,5sleep30-21swapper/319:41:063
19483260,4sleep30-21swapper/300:35:133
18694260,4sleep30-21swapper/300:05:103
17764260,4sleep30-21swapper/323:35:173
12229260,4sleep30-21swapper/323:30:113
12210260,2sleep30-21swapper/320:35:003
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
none10:07:545
8223252,2sleep30-21swapper/321:27:593
6861250,2sleep30-21swapper/323:53:093
5528250,4sleep30-21swapper/322:54:173
31074250,3sleep30-21swapper/321:50:153
30464250,2sleep30-21swapper/321:45:313
2930250,3sleep30-21swapper/322:20:223
27909250,3sleep30-21swapper/320:45:263
26575250,2sleep30-21swapper/322:44:343
2446250,4sleep30-21swapper/321:24:143
19336250,2sleep30-21swapper/319:15:003
17963250,3sleep30-21swapper/320:40:133
1389250,2sleep30-21swapper/323:47:563
13668253,2sleep30-21swapper/321:32:093
1112250,4sleep30-21swapper/320:22:473
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
none10:07:544
6238240,3sleep30-21swapper/319:58:253
5798240,2sleep30-21swapper/320:25:233
5586240,2sleep30-21swapper/322:55:013
4852240,3sleep30-21swapper/319:25:223
4503240,3sleep30-21swapper/322:25:113
3847240,2sleep30-21swapper/321:55:003
29356240,2sleep30-21swapper/300:15:013
28054240,2sleep30-21swapper/319:20:133
27876240,3sleep30-21swapper/323:13:523
25724240,2sleep30-21swapper/322:15:013
24165240,3sleep30-21swapper/321:40:223
23998240,2sleep30-21swapper/321:15:003
23674240,3sleep30-21swapper/321:10:593
23090240,2sleep30-21swapper/319:45:193
23090240,2sleep30-21swapper/319:45:193
23030240,3sleep30-21swapper/320:15:133
19637240,3sleep30-21swapper/322:05:263
18722241,1sleep3421rcuc/320:10:203
18341240,3sleep30-21swapper/300:03:463
15835240,2sleep30-21swapper/322:35:123
14070240,3sleep30-21swapper/319:10:083
13895240,2sleep30-21swapper/321:35:013
13743240,2sleep30-21swapper/300:29:563
12470240,3sleep30-21swapper/320:35:123
11674240,3sleep30-21swapper/320:02:503
29273230,2sleep30-21swapper/320:50:073
28219230,2sleep30-21swapper/323:15:083
28109230,2sleep30-21swapper/319:50:033
24145230,2sleep30-21swapper/300:10:033
23309230,2sleep30-21swapper/323:40:103
2115230,2sleep30-21swapper/320:55:013
14013230,2sleep30-21swapper/300:30:123
13289230,2sleep30-21swapper/321:05:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional