You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 07:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Mar 28, 2026 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111247421190,3sleep00-21swapper/019:35:220
116179621150,3sleep00-21swapper/021:55:120
120648221030,4sleep20-21swapper/200:00:172
11453062980,3sleep00-21swapper/021:10:010
110025928041,13sleep00-21swapper/019:05:140
110140627539,14sleep10-21swapper/119:06:161
110048727444,21sleep20-21swapper/219:05:162
110073526943,18sleep30-21swapper/319:05:213
11205692630,2sleep10-21swapper/120:00:011
12110902540,3sleep33056-21PK-Backend00:15:013
11568252310,7sleep3411rcuc/321:40:193
11447052290,1sleep21144712-21wc21:05:222
1101840992817,9cyclictest883-21dbus-daemon22:03:391
139099260,4rtkit-daemon1389-21rtkit-daemon20:45:171
139099260,4rtkit-daemon1389-21rtkit-daemon19:21:001
1101838992620,5cyclictest12158962chrt00:26:530
110183899260,9cyclictest1135418-21cat20:40:150
139099250,4rtkit-daemon1389-21rtkit-daemon23:18:101
139099250,4rtkit-daemon1389-21rtkit-daemon21:56:581
139099250,4rtkit-daemon1389-21rtkit-daemon21:11:341
139099250,4rtkit-daemon1389-21rtkit-daemon21:04:301
139099250,4rtkit-daemon1389-21rtkit-daemon19:12:061
139099250,3rtkit-daemon1389-21rtkit-daemon00:10:541
110184399252,14cyclictest1179607-21tr22:45:122
139099240,4rtkit-daemon1389-21rtkit-daemon23:34:550
139099240,4rtkit-daemon1389-21rtkit-daemon23:32:491
139099240,4rtkit-daemon1389-21rtkit-daemon22:36:181
139099240,4rtkit-daemon1389-21rtkit-daemon21:45:181
139099240,3rtkit-daemon1389-21rtkit-daemon21:35:051
139099240,3rtkit-daemon1389-21rtkit-daemon21:15:301
139099240,3rtkit-daemon1389-21rtkit-daemon00:05:181
110183899241,21cyclictest978-21snmpd00:32:480
139099230,3rtkit-daemon1389-21rtkit-daemon22:07:251
139099230,3rtkit-daemon1389-21rtkit-daemon21:32:181
139099230,3rtkit-daemon1389-21rtkit-daemon19:21:450
139099230,3rtkit-daemon1389-21rtkit-daemon19:18:281
139099230,3rtkit-daemon1389-21rtkit-daemon00:16:351
11187572230,4sleep20-21swapper/219:55:002
110184699230,21cyclictest3056-21PK-Backend23:41:383
1101843992321,1cyclictest0-21swapper/221:11:562
1101843992319,3cyclictest2156-21gnome-shell22:58:102
1101838992321,1cyclictest0-21swapper/023:42:460
1101838992321,1cyclictest0-21swapper/020:07:090
110183899230,21cyclictest1102039-21apt19:10:120
1101846992219,2cyclictest3056-21PK-Backend23:23:263
1101846992219,2cyclictest3056-21PK-Backend22:56:493
1101846992219,2cyclictest3056-21PK-Backend21:11:453
110184699220,20cyclictest3056-21PK-Backend22:41:493
110184699220,20cyclictest3056-21PK-Backend20:00:063
1101843992220,1cyclictest0-21swapper/223:52:572
1101843992220,1cyclictest0-21swapper/223:36:212
1101843992220,1cyclictest0-21swapper/223:06:062
1101843992220,1cyclictest0-21swapper/222:22:262
1101843992220,1cyclictest0-21swapper/200:29:492
110184399220,21cyclictest0-21swapper/220:24:102
110184399220,21cyclictest0-21swapper/219:19:352
110184399220,20cyclictest0-21swapper/200:35:572
1101840992220,1cyclictest0-21swapper/122:43:231
1101840992220,1cyclictest0-21swapper/121:26:301
110183899226,14cyclictest1128567-21cat20:20:220
110183899222,7cyclictest0-21swapper/020:47:590
1101838992220,1cyclictest0-21swapper/023:46:520
1101838992220,1cyclictest0-21swapper/019:49:190
1101838992218,3cyclictest0-21swapper/019:19:250
139099210,18rtkit-daemon1213-21kerneloops21:41:111
1101846992119,1cyclictest3056-21PK-Backend22:45:283
1101846992119,1cyclictest3056-21PK-Backend22:33:443
1101846992119,1cyclictest3056-21PK-Backend22:19:253
1101846992119,1cyclictest3056-21PK-Backend20:10:553
1101846992119,1cyclictest3056-21PK-Backend00:26:333
1101846992119,1cyclictest3056-21PK-Backend00:03:413
1101846992119,1cyclictest0-21swapper/320:50:303
1101846992119,1cyclictest0-21swapper/320:05:273
1101846992118,2cyclictest3056-21PK-Backend23:46:453
1101846992118,2cyclictest3056-21PK-Backend21:55:043
1101846992118,2cyclictest3056-21PK-Backend20:32:583
1101846992118,2cyclictest3056-21PK-Backend20:32:583
1101846992118,2cyclictest3056-21PK-Backend19:29:173
110184699210,20cyclictest3056-21PK-Backend23:53:423
110184699210,20cyclictest3056-21PK-Backend22:35:333
110184699210,20cyclictest3056-21PK-Backend20:36:233
110184699210,19cyclictest3056-21PK-Backend22:01:543
110184699210,19cyclictest3056-21PK-Backend21:31:463
110184699210,19cyclictest3056-21PK-Backend21:24:573
110184699210,19cyclictest3056-21PK-Backend19:43:443
110184699210,19cyclictest3056-21PK-Backend00:17:343
1101843992119,1cyclictest0-21swapper/223:04:042
1101843992119,1cyclictest0-21swapper/222:32:342
1101843992119,1cyclictest0-21swapper/220:57:312
1101843992119,1cyclictest0-21swapper/220:07:412
1101843992119,1cyclictest0-21swapper/219:14:072
1101843992113,6cyclictest1169415-21df_inode22:15:122
1101843992113,6cyclictest1148287-21users21:15:352
1101843992113,6cyclictest1137393-21python320:45:222
110184399210,20cyclictest0-21swapper/223:30:002
110184399210,20cyclictest0-21swapper/220:40:532
110184399210,20cyclictest0-21swapper/220:26:002
110184399210,20cyclictest0-21swapper/200:19:342
110184399210,20cyclictest0-21swapper/200:13:262
1101840992119,1cyclictest0-21swapper/123:43:391
1101840992119,1cyclictest0-21swapper/123:26:291
1101840992119,1cyclictest0-21swapper/123:22:231
1101840992119,1cyclictest0-21swapper/123:12:501
1101840992119,1cyclictest0-21swapper/120:58:181
1101840992119,1cyclictest0-21swapper/120:36:091
110184099210,20cyclictest0-21swapper/121:50:031
110184099210,20cyclictest0-21swapper/100:01:511
110183899215,14cyclictest1138673-21grep20:50:120
110183899213,11cyclictest12103451switchtime00:10:190
1101838992119,1cyclictest0-21swapper/022:19:190
1101838992119,1cyclictest0-21swapper/021:14:010
1101838992119,1cyclictest0-21swapper/020:57:250
1101838992119,1cyclictest0-21swapper/020:00:470
1101838992119,1cyclictest0-21swapper/019:53:250
1101838992119,1cyclictest0-21swapper/019:41:200
1101838992119,1cyclictest0-21swapper/019:34:240
1101838992119,1cyclictest0-21swapper/019:28:430
110183899210,20cyclictest13-21ksoftirqd/023:06:150
110183899210,20cyclictest0-21swapper/023:21:300
110183899210,20cyclictest0-21swapper/020:29:130
110183899210,20cyclictest0-21swapper/000:07:530
139099200,3rtkit-daemon1389-21rtkit-daemon19:48:211
1101846992018,1cyclictest3056-21PK-Backend22:27:293
1101846992018,1cyclictest3056-21PK-Backend20:55:563
1101846992018,1cyclictest3056-21PK-Backend20:41:373
1101846992018,1cyclictest3056-21PK-Backend00:05:443
1101846992017,2cyclictest3056-21PK-Backend23:19:353
1101846992017,2cyclictest3056-21PK-Backend20:15:073
110184699200,1cyclictest3056-21PK-Backend19:14:303
110184699200,19cyclictest3056-21PK-Backend22:07:553
110184699200,19cyclictest3056-21PK-Backend21:38:213
110184699200,19cyclictest3056-21PK-Backend20:21:573
110184699200,19cyclictest3056-21PK-Backend19:36:003
1101843992018,1cyclictest0-21swapper/222:40:522
1101843992018,1cyclictest0-21swapper/221:53:472
1101843992018,1cyclictest0-21swapper/221:43:122
1101843992018,1cyclictest0-21swapper/221:35:152
1101843992018,1cyclictest0-21swapper/221:33:262
1101843992018,1cyclictest0-21swapper/220:54:392
1101843992018,1cyclictest0-21swapper/220:32:022
1101843992018,1cyclictest0-21swapper/220:32:012
1101843992018,1cyclictest0-21swapper/220:14:302
1101843992018,1cyclictest0-21swapper/219:43:142
1101843992018,1cyclictest0-21swapper/219:33:152
1101843992018,1cyclictest0-21swapper/200:33:542
1101843992012,6cyclictest1115774-21memory19:45:162
110184399200,1cyclictest0-21swapper/222:00:502
110184399200,19cyclictest0-21swapper/221:56:252
110184399200,19cyclictest0-21swapper/221:25:362
110184399200,19cyclictest0-21swapper/220:19:442
110184399200,19cyclictest0-21swapper/200:23:402
1101840992018,1cyclictest0-21swapper/123:47:441
1101840992018,1cyclictest0-21swapper/123:03:171
1101840992018,1cyclictest0-21swapper/122:47:011
1101840992018,1cyclictest0-21swapper/122:29:031
1101840992018,1cyclictest0-21swapper/122:20:111
1101840992018,1cyclictest0-21swapper/122:18:221
1101840992018,1cyclictest0-21swapper/121:23:061
1101840992018,1cyclictest0-21swapper/120:50:141
1101840992018,1cyclictest0-21swapper/120:42:091
1101840992018,1cyclictest0-21swapper/120:25:061
1101840992018,1cyclictest0-21swapper/120:16:271
1101840992018,1cyclictest0-21swapper/120:13:041
1101840992018,1cyclictest0-21swapper/120:08:511
1101840992018,1cyclictest0-21swapper/119:34:301
1101840992018,1cyclictest0-21swapper/100:36:451
1101840992018,1cyclictest0-21swapper/100:30:501
1101840992013,5cyclictest1168130-21who22:10:221
110184099200,19cyclictest0-21swapper/123:58:461
110184099200,19cyclictest0-21swapper/123:39:331
110184099200,19cyclictest0-21swapper/120:23:171
110184099200,18cyclictest1112199-21ntpq19:35:191
1101838992018,1cyclictest0-21swapper/023:50:570
1101838992018,1cyclictest0-21swapper/023:39:410
1101838992018,1cyclictest0-21swapper/023:25:350
1101838992018,1cyclictest0-21swapper/022:59:330
1101838992018,1cyclictest0-21swapper/022:52:500
1101838992018,1cyclictest0-21swapper/022:27:220
1101838992018,1cyclictest0-21swapper/021:40:380
1101838992018,1cyclictest0-21swapper/021:38:140
1101838992018,1cyclictest0-21swapper/021:01:030
1101838992018,1cyclictest0-21swapper/020:31:500
1101838992018,1cyclictest0-21swapper/020:31:500
1101838992018,1cyclictest0-21swapper/020:19:000
1101838992018,1cyclictest0-21swapper/000:36:530
1101838992018,1cyclictest0-21swapper/000:17:550
1101838992017,2cyclictest0-21swapper/022:45:210
1101838992013,5cyclictest1167592-21cat22:10:170
1101838992011,7cyclictest1152164-21unin-run21:30:000
110183899200,8cyclictest0-21swapper/022:35:140
110183899200,19cyclictest0-21swapper/022:31:480
110183899200,19cyclictest0-21swapper/022:21:070
110183899200,19cyclictest0-21swapper/000:00:570
110183899200,18cyclictest0-21swapper/023:10:080
11065092190,5sleep31101832-21cyclictest19:20:183
110184699199,8cyclictest42-21ksoftirqd/323:25:123
110184699191,7cyclictest1120141-21chrt19:57:023
1101846991917,1cyclictest3056-21PK-Backend23:30:363
1101846991917,1cyclictest3056-21PK-Backend23:06:223
1101846991917,1cyclictest3056-21PK-Backend22:50:073
1101846991917,1cyclictest3056-21PK-Backend20:29:343
1101846991917,1cyclictest3056-21PK-Backend19:46:483
1101846991917,1cyclictest3056-21PK-Backend19:30:193
1101846991916,2cyclictest3056-21PK-Backend23:12:043
110184699190,1cyclictest3056-21PK-Backend22:23:523
110184699190,1cyclictest3056-21PK-Backend22:10:323
110184699190,1cyclictest3056-21PK-Backend00:37:213
1101843991917,1cyclictest0-21swapper/223:12:012
1101843991917,1cyclictest0-21swapper/220:39:042
110184399190,1cyclictest0-21swapper/223:59:062
110184399190,1cyclictest0-21swapper/222:05:162
110184399190,1cyclictest0-21swapper/221:01:092
110184399190,18cyclictest0-21swapper/223:20:472
110184399190,18cyclictest0-21swapper/222:39:502
110184399190,18cyclictest0-21swapper/222:12:192
1101840991917,1cyclictest0-21swapper/123:50:491
1101840991912,6cyclictest1145228-21unin-run21:10:011
1101840991912,5cyclictest1112928-21apt-get19:40:031
1101840991911,6cyclictest1187041-21fw_packets23:05:161
1101840991911,6cyclictest1184188-21sed22:55:231
110184099190,1cyclictest0-21swapper/122:52:421
110184099190,1cyclictest0-21swapper/120:30:061
110184099190,1cyclictest0-21swapper/120:30:061
110184099190,18cyclictest0-21swapper/100:28:481
1101838991917,1cyclictest0-21swapper/023:00:340
1101838991917,1cyclictest0-21swapper/021:31:390
1101838991917,1cyclictest0-21swapper/021:24:490
1101838991912,5cyclictest1213256-21ls00:20:120
1101838991912,5cyclictest1120444-21cut20:00:000
1101838991912,5cyclictest0-21swapper/020:35:160
110183899190,3cyclictest1159329-21turbostat21:50:010
110183899190,1cyclictest0-21swapper/023:15:490
110183899190,1cyclictest0-21swapper/022:44:190
1101846991816,1cyclictest3056-21PK-Backend20:46:043
1101846991815,2cyclictest3056-21PK-Backend00:33:293
1101846991811,5cyclictest42-21ksoftirqd/323:55:123
1101843991816,1cyclictest0-21swapper/223:16:552
1101843991816,1cyclictest0-21swapper/222:25:172
1101843991816,1cyclictest0-21swapper/219:35:172
1101843991816,1cyclictest0-21swapper/219:23:272
1101843991812,4cyclictest1201437-21needreboot23:45:172
110184099180,1cyclictest0-21swapper/122:33:291
1101838991816,1cyclictest0-21swapper/023:58:540
110183899181,4cyclictest1125574-21cron20:15:000
1101838991813,3cyclictest1161097-21apt-key21:55:010
1101846991715,1cyclictest3056-21PK-Backend21:28:213
1101846991715,1cyclictest3056-21PK-Backend19:15:333
1101846991715,1cyclictest3056-21PK-Backend00:20:383
1101846991714,2cyclictest3056-21PK-Backend23:00:413
1101843991715,1cyclictest0-21swapper/222:53:152
1101843991715,1cyclictest0-21swapper/221:22:102
1101843991715,1cyclictest0-21swapper/220:03:232
1101840991715,1cyclictest0-21swapper/119:25:581
1101840991715,1cyclictest0-21swapper/100:22:531
1101840991711,4cyclictest1121357-21ntp_kernel_err20:00:171
110183899171,6cyclictest13-21ksoftirqd/021:15:150
1101838991715,1cyclictest0-21swapper/022:07:010
1101838991715,1cyclictest0-21swapper/022:00:590
1101846991614,1cyclictest0-21swapper/321:19:093
1101846991611,4cyclictest3056-21PK-Backend21:00:113
110184699160,14cyclictest42-21ksoftirqd/321:50:143
110184399169,6cyclictest1208290-21sed00:05:172
1101843991614,1cyclictest0-21swapper/219:28:212
1101843991612,3cyclictest1120387-21perf20:00:012
1101843991611,3cyclictest1199228-21tr23:40:112
1101840991611,3cyclictest1117949-21open_files19:50:191
1101846991511,2cyclictest42-21ksoftirqd/319:50:043
110184399159,5cyclictest34-21ksoftirqd/221:45:012
110184699141,4cyclictest141rcu_preempt23:35:193
110184399140,12cyclictest1197065-21grep23:35:002
110184699130,5cyclictest3056-21PK-Backend21:45:353
110184699130,2cyclictest3056-21PK-Backend21:09:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional