You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 13:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Sun Aug 16, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
118001721310,3sleep20-21swapper/219:50:232
118613221030,2sleep20-21swapper/220:10:042
12792632990,3sleep30-21swapper/300:35:153
139099830,70rtkit-daemon0-21swapper/319:09:133
116375027536,33sleep20-21swapper/219:06:362
116253527443,20sleep10-21swapper/119:05:061
116253426242,12sleep00-21swapper/019:05:050
12686732550,3sleep33056-21PK-Backend00:05:153
11664902550,3sleep234-21ksoftirqd/219:15:032
12473332490,3sleep33056-21PK-Backend23:05:123
12671682390,3sleep11267174-21needreboot00:00:201
1164233992713,12cyclictest1262771-21unin-run23:50:000
12567602250,13sleep013-21ksoftirqd/023:30:200
12057552250,4chrt3056-21PK-Backend21:05:131
139099240,3rtkit-daemon1389-21rtkit-daemon20:41:250
139099240,3rtkit-daemon1389-21rtkit-daemon19:57:350
1164237992417,5cyclictest1168056-21cron19:17:001
116423399240,22cyclictest1788620-21WebKitWebProces21:13:260
139099230,15rtkit-daemon0-21swapper/021:54:570
11791152230,3sleep01179121-21cpuspeed_turbos19:50:130
1164233992315,5cyclictest1178703-21sh19:50:000
139099220,14rtkit-daemon3056-21PK-Backend22:48:220
12709642220,2sleep00-21swapper/000:10:220
11753472220,2sleep20-21swapper/219:40:012
1164237992216,5cyclictest1278647-21systemctl00:35:001
1164237992216,5cyclictest1278647-21systemctl00:35:001
116423799220,2cyclictest1788620-21WebKitWebProces19:13:201
116423799220,20cyclictest1389-21rtkit-daemon20:31:361
116423399222,17cyclictest1171757-21cron19:30:000
1164233992220,1cyclictest0-21swapper/023:05:470
1164233992220,1cyclictest0-21swapper/020:39:190
1164233992220,1cyclictest0-21swapper/020:18:100
1164233992214,3cyclictest13-21ksoftirqd/023:20:010
1164233992210,9cyclictest1192864-21unin-run20:30:000
1164233992210,9cyclictest1192864-21unin-run20:30:000
1164253992115,4cyclictest1224313-21idleruntime-cro22:00:003
1164253992113,6cyclictest436-20systemd-journal21:15:003
116425399210,20cyclictest3056-21PK-Backend22:59:333
116425399210,20cyclictest3056-21PK-Backend22:38:443
116425399210,20cyclictest3056-21PK-Backend21:34:093
116425399210,20cyclictest3056-21PK-Backend20:50:523
116425399210,20cyclictest3056-21PK-Backend19:11:403
116425399210,19cyclictest3056-21PK-Backend23:38:133
116425399210,19cyclictest3056-21PK-Backend20:46:443
116425399210,19cyclictest3056-21PK-Backend20:16:563
116425399210,19cyclictest3056-21PK-Backend19:25:463
1164247992119,1cyclictest0-21swapper/200:12:572
116424799210,20cyclictest0-21swapper/223:56:342
116424799210,20cyclictest0-21swapper/220:50:522
116424799210,20cyclictest0-21swapper/219:22:242
1164237992119,1cyclictest3056-21PK-Backend19:32:201
1164237992119,1cyclictest3056-21PK-Backend19:32:201
1164237992119,1cyclictest0-21swapper/120:27:081
1164237992119,1cyclictest0-21swapper/120:27:081
1164237992119,1cyclictest0-21swapper/100:35:161
116423799210,1cyclictest3056-21PK-Backend22:46:331
116423399212,18cyclictest1186266-21sort20:10:120
1164233992119,1cyclictest0-21swapper/023:27:440
1164233992119,1cyclictest0-21swapper/023:14:320
1164233992119,1cyclictest0-21swapper/023:01:010
1164233992119,1cyclictest0-21swapper/022:13:080
1164233992119,1cyclictest0-21swapper/020:01:140
1164233992119,1cyclictest0-21swapper/019:21:390
1164233992119,1cyclictest0-21swapper/000:31:110
1164233992119,1cyclictest0-21swapper/000:31:100
1164233992119,1cyclictest0-21swapper/000:26:450
1164233992119,1cyclictest0-21swapper/000:03:400
1164233992118,2cyclictest0-21swapper/022:05:110
1164233992114,4cyclictest1194826-21sh20:35:000
116423399210,20cyclictest0-21swapper/023:20:270
116423399210,20cyclictest0-21swapper/022:23:220
116423399210,20cyclictest0-21swapper/022:18:480
116423399210,20cyclictest0-21swapper/020:54:550
116423399210,20cyclictest0-21swapper/019:33:560
116423399210,20cyclictest0-21swapper/019:33:560
139099200,14rtkit-daemon0-21swapper/022:45:000
1164253992018,1cyclictest3056-21PK-Backend00:24:233
1164253992017,2cyclictest3056-21PK-Backend23:32:043
1164253992017,2cyclictest3056-21PK-Backend23:29:343
1164253992017,2cyclictest3056-21PK-Backend20:30:143
1164253992017,2cyclictest3056-21PK-Backend00:19:573
116425399200,1cyclictest3056-21PK-Backend22:01:093
116425399200,19cyclictest3056-21PK-Backend23:53:133
116425399200,19cyclictest3056-21PK-Backend23:40:423
116425399200,19cyclictest3056-21PK-Backend21:43:353
116425399200,19cyclictest3056-21PK-Backend20:06:083
116425399200,19cyclictest3056-21PK-Backend00:03:483
116425399200,19cyclictest0-21swapper/323:14:273
116425399200,18cyclictest3056-21PK-Backend22:28:543
116425399200,18cyclictest0-21swapper/321:01:473
1164247992018,1cyclictest0-21swapper/222:26:362
1164247992018,1cyclictest0-21swapper/221:40:072
1164247992018,1cyclictest0-21swapper/220:00:502
1164247992018,1cyclictest0-21swapper/200:29:332
1164247992017,2cyclictest0-21swapper/200:35:212
1164247992013,5cyclictest1176961-21cron19:45:002
1164247992012,6cyclictest1262730-21cron23:50:002
116424799201,1cyclictest0-21swapper/221:57:342
116424799200,1cyclictest0-21swapper/222:01:092
116424799200,1cyclictest0-21swapper/221:01:472
116424799200,1cyclictest0-21swapper/219:29:412
116424799200,1cyclictest0-21swapper/200:23:442
116424799200,19cyclictest0-21swapper/223:06:462
116424799200,19cyclictest0-21swapper/221:17:152
116424799200,19cyclictest0-21swapper/220:44:512
116424799200,19cyclictest0-21swapper/220:09:022
116424799200,19cyclictest0-21swapper/200:31:292
116424799200,19cyclictest0-21swapper/200:31:292
116424799200,19cyclictest0-21swapper/200:19:532
116424799200,19cyclictest0-21swapper/200:01:002
1164237992018,1cyclictest3056-21PK-Backend21:02:371
1164237992018,1cyclictest0-21swapper/119:25:031
1164237992015,3cyclictest2156-21gnome-shell22:50:091
1164237992013,5cyclictest436-20systemd-journal20:39:551
1164237992013,5cyclictest26-21ksoftirqd/120:15:171
1164237992013,5cyclictest1236670-21rm22:35:001
116423799200,1cyclictest0-21swapper/123:34:451
116423799200,1cyclictest0-21swapper/121:51:511
116423799200,19cyclictest3056-21PK-Backend21:21:501
116423799200,19cyclictest3056-21PK-Backend19:41:531
116423799200,19cyclictest0-21swapper/123:29:461
116423799200,19cyclictest0-21swapper/122:05:291
116423799200,19cyclictest0-21swapper/121:30:081
116423799200,19cyclictest0-21swapper/120:57:101
116423799200,19cyclictest0-21swapper/120:48:311
116423799200,19cyclictest0-21swapper/120:13:501
116423799200,19cyclictest0-21swapper/120:09:101
116423399202,16cyclictest1168464-21wc19:20:010
1164233992018,1cyclictest3056-21PK-Backend19:13:420
1164233992018,1cyclictest0-21swapper/021:55:440
1164233992018,1cyclictest0-21swapper/000:22:190
1164233992014,4cyclictest1233401-21cpuspeed_turbos22:25:110
1164233992012,6cyclictest1236482-21dpkg22:35:000
1164233992011,7cyclictest883-21dbus-daemon23:00:000
116423399200,19cyclictest0-21swapper/023:35:480
116423399200,19cyclictest0-21swapper/020:47:240
116423399200,19cyclictest0-21swapper/000:18:270
1164253991917,1cyclictest3056-21PK-Backend23:18:393
1164253991917,1cyclictest3056-21PK-Backend19:51:483
1164253991917,1cyclictest3056-21PK-Backend19:21:403
1164253991917,1cyclictest0-21swapper/320:26:293
1164253991917,1cyclictest0-21swapper/320:26:293
1164253991917,1cyclictest0-21swapper/320:10:133
1164253991917,1cyclictest0-21swapper/319:33:023
1164253991917,1cyclictest0-21swapper/319:33:023
1164253991917,1cyclictest0-21swapper/300:33:153
1164253991917,1cyclictest0-21swapper/300:33:153
1164253991916,2cyclictest3056-21PK-Backend23:24:343
1164253991916,2cyclictest0-21swapper/319:56:073
1164253991912,6cyclictest1167871-21sed19:15:233
1164253991912,5cyclictest1222720-21latency_hist21:55:013
1164253991912,5cyclictest1174772-21cat19:35:233
1164253991911,7cyclictest1210668-21/usr/sbin/munin21:20:143
116425399191,16cyclictest1219332-21/usr/sbin/munin21:45:143
116425399190,1cyclictest3056-21PK-Backend23:58:133
116425399190,1cyclictest3056-21PK-Backend23:45:433
116425399190,1cyclictest3056-21PK-Backend23:04:533
116425399190,1cyclictest3056-21PK-Backend20:04:053
116425399190,1cyclictest3056-21PK-Backend00:12:253
116425399190,1cyclictest0-21swapper/322:46:213
116425399190,18cyclictest3056-21PK-Backend20:42:583
116425399190,18cyclictest3056-21PK-Backend20:39:133
116425399190,17cyclictest1205700-21cstates21:05:133
1164247991917,1cyclictest0-21swapper/220:17:272
116424799191,6cyclictest141rcu_preempt20:22:092
116424799191,5cyclictest141rcu_preempt23:43:302
1164247991915,3cyclictest1207211-21sort21:10:112
1164247991913,5cyclictest1243871-21cat22:55:122
1164247991912,5cyclictest1241162-21ntpq22:45:202
1164247991912,5cyclictest1206339-21gzip21:05:202
1164247991911,6cyclictest1263592-21memory23:50:172
116424799190,1cyclictest0-21swapper/222:53:212
116424799190,1cyclictest0-21swapper/220:45:592
116424799190,1cyclictest0-21swapper/220:39:582
116424799190,1cyclictest0-21swapper/220:31:532
116424799190,1cyclictest0-21swapper/219:12:442
116424799190,18cyclictest0-21swapper/223:39:242
116424799190,18cyclictest0-21swapper/223:03:422
116424799190,18cyclictest0-21swapper/221:35:172
116423799192,13cyclictest1268494-21apt00:05:151
1164237991917,1cyclictest0-21swapper/123:53:391
1164237991917,1cyclictest0-21swapper/123:46:081
1164237991917,1cyclictest0-21swapper/122:14:361
1164237991917,1cyclictest0-21swapper/119:59:301
1164237991917,1cyclictest0-21swapper/119:46:471
1164237991917,1cyclictest0-21swapper/119:38:081
1164237991914,4cyclictest26-21ksoftirqd/100:10:191
1164237991912,5cyclictest1264821-21cat23:55:131
116423799190,1cyclictest0-21swapper/123:36:421
116423799190,1cyclictest0-21swapper/120:41:011
116423799190,18cyclictest0-21swapper/121:48:271
116423799190,18cyclictest0-21swapper/121:37:181
116423799190,18cyclictest0-21swapper/120:01:331
116423799190,18cyclictest0-21swapper/100:29:271
1164233991917,1cyclictest3056-21PK-Backend19:38:360
1164233991917,1cyclictest0-21swapper/022:38:230
1164233991917,1cyclictest0-21swapper/021:49:430
1164233991917,1cyclictest0-21swapper/020:56:020
1164233991917,1cyclictest0-21swapper/000:06:430
1164233991916,2cyclictest3056-21PK-Backend22:00:380
1164233991912,5cyclictest1175836-21expr19:40:130
116423399190,1cyclictest0-21swapper/021:31:380
116423399190,1cyclictest0-21swapper/020:23:240
116423399190,1cyclictest0-21swapper/020:08:170
116423399190,18cyclictest0-21swapper/023:52:310
116423399190,18cyclictest0-21swapper/021:26:440
116423399190,18cyclictest0-21swapper/000:39:500
116425399182,5cyclictest141rcu_preempt22:45:003
1164253991816,1cyclictest3056-21PK-Backend21:28:073
1164253991816,1cyclictest3056-21PK-Backend20:57:593
1164253991816,1cyclictest3056-21PK-Backend19:43:103
1164253991814,3cyclictest1216083-21grep21:35:143
116425399181,15cyclictest1242895-21ntp_states22:50:193
116425399180,16cyclictest1210456-21munin-run21:20:013
116424799183,2cyclictest141rcu_preempt23:20:132
116424799182,5cyclictest141rcu_preempt20:25:222
116424799182,5cyclictest141rcu_preempt20:25:222
1164247991816,1cyclictest0-21swapper/223:31:542
1164247991816,1cyclictest0-21swapper/223:14:372
116424799181,5cyclictest141rcu_preempt22:15:002
1164247991813,3cyclictest1212582-21cpuspeed_turbos21:25:122
1164247991810,6cyclictest1222083-21cat21:50:212
116424799180,5cyclictest141rcu_preempt22:15:162
116424799180,5cyclictest141rcu_preempt19:45:092
116424799180,1cyclictest0-21swapper/219:30:252
116424799180,1cyclictest0-21swapper/219:30:252
116423799189,7cyclictest1260012-21cat23:40:181
1164237991816,1cyclictest3056-21PK-Backend23:14:391
1164237991816,1cyclictest0-21swapper/123:24:461
1164237991816,1cyclictest0-21swapper/123:04:311
1164237991816,1cyclictest0-21swapper/121:55:161
1164237991816,1cyclictest0-21swapper/121:29:001
1164237991816,1cyclictest0-21swapper/120:23:231
1164237991816,1cyclictest0-21swapper/119:24:291
1164237991812,5cyclictest1201906-21sed20:55:011
1164237991811,5cyclictest1239583-21cat22:40:211
1164237991811,5cyclictest1231317-21sed22:20:011
116423799180,1cyclictest0-21swapper/100:23:061
116423399189,7cyclictest1260293-21ntp_states23:40:220
1164233991816,1cyclictest0-21swapper/021:06:090
1164233991811,6cyclictest1265247-21cut23:55:170
139099170,3rtkit-daemon0-21swapper/021:42:300
1164253991715,1cyclictest3056-21PK-Backend20:23:183
1164253991715,1cyclictest3056-21PK-Backend00:26:193
116424799171,5cyclictest141rcu_preempt00:05:152
1164247991715,1cyclictest0-21swapper/223:27:282
1164247991715,1cyclictest0-21swapper/219:55:162
1164247991714,2cyclictest3056-21PK-Backend21:45:142
116424799170,5cyclictest141rcu_preempt23:15:192
116424799170,5cyclictest141rcu_preempt22:40:002
116424799170,5cyclictest141rcu_preempt20:55:082
116423799179,6cyclictest1247746-21fw_packets23:05:161
1164237991715,1cyclictest0-21swapper/119:52:481
139099160,3rtkit-daemon0-21swapper/021:36:400
1164253991611,3cyclictest1229504-21turbostat22:15:003
1164247991614,1cyclictest3056-21PK-Backend21:30:062
1164247991614,1cyclictest0-21swapper/222:44:562
1164247991611,3cyclictest1211730-21cat21:20:232
116424799160,5cyclictest141rcu_preempt22:30:122
116424799160,5cyclictest141rcu_preempt22:20:202
116424799160,5cyclictest141rcu_preempt22:05:122
1164237991614,1cyclictest0-21swapper/122:59:451
1164237991612,2cyclictest1226034-21perf22:05:001
1164237991611,3cyclictest1250803-21acpi23:15:131
1164237991611,3cyclictest1237539-21load22:35:181
1164237991610,5cyclictest1232069-21sed22:20:181
1164237991610,4cyclictest1217745-21grep21:40:111
1164233991614,1cyclictest0-21swapper/021:00:560
1164253991511,3cyclictest1231691-21cpuspeed_turbos22:20:133
116425399150,5cyclictest141rcu_preempt22:20:013
116425399150,5cyclictest141rcu_preempt22:10:003
116423799158,5cyclictest1272373-21basename00:15:171
1164237991513,1cyclictest3056-21PK-Backend21:15:141
1164237991510,4cyclictest1208084-21seq21:10:211
116423399153,8cyclictest2175-21JS10:27:480
116423399151,9cyclictest3056-21PK-Backend21:15:110
116425399141,2cyclictest141rcu_preempt22:35:003
116425399140,3cyclictest3056-21PK-Backend19:47:093
1164233991412,1cyclictest3056-21PK-Backend22:50:030
116423799136,5cyclictest1233504-21expr22:25:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional