You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 09:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Aug 01, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117850222320,5sleep31178411-21cstates19:05:163
124628321110,3sleep00-21swapper/022:15:140
117944027639,13sleep10-21swapper/119:07:201
139099740,61rtkit-daemon0-21swapper/219:08:332
117935926751,9sleep00-21swapper/019:06:190
12639862580,4sleep33056-21PK-Backend23:05:003
12582962570,2sleep33056-21PK-Backend22:50:013
12017792570,3sleep23056-21PK-Backend20:10:012
12389812540,3sleep013-21ksoftirqd/021:55:130
12718312480,3sleep10-21swapper/123:25:201
12448602400,4sleep33056-21PK-Backend22:10:153
1179806993413,3cyclictest13-21ksoftirqd/019:50:000
117980699340,7cyclictest13-21ksoftirqd/021:25:000
117980699325,6cyclictest13-21ksoftirqd/023:40:010
1179806993113,8cyclictest13-21ksoftirqd/022:50:010
1179806993113,5cyclictest13-21ksoftirqd/023:04:590
1179806993113,5cyclictest13-21ksoftirqd/023:04:590
1179806993113,5cyclictest13-21ksoftirqd/021:10:000
1179806993112,10cyclictest13-21ksoftirqd/000:20:010
1179806993110,5cyclictest13-21ksoftirqd/021:20:000
117980699310,8cyclictest13-21ksoftirqd/021:05:000
117980699309,5cyclictest13-21ksoftirqd/021:30:010
117980699308,4cyclictest13-21ksoftirqd/023:45:010
1179806993017,4cyclictest13-21ksoftirqd/020:55:010
1179806993014,6cyclictest13-21ksoftirqd/020:19:590
1179806993013,5cyclictest13-21ksoftirqd/022:30:010
117980699296,6cyclictest13-21ksoftirqd/022:15:000
1179806992910,5cyclictest13-21ksoftirqd/019:55:010
1179806992910,10cyclictest13-21ksoftirqd/023:20:010
117980699290,6cyclictest13-21ksoftirqd/023:10:010
139099280,3rtkit-daemon1389-21rtkit-daemon22:42:321
117980699289,8cyclictest13-21ksoftirqd/000:05:000
117980699289,4cyclictest13-21ksoftirqd/023:25:010
117980699281,6cyclictest13-21ksoftirqd/022:40:000
1179806992811,5cyclictest13-21ksoftirqd/020:50:000
1179806992810,10cyclictest13-21ksoftirqd/021:45:000
117980699279,9cyclictest13-21ksoftirqd/019:20:000
117980699278,4cyclictest13-21ksoftirqd/022:45:000
117980699276,7cyclictest13-21ksoftirqd/022:20:220
117980699274,7cyclictest13-21ksoftirqd/021:35:210
117980699272,3cyclictest13-21ksoftirqd/019:40:010
117980699270,6cyclictest13-21ksoftirqd/019:40:010
12393642260,4sleep33056-21PK-Backend21:55:163
117980699269,9cyclictest13-21ksoftirqd/000:30:010
117980699268,9cyclictest13-21ksoftirqd/020:25:010
117980699267,9cyclictest13-21ksoftirqd/022:05:000
117980699267,10cyclictest13-21ksoftirqd/020:40:010
117980699264,7cyclictest13-21ksoftirqd/023:55:130
1179806992611,10cyclictest13-21ksoftirqd/000:10:000
1179806992610,5cyclictest13-21ksoftirqd/020:55:010
117980699260,10cyclictest1236986-21apt21:50:010
117980699259,5cyclictest13-21ksoftirqd/022:30:110
117980699258,8cyclictest13-21ksoftirqd/021:30:010
117980699250,15cyclictest1199819-21systemd-run20:05:000
139099240,4rtkit-daemon1389-21rtkit-daemon22:06:291
1179807992416,6cyclictest436-20systemd-journal00:05:001
117980799240,4cyclictest1280543-21sed23:50:201
117980699246,6cyclictest13-21ksoftirqd/022:05:000
117980699246,10cyclictest883-21dbus-daemon22:55:010
117980699246,10cyclictest13-21ksoftirqd/020:09:180
117980699245,10cyclictest13-21ksoftirqd/000:35:190
117980699245,10cyclictest13-21ksoftirqd/000:35:000
117980699244,6cyclictest13-21ksoftirqd/023:50:170
117980699242,4cyclictest13-21ksoftirqd/020:30:170
1179806992421,2cyclictest161rcuc/022:57:270
117980699241,4cyclictest13-21ksoftirqd/021:15:000
117980699240,10cyclictest161rcuc/019:20:130
139099230,3rtkit-daemon1389-21rtkit-daemon00:32:571
117981499230,21cyclictest1222860-21apt21:10:123
1179807992318,3cyclictest1219130-21grep21:00:011
1179807992315,6cyclictest1220854-21cron21:05:001
117980699237,9cyclictest13-21ksoftirqd/020:15:000
117980699237,6cyclictest13-21ksoftirqd/023:10:170
117980699236,7cyclictest13-21ksoftirqd/023:30:180
117980699235,7cyclictest13-21ksoftirqd/020:25:140
117980699235,15cyclictest1279387-21perf23:50:010
117980699235,10cyclictest13-21ksoftirqd/000:10:140
117980699230,7cyclictest13-21ksoftirqd/023:25:100
117980699230,13cyclictest13-21ksoftirqd/019:15:000
11857042220,2sleep13056-21PK-Backend19:25:001
117981499222,11cyclictest141rcu_preempt23:50:213
117981499220,20cyclictest3056-21PK-Backend21:30:133
117981499220,20cyclictest3056-21PK-Backend19:36:373
117981299229,4cyclictest1150581-21kworker/2:122:25:002
117981299227,3cyclictest141rcu_preempt22:15:142
117981299223,3cyclictest141rcu_preempt19:40:112
117981299223,2cyclictest141rcu_preempt00:05:002
1179812992220,1cyclictest0-21swapper/219:46:512
1179812992214,2cyclictest34-21ksoftirqd/219:55:012
117981299220,2cyclictest0-21swapper/221:32:332
1179807992216,5cyclictest1260072-21systemd-run22:55:011
1179807992214,6cyclictest1282839-21perf23:59:591
1179807992214,6cyclictest1190866-21apt-get19:40:001
117980799221,1cyclictest141rcu_preempt20:55:011
117980799220,2cyclictest141rcu_preempt23:45:011
117980699226,9cyclictest13-21ksoftirqd/019:35:000
117980699223,10cyclictest13-21ksoftirqd/000:20:210
12426642210,4sleep33056-21PK-Backend22:05:023
1179814992119,1cyclictest3056-21PK-Backend22:39:353
1179814992119,1cyclictest0-21swapper/320:30:313
1179814992119,1cyclictest0-21swapper/319:22:513
1179814992118,2cyclictest3056-21PK-Backend23:58:573
1179814992118,2cyclictest3056-21PK-Backend22:53:273
117981499210,19cyclictest3056-21PK-Backend23:33:013
117981499210,19cyclictest3056-21PK-Backend19:45:153
117981299216,3cyclictest141rcu_preempt21:40:132
117981299215,2cyclictest141rcu_preempt23:50:122
117981299214,3cyclictest141rcu_preempt22:50:192
117981299214,3cyclictest141rcu_preempt22:05:002
117981299213,3cyclictest141rcu_preempt19:35:182
1179812992119,1cyclictest0-21swapper/223:59:122
1179812992119,1cyclictest0-21swapper/221:09:452
1179812992119,1cyclictest0-21swapper/220:57:142
1179812992119,1cyclictest0-21swapper/220:37:482
1179812992119,1cyclictest0-21swapper/200:39:472
1179812992119,1cyclictest0-21swapper/200:26:152
1179812992118,2cyclictest3056-21PK-Backend21:50:272
1179812992114,5cyclictest1263655-21chmod23:05:012
1179812992114,5cyclictest1263655-21chmod23:05:012
1179812992113,6cyclictest34-21ksoftirqd/220:50:222
1179812992113,6cyclictest34-21ksoftirqd/219:25:132
1179812992113,5cyclictest34-21ksoftirqd/220:20:142
117981299210,9cyclictest0-21swapper/219:20:142
117981299210,7cyclictest0-21swapper/220:10:272
117981299210,6cyclictest0-21swapper/222:25:162
117981299210,5cyclictest0-21swapper/221:15:122
117981299210,3cyclictest141rcu_preempt23:30:012
117981299210,20cyclictest0-21swapper/220:28:222
117981299210,20cyclictest0-21swapper/200:33:532
117980799212,3cyclictest141rcu_preempt22:50:021
1179807992119,1cyclictest1192064-21strings19:40:161
1179807992119,1cyclictest0-21swapper/119:26:381
1179807992118,2cyclictest3056-21PK-Backend19:55:181
1179807992118,2cyclictest3056-21PK-Backend00:18:131
1179807992116,4cyclictest26-21ksoftirqd/121:25:011
1179807992113,6cyclictest1205313-21sed20:20:011
117980799210,20cyclictest0-21swapper/119:32:471
117980799210,19cyclictest3056-21PK-Backend20:04:301
117980699218,5cyclictest13-21ksoftirqd/020:00:000
117980699211,11cyclictest13-21ksoftirqd/020:45:010
1179814992018,1cyclictest3056-21PK-Backend21:17:483
1179814992018,1cyclictest3056-21PK-Backend21:02:423
1179814992018,1cyclictest3056-21PK-Backend20:28:353
1179814992018,1cyclictest3056-21PK-Backend20:19:083
1179814992018,1cyclictest0-21swapper/323:45:253
1179814992018,1cyclictest0-21swapper/319:25:413
1179814992018,1cyclictest0-21swapper/319:16:363
1179814992018,1cyclictest0-21swapper/319:14:123
1179814992016,2cyclictest3056-21PK-Backend19:50:143
1179814992012,6cyclictest1285484-21apt00:10:073
1179814992012,6cyclictest1215930-21apt20:50:113
1179814992012,6cyclictest1212464-21apt20:40:113
117981499201,17cyclictest1214198-21/usr/sbin/munin20:45:123
117981499201,17cyclictest1198701-21diskstats20:00:143
117981499200,1cyclictest3056-21PK-Backend23:15:313
117981499200,1cyclictest3056-21PK-Backend19:42:453
117981499200,19cyclictest3056-21PK-Backend23:14:443
117981499200,19cyclictest3056-21PK-Backend19:33:323
117981499200,19cyclictest0-21swapper/321:49:383
117981499200,19cyclictest0-21swapper/320:07:123
117981499200,19cyclictest0-21swapper/300:30:263
117981499200,19cyclictest0-21swapper/300:25:063
117981499200,19cyclictest0-21swapper/300:20:203
117981299203,3cyclictest141rcu_preempt21:55:212
1179812992018,1cyclictest0-21swapper/220:30:182
1179812992017,2cyclictest0-21swapper/220:45:182
1179812992013,6cyclictest34-21ksoftirqd/223:21:372
1179812992013,6cyclictest34-21ksoftirqd/223:05:232
1179812992012,6cyclictest1286943-21cron00:14:592
1179812992012,2cyclictest34-21ksoftirqd/223:35:192
1179812992012,2cyclictest34-21ksoftirqd/220:45:002
117981299200,6cyclictest1227178-21sort21:20:172
117981299200,5cyclictest0-21swapper/223:30:162
117981299200,5cyclictest0-21swapper/222:15:012
117981299200,5cyclictest0-21swapper/220:15:102
117981299200,19cyclictest0-21swapper/219:59:562
117980799204,3cyclictest141rcu_preempt20:09:591
1179807992018,1cyclictest3056-21PK-Backend19:16:241
1179807992018,1cyclictest0-21swapper/123:39:401
1179807992018,1cyclictest0-21swapper/123:34:191
1179807992018,1cyclictest0-21swapper/122:19:291
1179807992018,1cyclictest0-21swapper/121:32:511
1179807992018,1cyclictest0-21swapper/121:28:391
1179807992017,2cyclictest3056-21PK-Backend00:10:351
1179807992017,2cyclictest1262043-21apt23:00:121
1179807992017,2cyclictest1262043-21apt23:00:121
1179807992015,3cyclictest1269501-21cstates23:20:121
1179807992014,4cyclictest2156-21gnome-shell22:32:081
1179807992013,5cyclictest1203522-21turbostat.cron20:14:591
1179807992013,2cyclictest26-21ksoftirqd/100:25:121
1179807992012,6cyclictest26-21ksoftirqd/121:50:141
1179807992012,6cyclictest1207646-21fw_packets20:25:161
117980799200,2cyclictest141rcu_preempt21:20:001
117980799200,1cyclictest3056-21PK-Backend20:43:241
117980799200,1cyclictest0-21swapper/123:06:111
117980799200,1cyclictest0-21swapper/121:10:211
117980799200,19cyclictest3056-21PK-Backend19:11:161
117980799200,19cyclictest0-21swapper/121:56:171
117980799200,19cyclictest0-21swapper/120:21:271
117980699204,6cyclictest13-21ksoftirqd/019:26:160
12245942190,4sleep21224591-21apt-config21:15:012
117981499194,2cyclictest141rcu_preempt22:30:193
1179814991917,1cyclictest3056-21PK-Backend23:24:163
1179814991917,1cyclictest3056-21PK-Backend21:43:583
1179814991917,1cyclictest0-21swapper/300:35:133
1179814991916,2cyclictest3056-21PK-Backend23:39:293
1179814991912,5cyclictest1287568-21expr00:15:133
117981499190,5cyclictest1248481-21taskset22:20:173
117981499190,3cyclictest3056-21PK-Backend21:55:013
117981499190,1cyclictest3056-21PK-Backend21:05:123
117981499190,1cyclictest3056-21PK-Backend20:23:563
117981499190,1cyclictest0-21swapper/320:58:503
117981499190,18cyclictest3056-21PK-Backend21:39:263
117981499190,18cyclictest0-21swapper/320:38:013
117981499190,18cyclictest0-21swapper/319:57:463
117981299199,8cyclictest34-21ksoftirqd/222:45:182
117981299194,3cyclictest141rcu_preempt22:05:132
117981299193,2cyclictest141rcu_preempt21:25:192
117981299192,3cyclictest141rcu_preempt23:40:112
117981299191,3cyclictest141rcu_preempt22:55:172
1179812991911,6cyclictest34-21ksoftirqd/223:10:182
1179812991911,2cyclictest34-21ksoftirqd/219:10:162
117981299190,6cyclictest1267516-21wc23:15:122
117981299190,5cyclictest3056-21PK-Backend23:45:212
117981299190,5cyclictest0-21swapper/222:35:112
117981299190,1cyclictest0-21swapper/221:02:152
117981299190,1cyclictest0-21swapper/200:08:312
117981299190,18cyclictest0-21swapper/221:39:262
117980799194,6cyclictest141rcu_preempt23:15:091
1179807991917,1cyclictest3056-21PK-Backend20:37:151
1179807991917,1cyclictest3056-21PK-Backend20:32:151
1179807991917,1cyclictest0-21swapper/119:50:181
1179807991912,5cyclictest1278506-21cat23:45:181
1179807991911,6cyclictest26-21ksoftirqd/121:50:011
1179807991911,6cyclictest26-21ksoftirqd/121:35:111
1179807991910,7cyclictest1253582-21awk22:35:151
1179807991910,7cyclictest1234643-21python321:40:221
117980799190,1cyclictest3056-21PK-Backend20:45:541
117980799190,1cyclictest0-21swapper/100:05:151
117980799190,18cyclictest0-21swapper/121:07:161
1179806991916,2cyclictest161rcuc/021:52:310
117981499184,2cyclictest141rcu_preempt21:25:223
1179814991816,1cyclictest3056-21PK-Backend20:14:083
117981499181,2cyclictest141rcu_preempt22:25:123
117981299189,5cyclictest34-21ksoftirqd/221:45:152
117981299189,3cyclictest34-21ksoftirqd/222:40:192
1179812991811,6cyclictest1289627-21grep00:20:212
1179812991811,6cyclictest1287391-21expr00:15:112
1179812991811,5cyclictest34-21ksoftirqd/222:30:182
1179812991810,7cyclictest1-21systemd19:15:022
117981299180,17cyclictest0-21swapper/220:04:552
117981299180,17cyclictest0-21swapper/219:34:342
117980799187,3cyclictest1260430-21sort22:55:121
117980799186,4cyclictest26-21ksoftirqd/122:20:121
117980799183,6cyclictest141rcu_preempt22:10:191
117980799180,2cyclictest141rcu_preempt23:15:001
1179814991711,4cyclictest1-21systemd00:10:003
1179814991710,5cyclictest42-21ksoftirqd/322:05:013
117981499170,3cyclictest141rcu_preempt23:04:573
117981499170,3cyclictest141rcu_preempt23:04:563
117981499170,2cyclictest141rcu_preempt23:25:193
117980799179,6cyclictest26-21ksoftirqd/122:25:111
117980799179,6cyclictest26-21ksoftirqd/119:45:141
1179807991710,5cyclictest1240700-21awk22:00:111
117980799170,2cyclictest3056-21PK-Backend00:23:571
117981499167,2cyclictest141rcu_preempt22:15:203
117981499160,6cyclictest3056-21PK-Backend00:04:593
117981499150,2cyclictest141rcu_preempt23:40:053
117981499150,2cyclictest141rcu_preempt22:58:243
117981499150,1cyclictest141rcu_preempt22:40:493
117981499150,1cyclictest141rcu_preempt21:20:173
117980799150,4cyclictest26-21ksoftirqd/100:35:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional