You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 13:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri Jun 12, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
226614021360,3sleep00-21swapper/023:10:150
227633921260,3sleep30-21swapper/323:40:013
226955821250,3sleep00-21swapper/023:20:120
139099940,75rtkit-daemon0-21swapper/319:06:203
217913427947,22sleep20-21swapper/219:05:112
218031827757,14sleep10-21swapper/119:06:401
217981126548,10sleep00-21swapper/019:05:220
22052132520,2sleep20-21swapper/220:15:222
21839842520,2sleep33056-21PK-Backend19:15:203
22392142500,4sleep33056-21PK-Backend21:55:103
22782682490,3sleep13056-21PK-Backend23:45:121
22397832410,3sleep10-21swapper/121:55:171
21892072260,10sleep013-21ksoftirqd/019:30:210
139099260,4rtkit-daemon1389-21rtkit-daemon23:54:361
2180729992517,6cyclictest2197739-21ntp_states19:55:182
2180723992516,7cyclictest2189812-21latency_hist19:35:011
22291472240,3sleep33056-21PK-Backend21:25:153
2180723992413,4cyclictest26-21ksoftirqd/100:10:011
2180723992413,4cyclictest26-21ksoftirqd/100:10:001
22902472230,5sleep02290246-21grep00:19:590
2180729992315,6cyclictest2254453-21python322:35:222
218072399230,21cyclictest2218694-21missed_timers20:55:171
2180722992321,1cyclictest0-21swapper/000:33:200
139099230,19rtkit-daemon2180717-21cyclictest21:05:180
22389822220,9sleep013-21ksoftirqd/021:54:590
21868092220,2sleep00-21swapper/019:25:110
218073399229,11cyclictest42-21ksoftirqd/323:05:163
218073399220,21cyclictest3056-21PK-Backend19:28:213
2180729992214,6cyclictest2257636-21memory22:45:182
2180723992219,2cyclictest3056-21PK-Backend20:15:081
2180723992217,3cyclictest2181286-21df_inode19:10:121
218072399220,20cyclictest3056-21PK-Backend00:37:291
2180722992220,1cyclictest0-21swapper/023:36:080
2180722992220,1cyclictest0-21swapper/022:01:040
2180722992220,1cyclictest0-21swapper/019:24:150
2180722992218,3cyclictest2260522-21apt22:55:110
139099220,4rtkit-daemon1389-21rtkit-daemon21:11:281
218073399219,11cyclictest2248544-21ntp_states22:20:213
2180733992118,2cyclictest0-21swapper/320:20:193
2180733992111,8cyclictest42-21ksoftirqd/322:05:263
218073399210,19cyclictest3056-21PK-Backend23:20:343
218073399210,19cyclictest3056-21PK-Backend23:14:263
218073399210,19cyclictest3056-21PK-Backend00:08:273
218073399210,19cyclictest3056-21PK-Backend00:08:273
218073399210,14cyclictest3056-21PK-Backend20:50:193
2180729992113,7cyclictest2226012-21ntp_states21:15:232
2180729992113,6cyclictest2262252-21apt23:00:112
2180729992113,6cyclictest2262252-21apt23:00:102
2180729992112,7cyclictest2233285-21users21:35:222
218072999210,1cyclictest0-21swapper/219:46:152
2180723992119,1cyclictest3056-21PK-Backend23:42:461
2180723992119,1cyclictest3056-21PK-Backend22:40:281
2180723992119,1cyclictest3056-21PK-Backend22:27:231
2180723992119,1cyclictest3056-21PK-Backend19:56:501
2180723992119,1cyclictest0-21swapper/100:21:131
2180723992119,1cyclictest0-21swapper/100:01:051
218072399210,20cyclictest3056-21PK-Backend21:30:591
218072399210,20cyclictest0-21swapper/121:35:391
218072399210,20cyclictest0-21swapper/120:35:361
218072399210,19cyclictest3056-21PK-Backend20:40:151
2180722992119,1cyclictest0-21swapper/023:44:060
2180722992119,1cyclictest0-21swapper/023:34:060
2180722992119,1cyclictest0-21swapper/023:25:070
2180722992119,1cyclictest0-21swapper/023:05:400
2180722992119,1cyclictest0-21swapper/021:55:100
2180722992119,1cyclictest0-21swapper/020:37:570
2180722992119,1cyclictest0-21swapper/019:17:260
2180722992119,1cyclictest0-21swapper/000:12:580
2180722992113,6cyclictest2200194-21apt-get20:05:000
2180722992113,6cyclictest2200194-21apt-get20:05:000
218072299210,20cyclictest3056-21PK-Backend00:25:360
218072299210,20cyclictest0-21swapper/022:46:130
218072299210,20cyclictest0-21swapper/019:50:440
218072299210,20cyclictest0-21swapper/000:06:170
218072299210,20cyclictest0-21swapper/000:06:170
22907392200,2sleep00-21swapper/000:20:110
218073399208,11cyclictest42-21ksoftirqd/320:15:113
218073399204,14cyclictest2297195-21cron00:40:013
2180733992014,4cyclictest1095-21runrttasks23:30:213
218073399200,1cyclictest3056-21PK-Backend20:56:153
218073399200,19cyclictest3056-21PK-Backend19:52:013
218073399200,19cyclictest0-21swapper/323:45:423
218073399200,19cyclictest0-21swapper/323:35:423
218073399200,19cyclictest0-21swapper/322:53:583
218073399200,19cyclictest0-21swapper/322:30:383
218073399200,19cyclictest0-21swapper/322:26:333
218073399200,19cyclictest0-21swapper/320:39:133
218073399200,19cyclictest0-21swapper/320:29:393
218073399200,19cyclictest0-21swapper/300:22:393
218073399200,18cyclictest3056-21PK-Backend23:54:133
2180729992018,1cyclictest0-21swapper/223:53:002
2180729992018,1cyclictest0-21swapper/221:09:012
2180729992012,6cyclictest2245190-21sensors_temp22:10:202
218072999200,6cyclictest2182393-21awk19:15:002
218072999200,1cyclictest0-21swapper/220:31:362
218072999200,1cyclictest0-21swapper/200:31:242
218072999200,1cyclictest0-21swapper/200:24:582
218072999200,19cyclictest0-21swapper/223:40:102
218072999200,19cyclictest0-21swapper/223:34:002
218072999200,19cyclictest0-21swapper/221:51:342
218072999200,19cyclictest0-21swapper/221:48:292
218072999200,19cyclictest0-21swapper/221:26:192
218072999200,19cyclictest0-21swapper/221:14:432
218072999200,19cyclictest0-21swapper/221:02:192
218072999200,19cyclictest0-21swapper/220:56:162
218072999200,19cyclictest0-21swapper/220:24:542
218072999200,19cyclictest0-21swapper/220:12:312
218072999200,19cyclictest0-21swapper/219:21:002
218072999200,19cyclictest0-21swapper/200:39:372
218072999200,18cyclictest2214647-21awk20:45:112
2180723992018,1cyclictest3056-21PK-Backend23:37:531
2180723992018,1cyclictest3056-21PK-Backend22:47:231
2180723992018,1cyclictest3056-21PK-Backend22:20:271
2180723992018,1cyclictest3056-21PK-Backend21:15:581
2180723992018,1cyclictest3056-21PK-Backend20:32:461
2180723992018,1cyclictest3056-21PK-Backend00:29:451
2180723992018,1cyclictest0-21swapper/123:57:131
2180723992018,1cyclictest0-21swapper/123:25:021
2180723992018,1cyclictest0-21swapper/121:54:591
2180723992018,1cyclictest0-21swapper/121:26:191
2180723992018,1cyclictest0-21swapper/120:47:461
2180723992018,1cyclictest0-21swapper/119:25:261
2180723992017,2cyclictest3056-21PK-Backend22:09:391
2180723992017,2cyclictest3056-21PK-Backend20:11:151
218072399200,1cyclictest3056-21PK-Backend00:30:461
218072399200,1cyclictest0-21swapper/100:17:211
218072399200,19cyclictest3056-21PK-Backend23:31:591
218072399200,19cyclictest3056-21PK-Backend22:04:451
218072399200,19cyclictest0-21swapper/121:43:091
218072399200,19cyclictest0-21swapper/121:05:371
218072399200,19cyclictest0-21swapper/119:16:481
218072399200,19cyclictest0-21swapper/100:13:281
2180722992018,1cyclictest3056-21PK-Backend22:50:190
2180722992018,1cyclictest3056-21PK-Backend22:44:100
2180722992018,1cyclictest0-21swapper/023:48:590
2180722992018,1cyclictest0-21swapper/022:20:510
2180722992018,1cyclictest0-21swapper/022:06:590
2180722992018,1cyclictest0-21swapper/021:22:240
2180722992018,1cyclictest0-21swapper/020:51:210
2180722992018,1cyclictest0-21swapper/020:10:190
2180722992018,1cyclictest0-21swapper/000:38:140
2180722992013,5cyclictest436-20systemd-journal19:50:010
2180722992013,5cyclictest2247522-21cron22:20:000
218072299200,19cyclictest0-21swapper/022:39:030
218072299200,19cyclictest0-21swapper/021:25:150
218072299200,19cyclictest0-21swapper/021:12:520
218072299200,19cyclictest0-21swapper/021:00:410
218072299200,19cyclictest0-21swapper/020:56:020
218072299200,19cyclictest0-21swapper/020:16:140
218072299200,19cyclictest0-21swapper/019:57:280
218072299200,19cyclictest0-21swapper/019:40:240
218072299200,19cyclictest0-21swapper/019:14:020
139099200,3rtkit-daemon1389-21rtkit-daemon23:57:580
2180733991917,1cyclictest3056-21PK-Backend22:00:513
2180733991917,1cyclictest3056-21PK-Backend19:47:213
2180733991917,1cyclictest3056-21PK-Backend19:21:323
2180733991917,1cyclictest0-21swapper/321:31:583
2180733991917,1cyclictest0-21swapper/321:12:043
2180733991916,2cyclictest3056-21PK-Backend19:12:203
2180733991914,3cyclictest2257417-21df22:45:143
2180733991914,3cyclictest2215456-21python320:45:203
2180733991912,6cyclictest42-21ksoftirqd/320:00:203
2180733991912,6cyclictest42-21ksoftirqd/320:00:203
2180733991912,5cyclictest2235416-21cron21:45:013
2180733991912,5cyclictest2227443-21cat21:20:163
2180733991911,6cyclictest42-21ksoftirqd/322:35:123
2180733991911,6cyclictest2261225-21ntpq22:55:183
2180733991911,6cyclictest2246934-21python322:15:223
2180733991911,6cyclictest2200732-21apt20:05:123
218073399190,1cyclictest3056-21PK-Backend00:11:173
218073399190,1cyclictest0-21swapper/322:13:293
218073399190,1cyclictest0-21swapper/321:47:133
218073399190,1cyclictest0-21swapper/320:40:143
218073399190,1cyclictest0-21swapper/300:31:253
218073399190,18cyclictest3056-21PK-Backend23:59:543
218073399190,18cyclictest3056-21PK-Backend23:17:303
218073399190,18cyclictest3056-21PK-Backend00:17:143
218073399190,18cyclictest0-21swapper/320:30:413
218073399190,18cyclictest0-21swapper/320:11:353
218073399190,18cyclictest0-21swapper/319:55:523
2180729991917,1cyclictest0-21swapper/223:12:322
2180729991917,1cyclictest0-21swapper/222:30:202
2180729991917,1cyclictest0-21swapper/222:20:062
2180729991917,1cyclictest0-21swapper/221:22:272
2180729991917,1cyclictest0-21swapper/219:43:242
2180729991914,3cyclictest2293028-21proc_pri00:25:192
2180729991912,5cyclictest2260441-21date22:55:012
218072999190,1cyclictest3056-21PK-Backend23:48:072
218072999190,1cyclictest3056-21PK-Backend21:42:352
218072999190,1cyclictest0-21swapper/223:59:432
218072999190,1cyclictest0-21swapper/220:42:122
218072999190,1cyclictest0-21swapper/220:25:562
218072999190,1cyclictest0-21swapper/220:00:412
218072999190,1cyclictest0-21swapper/220:00:402
218072999190,1cyclictest0-21swapper/219:51:562
218072999190,1cyclictest0-21swapper/219:26:142
218072999190,1cyclictest0-21swapper/219:18:232
218072999190,1cyclictest0-21swapper/200:11:172
218072999190,18cyclictest0-21swapper/223:35:412
218072999190,18cyclictest0-21swapper/222:17:022
218072999190,18cyclictest0-21swapper/222:09:032
218072999190,18cyclictest0-21swapper/221:34:512
218072999190,18cyclictest0-21swapper/220:38:202
218072999190,18cyclictest0-21swapper/220:05:402
218072999190,18cyclictest0-21swapper/200:18:482
218072999190,18cyclictest0-21swapper/200:05:382
218072999190,18cyclictest0-21swapper/200:05:372
2180723991917,1cyclictest3056-21PK-Backend22:18:231
2180723991917,1cyclictest3056-21PK-Backend20:23:261
2180723991917,1cyclictest3056-21PK-Backend20:00:421
2180723991917,1cyclictest3056-21PK-Backend20:00:421
2180723991917,1cyclictest0-21swapper/121:45:111
2180723991917,1cyclictest0-21swapper/121:00:581
2180723991914,3cyclictest2267171-21sh23:14:591
2180723991913,4cyclictest26-21ksoftirqd/123:20:111
2180723991913,4cyclictest26-21ksoftirqd/119:50:011
2180723991910,7cyclictest2245071-21ntp_states22:10:171
218072399190,1cyclictest3056-21PK-Backend22:34:191
218072399190,1cyclictest3056-21PK-Backend21:20:381
218072399190,1cyclictest3056-21PK-Backend20:09:131
218072399190,1cyclictest0-21swapper/119:52:581
218072399190,1cyclictest0-21swapper/119:38:451
2180722991917,1cyclictest3056-21PK-Backend20:30:270
2180722991917,1cyclictest0-21swapper/023:16:550
2180722991917,1cyclictest0-21swapper/022:12:540
2180722991917,1cyclictest0-21swapper/021:48:130
2180722991917,1cyclictest0-21swapper/021:40:300
2180722991917,1cyclictest0-21swapper/020:45:410
2180722991917,1cyclictest0-21swapper/020:29:250
2180722991913,4cyclictest2200908-21tr20:05:130
2180722991912,6cyclictest883-21dbus-daemon23:05:000
2180722991912,6cyclictest883-21dbus-daemon23:05:000
2180722991912,5cyclictest883-21dbus-daemon20:24:590
2180722991912,5cyclictest2232520-21expr21:35:130
218072299190,1cyclictest0-21swapper/020:40:470
2180733991816,1cyclictest3056-21PK-Backend21:09:143
2180733991816,1cyclictest3056-21PK-Backend21:02:453
2180733991816,1cyclictest3056-21PK-Backend19:37:143
2180733991816,1cyclictest0-21swapper/321:15:563
2180733991816,1cyclictest0-21swapper/319:32:483
2180733991811,5cyclictest42-21ksoftirqd/321:35:123
218073399180,5cyclictest141rcu_preempt19:45:003
218073399180,5cyclictest141rcu_preempt00:05:013
2180729991816,1cyclictest0-21swapper/220:53:472
2180729991811,5cyclictest2260868-21cat22:55:142
218072999180,6cyclictest141rcu_preempt00:04:592
218072999180,18cyclictest0-21swapper/221:55:262
2180723991816,1cyclictest3056-21PK-Backend22:55:221
2180723991815,2cyclictest3056-21PK-Backend20:28:061
2180723991810,6cyclictest2259248-21cat22:50:161
2180722991816,1cyclictest0-21swapper/022:25:580
2180722991816,1cyclictest0-21swapper/021:16:440
2180722991816,1cyclictest0-21swapper/019:36:460
2180722991814,2cyclictest2280036-21cstates23:50:110
2180722991814,2cyclictest2251328-21apt-get22:30:040
218072299180,1cyclictest0-21swapper/000:02:250
218073399177,8cyclictest42-21ksoftirqd/322:40:133
218073399171,14cyclictest2292817-21sed00:25:153
218072999179,6cyclictest2267963-21wc23:15:172
218072999173,2cyclictest141rcu_preempt23:25:122
2180729991715,1cyclictest3056-21PK-Backend19:32:282
2180729991715,1cyclictest0-21swapper/222:26:152
218072999170,16cyclictest0-21swapper/219:38:442
218072399179,6cyclictest2264990-21wc23:05:221
2180723991715,1cyclictest3056-21PK-Backend22:38:251
2180723991711,4cyclictest26-21ksoftirqd/123:15:131
139099170,14rtkit-daemon0-21swapper/119:40:131
218073399165,10cyclictest42-21ksoftirqd/323:27:423
218073399160,14cyclictest2262618-21df_inode23:00:133
218073399160,14cyclictest2262618-21df_inode23:00:123
218072999169,5cyclictest2255462-21cut22:40:132
218072399167,3cyclictest26-21ksoftirqd/119:20:201
2180723991611,3cyclictest2216909-21missed_timers20:50:171
2180722991614,1cyclictest0-21swapper/021:31:580
218073399152,2cyclictest141rcu_preempt21:55:003
218072999157,2cyclictest34-21ksoftirqd/223:05:112
2180729991511,3cyclictest978-21snmpd23:24:392
218072399158,5cyclictest883-21dbus-daemon23:05:001
218072399158,5cyclictest883-21dbus-daemon23:05:001
218072999140,2cyclictest141rcu_preempt22:00:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional