You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 15:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Wed Jun 17, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
109378321930,7sleep10-21swapper/107:05:141
110278621340,5sleep00-21swapper/007:30:000
109486227539,14sleep00-21swapper/007:05:590
109370527239,26sleep30-21swapper/307:05:143
109504127039,25sleep20-21swapper/207:08:172
11384582490,2sleep30-21swapper/309:10:123
11541482440,3sleep00-21swapper/009:55:120
11329692430,4sleep013-21ksoftirqd/008:55:090
1095316993026,3cyclictest34-21ksoftirqd/207:25:012
1095316993011,5cyclictest34-21ksoftirqd/211:15:012
1095316992925,3cyclictest34-21ksoftirqd/207:20:012
11123942260,4chrt3056-21PK-Backend07:55:173
1095316992615,7cyclictest1155250-21munin-plugin-st10:00:002
109532099258,15cyclictest1141631-21cat09:20:123
109531699259,14cyclictest1-21systemd07:34:132
11984222240,2sleep00-21swapper/012:00:230
1095316992413,7cyclictest1095-21runrttasks12:10:092
1095314992416,5cyclictest1146591-21sh09:35:011
1095309992419,4cyclictest1160932-21cstates10:15:120
109532099236,15cyclictest141rcu_preempt08:05:003
1095320992315,6cyclictest436-20systemd-journal12:40:003
109531699236,5cyclictest34-21ksoftirqd/211:18:352
1095316992319,3cyclictest34-21ksoftirqd/210:48:342
1095316992315,6cyclictest1186763-21cron11:30:002
1095309992321,1cyclictest0-21swapper/010:30:270
139099220,4rtkit-daemon1389-21rtkit-daemon12:14:350
109532099227,13cyclictest1109099-21cat07:45:213
1095320992212,3cyclictest42-21ksoftirqd/310:45:183
109532099221,1cyclictest141rcu_preempt12:05:003
109532099220,20cyclictest3056-21PK-Backend10:34:043
109531699228,3cyclictest141rcu_preempt09:45:152
109531699227,5cyclictest34-21ksoftirqd/210:10:102
109531699223,3cyclictest141rcu_preempt08:04:032
1095316992219,2cyclictest331rcuc/208:18:152
1095316992218,3cyclictest1123662-21chrt08:28:372
1095316992218,3cyclictest1123662-21chrt08:28:362
1095309992220,1cyclictest3056-21PK-Backend07:39:250
1095309992220,1cyclictest0-21swapper/012:09:080
1095309992220,1cyclictest0-21swapper/008:29:270
1095309992220,1cyclictest0-21swapper/008:29:260
1095309992220,1cyclictest0-21swapper/008:00:280
1095309992220,1cyclictest0-21swapper/007:12:210
109530999220,20cyclictest1181596-21munin-run11:15:020
139099210,3rtkit-daemon1389-21rtkit-daemon11:27:470
109532099218,7cyclictest42-21ksoftirqd/307:20:173
109532099214,15cyclictest1140270-21expr09:15:113
1095320992118,2cyclictest3056-21PK-Backend08:21:153
1095320992118,2cyclictest3056-21PK-Backend08:11:553
1095320992118,2cyclictest1194435-21chrt11:50:153
1095320992116,4cyclictest1177309-21grep11:00:193
1095320992113,6cyclictest1195868-21expr11:55:123
1095320992112,7cyclictest1207861-21apt12:30:093
109532099210,20cyclictest3056-21PK-Backend07:32:283
109532099210,19cyclictest3056-21PK-Backend07:54:183
109531699214,5cyclictest34-21ksoftirqd/210:15:192
109531699213,17cyclictest1095-21runrttasks10:44:402
1095316992119,1cyclictest0-21swapper/212:30:432
1095316992119,1cyclictest0-21swapper/212:15:152
1095316992119,1cyclictest0-21swapper/212:04:542
1095316992119,1cyclictest0-21swapper/211:59:192
1095316992119,1cyclictest0-21swapper/211:05:392
1095316992119,1cyclictest0-21swapper/210:33:282
1095316992119,1cyclictest0-21swapper/210:21:262
1095316992119,1cyclictest0-21swapper/210:01:512
1095316992119,1cyclictest0-21swapper/209:21:222
1095316992119,1cyclictest0-21swapper/209:14:062
1095316992119,1cyclictest0-21swapper/208:41:272
1095316992119,1cyclictest0-21swapper/208:33:312
1095316992119,1cyclictest0-21swapper/208:21:542
1095316992119,1cyclictest0-21swapper/208:08:292
1095316992119,1cyclictest0-21swapper/207:57:062
1095316992119,1cyclictest0-21swapper/207:40:182
1095316992113,6cyclictest1132646-21sshd08:54:172
1095316992113,4cyclictest34-21ksoftirqd/210:30:002
1095316992113,4cyclictest34-21ksoftirqd/210:30:002
109531699211,11cyclictest34-21ksoftirqd/207:10:172
109531699210,20cyclictest0-21swapper/211:54:342
109531699210,20cyclictest0-21swapper/209:40:352
109531699210,20cyclictest0-21swapper/209:35:082
109531699210,20cyclictest0-21swapper/208:11:202
109531699210,19cyclictest3056-21PK-Backend07:25:092
1095314992113,6cyclictest1160428-21cron10:15:001
1095314992112,7cyclictest883-21dbus-daemon08:20:001
1095314992112,7cyclictest1207585-21cron12:30:001
109531499210,20cyclictest3056-21PK-Backend10:44:301
109531499210,19cyclictest3056-21PK-Backend09:38:071
109531499210,19cyclictest3056-21PK-Backend09:21:571
109531499210,19cyclictest3056-21PK-Backend08:59:121
1095309992119,1cyclictest0-21swapper/011:35:090
1095309992119,1cyclictest0-21swapper/010:58:520
1095309992119,1cyclictest0-21swapper/009:51:260
1095309992119,1cyclictest0-21swapper/007:30:330
1095309992114,6cyclictest1111385-21cron07:55:000
1095309992114,5cyclictest1118582-21cron08:15:000
109530999210,20cyclictest0-21swapper/012:18:010
109530999210,20cyclictest0-21swapper/011:46:370
109530999210,20cyclictest0-21swapper/007:59:250
139099200,3rtkit-daemon1389-21rtkit-daemon11:24:540
139099200,3rtkit-daemon1389-21rtkit-daemon11:19:470
11038352200,2sleep11102913-21/usr/sbin/munin07:30:221
1095320992018,1cyclictest3056-21PK-Backend11:10:493
1095320992018,1cyclictest3056-21PK-Backend10:11:273
1095320992018,1cyclictest0-21swapper/312:19:023
1095320992018,1cyclictest0-21swapper/311:47:523
1095320992015,3cyclictest1128697-21python308:40:563
1095320992012,6cyclictest1151768-21cron09:50:013
1095320992012,2cyclictest42-21ksoftirqd/309:35:123
109532099200,1cyclictest141rcu_preempt11:18:353
109532099200,1cyclictest0-21swapper/307:42:223
109532099200,19cyclictest3056-21PK-Backend10:29:043
109532099200,19cyclictest3056-21PK-Backend10:29:043
109532099200,19cyclictest0-21swapper/312:13:423
109532099200,19cyclictest0-21swapper/311:22:103
109532099200,19cyclictest0-21swapper/308:45:493
109532099200,19cyclictest0-21swapper/308:09:063
109531699209,3cyclictest141rcu_preempt11:34:112
109531699204,10cyclictest34-21ksoftirqd/210:52:082
109531699203,9cyclictest34-21ksoftirqd/207:50:172
1095316992018,1cyclictest0-21swapper/212:39:142
1095316992018,1cyclictest0-21swapper/209:28:402
1095316992018,1cyclictest0-21swapper/209:07:032
1095316992018,1cyclictest0-21swapper/208:45:532
1095316992015,4cyclictest978-21snmpd09:03:212
1095316992013,4cyclictest1095-21runrttasks11:20:182
109531699200,5cyclictest34-21ksoftirqd/208:35:102
109531699200,19cyclictest0-21swapper/212:20:362
109531699200,19cyclictest0-21swapper/212:09:402
109531699200,19cyclictest0-21swapper/211:45:132
109531699200,19cyclictest0-21swapper/211:42:502
109531699200,19cyclictest0-21swapper/210:59:372
109531699200,19cyclictest0-21swapper/209:50:442
109531699200,19cyclictest0-21swapper/207:46:472
1095314992018,1cyclictest3056-21PK-Backend07:37:131
1095314992018,1cyclictest0-21swapper/111:37:301
1095314992017,2cyclictest3056-21PK-Backend09:13:061
1095314992014,4cyclictest1788597-21WebKitNetworkPr11:18:351
1095314992010,7cyclictest436-20systemd-journal11:15:001
109531499200,1cyclictest0-21swapper/110:34:161
109531499200,19cyclictest3056-21PK-Backend12:02:051
109531499200,19cyclictest3056-21PK-Backend10:54:441
109531499200,19cyclictest3056-21PK-Backend10:47:551
109531499200,19cyclictest3056-21PK-Backend10:08:001
109531499200,19cyclictest3056-21PK-Backend08:45:201
109531499200,19cyclictest0-21swapper/111:20:201
109531499200,19cyclictest0-21swapper/110:18:141
109531499200,19cyclictest0-21swapper/107:11:581
109531499200,18cyclictest3056-21PK-Backend12:23:261
1095309992019,1cyclictest0-21swapper/012:21:460
1095309992018,1cyclictest0-21swapper/011:05:270
1095309992018,1cyclictest0-21swapper/010:22:490
1095309992018,1cyclictest0-21swapper/010:11:000
1095309992018,1cyclictest0-21swapper/009:42:350
1095309992018,1cyclictest0-21swapper/008:51:160
1095309992018,1cyclictest0-21swapper/008:48:400
1095309992013,5cyclictest1137032-21sshd09:05:160
1095309992012,6cyclictest1118958-21cat08:15:120
109530999200,19cyclictest3056-21PK-Backend07:15:450
109530999200,19cyclictest0-21swapper/012:27:400
109530999200,19cyclictest0-21swapper/009:45:100
109530999200,19cyclictest0-21swapper/008:05:070
109530999200,19cyclictest0-21swapper/007:41:130
11682942190,4chrt1168295-21needreboot10:35:191
109532099194,7cyclictest42-21ksoftirqd/307:19:373
1095320991917,1cyclictest0-21swapper/312:25:103
1095320991917,1cyclictest0-21swapper/312:23:343
1095320991917,1cyclictest0-21swapper/311:27:103
1095320991917,1cyclictest0-21swapper/309:50:243
1095320991917,1cyclictest0-21swapper/309:07:453
1095320991917,1cyclictest0-21swapper/309:02:313
1095320991916,2cyclictest3056-21PK-Backend08:18:243
1095320991914,3cyclictest1188120-21users11:30:213
1095320991914,3cyclictest1133566-21missed_timers08:55:153
1095320991913,5cyclictest1146505-21anacron09:34:133
1095320991912,5cyclictest1169513-21date10:40:023
1095320991912,5cyclictest1149281-21ntp_kernel_err09:40:153
109532099191,16cyclictest1179845-21ls11:10:003
1095320991911,2cyclictest42-21ksoftirqd/308:35:013
109532099190,1cyclictest0-21swapper/310:57:233
109532099190,1cyclictest0-21swapper/310:52:093
109532099190,1cyclictest0-21swapper/308:34:263
109532099190,1cyclictest0-21swapper/307:36:553
109532099190,18cyclictest0-21swapper/310:37:303
109532099190,18cyclictest0-21swapper/309:27:323
109531699192,9cyclictest1095-21runrttasks10:35:192
1095316991913,4cyclictest1145310-21grep09:30:142
1095316991911,6cyclictest1206975-21sensors_temp12:25:192
109531699190,1cyclictest0-21swapper/211:01:262
109531699190,1cyclictest0-21swapper/207:37:262
109531699190,10cyclictest34-21ksoftirqd/211:35:182
1095314991917,1cyclictest3056-21PK-Backend11:29:201
1095314991917,1cyclictest0-21swapper/110:21:391
1095314991917,1cyclictest0-21swapper/108:50:341
1095314991917,1cyclictest0-21swapper/108:26:271
1095314991917,1cyclictest0-21swapper/108:26:271
1095314991917,1cyclictest0-21swapper/108:10:251
1095314991917,1cyclictest0-21swapper/107:48:081
1095314991916,2cyclictest3056-21PK-Backend07:29:231
1095314991914,3cyclictest1121200-21missed_timers08:20:181
1095314991912,5cyclictest1165632-21cron10:30:001
1095314991912,5cyclictest1165632-21cron10:30:001
109531499190,1cyclictest3056-21PK-Backend11:55:071
109531499190,1cyclictest3056-21PK-Backend10:57:211
109531499190,1cyclictest3056-21PK-Backend09:28:121
109531499190,1cyclictest3056-21PK-Backend08:09:241
109531499190,1cyclictest3056-21PK-Backend07:40:511
109531499190,1cyclictest0-21swapper/108:04:441
109531499190,18cyclictest3056-21PK-Backend12:14:211
109531499190,18cyclictest3056-21PK-Backend08:37:031
109531499190,18cyclictest0-21swapper/111:42:511
1095309991917,1cyclictest3056-21PK-Backend09:15:240
1095309991917,1cyclictest0-21swapper/012:37:210
1095309991917,1cyclictest0-21swapper/011:50:230
1095309991917,1cyclictest0-21swapper/008:36:090
1095309991916,2cyclictest0-21swapper/008:31:290
109530999190,1cyclictest0-21swapper/010:27:010
109530999190,1cyclictest0-21swapper/010:27:010
109530999190,1cyclictest0-21swapper/009:31:040
109530999190,19cyclictest0-21swapper/010:04:440
109530999190,18cyclictest0-21swapper/008:20:560
1095320991816,1cyclictest3056-21PK-Backend07:14:173
1095320991816,1cyclictest0-21swapper/312:05:093
1095320991816,1cyclictest0-21swapper/308:50:153
1095320991813,3cyclictest1122484-21tr08:25:143
1095320991813,3cyclictest1122484-21tr08:25:143
1095320991810,6cyclictest42-21ksoftirqd/310:10:003
109532099180,1cyclictest141rcu_preempt11:35:163
1095316991816,1cyclictest0-21swapper/209:17:442
1095316991816,1cyclictest0-21swapper/208:57:242
1095316991813,4cyclictest331rcuc/210:06:522
109531499183,13cyclictest1188500-21cron11:35:011
109531499182,11cyclictest1178108-21cut11:05:011
1095314991816,1cyclictest3056-21PK-Backend12:15:561
1095314991816,1cyclictest3056-21PK-Backend11:48:591
1095314991816,1cyclictest3056-21PK-Backend11:05:461
1095314991816,1cyclictest0-21swapper/107:53:361
109530999183,13cyclictest1169159-21dump-pmu-power10:40:010
1095309991817,1cyclictest0-21swapper/009:26:380
1095309991816,1cyclictest0-21swapper/008:41:500
1095309991812,5cyclictest883-21dbus-daemon07:48:030
1095309991812,4cyclictest1148300-21cron09:40:000
109532099178,7cyclictest1154143-21df_inode09:55:123
109532099177,9cyclictest42-21ksoftirqd/307:25:183
1095320991714,2cyclictest3056-21PK-Backend10:24:033
1095320991711,5cyclictest1155629-21wc10:00:113
1095314991715,1cyclictest3056-21PK-Backend10:02:341
1095314991715,1cyclictest3056-21PK-Backend09:51:381
1095314991715,1cyclictest3056-21PK-Backend09:47:591
1095314991715,1cyclictest3056-21PK-Backend09:44:211
1095314991715,1cyclictest3056-21PK-Backend09:17:311
1095314991715,1cyclictest3056-21PK-Backend09:07:041
1095314991715,1cyclictest3056-21PK-Backend08:41:561
1095314991715,1cyclictest0-21swapper/107:23:351
1095314991714,2cyclictest3056-21PK-Backend09:57:051
1095314991710,5cyclictest1113177-21dpkg08:00:011
109531499170,5cyclictest141rcu_preempt11:55:001
109530999172,11cyclictest1173173-21apt10:50:110
1095309991715,1cyclictest0-21swapper/012:32:130
1095309991715,1cyclictest0-21swapper/011:42:530
1095309991715,1cyclictest0-21swapper/011:02:160
1095309991713,3cyclictest1100936-21apt07:24:590
1095309991710,5cyclictest436-20systemd-journal10:09:560
109530999170,15cyclictest436-20systemd-journal09:24:590
1095320991611,3cyclictest3056-21PK-Backend11:40:103
109531499162,12cyclictest1125011-21wc08:30:211
1095314991614,1cyclictest3056-21PK-Backend12:38:411
109530999169,5cyclictest1169980-21cat10:40:100
1095309991612,2cyclictest1188522-21latency_hist11:35:000
1095309991611,3cyclictest1171862-21if_enp2s010:45:150
11354062150,5chrt0-21swapper/009:00:180
109532099150,7cyclictest141rcu_preempt10:18:113
109531499157,6cyclictest883-21dbus-daemon07:15:011
1095314991513,1cyclictest3056-21PK-Backend09:00:141
109531499150,5cyclictest141rcu_preempt12:35:011
109530999152,5cyclictest1195841-21tr11:55:120
1095309991413,1cyclictest0-21swapper/009:12:460
1095314991311,1cyclictest3056-21PK-Backend12:05:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional