You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 04:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun Jul 05, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262668922200,12sleep342-21ksoftirqd/319:05:273
265123121170,7sleep126-21ksoftirqd/120:15:151
273507921060,4sleep13056-21PK-Backend00:10:221
262654527548,17sleep10-21swapper/119:05:251
262709126342,14sleep00-21swapper/019:09:350
262679726242,14sleep20-21swapper/219:05:472
27071822490,3sleep30-21swapper/322:55:013
26305462480,2sleep10-21swapper/119:15:211
26975232420,3sleep20-21swapper/222:25:202
27384362350,3sleep20-21swapper/200:20:202
26576052340,11sleep234-21ksoftirqd/220:35:002
27303672300,4sleep33056-21PK-Backend00:00:013
2627255992313,6cyclictest2716468-21apt23:20:103
2627251992315,6cyclictest2645931-21df20:00:122
262725199230,21cyclictest978-21snmpd21:48:062
262724799231,21cyclictest0-21swapper/121:30:011
2627245992316,5cyclictest2640093-21cron19:45:010
2627245992315,6cyclictest883-21dbus-daemon20:45:010
139099230,16rtkit-daemon3056-21PK-Backend21:53:513
139099230,15rtkit-daemon0-21swapper/222:05:282
2627255992220,1cyclictest3056-21PK-Backend20:08:193
2627255992220,1cyclictest0-21swapper/320:56:183
2627255992219,2cyclictest3056-21PK-Backend21:38:443
2627255992219,2cyclictest3056-21PK-Backend20:41:393
2627251992218,3cyclictest34-21ksoftirqd/200:00:002
262725199220,20cyclictest0-21swapper/221:11:292
2627247992220,1cyclictest0-21swapper/122:27:061
2627245992220,1cyclictest0-21swapper/023:37:060
2627245992220,1cyclictest0-21swapper/020:04:550
2627245992220,1cyclictest0-21swapper/000:21:140
262724599221,15cyclictest2652508-21chrt20:20:120
2627245992210,10cyclictest2648797-21unin-run20:10:000
262724599220,21cyclictest0-21swapper/019:17:510
262724599220,20cyclictest1788620-21WebKitWebProces19:52:320
2627255992119,1cyclictest3056-21PK-Backend22:26:493
2627255992119,1cyclictest3056-21PK-Backend22:14:063
2627255992119,1cyclictest3056-21PK-Backend21:09:233
2627255992119,1cyclictest3056-21PK-Backend20:48:353
2627255992119,1cyclictest0-21swapper/300:15:523
2627255992119,1cyclictest0-21swapper/300:10:453
2627255992118,2cyclictest3056-21PK-Backend23:28:013
262725599210,20cyclictest3056-21PK-Backend20:37:133
262725599210,20cyclictest0-21swapper/320:50:303
262725599210,20cyclictest0-21swapper/319:41:363
262725599210,20cyclictest0-21swapper/319:19:533
262725599210,19cyclictest3056-21PK-Backend20:20:153
262725599210,19cyclictest0-21swapper/323:10:023
2627251992119,1cyclictest0-21swapper/221:02:362
2627251992117,2cyclictest2651508-21ntp_states20:15:192
2627251992112,6cyclictest2641406-21runrttasks19:45:222
262725199210,2cyclictest2720150-21wc23:30:132
2627247992119,1cyclictest3056-21PK-Backend23:51:011
2627247992119,1cyclictest0-21swapper/122:24:561
2627247992119,1cyclictest0-21swapper/122:05:081
2627247992119,1cyclictest0-21swapper/121:45:561
2627247992119,1cyclictest0-21swapper/121:41:151
2627247992119,1cyclictest0-21swapper/121:08:581
2627247992119,1cyclictest0-21swapper/120:09:511
2627247992119,1cyclictest0-21swapper/100:35:161
2627247992119,1cyclictest0-21swapper/100:09:051
2627247992118,2cyclictest3056-21PK-Backend00:16:231
2627247992113,6cyclictest2647030-21cron20:05:001
2627247992112,6cyclictest2699219-21python322:30:231
262724799210,20cyclictest0-21swapper/119:35:301
2627245992119,1cyclictest3056-21PK-Backend23:19:230
2627245992119,1cyclictest0-21swapper/023:40:510
2627245992119,1cyclictest0-21swapper/023:26:050
2627245992119,1cyclictest0-21swapper/023:08:540
2627245992119,1cyclictest0-21swapper/022:33:330
2627245992119,1cyclictest0-21swapper/021:41:490
2627245992119,1cyclictest0-21swapper/020:58:430
2627245992119,1cyclictest0-21swapper/020:38:140
2627245992119,1cyclictest0-21swapper/000:31:280
2627245992119,1cyclictest0-21swapper/000:00:460
2627245992113,6cyclictest2688560-21python322:00:220
2627245992113,2cyclictest13-21ksoftirqd/000:40:000
262724599210,20cyclictest2701548-21apt-get22:40:010
262724599210,20cyclictest2701548-21apt-get22:40:010
262724599210,20cyclictest0-21swapper/022:49:150
262724599210,20cyclictest0-21swapper/022:17:030
262724599210,20cyclictest0-21swapper/021:05:390
262724599210,20cyclictest0-21swapper/020:46:320
262724599210,20cyclictest0-21swapper/020:13:000
139099210,3rtkit-daemon0-21swapper/300:25:023
2627255992018,1cyclictest3056-21PK-Backend22:58:473
2627255992018,1cyclictest3056-21PK-Backend22:35:283
2627255992018,1cyclictest3056-21PK-Backend22:35:283
2627255992018,1cyclictest3056-21PK-Backend22:31:093
2627255992018,1cyclictest3056-21PK-Backend22:08:253
2627255992018,1cyclictest3056-21PK-Backend21:11:193
2627255992018,1cyclictest0-21swapper/323:53:493
2627255992018,1cyclictest0-21swapper/323:47:543
2627255992018,1cyclictest0-21swapper/323:18:203
2627255992018,1cyclictest0-21swapper/320:13:203
2627255992017,2cyclictest3056-21PK-Backend23:41:593
2627255992017,2cyclictest3056-21PK-Backend00:21:003
262725599200,1cyclictest3056-21PK-Backend21:16:203
262725599200,1cyclictest3056-21PK-Backend20:25:153
262725599200,19cyclictest3056-21PK-Backend22:17:373
262725599200,19cyclictest3056-21PK-Backend21:27:413
262725599200,19cyclictest3056-21PK-Backend21:01:193
262725599200,19cyclictest3056-21PK-Backend19:30:553
262725599200,19cyclictest0-21swapper/322:41:103
262725599200,19cyclictest0-21swapper/322:41:093
2627251992018,1cyclictest0-21swapper/221:55:292
2627251992018,1cyclictest0-21swapper/221:07:032
2627251992013,5cyclictest2733518-21sshd00:06:272
262725199200,1cyclictest0-21swapper/222:20:312
262725199200,19cyclictest0-21swapper/223:18:582
262725199200,19cyclictest0-21swapper/223:02:222
262725199200,19cyclictest0-21swapper/222:51:322
262725199200,19cyclictest0-21swapper/222:35:042
262725199200,19cyclictest0-21swapper/222:35:042
262725199200,19cyclictest0-21swapper/221:34:402
262725199200,19cyclictest0-21swapper/221:21:432
262725199200,19cyclictest0-21swapper/221:17:512
262725199200,19cyclictest0-21swapper/220:48:312
262725199200,19cyclictest0-21swapper/220:22:152
262725199200,19cyclictest0-21swapper/220:06:262
262725199200,19cyclictest0-21swapper/219:41:592
262725199200,19cyclictest0-21swapper/219:34:422
262725199200,19cyclictest0-21swapper/219:16:382
262725199200,19cyclictest0-21swapper/200:38:412
262725199200,19cyclictest0-21swapper/200:31:242
262724799202,14cyclictest2685962-21apt21:55:111
2627247992018,1cyclictest3056-21PK-Backend23:16:481
2627247992018,1cyclictest3056-21PK-Backend22:41:261
2627247992018,1cyclictest3056-21PK-Backend22:41:261
2627247992018,1cyclictest0-21swapper/123:58:171
2627247992018,1cyclictest0-21swapper/122:35:441
2627247992018,1cyclictest0-21swapper/122:35:441
2627247992018,1cyclictest0-21swapper/121:31:571
2627247992018,1cyclictest0-21swapper/121:21:431
2627247992018,1cyclictest0-21swapper/121:17:511
2627247992018,1cyclictest0-21swapper/119:54:571
2627247992012,6cyclictest2721673-21apt23:35:141
262724799200,19cyclictest0-21swapper/123:40:471
262724799200,19cyclictest0-21swapper/123:32:421
262724799200,19cyclictest0-21swapper/122:49:511
262724799200,19cyclictest0-21swapper/121:52:321
262724799200,19cyclictest0-21swapper/121:38:321
262724799200,19cyclictest0-21swapper/120:47:021
262724799200,19cyclictest0-21swapper/120:27:561
262724799200,19cyclictest0-21swapper/100:32:171
262724799200,19cyclictest0-21swapper/100:04:461
2627245992018,1cyclictest0-21swapper/022:58:270
2627245992018,1cyclictest0-21swapper/022:37:520
2627245992018,1cyclictest0-21swapper/022:37:520
2627245992018,1cyclictest0-21swapper/022:27:040
2627245992018,1cyclictest0-21swapper/022:21:220
2627245992018,1cyclictest0-21swapper/022:07:030
2627245992018,1cyclictest0-21swapper/021:54:250
2627245992018,1cyclictest0-21swapper/020:31:180
2627245992018,1cyclictest0-21swapper/000:26:210
2627245992018,1cyclictest0-21swapper/000:10:590
2627245992018,1cyclictest0-21swapper/000:08:020
2627245992017,2cyclictest0-21swapper/021:00:390
2627245992011,7cyclictest2652222-21cron20:19:590
262724599200,1cyclictest3056-21PK-Backend23:04:220
262724599200,19cyclictest0-21swapper/023:15:000
262724599200,19cyclictest0-21swapper/021:39:050
139099200,14rtkit-daemon0-21swapper/223:27:392
27057562190,3sleep00-21swapper/022:50:130
26282112190,4sleep03056-21PK-Backend19:10:180
262725599191,7cyclictest2640740-21df_inode19:45:133
2627255991917,1cyclictest3056-21PK-Backend23:30:583
2627255991917,1cyclictest3056-21PK-Backend19:36:153
2627255991917,1cyclictest3056-21PK-Backend00:36:543
2627255991917,1cyclictest3056-21PK-Backend00:04:513
2627255991917,1cyclictest0-21swapper/321:40:063
2627255991917,1cyclictest0-21swapper/320:01:033
2627255991916,2cyclictest3056-21PK-Backend22:03:453
2627255991911,6cyclictest2627646-21expr19:10:113
262725599190,1cyclictest3056-21PK-Backend22:21:083
262725599190,1cyclictest3056-21PK-Backend21:55:133
262725599190,1cyclictest3056-21PK-Backend21:48:373
262725599190,1cyclictest3056-21PK-Backend21:23:153
262725599190,1cyclictest3056-21PK-Backend19:23:183
262725599190,1cyclictest3056-21PK-Backend00:33:583
262725599190,1cyclictest0-21swapper/323:35:173
262725599190,1cyclictest0-21swapper/323:09:143
2627251991917,1cyclictest0-21swapper/223:12:152
2627251991917,1cyclictest0-21swapper/222:55:522
2627251991917,1cyclictest0-21swapper/221:50:502
2627251991917,1cyclictest0-21swapper/220:55:412
2627251991917,1cyclictest0-21swapper/220:36:212
2627251991917,1cyclictest0-21swapper/219:50:242
2627251991917,1cyclictest0-21swapper/219:38:202
2627251991917,1cyclictest0-21swapper/219:28:482
2627251991917,1cyclictest0-21swapper/200:12:042
2627251991916,1cyclictest0-21swapper/222:40:112
2627251991916,1cyclictest0-21swapper/222:40:112
2627251991912,5cyclictest2678867-21sort21:35:122
262725199190,1cyclictest0-21swapper/223:48:102
262725199190,1cyclictest0-21swapper/223:06:542
262725199190,1cyclictest0-21swapper/220:42:432
262725199190,18cyclictest0-21swapper/223:41:292
262725199190,18cyclictest0-21swapper/222:47:142
262725199190,18cyclictest0-21swapper/222:03:262
262725199190,18cyclictest0-21swapper/220:54:192
262725199190,18cyclictest0-21swapper/219:59:102
262725199190,18cyclictest0-21swapper/219:59:102
262725199190,18cyclictest0-21swapper/219:12:392
262725199190,18cyclictest0-21swapper/200:02:242
2627247991917,1cyclictest0-21swapper/122:15:431
2627247991917,1cyclictest0-21swapper/122:11:241
2627247991917,1cyclictest0-21swapper/122:03:471
2627247991917,1cyclictest0-21swapper/121:13:241
2627247991917,1cyclictest0-21swapper/120:50:541
2627247991917,1cyclictest0-21swapper/120:38:441
2627247991914,3cyclictest1095-21runrttasks22:50:221
2627247991912,5cyclictest2707726-21awk22:55:171
262724799190,1cyclictest3056-21PK-Backend23:48:041
262724799190,1cyclictest3056-21PK-Backend23:21:071
262724799190,1cyclictest0-21swapper/120:32:221
262724799190,18cyclictest3056-21PK-Backend23:03:221
262724599192,16cyclictest1095-21runrttasks22:12:150
2627245991917,1cyclictest0-21swapper/021:30:330
2627245991917,1cyclictest0-21swapper/019:59:350
2627245991917,1cyclictest0-21swapper/019:59:340
2627245991913,4cyclictest2716650-21tr23:20:120
2627245991912,6cyclictest2686985-21sed21:55:220
2627245991911,7cyclictest2720304-21df_inode23:30:140
262724599190,1cyclictest3056-21PK-Backend20:50:240
262724599190,1cyclictest0-21swapper/021:26:410
262724599190,1cyclictest0-21swapper/020:27:260
262724599190,18cyclictest0-21swapper/000:16:070
139099190,13rtkit-daemon0-21swapper/323:04:583
27398942180,3sleep10-21swapper/100:25:121
2627255991816,1cyclictest3056-21PK-Backend19:53:263
2627255991816,1cyclictest0-21swapper/322:45:283
2627255991816,1cyclictest0-21swapper/300:07:493
2627251991816,1cyclictest3056-21PK-Backend21:40:082
2627251991816,1cyclictest3056-21PK-Backend00:28:252
2627251991816,1cyclictest0-21swapper/223:20:322
2627251991816,1cyclictest0-21swapper/222:18:212
2627251991816,1cyclictest0-21swapper/220:28:372
2627251991816,1cyclictest0-21swapper/220:13:232
2627251991812,4cyclictest2736694-21switchtime00:15:222
2627247991816,1cyclictest3056-21PK-Backend23:13:501
2627247991816,1cyclictest0-21swapper/121:00:201
2627247991816,1cyclictest0-21swapper/120:22:211
262724799180,1cyclictest0-21swapper/120:40:391
2627245991816,1cyclictest0-21swapper/023:57:490
2627245991816,1cyclictest0-21swapper/023:52:420
2627245991816,1cyclictest0-21swapper/021:18:220
2627245991816,1cyclictest0-21swapper/021:12:010
2627245991813,3cyclictest13-21ksoftirqd/023:50:010
2627245991811,5cyclictest13-21ksoftirqd/021:45:100
2627255991715,1cyclictest3056-21PK-Backend20:32:123
2627251991715,1cyclictest0-21swapper/221:29:272
2627251991712,3cyclictest2727219-21cpuspeed_turbos23:50:112
262724799179,6cyclictest2649033-21awk20:10:111
2627247991715,1cyclictest0-21swapper/123:28:231
2627247991715,1cyclictest0-21swapper/120:55:201
2627247991712,3cyclictest2635141-21acpi19:30:121
2627247991711,5cyclictest2644688-21gzip19:55:211
2627247991711,5cyclictest2644688-21gzip19:55:211
2627247991710,5cyclictest2738574-21sed00:20:221
262724599173,12cyclictest2674758-21cron21:25:000
2627245991713,3cyclictest13-21ksoftirqd/019:37:550
2627255991614,1cyclictest3056-21PK-Backend21:31:343
2627255991611,4cyclictest2645443-21sed20:00:003
2627255991611,4cyclictest2645443-21sed20:00:003
262725599160,14cyclictest2634166-21ntp_states19:25:173
2627251991614,1cyclictest0-21swapper/223:37:432
2627251991614,1cyclictest0-21swapper/222:11:522
262724799169,5cyclictest26-21ksoftirqd/119:25:011
2627247991614,1cyclictest3056-21PK-Backend23:07:561
2627247991611,3cyclictest2639583-21xargs19:40:221
2627245991614,1cyclictest0-21swapper/019:29:270
2627245991612,3cyclictest2640582-21cstates19:45:120
2627245991612,3cyclictest13-21ksoftirqd/019:25:000
2627255991510,3cyclictest2650749-21acpi20:15:103
262725199151,5cyclictest141rcu_preempt22:30:192
2627251991510,3cyclictest2632717-21pool-whoopsie19:22:552
262724799159,4cyclictest2632098-21uname19:20:181
2627247991513,1cyclictest0-21swapper/119:10:491
2627245991510,3cyclictest2635577-21idleruntime19:30:170
262724799148,4cyclictest2641048-21cut19:45:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional