You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 00:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Wed Aug 12, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
343997321250,3sleep20-21swapper/210:00:212
346282521240,3sleep10-21swapper/111:05:211
344863621110,3sleep00-21swapper/010:25:230
341742221040,2sleep10-21swapper/108:55:211
33774232900,6sleep20-21swapper/207:05:222
337788327439,13sleep30-21swapper/307:06:443
337797527338,9sleep00-21swapper/007:07:540
337736927348,16sleep10-21swapper/107:05:221
34012172500,3sleep10-21swapper/108:10:221
34644922440,4sleep33056-21PK-Backend11:10:203
34250692430,3sleep20-21swapper/209:20:002
34896352390,2sleep33056-21PK-Backend12:25:103
33787172370,2sleep30-21swapper/307:10:133
34713682360,3sleep10-21swapper/111:30:191
33815542280,3sleep00-21swapper/007:15:190
34850702270,4sleep33056-21PK-Backend12:10:203
337826099260,24cyclictest3392103-21/usr/sbin/munin07:45:221
34048392250,3chrt0-21swapper/008:20:240
3378254992318,3cyclictest13-21ksoftirqd/011:25:000
3378268992219,2cyclictest3056-21PK-Backend11:18:293
3378263992214,6cyclictest3477214-21cron11:49:592
3378260992220,1cyclictest0-21swapper/109:50:411
3378260992220,1cyclictest0-21swapper/107:30:221
337826099220,20cyclictest3056-21PK-Backend11:57:421
3378254992220,1cyclictest0-21swapper/012:35:340
3378254992220,1cyclictest0-21swapper/011:32:070
3378254992220,1cyclictest0-21swapper/011:05:030
3378254992220,1cyclictest0-21swapper/009:44:530
3378254992220,1cyclictest0-21swapper/009:09:240
3378254992220,1cyclictest0-21swapper/008:39:090
337825499221,14cyclictest1788620-21WebKitWebProces08:50:120
139099220,15rtkit-daemon3056-21PK-Backend10:01:413
34883092210,5sleep20-21swapper/212:20:172
3378268992119,1cyclictest3056-21PK-Backend12:22:453
3378268992118,2cyclictest3056-21PK-Backend08:39:523
337826899210,1cyclictest3056-21PK-Backend08:00:183
337826899210,19cyclictest3056-21PK-Backend12:36:243
337826899210,19cyclictest3056-21PK-Backend10:18:073
337826899210,19cyclictest3056-21PK-Backend09:48:473
3378263992119,1cyclictest0-21swapper/209:42:182
3378263992119,1cyclictest0-21swapper/208:13:432
3378263992113,6cyclictest436-20systemd-journal08:10:012
337826399210,20cyclictest0-21swapper/207:11:442
337826399210,19cyclictest0-21swapper/209:31:172
337826099216,13cyclictest3440605-21unin-run10:05:011
3378260992119,1cyclictest3056-21PK-Backend10:26:511
3378260992119,1cyclictest0-21swapper/112:39:541
3378260992119,1cyclictest0-21swapper/112:32:581
3378260992119,1cyclictest0-21swapper/111:29:101
3378260992119,1cyclictest0-21swapper/111:24:241
3378260992119,1cyclictest0-21swapper/110:42:121
3378260992119,1cyclictest0-21swapper/110:07:511
3378260992119,1cyclictest0-21swapper/109:43:241
3378260992119,1cyclictest0-21swapper/109:16:541
3378260992119,1cyclictest0-21swapper/109:14:591
3378260992119,1cyclictest0-21swapper/108:32:001
3378260992119,1cyclictest0-21swapper/108:21:581
3378260992119,1cyclictest0-21swapper/107:26:091
3378260992119,1cyclictest0-21swapper/107:15:341
3378260992119,1cyclictest0-21swapper/107:12:241
337826099210,20cyclictest0-21swapper/112:24:521
337826099210,20cyclictest0-21swapper/110:14:331
3378254992119,1cyclictest3056-21PK-Backend10:30:010
3378254992119,1cyclictest0-21swapper/012:05:320
3378254992119,1cyclictest0-21swapper/011:47:280
3378254992119,1cyclictest0-21swapper/011:41:520
3378254992119,1cyclictest0-21swapper/011:15:020
3378254992119,1cyclictest0-21swapper/011:13:060
3378254992119,1cyclictest0-21swapper/010:50:160
3378254992119,1cyclictest0-21swapper/010:36:230
3378254992119,1cyclictest0-21swapper/010:19:120
3378254992119,1cyclictest0-21swapper/008:42:400
3378254992119,1cyclictest0-21swapper/008:16:310
3378254992119,1cyclictest0-21swapper/008:08:540
3378254992119,1cyclictest0-21swapper/007:37:380
3378254992116,3cyclictest3428715-21apt09:30:120
337825499210,20cyclictest3056-21PK-Backend07:55:490
337825499210,20cyclictest3056-21PK-Backend07:21:220
337825499210,20cyclictest0-21swapper/010:03:040
337825499210,20cyclictest0-21swapper/009:55:470
337825499210,20cyclictest0-21swapper/008:46:530
337825499210,20cyclictest0-21swapper/008:28:400
337825499210,19cyclictest3056-21PK-Backend08:55:300
139099210,15rtkit-daemon3056-21PK-Backend07:43:033
139099210,14rtkit-daemon0-21swapper/210:16:422
34929892200,8sleep234-21ksoftirqd/212:35:012
3378268992018,1cyclictest0-21swapper/312:04:063
3378268992018,1cyclictest0-21swapper/310:33:563
3378268992014,4cyclictest2156-21gnome-shell07:37:093
3378268992012,6cyclictest3427362-21/usr/sbin/munin09:25:143
337826899201,17cyclictest883-21dbus-daemon09:20:003
337826899200,1cyclictest3056-21PK-Backend11:43:443
337826899200,1cyclictest3056-21PK-Backend10:47:133
337826899200,1cyclictest3056-21PK-Backend08:47:573
337826899200,1cyclictest3056-21PK-Backend07:15:023
337826899200,19cyclictest3056-21PK-Backend11:52:583
337826899200,19cyclictest3056-21PK-Backend10:09:293
337826899200,19cyclictest3056-21PK-Backend08:12:013
337826899200,19cyclictest0-21swapper/311:58:323
337826899200,19cyclictest0-21swapper/310:27:343
337826899200,19cyclictest0-21swapper/309:55:293
337826899200,19cyclictest0-21swapper/309:11:153
337826899200,19cyclictest0-21swapper/309:01:343
337826899200,19cyclictest0-21swapper/307:30:503
3378263992018,1cyclictest0-21swapper/208:42:432
3378263992018,1cyclictest0-21swapper/208:37:492
3378263992014,5cyclictest3449224-21cron10:29:592
3378263992013,5cyclictest3464341-21ntp_kernel_pll_11:10:182
337826399200,1cyclictest0-21swapper/212:05:082
337826399200,19cyclictest0-21swapper/212:29:292
337826399200,19cyclictest0-21swapper/212:02:382
337826399200,19cyclictest0-21swapper/210:52:482
337826399200,19cyclictest0-21swapper/209:51:522
337826399200,19cyclictest0-21swapper/207:40:302
337826099202,17cyclictest1095-21runrttasks11:13:311
3378260992018,1cyclictest0-21swapper/112:07:501
3378260992018,1cyclictest0-21swapper/111:50:261
3378260992018,1cyclictest0-21swapper/111:47:221
3378260992018,1cyclictest0-21swapper/111:44:521
3378260992018,1cyclictest0-21swapper/110:46:381
3378260992018,1cyclictest0-21swapper/108:26:531
3378260992018,1cyclictest0-21swapper/107:50:491
3378260992013,5cyclictest3428831-21wc09:30:131
3378260992012,6cyclictest26-21ksoftirqd/112:10:131
337826099200,19cyclictest0-21swapper/111:03:271
337826099200,19cyclictest0-21swapper/110:50:171
337826099200,19cyclictest0-21swapper/109:38:381
337826099200,19cyclictest0-21swapper/108:15:441
337826099200,19cyclictest0-21swapper/108:08:551
337825499209,8cyclictest3456170-21perf10:49:590
3378254992018,1cyclictest0-21swapper/011:35:100
3378254992018,1cyclictest0-21swapper/009:12:420
3378254992018,1cyclictest0-21swapper/008:34:360
3378254992018,1cyclictest0-21swapper/007:11:350
3378254992013,5cyclictest3401634-21sh08:15:010
337825499200,19cyclictest3056-21PK-Backend09:20:310
337825499200,19cyclictest3056-21PK-Backend07:28:580
337825499200,19cyclictest0-21swapper/012:34:110
337825499200,19cyclictest0-21swapper/009:15:590
337825499200,19cyclictest0-21swapper/007:44:410
337825499200,18cyclictest3441288-21cat10:05:170
139099200,13rtkit-daemon0-21swapper/210:30:372
3378268991917,1cyclictest3056-21PK-Backend11:49:523
3378268991917,1cyclictest3056-21PK-Backend09:38:403
3378268991917,1cyclictest3056-21PK-Backend08:42:023
3378268991917,1cyclictest3056-21PK-Backend08:26:413
3378268991917,1cyclictest3056-21PK-Backend07:24:493
3378268991917,1cyclictest0-21swapper/312:06:013
3378268991917,1cyclictest0-21swapper/308:21:003
3378268991916,2cyclictest3056-21PK-Backend10:11:593
337826899191,4cyclictest3459292-21python310:55:213
3378268991911,6cyclictest3436759-21sshd09:50:443
337826899191,13cyclictest1095-21runrttasks12:15:223
337826899190,1cyclictest3056-21PK-Backend11:35:543
337826899190,1cyclictest3056-21PK-Backend08:30:593
337826899190,1cyclictest3056-21PK-Backend08:05:583
337826899190,1cyclictest3056-21PK-Backend07:52:483
337826899190,1cyclictest0-21swapper/310:35:523
337826899190,18cyclictest3056-21PK-Backend11:06:483
337826899190,18cyclictest3056-21PK-Backend08:16:063
337826899190,18cyclictest0-21swapper/307:29:023
3378263991917,1cyclictest0-21swapper/212:18:332
3378263991917,1cyclictest0-21swapper/211:21:552
3378263991917,1cyclictest0-21swapper/210:55:522
3378263991917,1cyclictest0-21swapper/208:54:332
3378263991917,1cyclictest0-21swapper/207:33:422
3378263991914,3cyclictest3387882-21grep07:35:122
3378263991912,6cyclictest3408838-21cron08:35:002
3378263991912,5cyclictest3418015-21cron09:00:002
3378263991912,5cyclictest3395427-21ntpq07:55:172
337826399190,1cyclictest0-21swapper/212:38:062
337826399190,1cyclictest0-21swapper/211:40:482
337826399190,1cyclictest0-21swapper/211:00:062
337826399190,1cyclictest0-21swapper/209:47:392
337826399190,1cyclictest0-21swapper/209:09:002
337826399190,1cyclictest0-21swapper/207:51:472
337826399190,18cyclictest0-21swapper/211:56:302
3378260991917,1cyclictest0-21swapper/110:56:111
3378260991917,1cyclictest0-21swapper/109:07:291
3378260991917,1cyclictest0-21swapper/109:04:591
3378260991917,1cyclictest0-21swapper/108:00:441
3378260991916,2cyclictest3056-21PK-Backend08:52:211
337826099190,1cyclictest0-21swapper/108:43:561
337826099190,1cyclictest0-21swapper/107:40:091
337826099190,18cyclictest3056-21PK-Backend10:24:211
337825499198,8cyclictest883-21dbus-daemon12:29:480
3378254991917,1cyclictest3056-21PK-Backend12:00:310
3378254991917,1cyclictest0-21swapper/012:23:370
3378254991917,1cyclictest0-21swapper/010:40:480
3378254991917,1cyclictest0-21swapper/010:21:080
3378254991917,1cyclictest0-21swapper/008:02:310
3378254991917,1cyclictest0-21swapper/007:45:420
3378254991912,5cyclictest3478205-21seq11:50:200
3378254991912,5cyclictest3469013-21grep11:25:130
337825499190,1cyclictest0-21swapper/012:16:070
337825499190,1cyclictest0-21swapper/011:03:070
337825499190,1cyclictest0-21swapper/009:01:050
337825499190,1cyclictest0-21swapper/007:51:100
3378268991816,1cyclictest3056-21PK-Backend10:44:093
3378268991816,1cyclictest0-21swapper/310:20:023
3378268991816,1cyclictest0-21swapper/308:51:013
3378268991815,2cyclictest3056-21PK-Backend11:20:263
3378268991810,6cyclictest3395629-21cat07:55:203
337826899180,1cyclictest3056-21PK-Backend12:34:273
337826899180,16cyclictest3425436-21grep09:20:133
337826399189,7cyclictest436-20systemd-journal11:20:012
3378263991816,1cyclictest0-21swapper/210:21:192
3378263991816,1cyclictest0-21swapper/209:02:032
3378263991814,3cyclictest978-21snmpd07:47:582
3378263991812,5cyclictest883-21dbus-daemon09:28:012
3378263991811,5cyclictest3425613-21df09:20:142
3378263991810,6cyclictest3451984-21ntp_states10:35:192
337826399180,17cyclictest0-21swapper/208:16:262
3378260991816,1cyclictest3056-21PK-Backend12:15:531
3378260991811,5cyclictest3410178-21awk08:35:221
3378260991811,5cyclictest26-21ksoftirqd/112:25:131
3378260991811,5cyclictest26-21ksoftirqd/111:35:121
3378260991810,4cyclictest34130572sleep108:45:031
337826099180,1cyclictest0-21swapper/109:47:361
3378254991816,1cyclictest3056-21PK-Backend07:30:480
3378254991815,2cyclictest3056-21PK-Backend09:51:000
3378254991811,5cyclictest3434253-21expr09:45:140
3378254991810,6cyclictest3484827-21which12:10:170
3378268991715,1cyclictest3056-21PK-Backend11:30:343
3378268991715,1cyclictest3056-21PK-Backend11:25:133
3378268991715,1cyclictest3056-21PK-Backend09:44:003
3378268991715,1cyclictest3056-21PK-Backend07:49:093
3378268991710,6cyclictest82332-21update-manager09:09:473
3378268991710,6cyclictest42-21ksoftirqd/308:55:113
337826399179,7cyclictest3385687-21cron07:30:002
3378263991715,1cyclictest0-21swapper/212:11:162
3378263991715,1cyclictest0-21swapper/211:07:222
3378263991715,1cyclictest0-21swapper/209:10:212
3378263991715,1cyclictest0-21swapper/208:01:062
3378263991713,3cyclictest3473765-21idleruntime-cro11:40:002
3378263991712,3cyclictest978-21snmpd09:56:172
3378263991710,6cyclictest3431190-21ntp_states09:35:192
3378263991710,6cyclictest1-21systemd07:25:002
337826399170,1cyclictest0-21swapper/207:19:292
337826099179,6cyclictest3438845-21cron10:00:001
337826099172,11cyclictest3451242-21apt10:35:101
3378260991715,1cyclictest3056-21PK-Backend10:34:411
3378260991710,5cyclictest26-21ksoftirqd/110:15:201
337826099170,15cyclictest3056-21PK-Backend09:20:061
337825499177,8cyclictest883-21dbus-daemon10:15:010
3378254991715,1cyclictest0-21swapper/010:56:240
3378254991715,1cyclictest0-21swapper/009:25:040
3378268991614,1cyclictest3056-21PK-Backend10:50:173
3378263991614,1cyclictest0-21swapper/208:29:462
337826399161,13cyclictest3470730-21tr11:30:122
3378263991610,4cyclictest3469556-21awk11:25:182
337826399160,7cyclictest3414563-21munin-plugin-st08:50:002
3378260991614,1cyclictest3056-21PK-Backend12:01:541
3378260991614,1cyclictest3056-21PK-Backend07:57:051
3378260991611,3cyclictest3383243-21sh07:20:191
337826099161,11cyclictest3466224-21python311:15:201
3378260991610,4cyclictest3428158-21seq09:26:361
337826099160,15cyclictest3056-21PK-Backend07:37:321
337825499169,5cyclictest1-21systemd12:00:010
3378268991511,3cyclictest3056-21PK-Backend11:01:103
337826399159,5cyclictest3477997-21cut11:50:172
337826399158,5cyclictest3404007-21cat08:20:142
3378263991513,1cyclictest0-21swapper/210:09:502
3378263991511,2cyclictest3455231-21latency10:45:182
3378263991510,4cyclictest3453469-21sed10:40:172
337825499159,4cyclictest3430623-21grep09:35:130
337826399145,7cyclictest0-21swapper/210:13:442
337826899129,2cyclictest3056-21PK-Backend09:31:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional