You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 18:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Wed Jun 24, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90465521330,3sleep00-21swapper/008:40:020
96985921120,4sleep13056-21PK-Backend11:45:011
90931321050,3sleep13056-21PK-Backend08:50:221
87225127755,17sleep00-21swapper/007:08:000
87233227540,13sleep30-21swapper/307:09:043
87211026445,13sleep10-21swapper/107:06:121
87214626241,14sleep20-21swapper/207:06:412
9806882540,2sleep13056-21PK-Backend12:14:591
9552182490,4sleep13056-21PK-Backend11:00:221
8979672490,3sleep13056-21PK-Backend08:20:141
9717912470,4sleep13056-21PK-Backend11:50:101
9541022450,3sleep0161rcuc/011:00:010
9081152440,5sleep00-21swapper/008:50:010
87256599270,25cyclictest988936-21/usr/sbin/munin12:35:202
87256799261,12cyclictest0-21swapper/311:25:283
87256799250,9cyclictest873327-21missed_timers07:10:173
87256799240,9cyclictest903771-21timerandwakeup08:35:233
87256799240,14cyclictest0-21swapper/311:09:573
872560992418,5cyclictest26-21ksoftirqd/108:10:041
87256799238,7cyclictest0-21swapper/312:11:523
872567992321,1cyclictest0-21swapper/307:21:543
872567992315,5cyclictest908229-21apt08:50:113
87256799230,10cyclictest0-21swapper/310:35:203
872565992317,5cyclictest2019-21gmain11:50:002
872556992318,3cyclictest934467-21cron10:05:000
139099230,16rtkit-daemon3056-21PK-Backend10:55:201
872567992218,3cyclictest0-21swapper/308:11:223
872567992218,3cyclictest0-21swapper/308:00:473
87256799221,5cyclictest887162-21apt07:50:113
872565992220,1cyclictest0-21swapper/212:07:142
872565992220,1cyclictest0-21swapper/210:05:002
872565992220,1cyclictest0-21swapper/209:41:212
872565992220,1cyclictest0-21swapper/209:33:162
872565992220,1cyclictest0-21swapper/209:33:162
872565992220,1cyclictest0-21swapper/208:49:292
872565992220,1cyclictest0-21swapper/208:05:562
872565992213,7cyclictest928300-21ntp_states09:45:192
872560992220,1cyclictest3056-21PK-Backend10:13:001
872560992219,2cyclictest3056-21PK-Backend09:31:501
872560992219,2cyclictest3056-21PK-Backend09:31:501
872560992219,2cyclictest3056-21PK-Backend09:13:041
872560992219,2cyclictest3056-21PK-Backend08:46:281
872560992219,2cyclictest3056-21PK-Backend07:58:151
872560992219,2cyclictest3056-21PK-Backend07:54:231
872560992219,2cyclictest3056-21PK-Backend07:29:221
872560992219,2cyclictest3056-21PK-Backend07:14:011
87256099220,20cyclictest3056-21PK-Backend10:21:461
872556992215,6cyclictest971648-21/usr/sbin/munin11:50:120
87255699220,3cyclictest923111-21/usr/sbin/munin09:30:190
87255699220,3cyclictest923111-21/usr/sbin/munin09:30:190
8764252210,4sleep126-21ksoftirqd/107:19:591
872567992119,1cyclictest0-21swapper/311:33:063
872567992119,1cyclictest0-21swapper/311:03:323
872567992119,1cyclictest0-21swapper/310:42:163
872567992119,1cyclictest0-21swapper/307:47:503
872567992117,3cyclictest0-21swapper/310:16:143
872567992117,3cyclictest0-21swapper/307:15:393
87256799210,8cyclictest0-21swapper/307:29:353
87256799210,20cyclictest0-21swapper/312:34:103
87256799210,20cyclictest0-21swapper/311:57:393
87256799210,20cyclictest0-21swapper/310:00:413
87256799210,20cyclictest0-21swapper/309:24:363
87256799210,20cyclictest0-21swapper/308:59:423
87256799210,19cyclictest0-21swapper/309:30:443
87256799210,19cyclictest0-21swapper/309:30:443
872565992119,1cyclictest0-21swapper/212:25:392
872565992119,1cyclictest0-21swapper/211:54:582
872565992119,1cyclictest0-21swapper/210:55:362
872565992119,1cyclictest0-21swapper/210:52:322
872565992119,1cyclictest0-21swapper/210:45:492
872565992119,1cyclictest0-21swapper/210:34:072
872565992119,1cyclictest0-21swapper/210:16:282
872565992119,1cyclictest0-21swapper/210:12:512
872565992119,1cyclictest0-21swapper/209:18:292
872565992119,1cyclictest0-21swapper/208:58:562
872565992119,1cyclictest0-21swapper/208:25:572
872565992119,1cyclictest0-21swapper/207:54:202
872565992119,1cyclictest0-21swapper/207:44:402
872565992119,1cyclictest0-21swapper/207:24:052
872565992114,5cyclictest34-21ksoftirqd/211:35:112
872565992113,6cyclictest873456-21ntp_kernel_pll_07:10:182
87256599210,20cyclictest0-21swapper/211:10:572
87256599210,20cyclictest0-21swapper/210:08:382
87256599210,20cyclictest0-21swapper/208:53:212
872560992119,1cyclictest3056-21PK-Backend12:05:491
872560992119,1cyclictest3056-21PK-Backend11:06:071
872560992119,1cyclictest3056-21PK-Backend08:06:201
872560992118,2cyclictest3056-21PK-Backend11:14:311
872560992118,2cyclictest3056-21PK-Backend08:43:581
872560992118,2cyclictest3056-21PK-Backend07:43:011
87256099210,20cyclictest3056-21PK-Backend12:28:201
87256099210,20cyclictest3056-21PK-Backend11:26:351
87256099210,20cyclictest3056-21PK-Backend10:54:381
87256099210,20cyclictest3056-21PK-Backend10:31:191
87256099210,20cyclictest0-21swapper/109:35:291
87256099210,1cyclictest3056-21PK-Backend08:28:571
87256099210,19cyclictest3056-21PK-Backend11:56:161
87256099210,19cyclictest3056-21PK-Backend09:20:551
87256099210,19cyclictest3056-21PK-Backend08:03:151
872556992119,1cyclictest0-21swapper/010:44:480
872556992119,1cyclictest0-21swapper/009:09:370
872556992114,6cyclictest935401-21fw_packets10:05:140
139099210,14rtkit-daemon3056-21PK-Backend11:23:231
139099210,14rtkit-daemon0-21swapper/109:57:511
87256799209,9cyclictest970916-21sed11:45:213
872567992018,1cyclictest0-21swapper/312:39:173
872567992018,1cyclictest0-21swapper/311:41:443
872567992018,1cyclictest0-21swapper/310:31:203
872567992018,1cyclictest0-21swapper/310:11:273
872567992018,1cyclictest0-21swapper/310:06:063
872567992018,1cyclictest0-21swapper/309:10:033
872567992018,1cyclictest0-21swapper/309:02:463
872567992018,1cyclictest0-21swapper/308:46:373
872567992018,1cyclictest0-21swapper/308:05:483
872567992018,1cyclictest0-21swapper/307:59:263
872567992017,2cyclictest1-21systemd10:47:423
872567992014,4cyclictest973139-21sh11:55:003
872567992013,6cyclictest978064-21grep12:05:193
872567992012,7cyclictest962242-21seq11:20:223
872567992012,6cyclictest914580-21sed09:05:223
872567992011,7cyclictest985883-21chmod12:30:013
87256799200,8cyclictest917526-21diskstats09:15:143
87256799200,19cyclictest0-21swapper/312:20:523
87256799200,19cyclictest0-21swapper/312:20:513
87256799200,19cyclictest0-21swapper/310:56:483
87256799200,19cyclictest0-21swapper/309:56:063
87256799200,19cyclictest0-21swapper/308:29:273
87256799200,19cyclictest0-21swapper/307:41:283
87256799200,19cyclictest0-21swapper/307:32:013
872565992018,1cyclictest0-21swapper/212:31:212
872565992018,1cyclictest0-21swapper/212:13:232
872565992018,1cyclictest0-21swapper/211:43:152
872565992018,1cyclictest0-21swapper/211:27:062
872565992018,1cyclictest0-21swapper/211:01:452
872565992018,1cyclictest0-21swapper/210:36:372
872565992018,1cyclictest0-21swapper/208:30:232
872565992018,1cyclictest0-21swapper/208:03:262
872565992018,1cyclictest0-21swapper/207:48:322
872565992014,4cyclictest925334-21seq09:37:282
872565992013,5cyclictest34-21ksoftirqd/211:05:112
872565992013,5cyclictest34-21ksoftirqd/209:50:002
872565992012,7cyclictest882350-21cat07:35:162
872565992012,6cyclictest898424-21sensors_temp08:20:192
87256599200,1cyclictest0-21swapper/209:27:412
87256599200,19cyclictest0-21swapper/212:16:272
87256599200,19cyclictest0-21swapper/211:22:062
87256599200,19cyclictest0-21swapper/210:43:182
87256599200,19cyclictest0-21swapper/209:09:512
87256599200,19cyclictest0-21swapper/209:02:342
87256099209,8cyclictest936482-21munin-run10:10:011
872560992018,1cyclictest3056-21PK-Backend12:23:131
872560992018,1cyclictest3056-21PK-Backend12:23:131
872560992018,1cyclictest3056-21PK-Backend12:01:021
872560992018,1cyclictest3056-21PK-Backend11:48:241
872560992018,1cyclictest3056-21PK-Backend10:35:311
872560992018,1cyclictest3056-21PK-Backend09:28:121
872560992018,1cyclictest3056-21PK-Backend09:08:521
872560992018,1cyclictest3056-21PK-Backend08:57:371
872560992018,1cyclictest3056-21PK-Backend08:30:531
872560992018,1cyclictest3056-21PK-Backend07:49:571
872560992018,1cyclictest3056-21PK-Backend07:37:271
872560992018,1cyclictest0-21swapper/109:45:501
872560992017,2cyclictest3056-21PK-Backend12:30:021
872560992017,2cyclictest3056-21PK-Backend09:16:431
872560992017,2cyclictest3056-21PK-Backend09:02:571
872560992012,6cyclictest942917-21ntpq10:25:181
872560992012,6cyclictest942917-21ntpq10:25:181
87256099200,18cyclictest3056-21PK-Backend07:32:261
872556992018,1cyclictest0-21swapper/012:32:020
872556992018,1cyclictest0-21swapper/012:16:480
872556992013,5cyclictest931007-21sh09:55:000
872556992012,6cyclictest436-20systemd-journal11:50:000
872556992011,7cyclictest955797-21cron11:05:000
87255699200,1cyclictest0-21swapper/011:41:330
87255699200,19cyclictest3056-21PK-Backend12:36:010
87255699200,19cyclictest0-21swapper/011:59:100
87255699200,19cyclictest0-21swapper/009:24:110
87255699200,19cyclictest0-21swapper/009:00:380
872567991917,1cyclictest0-21swapper/310:53:113
872567991917,1cyclictest0-21swapper/309:47:273
872567991917,1cyclictest0-21swapper/309:41:523
872567991917,1cyclictest0-21swapper/308:24:273
872567991915,3cyclictest0-21swapper/311:12:453
87256799191,16cyclictest959895-21df11:15:143
872567991911,6cyclictest930129-21memory09:50:173
872567991911,6cyclictest904816-21awk08:40:113
872567991910,7cyclictest975811-21ls12:00:163
87256799190,1cyclictest0-21swapper/311:36:103
87256799190,1cyclictest0-21swapper/309:36:533
87256799190,1cyclictest0-21swapper/307:37:013
87256799190,18cyclictest0-21swapper/308:31:233
872565991917,1cyclictest0-21swapper/209:56:552
872565991917,1cyclictest0-21swapper/209:20:592
872565991917,1cyclictest0-21swapper/208:41:112
872565991917,1cyclictest0-21swapper/207:59:342
872565991917,1cyclictest0-21swapper/207:33:182
872565991913,4cyclictest34-21ksoftirqd/212:25:002
872565991913,4cyclictest34-21ksoftirqd/212:25:002
87256599190,18cyclictest0-21swapper/208:39:492
872560991917,1cyclictest3056-21PK-Backend12:18:261
872560991917,1cyclictest3056-21PK-Backend09:52:321
872560991917,1cyclictest3056-21PK-Backend09:42:451
872560991917,1cyclictest3056-21PK-Backend08:15:321
872560991916,2cyclictest3056-21PK-Backend11:36:561
872560991916,2cyclictest3056-21PK-Backend10:44:301
872556991917,1cyclictest0-21swapper/012:05:530
872556991917,1cyclictest0-21swapper/012:02:150
872556991917,1cyclictest0-21swapper/011:38:290
872556991917,1cyclictest0-21swapper/011:25:380
872556991917,1cyclictest0-21swapper/011:06:040
872556991917,1cyclictest0-21swapper/010:48:270
872556991917,1cyclictest0-21swapper/010:36:230
872556991917,1cyclictest0-21swapper/010:20:080
872556991917,1cyclictest0-21swapper/008:31:110
872556991917,1cyclictest0-21swapper/008:23:410
872556991917,1cyclictest0-21swapper/008:15:020
872556991917,1cyclictest0-21swapper/008:03:540
872556991917,1cyclictest0-21swapper/007:57:320
872556991917,1cyclictest0-21swapper/007:27:170
872556991913,5cyclictest909088-21python308:50:190
872556991912,5cyclictest874574-21awk07:15:020
87255699190,1cyclictest3056-21PK-Backend07:40:210
87255699190,1cyclictest3056-21PK-Backend07:12:300
87255699190,1cyclictest0-21swapper/012:29:120
87255699190,1cyclictest0-21swapper/011:32:200
87255699190,1cyclictest0-21swapper/009:37:010
87255699190,1cyclictest0-21swapper/008:36:120
87255699190,1cyclictest0-21swapper/008:13:060
87255699190,1cyclictest0-21swapper/007:38:250
87255699190,18cyclictest0-21swapper/011:23:070
87255699190,18cyclictest0-21swapper/010:33:190
87255699190,18cyclictest0-21swapper/010:15:210
87255699190,18cyclictest0-21swapper/009:44:180
87255699190,18cyclictest0-21swapper/009:16:540
87255699190,18cyclictest0-21swapper/008:56:260
87255699190,18cyclictest0-21swapper/008:26:110
87255699190,18cyclictest0-21swapper/007:47:180
87256799189,7cyclictest940349-21dpkg10:20:013
872567991816,1cyclictest0-21swapper/308:19:263
87256799180,16cyclictest920616-21apt09:25:093
872565991816,1cyclictest0-21swapper/212:04:102
872565991816,1cyclictest0-21swapper/210:20:072
872565991815,2cyclictest1095-21runrttasks07:16:302
872565991813,4cyclictest34-21ksoftirqd/211:30:102
872565991813,3cyclictest896346-21latency08:15:162
872565991812,5cyclictest916284-21swap09:10:212
872565991812,5cyclictest34-21ksoftirqd/208:10:112
872565991811,5cyclictest879337-21cat07:25:202
872556991816,1cyclictest0-21swapper/010:29:410
872556991816,1cyclictest0-21swapper/010:29:410
872556991816,1cyclictest0-21swapper/009:26:410
872556991815,2cyclictest0-21swapper/009:12:420
872567991715,1cyclictest0-21swapper/312:17:133
87256799170,15cyclictest942202-21apt10:25:113
87256799170,15cyclictest942202-21apt10:25:113
87256599172,14cyclictest1095-21runrttasks11:19:222
872565991711,5cyclictest34-21ksoftirqd/211:55:022
872560991715,1cyclictest3056-21PK-Backend11:33:171
872560991715,1cyclictest3056-21PK-Backend11:18:441
872560991715,1cyclictest3056-21PK-Backend10:49:161
872560991714,2cyclictest3056-21PK-Backend08:38:581
872556991715,1cyclictest0-21swapper/007:32:510
139099170,3rtkit-daemon0-21swapper/012:12:150
87256599168,6cyclictest942960-21awk10:25:192
87256599168,6cyclictest942960-21awk10:25:192
872560991611,3cyclictest988045-21/usr/sbin/munin12:35:141
872556991614,1cyclictest3056-21PK-Backend09:55:270
872556991614,1cyclictest3056-21PK-Backend09:46:490
872556991614,1cyclictest0-21swapper/012:23:310
872556991614,1cyclictest0-21swapper/012:23:300
872556991614,1cyclictest0-21swapper/008:06:240
872556991614,1cyclictest0-21swapper/007:51:100
872556991611,4cyclictest960235-21awk11:15:180
872560991513,1cyclictest3056-21PK-Backend10:01:451
87255699159,5cyclictest936911-21tr10:10:110
872556991512,2cyclictest878382-21cat07:25:000
872556991510,3cyclictest950858-21acpi10:50:110
87256099141,10cyclictest939958-21awk10:20:001
872556991412,1cyclictest0-21swapper/011:12:470
139099120,4rtkit-daemon3056-21PK-Backend07:22:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional