You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 18:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun May 03, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
89351021430,6sleep20-21swapper/212:00:122
82893421260,1sleep20-21swapper/208:55:192
82669821260,4sleep13056-21PK-Backend08:50:131
83909321160,3sleep30-21swapper/309:25:033
85543221120,2sleep30-21swapper/310:10:153
79317121100,4sleep20-21swapper/207:15:032
79062027341,25sleep30-21swapper/307:06:173
139099720,59rtkit-daemon0-21swapper/207:07:432
79091126747,11sleep10-21swapper/107:10:011
79063726644,14sleep00-21swapper/007:06:310
8272452350,3sleep00-21swapper/008:50:190
79105199289,4cyclictest856660-21sed10:15:002
7977462260,3chrt0-21swapper/207:25:212
79105199257,4cyclictest0-21swapper/209:20:172
791051992417,1cyclictest0-21swapper/209:16:492
8688762230,8sleep234-21ksoftirqd/210:50:122
791051992318,3cyclictest819245-21cron08:30:002
791051992318,3cyclictest819245-21cron08:30:002
79105199231,7cyclictest853268-21apt10:05:122
79104999230,21cyclictest3056-21PK-Backend11:32:491
791044992321,1cyclictest0-21swapper/010:25:340
791044992321,1cyclictest0-21swapper/008:13:130
791054992220,1cyclictest3056-21PK-Backend10:52:053
791054992220,1cyclictest0-21swapper/309:53:183
791054992219,2cyclictest3056-21PK-Backend11:08:273
791054992219,2cyclictest3056-21PK-Backend08:36:393
791054992219,2cyclictest3056-21PK-Backend07:25:543
79105499221,18cyclictest843725-21python309:35:213
79105199229,11cyclictest807115-21cron07:55:002
791051992218,2cyclictest978-21snmpd07:12:242
791051992217,4cyclictest0-21swapper/211:57:302
791049992220,1cyclictest3056-21PK-Backend09:26:551
791049992220,1cyclictest0-21swapper/111:45:331
791049992220,1cyclictest0-21swapper/110:29:421
791049992220,1cyclictest0-21swapper/109:00:061
791049992220,1cyclictest0-21swapper/107:12:521
79104999220,20cyclictest3056-21PK-Backend10:10:231
79104999220,20cyclictest0-21swapper/112:15:471
79104999220,20cyclictest0-21swapper/112:15:471
791044992220,1cyclictest3056-21PK-Backend07:55:210
791044992220,1cyclictest0-21swapper/012:23:090
791044992220,1cyclictest0-21swapper/011:55:310
791044992220,1cyclictest0-21swapper/011:21:030
791044992220,1cyclictest0-21swapper/011:12:330
791044992220,1cyclictest0-21swapper/010:52:170
791044992220,1cyclictest0-21swapper/010:01:200
791044992220,1cyclictest0-21swapper/009:53:170
791044992220,1cyclictest0-21swapper/009:29:160
791044992220,1cyclictest0-21swapper/009:20:380
791044992220,1cyclictest0-21swapper/009:07:000
791044992220,1cyclictest0-21swapper/008:38:480
791044992220,1cyclictest0-21swapper/007:48:050
79104499220,20cyclictest3056-21PK-Backend12:30:130
139099220,15rtkit-daemon3056-21PK-Backend09:07:203
139099220,14rtkit-daemon0-21swapper/208:39:352
791054992119,1cyclictest3056-21PK-Backend11:02:593
791054992119,1cyclictest3056-21PK-Backend09:13:023
791054992119,1cyclictest3056-21PK-Backend07:11:083
791054992119,1cyclictest0-21swapper/312:33:583
791054992119,1cyclictest0-21swapper/311:53:013
791054992119,1cyclictest0-21swapper/311:44:443
791054992119,1cyclictest0-21swapper/311:34:363
791054992119,1cyclictest0-21swapper/311:25:163
791054992119,1cyclictest0-21swapper/310:37:173
791054992119,1cyclictest0-21swapper/310:31:503
791054992119,1cyclictest0-21swapper/309:22:293
791054992119,1cyclictest0-21swapper/308:32:263
791054992119,1cyclictest0-21swapper/308:16:043
791054992119,1cyclictest0-21swapper/307:37:033
791054992118,2cyclictest3056-21PK-Backend10:59:213
791054992113,6cyclictest883-21dbus-daemon10:05:003
791054992110,3cyclictest8924632processes11:55:213
79105499210,2cyclictest829666-21apt-get09:00:043
79105499210,20cyclictest0-21swapper/312:21:413
79105499210,20cyclictest0-21swapper/311:18:353
79105499210,20cyclictest0-21swapper/311:18:353
791051992119,1cyclictest0-21swapper/209:01:002
791051992113,7cyclictest883-21dbus-daemon09:39:362
791051992111,8cyclictest883-21dbus-daemon10:00:012
79104999218,3cyclictest8935112ls12:00:131
791049992119,1cyclictest3056-21PK-Backend12:22:381
791049992119,1cyclictest3056-21PK-Backend11:12:341
791049992119,1cyclictest3056-21PK-Backend10:21:371
791049992119,1cyclictest3056-21PK-Backend09:52:031
791049992119,1cyclictest3056-21PK-Backend08:27:071
791049992119,1cyclictest3056-21PK-Backend08:27:061
791049992119,1cyclictest3056-21PK-Backend08:06:261
791049992119,1cyclictest0-21swapper/112:37:171
791049992119,1cyclictest0-21swapper/111:07:071
791049992119,1cyclictest0-21swapper/107:23:191
791049992118,2cyclictest3056-21PK-Backend09:32:581
79104999210,20cyclictest3056-21PK-Backend11:51:001
79104999210,20cyclictest0-21swapper/107:15:481
79104999210,19cyclictest3056-21PK-Backend11:44:311
79104999210,19cyclictest3056-21PK-Backend11:20:521
79104999210,19cyclictest3056-21PK-Backend11:16:121
79104999210,19cyclictest3056-21PK-Backend11:16:121
79104999210,19cyclictest3056-21PK-Backend10:19:481
79104999210,19cyclictest3056-21PK-Backend09:20:061
791044992119,1cyclictest3056-21PK-Backend10:20:070
791044992119,1cyclictest0-21swapper/011:40:450
791044992119,1cyclictest0-21swapper/011:15:230
791044992119,1cyclictest0-21swapper/011:15:220
791044992119,1cyclictest0-21swapper/010:47:380
791044992119,1cyclictest0-21swapper/008:21:240
791044992119,1cyclictest0-21swapper/007:24:390
791044992118,2cyclictest0-21swapper/011:05:160
791044992113,7cyclictest812006-21sshd08:06:100
79104499210,20cyclictest0-21swapper/012:10:050
79104499210,20cyclictest0-21swapper/012:04:360
79104499210,20cyclictest0-21swapper/009:35:330
79104499210,20cyclictest0-21swapper/009:15:250
79104499210,20cyclictest0-21swapper/008:34:350
79104499210,19cyclictest0-21swapper/011:50:510
139099210,14rtkit-daemon3056-21PK-Backend10:29:413
139099210,14rtkit-daemon3056-21PK-Backend08:25:103
139099210,14rtkit-daemon3056-21PK-Backend08:25:093
139099210,14rtkit-daemon3056-21PK-Backend07:16:053
791054992018,1cyclictest3056-21PK-Backend08:40:513
791054992018,1cyclictest3056-21PK-Backend07:21:223
791054992018,1cyclictest0-21swapper/312:26:073
791054992018,1cyclictest0-21swapper/312:08:363
791054992018,1cyclictest0-21swapper/309:41:493
791054992018,1cyclictest0-21swapper/307:43:263
791054992015,4cyclictest978-21snmpd10:06:283
79105499200,19cyclictest0-21swapper/312:11:143
79105499200,19cyclictest0-21swapper/312:03:093
79105499200,19cyclictest0-21swapper/311:24:153
79105499200,19cyclictest0-21swapper/307:46:573
791051992018,1cyclictest0-21swapper/211:09:022
791051992018,1cyclictest0-21swapper/210:25:572
791051992018,1cyclictest0-21swapper/210:22:192
791051992018,1cyclictest0-21swapper/209:28:042
791051992013,4cyclictest1095-21runrttasks07:30:212
79105199200,19cyclictest3056-21PK-Backend08:22:342
79105199200,19cyclictest0-21swapper/212:25:552
79105199200,19cyclictest0-21swapper/212:12:502
79105199200,19cyclictest0-21swapper/211:51:012
79105199200,19cyclictest0-21swapper/211:39:512
79105199200,19cyclictest0-21swapper/211:26:542
79105199200,19cyclictest0-21swapper/211:03:352
79105199200,19cyclictest0-21swapper/210:16:032
79105199200,19cyclictest0-21swapper/210:03:332
79105199200,19cyclictest0-21swapper/209:50:152
79105199200,19cyclictest0-21swapper/209:32:312
79105199200,19cyclictest0-21swapper/208:52:022
79105199200,19cyclictest0-21swapper/208:45:122
79105199200,19cyclictest0-21swapper/208:41:472
79105199200,19cyclictest0-21swapper/208:11:112
79105199200,19cyclictest0-21swapper/207:48:282
79105199200,18cyclictest0-21swapper/212:07:362
791049992018,1cyclictest3056-21PK-Backend10:45:031
791049992018,1cyclictest0-21swapper/109:10:401
791049992017,2cyclictest3056-21PK-Backend10:07:461
791049992017,2cyclictest3056-21PK-Backend09:39:001
79104999200,19cyclictest3056-21PK-Backend12:32:041
79104999200,18cyclictest3056-21PK-Backend12:26:031
79104999200,18cyclictest3056-21PK-Backend07:34:151
791044992018,1cyclictest3056-21PK-Backend10:31:010
791044992018,1cyclictest0-21swapper/012:38:030
791044992018,1cyclictest0-21swapper/012:05:390
791044992018,1cyclictest0-21swapper/010:56:570
791044992018,1cyclictest0-21swapper/010:44:480
791044992018,1cyclictest0-21swapper/010:07:370
791044992018,1cyclictest0-21swapper/009:12:480
791044992018,1cyclictest0-21swapper/008:43:000
791044992018,1cyclictest0-21swapper/008:29:340
791044992018,1cyclictest0-21swapper/008:29:340
791044992018,1cyclictest0-21swapper/007:41:360
791044992018,1cyclictest0-21swapper/007:30:130
79104499200,1cyclictest0-21swapper/009:57:420
79104499200,1cyclictest0-21swapper/007:13:240
79104499200,19cyclictest0-21swapper/012:18:440
79104499200,19cyclictest0-21swapper/012:18:430
79104499200,19cyclictest0-21swapper/011:37:540
79104499200,19cyclictest0-21swapper/011:04:140
79104499200,19cyclictest0-21swapper/010:12:030
79104499200,19cyclictest0-21swapper/009:47:020
79104499200,19cyclictest0-21swapper/007:35:480
139099200,13rtkit-daemon0-21swapper/208:05:012
791054991917,1cyclictest0-21swapper/311:12:063
791054991917,1cyclictest0-21swapper/309:48:523
791054991917,1cyclictest0-21swapper/309:15:393
791054991917,1cyclictest0-21swapper/308:57:403
791054991917,1cyclictest0-21swapper/308:51:053
791054991917,1cyclictest0-21swapper/308:01:433
791054991914,3cyclictest816435-21diskstats08:20:143
791054991912,5cyclictest808808-21sshd07:59:353
79105499190,1cyclictest0-21swapper/312:19:523
79105499190,1cyclictest0-21swapper/312:19:513
79105499190,1cyclictest0-21swapper/310:22:453
79105499190,1cyclictest0-21swapper/310:19:063
79105499190,1cyclictest0-21swapper/307:53:263
79105499190,18cyclictest0-21swapper/309:55:073
79105499190,18cyclictest0-21swapper/308:45:043
791051991917,1cyclictest0-21swapper/211:42:422
791051991917,1cyclictest0-21swapper/210:46:122
791051991917,1cyclictest0-21swapper/210:43:202
791051991917,1cyclictest0-21swapper/209:45:482
791051991913,4cyclictest436-20systemd-journal12:33:102
791051991912,5cyclictest815247-21cat08:15:212
79105199190,1cyclictest0-21swapper/211:48:102
79105199190,1cyclictest0-21swapper/211:21:132
79105199190,1cyclictest0-21swapper/210:58:082
79105199190,1cyclictest0-21swapper/208:03:142
79105199190,1cyclictest0-21swapper/207:55:442
79105199190,18cyclictest0-21swapper/211:15:322
79105199190,18cyclictest0-21swapper/211:15:312
79105199190,18cyclictest0-21swapper/211:12:412
79105199190,18cyclictest0-21swapper/210:36:512
79105199190,18cyclictest0-21swapper/210:31:252
79105199190,18cyclictest0-21swapper/209:41:222
79105199190,18cyclictest0-21swapper/209:11:342
791049991917,1cyclictest3056-21PK-Backend12:08:111
791049991917,1cyclictest3056-21PK-Backend11:58:181
791049991917,1cyclictest3056-21PK-Backend10:37:471
791049991917,1cyclictest3056-21PK-Backend10:33:211
791049991917,1cyclictest3056-21PK-Backend09:16:411
791049991917,1cyclictest3056-21PK-Backend07:47:181
791049991917,1cyclictest0-21swapper/108:35:191
791049991917,1cyclictest0-21swapper/108:00:171
791049991914,3cyclictest882469-21turbostat11:30:001
791049991913,4cyclictest828836-21needreboot08:55:181
791049991912,5cyclictest847137-21cut09:45:191
79104999191,17cyclictest1095-21runrttasks11:01:251
791044991917,1cyclictest0-21swapper/011:26:440
791044991917,1cyclictest0-21swapper/010:18:180
791044991917,1cyclictest0-21swapper/008:45:370
791044991917,1cyclictest0-21swapper/007:27:020
791044991912,5cyclictest841428-21expr09:30:120
791044991911,6cyclictest883-21dbus-daemon09:00:000
79104499190,1cyclictest0-21swapper/007:19:190
79104499190,18cyclictest0-21swapper/012:28:220
79104499190,18cyclictest0-21swapper/008:02:030
791054991816,1cyclictest0-21swapper/310:43:473
791054991811,5cyclictest800293-21wc07:35:003
79105499180,16cyclictest885595-21python311:35:213
79105499180,16cyclictest811233-21diskstats08:05:133
791051991816,1cyclictest0-21swapper/212:38:112
79105199181,5cyclictest803670-21dump-pmu-power07:44:592
791051991811,5cyclictest900784-21cat12:20:152
791049991816,1cyclictest3056-21PK-Backend12:11:351
791049991816,1cyclictest3056-21PK-Backend09:57:171
791049991816,1cyclictest3056-21PK-Backend07:42:261
791049991816,1cyclictest0-21swapper/110:55:111
79104999180,1cyclictest0-21swapper/110:50:301
791044991816,1cyclictest3056-21PK-Backend11:45:240
791044991816,1cyclictest0-21swapper/011:34:150
791044991816,1cyclictest0-21swapper/010:36:300
791044991810,6cyclictest830934-21ntpq09:00:190
791054991716,1cyclictest0-21swapper/309:32:083
791054991715,1cyclictest0-21swapper/311:45:463
79105499170,15cyclictest813327-21ntp_states08:10:183
79105199172,13cyclictest884197-21perf11:34:592
791051991715,1cyclictest0-21swapper/208:34:092
791051991712,3cyclictest898801-21cstates12:15:132
791051991712,3cyclictest898801-21cstates12:15:122
79104999179,6cyclictest823729-21ntp_states08:40:191
79104999172,13cyclictest885521-21wc11:35:211
791049991715,1cyclictest3056-21PK-Backend07:55:101
791049991714,2cyclictest3056-21PK-Backend10:41:251
791049991713,3cyclictest798396-21sh07:30:001
791044991715,1cyclictest0-21swapper/009:41:480
791051991610,5cyclictest795443-21ls07:20:132
791049991612,3cyclictest844578-21/usr/sbin/munin09:40:121
791049991610,4cyclictest833406-21basename09:10:011
791054991513,1cyclictest3056-21PK-Backend12:38:253
79105499151,11cyclictest867139-21apt10:45:123
79104999159,4cyclictest815786-21apt08:19:591
79104999158,6cyclictest805967-21expr07:50:121
79104999158,5cyclictest814058-21cron08:15:011
791049991511,3cyclictest3056-21PK-Backend07:36:431
791049991510,4cyclictest821066-21wc08:35:011
791049991510,3cyclictest1095-21runrttasks08:24:061
79104499158,5cyclictest806107-21cat07:50:160
79105199142,8cyclictest800409-21apt07:35:102
791049991412,1cyclictest3056-21PK-Backend10:01:441
79104499143,9cyclictest814449-21cpuspeed_turbos08:15:130
79105199131,10cyclictest884-21gmain09:05:092
791049991210,1cyclictest3056-21PK-Backend08:49:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional