You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 20:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Sat Aug 22, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63524522330,7sleep00-21swapper/007:05:170
71432321380,3sleep10-21swapper/110:50:151
63921721280,4sleep33056-21PK-Backend07:15:153
65014321240,2sleep00-21swapper/007:45:200
71293121130,2sleep30-21swapper/310:45:203
70707221110,2sleep00-21swapper/010:30:140
139099920,76rtkit-daemon0-21swapper/107:05:101
63618927149,15sleep20-21swapper/207:09:152
63605426242,14sleep30-21swapper/307:07:313
6695152510,2sleep00-21swapper/008:40:220
7163322470,4sleep342-21ksoftirqd/310:55:183
7163322470,4sleep342-21ksoftirqd/310:55:183
7357922440,4sleep33056-21PK-Backend11:50:203
6467562430,3sleep20-21swapper/207:35:242
7270812390,3sleep20-21swapper/211:25:202
6462722340,2sleep10-21swapper/107:35:181
139099310,3rtkit-daemon0-21swapper/009:25:000
6617622250,4sleep33056-21PK-Backend08:20:113
63639199240,22cyclictest685586-21seq09:25:370
139099240,17rtkit-daemon3056-21PK-Backend07:11:581
139099240,17rtkit-daemon3056-21PK-Backend07:11:571
139099240,15rtkit-daemon3056-21PK-Backend10:35:180
6527702230,9chrt652772-21turbostat07:55:002
636397992321,1cyclictest0-21swapper/212:33:572
636391992318,3cyclictest724981-21df_inode11:20:140
139099230,16rtkit-daemon3056-21PK-Backend10:36:231
63640299220,20cyclictest3056-21PK-Backend08:17:143
63640299220,20cyclictest3056-21PK-Backend07:47:523
636397992220,1cyclictest0-21swapper/209:38:022
636397992220,1cyclictest0-21swapper/208:17:252
636397992220,1cyclictest0-21swapper/208:04:282
636397992220,1cyclictest0-21swapper/207:58:532
63639799220,21cyclictest0-21swapper/211:11:522
63639799220,20cyclictest0-21swapper/212:20:322
636395992220,1cyclictest3056-21PK-Backend09:07:351
636395992220,1cyclictest0-21swapper/111:05:101
636395992220,1cyclictest0-21swapper/110:56:531
636395992220,1cyclictest0-21swapper/110:56:521
636395992220,1cyclictest0-21swapper/109:41:491
636395992220,1cyclictest0-21swapper/107:28:121
636395992218,2cyclictest691621-21cstates09:45:131
636395992215,6cyclictest705648-21df10:25:151
63639599220,9cyclictest886-21NetworkManager11:35:111
636391992218,2cyclictest1788620-21WebKitWebProces09:11:250
636391992215,5cyclictest652743-21cron07:55:010
636391992215,5cyclictest1095-21runrttasks10:08:150
636391992214,6cyclictest751777-21python312:35:210
139099220,15rtkit-daemon0-21swapper/008:04:540
139099220,14rtkit-daemon0-21swapper/010:50:370
139099220,14rtkit-daemon0-21swapper/010:22:040
63640299219,9cyclictest42-21ksoftirqd/309:35:203
63640299210,1cyclictest3056-21PK-Backend10:25:293
63640299210,19cyclictest3056-21PK-Backend12:30:563
63640299210,19cyclictest3056-21PK-Backend11:32:353
63640299210,19cyclictest3056-21PK-Backend10:50:443
63640299210,19cyclictest3056-21PK-Backend10:03:183
63640299210,19cyclictest3056-21PK-Backend09:31:493
636397992119,1cyclictest0-21swapper/212:27:152
636397992119,1cyclictest0-21swapper/211:52:542
636397992119,1cyclictest0-21swapper/211:20:572
636397992119,1cyclictest0-21swapper/211:17:322
636397992119,1cyclictest0-21swapper/210:58:402
636397992119,1cyclictest0-21swapper/210:58:402
636397992119,1cyclictest0-21swapper/210:22:032
636397992119,1cyclictest0-21swapper/210:04:392
636397992119,1cyclictest0-21swapper/209:27:482
636397992119,1cyclictest0-21swapper/209:08:212
636397992119,1cyclictest0-21swapper/208:45:372
636397992119,1cyclictest0-21swapper/208:40:032
636397992119,1cyclictest0-21swapper/207:22:502
636397992119,1cyclictest0-21swapper/207:17:292
636397992119,1cyclictest0-21swapper/207:11:352
636397992119,1cyclictest0-21swapper/207:11:342
63639799210,20cyclictest0-21swapper/212:37:492
63639799210,20cyclictest0-21swapper/212:14:382
63639799210,20cyclictest0-21swapper/212:01:262
63639799210,20cyclictest0-21swapper/210:35:482
63639799210,20cyclictest0-21swapper/209:57:222
636395992119,1cyclictest3056-21PK-Backend11:44:031
636395992119,1cyclictest0-21swapper/112:33:181
636395992119,1cyclictest0-21swapper/112:21:091
636395992119,1cyclictest0-21swapper/111:55:121
636395992119,1cyclictest0-21swapper/111:02:191
636395992119,1cyclictest0-21swapper/109:55:421
636395992119,1cyclictest0-21swapper/108:20:441
636395992119,1cyclictest0-21swapper/107:45:231
636395992119,1cyclictest0-21swapper/107:32:581
636395992119,1cyclictest0-21swapper/107:21:151
636395992113,6cyclictest723646-21awk11:15:221
63639599210,20cyclictest3056-21PK-Backend12:25:471
63639599210,20cyclictest0-21swapper/111:31:051
63639599210,20cyclictest0-21swapper/109:21:341
63639599210,19cyclictest3056-21PK-Backend10:43:201
636391992119,1cyclictest3056-21PK-Backend08:10:210
636391992119,1cyclictest0-21swapper/010:25:260
636391992119,1cyclictest0-21swapper/009:54:430
636391992119,1cyclictest0-21swapper/009:47:400
636391992119,1cyclictest0-21swapper/009:37:270
636391992119,1cyclictest0-21swapper/009:34:020
636391992119,1cyclictest0-21swapper/009:16:240
636391992119,1cyclictest0-21swapper/008:54:140
636391992113,6cyclictest640550-21apt07:20:130
636391992111,8cyclictest883-21dbus-daemon11:33:140
63639199210,19cyclictest3056-21PK-Backend11:36:500
63639199210,19cyclictest0-21swapper/010:00:120
139099210,14rtkit-daemon0-21swapper/008:45:370
139099210,14rtkit-daemon0-21swapper/007:25:060
636402992018,1cyclictest3056-21PK-Backend11:56:413
636402992018,1cyclictest3056-21PK-Backend07:43:543
636402992018,1cyclictest0-21swapper/310:40:513
636402992018,1cyclictest0-21swapper/309:07:013
636402992017,2cyclictest3056-21PK-Backend12:14:053
636402992017,2cyclictest3056-21PK-Backend11:28:563
636402992017,2cyclictest3056-21PK-Backend11:18:493
636402992017,2cyclictest0-21swapper/312:00:193
636402992017,2cyclictest0-21swapper/310:31:443
636402992012,5cyclictest6376792sleep307:10:223
636402992012,5cyclictest6376792sleep307:10:223
63640299200,1cyclictest3056-21PK-Backend07:21:513
63640299200,19cyclictest3056-21PK-Backend12:35:343
63640299200,19cyclictest3056-21PK-Backend12:23:243
63640299200,19cyclictest3056-21PK-Backend08:35:313
63640299200,19cyclictest0-21swapper/311:10:313
63640299200,19cyclictest0-21swapper/310:35:243
63640299200,18cyclictest3056-21PK-Backend10:10:483
63640299200,18cyclictest3056-21PK-Backend08:51:543
636397992018,1cyclictest3056-21PK-Backend07:49:332
636397992018,1cyclictest0-21swapper/212:19:312
636397992018,1cyclictest0-21swapper/212:07:072
636397992018,1cyclictest0-21swapper/211:58:352
636397992018,1cyclictest0-21swapper/211:47:142
636397992018,1cyclictest0-21swapper/210:18:252
636397992018,1cyclictest0-21swapper/210:11:092
636397992018,1cyclictest0-21swapper/209:40:392
636397992018,1cyclictest0-21swapper/209:17:342
636397992018,1cyclictest0-21swapper/208:24:492
636397992012,6cyclictest659082-21python308:10:202
636397992011,7cyclictest711231-21ntp_states10:40:202
63639799200,1cyclictest0-21swapper/210:25:412
63639799200,1cyclictest0-21swapper/208:53:362
63639799200,19cyclictest3056-21PK-Backend09:14:572
63639799200,19cyclictest0-21swapper/211:43:222
63639799200,19cyclictest0-21swapper/211:39:292
63639799200,19cyclictest0-21swapper/209:51:552
63639799200,19cyclictest0-21swapper/208:08:272
63639799200,19cyclictest0-21swapper/208:08:262
636395992018,1cyclictest0-21swapper/111:45:051
636395992018,1cyclictest0-21swapper/110:10:011
636395992017,2cyclictest3056-21PK-Backend08:29:431
63639599200,19cyclictest0-21swapper/112:36:081
63639599200,19cyclictest0-21swapper/112:10:471
63639599200,19cyclictest0-21swapper/111:54:121
63639599200,19cyclictest0-21swapper/110:49:351
63639599200,19cyclictest0-21swapper/110:06:221
63639599200,19cyclictest0-21swapper/107:50:431
63639199204,14cyclictest678746-21perf09:10:000
636391992018,1cyclictest3056-21PK-Backend07:55:270
636391992018,1cyclictest0-21swapper/012:33:350
636391992018,1cyclictest0-21swapper/012:18:340
636391992018,1cyclictest0-21swapper/011:59:080
636391992018,1cyclictest0-21swapper/011:28:320
636391992018,1cyclictest0-21swapper/011:10:070
636391992018,1cyclictest0-21swapper/010:19:580
636391992018,1cyclictest0-21swapper/009:58:220
636391992018,1cyclictest0-21swapper/007:17:280
636391992017,2cyclictest3056-21PK-Backend10:45:260
636391992015,4cyclictest13-21ksoftirqd/007:40:120
636391992012,6cyclictest723454-21memory11:15:180
636391992012,6cyclictest657208-21ntpq08:05:210
636391992012,6cyclictest657208-21ntpq08:05:210
63639199200,1cyclictest0-21swapper/012:11:470
63639199200,1cyclictest0-21swapper/011:46:100
63639199200,19cyclictest0-21swapper/012:07:260
63639199200,19cyclictest0-21swapper/011:05:270
63639199200,19cyclictest0-21swapper/009:40:510
63639199200,19cyclictest0-21swapper/008:39:540
139099200,14rtkit-daemon3056-21PK-Backend09:12:001
139099200,14rtkit-daemon0-21swapper/012:26:420
63640299198,8cyclictest42-21ksoftirqd/307:50:213
636402991917,1cyclictest3056-21PK-Backend10:20:153
636402991917,1cyclictest3056-21PK-Backend08:02:193
636402991917,1cyclictest0-21swapper/310:05:093
636402991917,1cyclictest0-21swapper/307:55:243
636402991916,2cyclictest3056-21PK-Backend09:52:513
636402991916,2cyclictest3056-21PK-Backend08:56:403
636402991914,3cyclictest679886-21python309:10:223
636402991914,3cyclictest664003-21memory08:25:183
636402991911,6cyclictest702388-21memory10:15:183
63640299190,1cyclictest3056-21PK-Backend11:24:163
63640299190,1cyclictest3056-21PK-Backend09:47:373
63640299190,1cyclictest3056-21PK-Backend09:26:013
63640299190,1cyclictest3056-21PK-Backend08:13:143
63640299190,1cyclictest0-21swapper/308:32:003
63640299190,18cyclictest3056-21PK-Backend12:18:453
63640299190,18cyclictest0-21swapper/312:26:153
636397991917,1cyclictest0-21swapper/207:25:132
636397991916,2cyclictest3056-21PK-Backend10:53:132
636397991912,5cyclictest692384-21sed09:45:232
63639799190,1cyclictest0-21swapper/210:06:282
63639799190,1cyclictest0-21swapper/209:00:582
63639599194,3cyclictest6880452cpuspeed_turbos09:35:111
636395991917,1cyclictest0-21swapper/109:34:121
636395991917,1cyclictest0-21swapper/108:19:561
636395991917,1cyclictest0-21swapper/108:00:501
636395991917,1cyclictest0-21swapper/107:15:221
636395991914,3cyclictest666610-21sh08:35:011
636395991914,3cyclictest657948-21idleruntime-cro08:10:001
636395991914,3cyclictest657948-21idleruntime-cro08:09:591
63639599190,1cyclictest3056-21PK-Backend12:04:181
63639599190,1cyclictest3056-21PK-Backend10:33:261
63639599190,1cyclictest0-21swapper/112:15:261
63639599190,1cyclictest0-21swapper/112:09:451
63639599190,1cyclictest0-21swapper/111:11:391
63639599190,1cyclictest0-21swapper/110:22:311
63639599190,1cyclictest0-21swapper/109:52:041
63639599190,1cyclictest0-21swapper/109:25:481
63639599190,1cyclictest0-21swapper/109:15:461
63639599190,18cyclictest0-21swapper/110:18:531
63639599190,18cyclictest0-21swapper/110:00:071
636391991917,1cyclictest0-21swapper/010:58:580
636391991917,1cyclictest0-21swapper/010:58:580
636391991917,1cyclictest0-21swapper/008:34:060
636391991917,1cyclictest0-21swapper/008:29:530
636391991913,5cyclictest746003-21sed12:20:170
636391991912,5cyclictest736000-21ls11:50:220
63639199190,18cyclictest0-21swapper/010:44:250
139099190,13rtkit-daemon0-21swapper/008:16:000
63640299187,8cyclictest42-21ksoftirqd/307:25:203
636402991816,1cyclictest3056-21PK-Backend11:46:343
636402991816,1cyclictest3056-21PK-Backend11:01:263
636402991816,1cyclictest3056-21PK-Backend09:41:023
636402991816,1cyclictest3056-21PK-Backend09:01:273
636402991812,4cyclictest731857-21expr11:40:123
63640299181,15cyclictest740248-21cpu12:05:133
636402991811,5cyclictest730221-21which11:35:173
636397991816,1cyclictest0-21swapper/211:31:592
636397991816,1cyclictest0-21swapper/211:07:112
636397991816,1cyclictest0-21swapper/210:30:212
636397991816,1cyclictest0-21swapper/209:30:252
636397991816,1cyclictest0-21swapper/208:29:022
636397991816,1cyclictest0-21swapper/207:43:592
636397991811,5cyclictest665715-21cat08:30:172
636395991816,1cyclictest0-21swapper/108:40:311
636395991816,1cyclictest0-21swapper/107:58:271
636395991811,5cyclictest676269-21ntpq09:00:191
636395991810,6cyclictest726396-21awk11:25:141
63639599180,1cyclictest0-21swapper/108:49:511
636391991816,1cyclictest3056-21PK-Backend08:24:530
636391991816,1cyclictest0-21swapper/012:00:100
636391991811,5cyclictest675998-21cat09:00:150
636391991810,6cyclictest645941-21grep07:35:130
63640299179,6cyclictest681377-21df_inode09:15:143
636402991715,1cyclictest3056-21PK-Backend11:06:533
636402991715,1cyclictest3056-21PK-Backend08:42:353
636402991715,1cyclictest3056-21PK-Backend08:05:303
636402991715,1cyclictest3056-21PK-Backend08:05:303
63639799179,6cyclictest712937-21ntpq10:45:212
636397991715,1cyclictest0-21swapper/209:20:122
636397991715,1cyclictest0-21swapper/207:34:472
63639599179,6cyclictest725575-21sed11:20:241
636395991711,5cyclictest667778-21ls08:35:231
636391991715,1cyclictest0-21swapper/010:11:540
636391991711,5cyclictest675425-21sed09:00:000
636391991710,6cyclictest883-21dbus-daemon11:05:010
636397991614,1cyclictest0-21swapper/208:35:022
636395991610,5cyclictest674673-21gzip08:55:221
636395991610,4cyclictest647737-21cpuspeed_turbos07:40:141
636391991612,2cyclictest644888-21sensors_temp07:30:200
6370702150,4sleep03056-21PK-Backend07:10:150
6370702150,4sleep03056-21PK-Backend07:10:150
636402991512,2cyclictest3056-21PK-Backend09:24:253
636397991513,1cyclictest0-21swapper/211:04:212
636391991513,1cyclictest0-21swapper/011:42:320
139099150,3rtkit-daemon0-21swapper/108:54:571
636402991412,1cyclictest3056-21PK-Backend08:45:463
636402991410,3cyclictest42-21ksoftirqd/307:38:173
636402991410,3cyclictest3056-21PK-Backend07:30:123
636397991412,1cyclictest0-21swapper/208:59:232
636395991410,3cyclictest658198-21acpi08:10:101
636402991311,1cyclictest3056-21PK-Backend09:57:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional