You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 00:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri Jul 17, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134463422740,6sleep1251rcuc/107:05:131
135571421180,3sleep00-21swapper/007:35:010
144557421160,4sleep03056-21PK-Backend11:45:180
146013921130,5sleep13056-21PK-Backend12:25:221
138696221100,3sleep30-21swapper/309:00:213
138494521040,4sleep20-21swapper/208:55:192
139099970,62rtkit-daemon0-21swapper/207:07:392
134577026645,14sleep30-21swapper/307:06:413
134578226342,14sleep00-21swapper/007:06:500
13474582590,4sleep20-21swapper/207:10:252
13951992490,4sleep30-21swapper/309:25:143
14485522440,3sleep00-21swapper/011:55:120
134617699412,23cyclictest0-21swapper/209:35:292
134617699401,26cyclictest0-21swapper/212:19:332
134617699401,26cyclictest0-21swapper/212:19:332
14570052390,3sleep0161rcuc/012:17:060
14570052390,3sleep0161rcuc/012:17:060
134617699393,24cyclictest0-21swapper/212:09:142
13610662380,4sleep13056-21PK-Backend07:50:141
134617699384,23cyclictest0-21swapper/210:37:442
134617699383,24cyclictest0-21swapper/212:03:482
134617699383,24cyclictest0-21swapper/209:12:232
134617699383,23cyclictest0-21swapper/211:48:142
134617699382,25cyclictest0-21swapper/208:18:462
134617699382,23cyclictest0-21swapper/211:52:112
134617699381,25cyclictest0-21swapper/208:39:232
134617699381,24cyclictest0-21swapper/209:57:092
134617699373,23cyclictest0-21swapper/209:02:072
134617699373,23cyclictest0-21swapper/208:47:292
134617699373,22cyclictest0-21swapper/207:32:142
134617699373,21cyclictest0-21swapper/212:27:382
134617699373,19cyclictest0-21swapper/212:38:022
134617699372,26cyclictest0-21swapper/210:20:322
134617699372,23cyclictest0-21swapper/211:10:042
134617699372,23cyclictest0-21swapper/211:04:142
134617699372,23cyclictest0-21swapper/210:52:592
134617699372,23cyclictest0-21swapper/209:08:302
134617699372,23cyclictest0-21swapper/208:26:232
134617699372,20cyclictest0-21swapper/207:35:102
134617699371,27cyclictest0-21swapper/211:29:122
134617699371,25cyclictest0-21swapper/209:27:302
134617699364,17cyclictest0-21swapper/208:41:272
134617699363,22cyclictest0-21swapper/209:53:492
134617699363,22cyclictest0-21swapper/208:11:202
134617699362,23cyclictest0-21swapper/211:58:472
134617699362,23cyclictest0-21swapper/210:02:542
134617699362,23cyclictest0-21swapper/207:53:032
134617699362,23cyclictest0-21swapper/207:16:262
134617699362,22cyclictest0-21swapper/211:07:442
134617699362,19cyclictest0-21swapper/211:17:422
134617699362,19cyclictest0-21swapper/209:16:042
134617699362,19cyclictest0-21swapper/208:05:412
134617699362,18cyclictest0-21swapper/212:31:552
134617699362,18cyclictest0-21swapper/209:21:572
134617699361,23cyclictest0-21swapper/208:34:122
134617699361,20cyclictest0-21swapper/210:55:402
134617699361,19cyclictest0-21swapper/209:45:472
134617699352,19cyclictest0-21swapper/210:14:062
134617699352,18cyclictest0-21swapper/210:26:522
134617699342,19cyclictest0-21swapper/210:42:212
134617699332,19cyclictest0-21swapper/212:13:202
134617699332,19cyclictest0-21swapper/209:32:312
134617699332,19cyclictest0-21swapper/207:47:022
134617699332,18cyclictest0-21swapper/210:05:082
134617699332,17cyclictest0-21swapper/210:47:062
134617699331,20cyclictest0-21swapper/207:43:092
134617699322,18cyclictest0-21swapper/212:22:542
134617699322,18cyclictest0-21swapper/211:32:452
134617699322,18cyclictest0-21swapper/209:44:232
134617699322,18cyclictest0-21swapper/208:21:142
134617699314,15cyclictest1095-21runrttasks08:02:492
134617699288,18cyclictest1364436-21date08:00:012
1346176992811,15cyclictest1095-21runrttasks07:20:012
134617699270,25cyclictest1353795-21ls07:30:002
134617699267,16cyclictest1412272-21cpuspeed_turbos10:15:142
134617699266,18cyclictest913-21gdbus11:40:022
134617699262,20cyclictest1441135-21apt11:35:102
134617699261,20cyclictest1417565-21apt10:30:112
139099250,17rtkit-daemon0-21swapper/310:15:133
134617699251,20cyclictest1382635-21apt08:50:142
1346180992419,3cyclictest1352689-21df07:25:123
134617699241,21cyclictest1435938-21apt11:20:112
1346171992321,1cyclictest3056-21PK-Backend11:00:340
1346171992319,3cyclictest0-21swapper/008:41:490
134618099225,15cyclictest1461587-21cat12:30:173
1346180992220,1cyclictest0-21swapper/312:15:463
1346180992220,1cyclictest0-21swapper/312:15:453
1346180992220,1cyclictest0-21swapper/311:42:343
1346180992220,1cyclictest0-21swapper/308:26:243
1346180992217,4cyclictest1356113-21expr07:35:143
134618099220,21cyclictest0-21swapper/310:23:243
1346174992220,1cyclictest3056-21PK-Backend12:17:001
1346174992220,1cyclictest3056-21PK-Backend12:16:591
1346174992220,1cyclictest3056-21PK-Backend11:55:381
1346174992220,1cyclictest3056-21PK-Backend10:25:131
1346174992220,1cyclictest3056-21PK-Backend08:45:091
1346174992219,2cyclictest3056-21PK-Backend11:09:331
1346171992220,1cyclictest0-21swapper/012:29:150
1346171992220,1cyclictest0-21swapper/010:21:060
1346171992220,1cyclictest0-21swapper/010:04:300
1346171992220,1cyclictest0-21swapper/009:28:470
1346171992220,1cyclictest0-21swapper/009:11:510
1346171992220,1cyclictest0-21swapper/008:02:150
134617199220,21cyclictest0-21swapper/008:21:000
134617199220,20cyclictest3056-21PK-Backend11:50:010
134617199220,20cyclictest0-21swapper/009:41:320
134618099212,16cyclictest1361919-21python307:50:223
1346180992119,1cyclictest0-21swapper/312:26:473
1346180992119,1cyclictest0-21swapper/312:12:283
1346180992119,1cyclictest0-21swapper/311:59:293
1346180992119,1cyclictest0-21swapper/310:46:223
1346180992119,1cyclictest0-21swapper/310:35:283
1346180992119,1cyclictest0-21swapper/309:46:063
1346180992119,1cyclictest0-21swapper/309:44:253
1346180992119,1cyclictest0-21swapper/309:21:193
1346180992119,1cyclictest0-21swapper/309:13:493
1346180992119,1cyclictest0-21swapper/308:45:443
1346180992119,1cyclictest0-21swapper/308:23:263
1346180992119,1cyclictest0-21swapper/307:59:463
134618099211,7cyclictest1371246-21/usr/sbin/munin08:15:233
1346180992116,3cyclictest1430476-21apt11:05:123
1346180992114,6cyclictest1422459-21sshd10:44:473
1346180992112,8cyclictest1445576-21ntpq11:45:193
134618099210,19cyclictest0-21swapper/311:30:033
1346174992119,1cyclictest3056-21PK-Backend11:43:541
1346174992119,1cyclictest3056-21PK-Backend11:18:131
1346174992119,1cyclictest3056-21PK-Backend10:50:151
1346174992119,1cyclictest3056-21PK-Backend10:14:111
1346174992119,1cyclictest3056-21PK-Backend09:31:261
1346174992119,1cyclictest3056-21PK-Backend09:20:521
1346174992119,1cyclictest0-21swapper/108:15:081
1346174992112,7cyclictest1391023-21cron09:14:591
134617499210,20cyclictest3056-21PK-Backend11:36:371
134617499210,20cyclictest0-21swapper/108:55:371
134617499210,19cyclictest3056-21PK-Backend12:36:401
134617499210,19cyclictest3056-21PK-Backend09:45:121
134617499210,19cyclictest3056-21PK-Backend09:26:261
1346171992119,1cyclictest0-21swapper/011:43:050
1346171992119,1cyclictest0-21swapper/011:38:050
1346171992119,1cyclictest0-21swapper/011:13:370
1346171992119,1cyclictest0-21swapper/010:39:040
1346171992119,1cyclictest0-21swapper/009:45:290
1346171992119,1cyclictest0-21swapper/008:53:380
1346171992119,1cyclictest0-21swapper/008:46:010
1346171992119,1cyclictest0-21swapper/008:06:210
1346171992119,1cyclictest0-21swapper/007:50:380
1346171992119,1cyclictest0-21swapper/007:41:470
134617199210,20cyclictest0-21swapper/012:37:470
134617199210,20cyclictest0-21swapper/012:01:580
134617199210,20cyclictest0-21swapper/010:52:290
134617199210,20cyclictest0-21swapper/009:51:460
134617199210,20cyclictest0-21swapper/007:26:320
134617199210,20cyclictest0-21swapper/007:12:060
134617199210,1cyclictest0-21swapper/007:49:380
134617199210,19cyclictest0-21swapper/010:43:150
14284882200,4sleep10-21swapper/111:00:121
134618099206,12cyclictest1417758-21cstates10:30:133
1346180992018,1cyclictest0-21swapper/311:00:363
1346180992018,1cyclictest0-21swapper/310:05:403
1346180992018,1cyclictest0-21swapper/309:50:053
1346180992018,1cyclictest0-21swapper/309:05:583
1346180992018,1cyclictest0-21swapper/308:41:313
1346180992018,1cyclictest0-21swapper/308:13:263
1346180992018,1cyclictest0-21swapper/308:01:093
1346180992018,1cyclictest0-21swapper/307:31:483
1346180992017,2cyclictest0-21swapper/310:27:373
1346180992013,5cyclictest1350589-21basename07:20:123
1346180992012,6cyclictest1447363-21awk11:50:183
1346180992012,6cyclictest1366922-21idleruntime08:05:193
134618099200,1cyclictest0-21swapper/310:53:053
134618099200,19cyclictest0-21swapper/312:23:293
134618099200,19cyclictest0-21swapper/311:35:033
134618099200,19cyclictest0-21swapper/311:15:363
134618099200,19cyclictest0-21swapper/311:13:403
134618099200,19cyclictest0-21swapper/309:55:123
134618099200,19cyclictest0-21swapper/309:32:083
134618099200,19cyclictest0-21swapper/307:42:033
1346174992018,1cyclictest3056-21PK-Backend11:46:241
1346174992018,1cyclictest3056-21PK-Backend11:20:431
1346174992018,1cyclictest3056-21PK-Backend10:58:051
1346174992018,1cyclictest3056-21PK-Backend10:35:541
1346174992018,1cyclictest3056-21PK-Backend09:09:561
1346174992017,2cyclictest3056-21PK-Backend11:12:051
134617499200,1cyclictest3056-21PK-Backend07:58:251
134617499200,1cyclictest3056-21PK-Backend07:37:301
134617499200,19cyclictest3056-21PK-Backend11:34:081
134617499200,19cyclictest3056-21PK-Backend09:43:281
134617499200,19cyclictest3056-21PK-Backend09:00:241
134617499200,19cyclictest3056-21PK-Backend07:21:341
134617499200,18cyclictest3056-21PK-Backend08:38:051
134617499200,18cyclictest3056-21PK-Backend08:22:451
134617499200,18cyclictest3056-21PK-Backend08:11:011
1346171992018,1cyclictest0-21swapper/011:22:300
1346171992018,1cyclictest0-21swapper/011:08:380
1346171992018,1cyclictest0-21swapper/010:58:030
1346171992018,1cyclictest0-21swapper/008:34:460
1346171992018,1cyclictest0-21swapper/008:28:180
1346171992018,1cyclictest0-21swapper/007:55:390
1346171992018,1cyclictest0-21swapper/007:20:110
1346171992013,5cyclictest1434193-21awk11:15:100
1346171992011,8cyclictest922-21systemd-logind07:40:000
134617199200,1cyclictest0-21swapper/012:13:000
134617199200,19cyclictest3056-21PK-Backend11:30:010
134617199200,19cyclictest0-21swapper/010:46:200
134617199200,19cyclictest0-21swapper/010:26:270
134617199200,19cyclictest0-21swapper/009:22:240
134617199200,19cyclictest0-21swapper/009:17:240
134617199200,19cyclictest0-21swapper/007:15:450
13916492190,4sleep13056-21PK-Backend09:15:151
13711372190,4sleep03056-21PK-Backend08:15:220
1346180991917,1cyclictest0-21swapper/310:11:013
1346180991917,1cyclictest0-21swapper/307:48:183
1346180991914,3cyclictest1406891-21apt10:00:113
134618099190,1cyclictest0-21swapper/312:01:263
134618099190,1cyclictest0-21swapper/309:37:563
134618099190,1cyclictest0-21swapper/309:19:243
134618099190,18cyclictest0-21swapper/310:58:403
134618099190,17cyclictest1377802-21df_inode08:35:143
1346174991917,1cyclictest3056-21PK-Backend12:03:421
1346174991917,1cyclictest3056-21PK-Backend10:46:021
1346174991917,1cyclictest3056-21PK-Backend08:26:171
1346174991917,1cyclictest3056-21PK-Backend08:06:231
1346174991917,1cyclictest0-21swapper/110:40:401
1346174991917,1cyclictest0-21swapper/107:10:331
134617499190,1cyclictest0-21swapper/110:30:331
134617499190,18cyclictest3056-21PK-Backend11:27:261
134617499190,18cyclictest3056-21PK-Backend07:15:451
1346171991917,1cyclictest0-21swapper/012:22:050
1346171991917,1cyclictest0-21swapper/009:08:470
1346171991917,1cyclictest0-21swapper/009:01:300
134617199190,1cyclictest3056-21PK-Backend10:30:390
134617199190,1cyclictest0-21swapper/011:33:050
14118692180,3chrt0-21swapper/010:14:590
134618099181,6cyclictest1436878-21find11:20:223
1346180991816,1cyclictest3056-21PK-Backend08:54:283
1346180991816,1cyclictest0-21swapper/312:06:403
1346180991816,1cyclictest0-21swapper/307:12:223
1346180991813,4cyclictest42-21ksoftirqd/307:20:003
1346180991813,3cyclictest1438061-21hddtemp_smartct11:25:153
134618099181,13cyclictest1095-21runrttasks08:30:133
1346174991816,1cyclictest3056-21PK-Backend12:20:521
1346174991816,1cyclictest3056-21PK-Backend12:12:331
1346174991815,2cyclictest3056-21PK-Backend07:47:431
1346174991811,5cyclictest1404467-21grep09:50:231
134617499180,16cyclictest3056-21PK-Backend09:36:251
1346171991816,1cyclictest0-21swapper/012:30:370
1346171991816,1cyclictest0-21swapper/009:39:490
1346171991816,1cyclictest0-21swapper/008:57:520
1346171991815,2cyclictest3056-21PK-Backend12:05:160
1346171991812,5cyclictest1413558-21cron10:19:590
1346171991812,5cyclictest1397484-21sed09:30:220
1346180991715,1cyclictest0-21swapper/308:59:493
1346174991711,4cyclictest1382764-21cpuspeed_turbos08:50:151
1346174991710,5cyclictest1448066-21turbostat.cron11:55:011
134617499170,1cyclictest3056-21PK-Backend08:34:071
134617499170,1cyclictest3056-21PK-Backend08:01:431
1346180991614,1cyclictest0-21swapper/312:39:113
134617499162,12cyclictest1452040-21sort12:05:101
134617499160,15cyclictest3056-21PK-Backend07:29:181
1346171991614,1cyclictest0-21swapper/010:09:500
1346174991510,4cyclictest3056-21PK-Backend12:34:271
134617199159,5cyclictest1406139-21grep09:55:240
134617199159,4cyclictest1369237-21cat08:10:180
134617499145,8cyclictest1407541-21needreboot10:00:181
1346174991410,3cyclictest3056-21PK-Backend10:07:311
1346174991410,3cyclictest3056-21PK-Backend07:41:341
134617199140,5cyclictest0-21swapper/008:35:220
134617499139,3cyclictest3056-21PK-Backend10:15:051
1346174991311,1cyclictest3056-21PK-Backend10:24:391
134617499127,4cyclictest1379797-21sed08:40:171
134617499125,6cyclictest26-21ksoftirqd/109:59:101
134617499106,3cyclictest3056-21PK-Backend07:30:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional