You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 19:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot7s.osadl.org (updated Thu May 07, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
307061121340,2sleep00-21swapper/008:00:110
308797821300,2sleep10-21swapper/108:50:001
305703421270,2sleep33056-21PK-Backend07:20:173
309607921110,3sleep13056-21PK-Backend09:10:211
30510162770,7sleep00-21swapper/007:05:130
305118927043,19sleep30-21swapper/307:05:163
305213626243,13sleep10-21swapper/107:08:291
305194426241,14sleep20-21swapper/207:05:592
31069122430,2sleep30-21swapper/309:45:013
31034042430,3sleep13056-21PK-Backend09:35:001
139099260,4rtkit-daemon1389-21rtkit-daemon07:14:040
305239099252,16cyclictest1788620-21WebKitWebProces08:50:111
31080882240,5sleep342-21ksoftirqd/309:45:213
3052390992413,8cyclictest1-21systemd08:15:011
139099240,3rtkit-daemon1389-21rtkit-daemon12:07:011
31456242230,2chrt0-21swapper/011:35:010
31210392230,4chrt0-21swapper/110:25:011
3052395992321,1cyclictest0-21swapper/311:30:463
305239599230,21cyclictest3056-21PK-Backend11:35:193
305239299239,12cyclictest3129703-21unin-run10:50:012
3052390992312,7cyclictest436-20systemd-journal11:10:001
31530182220,5sleep33056-21PK-Backend11:55:123
3052395992220,1cyclictest0-21swapper/309:23:103
3052395992219,2cyclictest3056-21PK-Backend11:15:513
3052395992216,4cyclictest42-21ksoftirqd/310:10:013
305239599220,21cyclictest0-21swapper/311:48:433
305239599220,20cyclictest3056-21PK-Backend08:19:163
3052392992220,1cyclictest0-21swapper/212:08:592
3052392992220,1cyclictest0-21swapper/211:29:452
3052392992220,1cyclictest0-21swapper/211:29:452
3052392992220,1cyclictest0-21swapper/211:20:262
3052392992220,1cyclictest0-21swapper/209:15:552
3052392992218,3cyclictest0-21swapper/209:51:382
3052392992218,2cyclictest34-21ksoftirqd/207:11:132
3052392992216,5cyclictest883-21dbus-daemon09:10:002
305239299220,20cyclictest0-21swapper/212:16:232
305239299220,20cyclictest0-21swapper/209:26:432
3052390992212,7cyclictest3061480-21cron07:35:001
305239099220,8cyclictest3117551-21perf10:15:001
3052385992220,1cyclictest0-21swapper/011:51:130
3052385992220,1cyclictest0-21swapper/011:03:280
3052385992220,1cyclictest0-21swapper/010:30:360
3052385992220,1cyclictest0-21swapper/009:59:190
3052385992220,1cyclictest0-21swapper/008:48:150
3052385992220,1cyclictest0-21swapper/008:38:220
3052385992214,6cyclictest3084874-21expr08:40:130
305239599214,15cyclictest3113017-21basename10:00:123
3052395992119,1cyclictest3056-21PK-Backend12:05:273
3052395992119,1cyclictest3056-21PK-Backend08:43:363
3052395992119,1cyclictest3056-21PK-Backend07:14:543
3052395992119,1cyclictest0-21swapper/312:33:123
3052395992119,1cyclictest0-21swapper/312:25:483
3052395992119,1cyclictest0-21swapper/310:45:303
3052395992119,1cyclictest0-21swapper/309:17:163
3052395992119,1cyclictest0-21swapper/308:58:083
3052395992119,1cyclictest0-21swapper/308:12:133
3052395992119,1cyclictest0-21swapper/307:42:533
3052395992119,1cyclictest0-21swapper/307:35:283
3052395992118,2cyclictest3056-21PK-Backend10:54:353
3052395992118,2cyclictest3056-21PK-Backend10:39:423
3052395992118,2cyclictest3056-21PK-Backend10:27:183
3052395992111,8cyclictest3104075-21sh09:35:153
305239599210,20cyclictest0-21swapper/310:12:183
305239599210,19cyclictest3056-21PK-Backend12:03:103
3052392992119,1cyclictest0-21swapper/212:04:402
3052392992119,1cyclictest0-21swapper/211:41:222
3052392992119,1cyclictest0-21swapper/211:19:112
3052392992119,1cyclictest0-21swapper/210:01:302
3052392992119,1cyclictest0-21swapper/209:13:512
3052392992119,1cyclictest0-21swapper/208:40:252
3052392992119,1cyclictest0-21swapper/208:34:582
3052392992119,1cyclictest0-21swapper/208:21:542
3052392992119,1cyclictest0-21swapper/208:11:122
3052392992119,1cyclictest0-21swapper/207:40:022
3052392992119,1cyclictest0-21swapper/207:23:072
305239299210,20cyclictest0-21swapper/211:51:292
305239299210,20cyclictest0-21swapper/210:35:442
305239299210,20cyclictest0-21swapper/209:37:312
305239299210,20cyclictest0-21swapper/209:24:412
305239299210,20cyclictest0-21swapper/207:15:502
305239299210,1cyclictest0-21swapper/211:57:022
305239299210,19cyclictest0-21swapper/208:58:382
305239299210,19cyclictest0-21swapper/207:45:032
305239099210,1cyclictest0-21swapper/111:52:571
3052385992119,1cyclictest3056-21PK-Backend09:01:140
3052385992119,1cyclictest0-21swapper/012:19:520
3052385992119,1cyclictest0-21swapper/012:14:320
3052385992119,1cyclictest0-21swapper/011:38:500
3052385992119,1cyclictest0-21swapper/011:21:390
3052385992119,1cyclictest0-21swapper/010:55:360
3052385992119,1cyclictest0-21swapper/010:49:490
3052385992119,1cyclictest0-21swapper/010:07:590
3052385992119,1cyclictest0-21swapper/010:03:390
3052385992119,1cyclictest0-21swapper/009:26:140
3052385992119,1cyclictest0-21swapper/009:21:200
3052385992119,1cyclictest0-21swapper/009:06:550
3052385992119,1cyclictest0-21swapper/008:58:220
3052385992119,1cyclictest0-21swapper/008:06:590
3052385992119,1cyclictest0-21swapper/007:41:170
3052385992113,6cyclictest3166356-21perf12:35:000
305238599210,9cyclictest31212822grep10:25:110
305238599210,20cyclictest0-21swapper/012:06:550
305238599210,20cyclictest0-21swapper/011:56:480
305238599210,20cyclictest0-21swapper/007:16:160
31464342200,3sleep10-21swapper/111:35:171
3052395992018,1cyclictest3056-21PK-Backend12:13:033
3052395992018,1cyclictest3056-21PK-Backend11:13:363
3052395992018,1cyclictest3056-21PK-Backend10:41:593
3052395992018,1cyclictest3056-21PK-Backend10:18:403
3052395992018,1cyclictest3056-21PK-Backend09:59:193
3052395992018,1cyclictest3056-21PK-Backend08:28:413
3052395992018,1cyclictest3056-21PK-Backend08:28:413
3052395992018,1cyclictest3056-21PK-Backend08:21:533
3052395992018,1cyclictest3056-21PK-Backend08:07:463
3052395992018,1cyclictest0-21swapper/312:37:313
3052395992018,1cyclictest0-21swapper/309:12:223
3052395992018,1cyclictest0-21swapper/309:06:413
3052395992018,1cyclictest0-21swapper/307:53:543
3052395992017,2cyclictest3056-21PK-Backend07:19:133
3052395992014,4cyclictest42-21ksoftirqd/309:55:003
305239599200,1cyclictest3056-21PK-Backend08:37:213
305239599200,19cyclictest3056-21PK-Backend11:02:263
305239599200,19cyclictest3056-21PK-Backend08:34:433
305239599200,19cyclictest0-21swapper/307:47:053
305239599200,18cyclictest3056-21PK-Backend11:29:303
305239599200,18cyclictest3056-21PK-Backend11:29:303
3052392992018,1cyclictest3056-21PK-Backend12:37:462
3052392992018,1cyclictest0-21swapper/211:45:552
3052392992018,1cyclictest0-21swapper/210:58:432
3052392992018,1cyclictest0-21swapper/209:58:132
3052392992018,1cyclictest0-21swapper/208:45:542
3052392992018,1cyclictest0-21swapper/208:36:472
3052392992018,1cyclictest0-21swapper/208:02:212
3052392992018,1cyclictest0-21swapper/207:57:072
305239299200,1cyclictest0-21swapper/207:36:392
305239299200,19cyclictest978-21snmpd11:03:152
305239299200,19cyclictest0-21swapper/211:31:002
305239299200,19cyclictest0-21swapper/210:26:242
305239299200,19cyclictest0-21swapper/210:05:502
305239299200,19cyclictest0-21swapper/209:47:182
305239299200,19cyclictest0-21swapper/209:04:182
305239299200,19cyclictest0-21swapper/208:53:582
305239299200,19cyclictest0-21swapper/207:27:402
305239099203,12cyclictest3056290-21munin-plugin-st07:19:591
3052390992018,1cyclictest0-21swapper/111:55:141
3052390992018,1cyclictest0-21swapper/108:37:151
3052390992014,4cyclictest886-21NetworkManager12:25:011
305239099200,5cyclictest0-21swapper/108:06:251
305239099200,19cyclictest3056-21PK-Backend08:58:101
305239099200,19cyclictest0-21swapper/111:28:031
305239099200,19cyclictest0-21swapper/111:28:031
305239099200,19cyclictest0-21swapper/110:31:591
305239099200,19cyclictest0-21swapper/108:28:361
305239099200,19cyclictest0-21swapper/108:28:361
305239099200,19cyclictest0-21swapper/107:57:051
305239099200,18cyclictest3056-21PK-Backend09:37:171
305239099200,18cyclictest3056-21PK-Backend09:21:071
305239099200,18cyclictest0-21swapper/108:20:101
3052385992018,1cyclictest0-21swapper/012:01:210
3052385992018,1cyclictest0-21swapper/011:18:070
3052385992018,1cyclictest0-21swapper/011:13:360
3052385992018,1cyclictest0-21swapper/010:51:040
3052385992018,1cyclictest0-21swapper/010:35:090
3052385992018,1cyclictest0-21swapper/010:22:450
3052385992018,1cyclictest0-21swapper/009:42:440
3052385992018,1cyclictest0-21swapper/008:53:420
3052385992018,1cyclictest0-21swapper/008:14:020
3052385992018,1cyclictest0-21swapper/007:55:430
3052385992018,1cyclictest0-21swapper/007:45:290
3052385992018,1cyclictest0-21swapper/007:23:330
305238599200,19cyclictest0-21swapper/011:41:060
305238599200,19cyclictest0-21swapper/010:15:210
305238599200,19cyclictest0-21swapper/009:46:360
305238599200,19cyclictest0-21swapper/009:19:170
305238599200,19cyclictest0-21swapper/009:14:250
305238599200,19cyclictest0-21swapper/008:33:080
305238599200,19cyclictest0-21swapper/008:24:300
305239599199,8cyclictest42-21ksoftirqd/310:30:213
305239599198,3cyclictest42-21ksoftirqd/308:47:383
305239599197,4cyclictest42-21ksoftirqd/310:23:483
3052395991917,1cyclictest3056-21PK-Backend11:53:163
3052395991914,4cyclictest42-21ksoftirqd/307:30:013
3052395991913,4cyclictest3100180-21/usr/sbin/munin09:25:123
305239599190,1cyclictest3056-21PK-Backend11:44:113
305239599190,1cyclictest0-21swapper/309:00:593
305239599190,1cyclictest0-21swapper/308:51:403
305239599190,18cyclictest0-21swapper/309:31:553
3052392991917,1cyclictest0-21swapper/212:34:272
3052392991917,1cyclictest0-21swapper/211:12:222
3052392991917,1cyclictest0-21swapper/209:43:252
3052392991917,1cyclictest0-21swapper/207:51:052
305239299190,1cyclictest0-21swapper/210:34:292
305239299190,1cyclictest0-21swapper/208:17:282
305239299190,18cyclictest0-21swapper/210:42:332
305239099195,12cyclictest3054093-21unin-run07:15:011
3052390991917,1cyclictest3056-21PK-Backend09:53:531
3052390991917,1cyclictest0-21swapper/111:34:381
3052390991917,1cyclictest0-21swapper/110:57:071
3052390991917,1cyclictest0-21swapper/108:17:331
3052390991916,2cyclictest3056-21PK-Backend10:50:311
3052390991915,3cyclictest3137104-21/usr/sbin/munin11:10:181
3052390991914,3cyclictest3070656-21grep08:00:121
3052390991913,4cyclictest3148987-21cron11:45:001
3052390991913,4cyclictest3125410-21strings10:35:161
3052390991912,5cyclictest3111722-21seq09:55:201
305239099190,1cyclictest3056-21PK-Backend09:02:361
305239099190,18cyclictest3056-21PK-Backend10:04:081
305239099190,18cyclictest0-21swapper/112:31:361
305239099190,18cyclictest0-21swapper/112:14:461
305239099190,18cyclictest0-21swapper/112:02:501
305239099190,18cyclictest0-21swapper/108:31:131
3052385991917,1cyclictest3056-21PK-Backend10:43:000
3052385991917,1cyclictest0-21swapper/012:24:120
3052385991917,1cyclictest0-21swapper/011:45:390
305238599190,1cyclictest0-21swapper/012:35:540
305238599190,1cyclictest0-21swapper/011:05:450
305238599190,1cyclictest0-21swapper/009:30:070
305238599190,1cyclictest0-21swapper/007:36:170
305238599190,18cyclictest0-21swapper/009:37:510
3052395991816,1cyclictest3056-21PK-Backend08:02:323
3052395991815,2cyclictest3056-21PK-Backend10:55:503
305239599180,1cyclictest3056-21PK-Backend11:24:573
3052392991816,1cyclictest0-21swapper/211:36:482
3052392991816,1cyclictest0-21swapper/210:51:542
3052392991816,1cyclictest0-21swapper/208:27:082
3052392991816,1cyclictest0-21swapper/208:27:082
3052392991814,2cyclictest3162847-21cron12:24:592
3052392991813,3cyclictest3103407-21sh09:34:592
305239299180,1cyclictest0-21swapper/212:25:492
3052390991816,1cyclictest3056-21PK-Backend09:07:491
3052390991816,1cyclictest0-21swapper/111:22:291
3052390991816,1cyclictest0-21swapper/108:41:401
3052390991812,4cyclictest3139277-21sort11:15:141
3052390991811,5cyclictest3068473-21cron07:54:591
305239099180,1cyclictest0-21swapper/111:01:261
305239099180,17cyclictest3056-21PK-Backend12:35:141
3052385991816,1cyclictest0-21swapper/011:25:110
3052385991816,1cyclictest0-21swapper/011:25:100
3052385991816,1cyclictest0-21swapper/009:53:580
3052385991816,1cyclictest0-21swapper/008:17:400
3052385991816,1cyclictest0-21swapper/007:53:070
305239599172,2cyclictest141rcu_preempt12:20:093
3052395991715,1cyclictest3056-21PK-Backend12:19:253
3052395991710,5cyclictest3060313-21cat07:30:113
3052392991713,3cyclictest3117962-21tr10:15:132
3052392991712,3cyclictest3136606-21latency_hist11:10:002
3052392991710,5cyclictest3060746-21ntpq07:30:182
305239099179,2cyclictest26-21ksoftirqd/107:40:131
305239099178,7cyclictest3057005-21cat07:20:161
305239099177,8cyclictest3108609-21sh09:49:591
305239099172,11cyclictest3058292-21apt07:25:121
3052390991715,1cyclictest0-21swapper/112:25:271
3052390991715,1cyclictest0-21swapper/110:17:591
3052390991711,4cyclictest3149776-21cut11:45:151
3052385991711,5cyclictest3080042-21sed08:25:200
3052385991711,5cyclictest3080042-21sed08:25:200
3052395991614,1cyclictest3056-21PK-Backend07:55:443
3052395991613,2cyclictest3056-21PK-Backend11:07:003
305239299169,6cyclictest3116284-21cat10:10:112
305239299169,5cyclictest3072733-21wc08:05:172
3052390991614,1cyclictest3056-21PK-Backend09:29:131
3052390991614,1cyclictest3056-21PK-Backend09:16:411
3052390991614,1cyclictest3056-21PK-Backend07:45:101
3052390991614,1cyclictest0-21swapper/112:17:041
3052390991610,4cyclictest3127190-21ntpq10:40:171
3052385991611,4cyclictest3060725-21awk07:30:160
305239299158,5cyclictest3120045-21cut10:20:162
3052392991513,1cyclictest0-21swapper/212:10:152
3052390991511,2cyclictest3122134-21sensors_temp10:25:201
3052390991511,2cyclictest26-21ksoftirqd/110:10:001
305239099150,14cyclictest3056-21PK-Backend07:38:141
305238599159,5cyclictest3058563-21expr07:25:120
3052385991513,1cyclictest3056-21PK-Backend10:11:170
3052385991510,3cyclictest3164602-21latency_hist12:30:010
3052390991410,3cyclictest3056-21PK-Backend09:43:491
305239099130,5cyclictest141rcu_preempt10:45:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional