You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-06 - 23:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Fri Nov 06, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
141824821150,2sleep20-21swapper/209:45:152
139020021070,2sleep20-21swapper/208:25:152
136194028061,13sleep00-21swapper/007:07:020
136072427946,24sleep30-21swapper/307:05:123
136108826840,22sleep20-21swapper/207:05:142
136193626343,13sleep10-21swapper/107:06:581
14612182490,3sleep10-21swapper/111:50:011
13783462470,3sleep10-21swapper/107:50:181
14752602460,3sleep30-21swapper/312:30:023
139099370,3rtkit-daemon0-21swapper/110:25:041
1362320993311,6cyclictest1401710-21cron09:00:011
1362320993212,18cyclictest1474141-21wc12:25:161
136232099307,12cyclictest1420703-21seq09:50:501
136232099303,14cyclictest0-21swapper/111:52:401
136232099297,12cyclictest1411826-21taskset09:26:281
1362326992811,6cyclictest1447041-21sh11:09:593
1362326992811,4cyclictest1478023-21needreboot12:35:173
136232099287,11cyclictest1375421-21taskset07:41:341
136232099286,8cyclictest1425948-21taskset10:06:271
136232099283,13cyclictest0-21swapper/110:18:541
136232099282,12cyclictest0-21swapper/112:36:521
1362315992824,3cyclictest13-21ksoftirqd/011:50:020
136232099273,13cyclictest0-21swapper/110:41:401
136232099272,8cyclictest1393270-21taskset08:35:061
139099260,4rtkit-daemon1389-21rtkit-daemon12:32:112
139099260,4rtkit-daemon1389-21rtkit-daemon11:09:332
136232699260,19cyclictest3056-21PK-Backend07:40:363
136232099265,19cyclictest1426715-21cstates10:10:111
136232099265,11cyclictest1410262-21taskset09:23:401
136232099264,4cyclictest1430840-21python310:20:201
136232099263,12cyclictest0-21swapper/107:26:431
136232099262,13cyclictest0-21swapper/110:38:511
136232099262,12cyclictest0-21swapper/108:28:581
136232099260,16cyclictest0-21swapper/111:00:111
139099250,4rtkit-daemon1389-21rtkit-daemon12:36:402
139099250,18rtkit-daemon978-21snmpd07:36:562
136232099256,11cyclictest1095-21runrttasks12:31:431
136232099256,11cyclictest1095-21runrttasks11:21:081
136232099254,5cyclictest0-21swapper/112:05:171
136232099253,8cyclictest0-21swapper/107:20:091
136232099253,14cyclictest0-21swapper/112:11:461
136232099252,15cyclictest1404961-21runrttasks09:07:221
136232099252,15cyclictest1404961-21runrttasks09:07:221
136232099252,13cyclictest0-21swapper/111:36:291
14187062240,4sleep33056-21PK-Backend09:45:213
136232699240,20cyclictest3056-21PK-Backend07:58:333
136232099245,8cyclictest1095-21runrttasks07:31:311
136232099245,5cyclictest1095-21runrttasks08:51:521
136232099244,8cyclictest1415707-21taskset09:38:271
136232099244,11cyclictest0-21swapper/107:55:121
136232099242,13cyclictest0-21swapper/110:31:401
136232099241,6cyclictest0-21swapper/109:00:121
1362320992413,6cyclictest1464906-21apt12:00:111
1362320992412,9cyclictest1-21systemd08:41:081
1362326992318,1cyclictest3056-21PK-Backend07:19:463
1362325992321,1cyclictest0-21swapper/208:10:362
136232099235,7cyclictest1442079-21/usr/sbin/munin10:55:201
136232099233,10cyclictest0-21swapper/111:28:181
136232099232,8cyclictest1408679-21/usr/sbin/munin09:20:011
136232099232,8cyclictest0-21swapper/109:14:181
1362320992313,6cyclictest1421311-21apt09:55:111
1362320992310,9cyclictest883-21dbus-daemon10:04:591
136232099230,14cyclictest0-21swapper/108:45:191
1362315992321,1cyclictest0-21swapper/010:32:230
14402412220,4chrt0-21swapper/010:50:020
139099220,4rtkit-daemon1389-21rtkit-daemon08:08:292
1362326992220,1cyclictest3056-21PK-Backend08:58:163
1362326992220,1cyclictest3056-21PK-Backend08:15:093
1362326992220,1cyclictest3056-21PK-Backend07:35:013
1362326992219,2cyclictest3056-21PK-Backend10:16:443
1362326992218,3cyclictest3056-21PK-Backend08:22:193
136232699220,20cyclictest3056-21PK-Backend12:21:013
136232699220,20cyclictest3056-21PK-Backend11:15:103
136232699220,20cyclictest3056-21PK-Backend08:50:043
1362325992220,1cyclictest0-21swapper/212:15:112
1362325992220,1cyclictest0-21swapper/211:03:412
1362325992220,1cyclictest0-21swapper/207:42:382
136232599220,21cyclictest0-21swapper/212:23:162
136232599220,21cyclictest0-21swapper/207:31:012
136232099223,6cyclictest0-21swapper/110:50:181
136232099222,8cyclictest0-21swapper/107:14:311
136232099222,7cyclictest0-21swapper/111:42:231
136232099222,6cyclictest1450281-21seq11:17:251
1362320992220,1cyclictest0-21swapper/108:21:451
1362320992212,6cyclictest1463172-21apt11:55:111
136232099220,9cyclictest0-21swapper/108:10:141
136232099220,3cyclictest1373262-21users07:35:211
136232099220,20cyclictest1788620-21WebKitWebProces11:05:101
1362315992220,1cyclictest0-21swapper/012:04:090
1362315992220,1cyclictest0-21swapper/011:16:380
1362315992220,1cyclictest0-21swapper/009:45:130
1362315992220,1cyclictest0-21swapper/008:40:160
1362315992218,3cyclictest1475450-21cpuspeed_turbos12:30:120
136231599220,21cyclictest0-21swapper/010:51:090
136231599220,21cyclictest0-21swapper/010:16:150
136231599220,21cyclictest0-21swapper/008:00:350
139099210,4rtkit-daemon1389-21rtkit-daemon11:23:242
139099210,4rtkit-daemon1389-21rtkit-daemon10:47:522
139099210,17rtkit-daemon1788643-21eadedCompositor11:30:082
13691742210,5chrt3056-21PK-Backend07:25:173
1362326992119,1cyclictest3056-21PK-Backend10:54:293
1362326992119,1cyclictest3056-21PK-Backend10:45:033
1362326992119,1cyclictest3056-21PK-Backend10:41:373
1362326992119,1cyclictest3056-21PK-Backend10:32:113
1362326992119,1cyclictest3056-21PK-Backend09:58:533
1362326992119,1cyclictest3056-21PK-Backend09:04:043
1362326992119,1cyclictest3056-21PK-Backend07:53:333
136232699210,19cyclictest3056-21PK-Backend12:05:193
136232699210,19cyclictest3056-21PK-Backend08:30:173
1362325992119,1cyclictest0-21swapper/212:26:542
1362325992119,1cyclictest0-21swapper/210:40:482
1362325992119,1cyclictest0-21swapper/210:28:052
1362325992119,1cyclictest0-21swapper/210:22:372
1362325992119,1cyclictest0-21swapper/210:18:582
1362325992119,1cyclictest0-21swapper/209:51:072
1362325992119,1cyclictest0-21swapper/209:27:072
1362325992119,1cyclictest0-21swapper/209:14:032
1362325992119,1cyclictest0-21swapper/208:42:402
1362325992119,1cyclictest0-21swapper/208:23:002
1362325992119,1cyclictest0-21swapper/208:17:122
1362325992119,1cyclictest0-21swapper/207:49:272
1362325992119,1cyclictest0-21swapper/207:17:432
136232599210,20cyclictest0-21swapper/212:14:102
136232599210,20cyclictest0-21swapper/212:05:532
136232599210,20cyclictest0-21swapper/210:53:322
136232599210,19cyclictest3056-21PK-Backend11:10:092
136232099213,8cyclictest1382605-21runrttasks08:04:511
1362320992119,1cyclictest0-21swapper/107:49:211
136232099210,20cyclictest0-21swapper/112:16:061
136232099210,1cyclictest0-21swapper/108:16:111
136232099210,13cyclictest0-21swapper/109:40:111
136231599218,4cyclictest13-21ksoftirqd/010:06:260
1362315992119,1cyclictest0-21swapper/012:28:230
1362315992119,1cyclictest0-21swapper/011:51:260
1362315992119,1cyclictest0-21swapper/011:02:040
1362315992119,1cyclictest0-21swapper/010:40:290
1362315992119,1cyclictest0-21swapper/010:14:250
1362315992119,1cyclictest0-21swapper/009:30:180
1362315992119,1cyclictest0-21swapper/009:20:520
1362315992118,2cyclictest1401988-21apt09:00:110
1362315992118,2cyclictest0-21swapper/011:35:030
1362315992116,4cyclictest13-21ksoftirqd/007:30:010
1362315992115,5cyclictest13-21ksoftirqd/007:40:010
136231599211,4cyclictest1415856-21munin-plugin-st09:40:000
136231599210,20cyclictest0-21swapper/011:30:230
136231599210,20cyclictest0-21swapper/011:29:210
136231599210,20cyclictest0-21swapper/009:19:030
136231599210,20cyclictest0-21swapper/008:30:030
136231599210,20cyclictest0-21swapper/007:12:290
14080832200,4sleep33056-21PK-Backend09:15:203
1362326992018,1cyclictest3056-21PK-Backend12:30:273
1362326992018,1cyclictest3056-21PK-Backend11:40:453
1362326992018,1cyclictest3056-21PK-Backend11:12:333
1362326992018,1cyclictest3056-21PK-Backend11:03:073
1362326992018,1cyclictest3056-21PK-Backend10:38:123
1362326992018,1cyclictest3056-21PK-Backend10:26:583
1362326992018,1cyclictest3056-21PK-Backend10:24:213
1362326992018,1cyclictest3056-21PK-Backend10:05:413
1362326992018,1cyclictest3056-21PK-Backend10:02:163
1362326992018,1cyclictest3056-21PK-Backend09:29:253
1362326992018,1cyclictest3056-21PK-Backend09:10:393
1362326992018,1cyclictest3056-21PK-Backend08:10:233
1362326992018,1cyclictest3056-21PK-Backend08:06:113
1362326992017,2cyclictest3056-21PK-Backend10:14:063
1362326992017,2cyclictest3056-21PK-Backend09:20:263
136232699200,19cyclictest3056-21PK-Backend12:18:233
136232699200,19cyclictest3056-21PK-Backend12:03:303
136232699200,19cyclictest3056-21PK-Backend11:36:193
136232699200,19cyclictest3056-21PK-Backend11:27:283
136232699200,19cyclictest3056-21PK-Backend09:40:133
136232699200,19cyclictest3056-21PK-Backend08:03:343
1362325992018,1cyclictest0-21swapper/209:15:522
1362325992018,1cyclictest0-21swapper/208:36:382
1362325992018,1cyclictest0-21swapper/208:30:362
1362325992018,1cyclictest0-21swapper/208:01:432
1362325992018,1cyclictest0-21swapper/207:23:042
1362325992012,6cyclictest1434144-21awk10:30:182
1362325992012,6cyclictest1378149-21cat07:50:162
136232599200,1cyclictest0-21swapper/210:03:382
136232599200,19cyclictest0-21swapper/210:35:212
136232599200,19cyclictest0-21swapper/209:37:362
136232599200,19cyclictest0-21swapper/208:55:442
136232599200,19cyclictest0-21swapper/207:57:172
136232099202,13cyclictest1412649-21apt09:30:111
1362320992018,1cyclictest0-21swapper/108:30:441
1362320992012,5cyclictest1454247-21apt11:30:111
136232099200,19cyclictest0-21swapper/112:23:441
1362315992017,2cyclictest0-21swapper/007:33:320
1362315992016,3cyclictest13-21ksoftirqd/010:59:590
1362315992015,3cyclictest1375706-21idleruntime-cro07:45:000
1362315992015,3cyclictest13-21ksoftirqd/007:19:590
1362315992013,5cyclictest1420226-21needreboot09:50:160
1362315992012,6cyclictest436-20systemd-journal11:14:590
1362315992010,2cyclictest141rcu_preempt07:57:410
136231599200,19cyclictest0-21swapper/010:01:070
136231599200,19cyclictest0-21swapper/009:13:010
136231599200,19cyclictest0-21swapper/008:58:220
136231599200,19cyclictest0-21swapper/008:47:050
136231599200,19cyclictest0-21swapper/008:19:130
136231599200,19cyclictest0-21swapper/008:08:260
136231599200,19cyclictest0-21swapper/007:51:080
136231599200,19cyclictest0-21swapper/007:20:120
1362326991917,1cyclictest3056-21PK-Backend12:14:593
1362326991917,1cyclictest3056-21PK-Backend09:54:403
1362326991917,1cyclictest3056-21PK-Backend08:38:293
1362326991917,1cyclictest3056-21PK-Backend07:21:223
136232699190,18cyclictest3056-21PK-Backend11:20:253
1362325991917,1cyclictest3056-21PK-Backend10:56:242
1362325991917,1cyclictest0-21swapper/211:52:542
1362325991917,1cyclictest0-21swapper/209:02:472
1362325991917,1cyclictest0-21swapper/208:53:072
1362325991917,1cyclictest0-21swapper/207:26:142
1362325991917,1cyclictest0-21swapper/207:14:392
136232599190,1cyclictest0-21swapper/211:36:052
136232599190,1cyclictest0-21swapper/211:28:352
136232599190,1cyclictest0-21swapper/210:13:312
136232599190,1cyclictest0-21swapper/209:43:502
136232599190,18cyclictest0-21swapper/212:01:132
136232099192,13cyclictest1418706-21runrttasks09:45:211
1362320991914,4cyclictest26-21ksoftirqd/111:15:011
1362315991917,1cyclictest0-21swapper/011:42:190
1362315991917,1cyclictest0-21swapper/010:24:200
1362315991917,1cyclictest0-21swapper/009:27:420
1362315991913,5cyclictest1472920-21sed12:20:230
1362315991912,5cyclictest1463612-21iwlist11:55:150
1362315991912,5cyclictest1446999-21seq11:09:460
1362315991911,6cyclictest1470875-21ntpq12:15:200
1362315991911,6cyclictest1404092-21df09:05:130
1362315991911,6cyclictest1404092-21df09:05:130
1362315991911,6cyclictest1390417-21memory08:25:200
136231599190,1cyclictest0-21swapper/012:11:260
136231599190,18cyclictest0-21swapper/011:20:170
136231599190,18cyclictest0-21swapper/010:26:080
136231599190,18cyclictest0-21swapper/008:38:280
1362326991816,1cyclictest3056-21PK-Backend11:58:173
1362326991816,1cyclictest3056-21PK-Backend11:50:263
1362326991816,1cyclictest3056-21PK-Backend08:44:173
1362326991816,1cyclictest3056-21PK-Backend07:34:143
1362326991816,1cyclictest0-21swapper/310:56:183
1362325991816,1cyclictest0-21swapper/211:48:142
1362325991816,1cyclictest0-21swapper/209:59:122
1362325991816,1cyclictest0-21swapper/209:34:592
136232599180,1cyclictest0-21swapper/208:45:172
136232099189,7cyclictest1383052-21tr08:05:131
136232099187,8cyclictest1438615-21/usr/sbin/munin10:45:191
136232099182,6cyclictest26-21ksoftirqd/107:15:441
136231599187,2cyclictest141rcu_preempt10:35:210
1362315991813,3cyclictest13-21ksoftirqd/008:25:000
1362315991811,5cyclictest1398751-21cat08:50:120
136231599180,1cyclictest0-21swapper/008:10:140
1362326991715,1cyclictest3056-21PK-Backend11:45:593
1362326991715,1cyclictest3056-21PK-Backend11:31:053
1362326991715,1cyclictest3056-21PK-Backend08:25:303
136232699170,3cyclictest1362883-21df_inode07:10:143
1362325991715,1cyclictest0-21swapper/211:55:462
136231599177,4cyclictest13-21ksoftirqd/007:47:020
1362315991715,1cyclictest0-21swapper/012:37:150
1362315991715,1cyclictest0-21swapper/012:09:370
1362315991715,1cyclictest0-21swapper/009:40:450
136231599170,7cyclictest1421953-21/usr/sbin/munin09:55:180
136232699160,14cyclictest13979362sleep308:46:093
1362325991614,1cyclictest0-21swapper/211:43:352
1362325991614,1cyclictest0-21swapper/209:24:302
1362326991510,3cyclictest1414753-21diskstats09:35:133
136232599159,5cyclictest1449934-21sed11:15:202
136232599154,9cyclictest1404382-21grep09:05:182
136232599154,9cyclictest1404382-21grep09:05:182
1362325991513,1cyclictest0-21swapper/210:09:062
136232699149,4cyclictest42-21ksoftirqd/307:45:233
136232699139,3cyclictest3056-21PK-Backend09:08:473
136232699139,3cyclictest3056-21PK-Backend09:08:463
136232699138,4cyclictest1414145-21systemd09:35:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional