You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 23:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Tue Sep 22, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137002021420,6sleep2341ksoftirqd/207:10:012
147752821210,4sleep00-21swapper/012:10:220
138705321070,3sleep33056-21PK-Backend07:55:173
138705321070,3sleep33056-21PK-Backend07:55:173
14356592980,3sleep00-21swapper/010:15:010
139099760,64rtkit-daemon0-21swapper/107:09:311
136962427152,13sleep30-21swapper/307:06:293
136988826739,22sleep00-21swapper/007:09:520
13704612460,3sleep20-21swapper/207:10:132
13868682310,3sleep00-21swapper/007:55:140
13868682310,3sleep00-21swapper/007:55:140
14268412290,10sleep013-21ksoftirqd/009:50:150
14268412290,10sleep013-21ksoftirqd/009:50:150
14223852270,4sleep13056-21PK-Backend09:35:201
137003599260,3cyclictest3056-21PK-Backend07:59:582
137003599260,3cyclictest3056-21PK-Backend07:59:582
137002799261,23cyclictest2175-21JS10:27:480
14143962240,3sleep33056-21PK-Backend09:15:003
14078742240,4sleep13056-21PK-Backend08:55:141
139099240,3rtkit-daemon1389-21rtkit-daemon10:48:110
137003899249,13cyclictest1411028-21cpuspeed09:05:123
137003599230,21cyclictest1788620-21WebKitWebProces10:08:212
137003599230,21cyclictest1459561-21ntp_states11:20:202
137003599230,21cyclictest1396523-21chrt08:21:062
14757842220,3sleep10-21swapper/112:05:211
14335372220,4sleep13056-21PK-Backend10:10:011
137003899220,20cyclictest3056-21PK-Backend11:52:363
137003599223,3cyclictest141rcu_preempt08:03:232
137003599222,8cyclictest34-21ksoftirqd/208:15:122
1370035992220,1cyclictest0-21swapper/211:15:132
1370035992220,1cyclictest0-21swapper/210:48:152
1370035992217,4cyclictest34-21ksoftirqd/210:35:012
137002799224,4cyclictest1398593-21basename08:30:000
1370027992220,1cyclictest0-21swapper/011:28:300
1370027992220,1cyclictest0-21swapper/010:27:000
1370027992220,1cyclictest0-21swapper/009:26:020
1370027992220,1cyclictest0-21swapper/008:24:450
1370027992219,2cyclictest3056-21PK-Backend11:18:030
1370027992219,2cyclictest0-21swapper/010:34:080
137002799221,17cyclictest1414184-21idleruntime-cro09:14:590
137003899214,15cyclictest1438655-21seq10:21:193
1370038992119,1cyclictest3056-21PK-Backend12:03:383
1370038992119,1cyclictest3056-21PK-Backend07:26:103
1370038992119,1cyclictest0-21swapper/311:44:393
1370038992119,1cyclictest0-21swapper/311:44:393
1370038992119,1cyclictest0-21swapper/311:03:013
1370038992119,1cyclictest0-21swapper/310:27:473
1370038992119,1cyclictest0-21swapper/310:13:543
1370038992119,1cyclictest0-21swapper/310:03:543
1370038992119,1cyclictest0-21swapper/308:17:143
1370038992118,2cyclictest3056-21PK-Backend09:43:043
137003899210,20cyclictest3056-21PK-Backend07:42:123
137003899210,20cyclictest0-21swapper/308:22:213
137003899210,19cyclictest3056-21PK-Backend12:20:203
137003899210,19cyclictest3056-21PK-Backend11:17:013
137003899210,19cyclictest3056-21PK-Backend09:23:453
1370035992119,1cyclictest0-21swapper/212:20:292
1370035992119,1cyclictest0-21swapper/212:12:452
1370035992119,1cyclictest0-21swapper/212:03:592
1370035992119,1cyclictest0-21swapper/211:36:272
1370035992119,1cyclictest0-21swapper/211:08:502
1370035992119,1cyclictest0-21swapper/210:38:362
1370035992119,1cyclictest0-21swapper/210:17:192
1370035992119,1cyclictest0-21swapper/209:38:132
1370035992119,1cyclictest0-21swapper/208:49:532
1370035992119,1cyclictest0-21swapper/208:05:252
1370035992119,1cyclictest0-21swapper/207:31:392
1370035992116,4cyclictest34-21ksoftirqd/209:20:012
1370035992113,6cyclictest1424834-21perf09:45:002
1370035992112,3cyclictest34-21ksoftirqd/211:00:172
137003599210,20cyclictest0-21swapper/211:26:282
137003599210,20cyclictest0-21swapper/209:32:312
137003599210,20cyclictest0-21swapper/208:33:442
137003599210,20cyclictest0-21swapper/207:26:312
137003599210,20cyclictest0-21swapper/207:18:412
1370033992113,6cyclictest1450147-21apt10:55:101
1370033992112,7cyclictest1376165-21cstates07:25:131
137003399210,20cyclictest0-21swapper/107:23:591
137003399210,1cyclictest3056-21PK-Backend10:21:211
1370027992119,1cyclictest0-21swapper/012:24:130
1370027992119,1cyclictest0-21swapper/010:55:250
1370027992119,1cyclictest0-21swapper/010:50:520
1370027992119,1cyclictest0-21swapper/009:46:240
1370027992119,1cyclictest0-21swapper/009:20:210
1370027992119,1cyclictest0-21swapper/009:06:350
1370027992119,1cyclictest0-21swapper/008:53:040
1370027992119,1cyclictest0-21swapper/008:46:010
1370027992119,1cyclictest0-21swapper/008:31:410
1370027992119,1cyclictest0-21swapper/007:36:050
1370027992119,1cyclictest0-21swapper/007:33:410
1370027992118,2cyclictest0-21swapper/011:41:010
1370027992118,2cyclictest0-21swapper/011:41:010
1370027992117,3cyclictest1095-21runrttasks10:42:360
137002799211,19cyclictest0-21swapper/012:10:010
137002799210,20cyclictest0-21swapper/008:04:290
137002799210,20cyclictest0-21swapper/007:24:350
137002799210,19cyclictest3056-21PK-Backend08:15:190
1370038992018,1cyclictest3056-21PK-Backend12:09:333
1370038992018,1cyclictest3056-21PK-Backend08:05:043
1370038992018,1cyclictest3056-21PK-Backend07:12:453
1370038992018,1cyclictest0-21swapper/312:33:063
1370038992018,1cyclictest0-21swapper/312:25:483
1370038992018,1cyclictest0-21swapper/311:55:403
1370038992018,1cyclictest0-21swapper/310:15:573
1370038992018,1cyclictest0-21swapper/309:47:593
1370038992018,1cyclictest0-21swapper/309:35:213
1370038992018,1cyclictest0-21swapper/309:27:373
1370038992016,3cyclictest1430029-21dump-pmu-power10:00:003
137003899201,16cyclictest1399712-21python308:30:223
137003899200,1cyclictest3056-21PK-Backend07:39:013
137003899200,19cyclictest3056-21PK-Backend09:17:163
137003899200,19cyclictest3056-21PK-Backend08:04:163
137003899200,19cyclictest3056-21PK-Backend07:54:293
137003899200,19cyclictest0-21swapper/309:51:513
137003899200,19cyclictest0-21swapper/309:51:513
137003899200,19cyclictest0-21swapper/308:52:493
137003899200,19cyclictest0-21swapper/308:48:233
137003899200,19cyclictest0-21swapper/308:43:563
137003899200,18cyclictest3056-21PK-Backend12:10:353
137003599204,2cyclictest141rcu_preempt10:55:462
1370035992018,1cyclictest3056-21PK-Backend09:47:462
1370035992018,1cyclictest0-21swapper/212:32:112
1370035992018,1cyclictest0-21swapper/211:50:212
1370035992018,1cyclictest0-21swapper/210:50:322
1370035992018,1cyclictest0-21swapper/210:41:532
1370035992018,1cyclictest0-21swapper/209:55:302
1370035992018,1cyclictest0-21swapper/209:12:172
1370035992018,1cyclictest0-21swapper/209:06:022
1370035992018,1cyclictest0-21swapper/208:51:412
1370035992018,1cyclictest0-21swapper/208:43:032
1370035992018,1cyclictest0-21swapper/207:20:502
1370035992014,4cyclictest1485514-21cpuspeed_turbos12:35:122
1370035992014,4cyclictest1485514-21cpuspeed_turbos12:35:122
1370035992013,5cyclictest1475382-21cat12:05:162
1370035992013,5cyclictest1095-21runrttasks09:50:232
1370035992013,5cyclictest1095-21runrttasks09:50:222
1370035992011,7cyclictest436-20systemd-journal12:20:012
137003599200,19cyclictest0-21swapper/211:45:272
137003599200,19cyclictest0-21swapper/209:22:102
137003599200,19cyclictest0-21swapper/208:39:522
137003599200,19cyclictest0-21swapper/208:26:142
1370033992018,1cyclictest3056-21PK-Backend12:13:431
1370033992018,1cyclictest0-21swapper/111:35:451
1370033992018,1cyclictest0-21swapper/109:42:021
1370033992018,1cyclictest0-21swapper/107:33:051
1370033992018,1cyclictest0-21swapper/107:10:061
1370033992017,2cyclictest3056-21PK-Backend08:06:511
137003399200,1cyclictest3056-21PK-Backend10:03:381
137003399200,1cyclictest0-21swapper/112:20:261
137003399200,1cyclictest0-21swapper/110:50:551
137003399200,19cyclictest3056-21PK-Backend12:35:461
137003399200,19cyclictest3056-21PK-Backend12:35:461
137003399200,19cyclictest3056-21PK-Backend11:57:481
137003399200,19cyclictest3056-21PK-Backend08:46:461
137003399200,19cyclictest0-21swapper/111:49:511
137003399200,19cyclictest0-21swapper/109:55:401
137003399200,19cyclictest0-21swapper/109:19:041
137003399200,18cyclictest3056-21PK-Backend11:05:371
137003399200,18cyclictest3056-21PK-Backend10:16:291
137003399200,18cyclictest3056-21PK-Backend09:34:171
137003399200,18cyclictest3056-21PK-Backend08:12:321
137002799202,15cyclictest1386120-21latency_hist07:55:000
1370027992018,1cyclictest3056-21PK-Backend11:55:070
1370027992018,1cyclictest0-21swapper/011:53:040
1370027992018,1cyclictest0-21swapper/009:39:270
1370027992018,1cyclictest0-21swapper/009:32:450
1370027992013,5cyclictest1465695-21sed11:40:010
1370027992012,6cyclictest1371312-21awk07:10:220
137002799200,19cyclictest0-21swapper/012:35:090
137002799200,19cyclictest0-21swapper/012:35:090
137002799200,19cyclictest0-21swapper/010:08:140
137002799200,19cyclictest0-21swapper/007:46:250
137002799200,18cyclictest3056-21PK-Backend12:26:030
137003899193,3cyclictest1441975-21timerwakeupswit10:30:273
1370038991915,3cyclictest42-21ksoftirqd/310:44:103
137003899190,1cyclictest3056-21PK-Backend10:52:553
137003899190,1cyclictest3056-21PK-Backend07:32:533
137003899190,1cyclictest3056-21PK-Backend07:21:023
137003899190,1cyclictest3056-21PK-Backend07:15:223
137003899190,1cyclictest0-21swapper/308:59:523
137003899190,18cyclictest0-21swapper/310:55:113
137003899190,18cyclictest0-21swapper/308:10:443
137003599198,3cyclictest141rcu_preempt07:46:072
137003599194,9cyclictest34-21ksoftirqd/210:00:142
1370035991917,1cyclictest0-21swapper/211:59:062
1370035991917,1cyclictest0-21swapper/211:30:342
1370035991917,1cyclictest0-21swapper/208:58:452
1370035991914,4cyclictest34-21ksoftirqd/210:20:222
1370035991910,7cyclictest436-20systemd-journal12:29:592
1370035991910,3cyclictest34-21ksoftirqd/210:10:482
137003599190,1cyclictest0-21swapper/210:26:052
1370033991917,1cyclictest3056-21PK-Backend12:15:461
1370033991917,1cyclictest0-21swapper/111:30:381
1370033991917,1cyclictest0-21swapper/109:13:361
1370033991917,1cyclictest0-21swapper/107:51:231
1370033991914,3cyclictest1427490-21tail09:50:211
1370033991914,3cyclictest1427490-21tail09:50:201
1370033991913,5cyclictest1446604-21expr10:45:131
1370033991912,5cyclictest1418873-21ntp_kernel_err09:25:181
1370033991912,5cyclictest1412469-21systemd-run09:10:001
1370033991910,7cyclictest1400947-21df_inode08:35:141
137003399190,1cyclictest3056-21PK-Backend12:30:201
137003399190,1cyclictest3056-21PK-Backend12:02:421
137003399190,1cyclictest3056-21PK-Backend10:33:121
137003399190,1cyclictest0-21swapper/111:00:021
137003399190,1cyclictest0-21swapper/108:33:131
137003399190,18cyclictest3056-21PK-Backend10:26:151
137003399190,18cyclictest3056-21PK-Backend10:11:361
137003399190,18cyclictest3056-21PK-Backend08:43:211
137003399190,18cyclictest0-21swapper/111:40:521
137003399190,18cyclictest0-21swapper/111:40:511
137003399190,18cyclictest0-21swapper/109:46:551
137003399190,18cyclictest0-21swapper/109:20:051
1370027991917,1cyclictest0-21swapper/012:31:310
1370027991912,5cyclictest1453959-21expr11:05:140
137002799190,1cyclictest0-21swapper/012:15:550
137002799190,1cyclictest0-21swapper/007:25:230
137002799190,18cyclictest0-21swapper/012:02:040
137002799190,18cyclictest0-21swapper/009:40:290
137002799190,18cyclictest0-21swapper/009:17:310
137002799190,18cyclictest0-21swapper/009:03:450
137002799190,18cyclictest0-21swapper/008:57:300
1370038991816,1cyclictest3056-21PK-Backend10:46:193
137003899181,16cyclictest1409613-21df_inode09:00:153
1370038991811,5cyclictest918-21rs:main3
137003899180,16cyclictest1478401-21apt12:15:113
137003899180,16cyclictest1455708-21df11:10:123
137003599188,3cyclictest34-21ksoftirqd/208:10:032
137003599188,2cyclictest141rcu_preempt07:42:022
137003599187,3cyclictest141rcu_preempt07:50:402
1370035991816,1cyclictest0-21swapper/211:40:342
1370035991816,1cyclictest0-21swapper/211:40:332
1370035991816,1cyclictest0-21swapper/209:29:412
1370035991816,1cyclictest0-21swapper/207:35:242
1370033991816,1cyclictest3056-21PK-Backend10:39:481
1370033991816,1cyclictest3056-21PK-Backend08:16:511
1370033991811,5cyclictest1387383-21ntpq07:55:201
1370033991811,5cyclictest1387383-21ntpq07:55:191
1370033991810,7cyclictest1383783-21smartctl07:45:221
1370033991810,6cyclictest1457315-21ls11:15:111
137003399180,1cyclictest3056-21PK-Backend08:27:051
137002799189,7cyclictest1390590-21cat08:05:170
137002799183,12cyclictest1372622-21cpuspeed_turbos07:15:130
1370027991816,1cyclictest0-21swapper/010:01:170
1370027991816,1cyclictest0-21swapper/008:13:090
1370027991812,5cyclictest1456815-21cron11:15:000
1370027991812,4cyclictest1095-21runrttasks11:45:180
1370027991810,6cyclictest1-21systemd08:40:000
1370038991715,1cyclictest0-21swapper/312:36:443
1370038991715,1cyclictest0-21swapper/312:36:443
1370038991715,1cyclictest0-21swapper/309:34:203
137003899170,3cyclictest1454482-21python311:05:213
137003899170,15cyclictest14635422sleep311:32:343
1370035991711,5cyclictest1455943-21sed11:10:152
137003399179,6cyclictest1388392-21awk08:00:121
1370033991715,1cyclictest3056-21PK-Backend09:00:511
1370033991715,1cyclictest3056-21PK-Backend08:54:371
1370033991715,1cyclictest0-21swapper/112:25:541
1370033991715,1cyclictest0-21swapper/108:21:581
1370033991714,2cyclictest1462020-21cron11:30:011
1370033991710,5cyclictest1470368-21ls11:50:251
1370033991710,5cyclictest1372015-21expr07:15:021
1370027991715,1cyclictest0-21swapper/007:40:030
1370027991710,5cyclictest1436313-21cat10:15:180
1370038991614,1cyclictest3056-21PK-Backend11:25:253
1370038991611,3cyclictest1433502-21idleruntime-cro10:09:593
1370038991610,4cyclictest1384394-21turbostat07:50:003
137003899160,14cyclictest1397086-21/usr/sbin/munin08:25:143
137003399169,5cyclictest1379820-21cat07:35:151
137003399168,6cyclictest1382045-21python307:40:181
1370033991614,1cyclictest3056-21PK-Backend11:13:001
1370033991611,3cyclictest1445720-21timerwakeupswit10:40:191
137002799167,8cyclictest1462477-21cpuspeed_turbos11:30:120
137002799167,7cyclictest883-21dbus-daemon11:25:000
1370027991614,1cyclictest3056-21PK-Backend10:35:230
1370027991614,1cyclictest0-21swapper/011:04:160
1370027991614,1cyclictest0-21swapper/010:23:080
1370038991513,1cyclictest3056-21PK-Backend11:47:433
1370038991510,3cyclictest1458926-21cat11:20:133
137003599158,5cyclictest1409959-21ntpq09:00:192
137003399152,11cyclictest1460273-21cron11:25:011
137002799158,6cyclictest1402739-21basename08:40:160
137003899140,3cyclictest1401753-21taskset08:36:303
1370038991311,1cyclictest3056-21PK-Backend11:35:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional