You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 00:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Sep 07, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133635321360,2sleep33056-21PK-Backend09:05:173
136480521340,3sleep20-21swapper/210:25:192
131928121300,3sleep30-21swapper/308:15:203
129448127940,33sleep20-21swapper/207:06:072
129449927039,24sleep30-21swapper/307:06:193
129454226242,13sleep10-21swapper/107:06:531
129450126243,13sleep00-21swapper/007:06:200
14046532580,2sleep33056-21PK-Backend12:20:013
14079512430,4sleep01407942-21cron12:30:000
13807712420,4sleep13056-21PK-Backend11:10:221
13445232380,3sleep10-21swapper/109:30:011
13607122330,5sleep10-21swapper/110:15:121
13065402330,2sleep00-21swapper/007:40:120
13114112310,3sleep10-21swapper/107:55:011
1294928993015,10cyclictest1402473-21apt-get12:15:002
13073092280,3sleep10-21swapper/107:40:211
13577312260,10sleep126-21ksoftirqd/110:05:171
129492899260,24cyclictest1389-21rtkit-daemon08:51:002
139099250,4rtkit-daemon1389-21rtkit-daemon12:37:262
13044262250,14sleep234-21ksoftirqd/207:35:012
1294935992416,5cyclictest1369279-21apt10:40:133
129492899240,22cyclictest1389-21rtkit-daemon11:20:132
13540182230,2sleep20-21swapper/209:55:122
1294935992320,2cyclictest3056-21PK-Backend07:27:233
1294925992320,2cyclictest3056-21PK-Backend08:28:241
1294925992320,2cyclictest3056-21PK-Backend08:17:011
1294925992316,4cyclictest1095-21runrttasks09:10:111
129492599231,2cyclictest0-21swapper/111:55:211
1294922992315,6cyclictest1299947-21python307:20:210
13683142220,4sleep00-21swapper/010:35:200
129493599226,15cyclictest1324320-21uname08:30:173
1294935992220,1cyclictest3056-21PK-Backend08:46:593
1294935992220,1cyclictest0-21swapper/308:43:143
1294935992214,6cyclictest1349187-21sed09:40:223
129493599220,20cyclictest3056-21PK-Backend11:31:253
1294928992218,3cyclictest886-21NetworkManager11:09:252
1294928992211,8cyclictest883-21dbus-daemon08:20:002
1294928992211,8cyclictest2085813-21snapd10:18:162
129492899220,20cyclictest0-21swapper/209:25:152
1294925992220,1cyclictest3056-21PK-Backend09:44:551
1294925992215,5cyclictest2156-21gnome-shell09:06:091
1294925992214,6cyclictest1368705-21sshd10:36:171
1294922992220,1cyclictest0-21swapper/010:19:550
1294922992220,1cyclictest0-21swapper/008:25:380
1294922992220,1cyclictest0-21swapper/008:14:020
1294922992220,1cyclictest0-21swapper/008:07:260
129492299220,21cyclictest0-21swapper/008:18:210
139099210,3rtkit-daemon1389-21rtkit-daemon09:08:172
139099210,18rtkit-daemon1317-21systemd07:40:152
1294935992119,1cyclictest3056-21PK-Backend11:35:373
1294935992119,1cyclictest3056-21PK-Backend10:22:103
1294935992119,1cyclictest3056-21PK-Backend09:36:133
1294935992119,1cyclictest3056-21PK-Backend07:45:353
1294935992119,1cyclictest3056-21PK-Backend07:35:073
1294935992119,1cyclictest0-21swapper/312:32:423
1294935992119,1cyclictest0-21swapper/311:16:113
1294935992119,1cyclictest0-21swapper/310:55:293
1294935992119,1cyclictest0-21swapper/310:50:153
1294935992119,1cyclictest0-21swapper/308:10:233
129493599211,18cyclictest1298087-21ntp_states07:15:193
129493599210,20cyclictest3056-21PK-Backend11:27:123
129493599210,19cyclictest3056-21PK-Backend11:40:373
129493599210,19cyclictest3056-21PK-Backend09:00:033
129493599210,19cyclictest3056-21PK-Backend09:00:033
129492899212,13cyclictest1095-21runrttasks11:10:212
1294928992113,6cyclictest883-21dbus-daemon08:10:152
1294928992111,7cyclictest436-20systemd-journal08:35:002
1294928992111,7cyclictest1383134-21cron11:20:002
129492899210,20cyclictest0-21swapper/211:29:042
1294925992119,1cyclictest3056-21PK-Backend12:37:121
1294925992119,1cyclictest3056-21PK-Backend10:54:171
1294925992119,1cyclictest3056-21PK-Backend08:30:331
1294925992119,1cyclictest0-21swapper/112:11:231
1294925992119,1cyclictest0-21swapper/112:07:591
1294925992119,1cyclictest0-21swapper/112:03:451
1294925992119,1cyclictest0-21swapper/111:46:091
1294925992119,1cyclictest0-21swapper/111:38:321
1294925992119,1cyclictest0-21swapper/111:25:541
1294925992119,1cyclictest0-21swapper/110:32:411
1294925992119,1cyclictest0-21swapper/109:59:421
1294925992119,1cyclictest0-21swapper/109:32:321
1294925992119,1cyclictest0-21swapper/108:59:331
1294925992118,2cyclictest3056-21PK-Backend10:41:051
129492599210,20cyclictest0-21swapper/111:50:211
129492599210,20cyclictest0-21swapper/110:04:091
129492599210,20cyclictest0-21swapper/107:36:461
1294922992119,1cyclictest0-21swapper/011:43:570
1294922992119,1cyclictest0-21swapper/011:30:320
1294922992119,1cyclictest0-21swapper/011:11:530
1294922992119,1cyclictest0-21swapper/011:02:270
1294922992119,1cyclictest0-21swapper/011:02:270
1294922992119,1cyclictest0-21swapper/010:34:210
1294922992119,1cyclictest0-21swapper/010:22:320
1294922992119,1cyclictest0-21swapper/010:10:290
1294922992119,1cyclictest0-21swapper/009:06:200
1294922992119,1cyclictest0-21swapper/007:51:580
129492299210,20cyclictest0-21swapper/012:33:390
129492299210,20cyclictest0-21swapper/012:11:490
129492299210,20cyclictest0-21swapper/007:17:440
139099200,2rtkit-daemon1389-21rtkit-daemon07:57:442
139099200,16rtkit-daemon1294916-21cyclictest07:21:003
13724662200,4sleep13056-21PK-Backend10:50:011
1294935992018,1cyclictest3056-21PK-Backend12:20:053
1294935992018,1cyclictest3056-21PK-Backend09:53:373
1294935992018,1cyclictest3056-21PK-Backend09:30:253
1294935992018,1cyclictest3056-21PK-Backend09:20:383
1294935992018,1cyclictest3056-21PK-Backend08:53:073
1294935992018,1cyclictest3056-21PK-Backend07:44:123
1294935992018,1cyclictest0-21swapper/312:36:063
1294935992018,1cyclictest0-21swapper/309:46:143
1294935992017,2cyclictest3056-21PK-Backend07:31:153
1294935992016,3cyclictest1372273-21chrt10:47:383
129493599200,1cyclictest3056-21PK-Backend12:04:513
129493599200,19cyclictest3056-21PK-Backend10:19:333
129493599200,19cyclictest3056-21PK-Backend10:03:033
129493599200,19cyclictest3056-21PK-Backend09:15:183
129493599200,19cyclictest3056-21PK-Backend08:58:283
129493599200,19cyclictest0-21swapper/311:24:353
129493599200,19cyclictest0-21swapper/311:10:093
129493599200,19cyclictest0-21swapper/311:07:323
129493599200,19cyclictest0-21swapper/308:35:433
129493599200,19cyclictest0-21swapper/308:01:163
129493599200,18cyclictest3056-21PK-Backend10:33:593
129492899208,10cyclictest34-21ksoftirqd/210:55:002
1294928992018,1cyclictest0-21swapper/211:50:472
1294928992018,1cyclictest0-21swapper/209:00:482
1294928992018,1cyclictest0-21swapper/209:00:482
1294928992012,6cyclictest1297244-21ls07:15:022
1294928992011,6cyclictest436-20systemd-journal11:00:002
129492899200,1cyclictest0-21swapper/210:10:172
129492899200,1cyclictest0-21swapper/210:01:112
129492899200,1cyclictest0-21swapper/209:37:182
129492899200,1cyclictest0-21swapper/208:55:142
129492899200,19cyclictest0-21swapper/210:43:292
129492899200,19cyclictest0-21swapper/209:34:412
129492899200,19cyclictest0-21swapper/209:13:192
129492899200,19cyclictest0-21swapper/208:38:102
129492899200,19cyclictest0-21swapper/208:23:572
129492899200,19cyclictest0-21swapper/208:03:502
129492899200,19cyclictest0-21swapper/207:29:172
1294925992018,1cyclictest3056-21PK-Backend11:09:171
1294925992018,1cyclictest3056-21PK-Backend11:01:551
1294925992018,1cyclictest3056-21PK-Backend11:01:551
1294925992018,1cyclictest3056-21PK-Backend08:45:071
1294925992018,1cyclictest3056-21PK-Backend07:26:321
1294925992018,1cyclictest3056-21PK-Backend07:16:451
1294925992018,1cyclictest0-21swapper/111:41:561
1294925992018,1cyclictest0-21swapper/109:01:091
1294925992018,1cyclictest0-21swapper/109:01:091
1294925992017,2cyclictest3056-21PK-Backend08:37:021
129492599200,1cyclictest0-21swapper/111:30:071
129492599200,1cyclictest0-21swapper/109:38:201
129492599200,19cyclictest3056-21PK-Backend08:13:301
129492599200,19cyclictest3056-21PK-Backend07:10:171
129492599200,19cyclictest3056-21PK-Backend07:10:161
129492599200,19cyclictest0-21swapper/108:52:371
1294922992018,1cyclictest0-21swapper/012:36:160
1294922992018,1cyclictest0-21swapper/012:16:010
1294922992018,1cyclictest0-21swapper/011:51:340
1294922992018,1cyclictest0-21swapper/011:47:220
1294922992018,1cyclictest0-21swapper/011:27:070
1294922992018,1cyclictest0-21swapper/010:41:110
1294922992018,1cyclictest0-21swapper/010:25:090
1294922992018,1cyclictest0-21swapper/010:08:390
1294922992018,1cyclictest0-21swapper/010:04:130
1294922992018,1cyclictest0-21swapper/009:39:460
1294922992018,1cyclictest0-21swapper/009:20:470
1294922992018,1cyclictest0-21swapper/009:01:000
1294922992018,1cyclictest0-21swapper/009:01:000
1294922992018,1cyclictest0-21swapper/008:32:540
1294922992018,1cyclictest0-21swapper/007:31:370
1294922992011,7cyclictest1400746-21cron12:10:000
129492299200,1cyclictest0-21swapper/008:01:380
129492299200,19cyclictest0-21swapper/011:24:300
129492299200,19cyclictest0-21swapper/011:09:160
129492299200,19cyclictest0-21swapper/009:10:530
129492299200,19cyclictest0-21swapper/007:59:420
129492299200,19cyclictest0-21swapper/007:39:550
1294935991917,1cyclictest3056-21PK-Backend10:37:243
1294935991917,1cyclictest3056-21PK-Backend09:25:253
1294935991914,3cyclictest978-21snmpd11:00:273
1294935991914,3cyclictest978-21snmpd11:00:273
129493599190,6cyclictest1399460-21grep12:05:143
129493599190,1cyclictest3056-21PK-Backend12:25:053
129493599190,1cyclictest3056-21PK-Backend11:50:383
129493599190,1cyclictest0-21swapper/308:07:043
129493599190,1cyclictest0-21swapper/307:57:243
129493599190,18cyclictest0-21swapper/307:10:403
129493599190,18cyclictest0-21swapper/307:10:403
129492899199,2cyclictest141rcu_preempt07:45:122
1294928991917,1cyclictest0-21swapper/211:30:542
1294928991917,1cyclictest0-21swapper/211:03:232
1294928991917,1cyclictest0-21swapper/211:03:222
1294928991917,1cyclictest0-21swapper/210:08:282
1294928991917,1cyclictest0-21swapper/209:16:302
1294928991917,1cyclictest0-21swapper/208:07:082
1294928991917,1cyclictest0-21swapper/207:50:042
1294928991917,1cyclictest0-21swapper/207:32:332
1294928991914,3cyclictest1095-21runrttasks07:21:162
1294928991912,6cyclictest1322462-21ls08:25:172
1294928991911,6cyclictest436-20systemd-journal11:55:512
129492899190,1cyclictest0-21swapper/212:29:352
129492899190,1cyclictest0-21swapper/212:08:532
129492899190,18cyclictest0-21swapper/212:32:122
129492899190,18cyclictest0-21swapper/212:16:442
129492899190,18cyclictest0-21swapper/211:48:592
129492899190,18cyclictest0-21swapper/211:42:582
129492899190,18cyclictest0-21swapper/210:46:062
129492899190,18cyclictest0-21swapper/210:34:512
129492899190,18cyclictest0-21swapper/207:11:452
129492899190,18cyclictest0-21swapper/207:11:452
1294925991917,1cyclictest3056-21PK-Backend12:29:481
1294925991917,1cyclictest3056-21PK-Backend08:44:191
1294925991917,1cyclictest3056-21PK-Backend08:22:421
1294925991917,1cyclictest3056-21PK-Backend07:57:071
1294925991917,1cyclictest0-21swapper/112:15:361
1294925991917,1cyclictest0-21swapper/110:21:391
1294925991917,1cyclictest0-21swapper/107:45:181
1294925991914,3cyclictest1404905-21grep12:20:131
1294925991913,4cyclictest1365523-21turbostat.cron10:30:001
129492599191,15cyclictest1383143-21turbostat11:20:001
129492599190,1cyclictest3056-21PK-Backend07:20:231
129492599190,1cyclictest0-21swapper/109:15:351
129492599190,18cyclictest0-21swapper/110:13:011
129492599190,18cyclictest0-21swapper/109:20:561
1294922991917,1cyclictest0-21swapper/012:24:260
1294922991917,1cyclictest0-21swapper/008:36:400
1294922991917,1cyclictest0-21swapper/007:45:570
1294922991912,6cyclictest1397553-21grep12:00:120
1294922991911,6cyclictest1-21systemd08:50:010
129492299190,1cyclictest0-21swapper/010:45:230
129492299190,1cyclictest0-21swapper/009:50:350
129492299190,1cyclictest0-21swapper/008:42:340
129492299190,18cyclictest0-21swapper/008:51:400
1294935991816,1cyclictest3056-21PK-Backend12:10:513
1294935991816,1cyclictest3056-21PK-Backend10:29:473
1294935991816,1cyclictest0-21swapper/308:26:033
129493599180,16cyclictest1320789-21memory08:20:173
1294928991816,1cyclictest0-21swapper/209:53:202
1294928991816,1cyclictest0-21swapper/208:48:522
129492899180,1cyclictest0-21swapper/208:42:432
1294925991816,1cyclictest0-21swapper/107:32:541
1294925991815,2cyclictest3056-21PK-Backend10:57:421
129492599180,1cyclictest3056-21PK-Backend08:07:081
129492599180,1cyclictest3056-21PK-Backend08:02:421
1294922991816,1cyclictest0-21swapper/008:59:240
1294922991813,3cyclictest2156-21gnome-shell09:55:090
1294922991811,5cyclictest1375248-21wc10:55:160
1294922991811,5cyclictest1301811-21cat07:25:220
1294935991715,1cyclictest3056-21PK-Backend07:50:143
129492899179,6cyclictest1349978-21awk09:45:122
129492899177,7cyclictest883-21dbus-daemon10:25:002
1294928991715,1cyclictest0-21swapper/209:44:552
1294928991710,6cyclictest1405611-21python312:20:212
129492899170,8cyclictest1368632-21python310:35:352
129492599174,11cyclictest1353106-21cron09:55:001
1294922991715,1cyclictest0-21swapper/011:55:470
1294922991712,3cyclictest1343740-21sh09:25:190
1294922991712,3cyclictest1340239-21timerandwakeup09:15:220
1294935991614,1cyclictest3056-21PK-Backend11:59:513
1294935991614,1cyclictest3056-21PK-Backend09:11:333
129492899168,6cyclictest883-21dbus-daemon09:25:002
129492299169,5cyclictest918-21rs:main0
129492299168,6cyclictest1344972-21expr09:30:120
1294922991614,1cyclictest0-21swapper/008:21:190
1294922991611,3cyclictest1381855-21tr11:15:130
129493599157,6cyclictest1353485-21mktemp09:55:013
1294928991513,1cyclictest0-21swapper/212:02:042
1294928991513,1cyclictest0-21swapper/211:36:082
1294922991513,1cyclictest0-21swapper/010:53:000
1294922991513,1cyclictest0-21swapper/009:44:470
1294922991513,1cyclictest0-21swapper/007:13:320
1294922991513,1cyclictest0-21swapper/007:13:320
1294935991412,1cyclictest3056-21PK-Backend11:49:503
1294935991412,1cyclictest3056-21PK-Backend10:11:563
1294925991410,3cyclictest3056-21PK-Backend09:46:571
129492299148,5cyclictest1350651-21tr09:45:180
129493599139,3cyclictest3056-21PK-Backend10:05:403
129492599138,2cyclictest26-21ksoftirqd/111:25:001
129492599110,3cyclictest3056-21PK-Backend12:30:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional