You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 18:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Apr 25, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55025621190,2sleep10-21swapper/110:45:211
49757321120,3sleep00-21swapper/008:15:180
49744821060,4sleep33056-21PK-Backend08:15:173
47239528341,14sleep10-21swapper/107:06:511
47252428060,14sleep20-21swapper/207:08:332
47167726844,16sleep00-21swapper/007:05:200
47257826241,14sleep30-21swapper/307:09:143
4884262550,3sleep1251rcuc/107:50:171
5355722510,3sleep20-21swapper/210:05:122
5236862490,2sleep13056-21PK-Backend09:30:131
5285982460,9sleep234-21ksoftirqd/209:45:102
5329412390,2sleep00-21swapper/009:55:230
5632942360,3sleep00-21swapper/011:25:010
4741392320,4sleep234-21ksoftirqd/207:10:362
139099280,4rtkit-daemon1389-21rtkit-daemon12:25:502
139099280,4rtkit-daemon1389-21rtkit-daemon09:51:132
139099280,4rtkit-daemon1389-21rtkit-daemon08:09:212
5615592270,4sleep13056-21PK-Backend11:20:011
139099270,4rtkit-daemon1389-21rtkit-daemon12:08:192
139099270,4rtkit-daemon1389-21rtkit-daemon10:02:553
139099260,4rtkit-daemon1389-21rtkit-daemon10:12:542
47281599250,19cyclictest0-21swapper/108:40:071
139099250,3rtkit-daemon1389-21rtkit-daemon11:36:062
472815992415,2cyclictest3056-21PK-Backend10:56:201
47281599240,23cyclictest0-21swapper/109:21:511
47281599240,22cyclictest0-21swapper/107:26:111
47281599240,18cyclictest0-21swapper/111:45:481
472810992413,9cyclictest484176-21unin-run07:39:590
472826992320,2cyclictest530703-21df_inode09:50:173
472826992317,5cyclictest558543-21cstates11:10:143
472823992315,6cyclictest505536-21cron08:40:002
472823992314,7cyclictest883-21dbus-daemon11:14:012
472815992320,2cyclictest3056-21PK-Backend10:05:181
472815992316,1cyclictest0-21swapper/110:37:081
472810992321,1cyclictest0-21swapper/008:58:470
5462242220,10sleep013-21ksoftirqd/010:35:120
472826992220,1cyclictest3056-21PK-Backend07:59:253
472826992220,1cyclictest0-21swapper/307:17:133
472826992219,2cyclictest3056-21PK-Backend11:53:273
472826992219,2cyclictest3056-21PK-Backend08:27:513
472826992219,2cyclictest3056-21PK-Backend08:01:353
472826992219,2cyclictest3056-21PK-Backend07:10:513
47282699220,20cyclictest3056-21PK-Backend11:05:333
47282699220,20cyclictest3056-21PK-Backend07:35:193
472823992213,7cyclictest883-21dbus-daemon07:15:022
472815992220,1cyclictest3056-21PK-Backend11:34:061
472815992220,1cyclictest0-21swapper/108:56:561
472815992220,1cyclictest0-21swapper/108:23:171
472815992218,3cyclictest0-21swapper/112:20:091
472815992217,4cyclictest3056-21PK-Backend10:53:301
472815992216,1cyclictest3056-21PK-Backend12:05:021
47281599220,21cyclictest0-21swapper/112:00:221
472810992217,4cyclictest13-21ksoftirqd/008:55:000
472810992217,3cyclictest549136-21awk10:44:590
472826992119,1cyclictest3056-21PK-Backend12:36:263
472826992119,1cyclictest3056-21PK-Backend12:36:253
472826992119,1cyclictest3056-21PK-Backend10:48:103
472826992119,1cyclictest3056-21PK-Backend10:41:543
472826992119,1cyclictest3056-21PK-Backend10:24:043
472826992119,1cyclictest0-21swapper/311:24:343
472826992119,1cyclictest0-21swapper/311:00:063
472826992119,1cyclictest0-21swapper/309:55:243
472826992119,1cyclictest0-21swapper/309:17:043
472826992119,1cyclictest0-21swapper/308:59:413
472826992119,1cyclictest0-21swapper/307:48:293
472826992118,2cyclictest3056-21PK-Backend09:43:203
472826992118,2cyclictest3056-21PK-Backend09:38:283
472826992117,3cyclictest514716-21find09:05:123
472826992111,7cyclictest1095-21runrttasks08:55:003
47282699210,20cyclictest3056-21PK-Backend12:08:473
47282699210,20cyclictest0-21swapper/311:36:153
47282699210,19cyclictest3056-21PK-Backend08:35:013
472823992113,6cyclictest519650-21cron09:20:002
47281599212,7cyclictest484472-21apt07:40:121
472815992119,1cyclictest3056-21PK-Backend10:10:451
472815992119,1cyclictest3056-21PK-Backend09:53:141
472815992119,1cyclictest0-21swapper/110:44:251
472815992119,1cyclictest0-21swapper/110:33:151
472815992119,1cyclictest0-21swapper/110:29:231
472815992119,1cyclictest0-21swapper/110:21:531
472815992119,1cyclictest0-21swapper/109:45:171
472815992119,1cyclictest0-21swapper/108:36:421
472815992119,1cyclictest0-21swapper/108:16:281
472815992119,1cyclictest0-21swapper/107:35:451
472815992119,1cyclictest0-21swapper/107:22:411
472815992113,6cyclictest436-20systemd-journal12:15:011
472815992112,7cyclictest517204-21ntp_states09:10:191
47281599210,20cyclictest3056-21PK-Backend09:55:161
47281599210,19cyclictest3056-21PK-Backend12:27:121
472810992119,1cyclictest0-21swapper/012:38:160
472810992119,1cyclictest0-21swapper/012:38:160
472810992119,1cyclictest0-21swapper/012:03:340
472810992119,1cyclictest0-21swapper/011:45:230
472810992119,1cyclictest0-21swapper/009:54:440
472810992119,1cyclictest0-21swapper/009:47:000
472810992119,1cyclictest0-21swapper/009:44:560
472810992119,1cyclictest0-21swapper/009:19:090
472810992119,1cyclictest0-21swapper/008:21:290
472810992119,1cyclictest0-21swapper/008:12:170
472810992119,1cyclictest0-21swapper/007:48:100
472810992119,1cyclictest0-21swapper/007:41:130
472810992119,1cyclictest0-21swapper/007:32:220
472810992119,1cyclictest0-21swapper/007:25:260
472810992119,1cyclictest0-21swapper/007:16:540
472810992114,5cyclictest494073-21strings08:05:180
472810992113,6cyclictest436-20systemd-journal12:34:590
47281099210,20cyclictest0-21swapper/011:58:060
47281099210,20cyclictest0-21swapper/009:06:440
47281099210,20cyclictest0-21swapper/008:25:550
47281099210,20cyclictest0-21swapper/007:21:540
47281099210,20cyclictest0-21swapper/007:10:310
139099210,3rtkit-daemon1389-21rtkit-daemon09:31:582
139099210,3rtkit-daemon1389-21rtkit-daemon07:38:112
139099210,17rtkit-daemon1009-21lldpd09:09:082
47282699208,3cyclictest5655842expr11:30:123
472826992018,1cyclictest3056-21PK-Backend12:00:423
472826992018,1cyclictest0-21swapper/312:24:433
472826992018,1cyclictest0-21swapper/312:17:403
472826992018,1cyclictest0-21swapper/310:25:053
472826992017,2cyclictest3056-21PK-Backend12:13:143
472826992017,2cyclictest3056-21PK-Backend07:25:113
472826992013,5cyclictest42-21ksoftirqd/309:10:173
472826992011,7cyclictest522526-21python309:25:223
47282699200,1cyclictest3056-21PK-Backend09:47:123
47282699200,19cyclictest3056-21PK-Backend10:34:253
47282699200,19cyclictest3056-21PK-Backend08:20:483
47282699200,19cyclictest3056-21PK-Backend07:41:333
47282699200,19cyclictest0-21swapper/311:26:233
47282699200,19cyclictest0-21swapper/310:55:273
47282699200,19cyclictest0-21swapper/310:10:043
47282699200,19cyclictest0-21swapper/310:09:033
47282699200,19cyclictest0-21swapper/309:20:573
47282699200,18cyclictest3056-21PK-Backend12:30:093
472823992018,1cyclictest0-21swapper/211:24:352
472823992018,1cyclictest0-21swapper/211:02:582
472823992018,1cyclictest0-21swapper/209:13:142
472823992018,1cyclictest0-21swapper/207:52:492
472823992015,4cyclictest978-21snmpd09:29:262
472823992014,4cyclictest535259-21perf10:05:012
47282399200,1cyclictest0-21swapper/208:58:412
47282399200,1cyclictest0-21swapper/207:44:252
47282399200,19cyclictest0-21swapper/210:30:132
47282399200,19cyclictest0-21swapper/209:59:442
472815992018,1cyclictest3056-21PK-Backend11:35:551
472815992018,1cyclictest3056-21PK-Backend09:16:101
472815992018,1cyclictest3056-21PK-Backend07:19:231
472815992018,1cyclictest0-21swapper/112:30:511
472815992018,1cyclictest0-21swapper/108:52:041
472815992018,1cyclictest0-21swapper/107:57:071
472815992013,5cyclictest582835-21cron12:20:001
47281599200,1cyclictest3056-21PK-Backend09:25:421
47281599200,1cyclictest0-21swapper/111:25:131
47281599200,19cyclictest0-21swapper/107:47:081
47281599200,18cyclictest3056-21PK-Backend09:05:081
472810992018,1cyclictest0-21swapper/011:43:340
472810992018,1cyclictest0-21swapper/011:36:440
472810992018,1cyclictest0-21swapper/010:50:270
472810992018,1cyclictest0-21swapper/010:09:440
472810992018,1cyclictest0-21swapper/009:20:100
472810992018,1cyclictest0-21swapper/008:01:150
472810992015,3cyclictest491137-21dump-pmu-power08:00:000
472810992014,5cyclictest883-21dbus-daemon11:05:000
472810992013,5cyclictest541397-21strings10:20:170
47281099200,19cyclictest0-21swapper/012:08:010
47281099200,19cyclictest0-21swapper/010:49:260
47281099200,19cyclictest0-21swapper/010:18:370
139099200,17rtkit-daemon894-21irqbalance08:51:592
472826991917,1cyclictest3056-21PK-Backend10:17:353
472826991917,1cyclictest3056-21PK-Backend08:09:043
472826991917,1cyclictest0-21swapper/310:51:493
472826991914,3cyclictest569802-21users11:40:223
472826991914,3cyclictest495321-21tr08:10:123
47282699190,1cyclictest3056-21PK-Backend11:59:413
47282699190,1cyclictest3056-21PK-Backend09:33:343
47282699190,1cyclictest3056-21PK-Backend08:42:373
47282699190,1cyclictest3056-21PK-Backend08:35:473
47282699190,1cyclictest3056-21PK-Backend07:23:023
47282699190,1cyclictest0-21swapper/311:15:413
47282699190,18cyclictest3056-21PK-Backend08:46:153
47282699190,17cyclictest585568-21/usr/sbin/munin12:25:163
472823991917,1cyclictest0-21swapper/212:01:592
472823991917,1cyclictest0-21swapper/211:40:562
472823991917,1cyclictest0-21swapper/211:17:312
472823991917,1cyclictest0-21swapper/210:43:582
472823991917,1cyclictest0-21swapper/210:27:232
472823991917,1cyclictest0-21swapper/208:40:162
472823991917,1cyclictest0-21swapper/207:33:302
472823991917,1cyclictest0-21swapper/207:27:562
472823991916,2cyclictest565033-21wc11:30:002
472823991912,5cyclictest502465-21expr08:30:132
472823991911,6cyclictest1983-21gdbus07:48:032
47282399190,1cyclictest0-21swapper/212:34:512
47282399190,1cyclictest0-21swapper/212:22:342
47282399190,1cyclictest0-21swapper/212:18:072
47282399190,1cyclictest0-21swapper/211:50:032
47282399190,1cyclictest0-21swapper/211:31:512
47282399190,1cyclictest0-21swapper/210:56:292
47282399190,18cyclictest0-21swapper/211:06:372
47282399190,18cyclictest0-21swapper/210:35:542
47282399190,18cyclictest0-21swapper/209:21:592
47282399190,18cyclictest0-21swapper/208:49:542
47282399190,18cyclictest0-21swapper/208:21:492
472815991917,1cyclictest3056-21PK-Backend11:11:081
472815991917,1cyclictest0-21swapper/111:08:171
472815991917,1cyclictest0-21swapper/110:15:251
472815991916,2cyclictest3056-21PK-Backend11:44:001
472815991911,6cyclictest495396-21cat08:10:131
47281599190,1cyclictest3056-21PK-Backend09:00:001
47281599190,1cyclictest0-21swapper/108:26:551
47281599190,1cyclictest0-21swapper/108:05:331
47281599190,1cyclictest0-21swapper/107:32:201
47281599190,18cyclictest0-21swapper/108:48:121
47281599190,18cyclictest0-21swapper/108:02:001
472810991917,1cyclictest0-21swapper/012:28:210
472810991917,1cyclictest0-21swapper/012:14:160
472810991917,1cyclictest0-21swapper/011:06:350
472810991917,1cyclictest0-21swapper/010:02:420
472810991917,1cyclictest0-21swapper/007:53:040
472810991914,3cyclictest543198-21ntp_states10:25:200
472810991911,6cyclictest559043-21awk11:10:200
47281099190,9cyclictest566729-21dump-pmu-power11:34:590
47281099190,1cyclictest0-21swapper/012:20:300
47281099190,1cyclictest0-21swapper/009:31:190
47281099190,18cyclictest0-21swapper/010:32:490
47281099190,18cyclictest0-21swapper/010:12:210
47281099190,18cyclictest0-21swapper/008:45:220
472826991816,1cyclictest3056-21PK-Backend11:47:113
472826991812,5cyclictest488339-21seq07:50:163
472823991816,1cyclictest0-21swapper/212:13:412
472823991816,1cyclictest0-21swapper/211:56:322
472823991816,1cyclictest0-21swapper/210:45:472
472823991816,1cyclictest0-21swapper/209:37:412
472823991816,1cyclictest0-21swapper/207:23:362
472823991812,4cyclictest1095-21runrttasks07:55:212
472815991816,1cyclictest0-21swapper/112:36:181
472815991816,1cyclictest0-21swapper/112:36:181
472815991816,1cyclictest0-21swapper/111:56:441
472815991816,1cyclictest0-21swapper/111:01:491
472815991816,1cyclictest0-21swapper/109:40:231
472815991811,5cyclictest572343-21expr11:50:131
472815991811,5cyclictest534600-21cut10:00:191
472815991811,5cyclictest473199-21mktemp07:10:021
472810991816,1cyclictest0-21swapper/011:27:170
472810991816,1cyclictest0-21swapper/010:57:300
472810991816,1cyclictest0-21swapper/008:39:060
472810991813,3cyclictest526601-21idleruntime-cro09:39:590
472826991712,3cyclictest513575-21memory09:00:183
47282699170,15cyclictest5471242sleep310:36:433
47282399179,6cyclictest512995-21apt09:00:112
472823991715,1cyclictest0-21swapper/210:21:412
472823991715,1cyclictest0-21swapper/208:18:252
472823991711,5cyclictest502094-21systemd-run08:30:012
472823991710,6cyclictest539325-21expr10:15:132
472815991715,1cyclictest0-21swapper/109:38:211
472815991711,5cyclictest503930-21sed08:34:591
472810991715,1cyclictest0-21swapper/011:54:290
472810991715,1cyclictest0-21swapper/009:00:500
472810991711,4cyclictest13-21ksoftirqd/008:40:180
472826991611,3cyclictest481711-21open_inodes07:30:203
47282399169,5cyclictest883-21dbus-daemon08:15:012
47282399162,12cyclictest551524-21tr10:50:122
472823991614,1cyclictest0-21swapper/208:02:232
47281099169,5cyclictest503375-21ls08:30:230
472810991611,3cyclictest522569-21switchtime09:25:220
472823991511,2cyclictest34-21ksoftirqd/209:40:132
47281099152,12cyclictest1095-21runrttasks12:15:380
472810991513,1cyclictest0-21swapper/009:14:280
472810991512,2cyclictest0-21swapper/011:19:410
47282399147,5cyclictest570462-21apt11:45:102
472815991410,3cyclictest3056-21PK-Backend11:21:241
47282399138,3cyclictest588808-21cstates12:35:142
47282399138,3cyclictest588808-21cstates12:35:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional