You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 15:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Tue Aug 11, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282353821380,4sleep3411rcuc/307:30:213
281369921070,8sleep20-21swapper/207:05:212
139099920,74rtkit-daemon0-21swapper/007:05:240
28920352900,2sleep00-21swapper/010:45:220
281408127741,13sleep30-21swapper/307:05:553
28370422650,3sleep10-21swapper/108:10:131
281405226344,13sleep10-21swapper/107:05:331
28764352470,4sleep13056-21PK-Backend10:00:241
28304212440,4sleep13056-21PK-Backend07:50:191
28191902360,4sleep13056-21PK-Backend07:20:131
28471392300,8sleep013-21ksoftirqd/008:38:390
2814605993025,4cyclictest13-21ksoftirqd/009:05:010
28354372250,3sleep234-21ksoftirqd/208:05:132
28848492240,1sleep10-21swapper/110:25:191
2814612992416,6cyclictest2903270-21cron11:20:012
139099240,16rtkit-daemon3056-21PK-Backend09:51:451
139099240,15rtkit-daemon3056-21PK-Backend09:20:311
28272812230,5sleep30-21swapper/307:40:203
2814605992321,1cyclictest0-21swapper/007:16:270
2814617992220,1cyclictest0-21swapper/309:05:293
281461799220,20cyclictest2924826-21irqstats12:20:153
281461299220,19cyclictest0-21swapper/207:41:142
2814609992220,1cyclictest0-21swapper/110:40:411
2814609992218,3cyclictest2850740-21munin-plugin-st08:49:591
2814605992220,1cyclictest0-21swapper/010:16:270
2814605992219,2cyclictest0-21swapper/007:58:250
2814605992216,4cyclictest2884465-21expr10:25:140
139099220,14rtkit-daemon3056-21PK-Backend10:09:391
139099220,14rtkit-daemon3056-21PK-Backend07:25:191
2814617992119,1cyclictest3056-21PK-Backend12:35:443
2814617992119,1cyclictest3056-21PK-Backend10:53:363
2814617992119,1cyclictest3056-21PK-Backend10:44:453
2814617992119,1cyclictest3056-21PK-Backend08:40:343
2814617992119,1cyclictest0-21swapper/310:17:343
2814617992119,1cyclictest0-21swapper/308:28:513
2814617992119,1cyclictest0-21swapper/307:29:033
2814617992119,1cyclictest0-21swapper/307:12:133
2814617992118,2cyclictest3056-21PK-Backend10:45:333
281461799210,20cyclictest3056-21PK-Backend08:56:563
281461799210,20cyclictest0-21swapper/310:04:373
281461799210,20cyclictest0-21swapper/307:46:333
281461799210,20cyclictest0-21swapper/307:46:333
281461799210,19cyclictest3056-21PK-Backend08:37:233
2814612992119,1cyclictest0-21swapper/211:54:152
2814612992111,8cyclictest2924096-21perf12:20:012
2814609992119,1cyclictest3056-21PK-Backend11:17:191
2814609992119,1cyclictest3056-21PK-Backend10:21:491
2814609992119,1cyclictest3056-21PK-Backend10:14:591
2814609992119,1cyclictest3056-21PK-Backend09:36:341
2814609992119,1cyclictest3056-21PK-Backend09:28:361
2814609992119,1cyclictest0-21swapper/112:25:261
2814609992119,1cyclictest0-21swapper/111:57:281
2814609992119,1cyclictest0-21swapper/111:52:271
2814609992119,1cyclictest0-21swapper/111:04:141
2814609992119,1cyclictest0-21swapper/110:46:371
2814609992119,1cyclictest0-21swapper/109:05:041
2814609992119,1cyclictest0-21swapper/109:03:421
2814609992119,1cyclictest0-21swapper/108:56:321
2814609992119,1cyclictest0-21swapper/108:35:231
2814609992119,1cyclictest0-21swapper/108:33:001
281460999210,20cyclictest3056-21PK-Backend08:29:151
281460999210,20cyclictest0-21swapper/112:36:131
281460999210,20cyclictest0-21swapper/111:06:371
281460999210,19cyclictest3056-21PK-Backend12:13:501
281460999210,19cyclictest3056-21PK-Backend11:26:591
281460999210,19cyclictest3056-21PK-Backend11:12:461
281460999210,19cyclictest3056-21PK-Backend07:17:091
2814605992119,1cyclictest0-21swapper/012:39:110
2814605992119,1cyclictest0-21swapper/012:12:400
2814605992119,1cyclictest0-21swapper/011:40:490
2814605992119,1cyclictest0-21swapper/011:20:430
2814605992119,1cyclictest0-21swapper/011:17:310
2814605992119,1cyclictest0-21swapper/010:57:040
2814605992119,1cyclictest0-21swapper/010:39:050
2814605992119,1cyclictest0-21swapper/009:25:030
2814605992119,1cyclictest0-21swapper/009:20:570
2814605992119,1cyclictest0-21swapper/008:43:540
2814605992119,1cyclictest0-21swapper/008:31:230
2814605992119,1cyclictest0-21swapper/008:29:470
2814605992119,1cyclictest0-21swapper/008:24:270
2814605992119,1cyclictest0-21swapper/008:18:320
2814605992119,1cyclictest0-21swapper/008:14:470
2814605992119,1cyclictest0-21swapper/007:50:540
2814605992119,1cyclictest0-21swapper/007:33:230
2814605992116,3cyclictest2896983-21df_inode11:00:150
281460599210,20cyclictest0-21swapper/011:13:320
281460599210,20cyclictest0-21swapper/010:33:110
281460599210,20cyclictest0-21swapper/010:12:080
281460599210,20cyclictest0-21swapper/010:09:590
139099210,14rtkit-daemon3056-21PK-Backend09:58:461
139099210,14rtkit-daemon0-21swapper/107:57:521
2814617992018,1cyclictest3056-21PK-Backend09:04:073
2814617992018,1cyclictest0-21swapper/312:05:233
2814617992018,1cyclictest0-21swapper/311:23:243
2814617992018,1cyclictest0-21swapper/311:05:203
2814617992018,1cyclictest0-21swapper/310:36:413
2814617992018,1cyclictest0-21swapper/308:31:143
2814617992018,1cyclictest0-21swapper/308:03:093
2814617992015,3cyclictest978-21snmpd11:28:013
2814617992015,3cyclictest2928564-21ntp_states12:30:223
2814617992013,5cyclictest2831604-21expr07:55:153
281461799200,1cyclictest3056-21PK-Backend09:46:043
281461799200,19cyclictest3056-21PK-Backend11:41:223
281461799200,19cyclictest0-21swapper/309:53:283
281461799200,19cyclictest0-21swapper/309:43:213
281461799200,19cyclictest0-21swapper/309:43:213
281461799200,19cyclictest0-21swapper/309:35:303
281461799200,19cyclictest0-21swapper/309:12:043
281461799200,19cyclictest0-21swapper/307:53:163
281461799200,19cyclictest0-21swapper/307:24:093
281461799200,18cyclictest3056-21PK-Backend11:55:223
281461799200,18cyclictest3056-21PK-Backend08:11:283
281461299202,17cyclictest1095-21runrttasks09:20:092
2814612992018,1cyclictest0-21swapper/211:46:512
2814612992018,1cyclictest0-21swapper/211:38:402
2814612992018,1cyclictest0-21swapper/210:50:132
2814612992018,1cyclictest0-21swapper/210:26:472
2814612992018,1cyclictest0-21swapper/209:17:462
2814612992018,1cyclictest0-21swapper/209:11:102
2814612992018,1cyclictest0-21swapper/208:30:212
2814612992018,1cyclictest0-21swapper/208:16:562
2814612992018,1cyclictest0-21swapper/208:01:552
2814612992018,1cyclictest0-21swapper/207:31:472
2814612992016,3cyclictest1095-21runrttasks12:10:082
2814612992016,3cyclictest1095-21runrttasks09:37:172
2814612992016,3cyclictest1095-21runrttasks07:36:522
281461299200,19cyclictest0-21swapper/212:00:022
281461299200,19cyclictest0-21swapper/208:59:212
281461299200,19cyclictest0-21swapper/207:24:102
281461299200,19cyclictest0-21swapper/207:17:472
281460999209,9cyclictest3056-21PK-Backend09:20:001
2814609992018,1cyclictest3056-21PK-Backend11:32:191
2814609992018,1cyclictest3056-21PK-Backend09:41:141
2814609992018,1cyclictest3056-21PK-Backend09:41:131
2814609992018,1cyclictest3056-21PK-Backend09:13:561
2814609992018,1cyclictest0-21swapper/109:47:141
2814609992018,1cyclictest0-21swapper/108:16:161
2814609992016,2cyclictest3056-21PK-Backend11:35:301
2814609992013,5cyclictest2893252-21cat10:50:141
2814609992013,5cyclictest2836694-21cut08:10:011
2814609992012,6cyclictest436-20systemd-journal11:44:551
281460999200,1cyclictest3056-21PK-Backend07:33:451
281460999200,19cyclictest0-21swapper/111:49:031
281460999200,18cyclictest3056-21PK-Backend07:47:241
281460999200,18cyclictest3056-21PK-Backend07:47:241
2814605992018,1cyclictest0-21swapper/009:56:060
2814605992018,1cyclictest0-21swapper/009:52:000
2814605992018,1cyclictest0-21swapper/009:36:120
2814605992018,1cyclictest0-21swapper/009:34:030
2814605992018,1cyclictest0-21swapper/009:18:140
2814605992018,1cyclictest0-21swapper/009:06:590
2814605992018,1cyclictest0-21swapper/008:59:000
2814605992018,1cyclictest0-21swapper/008:01:210
2814605992013,5cyclictest2870049-21cron09:45:000
2814605992013,5cyclictest2870049-21cron09:45:000
2814605992013,5cyclictest2835011-21dpkg08:05:010
281460599200,19cyclictest0-21swapper/012:18:410
281460599200,19cyclictest0-21swapper/010:42:030
281460599200,19cyclictest0-21swapper/010:22:560
281460599200,19cyclictest0-21swapper/007:21:140
139099200,13rtkit-daemon0-21swapper/007:37:000
2814617991917,1cyclictest3056-21PK-Backend12:01:103
2814617991917,1cyclictest3056-21PK-Backend10:33:433
2814617991917,1cyclictest0-21swapper/312:17:383
2814617991917,1cyclictest0-21swapper/309:31:573
2814617991917,1cyclictest0-21swapper/309:23:333
2814617991917,1cyclictest0-21swapper/307:15:243
2814617991916,2cyclictest3056-21PK-Backend12:25:303
2814617991916,2cyclictest3056-21PK-Backend08:17:363
2814617991914,3cyclictest2863754-21df09:25:123
2814617991912,5cyclictest2913680-21cron11:49:593
2814617991912,5cyclictest2874541-21ntpq09:55:203
2814617991912,5cyclictest2841198-21python308:20:223
2814617991911,6cyclictest436-20systemd-journal09:15:343
2814617991911,6cyclictest2907388-21df11:30:143
281461799191,16cyclictest2902674-21python311:15:213
281461799190,1cyclictest0-21swapper/312:10:363
281461799190,1cyclictest0-21swapper/310:22:403
281461799190,1cyclictest0-21swapper/308:06:553
281461799190,17cyclictest2898082-21grep11:05:003
2814612991917,1cyclictest0-21swapper/210:45:062
2814612991917,1cyclictest0-21swapper/209:51:332
2814612991917,1cyclictest0-21swapper/209:33:352
2814612991917,1cyclictest0-21swapper/209:25:572
2814612991917,1cyclictest0-21swapper/208:52:592
2814612991917,1cyclictest0-21swapper/208:12:222
281461299190,1cyclictest0-21swapper/212:33:562
281461299190,1cyclictest0-21swapper/210:33:162
281461299190,1cyclictest0-21swapper/209:42:472
281461299190,1cyclictest0-21swapper/209:42:472
281461299190,1cyclictest0-21swapper/209:06:302
281461299190,1cyclictest0-21swapper/209:03:132
281461299190,1cyclictest0-21swapper/207:55:132
281461299190,1cyclictest0-21swapper/207:51:282
281461299190,18cyclictest0-21swapper/211:12:242
281461299190,18cyclictest0-21swapper/210:17:212
281461299190,18cyclictest0-21swapper/208:46:502
281460999199,8cyclictest436-20systemd-journal08:55:001
2814609991917,1cyclictest3056-21PK-Backend07:14:121
2814609991915,3cyclictest2888138-21if_enp2s010:35:161
2814609991912,4cyclictest28345892sleep108:05:011
2814609991911,6cyclictest2827678-21cron07:45:001
281460999190,1cyclictest3056-21PK-Backend11:21:041
281460999190,1cyclictest3056-21PK-Backend08:24:081
281460999190,1cyclictest3056-21PK-Backend07:36:291
281460599194,13cyclictest2820819-21tr07:25:130
2814605991917,1cyclictest0-21swapper/012:30:460
2814605991917,1cyclictest0-21swapper/012:20:320
2814605991917,1cyclictest0-21swapper/011:34:150
2814605991917,1cyclictest0-21swapper/010:54:390
2814605991917,1cyclictest0-21swapper/009:49:170
2814605991917,1cyclictest0-21swapper/009:13:350
2814605991917,1cyclictest0-21swapper/008:51:170
2814605991917,1cyclictest0-21swapper/007:42:500
2814605991915,3cyclictest2898886-21latency11:05:180
2814605991912,5cyclictest436-20systemd-journal11:49:590
281460599190,1cyclictest0-21swapper/012:00:380
281460599190,1cyclictest0-21swapper/007:47:090
281460599190,1cyclictest0-21swapper/007:47:090
281460599190,18cyclictest0-21swapper/010:00:120
281460599190,18cyclictest0-21swapper/007:13:160
281461799181,15cyclictest2910245-21munin-run11:40:003
281461799181,15cyclictest2900659-21memory11:10:173
281461799180,6cyclictest2824423-21apt07:35:113
281461299182,12cyclictest2882470-21apt10:20:112
2814612991816,1cyclictest0-21swapper/211:28:042
2814612991816,1cyclictest0-21swapper/210:56:552
2814612991816,1cyclictest0-21swapper/210:44:192
2814612991816,1cyclictest0-21swapper/210:05:582
2814612991816,1cyclictest0-21swapper/210:03:492
2814612991816,1cyclictest0-21swapper/209:55:382
2814612991811,6cyclictest2920622-21cron12:10:002
2814612991811,5cyclictest2916408-21awk11:55:202
2814612991811,5cyclictest2904298-21ntpq11:20:192
2814612991811,5cyclictest2888177-21cut10:35:172
2814609991816,1cyclictest3056-21PK-Backend10:17:441
2814609991815,2cyclictest0-21swapper/110:31:161
2814605991816,1cyclictest0-21swapper/012:27:210
2814605991816,1cyclictest0-21swapper/012:07:270
2814605991814,3cyclictest2906761-21idleruntime-cro11:30:010
2814605991812,4cyclictest13-21ksoftirqd/011:55:180
2814617991715,1cyclictest3056-21PK-Backend10:55:133
2814617991715,1cyclictest3056-21PK-Backend10:26:273
2814617991713,2cyclictest2879714-21ntpq10:10:183
2814617991712,3cyclictest2878225-21timerandwakeup10:05:193
281461299176,9cyclictest913-21gdbus08:25:022
2814612991715,1cyclictest0-21swapper/208:24:132
2814612991714,2cyclictest2911944-21sh11:45:002
2814612991714,2cyclictest2822323-21sed07:30:012
2814612991713,3cyclictest34-21ksoftirqd/208:45:002
2814612991711,5cyclictest2879731-21ntpq10:10:192
2814612991711,5cyclictest2828706-21open_inodes07:45:212
2814612991711,5cyclictest2828706-21open_inodes07:45:202
2814612991710,5cyclictest2846546-21awk08:35:192
281461299170,1cyclictest0-21swapper/207:11:402
281460999172,11cyclictest2895618-21ntp_states10:55:201
2814609991712,3cyclictest2848172-21needreboot08:40:181
2814605991712,3cyclictest1095-21runrttasks08:45:230
2814605991710,6cyclictest2913946-21apt11:50:110
281461299163,8cyclictest2907018-21apt11:30:122
2814612991614,1cyclictest0-21swapper/212:36:332
2814612991614,1cyclictest0-21swapper/212:24:422
2814612991613,2cyclictest2898087-21idleruntime-cro11:04:592
2814612991610,5cyclictest2926210-21grep12:25:122
281460999168,6cyclictest2918132-21ntp_kernel_pll_12:00:191
2814609991614,1cyclictest3056-21PK-Backend12:22:011
2814609991612,2cyclictest26-21ksoftirqd/112:30:121
2814605991612,3cyclictest2910224-21idleruntime-cro11:40:000
29198942150,5sleep13056-21PK-Backend12:05:221
2814617991513,1cyclictest3056-21PK-Backend11:54:333
2814617991510,4cyclictest3056-21PK-Backend08:51:133
281461299158,5cyclictest2898607-21expr11:05:142
2814612991510,3cyclictest2871309-21grep09:45:242
2814609991411,2cyclictest3056-21PK-Backend09:33:161
2814609991410,2cyclictest26-21ksoftirqd/112:19:191
281461799139,3cyclictest978-21snmpd08:45:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional