You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 14:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Thu May 21, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232071528043,13sleep00-21swapper/019:07:480
232083127657,14sleep10-21swapper/119:09:181
232061627338,9sleep30-21swapper/319:06:303
232057726748,13sleep20-21swapper/219:06:022
23943352430,4sleep00-21swapper/022:35:190
23298712430,4sleep23056-21PK-Backend19:30:202
23716472400,4sleep33056-21PK-Backend21:30:273
24001702340,2sleep13056-21PK-Backend22:51:081
2321019993211,6cyclictest436-20systemd-journal23:50:002
2321019992912,5cyclictest2386337-21sshd22:15:082
2321019992911,6cyclictest2427164-21fw_packets00:10:122
24101882270,9sleep013-21ksoftirqd/023:20:180
23419202270,3sleep13056-21PK-Backend20:05:231
232101999250,1cyclictest0-21swapper/200:25:052
232101599250,23cyclictest2387700-21chrt22:18:281
2321013992519,4cyclictest2393281-21cron22:35:000
2321013992515,7cyclictest2328639-21cron19:30:000
139099250,17rtkit-daemon3056-21PK-Backend23:52:341
2321015992412,10cyclictest2358143-21unin-run20:55:001
232101399240,5cyclictest0-21swapper/019:30:090
2321021992320,2cyclictest0-21swapper/322:28:443
2321019992318,3cyclictest2369088-21cstates21:25:112
2321015992318,3cyclictest2363902-21expr21:10:141
139099230,15rtkit-daemon3056-21PK-Backend00:00:081
2321021992220,1cyclictest0-21swapper/323:02:163
2321021992219,2cyclictest3056-21PK-Backend21:25:023
2321021992219,2cyclictest3056-21PK-Backend21:13:133
2321021992219,2cyclictest3056-21PK-Backend20:12:233
2321021992219,1cyclictest3056-21PK-Backend23:30:283
232102199220,20cyclictest0-21swapper/300:00:093
232101999226,3cyclictest0-21swapper/222:05:112
2321019992220,1cyclictest0-21swapper/223:38:552
2321019992220,1cyclictest0-21swapper/200:01:052
2321019992218,3cyclictest0-21swapper/219:18:372
2321019992215,1cyclictest0-21swapper/223:51:322
2321019992215,1cyclictest0-21swapper/220:01:152
2321015992220,1cyclictest0-21swapper/123:32:091
2321015992220,1cyclictest0-21swapper/121:24:401
2321013992219,2cyclictest3056-21PK-Backend22:14:560
139099220,15rtkit-daemon3056-21PK-Backend22:13:301
139099220,15rtkit-daemon3056-21PK-Backend19:48:181
139099220,15rtkit-daemon3056-21PK-Backend00:25:551
139099220,15rtkit-daemon0-21swapper/020:05:150
139099220,14rtkit-daemon0-21swapper/019:17:310
139099220,13rtkit-daemon0-21swapper/121:00:131
23724352210,4chrt0-21swapper/121:35:011
23269872210,4sleep12326989-21find19:25:011
2321021992119,1cyclictest0-21swapper/323:07:573
2321021992119,1cyclictest0-21swapper/322:45:263
2321021992119,1cyclictest0-21swapper/322:22:423
2321021992119,1cyclictest0-21swapper/322:03:353
2321021992119,1cyclictest0-21swapper/300:20:173
2321021992118,2cyclictest3056-21PK-Backend23:24:473
2321021992118,2cyclictest3056-21PK-Backend20:21:223
2321021992118,2cyclictest3056-21PK-Backend19:27:143
2321021992114,5cyclictest42-21ksoftirqd/323:50:113
232102199211,18cyclictest884-21gmain22:40:083
232102199210,20cyclictest0-21swapper/323:44:413
232102199210,20cyclictest0-21swapper/323:10:483
232102199210,20cyclictest0-21swapper/322:38:103
232102199210,20cyclictest0-21swapper/321:50:383
232102199210,20cyclictest0-21swapper/320:32:183
232102199210,20cyclictest0-21swapper/320:29:263
232102199210,20cyclictest0-21swapper/319:20:323
232102199210,20cyclictest0-21swapper/300:34:303
232102199210,20cyclictest0-21swapper/300:09:423
232102199210,1cyclictest3056-21PK-Backend22:32:083
232102199210,19cyclictest3056-21PK-Backend21:36:183
2321019992119,1cyclictest0-21swapper/223:42:472
2321019992119,1cyclictest0-21swapper/223:22:392
2321019992119,1cyclictest0-21swapper/223:13:062
2321019992119,1cyclictest0-21swapper/222:56:022
2321019992119,1cyclictest0-21swapper/222:44:402
2321019992119,1cyclictest0-21swapper/221:23:222
2321019992119,1cyclictest0-21swapper/221:08:552
2321019992119,1cyclictest0-21swapper/220:37:122
2321019992119,1cyclictest0-21swapper/219:59:472
2321019992119,1cyclictest0-21swapper/200:36:412
232101999211,7cyclictest2330662-21apt19:35:112
2321019992113,6cyclictest2433859-21expr00:30:112
232101999210,20cyclictest0-21swapper/223:26:312
232101999210,20cyclictest0-21swapper/220:56:452
232101999210,20cyclictest0-21swapper/220:18:532
232101999210,20cyclictest0-21swapper/220:11:572
2321015992119,1cyclictest3056-21PK-Backend19:35:171
2321015992119,1cyclictest0-21swapper/120:17:361
232101599210,20cyclictest0-21swapper/122:42:141
2321013992119,1cyclictest0-21swapper/022:23:340
2321013992117,2cyclictest2356378-21turbostat20:49:590
232101399210,20cyclictest0-21swapper/021:27:320
139099210,15rtkit-daemon0-21swapper/023:25:570
139099210,14rtkit-daemon3056-21PK-Backend21:59:131
139099210,14rtkit-daemon3056-21PK-Backend20:31:341
139099210,14rtkit-daemon3056-21PK-Backend00:20:231
139099210,14rtkit-daemon0-21swapper/023:02:120
139099210,14rtkit-daemon0-21swapper/000:19:290
139099210,13rtkit-daemon0-21swapper/123:23:161
139099210,13rtkit-daemon0-21swapper/120:20:451
232102199208,5cyclictest978-21snmpd19:55:203
2321021992018,1cyclictest0-21swapper/322:50:063
2321021992018,1cyclictest0-21swapper/322:16:403
2321021992018,1cyclictest0-21swapper/322:14:033
2321021992018,1cyclictest0-21swapper/320:39:003
2321021992018,1cyclictest0-21swapper/320:02:573
2321021992018,1cyclictest0-21swapper/319:43:573
2321021992018,1cyclictest0-21swapper/319:19:303
2321021992018,1cyclictest0-21swapper/319:10:243
2321021992018,1cyclictest0-21swapper/300:28:483
2321021992018,1cyclictest0-21swapper/300:16:253
2321021992018,1cyclictest0-21swapper/300:10:443
2321021992017,2cyclictest3056-21PK-Backend23:18:183
2321021992017,2cyclictest3056-21PK-Backend21:18:133
2321021992012,6cyclictest2401655-21sed22:55:213
232102199200,1cyclictest3056-21PK-Backend23:29:273
232102199200,19cyclictest3056-21PK-Backend21:45:103
232102199200,19cyclictest3056-21PK-Backend20:15:063
232102199200,19cyclictest0-21swapper/323:37:583
232102199200,19cyclictest0-21swapper/320:43:533
232102199200,19cyclictest0-21swapper/319:46:273
2321019992018,1cyclictest0-21swapper/223:07:252
2321019992018,1cyclictest0-21swapper/222:27:432
2321019992018,1cyclictest0-21swapper/221:42:552
2321019992018,1cyclictest0-21swapper/221:39:172
2321019992018,1cyclictest0-21swapper/221:13:552
2321019992015,3cyclictest978-21snmpd20:05:122
2321019992012,6cyclictest2403025-21sed23:00:162
232101999200,1cyclictest0-21swapper/222:30:202
232101999200,1cyclictest0-21swapper/221:53:502
232101999200,1cyclictest0-21swapper/220:24:482
232101999200,19cyclictest0-21swapper/222:49:202
232101999200,19cyclictest0-21swapper/222:04:112
232101999200,19cyclictest0-21swapper/221:33:022
232101999200,19cyclictest0-21swapper/221:17:202
232101999200,19cyclictest0-21swapper/219:12:082
232101999200,19cyclictest0-21swapper/200:24:032
2321015992018,1cyclictest0-21swapper/123:28:441
2321015992013,5cyclictest2395023-21cron22:40:001
2321015992013,5cyclictest2358522-21expr20:55:121
232101599200,19cyclictest0-21swapper/120:49:391
232101599200,18cyclictest3056-21PK-Backend20:37:021
2321013992018,1cyclictest0-21swapper/023:49:530
2321013992018,1cyclictest0-21swapper/023:37:290
2321013992018,1cyclictest0-21swapper/022:48:220
2321013992018,1cyclictest0-21swapper/022:01:510
2321013992018,1cyclictest0-21swapper/021:24:540
2321013992018,1cyclictest0-21swapper/000:07:100
232101399200,1cyclictest0-21swapper/022:41:530
232101399200,1cyclictest0-21swapper/022:08:070
232101399200,1cyclictest0-21swapper/020:04:370
232101399200,1cyclictest0-21swapper/019:51:530
232101399200,19cyclictest0-21swapper/023:50:550
232101399200,19cyclictest0-21swapper/022:53:020
232101399200,19cyclictest0-21swapper/022:26:110
232101399200,19cyclictest0-21swapper/022:18:210
232101399200,19cyclictest0-21swapper/021:52:320
232101399200,19cyclictest0-21swapper/020:35:330
232101399200,19cyclictest0-21swapper/020:16:470
232101399200,19cyclictest0-21swapper/019:39:080
232101399200,19cyclictest0-21swapper/019:22:470
232101399200,19cyclictest0-21swapper/000:00:280
139099200,14rtkit-daemon3056-21PK-Backend23:13:251
139099200,14rtkit-daemon0-21swapper/021:05:100
139099200,13rtkit-daemon0-21swapper/119:28:041
139099200,13rtkit-daemon0-21swapper/021:46:050
139099200,13rtkit-daemon0-21swapper/021:35:130
139099200,12rtkit-daemon26-21ksoftirqd/121:25:151
2321021991917,1cyclictest3056-21PK-Backend20:55:423
2321021991917,1cyclictest3056-21PK-Backend20:47:583
2321021991917,1cyclictest0-21swapper/323:49:343
232102199191,13cyclictest2435444-21taskset00:35:113
232102199190,1cyclictest3056-21PK-Backend20:53:533
232102199190,18cyclictest0-21swapper/319:37:143
232102199190,17cyclictest2423062-40updatedb.mlocat00:00:003
2321019991917,1cyclictest0-21swapper/222:53:122
2321019991917,1cyclictest0-21swapper/221:48:232
2321019991917,1cyclictest0-21swapper/220:45:092
2321019991917,1cyclictest0-21swapper/220:33:202
2321019991912,5cyclictest2426006-21sed00:05:222
232101999190,1cyclictest0-21swapper/222:40:012
232101999190,1cyclictest0-21swapper/219:40:342
232101999190,1cyclictest0-21swapper/200:17:212
232101999190,18cyclictest0-21swapper/223:57:132
232101999190,18cyclictest0-21swapper/223:18:472
232101999190,18cyclictest0-21swapper/222:11:142
232101999190,18cyclictest0-21swapper/221:56:412
232101999190,18cyclictest0-21swapper/220:27:382
232101999190,18cyclictest0-21swapper/219:49:332
2321015991917,1cyclictest3056-21PK-Backend22:03:271
2321015991917,1cyclictest3056-21PK-Backend20:04:101
2321015991917,1cyclictest3056-21PK-Backend19:57:001
2321015991917,1cyclictest3056-21PK-Backend19:50:521
2321015991912,5cyclictest883-21dbus-daemon22:30:001
2321015991910,7cyclictest2375316-21users21:40:241
232101599190,5cyclictest3056-21PK-Backend23:05:021
232101599190,1cyclictest0-21swapper/123:17:431
232101599190,1cyclictest0-21swapper/122:22:131
2321013991917,1cyclictest0-21swapper/023:41:210
2321013991917,1cyclictest0-21swapper/023:31:480
2321013991917,1cyclictest0-21swapper/023:06:130
2321013991917,1cyclictest0-21swapper/021:57:120
2321013991917,1cyclictest0-21swapper/021:18:520
2321013991917,1cyclictest0-21swapper/020:43:170
2321013991917,1cyclictest0-21swapper/019:13:260
2321013991917,1cyclictest0-21swapper/000:20:350
2321013991910,7cyclictest2359455-21users20:55:220
232101399190,1cyclictest0-21swapper/023:16:340
232101399190,1cyclictest0-21swapper/022:55:520
232101399190,1cyclictest0-21swapper/020:10:040
232101399190,1cyclictest0-21swapper/000:30:080
232101399190,1cyclictest0-21swapper/000:12:510
232101399190,18cyclictest0-21swapper/020:23:230
139099190,13rtkit-daemon0-21swapper/021:43:060
24172452180,4sleep13056-21PK-Backend23:40:201
2321021991816,1cyclictest0-21swapper/320:05:403
232102199181,15cyclictest2383976-21users22:05:223
232102199180,16cyclictest2337348-21munin-run19:55:003
2321019991816,1cyclictest0-21swapper/223:33:132
2321019991813,3cyclictest2353334-21cpuspeed_turbos20:40:132
2321015991816,1cyclictest0-21swapper/121:05:071
2321015991813,4cyclictest26-21ksoftirqd/122:30:161
2321015991812,4cyclictest2397684-21smartctl22:45:141
2321015991811,5cyclictest2347982-21apt20:25:101
232101599180,16cyclictest3056-21PK-Backend23:38:451
2321013991816,1cyclictest0-21swapper/023:11:540
2321013991816,1cyclictest0-21swapper/021:14:400
2321013991816,1cyclictest0-21swapper/019:40:370
2321013991816,1cyclictest0-21swapper/000:36:510
2321013991813,4cyclictest2019-21gmain20:30:000
2321013991812,4cyclictest2357367-21ntp_kernel_pll_20:50:160
2321013991811,5cyclictest2350522-21cut20:30:190
2321013991811,4cyclictest1095-21runrttasks21:30:210
2321021991715,1cyclictest3056-21PK-Backend21:21:383
2321021991715,1cyclictest3056-21PK-Backend19:30:593
2321021991712,4cyclictest2363351-21latency_hist21:10:003
232102199170,15cyclictest2379422-21/usr/sbin/munin21:55:113
2321019991715,1cyclictest0-21swapper/219:23:302
2321019991710,5cyclictest2337487-21cat19:55:002
232101599179,6cyclictest1-21systemd21:20:011
232101599172,14cyclictest2421542-21sort23:55:111
2321015991715,1cyclictest3056-21PK-Backend19:12:061
2321015991715,1cyclictest0-21swapper/123:01:341
2321015991715,1cyclictest0-21swapper/121:35:011
2321015991714,2cyclictest3056-21PK-Backend00:36:241
232101399179,6cyclictest2360079-21seq21:00:030
2321013991711,4cyclictest2423222-21date00:00:000
2321019991614,1cyclictest0-21swapper/220:50:162
2321019991614,1cyclictest0-21swapper/219:25:332
232101999161,14cyclictest1095-21runrttasks22:22:002
232101599169,5cyclictest436-20systemd-journal20:15:001
232101599160,14cyclictest3056-21PK-Backend20:43:371
2321013991614,1cyclictest0-21swapper/000:27:180
139099160,4rtkit-daemon3056-21PK-Backend00:16:351
232101599158,5cyclictest2376169-21cat21:45:131
232101599158,5cyclictest2329371-21cat19:30:141
2321015991513,1cyclictest3056-21PK-Backend19:40:381
2321015991510,2cyclictest26-21ksoftirqd/123:45:111
2321013991513,1cyclictest0-21swapper/019:47:060
24276672140,4chrt3056-21PK-Backend00:10:191
232101999147,5cyclictest2360505-21forks21:00:152
2321015991410,3cyclictest3056-21PK-Backend22:09:171
2321015991410,3cyclictest3056-21PK-Backend00:32:251
232101599140,1cyclictest3056-21PK-Backend19:19:491
2321013991410,2cyclictest2338030-21if_enp2s019:55:150
2321021991311,1cyclictest3056-21PK-Backend21:42:333
232102199130,11cyclictest3056-21PK-Backend21:00:203
232101599139,3cyclictest3056-21PK-Backend21:50:411
232101599139,3cyclictest3056-21PK-Backend00:07:031
232101599128,3cyclictest3056-21PK-Backend22:59:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional