You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 17:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun Jul 05, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
299364621220,9sleep126-21ksoftirqd/111:00:301
293656321220,2sleep20-21swapper/208:20:112
290996229170,13sleep20-21swapper/207:05:202
139099860,66rtkit-daemon0-21swapper/307:05:263
290986127953,18sleep10-21swapper/107:05:191
291051127350,17sleep00-21swapper/007:05:590
29260592440,4sleep03056-21PK-Backend07:50:020
29522132430,3sleep00-21swapper/009:05:000
29522132430,3sleep00-21swapper/009:05:000
29916812420,4sleep10-21swapper/110:55:201
291100199350,21cyclictest0-21swapper/309:40:213
291100199300,8cyclictest3021298-21/usr/sbin/munin12:20:153
2911001992913,6cyclictest2936219-21cron08:20:003
29810992260,4sleep23056-21PK-Backend10:25:222
2911001992517,6cyclictest436-20systemd-journal09:15:003
29787392240,4sleep00-21swapper/010:20:150
291099099241,21cyclictest2944896-21awk08:45:000
139099240,7rtkit-daemon3056-21PK-Backend07:37:033
29582932230,4chrt3056-21PK-Backend09:20:171
2911001992321,1cyclictest0-21swapper/310:43:013
2910997992315,6cyclictest2994004-21cron11:05:002
2910990992321,1cyclictest0-21swapper/010:44:580
2910990992321,1cyclictest0-21swapper/007:55:060
139099230,3rtkit-daemon0-21swapper/309:27:173
139099230,16rtkit-daemon0-21swapper/311:31:363
29877232220,3sleep10-21swapper/110:45:141
2911001992220,1cyclictest0-21swapper/310:17:593
2911001992220,1cyclictest0-21swapper/308:35:043
2910997992220,1cyclictest0-21swapper/210:48:402
291099799220,3cyclictest2985353-21munin-run10:40:002
291099799220,20cyclictest0-21swapper/208:50:162
2910995992210,10cyclictest2980458-21diskstats10:25:141
2910990992220,1cyclictest0-21swapper/009:53:480
139099220,3rtkit-daemon0-21swapper/307:25:163
139099220,14rtkit-daemon3056-21PK-Backend07:46:133
139099220,14rtkit-daemon0-21swapper/211:16:362
139099220,14rtkit-daemon0-21swapper/210:30:062
139099220,14rtkit-daemon0-21swapper/209:10:152
29852812210,5chrt0-21swapper/010:39:240
2911001992119,1cyclictest0-21swapper/312:07:103
2911001992119,1cyclictest0-21swapper/311:56:213
2911001992119,1cyclictest0-21swapper/311:18:293
2911001992119,1cyclictest0-21swapper/309:57:173
2911001992119,1cyclictest0-21swapper/309:57:173
2911001992119,1cyclictest0-21swapper/309:45:283
2911001992119,1cyclictest0-21swapper/309:36:023
2911001992119,1cyclictest0-21swapper/308:53:503
2911001992119,1cyclictest0-21swapper/308:26:193
2911001992119,1cyclictest0-21swapper/308:06:393
2911001992119,1cyclictest0-21swapper/307:51:453
291100199210,20cyclictest0-21swapper/312:16:013
291100199210,20cyclictest0-21swapper/311:03:353
291100199210,20cyclictest0-21swapper/308:12:403
291100199210,20cyclictest0-21swapper/307:20:423
291100199210,19cyclictest3056-21PK-Backend11:49:043
2910997992119,1cyclictest0-21swapper/212:25:252
2910997992119,1cyclictest0-21swapper/212:21:402
2910997992119,1cyclictest0-21swapper/212:04:302
2910997992119,1cyclictest0-21swapper/211:38:552
2910997992119,1cyclictest0-21swapper/210:58:052
2910997992119,1cyclictest0-21swapper/209:49:042
2910997992119,1cyclictest0-21swapper/208:09:132
2910997992119,1cyclictest0-21swapper/207:24:452
2910997992119,1cyclictest0-21swapper/207:15:272
2910997992115,4cyclictest2156-21gnome-shell12:10:092
2910997992114,5cyclictest1-21systemd07:35:002
2910997992113,5cyclictest28650irq/123-ahci[0009:55:222
2910997992113,5cyclictest28650irq/123-ahci[0009:55:212
291099799210,20cyclictest0-21swapper/210:42:102
291099799210,20cyclictest0-21swapper/208:33:062
291099799210,1cyclictest0-21swapper/209:30:122
2910995992118,2cyclictest3056-21PK-Backend08:41:311
291099599210,19cyclictest3056-21PK-Backend12:25:521
291099599210,19cyclictest3056-21PK-Backend08:45:301
291099599210,19cyclictest3056-21PK-Backend07:41:011
291099599210,19cyclictest3056-21PK-Backend07:20:341
2910990992119,1cyclictest3056-21PK-Backend09:40:020
2910990992119,1cyclictest0-21swapper/012:16:450
2910990992119,1cyclictest0-21swapper/011:47:510
2910990992119,1cyclictest0-21swapper/011:25:550
2910990992119,1cyclictest0-21swapper/011:09:530
2910990992119,1cyclictest0-21swapper/010:47:080
2910990992119,1cyclictest0-21swapper/010:09:160
2910990992119,1cyclictest0-21swapper/008:24:460
2910990992113,6cyclictest2921068-21ntp_states07:35:210
2910990992112,7cyclictest1-21systemd08:32:470
291099099210,20cyclictest0-21swapper/012:35:030
291099099210,20cyclictest0-21swapper/012:11:370
291099099210,20cyclictest0-21swapper/012:02:110
291099099210,20cyclictest0-21swapper/011:43:320
291099099210,20cyclictest0-21swapper/011:30:480
291099099210,20cyclictest0-21swapper/010:10:390
291099099210,20cyclictest0-21swapper/008:50:480
291099099210,20cyclictest0-21swapper/008:10:260
291099099210,20cyclictest0-21swapper/007:45:040
139099210,15rtkit-daemon0-21swapper/212:39:292
139099210,14rtkit-daemon0-21swapper/309:51:103
139099210,14rtkit-daemon0-21swapper/308:55:283
139099210,14rtkit-daemon0-21swapper/210:18:392
139099210,14rtkit-daemon0-21swapper/208:55:062
29578252200,2sleep30-21swapper/309:20:113
291100199205,13cyclictest3011579-21taskset11:51:213
291100199205,13cyclictest3011579-21taskset11:51:213
2911001992018,1cyclictest0-21swapper/312:30:483
2911001992018,1cyclictest0-21swapper/311:22:013
2911001992018,1cyclictest0-21swapper/307:55:303
2911001992018,1cyclictest0-21swapper/307:15:423
291100199201,7cyclictest2930039-21irqstats08:00:173
2911001992017,2cyclictest3056-21PK-Backend10:52:133
2911001992017,2cyclictest3056-21PK-Backend10:08:263
291100199201,1cyclictest42-21ksoftirqd/308:45:393
291100199200,19cyclictest0-21swapper/308:33:303
291100199200,19cyclictest0-21swapper/307:30:573
291099799209,9cyclictest3004670-21cron11:35:002
291099799207,10cyclictest883-21dbus-daemon11:23:062
291099799203,16cyclictest1095-21runrttasks08:10:482
2910997992018,1cyclictest0-21swapper/211:44:022
2910997992018,1cyclictest0-21swapper/209:52:492
2910997992018,1cyclictest0-21swapper/209:43:092
2910997992018,1cyclictest0-21swapper/209:04:502
2910997992018,1cyclictest0-21swapper/209:04:502
2910997992018,1cyclictest0-21swapper/208:38:402
2910997992012,6cyclictest2928491-21grep07:55:172
2910997992011,7cyclictest2254-21gdbus11:53:062
2910997992011,7cyclictest2254-21gdbus11:53:062
291099799200,19cyclictest3056-21PK-Backend10:01:072
291099799200,19cyclictest0-21swapper/212:34:172
291099799200,19cyclictest0-21swapper/212:17:562
291099799200,19cyclictest0-21swapper/211:12:392
291099799200,19cyclictest0-21swapper/210:52:582
291099799200,19cyclictest0-21swapper/210:09:182
291099799200,19cyclictest0-21swapper/208:25:562
291099799200,19cyclictest0-21swapper/207:11:352
291099799200,18cyclictest436-20systemd-journal07:40:002
2910995992018,1cyclictest3056-21PK-Backend11:31:461
2910995992018,1cyclictest3056-21PK-Backend09:31:461
2910995992018,1cyclictest0-21swapper/112:00:441
2910995992013,5cyclictest2399-21gdbus10:38:031
2910995992012,6cyclictest2974605-21cron10:10:001
291099599200,1cyclictest3056-21PK-Backend10:14:591
291099599200,1cyclictest3056-21PK-Backend09:42:561
291099599200,19cyclictest3056-21PK-Backend12:17:141
291099599200,19cyclictest3056-21PK-Backend10:34:401
291099599200,19cyclictest3056-21PK-Backend10:16:211
291099599200,19cyclictest0-21swapper/110:01:011
291099599200,19cyclictest0-21swapper/107:55:271
291099599200,18cyclictest3056-21PK-Backend09:39:231
291099599200,18cyclictest3056-21PK-Backend08:52:401
2910990992018,1cyclictest0-21swapper/012:24:010
2910990992018,1cyclictest0-21swapper/010:56:210
2910990992018,1cyclictest0-21swapper/010:19:230
2910990992018,1cyclictest0-21swapper/010:04:360
2910990992018,1cyclictest0-21swapper/007:41:470
2910990992018,1cyclictest0-21swapper/007:29:240
2910990992014,5cyclictest3016499-21awk12:05:200
291099099200,1cyclictest3056-21PK-Backend11:50:010
291099099200,1cyclictest3056-21PK-Backend11:50:010
291099099200,1cyclictest0-21swapper/009:34:550
291099099200,19cyclictest0-21swapper/011:03:240
291099099200,19cyclictest0-21swapper/010:50:400
291099099200,19cyclictest0-21swapper/009:35:430
291099099200,19cyclictest0-21swapper/009:05:080
291099099200,19cyclictest0-21swapper/008:02:020
139099200,14rtkit-daemon3056-21PK-Backend11:40:283
139099200,14rtkit-daemon3056-21PK-Backend10:20:523
139099200,14rtkit-daemon3056-21PK-Backend08:21:003
139099200,14rtkit-daemon3056-21PK-Backend07:13:583
139099200,14rtkit-daemon0-21swapper/311:27:293
139099200,13rtkit-daemon3056-21PK-Backend10:49:253
139099200,13rtkit-daemon0-21swapper/310:33:563
139099200,13rtkit-daemon0-21swapper/207:45:382
291100199193,4cyclictest0-21swapper/310:55:223
2911001991917,1cyclictest0-21swapper/312:27:513
2911001991917,1cyclictest0-21swapper/311:35:333
2911001991917,1cyclictest0-21swapper/309:30:203
291100199190,7cyclictest2952094-21awk09:05:013
291100199190,7cyclictest2952094-21awk09:05:003
291100199190,1cyclictest0-21swapper/307:40:503
291100199190,18cyclictest3056-21PK-Backend12:04:123
291100199190,18cyclictest0-21swapper/309:20:003
2910997991917,1cyclictest0-21swapper/212:08:152
2910997991917,1cyclictest0-21swapper/207:53:522
2910997991912,5cyclictest2953813-21idleruntime-cro09:10:012
291099799190,1cyclictest0-21swapper/211:56:252
291099799190,1cyclictest0-21swapper/210:14:462
291099799190,1cyclictest0-21swapper/208:45:162
291099799190,1cyclictest0-21swapper/207:41:572
291099799190,18cyclictest3056-21PK-Backend11:05:222
2910995991917,1cyclictest3056-21PK-Backend12:38:021
2910995991917,1cyclictest3056-21PK-Backend09:58:021
2910995991917,1cyclictest3056-21PK-Backend09:58:021
2910995991917,1cyclictest3056-21PK-Backend08:39:071
2910995991917,1cyclictest3056-21PK-Backend07:18:301
2910995991917,1cyclictest0-21swapper/111:11:161
2910995991916,2cyclictest3056-21PK-Backend09:51:331
2910995991916,2cyclictest3056-21PK-Backend07:52:311
2910995991913,5cyclictest2935655-21sed08:15:221
2910995991912,5cyclictest3016175-21cat12:05:161
291099599190,1cyclictest3056-21PK-Backend10:42:171
291099599190,1cyclictest3056-21PK-Backend08:03:591
291099599190,1cyclictest0-21swapper/111:42:531
291099599190,1cyclictest0-21swapper/108:25:281
291099599190,1cyclictest0-21swapper/107:12:281
291099599190,18cyclictest3056-21PK-Backend12:30:121
291099599190,18cyclictest0-21swapper/111:47:121
291099599190,18cyclictest0-21swapper/110:52:011
291099599190,18cyclictest0-21swapper/110:22:221
291099099193,14cyclictest3025787-21munin-run12:35:000
2910990991917,1cyclictest3056-21PK-Backend09:46:320
2910990991917,1cyclictest3056-21PK-Backend08:29:130
2910990991917,1cyclictest0-21swapper/011:36:290
2910990991917,1cyclictest0-21swapper/008:07:010
2910990991917,1cyclictest0-21swapper/007:13:340
291099099190,1cyclictest0-21swapper/011:21:010
291099099190,1cyclictest0-21swapper/011:13:240
291099099190,1cyclictest0-21swapper/010:27:340
291099099190,1cyclictest0-21swapper/009:59:430
291099099190,1cyclictest0-21swapper/009:59:430
291099099190,18cyclictest0-21swapper/011:57:520
139099190,13rtkit-daemon0-21swapper/207:28:592
291100199182,15cyclictest0-21swapper/312:10:253
2911001991816,1cyclictest3056-21PK-Backend10:01:503
2911001991816,1cyclictest0-21swapper/312:36:443
2911001991816,1cyclictest0-21swapper/311:08:423
2911001991816,1cyclictest0-21swapper/309:09:113
291100199180,5cyclictest2976368-21systemd-run10:15:013
2910997991816,1cyclictest0-21swapper/210:24:332
2910997991816,1cyclictest0-21swapper/209:36:402
2910997991816,1cyclictest0-21swapper/209:26:402
2910997991810,6cyclictest2956815-21cat09:15:212
291099599189,7cyclictest2936955-21cat08:20:161
291099599188,8cyclictest3056-21PK-Backend11:30:001
2910995991816,1cyclictest3056-21PK-Backend12:21:331
2910995991816,1cyclictest3056-21PK-Backend11:56:251
2910995991816,1cyclictest3056-21PK-Backend11:51:321
2910995991816,1cyclictest3056-21PK-Backend11:51:321
2910995991816,1cyclictest3056-21PK-Backend11:36:381
2910995991816,1cyclictest3056-21PK-Backend11:15:221
2910995991816,1cyclictest3056-21PK-Backend08:08:591
2910995991816,1cyclictest3056-21PK-Backend07:38:171
2910995991816,1cyclictest0-21swapper/107:29:251
2910990991817,1cyclictest0-21swapper/008:35:270
2910990991816,1cyclictest0-21swapper/008:55:360
2910990991815,2cyclictest0-21swapper/008:18:240
291100199179,6cyclictest436-20systemd-journal10:40:003
2911001991711,4cyclictest2980241-21expr10:25:133
291100199171,14cyclictest2943899-21irqstats08:40:163
291100199170,15cyclictest1095-21runrttasks11:10:203
2910997991715,1cyclictest0-21swapper/211:46:592
2910997991712,3cyclictest2958277-21ntp_offset09:20:172
2910997991711,5cyclictest3001628-21expr11:25:122
2910995991715,1cyclictest3056-21PK-Backend12:11:331
2910995991715,1cyclictest3056-21PK-Backend08:55:021
2910995991715,1cyclictest3056-21PK-Backend08:13:121
2910995991715,1cyclictest3056-21PK-Backend07:34:591
2910995991715,1cyclictest0-21swapper/107:46:151
2910995991714,2cyclictest3056-21PK-Backend09:15:451
2910990991710,2cyclictest13-21ksoftirqd/009:29:550
2910997991614,1cyclictest0-21swapper/208:17:382
2910997991610,5cyclictest2943403-21cat08:40:122
291099599169,6cyclictest2953440-21awk09:05:231
2910995991614,1cyclictest3056-21PK-Backend11:07:451
2910995991614,1cyclictest3056-21PK-Backend09:47:141
2910995991611,3cyclictest3000772-21timerwakeupswit11:20:211
291099599160,6cyclictest3056-21PK-Backend09:10:211
291099099169,6cyclictest2998723-21awk11:15:180
2910990991614,1cyclictest0-21swapper/007:34:240
2910990991611,4cyclictest2945310-21tr08:45:120
2910997991510,3cyclictest1095-21runrttasks08:02:382
291099099159,4cyclictest2954762-21cut09:10:180
291099099156,7cyclictest1-21systemd07:15:010
2910990991510,4cyclictest2956396-21sshd09:15:170
2910990991510,4cyclictest13-21ksoftirqd/007:25:000
291099099150,5cyclictest0-21swapper/009:24:130
29405202140,3chrt3056-21PK-Backend08:30:171
2910995991410,3cyclictest3056-21PK-Backend09:28:271
2910990991410,3cyclictest2156-21gnome-shell10:30:090
2910995991312,1cyclictest0-21swapper/109:00:371
2910995991312,1cyclictest0-21swapper/109:00:371
291099099139,3cyclictest3022744-21cpuspeed_turbos12:25:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional