You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 20:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Jun 13, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
303482322480,6sleep2331rcuc/207:05:272
314328421240,3sleep10-21swapper/112:15:121
1390991090,93rtkit-daemon0-21swapper/307:05:203
303507328140,14sleep10-21swapper/107:07:571
303502426840,20sleep00-21swapper/007:07:200
31071572490,2sleep33056-21PK-Backend10:30:163
30427062480,5sleep20-21swapper/207:29:552
30435252350,1sleep00-21swapper/007:30:180
3035351993313,4cyclictest3111868-21tr10:45:120
3035362992715,10cyclictest3051486-21unin-run07:55:003
3035362992612,4cyclictest42-21ksoftirqd/311:05:013
3035362992612,4cyclictest42-21ksoftirqd/311:05:003
31358672240,4sleep20-21swapper/211:53:322
30673132240,9sleep342-21ksoftirqd/308:40:133
303536299240,19cyclictest0-21swapper/311:09:153
3035355992410,12cyclictest3139521-21unin-run12:05:001
3035351992416,6cyclictest3056639-21cron08:09:590
139099240,16rtkit-daemon3056-21PK-Backend12:13:213
139099240,16rtkit-daemon3056-21PK-Backend11:48:183
31455712230,3sleep00-21swapper/012:20:120
303535599231,3cyclictest26-21ksoftirqd/110:35:001
3035351992318,3cyclictest3131149-21df_inode11:40:140
139099230,6rtkit-daemon141rcu_preempt11:27:422
139099230,17rtkit-daemon3056-21PK-Backend12:15:553
139099230,16rtkit-daemon3056-21PK-Backend11:58:103
139099230,16rtkit-daemon3056-21PK-Backend11:58:093
139099230,16rtkit-daemon3056-21PK-Backend09:39:123
30659332220,2sleep00-21swapper/008:35:130
303536299224,2cyclictest141rcu_preempt09:25:003
3035362992220,1cyclictest3056-21PK-Backend11:43:423
3035362992220,1cyclictest3056-21PK-Backend10:27:113
3035362992219,2cyclictest0-21swapper/309:26:473
3035362992218,3cyclictest42-21ksoftirqd/308:57:333
303536299221,2cyclictest141rcu_preempt07:15:003
3035359992220,1cyclictest0-21swapper/212:06:262
3035359992220,1cyclictest0-21swapper/211:19:222
3035359992220,1cyclictest0-21swapper/211:09:562
3035359992220,1cyclictest0-21swapper/210:18:252
3035359992220,1cyclictest0-21swapper/210:05:072
3035359992220,1cyclictest0-21swapper/208:03:462
303535999220,20cyclictest0-21swapper/210:22:302
303535599224,4cyclictest26-21ksoftirqd/107:50:011
3035355992220,1cyclictest0-21swapper/111:59:231
3035355992220,1cyclictest0-21swapper/111:59:231
3035355992219,2cyclictest3056-21PK-Backend11:00:561
3035355992219,2cyclictest3056-21PK-Backend11:00:561
3035355992218,2cyclictest3106240-21idleruntime-cro10:30:001
3035355992214,6cyclictest3114312-21python310:50:201
3035355992213,7cyclictest3092981-21python309:50:201
3035351992214,6cyclictest3087291-21df_inode09:35:130
303535199220,8cyclictest3128795-21grep11:35:000
139099220,15rtkit-daemon3056-21PK-Backend11:36:513
139099220,15rtkit-daemon3056-21PK-Backend11:14:573
139099220,15rtkit-daemon3056-21PK-Backend10:07:173
30439752210,9sleep126-21ksoftirqd/107:30:221
3035362992119,1cyclictest3056-21PK-Backend12:32:433
3035362992119,1cyclictest3056-21PK-Backend10:40:223
3035362992119,1cyclictest3056-21PK-Backend09:47:023
3035362992119,1cyclictest0-21swapper/312:37:573
3035362992119,1cyclictest0-21swapper/309:12:283
3035362992118,2cyclictest3056-21PK-Backend12:01:203
3035362992118,2cyclictest3056-21PK-Backend09:41:343
303536299210,20cyclictest3056-21PK-Backend07:30:563
303536299210,20cyclictest0-21swapper/310:57:263
303536299210,19cyclictest3056-21PK-Backend08:12:593
303536299210,19cyclictest3056-21PK-Backend08:05:103
303536299210,19cyclictest3056-21PK-Backend07:40:423
303535999214,3cyclictest30797382awk09:15:012
3035359992119,1cyclictest0-21swapper/212:20:052
3035359992119,1cyclictest0-21swapper/212:19:042
3035359992119,1cyclictest0-21swapper/211:41:052
3035359992119,1cyclictest0-21swapper/211:35:592
3035359992119,1cyclictest0-21swapper/210:12:162
3035359992119,1cyclictest0-21swapper/209:43:382
3035359992119,1cyclictest0-21swapper/208:34:282
3035359992118,2cyclictest3056-21PK-Backend09:07:422
303535999210,20cyclictest0-21swapper/211:47:132
303535999210,20cyclictest0-21swapper/210:46:432
303535999210,20cyclictest0-21swapper/209:46:412
303535999210,20cyclictest0-21swapper/207:47:582
303535999210,19cyclictest0-21swapper/207:42:312
3035355992119,1cyclictest3056-21PK-Backend10:56:511
3035355992119,1cyclictest0-21swapper/111:39:231
3035355992119,1cyclictest0-21swapper/111:29:221
3035355992119,1cyclictest0-21swapper/111:20:231
3035355992119,1cyclictest0-21swapper/110:23:521
3035355992119,1cyclictest0-21swapper/109:05:311
3035355992119,1cyclictest0-21swapper/108:26:171
3035355992119,1cyclictest0-21swapper/108:20:371
3035355992119,1cyclictest0-21swapper/108:19:361
3035355992119,1cyclictest0-21swapper/108:10:151
3035355992119,1cyclictest0-21swapper/107:57:171
3035355992118,2cyclictest3056-21PK-Backend09:26:541
3035355992114,6cyclictest3100805-21gpgv10:15:011
3035355992114,5cyclictest3097080-21systemctl10:05:001
3035355992113,6cyclictest3068062-21ntpq08:40:211
303535599210,20cyclictest0-21swapper/111:31:251
303535599210,20cyclictest0-21swapper/107:26:281
303535599210,20cyclictest0-21swapper/107:11:421
303535599210,20cyclictest0-21swapper/107:11:411
3035351992119,1cyclictest0-21swapper/010:10:240
3035351992116,3cyclictest3138423-21hddtemp_smartct12:00:150
303535199210,20cyclictest0-21swapper/011:58:120
303535199210,20cyclictest0-21swapper/011:58:120
303535199210,20cyclictest0-21swapper/011:50:150
303535199210,20cyclictest0-21swapper/009:00:000
303535199210,1cyclictest0-21swapper/011:23:050
303535199210,1cyclictest0-21swapper/009:50:100
139099210,15rtkit-daemon3056-21PK-Backend08:16:403
139099210,15rtkit-daemon3056-21PK-Backend07:55:313
139099210,14rtkit-daemon3056-21PK-Backend10:52:403
3035362992018,1cyclictest3056-21PK-Backend10:20:423
3035362992018,1cyclictest3056-21PK-Backend07:12:513
3035362992018,1cyclictest3056-21PK-Backend07:12:503
3035362992017,2cyclictest3056-21PK-Backend12:28:173
303536299200,1cyclictest3056-21PK-Backend09:04:243
303536299200,1cyclictest3056-21PK-Backend07:28:333
303536299200,19cyclictest3056-21PK-Backend12:23:043
303536299200,19cyclictest3056-21PK-Backend11:29:443
303536299200,18cyclictest3056-21PK-Backend08:50:043
3035359992018,1cyclictest0-21swapper/212:37:092
3035359992018,1cyclictest0-21swapper/212:25:462
3035359992018,1cyclictest0-21swapper/212:01:332
3035359992018,1cyclictest0-21swapper/209:24:242
3035359992018,1cyclictest0-21swapper/208:48:072
3035359992018,1cyclictest0-21swapper/208:40:242
3035359992018,1cyclictest0-21swapper/208:10:302
3035359992018,1cyclictest0-21swapper/207:59:062
3035359992018,1cyclictest0-21swapper/207:33:382
303535999200,1cyclictest0-21swapper/207:21:012
303535999200,19cyclictest0-21swapper/210:29:402
303535999200,19cyclictest0-21swapper/208:38:212
303535999200,19cyclictest0-21swapper/208:26:442
303535599206,4cyclictest26-21ksoftirqd/110:40:011
3035355992018,1cyclictest3056-21PK-Backend11:05:021
3035355992018,1cyclictest0-21swapper/112:12:491
3035355992018,1cyclictest0-21swapper/112:07:081
3035355992018,1cyclictest0-21swapper/111:10:101
3035355992018,1cyclictest0-21swapper/109:35:531
3035355992018,1cyclictest0-21swapper/109:24:521
3035355992018,1cyclictest0-21swapper/109:16:071
3035355992018,1cyclictest0-21swapper/108:55:581
3035355992018,1cyclictest0-21swapper/108:52:071
3035355992018,1cyclictest0-21swapper/108:38:411
3035355992017,2cyclictest0-21swapper/111:15:161
3035355992014,4cyclictest26-21ksoftirqd/110:50:021
303535599200,1cyclictest0-21swapper/108:05:351
303535599200,19cyclictest3056-21PK-Backend09:58:441
303535599200,19cyclictest0-21swapper/112:22:081
303535599200,19cyclictest0-21swapper/111:49:231
303535599200,19cyclictest0-21swapper/111:41:261
303535599200,19cyclictest0-21swapper/110:42:171
303535599200,19cyclictest0-21swapper/110:15:561
303535599200,19cyclictest0-21swapper/109:14:031
303535599200,19cyclictest0-21swapper/107:54:281
303535599200,19cyclictest0-21swapper/107:40:071
3035351992018,1cyclictest0-21swapper/011:48:130
3035351992018,1cyclictest0-21swapper/010:42:550
3035351992018,1cyclictest0-21swapper/009:58:080
3035351992018,1cyclictest0-21swapper/009:41:100
3035351992018,1cyclictest0-21swapper/009:17:170
3035351992018,1cyclictest0-21swapper/009:10:350
3035351992018,1cyclictest0-21swapper/008:32:090
3035351992018,1cyclictest0-21swapper/008:26:290
3035351992018,1cyclictest0-21swapper/007:56:270
3035351992018,1cyclictest0-21swapper/007:24:510
3035351992014,4cyclictest3147619-21strings12:25:170
3035351992013,6cyclictest3070522-21apt-get08:50:000
3035351992013,5cyclictest3144986-21date12:20:020
303535199200,4cyclictest3054929-21basename08:05:000
303535199200,1cyclictest0-21swapper/010:02:120
303535199200,1cyclictest0-21swapper/009:30:090
303535199200,19cyclictest0-21swapper/011:36:080
303535199200,19cyclictest0-21swapper/010:06:180
303535199200,19cyclictest0-21swapper/009:48:060
303535199200,19cyclictest0-21swapper/009:28:070
139099200,14rtkit-daemon3056-21PK-Backend09:09:383
139099200,14rtkit-daemon0-21swapper/212:30:542
139099200,14rtkit-daemon0-21swapper/208:19:322
139099200,13rtkit-daemon3056-21PK-Backend11:22:183
31072392190,3sleep00-21swapper/010:30:170
3035362991917,1cyclictest3056-21PK-Backend11:50:123
3035362991917,1cyclictest3056-21PK-Backend11:33:353
3035362991917,1cyclictest3056-21PK-Backend10:37:313
3035362991917,1cyclictest0-21swapper/308:33:223
3035362991911,6cyclictest42-21ksoftirqd/307:38:333
3035362991910,2cyclictest42-21ksoftirqd/308:40:003
303536299190,1cyclictest3056-21PK-Backend09:15:053
303536299190,1cyclictest3056-21PK-Backend08:27:063
303536299190,1cyclictest3056-21PK-Backend08:01:453
303536299190,1cyclictest0-21swapper/308:21:523
303536299190,18cyclictest3056-21PK-Backend10:13:523
303536299190,18cyclictest3056-21PK-Backend07:47:173
3035359991917,1cyclictest0-21swapper/210:54:072
3035359991917,1cyclictest0-21swapper/209:51:482
3035359991917,1cyclictest0-21swapper/209:27:282
3035359991917,1cyclictest0-21swapper/208:53:012
3035359991917,1cyclictest0-21swapper/207:15:542
3035359991917,1cyclictest0-21swapper/207:11:152
3035359991917,1cyclictest0-21swapper/207:11:152
3035359991912,5cyclictest883-21dbus-daemon08:58:032
3035359991912,5cyclictest1095-21runrttasks09:55:202
303535999190,1cyclictest0-21swapper/212:11:202
303535999190,1cyclictest0-21swapper/211:59:312
303535999190,1cyclictest0-21swapper/211:59:302
303535999190,1cyclictest0-21swapper/209:16:262
303535999190,18cyclictest0-21swapper/208:06:372
3035355991917,1cyclictest0-21swapper/109:04:301
3035355991917,1cyclictest0-21swapper/108:46:261
3035355991917,1cyclictest0-21swapper/108:34:491
3035355991917,1cyclictest0-21swapper/108:00:081
3035355991913,4cyclictest3040079-21cat07:20:171
303535599191,2cyclictest141rcu_preempt07:15:011
303535599190,1cyclictest0-21swapper/112:31:281
303535599190,1cyclictest0-21swapper/111:51:261
303535599190,18cyclictest0-21swapper/112:28:371
303535599190,18cyclictest0-21swapper/107:38:181
303535199199,8cyclictest3037052-21idleruntime-cro07:14:590
303535199199,8cyclictest3037052-21idleruntime-cro07:14:590
3035351991917,1cyclictest0-21swapper/011:14:520
3035351991917,1cyclictest0-21swapper/010:19:230
3035351991917,1cyclictest0-21swapper/008:56:090
3035351991917,1cyclictest0-21swapper/008:50:280
3035351991913,4cyclictest2156-21gnome-shell10:24:100
3035351991912,5cyclictest3077724-21apt-get09:10:000
303535199191,16cyclictest3141858-21df_inode12:10:120
303535199191,13cyclictest3067330-21apt08:40:140
303535199190,1cyclictest0-21swapper/012:05:560
303535199190,18cyclictest0-21swapper/012:31:170
303535199190,18cyclictest0-21swapper/011:20:000
303535199190,18cyclictest0-21swapper/011:05:400
303535199190,18cyclictest0-21swapper/010:29:240
303535199190,18cyclictest0-21swapper/008:16:540
303535199190,18cyclictest0-21swapper/007:43:420
139099190,14rtkit-daemon3056-21PK-Backend11:13:282
139099190,13rtkit-daemon0-21swapper/210:36:522
303536299189,7cyclictest42-21ksoftirqd/307:21:373
303536299183,2cyclictest141rcu_preempt10:45:203
3035362991816,1cyclictest3056-21PK-Backend11:19:363
3035362991816,1cyclictest3056-21PK-Backend09:33:173
3035362991816,1cyclictest0-21swapper/309:53:313
303536299180,17cyclictest3056-21PK-Backend10:19:403
3035359991816,1cyclictest0-21swapper/211:30:522
3035359991816,1cyclictest0-21swapper/207:50:482
3035359991816,1cyclictest0-21swapper/207:36:162
3035359991811,5cyclictest3061846-21cron08:25:002
303535599185,7cyclictest26-21ksoftirqd/112:35:091
3035355991816,1cyclictest0-21swapper/109:49:461
3035355991815,2cyclictest0-21swapper/110:06:561
303535599180,1cyclictest0-21swapper/109:31:271
3035351991816,1cyclictest0-21swapper/012:35:570
3035351991816,1cyclictest0-21swapper/011:02:350
3035351991816,1cyclictest0-21swapper/011:02:350
3035351991816,1cyclictest0-21swapper/007:29:510
3035351991812,5cyclictest3045312-21load07:35:170
3035351991811,5cyclictest3081877-21grep09:20:130
3035362991715,1cyclictest0-21swapper/312:05:463
303536299170,2cyclictest141rcu_preempt10:02:573
303536299170,15cyclictest3094212-21df09:55:133
3035359991715,1cyclictest0-21swapper/210:59:282
3035359991715,1cyclictest0-21swapper/209:30:322
3035359991715,1cyclictest0-21swapper/209:02:472
3035359991710,5cyclictest3110982-21cat10:40:222
3035359991710,5cyclictest3096106-21expr10:00:172
3035355991715,1cyclictest0-21swapper/109:42:491
3035351991715,1cyclictest0-21swapper/011:27:090
3035351991715,1cyclictest0-21swapper/008:12:150
3035351991715,1cyclictest0-21swapper/007:52:480
3035351991715,1cyclictest0-21swapper/007:15:440
3035351991714,2cyclictest3056-21PK-Backend08:20:470
3035351991710,5cyclictest3113617-21grep10:50:130
3035351991710,5cyclictest3048584-21expr07:45:130
303536299168,2cyclictest42-21ksoftirqd/308:45:143
303535999168,6cyclictest3116969-21awk11:00:132
303535999168,6cyclictest3116969-21awk11:00:122
3035359991614,1cyclictest0-21swapper/210:33:592
303535199162,11cyclictest3108258-21apt10:35:120
3035351991611,3cyclictest3115827-21needreboot10:55:180
303535999159,4cyclictest3124619-21awk11:20:182
303535999139,3cyclictest3087072-21cpuspeed_turbos09:35:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional