You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 13:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Apr 10, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292565299181169,7cyclictest3027021-21apt-get20:50:022
292564999168164,3cyclictest0-21swapper/120:50:031
308721621020,18chrt75-21kworker/3:1+events21:51:213
30437242910,6chrt0-21swapper/221:06:252
2925646998871,15cyclictest0-21swapper/020:50:030
2925649996457,5cyclictest3072016-21kworker/u8:0+events_unbound22:16:351
292564699636,34cyclictest1-21systemd00:20:010
2925649996151,8cyclictest3046172-21ntpq21:06:291
2925649996054,4cyclictest2952167-21kworker/u8:0+events_unbound20:16:351
32251392590,4chrt0-21swapper/000:06:370
2925649995953,4cyclictest3072016-21kworker/u8:0+events_unbound22:01:341
2925649995853,4cyclictest3036851-21kworker/u8:0+flush-8:021:11:331
2925649995852,4cyclictest3204833-21kworker/u8:3+flush-8:023:56:381
2925649995852,4cyclictest3179140-21kworker/u8:0+events_unbound23:41:331
2925649995852,4cyclictest3054954-21kworker/u8:1+flush-8:021:21:371
2925649995750,5cyclictest3133963-21kworker/u8:3+events_unbound23:16:281
2925649995750,5cyclictest2957792-21kworker/u8:3+events_unbound21:41:351
2925649995651,3cyclictest2957792-21kworker/u8:3+events_unbound19:51:341
2925649995649,5cyclictest3243276-21kworker/u8:0+flush-8:000:36:331
2925652995550,3cyclictest3101155-21kworker/u8:1+flush-8:022:41:352
2925649995549,4cyclictest2577470-21kworker/u8:1+events_unbound20:46:321
2925649995548,5cyclictest3054954-21kworker/u8:1+events_unbound21:26:231
2925649995548,5cyclictest3054954-21kworker/u8:1+events_unbound21:26:231
2925646995533,7cyclictest3131436-21latency_hist22:35:010
2925652995448,4cyclictest3072016-21kworker/u8:0+events_unbound22:51:372
2925649995448,5cyclictest2577470-21kworker/u8:1+flush-8:019:36:361
2925649995448,4cyclictest3101155-21kworker/u8:1+flush-8:022:31:341
2925649995447,4cyclictest2577470-21kworker/u8:1+flush-8:020:21:371
2925649995245,5cyclictest3141609-21kworker/u8:2+events_unbound22:56:191
2925652995146,4cyclictest2577470-21kworker/u8:1+flush-8:020:06:362
2925652995143,6cyclictest280-21systemd-journal21:20:002
2925649995145,4cyclictest2577470-21kworker/u8:1+events_unbound19:16:341
2925649994944,3cyclictest2090541-21kworker/u8:4+events_unbound19:11:351
2925649994944,3cyclictest2090541-21kworker/u8:4+events_unbound19:11:351
2925649994942,5cyclictest3054954-21kworker/u8:1+flush-8:021:36:371
2925649994942,5cyclictest2957792-21kworker/u8:3+flush-8:021:46:341
2925649994941,5cyclictest2957792-21kworker/u8:3+flush-8:020:01:351
2925649994937,6cyclictest3243276-21kworker/u8:0+flush-8:000:31:211
2925649994842,4cyclictest2577470-21kworker/u8:1+events_unbound21:01:351
2925649994840,6cyclictest3101155-21kworker/u8:1+flush-8:022:21:331
2925652994742,3cyclictest3141609-21kworker/u8:2+events_unbound23:11:292
2925649994742,4cyclictest3047267-21kworker/u8:2+flush-8:021:31:371
2925649994742,3cyclictest2957792-21kworker/u8:3+events_unbound20:56:291
2925649994741,5cyclictest2952167-21kworker/u8:0+flush-8:019:46:301
2925649994741,4cyclictest2878931-21kworker/u8:2+flush-8:019:21:211
2925649994741,4cyclictest2577470-21kworker/u8:1+events_unbound19:56:311
31245192460,5sleep20-21swapper/222:26:272
2925652994642,3cyclictest3141609-21kworker/u8:2+events_unbound23:36:282
2925652994641,4cyclictest2952167-21kworker/u8:0+events_unbound20:36:322
2925649994641,4cyclictest3215521-21kworker/u8:0+flush-8:000:16:311
2925649994641,4cyclictest2952167-21kworker/u8:0+events_unbound20:26:341
2925649994640,5cyclictest3054954-21kworker/u8:1+flush-8:021:51:311
2925649994640,4cyclictest3171034-21kworker/u8:1+events_unbound00:06:301
2925649994640,4cyclictest3072016-21kworker/u8:0+events_unbound22:26:361
2925649994637,7cyclictest2577470-21kworker/u8:1+flush-8:019:31:301
2925646994637,6cyclictest3195734-21latency_hist23:40:000
2925646994636,8cyclictest3095730-21ntpq21:56:280
2925652994540,4cyclictest2957792-21kworker/u8:3+events_unbound20:56:332
2925649994539,4cyclictest2878931-21kworker/u8:2+flush-8:019:26:351
2925646994535,7cyclictest2997119-21latency_hist20:20:010
2925652994439,4cyclictest3133963-21kworker/u8:3+events_unbound23:01:352
2925649994440,3cyclictest3072016-21kworker/u8:0+events_unbound21:56:311
2925649994436,6cyclictest3171034-21kworker/u8:1+events_unbound00:26:221
2925649994434,8cyclictest3204771-21ntpq23:46:311
2925646994436,6cyclictest2977351-21latency_hist20:00:010
2925652994339,3cyclictest3235042-21kworker/u8:2+flush-8:000:31:332
2925649994338,3cyclictest3101155-21kworker/u8:1+flush-8:022:06:261
2925649994338,3cyclictest2952167-21kworker/u8:0+events_unbound19:45:011
2925652994237,3cyclictest3171034-21kworker/u8:1+events_unbound23:31:382
2925652994237,3cyclictest3171034-21kworker/u8:1+events_unbound23:31:382
2925649994236,4cyclictest3179140-21kworker/u8:0+events_unbound23:26:251
2925649994236,4cyclictest3179140-21kworker/u8:0+events_unbound23:26:251
2925649994236,4cyclictest2577470-21kworker/u8:1+flush-8:020:11:221
2925649994132,6cyclictest280-21systemd-journal20:40:001
2925649994034,4cyclictest3101155-21kworker/u8:1+flush-8:022:11:211
2925649994033,5cyclictest3179140-21kworker/u8:0+flush-8:023:21:331
2925649994033,4cyclictest3141609-21kworker/u8:2+flush-8:023:51:261
292564699402,35cyclictest2937544-21kworker/0:1+events21:11:170
2925649993833,4cyclictest3133963-21kworker/u8:3+events_unbound23:06:191
2925652993731,4cyclictest3204833-21kworker/u8:3+flush-8:023:46:352
2925649993731,5cyclictest2577470-21kworker/u8:1+flush-8:020:06:201
2925649993730,5cyclictest2952167-21kworker/u8:0+events_unbound20:31:211
2925646993730,5cyclictest280-21systemd-journal20:08:560
2925646993726,8cyclictest3211165-21diskstats23:56:210
2925649993627,7cyclictest3145999-21unixbench_multi22:46:361
2925649993627,6cyclictest280-21systemd-journal00:01:181
2925646993626,8cyclictest2958161-21diskstats19:41:200
292564699362,28cyclictest3111443-21kworker/0:0+events22:26:180
29858312350,2chrt75-21kworker/3:1+events20:06:263
2925649993529,5cyclictest3141609-21kworker/u8:2+events_unbound23:31:211
2925649993529,5cyclictest3141609-21kworker/u8:2+events_unbound23:31:211
2925649993529,4cyclictest3072016-21kworker/u8:0+events_unbound23:01:231
2925649993528,5cyclictest3133963-21kworker/u8:3+flush-8:022:41:251
292564699352,32cyclictest2937544-21kworker/0:1+events21:23:270
30273062340,2sleep3471rcuc/320:50:013
2925652993428,4cyclictest2957321-21apt-get19:40:012
2925649993430,3cyclictest3141609-21kworker/u8:2+flush-8:022:51:391
292564699343,29cyclictest3111443-21kworker/0:0+events23:31:350
292564699343,29cyclictest3111443-21kworker/0:0+events23:31:350
2925646993417,14cyclictest280-21systemd-journal21:41:180
32455122330,3sleep03245510-21grep00:30:010
2925649993329,3cyclictest3171034-21kworker/u8:1+events_unbound00:11:251
2925646993323,7cyclictest280-21systemd-journal22:09:180
292564699332,29cyclictest3111443-21kworker/0:0+events23:06:310
2925652993227,4cyclictest3133963-21kworker/u8:3+flush-8:022:36:312
2925652993227,4cyclictest2878931-21kworker/u8:2+flush-8:019:16:362
2925652993226,4cyclictest2981962-21unixbench_multi20:01:362
292564699328,18cyclictest2937544-21kworker/0:1+events21:30:010
292564699328,18cyclictest2937544-21kworker/0:1+events21:30:010
292564699322,28cyclictest3111443-21kworker/0:0+events23:16:260
2925646993210,16cyclictest2937544-21kworker/0:1+events19:26:170
2925649993125,4cyclictest3056925-21cron21:20:001
292564699317,22cyclictest2937544-21kworker/0:1+events21:46:390
292564699311,29cyclictest2925509-21kworker/0:3+events19:10:010
2925646993110,19cyclictest3111443-21kworker/0:0+events23:45:010
2925649993025,3cyclictest3132509-21irqrtprio22:36:241
2925649993024,4cyclictest3195720-21cron23:40:001
292564699302,27cyclictest2937544-21kworker/0:1+events20:36:310
292564699302,26cyclictest2937544-21kworker/0:1+events20:50:000
292564699301,27cyclictest2937544-21kworker/0:1+events22:25:010
29982002290,1sleep02998205-21grep20:21:240
2925649992925,2cyclictest3166652-21cpuspeed_turbos23:11:191
292564699298,15cyclictest2937544-21kworker/0:1+events20:31:010
292564699294,24cyclictest2937544-21kworker/0:1+events19:36:370
292564699293,20cyclictest2937544-21kworker/0:1+events22:16:170
2925646992924,3cyclictest3246171-21fschecks_time00:31:210
2925646992924,3cyclictest3171007-21turbostat.cron23:15:000
292564699292,26cyclictest2937544-21kworker/0:1+events19:55:010
292564699292,25cyclictest3111443-21kworker/0:0+events22:41:290
292564699291,27cyclictest3111443-21kworker/0:0+events23:01:290
292564699291,26cyclictest3111443-21kworker/0:0+events22:36:360
292564699291,26cyclictest3111443-21kworker/0:0+events00:01:250
292564699291,26cyclictest2937544-21kworker/0:1+events20:41:300
292564699290,27cyclictest2937544-21kworker/0:1+events20:01:210
292564699288,19cyclictest3215536-21kworker/0:2+events00:11:300
292564699288,17cyclictest3111443-21kworker/0:0+events22:51:030
292564699285,22cyclictest2937544-21kworker/0:1+events21:17:130
2925646992822,4cyclictest3204815-21ntpq23:46:320
292564699282,24cyclictest2937544-21kworker/0:1+events20:26:330
292564699281,25cyclictest3111443-21kworker/0:0+events23:51:300
2925646992810,17cyclictest2937544-21kworker/0:1+events21:36:290
2925646992810,16cyclictest2937544-21kworker/0:1+events21:06:260
29670142270,3sleep20-21swapper/219:46:352
2925652992723,3cyclictest280-21systemd-journal21:35:002
2925652992723,2cyclictest3152543-21kthreadcore22:56:252
2925652992723,2cyclictest3062600-21fschecks_time21:26:222
2925652992723,2cyclictest3062600-21fschecks_time21:26:222
292564699279,16cyclictest2937544-21kworker/0:1+events22:05:010
292564699276,15cyclictest2937544-21kworker/0:1+events20:11:140
292564699274,17cyclictest3111443-21kworker/0:0+events23:25:010
2925646992710,16cyclictest3111443-21kworker/0:0+events22:56:260
292564699270,25cyclictest2937544-21kworker/0:1+events22:11:190
2925652992623,2cyclictest3210558-21cron23:55:002
2925652992622,3cyclictest2577470-21kworker/u8:1+events_unbound20:35:002
2925652992621,4cyclictest3215476-21idleruntime-cro00:00:012
2925652992621,3cyclictest3180903-21latency_hist23:25:002
2925649992621,4cyclictest2952167-21kworker/u8:0+flush-8:020:41:301
292564699269,16cyclictest2937544-21kworker/0:1+events19:31:290
292564699268,16cyclictest2937544-21kworker/0:1+events20:56:290
2925646992617,4cyclictest0-21swapper/023:26:170
2925646992617,4cyclictest0-21swapper/023:26:160
292564699261,22cyclictest2937855-21apt-get19:21:180
2925646992610,15cyclictest2937544-21kworker/0:1+events21:51:220
2925646992610,15cyclictest2937544-21kworker/0:1+events21:31:210
2925646992610,14cyclictest2925509-21kworker/0:3+events19:11:170
2925646992610,14cyclictest2925509-21kworker/0:3+events19:11:170
2925652992521,2cyclictest3181466-21cpuspeed_turbos23:26:192
2925652992521,2cyclictest3181466-21cpuspeed_turbos23:26:192
2925652992520,3cyclictest2968143-21fschecks_time19:51:222
292564699258,15cyclictest3215536-21kworker/0:2+events00:21:380
292564699255,19cyclictest2937544-21kworker/0:1+events21:00:580
292564699253,17cyclictest2925509-21kworker/0:3+events19:15:030
2925652992419,4cyclictest20977-21cron19:25:002
2925652992418,4cyclictest3120966-21unixbench_multi22:21:382
2925652992418,4cyclictest3086686-21turbostat.cron21:50:002
292564699248,15cyclictest3111443-21kworker/0:0+events22:46:310
292564699246,17cyclictest2937544-21kworker/0:1+events19:49:090
292564699244,14cyclictest3215536-21kworker/0:2+events00:35:290
2925652992318,3cyclictest3061576-21unixbench_multi21:21:392
2925652992318,3cyclictest3026690-21unixbench_singl20:46:352
2925652992312,8cyclictest3007245-21awk20:30:002
2925652992218,3cyclictest2997829-21sort20:21:222
2925652992213,7cyclictest3245549-21sed00:30:012
29209582225,10sleep10-21swapper/119:06:181
2925652992117,2cyclictest3037706-21cpuspeed_turbos21:01:192
2925652992116,4cyclictest2577470-21kworker/u8:1+flush-8:019:40:062
2925649992117,3cyclictest3204833-21kworker/u8:3+flush-8:000:21:221
292565299204,2cyclictest30199471kthreadcore20:41:262
292565299202,3cyclictest0-21swapper/200:21:102
2925652992016,3cyclictest2951938-21unixbench_multi19:31:362
2925652992015,4cyclictest2925522-21kworker/u8:0+events_unbound19:10:072
2925652992015,4cyclictest2925522-21kworker/u8:0+events_unbound19:10:072
2925652992012,6cyclictest3101879-21sshd22:06:182
292565299200,6cyclictest3255056-21grep00:36:362
29251012203,10sleep20-21swapper/219:06:392
292565299197,4cyclictest0-21swapper/222:31:342
292565299192,12cyclictest3100715-21ntpq22:01:322
2925652991915,2cyclictest3087249-21cpuspeed_turbos21:51:212
2925652991915,2cyclictest0-21swapper/221:11:312
29246332192,9sleep30-21swapper/319:06:323
292565299189,6cyclictest3176037-21grep23:20:002
292565299183,9cyclictest3229518-21ntpq00:11:282
2925652991814,2cyclictest0-21swapper/220:16:222
2925652991814,2cyclictest0-21swapper/200:06:192
2925652991813,3cyclictest0-21swapper/219:30:012
292565299179,6cyclictest3230735-21sshd00:16:172
292565299173,3cyclictest0-21swapper/200:01:342
292565299172,8cyclictest0-21swapper/221:56:232
292565299172,5cyclictest0-21swapper/222:16:222
2925652991713,2cyclictest0-21swapper/223:06:362
2925652991713,2cyclictest0-21swapper/220:11:232
2925652991713,2cyclictest0-21swapper/219:56:352
2925652991712,4cyclictest3072016-21kworker/u8:0+events_unbound21:35:122
292565299170,4cyclictest3141965-21df22:46:192
30371272160,3sleep3451irq_work/321:00:003
29727842162,9sleep30-21swapper/319:56:163
292565299162,4cyclictest0-21swapper/221:41:182
292565299162,13cyclictest0-21swapper/223:41:192
2925652991612,2cyclictest0-21swapper/222:11:262
30468462158,4sleep30-21swapper/321:07:473
29932872145,5sleep30-21swapper/320:16:233
29374742142,7sleep30-21swapper/319:19:593
32353472132,6sleep30-21swapper/300:20:023
31504222134,5sleep30-21swapper/322:51:333
31267222132,6sleep30-21swapper/322:30:023
30528642132,7sleep30-21swapper/321:16:263
29605022134,5sleep30-21swapper/319:41:273
29534042132,7sleep30-21swapper/319:36:263
29477212132,7sleep30-21swapper/319:31:163
32502862122,6sleep30-21swapper/300:33:383
32449502122,6sleep30-21swapper/300:26:403
32211102122,6sleep30-21swapper/300:06:213
32105842122,6sleep30-21swapper/323:55:023
32105302122,6sleep30-21swapper/323:54:423
31947342122,6sleep30-21swapper/323:36:283
31898962122,6sleep30-21swapper/323:31:303
31898962122,6sleep30-21swapper/323:31:303
31847732122,6sleep30-21swapper/323:26:283
31847732122,6sleep30-21swapper/323:26:283
31708012122,6sleep30-21swapper/323:12:323
31611772122,5sleep30-21swapper/323:05:013
31565722122,6sleep30-21swapper/323:01:153
31364382122,5sleep30-21swapper/322:40:013
31114082122,5sleep30-21swapper/322:15:013
31108332122,6sleep30-21swapper/322:11:363
31061772122,6sleep30-21swapper/322:06:393
30858382123,6sleep30-21swapper/321:46:323
30768142122,6sleep30-21swapper/321:40:023
30672012123,5sleep30-21swapper/321:31:193
30660602123,5sleep30-21swapper/321:26:343
30660602123,5sleep30-21swapper/321:26:343
30482712122,6sleep30-21swapper/321:11:243
30371272122,5sleep30-21swapper/321:00:013
30273062122,5sleep30-21swapper/320:50:023
30173482122,6sleep30-21swapper/320:40:023
30021802122,6sleep30-21swapper/320:25:023
29773852122,5sleep30-21swapper/320:00:013
29631542122,6sleep30-21swapper/319:46:213
29277622122,6sleep30-21swapper/319:11:263
29277622122,6sleep30-21swapper/319:11:263
32512082112,5sleep30-21swapper/300:36:233
32314442113,5sleep30-21swapper/300:16:253
32258352112,5sleep30-21swapper/300:11:193
32160982112,5sleep30-21swapper/300:01:203
32008632112,5sleep30-21swapper/323:45:023
31969952112,5sleep30-21swapper/323:41:253
31761882112,5sleep30-21swapper/323:20:023
31751912112,5sleep30-21swapper/323:16:333
31514962112,5sleep30-21swapper/322:55:023
31457242112,5sleep30-21swapper/322:46:353
31317602112,5sleep30-21swapper/322:36:163
31259512112,5sleep30-21swapper/322:26:373
31210542112,5sleep30-21swapper/322:21:393
30969482112,5sleep30-21swapper/322:01:213
30955782112,5sleep30-21swapper/321:56:263
30721062112,5sleep30-21swapper/321:36:173
30572642112,5sleep30-21swapper/321:21:083
30127632110,6sleep30-21swapper/320:36:213
30113192112,5sleep30-21swapper/320:31:323
30007692112,5sleep30-21swapper/320:21:283
29881042112,6sleep30-21swapper/320:11:213
29676802112,5sleep30-21swapper/319:50:023
29465682112,5sleep30-21swapper/319:26:313
29387382112,5sleep30-21swapper/319:21:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional