You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 03:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Apr 27, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3763235995852,4cyclictest3953680-21kworker/u8:2+events_unbound00:31:241
3763230995647,6cyclictest4077953-21latency_hist00:25:010
3763235995348,3cyclictest3844268-21kworker/u8:1+events_unbound22:26:241
3763235995346,5cyclictest3953680-21kworker/u8:2+flush-8:023:01:091
3763235995247,3cyclictest3844268-21kworker/u8:1+events_unbound22:01:211
3763235995246,5cyclictest3762799-21kworker/u8:2+flush-8:020:31:241
3763235995246,4cyclictest3863837-21kworker/u8:0+flush-8:021:01:091
3763235995246,4cyclictest3414746-21kworker/u8:0+flush-8:019:15:041
3763235995146,4cyclictest3844268-21kworker/u8:1+events_unbound21:31:111
3763235995143,6cyclictest3768163-21latency_hist19:15:011
3763240995040,7cyclictest3894188-21cat21:20:012
3763235995045,4cyclictest2935746-21kworker/u8:3+events_unbound20:01:191
3763235995045,3cyclictest4033402-21kworker/u8:1+flush-8:000:21:251
3763235995044,4cyclictest3839307-21latency_hist20:25:011
3763235995043,5cyclictest2935746-21kworker/u8:3+flush-8:020:41:211
3763235994945,3cyclictest2935746-21kworker/u8:3+events_unbound19:21:181
3763235994944,4cyclictest4012966-21kworker/u8:3+flush-8:023:31:181
3763235994944,4cyclictest3953680-21kworker/u8:2+events_unbound22:46:251
3763235994943,5cyclictest2935746-21kworker/u8:3+events_unbound19:46:241
3763235994936,9cyclictest280-21systemd-journal00:28:371
3763230994943,4cyclictest3762799-21kworker/u8:2+flush-8:019:31:100
3763230994942,5cyclictest3992363-21ntpq22:56:200
3763235994843,3cyclictest3888136-21kworker/u8:3+events_unbound22:16:221
3763235994842,5cyclictest2935746-21kworker/u8:3+flush-8:020:16:191
3763235994743,3cyclictest3844268-21kworker/u8:1+events_unbound21:21:201
3763235994742,4cyclictest3963192-21kworker/u8:0+flush-8:022:36:081
3763235994740,5cyclictest3953680-21kworker/u8:2+flush-8:022:51:181
3763235994640,4cyclictest3953680-21kworker/u8:2+events_unbound00:06:231
3763230994638,6cyclictest3763476-21/usr/sbin/munin19:11:240
3763230994636,8cyclictest4032033-21ntpq23:36:160
3763235994540,4cyclictest3953680-21kworker/u8:2+events_unbound22:41:171
3763235994540,4cyclictest2935746-21kworker/u8:3+events_unbound19:31:211
3763235994539,5cyclictest3953680-21kworker/u8:2+events_unbound23:16:071
3763235994538,5cyclictest4033402-21kworker/u8:1+flush-8:000:11:231
3763230994541,3cyclictest3888136-21kworker/u8:3+events_unbound21:16:220
38371312440,3sleep2371rcuc/220:21:142
3763235994438,5cyclictest4033402-21kworker/u8:1+events_unbound23:41:161
3763235994438,5cyclictest3953680-21kworker/u8:2+flush-8:023:56:191
3763235994438,4cyclictest3953680-21kworker/u8:2+flush-8:000:36:201
3763235994438,4cyclictest3888136-21kworker/u8:3+events_unbound21:11:221
3763235994437,6cyclictest3953680-21kworker/u8:2+flush-8:022:56:191
3763230994438,4cyclictest3863837-21kworker/u8:0+events_unbound21:01:150
3763235994339,3cyclictest3903915-21kworker/u8:0+flush-8:021:46:231
3763235994338,3cyclictest3762799-21kworker/u8:2+flush-8:021:06:241
3763235994337,4cyclictest3932991-21ntpq21:56:181
3763230994339,3cyclictest3762799-21kworker/u8:2+flush-8:019:36:250
3763230994339,3cyclictest3762799-21kworker/u8:2+flush-8:019:36:250
3763235994238,3cyclictest3863837-21kworker/u8:0+events_unbound20:51:071
3763235994237,4cyclictest3903915-21kworker/u8:0+flush-8:021:51:211
3763235994237,3cyclictest3953680-21kworker/u8:2+flush-8:023:46:111
3763235994236,4cyclictest3963192-21kworker/u8:0+events_unbound23:11:241
3763235994236,4cyclictest2935746-21kworker/u8:3+flush-8:019:41:191
3763235994236,4cyclictest2935746-21kworker/u8:3+flush-8:019:41:191
3763235994234,6cyclictest2935746-21kworker/u8:3+flush-8:020:26:201
3763235994232,8cyclictest3957709-21ntpq22:21:161
3763230994238,3cyclictest2935746-21kworker/u8:3+flush-8:020:11:210
3763230994237,4cyclictest3844268-21kworker/u8:1+flush-8:021:56:080
3763230994232,7cyclictest280-21systemd-journal21:42:380
3763235994136,4cyclictest4033402-21kworker/u8:1+events_unbound00:01:071
3763235994135,4cyclictest3888136-21kworker/u8:3+flush-8:021:16:081
3763230994131,8cyclictest3823579-21ntpq20:06:160
3763235994036,3cyclictest3762799-21kworker/u8:2+events_unbound20:46:111
3763235994035,4cyclictest3903915-21kworker/u8:0+events_unbound21:40:011
3763235994035,4cyclictest2935746-21kworker/u8:3+flush-8:019:26:101
3763235994035,3cyclictest3942939-21ntpq22:06:191
3763235994034,5cyclictest3762799-21kworker/u8:2+events_unbound19:36:181
3763235994034,5cyclictest3762799-21kworker/u8:2+events_unbound19:36:181
3763235994033,6cyclictest3762799-21kworker/u8:2+flush-8:021:26:201
3763235993833,4cyclictest3888136-21kworker/u8:3+flush-8:022:11:091
3763235993831,5cyclictest3844268-21kworker/u8:1+flush-8:023:06:171
3763235993830,6cyclictest2935746-21kworker/u8:3+flush-8:020:11:161
3763230993831,6cyclictest2935746-21kworker/u8:3+flush-8:020:26:240
3763235993734,2cyclictest3963192-21kworker/u8:0+flush-8:023:36:221
3763235993731,4cyclictest3844268-21kworker/u8:1+flush-8:021:41:231
3763235993725,9cyclictest4022816-21latency_hist23:30:011
3763230993733,3cyclictest3844268-21kworker/u8:1+events_unbound21:21:130
3763230993731,5cyclictest4033402-21kworker/u8:1+events_unbound00:11:090
3763230993730,5cyclictest3963192-21kworker/u8:0+flush-8:023:11:170
37628482374,11sleep10-21swapper/119:07:261
3763235993632,3cyclictest4013998-21irqrtprio23:21:121
3763230993631,4cyclictest3414746-21kworker/u8:0+events_unbound19:15:030
3763230993631,3cyclictest2935746-21kworker/u8:3+events_unbound19:21:080
3763230993629,5cyclictest4048029-21apt-get23:55:010
3763240993526,7cyclictest4023233-21cat23:30:012
3763235993530,4cyclictest4033402-21kworker/u8:1+flush-8:000:16:221
3763235993529,4cyclictest3953680-21kworker/u8:2+events_unbound22:31:141
3763230993526,7cyclictest3849294-21cat20:35:010
3763235993428,5cyclictest2935746-21kworker/u8:3+flush-8:019:56:191
3763235993426,6cyclictest3762799-21kworker/u8:2+flush-8:019:51:211
3763230993427,5cyclictest280-21systemd-journal19:30:000
3763240993324,7cyclictest4048113-21cat23:55:002
3763240993323,8cyclictest4073005-21/usr/sbin/munin00:20:002
40671482320,3sleep375-21kworker/3:1+events00:11:173
3763240993226,4cyclictest4032924-21apt-get23:40:002
3763230993230,1cyclictest3762799-21kworker/u8:2+events_unbound20:36:230
3763230993228,2cyclictest280-21systemd-journal23:10:000
3763230993227,3cyclictest2935746-21kworker/u8:3+events_unbound19:46:200
3763230993224,6cyclictest3903915-21kworker/u8:0+events_unbound21:51:170
3763230993222,8cyclictest280-21systemd-journal22:30:000
37629262324,9sleep20-21swapper/219:08:272
3763240993125,4cyclictest3829065-21unixbench_singl20:11:242
3763235993125,5cyclictest3762799-21kworker/u8:2+flush-8:020:35:031
3763230993127,3cyclictest3888136-21kworker/u8:3+flush-8:022:11:250
3763230993127,3cyclictest3762799-21kworker/u8:2+events_unbound21:26:250
3763230993123,6cyclictest3973444-21latency_hist22:40:010
3763230993025,4cyclictest2935746-21kworker/u8:3+flush-8:020:16:210
3763230993025,3cyclictest3953680-21kworker/u8:2+events_unbound23:21:060
3763230993025,3cyclictest2935746-21kworker/u8:3+flush-8:019:41:220
3763230993025,3cyclictest2935746-21kworker/u8:3+flush-8:019:41:210
3763230993024,4cyclictest4048242-21latency_hist23:55:010
3763230993024,4cyclictest3953680-21kworker/u8:2+flush-8:000:01:090
3763230993020,8cyclictest280-21systemd-journal20:05:010
376324099294,7cyclictest3963555-21munin-run22:30:002
3763235992926,2cyclictest3870108-21irqcore20:56:121
3763235992921,6cyclictest4048029-21apt-get23:55:001
3763230992925,3cyclictest3762799-21kworker/u8:2+flush-8:019:51:200
3763230992925,2cyclictest4010467-21kthreadcore23:16:140
3763230992924,4cyclictest3953680-21kworker/u8:2+events_unbound22:31:240
3763230992924,4cyclictest3844268-21kworker/u8:1+events_unbound22:06:210
3763230992924,3cyclictest3953680-21kworker/u8:2+flush-8:022:41:140
3763230992924,3cyclictest3935150-21kthreadcore22:01:120
3763230992923,4cyclictest3997791-21grep23:01:240
3763230992920,7cyclictest4023357-21/usr/sbin/munin23:31:170
3763240992824,2cyclictest4007633-21unixbench_singl23:11:262
3763240992820,5cyclictest280-21systemd-journal21:50:012
3763230992826,1cyclictest3903915-21kworker/u8:0+events_unbound21:46:070
3763240992722,3cyclictest3824080-21unixbench_multi20:06:232
3763230992723,3cyclictest3888136-21kworker/u8:3+flush-8:021:11:220
3763230992722,4cyclictest4033402-21kworker/u8:1+flush-8:023:41:180
3763230992722,4cyclictest3953680-21kworker/u8:2+events_unbound00:06:100
3763230992622,3cyclictest4033402-21kworker/u8:1+events_unbound00:40:000
3763230992621,4cyclictest4033402-21kworker/u8:1+flush-8:000:16:170
3763240992520,3cyclictest3974053-21fschecks_count22:41:082
3763240992511,9cyclictest3859649-21apt-get20:46:062
376324099251,12cyclictest4088146-21apt-get00:36:062
376323099252,1cyclictest0-21swapper/022:46:240
3763230992521,3cyclictest4033402-21kworker/u8:1+flush-8:000:32:080
3763230992521,2cyclictest3859324-21turbostat.cron20:45:000
3763230992520,4cyclictest3953680-21kworker/u8:2+events_unbound23:46:070
3763230992520,4cyclictest3864221-21cron20:50:000
3763230992519,5cyclictest3953680-21kworker/u8:2+flush-8:022:51:230
3763230992517,1cyclictest0-21swapper/020:56:050
3763230992514,8cyclictest4082760-21sshd00:28:370
376324099246,4cyclictest0-21swapper/223:41:192
376324099242,11cyclictest3957793-21ntpq22:21:182
376324099242,11cyclictest3933034-21ntpq21:56:202
376324099242,10cyclictest880-21mta-sts-daemon23:06:162
3763240992420,3cyclictest3894605-21aten2_r5power_v21:21:072
3763240992420,2cyclictest4057834-21unixbench_singl00:01:242
3763240992420,2cyclictest3869742-21cpuspeed_turbos20:56:082
3763240992415,4cyclictest3899682-21apt-get21:26:062
3763240992415,4cyclictest3854715-21apt-get20:41:042
3763240992411,9cyclictest3839636-21apt-get20:26:072
3763240992410,9cyclictest3879406-21apt-get21:06:072
3763230992419,3cyclictest4022924-21apt-key23:29:590
3763230992416,6cyclictest3835292-21irqcore20:21:110
3763230992416,6cyclictest280-21systemd-journal21:40:010
376324099233,4cyclictest0-21swapper/221:51:242
376324099233,10cyclictest0-21swapper/222:06:212
376324099232,10cyclictest3947852-21ntpq22:11:172
3763240992320,2cyclictest3868805-21unixbench_multi20:51:242
3763240992319,2cyclictest3775443-21aten2_r5power_e19:21:072
3763240992318,4cyclictest3993164-21idleruntime-cro23:00:002
3763240992318,4cyclictest3799748-21apt19:45:002
3763240992318,4cyclictest3799748-21apt19:45:002
3763240992318,4cyclictest3762799-21kworker/u8:2-ext4-rsv-conversion19:55:002
376324099231,13cyclictest0-21swapper/223:16:162
376324099231,13cyclictest0-21swapper/219:36:202
376324099231,13cyclictest0-21swapper/219:36:192
3763235992318,3cyclictest0-21swapper/120:10:011
3763230992320,2cyclictest3844268-21kworker/u8:1+flush-8:022:21:210
3763230992318,3cyclictest3844268-21kworker/u8:1+flush-8:022:19:520
3763230992318,3cyclictest3762799-21kworker/u8:2+events_unbound21:06:120
3763230992318,3cyclictest2935746-21kworker/u8:3+events_unbound20:00:010
3763230992313,8cyclictest280-21systemd-journal21:35:000
376324099223,9cyclictest0-21swapper/223:49:142
376324099223,5cyclictest3918512-21/usr/sbin/munin21:41:222
376324099222,4cyclictest0-21swapper/220:39:282
376324099222,10cyclictest4062302-21ntpq00:06:192
3763240992213,7cyclictest280-21systemd-journal21:35:002
376324099220,12cyclictest3972722-21ps22:36:212
376324099220,11cyclictest3784130-21ntpq19:26:202
3763230992218,2cyclictest0-21swapper/020:55:010
376324099214,4cyclictest0-21swapper/220:17:242
376324099213,4cyclictest0-21swapper/221:10:272
3763240992118,2cyclictest3765681-21kthreadcore19:11:152
3763240992117,3cyclictest4078559-21grep00:26:082
376324099211,6cyclictest39-21ksoftirqd/222:47:182
3763240992114,4cyclictest4077141-21ntpq00:21:202
376324099210,7cyclictest39-21ksoftirqd/221:38:242
376324099210,6cyclictest39-21ksoftirqd/221:03:282
376324099210,11cyclictest3768360-21munin-node19:15:012
3763230992110,7cyclictest3763233-21grep19:10:010
376324099205,6cyclictest0-21swapper/200:10:512
376324099205,5cyclictest0-21swapper/222:51:332
376324099205,4cyclictest0-21swapper/223:21:372
376324099205,4cyclictest0-21swapper/222:30:302
376324099205,13cyclictest3812937-21tr19:56:152
3763240992016,2cyclictest0-21swapper/200:00:002
3763240992010,8cyclictest3815925-21tr20:01:132
376324099200,6cyclictest39-21ksoftirqd/222:00:192
376324099200,6cyclictest39-21ksoftirqd/219:30:392
376324099195,4cyclictest0-21swapper/223:30:262
376324099195,4cyclictest0-21swapper/220:33:082
376324099195,11cyclictest4083105-21chrt00:30:022
376324099193,6cyclictest0-21swapper/219:47:172
376324099192,4cyclictest0-21swapper/222:16:062
3763240991916,2cyclictest3993737-21cpuspeed_turbos23:01:072
37627792183,8sleep30-21swapper/319:06:353
39795882178,5sleep30-21swapper/322:46:133
38001812150,2chrt75-21kworker/3:1+events19:46:073
40238762132,7sleep30-21swapper/323:31:133
39538152132,6sleep30-21swapper/322:20:023
39063482132,7sleep30-21swapper/321:31:143
38791012132,6sleep30-21swapper/321:05:023
40883902122,6sleep30-21swapper/300:36:103
40852732122,6sleep30-21swapper/300:31:163
40689102122,6sleep30-21swapper/300:16:113
40585142122,6sleep30-21swapper/300:06:083
40337512122,6sleep30-21swapper/323:41:083
40320942122,6sleep30-21swapper/323:36:173
40228022122,6sleep30-21swapper/323:30:003
40123232122,6sleep30-21swapper/323:16:243
40037602122,6sleep30-21swapper/323:11:103
39882552122,5sleep30-21swapper/322:55:013
39779682122,6sleep30-21swapper/322:41:253
39693292122,6sleep30-21swapper/322:36:113
39635622122,5sleep30-21swapper/322:30:003
39594022122,6sleep30-21swapper/322:26:123
39388162122,5sleep30-21swapper/322:05:013
39290602122,6sleep30-21swapper/321:55:023
39099972122,6sleep30-21swapper/321:36:123
38849302122,6sleep30-21swapper/321:11:123
38632172122,6sleep30-21swapper/320:46:163
38544112122,6sleep30-21swapper/320:40:023
38449232122,6sleep30-21swapper/320:31:113
38439622122,6sleep30-21swapper/320:26:383
38392922122,6sleep30-21swapper/320:25:013
38334862122,6sleep30-21swapper/320:16:183
38286222124,5sleep30-21swapper/320:11:213
38203742122,6sleep30-21swapper/320:06:113
38090142122,6sleep30-21swapper/319:51:223
37857062122,6sleep30-21swapper/319:31:123
37806282122,6sleep30-21swapper/319:26:103
37759092122,6sleep30-21swapper/319:21:133
40783092112,5sleep30-21swapper/300:26:063
40761872112,5sleep30-21swapper/300:21:173
40534442112,5sleep30-21swapper/300:00:023
40488292112,5sleep30-21swapper/323:56:093
40439382112,5sleep30-21swapper/323:51:103
40381802111,5sleep30-21swapper/323:45:013
40129732112,5sleep30-21swapper/323:20:013
40029372112,5sleep30-21swapper/323:08:383
39970442112,5sleep30-21swapper/323:01:153
39835902112,5sleep30-21swapper/322:50:363
39492712112,5sleep30-21swapper/322:16:093
39445132112,5sleep30-21swapper/322:11:113
39341502112,5sleep30-21swapper/322:00:283
39287752112,5sleep30-21swapper/321:52:373
39230282112,5sleep30-21swapper/321:46:153
39149012112,5sleep30-21swapper/321:41:093
39036742112,5sleep30-21swapper/321:26:253
38944962112,5sleep30-21swapper/321:21:073
38896972112,5sleep30-21swapper/321:16:103
38733932112,5sleep30-21swapper/320:56:233
38649302112,5sleep30-21swapper/320:51:093
38506452112,5sleep30-21swapper/320:36:133
38187562112,5sleep30-21swapper/320:01:213
38124422112,6sleep30-21swapper/319:56:163
37951992112,5sleep30-21swapper/319:41:073
37951992112,5sleep30-21swapper/319:41:073
37898832112,5sleep30-21swapper/319:35:013
37898832112,5sleep30-21swapper/319:35:013
37740142112,5sleep30-21swapper/319:16:153
37630922112,5sleep30-21swapper/319:10:013
38743892102,5sleep30-21swapper/321:00:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional