You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 05:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 24, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41960923790,2sleep30-21swapper/323:35:223
152841997267,4cyclictest457841-21kworker/u8:2+flush-8:000:35:371
152841997264,6cyclictest239399-21kworker/u8:3+flush-8:021:35:391
152837997268,3cyclictest2983773-21kworker/u8:0+flush-8:020:35:380
152837997262,8cyclictest214936-21/usr/sbin/munin20:10:350
152837997167,3cyclictest427572-21kworker/u8:0+flush-8:023:50:380
152837997165,4cyclictest213805-21kworker/u8:1+events_unbound20:55:360
152841997064,5cyclictest213805-21kworker/u8:1+flush-8:021:00:361
152841997057,5cyclictest281867-21kworker/u8:0+flush-8:023:25:371
152837997062,6cyclictest264693-21/usr/sbin/munin21:00:380
152841996963,5cyclictest164382-21kworker/u8:3+events_unbound19:50:361
152841996963,4cyclictest281867-21kworker/u8:0+events_unbound22:10:351
152837996963,5cyclictest323470-21kworker/u8:1+events_unbound22:00:230
152841996864,3cyclictest373208-21kworker/u8:1+events_unbound23:35:181
152841996858,5cyclictest356308-21kworker/u8:3+events_unbound22:30:371
152841996857,6cyclictest457841-21kworker/u8:2+events_unbound00:30:301
152837996862,4cyclictest356308-21kworker/u8:3+events_unbound23:05:290
152837996862,4cyclictest274550-21kworker/u8:2+events_unbound21:10:340
152841996761,5cyclictest239399-21kworker/u8:3+flush-8:020:50:201
152841996760,5cyclictest213805-21kworker/u8:1+flush-8:020:15:321
152837996763,3cyclictest356308-21kworker/u8:3+flush-8:023:00:380
152837996763,3cyclictest356308-21kworker/u8:3+events_unbound22:45:360
152837996759,5cyclictest204833-21latency_hist20:00:010
152841996661,3cyclictest427572-21kworker/u8:0+events_unbound23:55:341
152845996558,5cyclictest373208-21kworker/u8:1+flush-8:022:55:382
152837996561,3cyclictest184906-21kworker/u8:2+flush-8:020:05:450
152837996561,3cyclictest184906-21kworker/u8:2+events_unbound20:30:390
152841996458,5cyclictest323470-21kworker/u8:1+flush-8:022:00:351
152841996454,5cyclictest213805-21kworker/u8:1+events_unbound21:30:361
152837996459,4cyclictest418743-21kworker/u8:3+events_unbound00:05:210
152837996459,4cyclictest356308-21kworker/u8:3+events_unbound22:30:390
152837996459,4cyclictest213805-21kworker/u8:1+flush-8:020:25:210
152837996359,3cyclictest394182-21kworker/u8:2+events_unbound23:35:340
152837996358,4cyclictest213805-21kworker/u8:1+events_unbound20:20:180
152837996358,4cyclictest184906-21kworker/u8:2+events_unbound20:00:320
152837996358,3cyclictest338303-21kworker/u8:2+events_unbound22:15:190
152837996356,5cyclictest418743-21kworker/u8:3+events_unbound00:25:360
152841996256,4cyclictest323470-21kworker/u8:1+events_unbound22:20:201
152837996258,3cyclictest239399-21kworker/u8:3+events_unbound21:20:360
152841996155,5cyclictest281867-21kworker/u8:0+flush-8:021:25:361
152841996154,5cyclictest281867-21kworker/u8:0+flush-8:021:45:321
152841996154,5cyclictest281867-21kworker/u8:0+flush-8:021:45:311
152837996157,3cyclictest239399-21kworker/u8:3+events_unbound21:15:390
152837996156,3cyclictest427572-21kworker/u8:0+events_unbound00:15:280
152837996151,3cyclictest281867-21kworker/u8:0+events_unbound23:30:250
152841996056,3cyclictest179397-21kworker/u8:1+flush-8:019:35:211
152841996055,4cyclictest418743-21kworker/u8:3+flush-8:023:40:311
152841996050,4cyclictest51136-21kworker/u8:2+events_unbound19:10:331
152837996056,3cyclictest239399-21kworker/u8:3+events_unbound21:05:190
152837996055,3cyclictest281867-21kworker/u8:0+events_unbound23:25:380
152841995952,5cyclictest281867-21kworker/u8:0+events_unbound22:05:341
152837995956,2cyclictest418743-21kworker/u8:3+events_unbound00:35:360
152837995955,3cyclictest443350-21kworker/u8:1+events_unbound00:00:230
152837995955,3cyclictest427572-21kworker/u8:0+flush-8:000:20:220
152837995955,3cyclictest323470-21kworker/u8:1+events_unbound22:20:340
152837995954,4cyclictest427572-21kworker/u8:0+flush-8:023:55:230
152837995952,3cyclictest281867-21kworker/u8:0+events_unbound21:45:360
152837995952,3cyclictest281867-21kworker/u8:0+events_unbound21:45:350
152841995852,4cyclictest338303-21kworker/u8:2+flush-8:022:25:231
152837995854,3cyclictest2983773-21kworker/u8:0+flush-8:020:45:230
152837995854,3cyclictest213805-21kworker/u8:1+events_unbound20:50:350
152837995854,3cyclictest184906-21kworker/u8:2+events_unbound20:15:200
152837995853,4cyclictest2983773-21kworker/u8:0+events_unbound19:40:300
152841995753,3cyclictest2983773-21kworker/u8:0+events_unbound20:10:331
152841995752,4cyclictest338303-21kworker/u8:2+flush-8:022:40:211
152841995751,4cyclictest213805-21kworker/u8:1+flush-8:020:55:321
152841995751,4cyclictest213805-21kworker/u8:1+events_unbound21:15:221
152841995750,6cyclictest213805-21kworker/u8:1+flush-8:021:20:331
152841995749,6cyclictest178527-21ntpq19:30:301
152837995753,3cyclictest281867-21kworker/u8:0+events_unbound21:40:410
152837995753,3cyclictest281867-21kworker/u8:0+events_unbound21:40:400
152837995751,4cyclictest2983773-21kworker/u8:0+events_unbound19:15:050
152837995750,5cyclictest164382-21kworker/u8:3+events_unbound19:45:330
152845995651,3cyclictest373208-21kworker/u8:1+events_unbound23:15:342
152845995651,3cyclictest281867-21kworker/u8:0+flush-8:022:45:222
152841995649,6cyclictest394182-21kworker/u8:2+flush-8:023:50:331
152841995649,4cyclictest356308-21kworker/u8:3+flush-8:023:05:371
152837995652,3cyclictest51136-21kworker/u8:2+flush-8:019:30:210
152837995651,4cyclictest427572-21kworker/u8:0+events_unbound23:45:330
152837995651,4cyclictest338303-21kworker/u8:2+events_unbound22:35:360
152837995651,4cyclictest213805-21kworker/u8:1+events_unbound21:30:410
152841995548,6cyclictest356308-21kworker/u8:3+flush-8:023:00:211
152841995548,5cyclictest184906-21kworker/u8:2+events_unbound20:30:351
152841995546,6cyclictest1704890-21systemd-journal00:10:261
152845995450,3cyclictest427572-21kworker/u8:0+flush-8:000:05:322
152845995448,4cyclictest281867-21kworker/u8:0+flush-8:023:20:222
152845995448,4cyclictest281867-21kworker/u8:0+flush-8:021:30:232
152841995449,4cyclictest281867-21kworker/u8:0+flush-8:023:30:201
152837995450,3cyclictest164382-21kworker/u8:3+flush-8:019:35:370
152845995344,6cyclictest1704890-21systemd-journal20:10:002
152841995348,3cyclictest2983773-21kworker/u8:0+flush-8:020:35:321
152841995346,5cyclictest427572-21kworker/u8:0+flush-8:000:05:381
152841995343,7cyclictest408412-21apt-get23:25:011
152837995347,4cyclictest239399-21kworker/u8:3+events_unbound21:35:320
152845995246,4cyclictest281867-21kworker/u8:0+flush-8:023:30:312
152841995248,3cyclictest164382-21kworker/u8:3+events_unbound19:45:201
152841995246,4cyclictest338303-21kworker/u8:2+flush-8:022:35:341
152841995246,4cyclictest164382-21kworker/u8:3+events_unbound19:25:211
152837995248,3cyclictest51136-21kworker/u8:2+events_unbound19:10:190
152845995147,3cyclictest239399-21kworker/u8:3+flush-8:020:40:312
152841995145,4cyclictest281867-21kworker/u8:0+events_unbound21:40:391
152841995145,4cyclictest281867-21kworker/u8:0+events_unbound21:40:381
152837995140,8cyclictest399043-21diskstats23:15:220
4317362500,2sleep375-21kworker/3:1-events23:45:273
3971832500,1sleep0397188-21grep23:10:270
152845995046,3cyclictest394182-21kworker/u8:2+flush-8:023:45:302
152837995046,3cyclictest457841-21kworker/u8:2+flush-8:000:30:300
152837995045,4cyclictest373208-21kworker/u8:1+flush-8:022:55:330
152837995043,5cyclictest328783-21kworker/u8:3+events_unbound22:10:010
152845994939,8cyclictest1704890-21systemd-journal21:29:592
152841994944,4cyclictest2983773-21kworker/u8:0+events_unbound19:15:021
152841994943,4cyclictest443350-21kworker/u8:1+events_unbound00:00:211
152837994942,5cyclictest164382-21kworker/u8:3+events_unbound19:30:000
3365272480,4sleep30-21swapper/322:10:263
152845994843,3cyclictest281867-21kworker/u8:0+flush-8:021:50:302
152845994842,4cyclictest239399-21kworker/u8:3+events_unbound21:05:222
152841994844,3cyclictest418743-21kworker/u8:3+events_unbound00:15:211
152837994844,3cyclictest427572-21kworker/u8:0+events_unbound00:10:250
152841994742,4cyclictest2983773-21kworker/u8:0+flush-8:019:40:371
1669452460,2sleep3471rcuc/319:20:263
152845994641,4cyclictest418743-21kworker/u8:3+events_unbound00:00:352
152841994643,2cyclictest239399-21kworker/u8:3+events_unbound21:05:341
152841994642,3cyclictest356308-21kworker/u8:3+events_unbound22:50:211
152837994642,3cyclictest213805-21kworker/u8:1+events_unbound21:25:230
152837994632,4cyclictest281867-21kworker/u8:0+events_unbound21:57:250
152845994537,6cyclictest1704890-21systemd-journal21:40:002
152841994539,4cyclictest184906-21kworker/u8:2+events_unbound20:25:491
152841994538,5cyclictest1704890-21systemd-journal23:49:251
152841994534,8cyclictest1704890-21systemd-journal20:45:481
152837994541,3cyclictest281867-21kworker/u8:0+events_unbound21:50:210
4085182440,2chrt201rcuc/023:25:010
152845994438,4cyclictest213805-21kworker/u8:1+flush-8:020:20:282
152841994439,4cyclictest184906-21kworker/u8:2+events_unbound19:55:361
152841994438,4cyclictest213805-21kworker/u8:1+events_unbound20:20:191
152841994434,8cyclictest322881-21ntpq21:55:451
152837994440,3cyclictest394182-21kworker/u8:2+events_unbound23:40:220
152837994436,6cyclictest378488-21latency_hist22:55:000
152837994436,3cyclictest323470-21kworker/u8:1+events_unbound22:14:530
152841994338,4cyclictest281867-21kworker/u8:0+events_unbound23:10:191
152841994338,3cyclictest457841-21kworker/u8:2+events_unbound00:30:011
152837994339,3cyclictest51136-21kworker/u8:2+flush-8:019:20:420
152841994238,3cyclictest239399-21kworker/u8:3+events_unbound20:40:411
152841994236,4cyclictest164382-21kworker/u8:3+events_unbound20:05:341
152841994235,6cyclictest51136-21kworker/u8:2+events_unbound19:20:211
152837994238,3cyclictest281867-21kworker/u8:0+events_unbound22:40:370
152845994136,4cyclictest373208-21kworker/u8:1+flush-8:022:50:322
152845994035,4cyclictest51136-21kworker/u8:2+flush-8:019:20:332
152845994032,6cyclictest393728-21base6423:10:012
152837994035,4cyclictest239399-21kworker/u8:3+flush-8:020:40:310
152841993935,3cyclictest281867-21kworker/u8:0+events_unbound23:15:201
152837993927,3cyclictest338303-21kworker/u8:2+events_unbound22:26:200
152845993833,3cyclictest1704890-21systemd-journal19:50:002
152845993832,4cyclictest457841-21kworker/u8:2+events_unbound00:30:412
152837993831,5cyclictest164382-21kworker/u8:3+events_unbound19:50:180
152845993631,4cyclictest338303-21kworker/u8:2+flush-8:022:25:272
152841993632,3cyclictest184906-21kworker/u8:2+events_unbound20:00:261
152841993529,4cyclictest338914-21apt-get22:15:161
152845993430,3cyclictest281867-21kworker/u8:0+events_unbound23:10:352
152841993430,3cyclictest274550-21kworker/u8:2+flush-8:021:11:021
152845993328,3cyclictest189829-21latency_hist19:45:012
152845993328,3cyclictest157749-21turbostat.cron19:15:012
3630282310,5sleep2371rcuc/222:35:392
152845993127,3cyclictest259046-21unixbench_multi20:50:382
152845993122,7cyclictest209789-21turbostat.cron20:05:012
152845993122,7cyclictest1704890-21systemd-journal23:04:592
152841993026,3cyclictest457841-21kworker/u8:2+flush-8:000:20:311
152841993025,4cyclictest281867-21kworker/u8:0+events_unbound22:45:321
4398202290,5sleep30-21swapper/323:55:263
152841992826,1cyclictest298721-21kworker/u8:2+events_unbound21:50:391
152841992824,3cyclictest373208-21kworker/u8:1+events_unbound22:55:401
152845992722,4cyclictest323470-21kworker/u8:1+flush-8:022:06:072
152845992722,4cyclictest239399-21kworker/u8:3+events_unbound20:38:142
152845992623,2cyclictest215180-21cpuspeed_turbos20:10:202
152845992621,4cyclictest427572-21kworker/u8:0+flush-8:000:35:542
152845992621,3cyclictest339227-21fschecks_time22:15:212
152845992621,3cyclictest309353-21aten2_r5power_p21:45:202
152845992621,3cyclictest309353-21aten2_r5power_p21:45:202
152845992522,2cyclictest324181-21aten2_r5power_v22:00:232
152845992520,3cyclictest368228-21unixbench_singl22:40:372
152845992519,4cyclictest0-21swapper/219:20:002
152845992519,1cyclictest161rcu_preempt20:30:312
152845992517,6cyclictest184423-21apt-get19:40:012
152845992421,2cyclictest274941-21fschecks_time21:10:222
152845992419,4cyclictest427572-21kworker/u8:0+events_unbound23:50:062
152845992419,3cyclictest0-21swapper/200:15:002
15284599241,6cyclictest3379862python322:10:362
15284599235,16cyclictest289213-21turbostat.cron21:25:002
152845992318,4cyclictest338303-21kworker/u8:2+events_unbound22:24:482
152845992315,6cyclictest442522-21grep23:55:352
1526252232,15sleep00-21swapper/019:09:330
152845992218,2cyclictest0-21swapper/221:20:002
152845992216,4cyclictest229837-21apt-get20:25:192
152845992215,5cyclictest0-21swapper/200:15:032
152845992214,6cyclictest170178-21fschecks_time19:25:212
152845992212,8cyclictest250224-21fschecks_time20:45:222
15284599215,4cyclictest0-21swapper/221:00:202
15284599214,15cyclictest467392-21ntpq00:20:292
15284599212,1cyclictest0-21swapper/221:40:412
15284599212,1cyclictest0-21swapper/221:40:402
15284599212,13cyclictest219899-21apt-get20:15:202
152845992114,2cyclictest161rcu_preempt19:30:222
1523952214,11sleep10-21swapper/119:06:331
152845992016,2cyclictest0-21swapper/219:55:192
15284599201,4cyclictest4196142irqrtprio23:35:232
15284599197,3cyclictest371rcuc/200:25:282
152845991915,3cyclictest418743-21kworker/u8:3+events_unbound23:41:292
152845991914,3cyclictest259773-21aten2_r5power_c20:55:202
1477652194,9sleep20-21swapper/219:05:022
15284599185,2cyclictest0-21swapper/219:52:292
1480022182,8sleep30-21swapper/319:05:033
2257992170,2sleep3471rcuc/320:20:233
15284599179,6cyclictest320273-21tr21:55:402
15284599178,7cyclictest409540-21sed23:25:262
152845991613,2cyclictest0-21swapper/222:30:222
4484842133,6sleep30-21swapper/300:05:013
4145362132,7sleep30-21swapper/323:30:273
3637322132,6sleep30-21swapper/322:40:023
3540102132,6sleep30-21swapper/322:30:033
3287802132,6sleep30-21swapper/322:05:023
3142592132,6sleep30-21swapper/321:50:213
3078802132,7sleep30-21swapper/321:40:343
3078802132,7sleep30-21swapper/321:40:333
2743012132,7sleep30-21swapper/321:10:003
4788902122,6sleep30-21swapper/300:35:243
4745572122,6sleep30-21swapper/300:30:273
4686042122,6sleep30-21swapper/300:25:203
4577742122,6sleep30-21swapper/300:10:433
4439712122,6sleep30-21swapper/300:00:253
4340472122,6sleep30-21swapper/323:50:243
4235172122,6sleep30-21swapper/323:40:023
4037532122,6sleep30-21swapper/323:20:183
3985402122,5sleep30-21swapper/323:15:023
3960722122,6sleep30-21swapper/323:10:283
3885372122,6sleep30-21swapper/323:05:023
3837472121,7sleep30-21swapper/323:00:203
3592282120,8sleep30-21swapper/322:35:243
3386322122,5sleep30-21swapper/322:15:023
3240422122,6sleep30-21swapper/322:00:213
2997082122,6sleep30-21swapper/321:35:253
2890322122,6sleep30-21swapper/321:22:483
2794002122,5sleep30-21swapper/321:15:023
2749942122,6sleep30-21swapper/321:10:233
2689452122,6sleep30-21swapper/321:00:413
2545612122,5sleep30-21swapper/320:50:023
2393262122,6sleep30-21swapper/320:33:483
2295722122,5sleep30-21swapper/320:25:003
2197182122,6sleep30-21swapper/320:15:023
2187552122,6sleep30-21swapper/320:10:333
2001712122,6sleep30-21swapper/319:55:203
1949362122,6sleep30-21swapper/319:50:013
1851902122,6sleep30-21swapper/319:40:233
1833492122,6sleep30-21swapper/319:35:283
1695932122,5sleep30-21swapper/319:25:023
1575072122,6sleep30-21swapper/319:12:013
4675182112,5sleep30-21swapper/300:20:353
4582212111,5sleep30-21swapper/300:15:013
4134502112,5sleep30-21swapper/323:28:503
3795562112,5sleep30-21swapper/322:55:273
3737932112,5sleep30-21swapper/322:50:173
3689052111,6sleep30-21swapper/322:45:193
3495272112,5sleep30-21swapper/322:25:243
3445292112,5sleep30-21swapper/322:20:273
3191142112,5sleep30-21swapper/321:55:183
3096462112,6sleep30-21swapper/321:45:243
3096462112,6sleep30-21swapper/321:45:243
2990502112,6sleep30-21swapper/321:34:593
2892322112,5sleep30-21swapper/321:25:013
2606242112,5sleep30-21swapper/320:55:263
2498782112,6sleep30-21swapper/320:45:203
2489342112,5sleep30-21swapper/320:40:383
2397112112,6sleep30-21swapper/320:35:213
2100092112,5sleep30-21swapper/320:05:023
2095882112,5sleep30-21swapper/320:02:383
1905962112,5sleep30-21swapper/319:45:243
1792202112,6sleep30-21swapper/319:32:003
1608452112,5sleep30-21swapper/319:15:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional