You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 07:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Jun 18, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
167497821920,3sleep375-21kworker/3:1+events21:40:013
17363122800,2sleep20-21swapper/222:40:312
15758752710,5sleep1281rcuc/120:00:261
1523574996964,4cyclictest1528683-21kworker/u8:1+events_unbound20:20:391
1523574996662,3cyclictest1555495-21kworker/u8:2+events_unbound22:00:351
1523574996559,4cyclictest1471125-21kworker/u8:0+flush-8:019:55:441
1523574996459,4cyclictest1662536-21kworker/u8:1+flush-8:021:35:421
1523574996459,4cyclictest1649359-21kworker/u8:4+events_unbound21:25:411
1523574996458,3cyclictest1704072-21kworker/u8:3+events_unbound23:40:401
1523574996458,3cyclictest1704072-21kworker/u8:3+events_unbound23:40:401
1523574996457,5cyclictest1555495-21kworker/u8:2+flush-8:021:20:381
1523574996453,5cyclictest1815704-21kworker/u8:4+flush-8:000:10:301
1523574996356,6cyclictest1555495-21kworker/u8:2+events_unbound21:15:371
1523572996254,6cyclictest1662536-21kworker/u8:1+flush-8:023:15:350
1523574996155,4cyclictest1704890-21systemd-journal19:10:271
1523574996155,4cyclictest1471125-21kworker/u8:0+events_unbound20:15:351
1523574996053,5cyclictest1754736-21kworker/u8:0+flush-8:000:00:371
1523574996053,5cyclictest1754736-21kworker/u8:0+flush-8:000:00:371
1523574996052,6cyclictest1704890-21systemd-journal21:10:271
1523574995953,4cyclictest1754736-21kworker/u8:0+flush-8:023:30:261
1523574995953,4cyclictest1704072-21kworker/u8:3+events_unbound22:30:341
1523574995952,5cyclictest1704072-21kworker/u8:3+flush-8:022:15:391
1523574995952,5cyclictest1599817-21kworker/u8:3+flush-8:020:35:371
1523574995952,5cyclictest1599817-21kworker/u8:3+flush-8:020:35:361
1523574995853,3cyclictest1629254-21kworker/u8:0+events_unbound21:50:371
1523574995852,3cyclictest1629254-21kworker/u8:0+events_unbound21:55:251
1523574995851,5cyclictest1704072-21kworker/u8:3+events_unbound23:10:271
1523574995851,5cyclictest1629254-21kworker/u8:0+flush-8:020:55:291
1523574995850,6cyclictest1528683-21kworker/u8:1+flush-8:019:15:361
1523577995752,3cyclictest1629254-21kworker/u8:0+events_unbound21:05:362
1523574995753,3cyclictest1555495-21kworker/u8:2+events_unbound20:30:421
1523574995753,3cyclictest1555495-21kworker/u8:2+events_unbound20:30:421
1523574995752,4cyclictest1599817-21kworker/u8:3+events_unbound20:25:261
1523574995744,10cyclictest1704890-21systemd-journal19:20:271
16210182560,2sleep20-21swapper/220:45:292
1523577995652,3cyclictest1815704-21kworker/u8:4+events_unbound00:00:432
1523577995652,3cyclictest1815704-21kworker/u8:4+events_unbound00:00:422
1523574995650,4cyclictest1704072-21kworker/u8:3+events_unbound23:05:241
1523574995649,5cyclictest1815704-21kworker/u8:4+events_unbound00:15:371
1523574995551,3cyclictest1662536-21kworker/u8:1+events_unbound22:40:391
1523574995550,4cyclictest1662536-21kworker/u8:1+events_unbound23:35:371
1523574995547,6cyclictest1662536-21kworker/u8:1+flush-8:023:50:361
1523574995546,6cyclictest1704890-21systemd-journal22:50:281
1523574995544,7cyclictest1704890-21systemd-journal20:10:271
1523574995449,4cyclictest1599817-21kworker/u8:3+events_unbound21:05:411
1523574995449,4cyclictest1555495-21kworker/u8:2+events_unbound21:45:391
1523574995448,4cyclictest1629254-21kworker/u8:0+events_unbound22:05:361
1523574995448,3cyclictest1662536-21kworker/u8:1+events_unbound22:10:261
1523574995447,5cyclictest1754736-21kworker/u8:0+events_unbound00:05:281
1523574995447,5cyclictest1704072-21kworker/u8:3+events_unbound23:00:361
1523577995248,3cyclictest1662536-21kworker/u8:1+events_unbound22:50:352
1523577995248,3cyclictest1528683-21kworker/u8:1+events_unbound20:20:432
1523574995246,4cyclictest1528683-21kworker/u8:1+events_unbound19:25:401
1523572995246,4cyclictest1471125-21kworker/u8:0+flush-8:019:45:290
1523577995147,3cyclictest1555495-21kworker/u8:2+events_unbound21:45:452
1523574995145,4cyclictest1704072-21kworker/u8:3+events_unbound22:25:281
1523572995141,8cyclictest1619336-21ntpq20:40:350
1523577995044,4cyclictest1575276-21gpgv20:00:002
1523574995044,5cyclictest1754736-21kworker/u8:0+events_unbound23:55:391
1523574995044,5cyclictest1754736-21kworker/u8:0+events_unbound23:55:381
1523574995044,4cyclictest1754736-21kworker/u8:0+events_unbound23:20:251
1523574995044,4cyclictest1599817-21kworker/u8:3+flush-8:020:45:321
1523574995044,4cyclictest1599817-21kworker/u8:3+events_unbound20:50:241
1523574995042,6cyclictest1528683-21kworker/u8:1+events_unbound19:50:251
1523574995042,6cyclictest1528683-21kworker/u8:1+events_unbound19:50:241
1523574994943,5cyclictest1555495-21kworker/u8:2+events_unbound22:45:381
1523572994945,3cyclictest1704072-21kworker/u8:3+events_unbound22:15:420
1523572994941,6cyclictest1599233-21ntpq20:20:330
1523574994841,5cyclictest1662536-21kworker/u8:1+events_unbound21:30:421
1523574994740,5cyclictest1555495-21kworker/u8:2+events_unbound22:55:271
1523572994738,7cyclictest1614345-21ntpq20:35:330
1523572994738,7cyclictest1614345-21ntpq20:35:330
1523574994641,3cyclictest1844318-21kworker/u8:1+events_unbound00:30:301
1523574994641,3cyclictest1599817-21kworker/u8:3+events_unbound20:45:011
1523572994640,4cyclictest1699958-21apt-get22:05:210
1523572994637,7cyclictest1540444-21apt-get19:24:590
1523572994637,6cyclictest1844293-21base6400:30:020
1523572994636,8cyclictest1838024-21ntpq00:20:350
1523574994541,3cyclictest1754736-21kworker/u8:0+events_unbound00:20:381
1523574994540,4cyclictest1815704-21kworker/u8:4+flush-8:000:35:261
1523574994540,4cyclictest1528683-21kworker/u8:1+events_unbound19:45:321
1523574994538,5cyclictest1662536-21kworker/u8:1+flush-8:022:35:371
1523574994440,3cyclictest1754736-21kworker/u8:0+events_unbound00:25:401
1523574994440,3cyclictest1528683-21kworker/u8:1+flush-8:019:40:401
1523574994339,3cyclictest1754736-21kworker/u8:0+flush-8:023:15:261
1523574994339,3cyclictest1528683-21kworker/u8:1+events_unbound20:05:261
1523574994338,4cyclictest1754736-21kworker/u8:0+flush-8:023:25:431
1523572994338,4cyclictest1662536-21kworker/u8:1+flush-8:023:55:300
1523572994338,4cyclictest1662536-21kworker/u8:1+flush-8:023:55:300
1523577994238,3cyclictest1555495-21kworker/u8:2+events_unbound20:35:262
1523577994238,3cyclictest1555495-21kworker/u8:2+events_unbound20:35:252
1523577994237,4cyclictest1555495-21kworker/u8:2+events_unbound22:55:462
1523572994237,3cyclictest1528683-21kworker/u8:1+flush-8:019:50:310
1523572994237,3cyclictest1528683-21kworker/u8:1+flush-8:019:50:300
1523572994234,6cyclictest1679051-21ntpq21:40:370
1523577994136,4cyclictest1815704-21kworker/u8:4+events_unbound00:20:462
1523572994135,4cyclictest1471125-21kworker/u8:0+flush-8:020:05:380
1523572994134,5cyclictest1754736-21kworker/u8:0+events_unbound23:20:350
1523577994036,3cyclictest1528683-21kworker/u8:1+flush-8:019:50:332
1523577994036,3cyclictest1528683-21kworker/u8:1+flush-8:019:50:322
1523574994036,3cyclictest1662536-21kworker/u8:1+events_unbound23:45:401
1523574994036,3cyclictest1629254-21kworker/u8:0+flush-8:021:40:271
1523572994036,3cyclictest1555495-21kworker/u8:2+events_unbound21:55:390
1523572994031,7cyclictest1654263-21ntpq21:15:350
1523572993934,4cyclictest1528683-21kworker/u8:1+flush-8:019:19:590
1523572993932,5cyclictest1704890-21systemd-journal23:11:230
1523572993830,6cyclictest1528683-21kworker/u8:1+flush-8:019:35:350
1523572993828,8cyclictest1688873-21ntpq21:50:330
1523574993728,7cyclictest1639142-21ntpq21:00:341
1523572993732,4cyclictest1665669-21sshd21:30:260
1523572993731,5cyclictest1815704-21kworker/u8:4+flush-8:000:10:310
1523572993728,7cyclictest1818262-21ntpq00:00:370
1523572993728,7cyclictest1818262-21ntpq00:00:370
1523577993630,4cyclictest1754736-21kworker/u8:0+events_unbound00:10:092
1523574993632,3cyclictest1555495-21kworker/u8:2+events_unbound22:22:301
1523572993626,4cyclictest1528683-21kworker/u8:1+flush-8:020:45:280
1523572993531,3cyclictest1555495-21kworker/u8:2+flush-8:021:20:380
1523572993530,3cyclictest1555495-21kworker/u8:2+events_unbound22:50:420
1523577993425,6cyclictest1704890-21systemd-journal22:00:002
1523574993422,6cyclictest1528683-21kworker/u8:1+events_unbound19:35:321
1523572993423,9cyclictest1719683-21apt-get22:25:030
1523572993423,9cyclictest1559580-21ntpq19:40:370
1523577993327,4cyclictest1662536-21kworker/u8:1+events_unbound21:35:022
1523572993328,3cyclictest1823139-21needreboot00:05:370
1523572993310,21cyclictest1605372-21kworker/0:0+events22:44:580
1523577993227,3cyclictest1662536-21kworker/u8:1+events_unbound23:55:062
1523577993227,3cyclictest1662536-21kworker/u8:1+events_unbound23:55:062
1523572993228,3cyclictest1599817-21kworker/u8:3+flush-8:021:05:420
1523572993227,4cyclictest1754736-21kworker/u8:0+flush-8:023:30:250
1523572993227,4cyclictest1528683-21kworker/u8:1+events_unbound20:50:350
1523572993226,5cyclictest1649359-21kworker/u8:4+events_unbound21:25:350
1523572993226,4cyclictest1662536-21kworker/u8:1+events_unbound22:35:250
1523572993224,7cyclictest1528683-21kworker/u8:1+events_unbound19:55:380
1523572993222,8cyclictest1843852-21latency_hist00:30:010
1523577993127,3cyclictest1662536-21kworker/u8:1+events_unbound22:38:362
1523577993127,3cyclictest1599817-21kworker/u8:3+events_unbound20:50:182
1523577993127,3cyclictest1555495-21kworker/u8:2+events_unbound21:15:072
1523572993129,1cyclictest1704072-21kworker/u8:3+events_unbound23:40:010
1523572993126,3cyclictest1555495-21kworker/u8:2+flush-8:020:55:430
1523572993125,4cyclictest1528683-21kworker/u8:1+flush-8:020:10:320
16054472300,3sleep2371rcuc/220:30:002
1523577993026,2cyclictest1780540-21kthreadcore23:25:312
1523577993020,2cyclictest161rcu_preempt21:25:242
1523572993026,3cyclictest1471125-21kworker/u8:0+events_unbound19:25:300
1523572993024,4cyclictest1815704-21kworker/u8:4+flush-8:000:35:410
1523572993024,4cyclictest1704072-21kworker/u8:3+flush-8:022:30:320
1523572993024,4cyclictest1555495-21kworker/u8:2+flush-8:022:45:380
1523577992925,3cyclictest1629254-21kworker/u8:0+events_unbound21:11:422
1523572992925,3cyclictest1662536-21kworker/u8:1+events_unbound21:35:440
1523572992922,3cyclictest0-21swapper/020:00:230
1523577992824,3cyclictest1704072-21kworker/u8:3+events_unbound23:34:442
1523577992823,4cyclictest1555495-21kworker/u8:2+flush-8:021:50:322
1523574992821,5cyclictest1545886-21apt-get19:30:221
1523572992823,4cyclictest1650195-21cron21:15:010
1523572992823,4cyclictest1555495-21kworker/u8:2+events_unbound22:20:300
1523572992822,5cyclictest1629254-21kworker/u8:0+events_unbound21:00:400
1523572992820,6cyclictest1704072-21kworker/u8:3+flush-8:022:10:370
1523572992819,6cyclictest1784272-21latency_hist23:30:010
1523577992724,2cyclictest1769762-21aten2_r5power_p23:15:252
1523577992723,2cyclictest1695083-21aten2_r5power_e22:00:242
1523572992723,3cyclictest1759063-21unixbench_multi23:00:430
1523572992722,4cyclictest1555495-21kworker/u8:2+events_unbound21:45:410
1523572992722,4cyclictest1528683-21kworker/u8:1+flush-8:019:30:430
1523577992622,3cyclictest1528683-21kworker/u8:1+events_unbound19:40:002
1523577992622,2cyclictest1639629-21unixbench_multi21:00:422
1523577992619,2cyclictest161rcu_preempt20:05:242
1523572992622,3cyclictest1343711-21kworker/u8:2+events_unbound19:10:460
1523572992621,4cyclictest1555495-21kworker/u8:2+flush-8:020:30:310
1523572992621,4cyclictest1555495-21kworker/u8:2+flush-8:020:30:300
1523572992621,3cyclictest1754736-21kworker/u8:0+events_unbound23:55:000
1523577992519,4cyclictest1743647-21needreboot22:45:352
1523577992518,5cyclictest1704890-21systemd-journal19:40:002
1523572992522,2cyclictest1704072-21kworker/u8:3+events_unbound23:45:310
1523572992520,3cyclictest1698994-21runrttasks22:00:400
1523572992519,4cyclictest1471125-21kworker/u8:0+events_unbound20:15:390
1523577992421,2cyclictest1615918-21fschecks_time20:40:282
1523577992420,2cyclictest1541012-21aten2_r5power_e19:25:252
1523577992419,4cyclictest1799131-21idleruntime-cro23:45:002
1523577992419,4cyclictest1799131-21idleruntime-cro23:45:002
1523577992419,3cyclictest371rcuc/219:20:332
1523577992419,3cyclictest1719308-21unixbench_singl22:20:422
1523577992414,2cyclictest161rcu_preempt22:15:312
152357799240,14cyclictest1833954-21cron00:20:012
1523572992419,4cyclictest1754736-21kworker/u8:0+flush-8:023:07:570
1523572992419,4cyclictest1754736-21kworker/u8:0+flush-8:000:15:430
1523572992418,4cyclictest1704072-21kworker/u8:3+flush-8:023:40:370
1523572992418,4cyclictest1704072-21kworker/u8:3+flush-8:023:40:360
152357799237,3cyclictest161rcu_preempt21:00:012
152357799236,2cyclictest161rcu_preempt00:35:402
1523577992319,2cyclictest0-21swapper/222:10:422
152357799230,6cyclictest1679934-21apt21:45:002
1523572992319,3cyclictest1528683-21kworker/u8:1+events_unbound20:25:450
1523577992219,2cyclictest1769013-21unixbench_singl23:10:442
1523577992215,5cyclictest1803674-21grep23:45:412
152357799220,11cyclictest1546773-21taskset19:30:302
1523572992217,4cyclictest1555495-21kworker/u8:2+events_unbound22:55:360
15233352224,11sleep10-21swapper/119:09:091
152357799212,4cyclictest0-21swapper/223:05:312
152357799212,2cyclictest0-21swapper/222:25:402
1523577992118,2cyclictest1605691-21aten2_r5power_p20:30:252
1523577992118,2cyclictest1605691-21aten2_r5power_p20:30:252
152357799211,3cyclictest1843855-21munin-run00:30:002
1523577992112,2cyclictest161rcu_preempt00:05:332
152357799210,12cyclictest1667873-21cut21:30:332
152357799210,11cyclictest1843842-21apt-get00:30:032
152357799204,8cyclictest0-21swapper/219:10:252
152357799203,8cyclictest1703680-21seq22:05:342
152357799202,9cyclictest0-21swapper/223:35:282
152357799202,4cyclictest0-21swapper/222:30:312
152357799201,9cyclictest1586360-21tr20:10:282
152357799201,3cyclictest1807648-21seq23:50:322
152357799201,10cyclictest1591296-21cut20:15:302
152357799200,18cyclictest1564392-21needreboot19:45:362
152357799200,10cyclictest1535043-21grep19:15:432
15187682204,10sleep20-21swapper/219:05:052
15187642202,8sleep30-21swapper/319:05:033
152357799193,5cyclictest0-21swapper/223:00:132
152357799192,9cyclictest0-21swapper/223:20:282
152357799191,6cyclictest0-21swapper/221:20:362
15187712192,12sleep00-21swapper/019:05:080
152357799183,5cyclictest0-21swapper/220:00:322
16241552152,9sleep30-21swapper/320:45:363
15604432140,10sleep30-21swapper/319:45:003
16997102132,6sleep30-21swapper/322:05:023
16749782132,6sleep30-21swapper/321:40:013
16651692132,6sleep30-21swapper/321:30:023
16594922134,5sleep30-21swapper/321:20:433
15945382132,7sleep30-21swapper/320:15:423
15853432132,7sleep30-21swapper/320:10:003
18492792122,5sleep30-21swapper/300:35:033
18400992122,6sleep30-21swapper/300:25:323
18339482122,5sleep30-21swapper/300:20:023
18296962122,6sleep30-21swapper/300:15:273
18286982122,6sleep30-21swapper/300:10:463
18191342122,6sleep30-21swapper/300:05:013
18130122122,6sleep30-21swapper/323:55:383
18130122122,6sleep30-21swapper/323:55:383
18082442122,6sleep30-21swapper/323:50:393
18036702122,6sleep30-21swapper/323:45:433
17885692122,6sleep30-21swapper/323:30:423
17748982122,6sleep30-21swapper/323:20:253
17696802122,6sleep30-21swapper/323:15:253
17652392122,6sleep30-21swapper/323:10:313
17550462122,6sleep30-21swapper/323:00:283
17541652122,6sleep30-21swapper/322:56:023
17399332122,5sleep30-21swapper/322:45:023
17248722122,6sleep30-21swapper/322:30:013
17240372122,6sleep30-21swapper/322:25:403
17152902122,6sleep30-21swapper/322:20:273
16953982122,6sleep30-21swapper/322:00:283
16531832123,5sleep30-21swapper/321:15:343
16401782122,5sleep30-21swapper/321:05:013
16308832122,6sleep30-21swapper/320:55:313
16259172122,6sleep30-21swapper/320:50:283
16061322122,6sleep30-21swapper/320:30:313
16061322122,6sleep30-21swapper/320:30:313
16006712122,6sleep30-21swapper/320:25:243
15998722122,6sleep30-21swapper/320:21:283
15893872122,6sleep30-21swapper/320:10:353
15766552122,6sleep30-21swapper/320:00:333
15643052122,6sleep30-21swapper/319:45:353
15405362122,5sleep30-21swapper/319:25:003
15373292122,6sleep30-21swapper/319:20:323
18472112112,5sleep30-21swapper/300:30:323
18189252112,5sleep30-21swapper/300:02:203
18189252112,5sleep30-21swapper/300:02:193
17969922112,6sleep30-21swapper/323:40:333
17969922112,6sleep30-21swapper/323:40:323
17932392112,5sleep30-21swapper/323:35:353
17834512112,6sleep30-21swapper/323:25:403
17595042112,4sleep30-21swapper/323:05:003
17448972112,6sleep30-21swapper/322:50:243
17351082112,5sleep30-21swapper/322:40:253
17303652112,5sleep30-21swapper/322:35:283
17112372112,5sleep30-21swapper/322:15:323
17057802112,5sleep30-21swapper/322:10:323
16900212112,5sleep30-21swapper/321:55:013
16884932112,5sleep30-21swapper/321:50:333
16844032112,5sleep30-21swapper/321:45:433
16454622112,5sleep30-21swapper/321:10:163
16353942110,7sleep30-21swapper/321:00:253
16160212110,7sleep30-21swapper/320:40:303
16105592112,6sleep30-21swapper/320:35:203
16105592112,6sleep30-21swapper/320:35:193
15710692110,7sleep30-21swapper/319:55:303
15654612112,5sleep30-21swapper/319:50:023
15654612112,5sleep30-21swapper/319:50:023
15541682112,5sleep30-21swapper/319:35:333
15467732112,5sleep30-21swapper/319:30:313
15306342112,6sleep30-21swapper/319:15:063
15237302112,5sleep30-21swapper/319:10:243
16603712102,5sleep30-21swapper/321:25:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional