You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 16:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Jun 13, 2026 12:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59700021960,3sleep375-21kworker/3:1-events10:35:323
390757997165,4cyclictest705116-21kworker/u8:0+events_unbound12:25:451
390757997165,4cyclictest705116-21kworker/u8:0+events_unbound12:25:441
390757997164,4cyclictest546176-21kworker/u8:2+flush-8:011:00:461
390755996653,10cyclictest676296-21diskstats11:55:290
3951122630,7sleep30-21swapper/307:10:473
390757996356,5cyclictest660595-21kworker/u8:3+events_unbound12:00:321
390757996353,7cyclictest482091-21/usr/sbin/munin08:40:451
390757996258,3cyclictest546187-21kworker/u8:4+events_unbound09:45:461
390757996155,4cyclictest546176-21kworker/u8:2+events_unbound10:55:311
390755996051,6cyclictest427383-21latency_hist07:45:000
390757995955,3cyclictest417095-21kworker/u8:3+flush-8:008:05:311
390757995954,3cyclictest457054-21kworker/u8:0+events_unbound09:15:441
390757995953,4cyclictest556107-21kworker/u8:1+events_unbound10:10:011
390757995952,5cyclictest457054-21kworker/u8:0+flush-8:009:50:411
390757995951,6cyclictest586351-21kworker/u8:1+events_unbound10:30:431
390757995950,6cyclictest670859-21latency_hist11:50:011
390757995950,6cyclictest1704890-21systemd-journal09:45:001
390761995848,8cyclictest601155-21cp10:40:002
390757995854,3cyclictest586351-21kworker/u8:1+events_unbound10:35:381
390757995853,4cyclictest338991-21kworker/u8:2+flush-8:007:25:441
390757995751,4cyclictest546176-21kworker/u8:2+flush-8:010:20:411
3904142576,19sleep10-21swapper/107:07:401
390757995648,6cyclictest487045-21kworker/u8:2+events_unbound09:00:321
390757995648,6cyclictest487045-21kworker/u8:2+events_unbound09:00:311
390757995551,3cyclictest660595-21kworker/u8:3+flush-8:011:50:481
390757995550,4cyclictest457054-21kworker/u8:0+events_unbound08:35:301
390757995549,5cyclictest546187-21kworker/u8:4+events_unbound10:45:301
390757995549,5cyclictest546176-21kworker/u8:2+flush-8:011:10:411
390757995549,4cyclictest635871-21kworker/u8:1+events_unbound11:30:401
390757995445,7cyclictest401703-21ntpq07:15:421
390757995346,5cyclictest556107-21kworker/u8:1+events_unbound09:55:281
390757995345,6cyclictest490930-21ntpq08:45:431
390757995246,5cyclictest526916-21kworker/u8:1+events_unbound09:25:411
390757995246,5cyclictest3749718-21kworker/u8:4+events_unbound07:10:301
390757995245,5cyclictest338991-21kworker/u8:2+events_unbound07:55:401
390755995145,4cyclictest546187-21kworker/u8:4+events_unbound10:00:450
390755995145,4cyclictest417095-21kworker/u8:3+flush-8:008:05:330
390755995144,5cyclictest591378-21apt-get10:30:270
390755995139,9cyclictest636733-21diskstats11:15:310
5677092500,2chrt481ktimers/310:05:353
390757995045,4cyclictest338991-21kworker/u8:2+events_unbound08:10:481
390757995041,6cyclictest1704890-21systemd-journal09:05:491
390757995041,4cyclictest363011-21kworker/u8:1+events_unbound07:40:451
390755995046,3cyclictest457054-21kworker/u8:0+events_unbound09:50:470
390755995041,7cyclictest694636-21ntpq12:10:400
390755995041,7cyclictest694636-21ntpq12:10:400
390757994946,2cyclictest417095-21kworker/u8:3+flush-8:008:30:441
390757994943,5cyclictest457054-21kworker/u8:0+events_unbound08:20:411
390757994843,4cyclictest417095-21kworker/u8:3+events_unbound08:25:321
390757994843,4cyclictest338991-21kworker/u8:2+flush-8:008:00:411
390757994840,6cyclictest462013-21latency_hist08:20:001
390757994835,9cyclictest1704890-21systemd-journal10:40:471
390757994743,3cyclictest570920-21kworker/u8:0+events_unbound10:10:461
390757994743,3cyclictest526916-21kworker/u8:1+events_unbound09:35:471
390757994742,4cyclictest338991-21kworker/u8:2+events_unbound07:35:301
390757994742,3cyclictest635871-21kworker/u8:1+flush-8:011:35:351
390757994738,7cyclictest500744-21ntpq08:55:381
390755994738,7cyclictest645294-21ntpq11:20:420
390755994735,9cyclictest710374-21apt-get12:30:000
390755994735,9cyclictest710374-21apt-get12:29:590
4246002460,2chrt481ktimers/307:40:373
390757994642,3cyclictest705116-21kworker/u8:0+events_unbound12:30:461
390757994642,3cyclictest705116-21kworker/u8:0+events_unbound12:30:461
390757994642,3cyclictest685334-21kworker/u8:2+flush-8:012:10:461
390757994642,3cyclictest685334-21kworker/u8:2+flush-8:012:10:451
390757994641,4cyclictest546176-21kworker/u8:2+flush-8:011:40:321
390755994638,6cyclictest615453-21ntpq10:50:410
390755994637,7cyclictest550633-21ntpq09:45:410
390755994637,6cyclictest1704890-21systemd-journal08:30:370
390755994635,8cyclictest461177-21ntpq08:15:410
390757994541,3cyclictest338991-21kworker/u8:2+flush-8:007:50:371
390757994540,4cyclictest363011-21kworker/u8:1+events_unbound07:45:431
390757994440,3cyclictest665580-21kworker/u8:1+flush-8:011:55:441
390757994440,3cyclictest635871-21kworker/u8:1+events_unbound11:20:431
390755994439,3cyclictest338991-21kworker/u8:2+flush-8:007:50:480
390755994438,4cyclictest507030-21kworker/u8:3+flush-8:009:30:320
390757994339,3cyclictest586351-21kworker/u8:1+events_unbound10:25:461
390757994333,8cyclictest704553-21ntpq12:20:411
390757994333,8cyclictest704553-21ntpq12:20:411
390757994333,4cyclictest516321-21kworker/u8:1+events_unbound09:10:501
390755994337,4cyclictest395351-21kworker/u8:0+flush-8:007:30:360
390755994336,5cyclictest431393-21ntpq07:45:400
390755994335,7cyclictest660595-21kworker/u8:3+flush-8:011:50:420
4062792420,6sleep30-21swapper/307:20:383
390757994237,4cyclictest395351-21kworker/u8:0+flush-8:007:20:311
390755994232,8cyclictest684735-21ntpq12:00:390
390755994231,9cyclictest437801-21diskstats07:55:290
390757994137,3cyclictest546187-21kworker/u8:4+flush-8:010:00:461
390755994134,5cyclictest719609-21ntpq12:35:390
390755994134,5cyclictest719609-21ntpq12:35:390
390757994036,3cyclictest507030-21kworker/u8:3+flush-8:009:20:471
390761993930,6cyclictest1704890-21systemd-journal07:40:002
390757993935,3cyclictest487045-21kworker/u8:2+flush-8:008:50:311
390757993935,3cyclictest487045-21kworker/u8:2+flush-8:008:50:311
390757993934,4cyclictest570920-21kworker/u8:0+events_unbound10:15:311
390757993933,4cyclictest635871-21kworker/u8:1+events_unbound11:15:471
390755993933,4cyclictest607062-21kworker/u8:0+flush-8:011:05:470
390755993932,5cyclictest491747-21latency_hist08:50:000
390755993932,5cyclictest1704890-21systemd-journal08:55:480
390755993931,6cyclictest1704890-21systemd-journal08:45:000
390755993929,7cyclictest1704890-21systemd-journal08:29:590
390755993928,9cyclictest590189-21ntpq10:25:410
390755993927,10cyclictest338991-21kworker/u8:2+flush-8:007:35:460
390757993834,3cyclictest685334-21kworker/u8:2+events_unbound12:39:231
390757993834,3cyclictest685334-21kworker/u8:2+events_unbound12:39:221
390757993834,3cyclictest685334-21kworker/u8:2+events_unbound12:05:491
390755993833,3cyclictest457054-21kworker/u8:0+events_unbound09:40:450
390755993831,6cyclictest338991-21kworker/u8:2+flush-8:007:25:400
390761993731,4cyclictest456144-21journal-offline08:10:402
390757993733,3cyclictest507030-21kworker/u8:3+flush-8:009:30:471
390755993732,4cyclictest546176-21kworker/u8:2+events_unbound10:05:460
390755993730,5cyclictest646647-21diskstats11:25:300
6425032360,2sleep20-21swapper/211:20:352
390757993632,3cyclictest546187-21kworker/u8:4+events_unbound10:50:371
390757993631,4cyclictest635871-21kworker/u8:1+flush-8:011:25:301
390755993631,3cyclictest660595-21kworker/u8:3+events_unbound11:45:450
390757993531,3cyclictest685334-21kworker/u8:2+events_unbound12:16:381
390757993531,3cyclictest685334-21kworker/u8:2+events_unbound12:16:371
390755993532,2cyclictest685334-21kworker/u8:2+flush-8:012:05:350
6193632340,4sleep0201rcuc/010:55:370
390761993327,4cyclictest1704890-21systemd-journal09:40:532
390757993329,3cyclictest607062-21kworker/u8:0+events_unbound11:05:401
390755993328,4cyclictest665580-21kworker/u8:1+events_unbound12:20:010
390755993328,4cyclictest665580-21kworker/u8:1+events_unbound12:20:000
390755993328,4cyclictest338991-21kworker/u8:2+flush-8:007:20:450
390755993327,4cyclictest338991-21kworker/u8:2+events_unbound08:10:380
390761993224,6cyclictest1704890-21systemd-journal09:10:012
390755993227,4cyclictest417095-21kworker/u8:3+flush-8:008:24:180
390755993225,5cyclictest506565-21latency_hist09:05:000
390755993225,5cyclictest506565-21latency_hist09:05:000
39076199315,16cyclictest492615-21/usr/sbin/munin08:50:342
39076199315,16cyclictest492615-21/usr/sbin/munin08:50:332
390755993127,3cyclictest570920-21kworker/u8:0+flush-8:010:10:460
390755993126,3cyclictest487045-21kworker/u8:2+events_unbound09:05:010
390757993025,4cyclictest338991-21kworker/u8:2+flush-8:007:31:031
39076199296,6cyclictest0-21swapper/210:30:302
39076199296,2cyclictest5905902timerwakeupswit10:25:472
390761992923,4cyclictest446776-21unixbench_singl08:00:462
390755992923,4cyclictest507030-21kworker/u8:3+events_unbound09:20:440
390755992922,5cyclictest546176-21kworker/u8:2+events_unbound10:40:410
39076199286,5cyclictest669965-21ntpq11:45:412
39076199283,11cyclictest580209-21ntpq10:15:382
390761992825,2cyclictest586115-21cat10:25:002
390761992813,9cyclictest536878-21apt-get09:35:282
39076199279,14cyclictest570829-21unixbench_multi10:05:482
390761992724,2cyclictest615888-21unixbench_multi10:50:462
390761992723,3cyclictest407169-21unixbench_singl07:20:482
390761992720,5cyclictest1704890-21systemd-journal09:35:002
390755992722,3cyclictest635871-21kworker/u8:1+events_unbound11:35:440
390755992722,3cyclictest596538-21cpuspeed_turbos10:35:290
390755992719,6cyclictest3749718-21kworker/u8:4+flush-8:007:10:430
390761992622,2cyclictest482147-21aten2_r5power_c08:40:282
390761992612,9cyclictest501914-21apt-get09:00:292
390761992612,9cyclictest501914-21apt-get09:00:282
390755992622,3cyclictest661308-21aten2_r5power_p11:40:290
390755992622,3cyclictest526916-21kworker/u8:1+flush-8:009:35:420
390755992620,4cyclictest546176-21kworker/u8:2+flush-8:011:30:470
390761992522,2cyclictest711173-21fschecks_count12:30:312
390761992522,2cyclictest711173-21fschecks_count12:30:312
390761992521,2cyclictest676311-21fschecks_count11:55:282
390761992521,2cyclictest497883-21kthreadcore08:55:332
390761992512,8cyclictest565414-21ntpq10:00:372
390761992511,10cyclictest663389-21ps11:40:352
390755992521,2cyclictest0-21swapper/008:35:370
390755992515,8cyclictest606691-21munin-node10:45:260
39038622512,7sleep30-21swapper/307:07:193
39076199247,4cyclictest0-21swapper/208:15:272
390761992421,2cyclictest472257-21aten2_r5power_c08:30:282
390761992420,3cyclictest437868-21fschecks_time07:55:312
390761992418,4cyclictest1704890-21systemd-journal11:26:122
390755992420,2cyclictest711474-21irqcore12:30:340
390755992420,2cyclictest711474-21irqcore12:30:330
390755992413,9cyclictest0-21swapper/009:15:290
39076199234,4cyclictest0-21swapper/208:20:302
39076199233,9cyclictest0-21swapper/209:10:272
39076199232,10cyclictest635396-21ntpq11:10:442
390761992320,2cyclictest689644-21grep12:05:392
390761992319,3cyclictest651556-21cpuspeed_turbos11:30:302
390761992319,2cyclictest517220-21cpuspeed_turbos09:15:302
390761992319,2cyclictest0-21swapper/211:20:002
390761992313,5cyclictest601570-21apt-get10:40:292
390761992313,4cyclictest397891-21apt-get07:15:272
390755992320,2cyclictest515753-21needreboot09:10:400
390755992318,4cyclictest607062-21kworker/u8:0+flush-8:011:00:300
390755992318,4cyclictest338991-21kworker/u8:2+events_unbound07:15:020
390755992318,3cyclictest338991-21kworker/u8:2+events_unbound08:00:360
39076199221,5cyclictest531289-21users09:25:482
390755992212,7cyclictest526962-21apt-get09:25:280
39076199216,6cyclictest0-21swapper/209:55:292
39076199215,10cyclictest681024-21apt-get12:00:272
39076199214,4cyclictest0-21swapper/210:56:282
39076199213,6cyclictest0-21swapper/212:27:022
39076199213,6cyclictest0-21swapper/212:27:012
390761992118,2cyclictest551882-21aten2_r5power_v09:50:292
390761992117,3cyclictest607062-21kworker/u8:0+flush-8:010:45:372
39076199210,5cyclictest490878-21ntpq08:45:432
390755992117,3cyclictest577012-21sort10:15:340
390755992116,4cyclictest561014-21unixbench_singl09:55:450
390755992116,3cyclictest0-21swapper/010:20:290
39076199209,9cyclictest717534-21tr12:35:352
39076199209,9cyclictest717534-21tr12:35:342
39076199206,6cyclictest0-21swapper/207:25:352
39076199206,2cyclictest0-21swapper/208:25:292
39076199205,6cyclictest0-21swapper/212:12:492
39076199205,6cyclictest0-21swapper/212:12:482
39076199202,5cyclictest0-21swapper/207:43:302
39076199202,5cyclictest0-21swapper/207:10:362
39076199202,4cyclictest704553-21ntpq12:20:402
39076199202,4cyclictest704553-21ntpq12:20:392
39076199202,4cyclictest0-21swapper/208:06:332
390761992016,2cyclictest5490002sleep209:45:362
390761992015,3cyclictest526247-21unixbench_multi09:20:462
39076199201,4cyclictest625379-21ntpq11:00:402
390761992012,4cyclictest432595-21apt-get07:50:292
390761992011,7cyclictest696115-21fschecks_count12:15:302
390761992011,7cyclictest696115-21fschecks_count12:15:302
390761992010,8cyclictest481162-21/usr/sbin/munin08:35:442
390755992016,2cyclictest0-21swapper/011:10:320
390755992015,3cyclictest685334-21kworker/u8:2+events_unbound12:20:350
390755992015,3cyclictest685334-21kworker/u8:2+events_unbound12:20:350
3897682203,11sleep0885-21mta-sts-daemon07:05:420
39076199193,6cyclictest0-21swapper/211:35:252
39076199192,4cyclictest0-21swapper/210:14:142
390761991915,2cyclictest0-21swapper/211:50:402
39076199190,5cyclictest630356-21ntpq11:05:402
390755991915,3cyclictest496323-21unixbench_singl08:50:470
390755991915,3cyclictest496323-21unixbench_singl08:50:470
39076199188,8cyclictest431579-21/usr/sbin/munin07:45:442
39076199184,4cyclictest0-21swapper/207:30:482
3902732184,9sleep20-21swapper/207:05:492
4920332162,9sleep30-21swapper/308:50:283
4920332162,9sleep30-21swapper/308:50:273
4760002142,8sleep30-21swapper/308:30:423
6967082132,7sleep30-21swapper/312:15:353
6967082132,7sleep30-21swapper/312:15:353
6905992132,6sleep30-21swapper/312:10:013
5465352132,6sleep30-21swapper/309:45:013
5217152132,6sleep30-21swapper/309:20:023
7155502121,6sleep30-21swapper/312:35:013
7155502121,6sleep30-21swapper/312:35:003
7049572122,6sleep30-21swapper/312:20:483
7049572122,6sleep30-21swapper/312:20:473
6757352122,6sleep30-21swapper/311:54:483
6560132122,5sleep30-21swapper/311:35:013
6515862122,6sleep30-21swapper/311:30:323
6466452122,6sleep30-21swapper/311:25:293
6414452122,6sleep30-21swapper/311:20:293
6403142123,5sleep30-21swapper/311:15:433
6308752122,6sleep30-21swapper/311:05:483
6223192122,6sleep30-21swapper/311:00:343
6157742122,6sleep30-21swapper/310:50:473
6106112122,6sleep30-21swapper/310:45:463
6018142122,6sleep30-21swapper/310:40:323
5920892122,6sleep30-21swapper/310:30:373
5868932122,6sleep30-21swapper/310:25:353
5848852122,6sleep30-21swapper/310:20:363
5767902122,6sleep30-21swapper/310:15:323
5715312122,6sleep30-21swapper/310:10:303
5560682122,6sleep30-21swapper/309:50:483
5455952122,6sleep30-21swapper/309:40:413
5313762122,6sleep30-21swapper/309:26:483
5172632122,6sleep30-21swapper/309:15:313
5119072122,5sleep30-21swapper/309:10:033
5062712122,6sleep30-21swapper/309:01:203
5062712122,6sleep30-21swapper/309:01:193
5012622122,6sleep30-21swapper/308:55:463
4781402122,6sleep30-21swapper/308:35:353
4631532122,6sleep30-21swapper/308:20:343
4573672122,6sleep30-21swapper/308:15:293
4570122122,5sleep30-21swapper/308:15:013
4471842122,5sleep30-21swapper/308:05:023
4413772122,7sleep30-21swapper/307:55:433
4363412122,6sleep30-21swapper/307:50:413
4179522122,6sleep30-21swapper/307:35:323
4127862122,6sleep30-21swapper/307:30:293
3956892122,5sleep30-21swapper/307:15:003
7204552113,5sleep30-21swapper/312:39:023
7204552113,5sleep30-21swapper/312:39:013
7055272112,5sleep30-21swapper/312:25:023
7055272112,5sleep30-21swapper/312:25:023
6908952112,5sleep30-21swapper/312:10:293
6908952112,5sleep30-21swapper/312:10:283
6807692112,5sleep30-21swapper/312:00:003
6800692112,5sleep30-21swapper/311:55:443
6675852112,5sleep30-21swapper/311:45:363
6657632113,5sleep30-21swapper/311:43:243
6315082112,5sleep30-21swapper/311:10:293
6169832112,5sleep30-21swapper/310:55:323
5627392112,5sleep30-21swapper/310:00:353
5611792112,5sleep30-21swapper/309:57:343
5374412112,6sleep30-21swapper/309:35:353
5319232112,5sleep30-21swapper/309:30:283
5070862112,5sleep30-21swapper/309:05:293
4871042112,5sleep30-21swapper/308:45:313
4821212112,5sleep30-21swapper/308:40:293
4715312112,6sleep30-21swapper/308:25:483
4424652112,6sleep30-21swapper/308:00:153
4276362112,5sleep30-21swapper/307:45:263
4114962112,5sleep30-21swapper/307:25:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional