You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 03:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 23, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4431312820,3sleep375-21kworker/3:1-events19:55:383
391930996761,4cyclictest582762-21gpgv22:20:012
391926996661,3cyclictest3759298-21kworker/u8:2+events_unbound19:15:381
391926996660,4cyclictest423831-21kworker/u8:1+flush-8:020:00:371
391926996458,5cyclictest502672-21kworker/u8:0+events_unbound21:05:351
391926996457,4cyclictest349801-21kworker/u8:0+events_unbound19:40:011
391926996452,9cyclictest666987-21ntpq23:40:331
391926996358,3cyclictest527777-21kworker/u8:1+flush-8:021:50:351
391926996257,3cyclictest468564-21kworker/u8:3+events_unbound22:30:181
391926996256,5cyclictest642739-21kworker/u8:1+events_unbound23:55:331
391926996157,3cyclictest423831-21kworker/u8:1+events_unbound20:20:331
391926996155,4cyclictest518033-21kworker/u8:2+flush-8:021:25:211
391926996155,4cyclictest468564-21kworker/u8:3+flush-8:023:30:321
391926996154,5cyclictest502672-21kworker/u8:0+flush-8:021:00:361
391926996154,4cyclictest423831-21kworker/u8:1+events_unbound20:05:221
391930996054,4cyclictest633026-21gpgv23:10:012
391926996055,4cyclictest468564-21kworker/u8:3+events_unbound20:50:391
391926996055,4cyclictest468564-21kworker/u8:3+events_unbound20:50:381
391926996055,4cyclictest423831-21kworker/u8:1+events_unbound19:45:201
391926996055,3cyclictest642739-21kworker/u8:1+flush-8:000:15:211
391926996053,4cyclictest448755-21kworker/u8:2+events_unbound20:40:241
391926995948,8cyclictest463385-21latency_hist20:20:011
391926995852,4cyclictest557648-21kworker/u8:2+flush-8:022:45:331
391923995847,8cyclictest477316-21ntpq20:30:330
391926995751,5cyclictest468564-21kworker/u8:3+flush-8:023:00:211
391923995747,7cyclictest602100-21ntpq22:35:330
391926995651,4cyclictest518033-21kworker/u8:2+events_unbound21:20:351
391926995651,4cyclictest518033-21kworker/u8:2+events_unbound21:20:341
391926995650,4cyclictest473526-21kworker/u8:1+flush-8:021:10:401
391923995650,4cyclictest423831-21kworker/u8:1+flush-8:020:05:360
391926995550,4cyclictest653220-21kworker/u8:2+flush-8:023:50:301
391926995547,6cyclictest683042-21/usr/sbin/munin00:00:331
391923995548,4cyclictest468564-21kworker/u8:3+flush-8:020:35:350
391926995450,3cyclictest642739-21kworker/u8:1+flush-8:023:20:321
391926995448,4cyclictest607988-21kworker/u8:0+flush-8:022:55:221
391926995447,5cyclictest642739-21kworker/u8:1+flush-8:000:30:311
391926995444,7cyclictest437801-21ntpq19:50:341
6852012530,4chrt75-21kworker/3:1-events00:00:273
391926995349,3cyclictest575760-21kworker/u8:1+events_unbound22:15:231
391926995347,4cyclictest448755-21kworker/u8:2+events_unbound20:45:331
391926995346,5cyclictest575760-21kworker/u8:1+events_unbound22:40:341
391926995345,6cyclictest468564-21kworker/u8:3+events_unbound22:35:031
391926995248,3cyclictest537288-21kworker/u8:0+flush-8:021:40:221
391926995246,4cyclictest653220-21kworker/u8:2+flush-8:000:25:201
391926995146,4cyclictest557648-21kworker/u8:2+events_unbound22:05:251
391926995146,3cyclictest3759298-21kworker/u8:2+events_unbound19:20:251
391926995145,4cyclictest518033-21kworker/u8:2+events_unbound21:30:311
391926995144,5cyclictest349801-21kworker/u8:0+events_unbound20:10:361
391926995143,6cyclictest557648-21kworker/u8:2+flush-8:021:55:341
391926995136,5cyclictest642739-21kworker/u8:1+flush-8:023:25:231
391923995145,4cyclictest513151-21apt-get21:10:010
391923995144,5cyclictest575760-21kworker/u8:1+events_unbound22:15:370
6679512500,2chrt0-21swapper/223:45:012
391930995042,5cyclictest577906-21cat22:15:002
391930995039,8cyclictest1704890-21systemd-journal23:55:382
391926995045,4cyclictest607988-21kworker/u8:0+events_unbound23:05:331
391923995041,7cyclictest717892-21latency_hist00:35:010
391923995040,7cyclictest507269-21ntpq21:00:300
391923994941,5cyclictest642147-21ntpq23:15:320
391926994829,6cyclictest473526-21kworker/u8:1+events_unbound20:55:381
391923994842,4cyclictest642739-21kworker/u8:1+events_unbound23:45:380
391926994740,5cyclictest575760-21kworker/u8:1+flush-8:022:20:321
391923994739,5cyclictest557648-21kworker/u8:2+events_unbound22:25:370
391926994639,5cyclictest557648-21kworker/u8:2+events_unbound22:00:251
391926994639,5cyclictest468564-21kworker/u8:3+flush-8:021:35:321
391926994638,5cyclictest591946-21ntpq22:25:311
391926994637,7cyclictest391470-21kworker/u8:1+flush-8:019:10:331
391926994539,4cyclictest468564-21kworker/u8:3+events_unbound20:35:221
391923994541,3cyclictest468564-21kworker/u8:3+flush-8:023:30:350
391923994540,4cyclictest423831-21kworker/u8:1+events_unbound19:55:230
391923994539,4cyclictest653220-21kworker/u8:2+events_unbound00:00:380
391926994439,3cyclictest557648-21kworker/u8:2+flush-8:023:15:281
391926994438,5cyclictest642739-21kworker/u8:1+flush-8:023:45:331
391926994427,12cyclictest1704890-21systemd-journal20:31:401
391923994335,6cyclictest472362-21ntpq20:25:310
391926994235,5cyclictest349801-21kworker/u8:0+events_unbound20:25:371
391923994235,5cyclictest468564-21kworker/u8:3+flush-8:021:35:320
391923994235,4cyclictest653220-21kworker/u8:2+flush-8:023:40:310
391930994130,8cyclictest688235-21cp00:05:012
391926994137,3cyclictest468564-21kworker/u8:3+events_unbound00:35:401
391926994135,4cyclictest642739-21kworker/u8:1+events_unbound00:10:331
391926994135,4cyclictest468564-21kworker/u8:3+events_unbound23:10:341
391926994133,6cyclictest653220-21kworker/u8:2+events_unbound23:35:231
391923994134,5cyclictest518033-21kworker/u8:2+flush-8:021:30:300
391923994133,5cyclictest607048-21ntpq22:40:330
391923994131,8cyclictest528779-21diskstats21:25:220
391930994035,4cyclictest423831-21kworker/u8:1+flush-8:019:40:362
391926994035,4cyclictest642739-21kworker/u8:1+flush-8:000:05:301
391926994034,4cyclictest468564-21kworker/u8:3+events_unbound00:20:321
391923994035,3cyclictest557648-21kworker/u8:2+events_unbound22:00:210
391923994034,4cyclictest468564-21kworker/u8:3+events_unbound00:35:370
391930993928,8cyclictest1704890-21systemd-journal00:17:002
391926993930,6cyclictest573048-21/usr/sbin/munin22:10:381
391926993831,5cyclictest468564-21kworker/u8:3+events_unbound21:45:261
391930993732,4cyclictest518033-21kworker/u8:2+flush-8:021:25:312
391926993732,4cyclictest468564-21kworker/u8:3+events_unbound22:50:261
391926993729,6cyclictest424084-21apt-get19:40:191
391923993733,3cyclictest8550irq/124-ahci[0000:00:12.0]23:25:310
391923993728,7cyclictest468564-21kworker/u8:3+flush-8:021:45:310
391930993631,4cyclictest642739-21kworker/u8:1+events_unbound00:05:412
391926993632,3cyclictest349801-21kworker/u8:0+flush-8:019:55:281
391926993631,4cyclictest518033-21kworker/u8:2+flush-8:021:15:391
391923993630,4cyclictest468564-21kworker/u8:3+events_unbound21:15:250
391923993630,4cyclictest3759298-21kworker/u8:2+flush-8:019:25:310
391923993629,6cyclictest518033-21kworker/u8:2+flush-8:021:20:330
391923993629,6cyclictest518033-21kworker/u8:2+flush-8:021:20:320
391923993628,6cyclictest468564-21kworker/u8:3+flush-8:020:50:340
391923993628,6cyclictest468564-21kworker/u8:3+flush-8:020:50:330
391923993530,3cyclictest653220-21kworker/u8:2+flush-8:023:35:290
391923993528,5cyclictest653220-21kworker/u8:2+flush-8:000:05:210
391923993528,5cyclictest3759298-21kworker/u8:2+flush-8:019:15:340
391930993429,3cyclictest349801-21kworker/u8:0+flush-8:019:50:222
391926993426,5cyclictest417929-21ntpq19:30:301
391923993428,4cyclictest468564-21kworker/u8:3+events_unbound23:05:370
391923993426,6cyclictest1704890-21systemd-journal20:57:170
391923993328,4cyclictest642739-21kworker/u8:1+events_unbound00:25:320
391923993328,4cyclictest448755-21kworker/u8:2+events_unbound20:45:360
391923993320,3cyclictest593457-21fschecks_time22:30:200
3914652334,10sleep20-21swapper/219:08:472
391930993228,3cyclictest537288-21kworker/u8:0+events_unbound21:40:002
391930993221,8cyclictest1704890-21systemd-journal20:09:592
391923993227,4cyclictest642739-21kworker/u8:1+flush-8:023:20:380
391923993226,4cyclictest557648-21kworker/u8:2+events_unbound22:22:380
391923993226,4cyclictest468564-21kworker/u8:3+events_unbound23:10:350
391923993226,4cyclictest419168-21aten2_r5power_p19:35:200
391923993223,6cyclictest408691-21latency_hist19:25:010
391923993220,9cyclictest547177-21ntpq21:40:320
391930993125,4cyclictest423831-21kworker/u8:1+flush-8:020:10:242
391923993127,3cyclictest575760-21kworker/u8:1+events_unbound22:10:400
391923993127,2cyclictest396883-21systemd-run19:15:000
391923993126,4cyclictest468564-21kworker/u8:3+flush-8:000:20:280
391923993126,4cyclictest349801-21kworker/u8:0+events_unbound19:50:240
391923993124,5cyclictest622873-21cron22:59:590
391923993121,7cyclictest612949-21latency_hist22:50:010
391930993026,3cyclictest468564-21kworker/u8:3+flush-8:022:50:342
391930993026,2cyclictest707889-21cp00:25:012
391926993023,4cyclictest391470-21kworker/u8:1+events_unbound19:30:001
391923993026,3cyclictest537288-21kworker/u8:0+events_unbound22:05:390
391923993026,3cyclictest349801-21kworker/u8:0+flush-8:020:10:370
391923993025,3cyclictest424612-21irqcore19:40:250
6393432290,3sleep20-21swapper/223:15:262
391930992924,3cyclictest633617-21aten2_r5power_v23:10:212
391923992924,3cyclictest0-21swapper/000:20:000
391930992823,3cyclictest607528-21unixbench_multi22:40:382
391923992824,3cyclictest468564-21kworker/u8:3+flush-8:020:40:360
391923992824,3cyclictest423831-21kworker/u8:1+flush-8:019:45:350
391923992822,4cyclictest693435-21cpuspeed_turbos00:10:210
391923992819,7cyclictest448514-21cron20:04:590
391930992722,3cyclictest468822-21cpuspeed_turbos20:25:202
391923992722,3cyclictest682777-21systemctl00:00:000
391923992722,3cyclictest467928-21head20:20:380
391923992721,5cyclictest557648-21kworker/u8:2+flush-8:021:55:340
391923992721,4cyclictest513147-21cron21:10:000
391923992721,4cyclictest423831-21kworker/u8:1+events_unbound20:15:320
391930992622,3cyclictest718385-21cpuspeed_turbos00:35:222
391930992622,3cyclictest587929-21turbostat.cron22:25:012
391930992621,3cyclictest597368-21unixbench_singl22:30:362
391930992619,5cyclictest508209-21turbostat.cron21:05:002
391930992618,6cyclictest443587-21awk20:00:002
391930992612,2cyclictest0-21swapper/220:55:222
391923992620,4cyclictest613481-21fschecks_count22:50:230
391923992620,4cyclictest418431-21unixbench_singl19:30:370
391930992522,2cyclictest443972-21aten2_r5power_v20:00:212
391930992520,4cyclictest575760-21kworker/u8:1+flush-8:022:35:332
391930992520,4cyclictest391917-21cyclictest21:30:382
391930992517,5cyclictest523536-21grep21:20:012
391930992421,2cyclictest717448-21unixbench_multi00:30:392
391930992420,2cyclictest488484-21aten2_r5power_c20:45:202
391930992417,5cyclictest623128-21awk23:00:012
391930992416,6cyclictest513143-21turbostat.cron21:09:592
391930992320,2cyclictest563338-21aten2_r5power_v22:00:192
391930992319,2cyclictest647695-21unixbench_singl23:20:392
391930992316,5cyclictest518356-21cron21:14:592
391930992315,6cyclictest1704890-21systemd-journal00:14:592
391923992319,3cyclictest653220-21kworker/u8:2+events_unbound23:50:380
391923992319,3cyclictest623571-21cpuspeed23:00:210
391923992319,3cyclictest527777-21kworker/u8:1+events_unbound21:50:330
39193099222,14cyclictest653261-21apt-get23:30:192
391930992219,2cyclictest608552-21fschecks_time22:45:222
391930992218,3cyclictest448755-21kworker/u8:2+flush-8:020:30:342
391930992218,3cyclictest391470-21kworker/u8:1+flush-8:019:30:362
391930992218,2cyclictest429355-21fschecks_time19:45:222
391930992217,4cyclictest662894-21cron23:39:592
391930992210,8cyclictest483496-21apt-get20:40:172
391930992210,3cyclictest5440102irqcore21:40:262
3914112223,4sleep00-21swapper/019:08:040
391930992111,7cyclictest675007-21tr23:50:262
3914692214,11sleep10-21swapper/119:08:501
39193099202,12cyclictest708294-21apt-get00:25:172
391930992016,2cyclictest588415-21tr22:25:202
391930992012,6cyclictest527845-21sshd21:20:392
391930992012,6cyclictest527845-21sshd21:20:382
391930992012,6cyclictest423014-21grep19:35:352
39193099201,12cyclictest408956-21apt-get19:25:192
391930992010,2cyclictest0-21swapper/223:00:262
39193099191,8cyclictest4088752cat19:25:012
391930991915,2cyclictest648662-21fschecks_time23:25:232
391930991915,2cyclictest0-21swapper/221:55:322
39193099191,13cyclictest668151-21apt-get23:45:212
39193099190,2cyclictest4617571kthreadcore20:15:302
39193099182,11cyclictest568141-21apt-get22:05:192
391930991814,2cyclictest399760-21sed19:15:252
391930991814,2cyclictest0-21swapper/220:35:262
391930991813,4cyclictest548639-21cut21:45:212
391930991813,3cyclictest493602-21cpuspeed_turbos20:50:222
391930991813,3cyclictest493602-21cpuspeed_turbos20:50:212
3869342182,8sleep30-21swapper/319:05:023
39193099177,7cyclictest466075-21cut20:20:262
6171252150,3sleep375-21kworker/3:1+events22:50:363
39193099156,7cyclictest393146-21cut19:10:272
391930991512,2cyclictest553422-21aten2_r5power_v21:50:182
7130272132,6sleep30-21swapper/300:30:013
6530542132,6sleep30-21swapper/323:30:023
6387992132,7sleep30-21swapper/323:15:253
5985662133,6sleep30-21swapper/322:35:243
5886712132,7sleep30-21swapper/322:25:253
5874372132,7sleep30-21swapper/322:20:393
5431592132,6sleep30-21swapper/321:40:013
5223922132,7sleep30-21swapper/321:15:343
4921962132,7sleep30-21swapper/320:45:313
4834702130,9sleep30-21swapper/320:40:173
4636722132,7sleep30-21swapper/320:20:203
4374702133,7sleep30-21swapper/319:50:293
4327942132,7sleep30-21swapper/319:45:323
4239872132,6sleep30-21swapper/319:40:023
4187992132,7sleep30-21swapper/319:35:013
3968852132,6sleep30-21swapper/319:15:013
7223882122,6sleep30-21swapper/300:35:403
7030992122,6sleep30-21swapper/300:20:193
7019422121,7sleep30-21swapper/300:15:333
6878652122,5sleep30-21swapper/300:05:023
6816922122,6sleep30-21swapper/323:55:303
6628902122,5sleep30-21swapper/323:40:013
6587592122,6sleep30-21swapper/323:35:273
6300162122,6sleep30-21swapper/323:05:293
6250532122,6sleep30-21swapper/323:00:283
6219122122,6sleep30-21swapper/322:55:313
6092392120,2sleep3481ktimers/322:45:253
6030012122,5sleep30-21swapper/322:40:023
5929852122,5sleep30-21swapper/322:30:013
5730472122,6sleep30-21swapper/322:10:193
5678962122,6sleep30-21swapper/322:05:023
5664592122,6sleep30-21swapper/322:00:293
5577632122,6sleep30-21swapper/321:52:223
5483612122,6sleep30-21swapper/321:45:203
5387982122,6sleep30-21swapper/321:35:243
5346582122,6sleep30-21swapper/321:30:273
5136322122,6sleep30-21swapper/321:10:193
5120102122,7sleep30-21swapper/321:05:313
5035312122,6sleep30-21swapper/321:00:213
4986712122,6sleep30-21swapper/320:55:223
4933882122,6sleep30-21swapper/320:50:223
4933882122,6sleep30-21swapper/320:50:223
4788732122,6sleep30-21swapper/320:35:253
4775722122,6sleep30-21swapper/320:30:393
4585252122,6sleep30-21swapper/320:15:023
4574942122,6sleep30-21swapper/320:10:313
4487492122,5sleep30-21swapper/320:05:033
4438762122,6sleep30-21swapper/320:00:213
3925142122,6sleep30-21swapper/319:10:253
7082982112,5sleep30-21swapper/300:25:203
6934702112,5sleep30-21swapper/300:10:223
6730212112,6sleep30-21swapper/323:50:173
6717492112,6sleep30-21swapper/323:45:313
6483532112,6sleep30-21swapper/323:25:213
6436162112,5sleep30-21swapper/323:20:223
6334582112,5sleep30-21swapper/323:10:043
5780132112,5sleep30-21swapper/322:15:213
5582072112,5sleep30-21swapper/321:55:023
5282502112,5sleep30-21swapper/321:25:013
5245132112,5sleep30-21swapper/321:20:273
5245132112,5sleep30-21swapper/321:20:263
4683202112,5sleep30-21swapper/320:25:003
4190872112,6sleep30-21swapper/319:35:203
4129642112,5sleep30-21swapper/319:25:383
4040012112,6sleep30-21swapper/319:20:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional