You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 06:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Apr 08, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
352024521840,2sleep30-21swapper/322:16:263
356917121570,3sleep3451irq_work/323:06:263
3332722996557,6cyclictest3586923-21kworker/u8:1+events_unbound23:36:191
3332722996154,5cyclictest3408824-21kworker/u8:0+events_unbound20:41:341
34910482580,3chrt371rcuc/221:46:272
3332722995851,5cyclictest3512688-21kworker/u8:3+events_unbound22:46:351
3332722995752,3cyclictest3384093-21kworker/u8:2+events_unbound20:06:251
3332722995752,3cyclictest3305189-21kworker/u8:1+events_unbound19:56:351
3332722995652,3cyclictest3512688-21kworker/u8:3+flush-8:023:31:371
3332722995651,3cyclictest3305189-21kworker/u8:1+events_unbound19:46:221
3332722995649,5cyclictest3384093-21kworker/u8:2+events_unbound20:31:351
3332718995645,9cyclictest3424272-21diskstats20:41:200
35649282550,8sleep1281rcuc/123:01:271
3332722995549,4cyclictest3408824-21kworker/u8:0+events_unbound20:56:201
3332722995549,4cyclictest1972509-21kworker/u8:2+flush-8:019:21:331
3332722995548,5cyclictest3305189-21kworker/u8:1+events_unbound19:41:211
3332722995449,4cyclictest3586923-21kworker/u8:1+flush-8:000:01:231
3332722995449,3cyclictest3429104-21kworker/u8:3+events_unbound21:01:221
3332722995346,5cyclictest3423705-21kworker/u8:1+events_unbound22:36:321
3332722995247,3cyclictest3621809-21kworker/u8:0+events_unbound00:16:351
3332722995246,4cyclictest3305189-21kworker/u8:1+events_unbound19:16:241
3332722995147,3cyclictest3423705-21kworker/u8:1+flush-8:022:11:371
3332722995145,5cyclictest3512688-21kworker/u8:3+flush-8:023:21:331
3332722995145,4cyclictest3305189-21kworker/u8:1+events_unbound19:31:221
3332722995144,5cyclictest3423705-21kworker/u8:1+events_unbound22:26:331
3332722995144,5cyclictest3423705-21kworker/u8:1+events_unbound22:26:331
3332722995144,5cyclictest3305189-21kworker/u8:1+flush-8:019:51:321
3332722995043,5cyclictest3305189-21kworker/u8:1+events_unbound19:11:301
3332726994939,7cyclictest280-21systemd-journal19:14:592
3332722994945,3cyclictest3384093-21kworker/u8:2+flush-8:020:01:371
3332722994943,5cyclictest3448876-21kworker/u8:2+flush-8:021:16:361
3332722994841,5cyclictest3423705-21kworker/u8:1+events_unbound21:51:201
3332722994841,5cyclictest3305189-21kworker/u8:1+events_unbound20:11:321
3332718994842,4cyclictest3423705-21kworker/u8:1+flush-8:021:41:220
3332722994742,4cyclictest3384093-21kworker/u8:2+flush-8:020:21:371
3332722994742,4cyclictest3384093-21kworker/u8:2+flush-8:020:21:371
3332722994742,3cyclictest3586923-21kworker/u8:1+events_unbound23:56:301
3332722994740,5cyclictest3423705-21kworker/u8:1+events_unbound22:06:361
3332718994741,4cyclictest3433821-21latency_hist20:50:010
3332722994642,3cyclictest3586923-21kworker/u8:1+events_unbound23:51:201
3332722994641,4cyclictest3512688-21kworker/u8:3+flush-8:023:06:231
3332722994539,4cyclictest3408824-21kworker/u8:0+events_unbound20:51:211
3332722994439,4cyclictest3448876-21kworker/u8:2+flush-8:022:21:361
3332722994439,3cyclictest3429104-21kworker/u8:3+flush-8:021:06:251
3332718994437,5cyclictest3641894-21apt-get00:21:170
3332718994436,5cyclictest3458549-21latency_hist21:15:010
3332722994339,3cyclictest3512688-21kworker/u8:3+flush-8:023:46:361
3332722994338,4cyclictest3448876-21kworker/u8:2+flush-8:021:21:311
3332722994337,5cyclictest3305189-21kworker/u8:1+events_unbound20:16:321
3332722994336,5cyclictest3621809-21kworker/u8:0+events_unbound00:21:321
3332722994238,3cyclictest3621809-21kworker/u8:0+flush-8:000:06:381
3332722994235,5cyclictest3512688-21kworker/u8:3+flush-8:022:16:251
3332718994232,7cyclictest3439080-21/usr/sbin/munin20:56:310
3332722994135,5cyclictest3512688-21kworker/u8:3+events_unbound22:51:241
3332722994135,5cyclictest1972509-21kworker/u8:2+events_unbound19:26:331
3332722994135,4cyclictest3423657-21latency_hist20:40:011
3332722994133,5cyclictest3493126-21latency_hist21:50:011
3332722994132,6cyclictest280-21systemd-journal23:10:501
3332718994130,9cyclictest3507070-21ntpq22:01:280
3332726994032,6cyclictest3429069-21cp20:45:012
3332722994035,4cyclictest3621809-21kworker/u8:0+flush-8:000:26:241
3332722994034,4cyclictest3621809-21kworker/u8:0+flush-8:000:11:261
3332722994033,5cyclictest3305189-21kworker/u8:1+events_unbound19:36:341
3332722993935,3cyclictest3512688-21kworker/u8:3+flush-8:022:56:351
3332722993934,3cyclictest3512688-21kworker/u8:3+events_unbound22:31:381
3332722993933,4cyclictest3448876-21kworker/u8:2+events_unbound23:16:311
3332722993932,5cyclictest3448876-21kworker/u8:2+events_unbound22:41:331
3332722993932,5cyclictest3448876-21kworker/u8:2+events_unbound21:11:391
3332718993930,6cyclictest3393959-21latency_hist20:10:010
33323332394,10sleep10-21swapper/119:07:441
3332722993832,4cyclictest3478097-21kworker/u8:0+events_unbound22:05:001
3332718993828,8cyclictest3512688-21kworker/u8:3+flush-8:022:56:260
3332718993827,8cyclictest3449242-21diskstats21:06:210
3332722993632,3cyclictest3448876-21kworker/u8:2+events_unbound21:31:211
3332718993530,4cyclictest3478097-21kworker/u8:0+flush-8:022:06:340
3332718993529,4cyclictest3586923-21kworker/u8:1+flush-8:000:01:350
3332718993524,8cyclictest280-21systemd-journal20:30:370
3332722993429,3cyclictest3656672-21apt-get00:36:181
3332722993429,3cyclictest3603115-21irqrtprio23:41:261
3332722993327,5cyclictest3448876-21kworker/u8:2+events_unbound23:26:331
3332722993325,6cyclictest3472466-21ntpq21:26:301
3332722993325,6cyclictest280-21systemd-journal00:30:501
3332722993325,6cyclictest280-21systemd-journal00:30:501
3332718993328,3cyclictest3552850-21kworker/u8:0+flush-8:023:11:230
3332718993327,4cyclictest3423705-21kworker/u8:1+flush-8:021:46:190
333271899331,29cyclictest3552440-21munin-run22:50:010
3332726993225,5cyclictest3621778-40logrotate00:00:002
3332722993228,3cyclictest3423705-21kworker/u8:1+events_unbound20:46:351
3332722993227,3cyclictest3484306-21irqrtprio21:41:251
3332718993226,4cyclictest3344522-21true19:20:000
3332718993223,6cyclictest3305189-21kworker/u8:1+flush-8:019:11:190
33278952324,8sleep20-21swapper/219:05:202
33516072310,2sleep3471rcuc/319:26:273
3332722993127,3cyclictest3478097-21kworker/u8:0+flush-8:021:36:371
3332722993122,7cyclictest3498353-21/usr/sbin/munin21:56:331
3332718993126,4cyclictest3512688-21kworker/u8:3+flush-8:023:41:210
3332718993123,6cyclictest3384093-21kworker/u8:2+flush-8:020:36:190
3332718993120,8cyclictest3630848-21ntpq00:06:320
3332718993025,3cyclictest3468978-21cpuspeed_turbos21:26:200
3332718993021,7cyclictest3384093-21kworker/u8:2+flush-8:020:11:230
3332726992924,3cyclictest3596708-21unixbench_multi23:31:392
3332726992924,3cyclictest3568505-21irqrtprio23:06:252
3332718992925,3cyclictest3305189-21kworker/u8:1+flush-8:019:36:360
3332718992924,3cyclictest3621814-21systemd-run00:00:010
3332718992923,4cyclictest3448876-21kworker/u8:2+flush-8:021:21:210
3332718992914,3cyclictest0-21swapper/019:31:250
33766192280,6sleep3451irq_work/319:51:273
3332726992823,3cyclictest3378760-21unixbench_singl19:51:382
3332718992824,2cyclictest3403852-21sh20:20:000
3332718992823,3cyclictest3482874-21unixbench_multi21:36:370
3332718992822,5cyclictest3597476-21aten2_r5power_e23:36:180
3332718992822,4cyclictest3280278-21kworker/u8:3+flush-8:019:46:380
3332718992821,5cyclictest280-21systemd-journal00:13:020
3332718992818,8cyclictest3526844-21ntpq22:21:280
3332718992813,13cyclictest3305189-21kworker/u8:1+flush-8:020:21:230
3332718992813,13cyclictest3305189-21kworker/u8:1+flush-8:020:21:230
3332726992722,3cyclictest3547141-21unixbench_singl22:41:372
3332718992723,3cyclictest3656341-21systemd-run00:35:000
3332718992723,3cyclictest3656341-21systemd-run00:35:000
3332718992723,2cyclictest3369186-21cron19:45:000
3332718992722,2cyclictest0-21swapper/019:51:310
3332718992720,6cyclictest3512688-21kworker/u8:3+flush-8:023:46:370
3332718992622,3cyclictest3581917-21unixbench_singl23:16:380
3332718992621,4cyclictest3448876-21kworker/u8:2+events_unbound23:26:350
3332718992618,4cyclictest0-21swapper/021:51:180
3332726992522,2cyclictest3384499-21aten2_r5power_p20:01:212
3332726992521,2cyclictest3379652-21cpuspeed_turbos19:56:202
3332726992517,6cyclictest280-21systemd-journal21:20:002
3332726992516,7cyclictest3606599-21unixbench_multi23:41:382
333271899252,22cyclictest0-21swapper/023:31:370
3332718992521,3cyclictest3463499-21systemd-run21:20:010
3332718992521,2cyclictest0-21swapper/022:51:340
3332718992520,3cyclictest3448876-21kworker/u8:2+flush-8:022:41:320
3332718992520,3cyclictest3448876-21kworker/u8:2+flush-8:021:31:260
3332718992520,3cyclictest1972509-21kworker/u8:2+flush-8:019:21:310
3332718992515,8cyclictest3448876-21kworker/u8:2+flush-8:022:26:190
3332718992515,8cyclictest3448876-21kworker/u8:2+flush-8:022:26:190
333272699242,21cyclictest3396471-21grep20:11:272
3332726992421,2cyclictest3513251-21aten2_r5power_c22:11:192
3332726992421,2cyclictest3340210-21fschecks_time19:16:232
3332726992420,2cyclictest3474017-21fschecks_time21:31:222
3332726992420,2cyclictest3409369-21cpuspeed_turbos20:26:212
3332726992419,3cyclictest3542173-21unixbench_singl22:36:372
3332726992419,3cyclictest3349143-21unixbench_singl19:21:372
3332726992416,7cyclictest3399573-21fschecks_time20:16:222
3332726992416,6cyclictest3502661-21unixbench_singl21:56:352
3332718992419,3cyclictest3512688-21kworker/u8:3+events_unbound23:06:330
3332718992418,4cyclictest3542208-21unixbench_singl22:36:370
3332718992418,4cyclictest3408824-21kworker/u8:0+flush-8:020:51:220
3332726992319,2cyclictest3631317-21unixbench_multi00:06:382
3332726992319,2cyclictest0-21swapper/200:40:002
3332726992318,3cyclictest3443320-21unixbench_multi20:56:392
3332726992318,3cyclictest0-21swapper/219:40:002
3332726992316,5cyclictest280-21systemd-journal20:10:002
3332726992314,7cyclictest280-21systemd-journal21:30:002
3332718992318,3cyclictest0-21swapper/023:51:370
3332718992318,2cyclictest0-21swapper/023:21:290
3332718992317,4cyclictest3651088-21unixbench_singl00:26:350
3332718992317,4cyclictest3388681-21unixbench_multi20:01:380
3332718992316,5cyclictest1-21systemd23:05:010
3332718992313,7cyclictest3332522-21latency_hist19:10:010
3332726992218,2cyclictest3562123-21unixbench_multi22:56:372
3332726992218,2cyclictest3512546-21unixbench_singl22:06:372
3332726992217,3cyclictest3518444-21fschecks_count22:16:212
3332726992217,3cyclictest3373789-21unixbench_multi19:46:382
3332726992213,7cyclictest3652053-21fschecks_time00:31:232
3332726992213,7cyclictest3652053-21fschecks_time00:31:232
3332726992213,7cyclictest3637223-21fschecks_count00:16:202
3332726992213,7cyclictest3482848-21unixbench_multi21:36:372
3332726992213,7cyclictest3364946-21fschecks_time19:41:222
3332726992212,8cyclictest3354095-21unixbench_singl19:26:382
3332718992218,3cyclictest8550irq/124-ahci[0000:00:12.0]22:30:200
3332718992218,2cyclictest0-21swapper/020:26:210
3332718992218,2cyclictest0-21swapper/000:16:340
3332718992217,4cyclictest3517453-21unixbench_multi22:11:380
3332718992217,3cyclictest0-21swapper/021:05:000
3332718992216,3cyclictest0-21swapper/000:36:190
3332718992215,5cyclictest3305189-21kworker/u8:1+flush-8:019:56:210
35731152210,2sleep3481ktimers/323:11:243
333272699212,2cyclictest34666881kthreadcore21:21:262
3332726992118,2cyclictest20977-21cron22:30:002
3332726992118,2cyclictest20977-21cron22:30:002
3332726992117,2cyclictest0-21swapper/221:11:202
3332726992116,3cyclictest3636289-21unixbench_singl00:11:392
3332726992116,3cyclictest3552062-21unixbench_singl22:46:372
3332726992115,4cyclictest3612528-21fschecks_count23:51:222
3332726992115,4cyclictest3448321-21unixbench_singl21:01:392
3332726992112,7cyclictest3582926-21fschecks_time23:21:222
3332718992117,2cyclictest0-21swapper/021:56:210
3332718992116,4cyclictest1972509-21kworker/u8:2+flush-8:019:26:330
3332718992114,5cyclictest3512688-21kworker/u8:3+flush-8:022:16:210
33324242217,8sleep30-21swapper/319:08:543
3332726992016,2cyclictest0-21swapper/221:41:292
3332726992015,3cyclictest3582238-21cron23:20:002
3332726992012,6cyclictest3557218-21unixbench_multi22:51:372
3332726991915,2cyclictest0-21swapper/200:21:242
333272299191,14cyclictest407-21mta-sts-daemon20:26:311
3332726991815,2cyclictest3607570-21fschecks_count23:46:222
3332726991813,4cyclictest3651071-21unixbench_singl00:26:362
3332726991813,4cyclictest3448876-21kworker/u8:2+flush-8:022:21:212
3332726991813,3cyclictest3423317-21unixbench_multi20:36:382
3332726991813,3cyclictest0-21swapper/223:01:352
3332726991813,3cyclictest0-21swapper/221:55:012
3332726991813,3cyclictest0-21swapper/220:21:312
3332726991813,3cyclictest0-21swapper/220:21:312
3332726991812,4cyclictest0-21swapper/221:06:342
33831442170,2sleep3481ktimers/319:56:293
333272699179,6cyclictest3587816-21fschecks_count23:26:222
333272699179,6cyclictest3537533-21cron22:35:002
333272699178,7cyclictest3624761-21tr00:01:282
333272699178,7cyclictest3355351-21sed19:31:272
3332726991714,2cyclictest0-21swapper/223:11:252
3332726991713,2cyclictest0-21swapper/222:01:222
3332726991712,3cyclictest3434484-21fschecks_time20:51:222
3332726991614,1cyclictest0-21swapper/220:31:272
3332726991612,2cyclictest0-21swapper/223:36:272
3332726991611,3cyclictest0-21swapper/220:46:262
35538862145,5sleep30-21swapper/322:51:263
34579612142,8sleep30-21swapper/321:11:383
34286212142,7sleep30-21swapper/320:45:013
36026372132,7sleep30-21swapper/323:41:233
34724602132,7sleep30-21swapper/321:26:313
33852992133,6sleep30-21swapper/320:01:273
33544102132,6sleep30-21swapper/319:30:003
33446182132,6sleep30-21swapper/319:20:023
36590952122,6sleep30-21swapper/300:36:283
36418982122,6sleep30-21swapper/300:21:203
36412352122,6sleep30-21swapper/300:16:383
36214752122,6sleep30-21swapper/323:56:403
36119162122,5sleep30-21swapper/323:50:013
36073102122,6sleep30-21swapper/323:46:193
35880382122,6sleep30-21swapper/323:26:263
35635662122,6sleep30-21swapper/323:01:263
35609902122,6sleep30-21swapper/322:56:283
35422402122,6sleep30-21swapper/322:36:503
35332302122,6sleep30-21swapper/322:31:243
35317562123,5sleep30-21swapper/322:26:303
35317562123,5sleep30-21swapper/322:26:303
35033592122,6sleep30-21swapper/322:01:183
34823132122,6sleep30-21swapper/321:36:303
34592582122,6sleep30-21swapper/321:16:243
34188142122,6sleep30-21swapper/320:35:023
34078022122,6sleep30-21swapper/320:21:303
34078022122,6sleep30-21swapper/320:21:293
34036002122,6sleep30-21swapper/320:17:003
33732212122,6sleep30-21swapper/319:46:303
33641232122,6sleep30-21swapper/319:38:203
33374002122,6sleep30-21swapper/319:12:193
36519802112,5sleep30-21swapper/300:31:233
36519802112,5sleep30-21swapper/300:31:233
36464902112,5sleep30-21swapper/300:25:013
36324012112,6sleep30-21swapper/300:11:243
36269952112,5sleep30-21swapper/300:05:023
36225922112,5sleep30-21swapper/300:01:253
35983002112,5sleep30-21swapper/323:36:253
35924812112,5sleep30-21swapper/323:31:193
35830522112,6sleep30-21swapper/323:21:243
35774332112,6sleep30-21swapper/323:15:023
35510132112,5sleep30-21swapper/322:46:293
35466092112,5sleep30-21swapper/322:41:313
35230432113,5sleep30-21swapper/322:20:283
35128942112,5sleep30-21swapper/322:10:013
35082162113,5sleep30-21swapper/322:05:443
35029572112,6sleep30-21swapper/321:59:453
34938392112,6sleep30-21swapper/321:51:233
34885102112,5sleep30-21swapper/321:46:173
34839582112,6sleep30-21swapper/321:41:243
34740912112,5sleep30-21swapper/321:31:243
34676572112,5sleep30-21swapper/321:21:333
34488722113,5sleep30-21swapper/321:05:033
34439282112,5sleep30-21swapper/321:00:023
34380232112,5sleep30-21swapper/320:51:363
34300962112,5sleep30-21swapper/320:46:263
34144632112,5sleep30-21swapper/320:31:253
34094742112,5sleep30-21swapper/320:26:233
33941792112,5sleep30-21swapper/320:10:023
33893972112,5sleep30-21swapper/320:06:213
33651102112,6sleep30-21swapper/319:41:253
33398292112,5sleep30-21swapper/319:15:483
34390152102,5sleep30-21swapper/320:55:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional