You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 14:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun May 03, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4491532910,2chrt75-21kworker/3:1-events09:56:133
278992996747,6cyclictest554228-21latency_hist11:45:011
278995995952,5cyclictest242140-21kworker/u8:2+flush-8:008:46:162
278990995850,5cyclictest529532-21latency_hist11:20:010
278992995647,6cyclictest519444-21latency_hist11:10:011
278990995647,6cyclictest549278-21latency_hist11:40:010
278990995443,8cyclictest485172-21diskstats10:36:020
278992995243,6cyclictest588825-21latency_hist12:20:011
278990995140,8cyclictest401062-21diskstats09:11:030
278995995043,4cyclictest519831-21base6411:10:002
278990995040,7cyclictest509533-21latency_hist11:00:010
4697872480,3sleep2371rcuc/210:19:592
278990994842,4cyclictest445936-21kworker/u8:0+events_unbound11:01:180
278990994639,5cyclictest533600-21ntpq11:21:110
278990994635,5cyclictest242140-21kworker/u8:2+flush-8:007:21:130
278995994539,4cyclictest405469-21kworker/u8:2+events_unbound09:46:192
278992994537,6cyclictest3539273-21kworker/u8:3+flush-8:007:26:171
278992994436,6cyclictest280-21systemd-journal09:30:001
278992994435,7cyclictest499955-21/usr/sbin/munin10:51:111
278990994435,6cyclictest474726-21latency_hist10:25:010
278992994237,4cyclictest414615-21ntpq09:21:151
278990994232,4cyclictest534509-21kworker/u8:1+flush-8:011:31:120
27857524228,8sleep30-21swapper/307:06:563
278990994133,5cyclictest300922-21latency_hist07:30:010
278990994130,9cyclictest460451-21diskstats10:11:040
278990994130,9cyclictest460451-21diskstats10:11:030
278995994034,5cyclictest478793-21kworker/u8:1+flush-8:011:16:172
278992994031,6cyclictest370767-21base6408:40:011
278992993933,4cyclictest395544-21latency_hist09:05:011
278992993929,7cyclictest280-21systemd-journal10:01:571
278990993933,4cyclictest405469-21kworker/u8:2+events_unbound09:46:170
278992993829,6cyclictest569032-21latency_hist12:00:011
278990993831,5cyclictest284159-21kworker/u8:0+flush-8:007:36:040
278995993727,8cyclictest365234-21cp08:35:012
278992993731,4cyclictest400812-21apt-get09:11:001
278995993630,4cyclictest284159-21kworker/u8:0+flush-8:009:41:192
278992993625,9cyclictest282983-21ntpq07:11:121
278990993630,5cyclictest284159-21kworker/u8:0+flush-8:008:41:170
278990993630,4cyclictest242140-21kworker/u8:2+events_unbound07:15:010
278992993530,3cyclictest574160-21latency_hist12:05:011
278992993530,3cyclictest574160-21latency_hist12:05:011
278992993528,5cyclictest459875-21latency_hist10:10:011
278992993527,6cyclictest280-21systemd-journal09:31:581
278990993528,5cyclictest445936-21kworker/u8:0+flush-8:010:01:180
278990993526,6cyclictest242140-21kworker/u8:2+flush-8:008:16:130
278990993525,8cyclictest574582-21diskstats12:06:030
27899099350,32cyclictest1-21systemd11:15:010
278992993428,4cyclictest445936-21kworker/u8:0+flush-8:010:41:031
278992993428,4cyclictest280-21systemd-journal11:00:581
278992993427,5cyclictest340784-21apt-get08:10:591
278992993426,6cyclictest283864-21apt-get07:15:031
278992993425,6cyclictest340462-21latency_hist08:10:011
278992993425,6cyclictest340462-21latency_hist08:10:011
278990993428,5cyclictest3539273-21kworker/u8:3+flush-8:008:06:030
278990993428,5cyclictest3539273-21kworker/u8:3+flush-8:008:06:030
278990993427,5cyclictest454934-21kworker/u8:3+flush-8:010:26:160
278990993423,9cyclictest449105-21ntpq09:56:120
27899099340,32cyclictest1-21systemd09:29:570
278995993324,7cyclictest280-21systemd-journal09:20:002
278992993329,3cyclictest3539273-21kworker/u8:3+flush-8:007:39:521
278992993323,7cyclictest320734-21latency_hist07:50:011
278990993326,5cyclictest280-21systemd-journal12:26:230
278990993325,5cyclictest325240-21grep07:51:200
2786302333,9sleep10-21swapper/107:07:371
278995993227,4cyclictest478793-21kworker/u8:1+flush-8:011:11:172
278992993225,5cyclictest564131-21grep11:55:001
278992993224,5cyclictest315771-21latency_hist07:45:011
278992993223,7cyclictest280-21systemd-journal08:40:011
278990993226,4cyclictest440416-21apt-get09:50:580
278990993225,5cyclictest3539273-21kworker/u8:3+events_unbound09:06:160
2785912324,8sleep20-21swapper/207:07:072
278995993123,6cyclictest280-21systemd-journal08:55:012
278992993128,2cyclictest445936-21kworker/u8:0+flush-8:010:11:021
278992993128,2cyclictest445936-21kworker/u8:0+flush-8:010:11:021
278992993126,3cyclictest522157-21kthreadcore11:11:091
278992993125,4cyclictest280-21systemd-journal12:31:231
278992993124,5cyclictest589159-21apt-get12:20:571
278992993121,8cyclictest284159-21kworker/u8:0+flush-8:008:01:131
278990993127,3cyclictest284159-21kworker/u8:0+flush-8:008:35:340
278990993124,5cyclictest445936-21kworker/u8:0+flush-8:011:06:050
278990993018,9cyclictest280-21systemd-journal10:20:000
278995992925,3cyclictest300527-21unixbench_multi07:26:172
278995992923,4cyclictest435177-21kworker/u8:1+events_unbound09:56:132
278992992924,4cyclictest478793-21kworker/u8:1+flush-8:010:46:151
278992992922,5cyclictest470094-21apt-get10:20:591
278992992921,6cyclictest465134-21apt-get10:15:581
278990992926,2cyclictest592846-21needreboot12:21:100
278990992925,3cyclictest3539273-21kworker/u8:3+events_unbound08:01:070
278990992925,3cyclictest278984-21cyclictest08:21:020
278990992924,4cyclictest445936-21kworker/u8:0+flush-8:012:14:280
278990992924,4cyclictest3539273-21kworker/u8:3+flush-8:008:11:040
278990992921,5cyclictest385268-21grep08:51:200
278995992820,6cyclictest370303-21apt-get08:40:012
278995992818,8cyclictest280-21systemd-journal09:23:572
278992992819,7cyclictest484601-21latency_hist10:35:001
278990992824,3cyclictest284159-21kworker/u8:0+flush-8:008:31:190
278990992822,5cyclictest411614-21kworker/u8:1+flush-8:009:23:280
278990992819,7cyclictest603918-21/usr/sbin/munin12:36:110
278990992818,7cyclictest534509-21kworker/u8:1+flush-8:011:46:130
278995992722,3cyclictest391213-21uniq09:01:032
278995992721,4cyclictest280-21systemd-journal10:40:582
278992992723,3cyclictest395954-21aten2_r5power_p09:06:011
278992992723,3cyclictest360190-21cron08:30:011
278992992718,7cyclictest475026-21/usr/sbin/munin10:26:111
278990992723,3cyclictest445936-21kworker/u8:0+events_unbound11:41:140
278990992722,3cyclictest445936-21kworker/u8:0+events_unbound11:26:190
278990992721,4cyclictest445936-21kworker/u8:0+events_unbound10:51:170
278990992721,4cyclictest391141-21cpuspeed_turbos09:01:020
278990992720,6cyclictest430886-21fschecks_time09:41:040
278990992720,5cyclictest445936-21kworker/u8:0+events_unbound12:00:000
278990992720,5cyclictest425257-21cron09:35:000
278990992718,7cyclictest495065-21diskstats10:46:040
278990992717,8cyclictest569626-21diskstats12:01:040
278990992717,8cyclictest569626-21diskstats12:01:030
278995992623,2cyclictest564770-21fschecks_time11:56:032
278995992623,2cyclictest485009-21aten2_r5power_p10:36:002
278995992623,2cyclictest464814-21cat10:15:002
278995992623,2cyclictest464814-21cat10:15:002
278992992623,2cyclictest295952-21cron07:25:001
278992992622,2cyclictest549316-21systemd-run11:40:001
278992992621,3cyclictest20977-21cron12:10:001
278992992619,5cyclictest360502-21/usr/sbin/munin08:31:141
278992992617,7cyclictest409495-21ntpq09:16:111
278992992616,8cyclictest425844-21diskstats09:36:031
278990992624,1cyclictest242140-21kworker/u8:2+events_unbound07:11:120
278990992620,4cyclictest242140-21kworker/u8:2+events_unbound07:31:060
278990992620,4cyclictest1-21systemd10:32:370
278990992617,6cyclictest280-21systemd-journal09:38:570
278990992617,6cyclictest242140-21kworker/u8:2+events_unbound08:26:130
2779732265,13sleep0278004-21ntpq07:06:130
278995992521,3cyclictest3539273-21kworker/u8:3+flush-8:007:16:192
278995992521,2cyclictest334579-21needreboot08:01:122
278995992520,4cyclictest344985-21unixbench_multi08:11:182
278995992512,8cyclictest400812-21apt-get09:11:022
27899599250,12cyclictest295960-21awk07:25:002
278992992521,2cyclictest559158-21sh11:50:001
278992992519,4cyclictest280-21systemd-journal12:36:571
278992992513,3cyclictest0-21swapper/110:56:171
27899299250,23cyclictest321296-21cpuspeed_turbos07:51:031
278990992519,4cyclictest3539273-21kworker/u8:3+flush-8:008:56:180
278990992519,4cyclictest326886-21tr07:56:080
4292122240,5sleep3481ktimers/309:36:103
278995992420,3cyclictest454934-21kworker/u8:3+events_unbound10:26:212
278995992419,4cyclictest20977-21cron09:00:012
278995992416,6cyclictest280-21systemd-journal10:05:002
278992992420,2cyclictest0-21swapper/111:16:161
278992992420,2cyclictest0-21swapper/107:31:071
278990992420,3cyclictest445936-21kworker/u8:0+events_unbound12:31:060
278990992419,3cyclictest0-21swapper/010:06:170
278990992418,4cyclictest445936-21kworker/u8:0+events_unbound10:41:070
278995992318,4cyclictest534509-21kworker/u8:1+flush-8:011:36:082
278995992311,4cyclictest0-21swapper/208:26:122
278992992319,3cyclictest449953-21cron10:00:001
278992992319,2cyclictest376795-21irqrtprio08:46:071
278992992319,2cyclictest0-21swapper/109:41:031
278992992318,4cyclictest444657-21unixbench_multi09:51:191
278990992317,4cyclictest311256-21grep07:41:000
27899599222,14cyclictest325961-21apt-get07:56:012
278995992219,2cyclictest375180-21unixbench_singl08:41:192
278995992218,3cyclictest563724-21unixbench_multi11:51:202
278995992218,3cyclictest283858-21latency_hist07:15:012
278995992217,4cyclictest445936-21kworker/u8:0+flush-8:010:56:072
278992992218,2cyclictest0-21swapper/111:26:011
278992992217,3cyclictest0-21swapper/111:21:181
278992992214,6cyclictest325961-21apt-get07:55:581
278992992213,7cyclictest380960-21/usr/sbin/munin08:51:121
278990992217,4cyclictest3539273-21kworker/u8:3+flush-8:008:48:290
278990992217,4cyclictest284159-21kworker/u8:0+events_unbound09:16:180
278995992118,2cyclictest354947-21unixbench_singl08:21:202
278995992118,2cyclictest305496-21unixbench_multi07:31:202
278995992116,4cyclictest529242-21kworker/u8:3+flush-8:011:21:092
278995992115,5cyclictest340065-21unixbench_multi08:06:192
278995992115,5cyclictest340065-21unixbench_multi08:06:192
278992992117,2cyclictest0-21swapper/111:31:071
278992992115,4cyclictest0-21swapper/112:26:011
278992992113,6cyclictest280-21systemd-journal12:11:581
278990992117,3cyclictest534509-21kworker/u8:1+flush-8:011:51:190
278990992115,4cyclictest584222-21aten2_r5power_c12:16:000
27899599202,13cyclictest579243-21apt-get12:10:592
278995992016,3cyclictest0-21swapper/209:40:002
278995992016,2cyclictest311367-21cpuspeed_turbos07:41:002
278995992012,6cyclictest458615-21tr10:06:092
278995992011,7cyclictest481420-21seq10:31:102
278992992018,1cyclictest0-21swapper/108:16:161
278992992016,2cyclictest0-21swapper/110:36:001
278992992016,2cyclictest0-21swapper/108:21:091
278992992012,6cyclictest280-21systemd-journal09:46:561
278995991916,2cyclictest603619-21turbostat.cron12:35:002
278995991915,2cyclictest0-21swapper/209:51:192
278995991914,3cyclictest0-21swapper/210:50:012
278995991913,2cyclictest0-21swapper/207:51:182
278992991914,4cyclictest387283-21kthreadcore08:56:081
278990991915,2cyclictest0-21swapper/007:46:060
27899599189,7cyclictest551704-21tr11:41:092
278995991814,2cyclictest0-21swapper/211:46:112
278995991813,4cyclictest417868-21kworker/u8:3+events_unbound09:33:582
278995991813,3cyclictest593382-21unixbench_multi12:21:182
278995991810,6cyclictest280-21systemd-journal11:35:002
278995991714,2cyclictest400120-21unixbench_multi09:06:192
278995991713,2cyclictest535128-21fschecks_time11:26:032
278995991713,2cyclictest415926-21cpuspeed_turbos09:26:022
278995991713,2cyclictest0-21swapper/212:05:002
278995991713,2cyclictest0-21swapper/212:05:002
27899599171,12cyclictest470094-21apt-get10:20:592
27899599162,2cyclictest0-21swapper/211:03:332
27899599162,2cyclictest0-21swapper/207:47:052
278995991613,2cyclictest0-21swapper/212:35:552
278995991613,1cyclictest0-21swapper/210:51:162
278995991612,2cyclictest594312-21cpuspeed_turbos12:26:012
278995991612,2cyclictest0-21swapper/208:15:362
278995991611,3cyclictest0-21swapper/212:06:182
278995991611,3cyclictest0-21swapper/207:36:092
3760482152,8sleep30-21swapper/308:45:593
27899599152,12cyclictest0-21swapper/212:15:242
2998542142,8sleep30-21swapper/307:26:103
5937972132,6sleep30-21swapper/312:25:013
5228522133,6sleep30-21swapper/311:11:103
5139052132,7sleep30-21swapper/311:01:193
4945142132,6sleep30-21swapper/310:45:023
3955682132,6sleep30-21swapper/309:05:023
3704112132,6sleep30-21swapper/308:40:023
3306142132,6sleep30-21swapper/308:00:003
3048402132,7sleep30-21swapper/307:31:123
6036062122,5sleep30-21swapper/312:35:013
5937522122,6sleep30-21swapper/312:24:583
5849222122,6sleep30-21swapper/312:16:073
5752152123,5sleep30-21swapper/312:06:083
5693802122,6sleep30-21swapper/312:01:023
5693802122,6sleep30-21swapper/312:01:023
5595032122,6sleep30-21swapper/311:51:033
5542442122,5sleep30-21swapper/311:45:013
5498622122,6sleep30-21swapper/311:41:033
5445662122,6sleep30-21swapper/311:35:023
5394102122,6sleep30-21swapper/311:29:593
5286252122,6sleep30-21swapper/311:16:123
5049432122,6sleep30-21swapper/310:56:013
4858092122,6sleep30-21swapper/310:36:063
4788902122,6sleep30-21swapper/310:26:163
4744772122,6sleep30-21swapper/310:21:593
4571342122,5sleep30-21swapper/310:06:103
4511912122,6sleep30-21swapper/310:01:083
4450062122,6sleep30-21swapper/309:54:573
4302592122,5sleep30-21swapper/309:40:013
4204492122,6sleep30-21swapper/309:30:023
4202102122,6sleep30-21swapper/309:28:583
4007492122,6sleep30-21swapper/309:10:363
3954462123,5sleep30-21swapper/309:03:583
3853092122,6sleep30-21swapper/308:51:223
3694482121,7sleep30-21swapper/308:36:133
3547632122,6sleep30-21swapper/308:21:203
3418042123,5sleep30-21swapper/308:11:093
3399292122,6sleep30-21swapper/308:06:193
3399292122,6sleep30-21swapper/308:06:193
3296152122,6sleep30-21swapper/307:56:123
3206392122,6sleep30-21swapper/307:48:583
3058732122,5sleep30-21swapper/307:35:013
2870612122,6sleep30-21swapper/307:16:073
2837612122,6sleep30-21swapper/307:13:573
6039482112,5sleep30-21swapper/312:36:013
5789442112,5sleep30-21swapper/312:10:003
5659542112,5sleep30-21swapper/311:56:093
5396762112,6sleep30-21swapper/311:30:243
5302492112,5sleep30-21swapper/311:21:053
5186732112,5sleep30-21swapper/311:06:173
5043032112,5sleep30-21swapper/310:51:203
4935352112,5sleep30-21swapper/310:41:133
4802402112,5sleep30-21swapper/310:31:063
4676142112,5sleep30-21swapper/310:16:093
4606422112,6sleep30-21swapper/310:11:073
4606422112,6sleep30-21swapper/310:11:073
4399682113,5sleep30-21swapper/309:48:363
4107002112,5sleep30-21swapper/309:20:593
4062082112,5sleep30-21swapper/309:16:063
3859172112,5sleep30-21swapper/308:55:593
3605312112,5sleep30-21swapper/308:31:033
3556162112,5sleep30-21swapper/308:26:023
3210652112,5sleep30-21swapper/307:51:023
3113972112,5sleep30-21swapper/307:41:033
2912752112,6sleep30-21swapper/307:20:203
3455982102,5sleep30-21swapper/308:15:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional