You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 13:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Jun 17, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25694994842,4cyclictest335557-21systemd-journal00:10:013
25690994845,2cyclictest77820-21kworker/u8:2+flush-259:020:15:002
25681994832,14cyclictest244103-21gpgv22:40:010
25686994236,4cyclictest207537-21latency_hist22:05:001
25694994138,2cyclictest52004-21kworker/u8:4+flush-259:020:00:003
25686993834,3cyclictest275202-21kworker/u8:3+flush-259:023:30:161
25690993734,2cyclictest275202-21kworker/u8:3+flush-259:023:50:012
25686993632,3cyclictest347222-21gpgv00:20:001
25690993532,2cyclictest93325-21kworker/u8:1+flush-259:021:20:002
25686993328,3cyclictest335557-21systemd-journal21:11:191
25686993229,2cyclictest52004-21kworker/u8:4+flush-259:020:10:001
25686993227,4cyclictest169976-21ntpq21:25:221
25681993125,4cyclictest56016-21ntpq19:35:200
25681993125,4cyclictest305872-21latency_hist23:40:010
25686993024,4cyclictest160503-21latency_hist21:20:011
25694992824,3cyclictest275202-21kworker/u8:3+flush-259:023:30:003
25694992824,3cyclictest119025-21kworker/u8:3+flush-259:021:00:013
25690992822,5cyclictest248311-21ntpq22:40:222
25686992823,3cyclictest326713-21/usr/sbin/munin00:00:131
25681992825,2cyclictest31058-21apt-get19:15:110
25681992822,4cyclictest335557-21systemd-journal20:25:000
25681992822,4cyclictest175167-21ntpq21:30:220
25694992722,3cyclictest335557-21systemd-journal20:19:593
25690992724,2cyclictest52004-21kworker/u8:4+flush-259:020:04:592
25686992719,6cyclictest368420-21gpgv00:40:011
25681992721,4cyclictest335557-21systemd-journal23:45:000
25690992622,3cyclictest93325-21kworker/u8:1+flush-259:020:55:172
25686992621,4cyclictest358100-21apt-get00:30:111
25681992620,4cyclictest211876-21ntpq22:05:240
25690992522,2cyclictest103475-21kworker/u8:3+flush-259:020:30:002
25690992521,3cyclictest249440-21kworker/u8:3+flush-259:022:45:262
25690992521,2cyclictest145227-21apt-get21:05:122
25686992522,2cyclictest347725-21base6400:20:001
25681992518,5cyclictest249208-21latency_hist22:45:010
25694992422,1cyclictest61583-21fwupd19:40:263
25694992418,4cyclictest335557-21systemd-journal21:40:273
25690992421,2cyclictest66393-21kworker/u8:0+flush-259:020:19:592
25686992420,3cyclictest66393-21kworker/u8:0+flush-259:020:55:011
25686992419,4cyclictest197278-21latency_hist21:55:011
25686992418,4cyclictest509-21rs:main1
25686992418,4cyclictest254682-21apt-get22:50:131
25686992418,4cyclictest254682-21apt-get22:50:131
25681992421,2cyclictest336868-21true00:10:010
25681992418,4cyclictest335557-21systemd-journal22:49:550
25694992317,4cyclictest82810-21latency_hist20:05:013
25690992319,3cyclictest335557-21systemd-journal20:36:112
25690992319,3cyclictest335557-21systemd-journal20:36:112
25690992319,3cyclictest181677-21kworker/u8:1+flush-259:021:50:012
25690992318,3cyclictest509-21rs:main2
25686992319,3cyclictest66393-21kworker/u8:0+flush-259:020:20:171
25686992317,4cyclictest335557-21systemd-journal23:40:001
25681992320,2cyclictest335557-21systemd-journal22:55:000
25681992320,2cyclictest335557-21systemd-journal22:55:000
25681992317,4cyclictest154408-21ntpq21:10:200
25694992217,3cyclictest20353-21kworker/u8:0+flush-259:019:25:173
25686992219,1cyclictest285271-21latency_hist23:20:011
25686992216,4cyclictest181636-21latency_hist21:40:011
25686992215,5cyclictest29934-21ntpq19:10:231
25681992217,3cyclictest337112-21apt-get00:10:110
2568199221,5cyclictest50921-21ntpq19:30:220
25681992212,9cyclictest60350irq/132-enp0s29f1:rx-019:40:210
25681992211,10cyclictest347087-21cron00:19:590
25694992115,4cyclictest301136-21diskstats23:35:133
25690992117,3cyclictest51796-21kworker/u8:3+flush-259:019:45:242
25690992117,3cyclictest347138-21kworker/u8:0+flush-259:000:40:002
25690992117,3cyclictest269834-21kworker/u8:1+flush-259:023:55:252
25690992115,4cyclictest129398-21latency_hist20:50:002
25686992116,4cyclictest244335-21apt-get22:40:131
25686992115,4cyclictest233657-21apt-get22:30:121
25681992116,4cyclictest76720-21ntpq19:55:210
2568199210,19cyclictest1-21systemd22:22:270
25694992015,3cyclictest98515-21apt-get20:20:113
25690992017,2cyclictest509-21rs:main2
25690992016,3cyclictest41123-21kworker/u8:1+events_unbound19:40:262
25686992017,2cyclictest228236-21idleruntime-cro22:24:591
25686992017,2cyclictest181893-21apt-get21:40:101
2568199207,1cyclictest0-21swapper/022:10:110
2568199205,2cyclictest62502-21cut19:45:130
2568199204,3cyclictest507-21in:imuxsock20:09:250
25681992015,3cyclictest1-21systemd19:55:000
25690991915,3cyclictest52004-21kworker/u8:4+flush-259:020:05:272
25690991914,4cyclictest335557-21systemd-journal23:24:552
25690991913,4cyclictest41123-21kworker/u8:1+flush-259:019:40:002
25690991912,5cyclictest25577-21latency_hist19:10:012
25681991913,4cyclictest335557-21systemd-journal21:01:180
25694991814,3cyclictest269834-21kworker/u8:1+flush-259:023:10:173
25694991814,3cyclictest170243-21kworker/u8:0+flush-259:022:00:013
25694991814,3cyclictest103476-21kworker/u8:5+flush-259:021:35:173
25694991813,4cyclictest212961-21kworker/u8:3+flush-259:022:12:573
25694991812,4cyclictest353114-21diskstats00:25:143
25694991811,5cyclictest192113-21latency_hist21:50:003
25690991811,5cyclictest335557-21systemd-journal19:35:002
25690991810,6cyclictest347292-21cp00:20:002
25686991815,2cyclictest238525-21kworker/u8:2+flush-259:023:05:001
25686991815,2cyclictest176028-21idleruntime-cro21:35:011
25681991815,2cyclictest41096-21cron19:25:010
25681991815,2cyclictest269794-21cron23:05:000
25681991813,4cyclictest335557-21systemd-journal23:33:280
25681991813,4cyclictest186866-21latency_hist21:45:010
2568199180,2cyclictest352841-21wc00:25:000
25694991713,3cyclictest207772-21kworker/u8:1+flush-259:022:29:593
25694991713,3cyclictest108937-21apt-get20:30:123
25694991713,3cyclictest108937-21apt-get20:30:113
25694991713,2cyclictest0-21swapper/323:00:003
25694991710,5cyclictest243645-21apt-get22:40:003
25690991711,4cyclictest335557-21systemd-journal23:15:012
25690991711,4cyclictest254842-21diskstats22:50:152
25690991711,4cyclictest254842-21diskstats22:50:142
25686991714,2cyclictest67267-21cron19:49:591
25686991713,3cyclictest207772-21kworker/u8:1+events_unbound22:30:001
25681991714,2cyclictest60350irq/132-enp0s29f1:rx-020:50:150
25681991714,1cyclictest0-21swapper/023:55:000
25681991713,3cyclictest60350irq/132-enp0s29f1:rx-021:05:220
25681991712,3cyclictest202670-21/usr/sbin/munin22:00:160
2568199170,8cyclictest0-21swapper/000:35:210
2568199170,6cyclictest0-21swapper/000:25:130
2568199170,2cyclictest107101-21tr20:25:180
25694991612,3cyclictest347132-21gpgv00:20:003
25694991612,3cyclictest331687-21kworker/u8:4+flush-259:000:35:003
25690991612,2cyclictest0-21swapper/223:55:002
25686991613,2cyclictest103476-21kworker/u8:5+flush-259:020:40:181
25686991612,2cyclictest0-21swapper/123:15:001
2568199166,2cyclictest60350irq/132-enp0s29f1:rx-023:05:140
25681991614,1cyclictest60350irq/132-enp0s29f1:rx-023:20:130
25681991614,1cyclictest60350irq/132-enp0s29f1:rx-022:55:240
25681991614,1cyclictest60350irq/132-enp0s29f1:rx-021:55:230
25681991610,5cyclictest60350irq/132-enp0s29f1:rx-019:12:220
25694991512,2cyclictest0-21swapper/322:44:593
25694991511,3cyclictest93325-21kworker/u8:1+flush-259:020:25:253
2569099159,4cyclictest331658-21latency_hist00:05:012
25690991512,2cyclictest509-21rs:main2
25690991511,3cyclictest103476-21kworker/u8:5+flush-259:022:26:322
25690991510,3cyclictest103476-21kworker/u8:5+flush-259:021:40:212
2568699159,4cyclictest335557-21systemd-journal22:36:261
2568699158,5cyclictest56937-21latency_hist19:40:021
25686991513,1cyclictest0-21swapper/123:00:001
25686991510,3cyclictest335557-21systemd-journal19:55:001
2568199158,1cyclictest98258-21turbostat20:20:000
25681991513,1cyclictest60350irq/132-enp0s29f1:rx-022:19:150
25681991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:150
25681991513,1cyclictest60350irq/132-enp0s29f1:rx-020:45:180
25681991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:150
25681991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:140
25681991513,1cyclictest60350irq/132-enp0s29f1:rx-020:00:140
25681991512,2cyclictest60350irq/132-enp0s29f1:rx-023:55:190
25681991512,2cyclictest60350irq/132-enp0s29f1:rx-023:26:340
25681991512,2cyclictest60350irq/132-enp0s29f1:rx-022:34:500
25681991512,2cyclictest60350irq/132-enp0s29f1:rx-021:27:300
25681991512,2cyclictest60350irq/132-enp0s29f1:rx-020:14:320
25681991512,2cyclictest0-21swapper/019:30:020
25681991511,3cyclictest222279-21kworker/u8:0+flush-259:022:25:260
2569499149,4cyclictest170243-21kworker/u8:0+flush-259:022:05:283
25694991411,2cyclictest130088-21irqcore20:50:163
25694991411,2cyclictest103476-21kworker/u8:5+flush-259:021:15:013
25694991411,2cyclictest0-21swapper/320:45:003
2569099149,3cyclictest46453-21latency_hist19:30:012
2569099141,4cyclictest212728-21awk22:10:002
25690991411,1cyclictest0-21swapper/219:20:142
2568699149,4cyclictest335557-21systemd-journal20:14:591
2568699149,4cyclictest249450-21/usr/sbin/munin22:45:161
25686991411,2cyclictest93325-21kworker/u8:1+flush-259:020:25:161
25686991411,2cyclictest0-21swapper/119:30:011
25681991412,1cyclictest60350irq/132-enp0s29f1:rx-023:45:190
25681991412,1cyclictest60350irq/132-enp0s29f1:rx-021:47:230
25681991411,2cyclictest60350irq/132-enp0s29f1:rx-023:15:110
25681991411,2cyclictest60350irq/132-enp0s29f1:rx-023:10:290
25681991411,2cyclictest60350irq/132-enp0s29f1:rx-021:20:010
25681991411,2cyclictest60350irq/132-enp0s29f1:rx-020:41:240
25681991411,2cyclictest60350irq/132-enp0s29f1:rx-000:30:300
2569499139,3cyclictest335557-21systemd-journal22:51:423
2569499139,3cyclictest335557-21systemd-journal22:51:423
2569499138,4cyclictest223047-21latency_hist22:20:003
2569499138,4cyclictest103476-21kworker/u8:5+flush-259:020:45:253
25694991310,2cyclictest310143-21ntp_kernel_pll_23:40:203
2569099139,3cyclictest176275-21store21:35:002
25690991311,1cyclictest0-21swapper/219:20:012
25690991310,2cyclictest67611-21cpuspeed_turbos19:50:112
25690991310,2cyclictest295146-21unixbench_singl23:25:252
2568699139,3cyclictest66393-21kworker/u8:0+flush-259:020:30:171
2568699139,3cyclictest66393-21kworker/u8:0+flush-259:020:30:171
25686991310,2cyclictest500-21systemd-logind19:45:001
25681991311,1cyclictest60350irq/132-enp0s29f1:rx-021:35:180
25681991311,1cyclictest60350irq/132-enp0s29f1:rx-021:20:160
25681991311,1cyclictest60350irq/132-enp0s29f1:rx-000:00:120
25681991310,2cyclictest60350irq/132-enp0s29f1:rx-020:30:360
25681991310,2cyclictest60350irq/132-enp0s29f1:rx-020:30:350
2569499129,2cyclictest233831-21fschecks_count22:30:153
2569499129,2cyclictest196780-21unixbench_multi21:50:253
2569499127,3cyclictest249440-21kworker/u8:3+flush-259:022:45:193
2569499126,4cyclictest321336-21latency_hist23:55:013
25694991210,1cyclictest282687-21sort23:15:163
25694991210,1cyclictest0-21swapper/319:54:593
25694991210,1cyclictest0-21swapper/319:15:003
2569099129,2cyclictest358241-21cpuspeed_turbos00:30:132
2569099129,2cyclictest197756-21fschecks_time21:55:132
2569099129,1cyclictest0-21swapper/222:00:192
2569099128,2cyclictest0-21swapper/221:20:262
2569099128,2cyclictest0-21swapper/220:20:162
2569099127,3cyclictest269834-21kworker/u8:1+flush-259:023:16:522
2569099122,2cyclictest1935902cut21:50:182
25690991210,1cyclictest0-21swapper/200:25:132
2568699129,2cyclictest274501-21unixbench_multi23:05:271
2568699129,2cyclictest134918-21cpuspeed_turbos20:55:141
2568699128,3cyclictest311298-21apt-get23:45:121
2568699120,11cyclictest0-21swapper/120:04:591
2569499111,2cyclictest341998-21awk00:15:003
2569099118,1cyclictest0-21swapper/222:25:002
2569099117,3cyclictest332943-21kthreadcore00:05:202
2569099117,2cyclictest153526-21kthreadcore21:10:182
2569099117,2cyclictest0-21swapper/222:57:272
2568699118,1cyclictest0-21swapper/100:30:001
2569499108,1cyclictest0-21swapper/321:25:183
2569499107,2cyclictest173405-21kthreadcore21:30:173
2569499105,4cyclictest335557-21systemd-journal21:05:013
2569099108,1cyclictest0-21swapper/222:10:132
2569099108,1cyclictest0-21swapper/200:20:182
2569099107,2cyclictest176834-21cpuspeed_turbos21:35:142
2569099106,3cyclictest270076-21apt-get23:05:132
2568699107,2cyclictest103476-21kworker/u8:5+flush-259:021:10:011
2568699104,4cyclictest290651-21/usr/sbin/munin23:25:191
256949995,3cyclictest224086-21sed22:20:173
256869997,1cyclictest187542-21irqcore21:45:171
256869997,1cyclictest114223-21cpuspeed_turbos20:35:131
256869997,1cyclictest114223-21cpuspeed_turbos20:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional