You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 03:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Jun 06, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2444992994438,4cyclictest2710653-21latency_hist23:25:013
2444987994441,2cyclictest2549702-21kworker/u8:0+flush-259:021:30:011
2444992994339,2cyclictest2658735-21gpgv22:35:013
2444992994238,3cyclictest2549702-21kworker/u8:0+events_unbound21:45:023
2444992994037,2cyclictest2549702-21kworker/u8:0+events_unbound21:37:303
2444992994036,3cyclictest2471205-21kworker/u8:3+events_unbound19:37:313
2444984994032,6cyclictest335557-21systemd-journal20:55:000
2444987993934,3cyclictest2684909-21kworker/u8:0+flush-259:023:20:221
2444987993933,4cyclictest2742212-21kworker/u8:0+flush-259:023:55:151
2444984993931,6cyclictest2658805-21cp22:35:000
2444992993835,2cyclictest2518170-21kworker/u8:2+events_unbound20:20:253
2444992993834,3cyclictest2653664-21kworker/u8:2+events_unbound22:55:143
2444987993834,3cyclictest2653451-21kworker/u8:1+flush-259:023:00:201
2444992993734,3cyclictest2705517-21kworker/u8:1+events_unbound23:31:183
2444992993734,2cyclictest2752767-21kworker/u8:4+events_unbound00:05:153
2444992993733,3cyclictest2493289-21kworker/u8:0+events_unbound20:10:293
2444992993733,3cyclictest2429517-21kworker/u8:2+events_unbound19:25:293
2444988993731,4cyclictest2518426-21latency_hist20:20:012
2444987993731,4cyclictest2664480-21apt-get22:40:121
2444987993730,5cyclictest2626251-21ntpq22:00:201
2444984993730,5cyclictest2731277-21apt-get23:45:010
2444992993633,2cyclictest2591121-21kworker/u8:4+events_unbound21:32:303
2444988993630,4cyclictest2679701-21latency_hist22:55:002
2444992993533,2cyclictest2752767-21kworker/u8:4+events_unbound00:33:513
2444992993532,2cyclictest2450147-21kworker/u8:1+events_unbound19:55:243
2444992993531,3cyclictest2493289-21kworker/u8:0+events_unbound20:25:303
2444992993431,2cyclictest2752767-21kworker/u8:4+events_unbound00:15:243
2444992993431,2cyclictest2725753-21kworker/u8:3+events_unbound00:22:303
2444992993430,3cyclictest2653664-21kworker/u8:2+events_unbound22:53:303
2444992993427,5cyclictest2788883-21latency_hist00:40:003
2444987993431,2cyclictest2752767-21kworker/u8:4+events_unbound00:25:191
2444987993430,3cyclictest2549702-21kworker/u8:0+flush-259:021:35:201
2444984993430,3cyclictest2617078-21apt-get21:55:120
2444984993430,3cyclictest2617078-21apt-get21:55:110
2444984993428,4cyclictest335557-21systemd-journal22:39:300
2444992993329,3cyclictest2684909-21kworker/u8:0+events_unbound23:19:303
2444987993329,3cyclictest2627164-21kworker/u8:4+flush-259:022:05:151
2444992993229,2cyclictest2725753-21kworker/u8:3+events_unbound23:42:323
2444992993229,2cyclictest2493289-21kworker/u8:0+events_unbound20:15:133
2444988993225,5cyclictest2482538-21cp19:45:012
2444987993128,2cyclictest2549702-21kworker/u8:0+flush-259:021:55:211
2444987993128,2cyclictest2549702-21kworker/u8:0+flush-259:021:55:201
2444987993127,3cyclictest2544801-21apt-get20:45:101
2444984993126,3cyclictest2575733-21apt-get21:15:110
2444984993126,3cyclictest2544187-21kworker/u8:2+events_unbound21:25:160
2444984993125,4cyclictest335557-21systemd-journal19:40:000
2444992993028,2cyclictest2529169-21kworker/u8:3+events_unbound20:35:273
2444992993027,3cyclictest2429517-21kworker/u8:2+events_unbound19:44:313
2444992993027,2cyclictest2627164-21kworker/u8:4+events_unbound22:08:313
2444992993027,2cyclictest2549702-21kworker/u8:0+events_unbound21:11:303
2444992993027,2cyclictest2471205-21kworker/u8:3+events_unbound19:45:273
2444992993026,3cyclictest2642726-21kworker/u8:0+events_unbound22:38:313
2444988993023,5cyclictest2475464-21ntpq19:35:202
2444988992923,4cyclictest2752767-21kworker/u8:4+flush-259:000:40:012
2444987992924,3cyclictest2570326-21latency_hist21:10:001
2444992992824,3cyclictest2590912-21kworker/u8:1+events_unbound21:54:313
2444992992824,3cyclictest2590912-21kworker/u8:1+events_unbound21:54:303
2444992992823,4cyclictest2758199-21apt-get00:10:113
2444992992823,4cyclictest2758199-21apt-get00:10:103
2444987992825,2cyclictest2684909-21kworker/u8:0+events_unbound23:29:311
2444987992825,2cyclictest2560032-21kworker/u8:3+events_unbound22:10:211
2444987992824,3cyclictest353332-21kworker/u8:4+flush-259:019:20:151
2444984992824,3cyclictest2498057-21apt-get20:00:120
2444992992723,3cyclictest2450147-21kworker/u8:1+events_unbound20:50:443
2444992992720,5cyclictest335557-21systemd-journal19:15:003
2444988992719,6cyclictest2555290-21diskstats20:55:142
2444987992723,3cyclictest2471205-21kworker/u8:3+flush-259:019:40:201
2444984992721,4cyclictest2611673-21true21:50:000
2444992992623,2cyclictest2684909-21kworker/u8:0+events_unbound23:45:253
2444992992623,2cyclictest2684909-21kworker/u8:0+events_unbound23:10:253
2444992992623,2cyclictest2560032-21kworker/u8:3+events_unbound21:43:313
2444987992623,2cyclictest2742212-21kworker/u8:0+events_unbound00:00:131
2444987992623,2cyclictest2560032-21kworker/u8:3+events_unbound22:25:181
2444987992623,2cyclictest2450147-21kworker/u8:1+events_unbound20:00:221
2444987992622,3cyclictest2549702-21kworker/u8:0+flush-259:021:00:461
2444987992621,4cyclictest2684909-21kworker/u8:0+events_unbound23:41:191
2444984992619,5cyclictest2720985-21latency_hist23:35:010
2444992992523,2cyclictest2736705-21kworker/u8:1+events_unbound23:51:313
2444992992522,2cyclictest2669397-21kworker/u8:3+events_unbound22:46:313
2444992992522,2cyclictest2653664-21kworker/u8:2+events_unbound23:00:293
2444992992522,2cyclictest2544187-21kworker/u8:2+events_unbound20:44:313
2444992992519,3cyclictest2450147-21kworker/u8:1+events_unbound20:34:243
2444987992519,4cyclictest335557-21systemd-journal23:35:311
2444984992517,6cyclictest2731275-21latency_hist23:45:000
2444992992422,2cyclictest2560032-21kworker/u8:3+events_unbound22:25:263
2444992992421,2cyclictest2450147-21kworker/u8:1+events_unbound19:32:253
2444987992421,2cyclictest2778423-21kworker/u8:0+events_unbound00:35:151
2444987992420,3cyclictest2752767-21kworker/u8:4+events_unbound00:20:141
2444987992420,3cyclictest2669397-21kworker/u8:3+flush-259:023:05:241
2444987992420,3cyclictest2450389-21apt-get19:15:121
2444987992418,4cyclictest2560000-21latency_hist21:00:011
2444984992418,4cyclictest2752767-21kworker/u8:4+flush-259:000:15:300
2444992992320,2cyclictest2627165-21kworker/u8:5+events_unbound22:11:303
2444992992320,2cyclictest2450147-21kworker/u8:1+events_unbound19:19:433
2444992992315,3cyclictest2455540-21apt-get19:20:113
2444988992319,3cyclictest2658617-21latency_hist22:35:002
2444988992319,3cyclictest2450147-21kworker/u8:1+events_unbound20:45:162
2444987992319,3cyclictest2493289-21kworker/u8:0+events_unbound20:25:141
2444987992317,4cyclictest335557-21systemd-journal19:36:291
2444987992317,4cyclictest2533448-21ntpq20:30:211
2444984992319,3cyclictest2621873-21kworker/u8:2+events_unbound22:00:190
2444984992319,2cyclictest2627164-21kworker/u8:4+events_unbound22:20:000
2444984992317,4cyclictest2450147-21kworker/u8:1+flush-259:019:15:160
2444984992316,5cyclictest2596126-21latency_hist21:35:000
2444992992219,2cyclictest2684909-21kworker/u8:0+events_unbound23:38:323
2444992992219,2cyclictest2621873-21kworker/u8:2+events_unbound22:00:303
2444992992219,2cyclictest2429517-21kworker/u8:2+events_unbound19:54:293
2444987992218,3cyclictest2752767-21kworker/u8:4+flush-259:000:15:201
2444987992218,3cyclictest2705517-21kworker/u8:1+flush-259:023:30:171
2444987992218,3cyclictest2611916-21apt-get21:50:121
2444987992218,3cyclictest2611916-21apt-get21:50:111
2444987992218,3cyclictest2590912-21kworker/u8:1+flush-259:021:45:151
2444987992218,3cyclictest2560032-21kworker/u8:3+events_unbound21:40:271
2444987992218,3cyclictest2549702-21kworker/u8:0+events_unbound21:20:201
2444987992218,3cyclictest2529169-21kworker/u8:3+flush-259:020:40:151
2444987992216,4cyclictest2460668-21/usr/sbin/munin19:25:151
2444987992216,2cyclictest2471205-21kworker/u8:3+events_unbound19:45:131
2444984992218,3cyclictest2493289-21kworker/u8:0+flush-259:020:25:210
2444984992218,3cyclictest2450147-21kworker/u8:1+events_unbound19:30:220
2444984992216,4cyclictest2772553-21ntpq00:20:200
2444984992216,4cyclictest2519269-21diskstats20:20:130
2444984992215,5cyclictest2684023-21ntpq22:55:210
2444988992115,4cyclictest2642943-21/usr/sbin/munin22:20:192
2444988992115,4cyclictest2570594-21apt-get21:10:112
2444987992117,3cyclictest2725753-21kworker/u8:3+events_unbound00:32:491
2444987992117,3cyclictest2684909-21kworker/u8:0+flush-259:023:45:221
2444987992117,3cyclictest2653664-21kworker/u8:2+events_unbound23:10:141
2444987992117,3cyclictest2560032-21kworker/u8:3+events_unbound22:30:231
2444987992117,3cyclictest2492866-21/usr/sbin/munin19:55:141
2444992992017,2cyclictest2653664-21kworker/u8:2+events_unbound23:26:173
2444992992017,2cyclictest2560032-21kworker/u8:3+events_unbound21:07:303
2444992992017,2cyclictest2544187-21kworker/u8:2+events_unbound21:27:293
2444992992013,5cyclictest335557-21systemd-journal23:08:303
2444988992017,1cyclictest2725753-21kworker/u8:3+flush-259:023:50:012
2444988992014,3cyclictest2731259-21idleruntime-cro23:44:592
2444987992016,3cyclictest2653664-21kworker/u8:2+events_unbound22:56:321
2444987992015,4cyclictest2493289-21kworker/u8:0+flush-259:020:05:341
2444987992015,3cyclictest2560032-21kworker/u8:3+events_unbound22:22:311
2444984992016,3cyclictest2642726-21kworker/u8:0+flush-259:022:25:010
2444984992016,3cyclictest2580875-21apt-get21:20:130
2444984992015,3cyclictest353332-21kworker/u8:4+flush-259:019:10:160
2444984992014,4cyclictest2700372-21latency_hist23:15:010
2444992991917,2cyclictest2742212-21kworker/u8:0+events_unbound00:00:083
2444992991917,2cyclictest2642726-21kworker/u8:0+events_unbound22:24:573
2444992991916,2cyclictest2642726-21kworker/u8:0+events_unbound22:41:113
2444992991916,2cyclictest2544187-21kworker/u8:2+events_unbound21:15:293
2444992991915,3cyclictest2450147-21kworker/u8:1+events_unbound20:04:243
2444988991914,4cyclictest2742113-21gpgv23:55:012
2444988991912,5cyclictest2767346-21ntpq00:15:202
244498899190,17cyclictest1-21systemd22:00:002
244498899190,17cyclictest1-21systemd22:00:002
2444987991916,2cyclictest2560032-21kworker/u8:3+flush-259:021:12:351
2444987991916,2cyclictest2544187-21kworker/u8:2+flush-259:021:15:251
2444987991916,2cyclictest2450147-21kworker/u8:1+flush-259:020:15:221
2444987991915,3cyclictest2736705-21kworker/u8:1+events_unbound00:10:131
2444987991915,3cyclictest2736705-21kworker/u8:1+events_unbound00:10:131
2444987991915,3cyclictest2529169-21kworker/u8:3+events_unbound20:35:231
2444987991915,3cyclictest2450147-21kworker/u8:1+events_unbound19:30:161
2444987991915,3cyclictest2429517-21kworker/u8:2+events_unbound19:50:171
2444987991914,4cyclictest2659306-21apt-get22:35:131
2444984991914,4cyclictest335557-21systemd-journal22:26:040
2444984991913,4cyclictest335557-21systemd-journal20:00:000
2444984991913,4cyclictest2736705-21kworker/u8:1+flush-259:000:10:160
2444984991913,4cyclictest2736705-21kworker/u8:1+flush-259:000:10:160
2444992991815,2cyclictest2752767-21kworker/u8:4+events_unbound00:27:203
2444992991815,2cyclictest2653664-21kworker/u8:2+events_unbound23:55:033
2444992991815,2cyclictest2590912-21kworker/u8:1+events_unbound21:55:553
2444992991815,2cyclictest2590912-21kworker/u8:1+events_unbound21:55:553
2444992991815,2cyclictest2450147-21kworker/u8:1+events_unbound20:47:203
2444992991815,2cyclictest2450147-21kworker/u8:1+events_unbound20:08:323
2444988991814,3cyclictest2544187-21kworker/u8:2+flush-259:021:25:172
2444987991815,2cyclictest2653664-21kworker/u8:2+flush-259:022:50:161
2444987991814,3cyclictest500-21systemd-logind19:15:001
2444987991814,3cyclictest2560032-21kworker/u8:3+events_unbound22:19:301
2444987991813,3cyclictest2653664-21kworker/u8:2+flush-259:023:15:161
2444984991814,3cyclictest2560032-21kworker/u8:3+events_unbound21:40:110
2444984991813,3cyclictest60350irq/132-enp0s29f1:rx-023:00:210
2444992991714,2cyclictest2549702-21kworker/u8:0+events_unbound21:00:033
2444992991713,3cyclictest2549702-21kworker/u8:0+events_unbound21:21:513
244498899176,2cyclictest2684909-21kworker/u8:0+flush-259:023:40:002
2444988991713,3cyclictest353332-21kworker/u8:4+flush-259:019:11:002
2444988991710,5cyclictest2664215-21latency_hist22:40:002
2444987991715,1cyclictest2725753-21kworker/u8:3+events_unbound23:50:211
2444987991715,1cyclictest2450147-21kworker/u8:1+events_unbound20:50:221
2444987991714,2cyclictest2450147-21kworker/u8:1+events_unbound20:21:301
2444984991714,2cyclictest60350irq/132-enp0s29f1:rx-021:11:060
2444984991714,2cyclictest60350irq/132-enp0s29f1:rx-021:00:130
2444988991613,2cyclictest2640118-21kthreadcore22:15:182
2444988991611,4cyclictest2736705-21kworker/u8:1+flush-259:000:15:002
2444988991611,4cyclictest2736705-21kworker/u8:1+flush-259:000:14:592
2444984991614,1cyclictest60350irq/132-enp0s29f1:rx-022:48:360
2444984991614,1cyclictest60350irq/132-enp0s29f1:rx-020:40:250
2444984991613,2cyclictest60350irq/132-enp0s29f1:rx-021:39:430
2444984991613,2cyclictest60350irq/132-enp0s29f1:rx-020:30:160
2444984991613,2cyclictest60350irq/132-enp0s29f1:rx-020:15:530
2444984991613,2cyclictest60350irq/132-enp0s29f1:rx-019:28:070
2444984991613,2cyclictest60350irq/132-enp0s29f1:rx-000:30:210
2444984991613,2cyclictest1-21systemd00:09:590
2444984991613,2cyclictest0-21swapper/019:55:000
2444984991612,3cyclictest2752767-21kworker/u8:4+flush-259:000:25:210
2444984991612,2cyclictest60350irq/132-enp0s29f1:rx-021:05:130
2444984991611,3cyclictest2632779-21diskstats22:10:120
244498899159,5cyclictest2653664-21kworker/u8:2+flush-259:023:20:002
2444988991512,2cyclictest2502932-21cron20:05:002
2444988991511,3cyclictest2493289-21kworker/u8:0+flush-259:020:10:242
244498499159,4cyclictest2690264-21/usr/sbin/munin23:05:190
244498499158,5cyclictest2513274-21latency_hist20:15:010
2444984991514,1cyclictest60350irq/132-enp0s29f1:rx-020:36:120
2444984991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:260
2444984991513,1cyclictest60350irq/132-enp0s29f1:rx-020:45:090
2444984991512,2cyclictest60350irq/132-enp0s29f1:rx-023:29:390
2444984991512,2cyclictest60350irq/132-enp0s29f1:rx-023:21:140
2444984991512,2cyclictest2679701-21sh22:55:010
2444984991512,2cyclictest2631912-21unixbench_singl22:05:260
2444984991511,3cyclictest2476324-21apt-get19:40:020
2444984991510,4cyclictest2616810-21latency_hist21:55:010
2444984991510,4cyclictest2616810-21latency_hist21:55:000
2444988991410,3cyclictest2450147-21kworker/u8:1+flush-259:020:34:002
2444987991410,3cyclictest2752767-21kworker/u8:4+events_unbound00:05:261
2444987991410,3cyclictest2642726-21kworker/u8:0+events_unbound22:45:021
2444987991410,3cyclictest2560032-21kworker/u8:3+events_unbound21:32:341
2444984991413,1cyclictest60350irq/132-enp0s29f1:rx-023:36:170
2444984991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:160
2444984991411,2cyclictest60350irq/132-enp0s29f1:rx-019:45:130
2444984991410,3cyclictest2748109-21fschecks_time00:00:130
2444988991310,2cyclictest2459957-21unixbench_multi19:20:242
2444988991310,2cyclictest0-21swapper/219:15:222
244498899130,12cyclictest2653442-21munin-run22:30:012
244498799139,3cyclictest2493289-21kworker/u8:0+events_unbound20:10:171
244498899129,2cyclictest509-21rs:main2
244498899129,2cyclictest2694756-21unixbench_singl23:05:242
244498899129,1cyclictest0-21swapper/221:15:222
244498899129,1cyclictest0-21swapper/219:55:002
2444988991210,1cyclictest0-21swapper/222:05:002
244498499129,2cyclictest60350irq/132-enp0s29f1:rx-023:15:130
244498499129,2cyclictest60350irq/132-enp0s29f1:rx-019:20:220
244498499128,3cyclictest60350irq/132-enp0s29f1:rx-022:40:110
244498899117,2cyclictest2553994-21ntpq20:50:212
244498899115,4cyclictest335557-21systemd-journal21:35:292
244498899107,2cyclictest2715360-21unixbench_singl23:25:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional