You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 15:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Aug 02, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
416799995248,3cyclictest650447-21kworker/u8:2+flush-259:023:19:592
416799994946,2cyclictest713288-21kworker/u8:3+events_unbound00:40:012
416804994845,2cyclictest379201-21kworker/u8:1+events_unbound19:31:563
416804994844,3cyclictest754947-21base6400:35:013
416804994744,2cyclictest510707-21kworker/u8:2+events_unbound20:54:043
416804994743,3cyclictest650447-21kworker/u8:2+events_unbound23:12:033
416804994643,3cyclictest427100-21kworker/u8:2+events_unbound19:27:043
416796994643,2cyclictest490158-21kworker/u8:4+events_unbound20:33:041
416804994542,2cyclictest594073-21kworker/u8:1+events_unbound22:51:033
416799994542,2cyclictest490158-21kworker/u8:4+events_unbound22:00:012
416796994542,2cyclictest594073-21kworker/u8:1+events_unbound22:49:021
416796994541,3cyclictest583997-21kworker/u8:0+events_unbound22:04:021
416796994441,2cyclictest490158-21kworker/u8:4+events_unbound21:10:261
416804994340,2cyclictest677349-21kworker/u8:0+events_unbound23:57:453
416799994338,4cyclictest335557-21systemd-journal23:30:002
416799994338,4cyclictest335557-21systemd-journal23:29:592
416796994340,2cyclictest661155-21kworker/u8:0+events_unbound23:06:051
416796994339,3cyclictest629878-21kworker/u8:0+events_unbound22:32:341
416804994239,2cyclictest551157-21kworker/u8:0+events_unbound21:26:023
416799994236,2cyclictest490158-21kworker/u8:4+events_unbound21:40:242
416796994239,2cyclictest557403-21kworker/u8:1+events_unbound21:32:111
416796994239,2cyclictest401547-21kworker/u8:0+events_unbound19:20:031
416796994239,2cyclictest379201-21kworker/u8:1+events_unbound19:28:021
416799994134,3cyclictest453290-21kworker/u8:3+flush-259:019:55:212
416796994138,2cyclictest594073-21kworker/u8:1+events_unbound22:15:011
416796994137,3cyclictest490158-21kworker/u8:4+events_unbound20:35:021
416796994135,2cyclictest594073-21kworker/u8:1+events_unbound22:25:241
416799994037,2cyclictest568223-21kworker/u8:3+flush-259:021:35:152
416796994037,2cyclictest677349-21kworker/u8:0+events_unbound23:35:011
416796993936,2cyclictest490158-21kworker/u8:4+events_unbound20:44:021
416796993936,2cyclictest401547-21kworker/u8:0+events_unbound19:34:031
416794993933,4cyclictest614726-21latency_hist22:20:020
416799993835,2cyclictest489104-21kworker/u8:0+events_unbound20:55:202
416799993832,4cyclictest515857-21latency_hist20:45:002
416796993835,2cyclictest713288-21kworker/u8:3+events_unbound00:05:001
416796993835,2cyclictest630225-21kworker/u8:3+events_unbound22:50:031
416796993835,2cyclictest490158-21kworker/u8:4+events_unbound21:22:021
416796993835,2cyclictest453290-21kworker/u8:3+events_unbound20:16:021
416799993733,3cyclictest630225-21kworker/u8:3+events_unbound22:57:212
416799993733,3cyclictest594073-21kworker/u8:1+events_unbound22:30:192
416796993735,2cyclictest594073-21kworker/u8:1+events_unbound22:05:041
416796993735,2cyclictest401547-21kworker/u8:0+events_unbound19:45:211
416796993734,3cyclictest713288-21kworker/u8:3+events_unbound00:05:051
416796993734,2cyclictest594073-21kworker/u8:1+events_unbound22:42:021
416794993731,4cyclictest568211-21latency_hist21:35:000
416804993630,4cyclictest692864-21apt-get23:35:133
416799993633,2cyclictest489104-21kworker/u8:0+flush-259:020:35:202
416799993633,2cyclictest358534-21kworker/u8:2+events_unbound19:10:252
416799993632,3cyclictest594073-21kworker/u8:1+flush-259:022:05:242
416796993633,2cyclictest713288-21kworker/u8:3+events_unbound00:32:411
416796993633,2cyclictest594073-21kworker/u8:1+events_unbound22:20:151
416796993633,2cyclictest490158-21kworker/u8:4+events_unbound21:55:251
416796993630,4cyclictest708113-21latency_hist23:50:011
416796993532,2cyclictest713288-21kworker/u8:3+events_unbound00:20:161
416796993532,2cyclictest677349-21kworker/u8:0+flush-259:023:32:281
416796993532,2cyclictest677349-21kworker/u8:0+events_unbound23:50:161
416796993532,2cyclictest671705-21kworker/u8:3+events_unbound23:25:221
416796993532,2cyclictest671705-21kworker/u8:3+events_unbound23:25:211
416796993532,2cyclictest401547-21kworker/u8:0+events_unbound20:05:161
416796993532,2cyclictest379201-21kworker/u8:1+events_unbound19:36:571
416799993431,2cyclictest677349-21kworker/u8:0+flush-259:023:50:202
416799993430,3cyclictest650447-21kworker/u8:2+flush-259:023:10:162
416794993428,4cyclictest437408-21latency_hist19:30:010
416799993330,2cyclictest677349-21kworker/u8:0+flush-259:023:30:162
416799993330,2cyclictest677349-21kworker/u8:0+events_unbound23:35:032
416799993330,2cyclictest594073-21kworker/u8:1+events_unbound22:44:022
416799993329,3cyclictest478947-21kworker/u8:2+events_unbound20:14:022
416796993330,2cyclictest453290-21kworker/u8:3+events_unbound20:20:131
416799993228,3cyclictest697800-21kworker/u8:2+events_unbound23:45:252
416799993228,3cyclictest630225-21kworker/u8:3+events_unbound22:35:042
416796993229,2cyclictest490158-21kworker/u8:4+events_unbound20:50:211
416796993227,2cyclictest478947-21kworker/u8:2+events_unbound20:10:241
416799993128,2cyclictest594073-21kworker/u8:1+flush-259:023:00:142
416799993127,3cyclictest677349-21kworker/u8:0+events_unbound23:40:212
416799993127,3cyclictest453290-21kworker/u8:3+flush-259:020:20:242
416796993128,2cyclictest583997-21kworker/u8:0+events_unbound22:10:241
416796993026,3cyclictest713288-21kworker/u8:3+events_unbound00:15:121
416796993026,3cyclictest469091-21apt-get20:00:111
416796993025,3cyclictest495411-21/usr/sbin/munin20:25:221
416794993026,3cyclictest490158-21kworker/u8:4+events_unbound22:03:020
416794993022,5cyclictest462785-21ntpq19:50:220
416804992926,2cyclictest468846-21kworker/u8:1+events_unbound20:00:263
416799992926,2cyclictest677349-21kworker/u8:0+events_unbound00:09:022
416794992925,3cyclictest671705-21kworker/u8:3+flush-259:023:35:000
416794992925,3cyclictest510952-21apt-get20:40:140
416794992923,4cyclictest744588-21/usr/sbin/munin00:25:140
416804992825,2cyclictest677349-21kworker/u8:0+events_unbound23:31:053
416804992825,2cyclictest650447-21kworker/u8:2+events_unbound23:22:043
416804992825,2cyclictest453290-21kworker/u8:3+events_unbound20:37:043
416799992824,3cyclictest713288-21kworker/u8:3+flush-259:000:20:252
416799992824,3cyclictest453290-21kworker/u8:3+events_unbound19:53:022
416796992826,2cyclictest734012-21kworker/u8:0+events_unbound00:28:521
416796992825,2cyclictest490158-21kworker/u8:4+events_unbound21:02:211
416794992824,3cyclictest490158-21kworker/u8:4+events_unbound20:53:030
416794992821,4cyclictest335557-21systemd-journal21:27:030
416799992722,3cyclictest677349-21kworker/u8:0+events_unbound23:55:042
416799992722,2cyclictest427100-21kworker/u8:2+events_unbound19:25:132
416796992726,1cyclictest489104-21kworker/u8:0+events_unbound21:05:241
416796992725,2cyclictest489104-21kworker/u8:0+events_unbound20:55:241
416796992723,2cyclictest401547-21kworker/u8:0+events_unbound19:57:021
416794992724,2cyclictest510707-21kworker/u8:2+events_unbound21:00:040
416794992723,3cyclictest453290-21kworker/u8:3+flush-259:020:30:000
416794992722,3cyclictest568475-21apt-get21:35:130
416794992721,4cyclictest656015-21latency_hist23:00:000
416804992623,2cyclictest453290-21kworker/u8:3+events_unbound19:49:023
416799992623,2cyclictest630225-21kworker/u8:3+events_unbound23:05:242
416799992623,2cyclictest583997-21kworker/u8:0+events_unbound21:50:142
416799992623,2cyclictest401547-21kworker/u8:0+events_unbound19:40:242
416799992622,3cyclictest490158-21kworker/u8:4+events_unbound20:31:042
416799992619,2cyclictest749573-21kworker/u8:2+events_unbound00:30:152
416796992624,2cyclictest728676-21kworker/u8:2+events_unbound00:10:151
416796992619,5cyclictest521113-21latency_hist20:50:011
416794992622,3cyclictest630225-21kworker/u8:3+events_unbound22:40:000
416794992622,3cyclictest490158-21kworker/u8:4+flush-259:021:47:120
416794992622,3cyclictest490158-21kworker/u8:4+events_unbound21:57:030
416794992622,3cyclictest468846-21kworker/u8:1+events_unbound20:05:240
416804992523,2cyclictest594073-21kworker/u8:1+events_unbound22:27:163
416804992523,2cyclictest468846-21kworker/u8:1+events_unbound20:05:263
416804992523,2cyclictest453290-21kworker/u8:3+events_unbound19:51:033
416804992522,2cyclictest713288-21kworker/u8:3+events_unbound00:21:033
416804992522,2cyclictest453290-21kworker/u8:3+events_unbound20:48:023
416799992522,3cyclictest489104-21kworker/u8:0+events_unbound21:08:022
416799992522,2cyclictest713288-21kworker/u8:3+events_unbound00:17:472
416799992522,2cyclictest490158-21kworker/u8:4+events_unbound21:20:112
416799992521,3cyclictest583997-21kworker/u8:0+events_unbound22:11:052
416796992523,2cyclictest630225-21kworker/u8:3+events_unbound22:35:261
416796992522,2cyclictest707882-21kworker/u8:1+events_unbound23:58:031
416796992521,3cyclictest490158-21kworker/u8:4+events_unbound21:17:021
416794992522,2cyclictest489104-21kworker/u8:0+flush-259:021:05:150
416794992521,3cyclictest677349-21kworker/u8:0+events_unbound23:37:030
416794992519,4cyclictest547025-21latency_hist21:15:010
416804992421,2cyclictest358534-21kworker/u8:2+events_unbound19:12:033
416804992419,4cyclictest634528-21ntpq22:35:243
416799992421,2cyclictest490158-21kworker/u8:4+flush-259:022:00:242
416799992421,2cyclictest490158-21kworker/u8:4+events_unbound22:23:042
416799992421,2cyclictest379201-21kworker/u8:1+events_unbound19:15:122
416799992420,3cyclictest542081-21kworker/u8:3+events_unbound21:12:222
416799992420,3cyclictest490158-21kworker/u8:4+events_unbound21:47:272
416799992419,3cyclictest640561-21kworker/u8:0+events_unbound22:45:182
416799992419,2cyclictest453290-21kworker/u8:3+events_unbound20:25:192
416794992420,3cyclictest542081-21kworker/u8:3+events_unbound21:20:220
416794992419,4cyclictest490158-21kworker/u8:4+events_unbound21:52:040
416804992320,2cyclictest630225-21kworker/u8:3+events_unbound23:00:033
416804992320,2cyclictest379201-21kworker/u8:1+events_unbound19:39:043
416799992320,2cyclictest401547-21kworker/u8:0+events_unbound19:21:032
416796992321,2cyclictest650447-21kworker/u8:2+events_unbound23:15:171
416796992321,2cyclictest401547-21kworker/u8:0+events_unbound19:40:281
416796992319,3cyclictest651074-21/usr/sbin/munin22:55:221
416794992320,2cyclictest401547-21kworker/u8:0+flush-259:019:11:020
416794992318,3cyclictest489104-21kworker/u8:0+events_unbound20:35:220
416794992317,4cyclictest604649-21/usr/sbin/munin22:10:140
416804992219,2cyclictest565506-21kworker/u8:2+events_unbound21:36:033
416804992219,2cyclictest490158-21kworker/u8:4+events_unbound21:19:043
416799992219,2cyclictest489104-21kworker/u8:0+flush-259:021:00:242
416799992218,3cyclictest557403-21kworker/u8:1+events_unbound21:27:112
416799992216,2cyclictest453290-21kworker/u8:3+events_unbound20:15:252
416794992218,3cyclictest677380-21apt-get23:20:140
416794992218,3cyclictest490158-21kworker/u8:4+events_unbound20:47:060
416794992218,3cyclictest401547-21kworker/u8:0+events_unbound19:30:190
416794992216,4cyclictest509-21rs:main0
416804992118,2cyclictest630225-21kworker/u8:3+events_unbound22:57:043
416804992118,2cyclictest542081-21kworker/u8:3+events_unbound21:22:103
416804992118,2cyclictest478947-21kworker/u8:2+events_unbound20:10:043
416799992118,2cyclictest713288-21kworker/u8:3+events_unbound00:10:032
416799992118,2cyclictest551157-21kworker/u8:0+events_unbound21:15:242
416796992116,3cyclictest509-21rs:main1
416796992116,2cyclictest565506-21kworker/u8:2+events_unbound21:44:041
416796992114,5cyclictest671881-21cp23:15:001
416794992118,2cyclictest713261-21idleruntime-cro23:55:000
416794992117,3cyclictest594073-21kworker/u8:1+flush-259:022:05:210
416794992117,3cyclictest565506-21kworker/u8:2+events_unbound21:42:130
416794992117,3cyclictest489104-21kworker/u8:0+events_unbound21:00:010
416794992116,4cyclictest661155-21kworker/u8:0+events_unbound23:09:040
416799992016,3cyclictest713288-21kworker/u8:3+events_unbound00:02:032
416799992015,4cyclictest442589-21gpgv19:35:002
416796992018,2cyclictest707882-21kworker/u8:1+events_unbound00:37:041
416794992016,3cyclictest713288-21kworker/u8:3+events_unbound00:20:140
416794992016,3cyclictest677349-21kworker/u8:0+flush-259:000:00:250
416794992016,3cyclictest594073-21kworker/u8:1+events_unbound22:30:160
416794992016,3cyclictest437451-21kworker/u8:3+flush-259:019:35:210
416794992016,3cyclictest401547-21kworker/u8:0+events_unbound19:45:180
416794992013,5cyclictest618952-21ntpq22:20:200
416804991917,2cyclictest583997-21kworker/u8:0+events_unbound21:54:563
416804991917,1cyclictest468837-21idleruntime-cro20:00:013
416799991917,2cyclictest557403-21kworker/u8:1+flush-259:021:32:242
416799991916,2cyclictest630225-21kworker/u8:3+events_unbound22:52:202
416799991915,3cyclictest521377-21apt-get20:50:122
416796991916,2cyclictest551157-21kworker/u8:0+events_unbound21:25:191
416794991916,2cyclictest677108-21sh23:20:000
416804991816,2cyclictest713288-21kworker/u8:3+events_unbound00:16:043
416804991816,2cyclictest671705-21kworker/u8:3+events_unbound23:29:283
416804991816,2cyclictest671705-21kworker/u8:3+events_unbound23:29:273
416804991816,2cyclictest661155-21kworker/u8:0+events_unbound23:05:023
416804991815,2cyclictest609351-21kworker/u8:2+events_unbound22:19:203
416804991815,2cyclictest594073-21kworker/u8:1+events_unbound23:17:413
416804991815,2cyclictest490158-21kworker/u8:4+events_unbound21:49:203
416804991815,2cyclictest453290-21kworker/u8:3+events_unbound20:18:243
416804991814,3cyclictest489104-21kworker/u8:0+flush-259:020:45:003
416796991815,2cyclictest630225-21kworker/u8:3+events_unbound23:02:211
416794991815,2cyclictest707882-21kworker/u8:1+events_unbound23:55:200
416794991815,2cyclictest671705-21kworker/u8:3+flush-259:023:25:210
416794991815,2cyclictest671705-21kworker/u8:3+flush-259:023:25:200
416794991814,3cyclictest640561-21kworker/u8:0+events_unbound22:45:230
416794991814,3cyclictest453290-21kworker/u8:3+events_unbound20:24:030
416794991814,3cyclictest401547-21kworker/u8:0+events_unbound19:55:030
416794991814,3cyclictest379201-21kworker/u8:1+events_unbound19:15:180
41680499178,1cyclictest0-21swapper/323:40:203
416804991715,2cyclictest490158-21kworker/u8:4+events_unbound22:24:563
416804991714,2cyclictest713288-21kworker/u8:3+events_unbound00:01:393
416804991714,2cyclictest707882-21kworker/u8:1+events_unbound00:35:043
416804991710,4cyclictest583997-21kworker/u8:0+events_unbound21:59:053
416799991713,3cyclictest734012-21kworker/u8:0+events_unbound00:27:412
416796991714,2cyclictest490158-21kworker/u8:4+events_unbound21:45:031
416796991714,2cyclictest453290-21kworker/u8:3+events_unbound19:54:581
416794991714,2cyclictest749573-21kworker/u8:2+flush-259:000:35:170
416794991714,2cyclictest734012-21kworker/u8:0+flush-259:000:15:210
416794991714,2cyclictest60350irq/132-enp0s29f1:rx-022:50:170
416794991713,3cyclictest707882-21kworker/u8:1+flush-259:023:50:000
416794991713,3cyclictest650447-21kworker/u8:2+flush-259:023:10:040
416794991713,3cyclictest60350irq/132-enp0s29f1:rx-000:30:210
41680499167,4cyclictest0-21swapper/323:48:433
41680499163,3cyclictest50-21ksoftirqd/319:40:193
41680499162,2cyclictest491ktimers/322:45:243
416804991615,1cyclictest453290-21kworker/u8:3+events_unbound20:24:283
416804991614,2cyclictest379201-21kworker/u8:1+events_unbound19:16:013
416804991613,2cyclictest712394-21ntp_kernel_pll_23:50:203
416804991613,2cyclictest510707-21kworker/u8:2+events_unbound21:08:423
416804991613,2cyclictest489104-21kworker/u8:0+events_unbound20:58:573
416804991613,2cyclictest401547-21kworker/u8:0+events_unbound19:24:573
416799991613,2cyclictest609351-21kworker/u8:2+events_unbound22:17:022
41679699167,1cyclictest191rcu_preempt23:40:181
416794991614,1cyclictest60350irq/132-enp0s29f1:rx-020:30:160
416794991614,1cyclictest60350irq/132-enp0s29f1:rx-020:17:240
416794991613,2cyclictest60350irq/132-enp0s29f1:rx-021:20:000
416794991612,3cyclictest453290-21kworker/u8:3+events_unbound19:45:000
41680499154,5cyclictest491ktimers/322:40:173
41680499154,3cyclictest50-21ksoftirqd/321:15:003
416804991513,2cyclictest713288-21kworker/u8:3+events_unbound00:25:023
416804991513,1cyclictest491ktimers/322:10:223
416804991512,2cyclictest490158-21kworker/u8:4+events_unbound22:00:053
416804991512,2cyclictest490158-21kworker/u8:4+events_unbound21:42:043
416804991512,2cyclictest453290-21kworker/u8:3+events_unbound20:28:013
416804991510,2cyclictest191rcu_preempt21:05:013
41680499150,2cyclictest729028-21apt-get00:10:123
416799991512,2cyclictest468846-21kworker/u8:1+events_unbound20:00:242
41679699157,1cyclictest191rcu_preempt19:10:201
41679699155,1cyclictest191rcu_preempt21:50:201
41679699153,6cyclictest572247-21grep21:35:191
416794991513,1cyclictest60350irq/132-enp0s29f1:rx-022:40:090
416794991513,1cyclictest60350irq/132-enp0s29f1:rx-000:10:240
416794991513,1cyclictest60350irq/132-enp0s29f1:rx-000:08:270
416794991511,3cyclictest594073-21kworker/u8:1+flush-259:023:00:190
41680499147,2cyclictest191rcu_preempt20:30:223
41680499147,2cyclictest0-21swapper/322:05:193
416799991412,2cyclictest401547-21kworker/u8:0+flush-259:019:45:152
416799991410,3cyclictest650447-21kworker/u8:2+flush-259:023:21:182
416794991412,1cyclictest60350irq/132-enp0s29f1:rx-020:00:160
416794991412,1cyclictest60350irq/132-enp0s29f1:rx-019:20:160
416794991410,3cyclictest478947-21kworker/u8:2+flush-259:020:10:210
416799991310,2cyclictest468846-21kworker/u8:1+events_unbound20:05:292
41679999117,3cyclictest510707-21kworker/u8:2+events_unbound20:49:402
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional