You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 11:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Sep 04, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
476941995248,3cyclictest637893-21kworker/u8:2+flush-259:022:25:250
476941994439,3cyclictest586209-21base6420:55:010
476948994136,3cyclictest596833-21apt-get21:05:111
476941993531,3cyclictest751932-21kworker/u8:2+flush-259:000:05:000
476941993531,3cyclictest751932-21kworker/u8:2+flush-259:000:05:000
476941993531,3cyclictest627585-21kworker/u8:1+flush-259:021:55:230
476941993531,3cyclictest565175-21kworker/u8:0+events_unbound21:04:270
476941993531,3cyclictest2630397-21kworker/u8:2+flush-259:020:15:240
476941993428,4cyclictest751932-21kworker/u8:2+flush-259:023:55:200
476941993428,4cyclictest751932-21kworker/u8:2+flush-259:023:55:190
476941993427,5cyclictest519042-21diskstats19:50:150
476955993328,3cyclictest695187-21kworker/u8:3+flush-259:023:40:003
476941993329,3cyclictest482296-21kworker/u8:1+events_unbound19:35:220
476941993327,4cyclictest622703-21apt-get21:30:160
476955993226,4cyclictest498153-21cat19:30:013
476951993227,3cyclictest586408-21base6420:55:012
476941993226,4cyclictest335557-21systemd-journal23:55:000
476955993126,3cyclictest731311-21latency_hist23:15:003
476948993127,3cyclictest751932-21kworker/u8:2+flush-259:023:45:001
476941993128,2cyclictest627585-21kworker/u8:1+events_unbound21:40:200
476941993027,2cyclictest482296-21kworker/u8:1+events_unbound19:15:150
476955992921,6cyclictest335557-21systemd-journal23:29:593
476951992924,3cyclictest601989-21/usr/sbin/munin21:10:252
476948992925,3cyclictest695187-21kworker/u8:3+flush-259:023:20:241
476948992923,4cyclictest674534-21kworker/u8:1+flush-259:000:25:161
476941992926,2cyclictest695187-21kworker/u8:3+flush-259:023:30:000
476941992923,4cyclictest335557-21systemd-journal23:24:330
476948992823,4cyclictest539576-21apt-get20:10:111
476948992821,5cyclictest705743-21apt-get22:50:161
476941992825,2cyclictest637893-21kworker/u8:2+flush-259:022:45:000
476941992822,4cyclictest335557-21systemd-journal19:55:010
476955992723,3cyclictest2630397-21kworker/u8:2+flush-259:019:25:173
476948992724,2cyclictest507920-21kworker/u8:3+flush-259:020:30:151
476941992724,2cyclictest648476-21kworker/u8:0+flush-259:022:10:240
476955992623,2cyclictest627585-21kworker/u8:1+flush-259:021:55:263
476955992620,5cyclictest788705-21cat00:10:003
476951992620,4cyclictest509-21rs:main2
476941992623,2cyclictest674534-21kworker/u8:1+events_unbound23:00:230
476941992623,2cyclictest648476-21kworker/u8:0+events_unbound22:00:210
476941992622,3cyclictest674534-21kworker/u8:1+events_unbound00:10:240
476941992622,3cyclictest648476-21kworker/u8:0+events_unbound22:05:240
476941992522,2cyclictest2630397-21kworker/u8:2+flush-259:020:40:220
476941992520,2cyclictest637893-21kworker/u8:2+events_unbound22:50:290
476955992421,2cyclictest2630397-21kworker/u8:2+events_unbound20:15:173
476955992420,3cyclictest507920-21kworker/u8:3+flush-259:020:25:253
47695199246,7cyclictest0-21swapper/223:35:162
476951992418,4cyclictest601755-21latency_hist21:10:002
476948992420,3cyclictest2630397-21kworker/u8:2+flush-259:020:05:001
476941992421,2cyclictest674534-21kworker/u8:1+events_unbound23:35:220
476941992421,2cyclictest507920-21kworker/u8:3+flush-259:020:30:230
476941992421,2cyclictest507920-21kworker/u8:3+events_unbound19:45:150
476941992420,3cyclictest2630397-21kworker/u8:2+flush-259:020:35:140
476955992319,3cyclictest772830-21/usr/sbin/munin23:55:163
476955992319,3cyclictest772830-21/usr/sbin/munin23:55:153
476955992318,3cyclictest335557-21systemd-journal22:34:553
476955992315,7cyclictest674534-21kworker/u8:1+flush-259:023:03:413
476951992320,2cyclictest591701-21apt-get21:00:132
476951992318,3cyclictest586289-21latency_hist20:55:012
476948992320,2cyclictest507-21in:imuxsock22:40:001
476948992319,2cyclictest335557-21systemd-journal22:28:001
476941992320,2cyclictest2630397-21kworker/u8:2+flush-259:021:10:150
476941992319,3cyclictest2630397-21kworker/u8:2+events_unbound19:10:170
476941992318,4cyclictest335557-21systemd-journal21:19:590
476941992317,4cyclictest631870-21ntpq21:35:220
476951992215,6cyclictest1-21systemd20:50:002
476948992217,3cyclictest814784-21apt-get00:35:121
476948992216,4cyclictest508574-21apt-get19:40:121
476941992219,2cyclictest674534-21kworker/u8:1+events_unbound22:45:170
476955992118,2cyclictest819677-21munin-plugin-st00:40:013
476955992116,3cyclictest617525-21apt-get21:25:133
47695199211,18cyclictest643080-21awk21:50:002
47695199210,9cyclictest7925952cut00:10:182
47695199210,12cyclictest622192-21taskset21:27:182
476948992118,2cyclictest607188-21apt-get21:15:111
476948992117,3cyclictest793730-21cron00:15:001
476941992118,2cyclictest762272-21kworker/u8:4+events_unbound00:28:020
476941992118,2cyclictest482296-21kworker/u8:1+events_unbound19:35:000
476941992118,2cyclictest2630397-21kworker/u8:2+flush-259:019:20:250
476941992117,3cyclictest2630397-21kworker/u8:2+events_unbound20:09:350
476955992015,3cyclictest565175-21kworker/u8:0+flush-259:020:45:193
476948992016,3cyclictest674534-21kworker/u8:1+flush-259:023:20:001
476948992013,5cyclictest606029-21ntpq21:10:231
476948992013,5cyclictest509-21rs:main1
476941992017,2cyclictest674534-21kworker/u8:1+events_unbound23:15:160
476941992017,2cyclictest637893-21kworker/u8:2+flush-259:021:50:270
476941992016,3cyclictest751932-21kworker/u8:2+events_unbound23:45:110
476955991916,2cyclictest596506-21kworker/u8:3+flush-259:021:45:153
476955991915,3cyclictest674534-21kworker/u8:1+flush-259:022:40:013
47695199194,6cyclictest575559-21apt20:45:002
476948991914,4cyclictest335557-21systemd-journal22:50:011
476948991914,3cyclictest482328-21apt-get19:15:101
476948991914,3cyclictest2630397-21kworker/u8:2+flush-259:019:25:051
476948991913,5cyclictest335557-21systemd-journal21:00:011
476941991916,2cyclictest762272-21kworker/u8:4+events_unbound00:08:160
476941991916,2cyclictest674534-21kworker/u8:1+flush-259:023:10:270
476941991916,2cyclictest471837-21kworker/u8:0+events_unbound19:43:340
476941991915,3cyclictest674534-21kworker/u8:1+events_unbound22:39:580
476955991815,2cyclictest762272-21kworker/u8:4+events_unbound00:30:193
476955991815,2cyclictest633426-21irqcore21:40:193
476955991814,3cyclictest695187-21kworker/u8:3+flush-259:023:05:143
476955991813,3cyclictest637893-21kworker/u8:2+flush-259:022:50:303
47695199189,7cyclictest683831-21needreboot22:25:202
47695199184,11cyclictest767857-21df_inode23:50:162
47695199181,9cyclictest679664-21latency_hist22:25:012
47695199181,8cyclictest808463-21ntp_states00:25:222
476951991815,2cyclictest697704-21kthreadcore22:40:192
476951991814,3cyclictest762272-21kworker/u8:4+flush-259:000:20:012
476951991814,2cyclictest0-21swapper/222:05:002
476951991810,7cyclictest482739-21grep19:15:152
47695199180,4cyclictest669301-21seq22:14:182
476948991813,4cyclictest570594-21apt-get20:40:101
476948991811,5cyclictest559116-21ntpq20:25:221
476941991815,2cyclictest674534-21kworker/u8:1+events_unbound00:15:140
476941991814,3cyclictest617276-21kworker/u8:0+events_unbound21:29:200
476941991813,3cyclictest747022-21apt-get23:30:150
476955991714,2cyclictest648476-21kworker/u8:0+flush-259:022:00:273
476955991714,2cyclictest486290-21ntp_kernel_err19:15:193
476955991713,3cyclictest674534-21kworker/u8:1+events_unbound22:45:003
476955991712,4cyclictest518623-21latency_hist19:50:013
47695199179,5cyclictest659256-21cp22:05:022
47695199175,10cyclictest710809-21cat22:55:022
47695199171,14cyclictest497541-21idleruntime-cro19:30:002
476951991710,6cyclictest0-21swapper/219:50:182
476951991710,5cyclictest761395-21ntpq23:40:222
47695199170,13cyclictest622901-21/usr/sbin/munin21:30:192
47695199170,13cyclictest607466-21tune2fs21:15:142
47694899179,5cyclictest335557-21systemd-journal23:05:011
476941991714,2cyclictest751932-21kworker/u8:2+events_unbound23:40:280
476941991714,2cyclictest637893-21kworker/u8:2+events_unbound22:30:240
476941991714,2cyclictest637893-21kworker/u8:2+events_unbound22:24:550
476941991714,2cyclictest60350irq/132-enp0s29f1:rx-021:45:570
476941991714,2cyclictest565175-21kworker/u8:0+events_unbound20:45:220
476941991714,2cyclictest2630397-21kworker/u8:2+events_unbound20:10:150
476941991713,3cyclictest674534-21kworker/u8:1+events_unbound00:32:330
476941991713,3cyclictest586569-21apt-get20:55:120
476955991613,2cyclictest695187-21kworker/u8:3+flush-259:023:23:103
476955991613,2cyclictest674534-21kworker/u8:1+flush-259:022:25:223
476955991610,4cyclictest335557-21systemd-journal19:45:003
47695199168,7cyclictest695127-21cron22:40:012
47695199165,9cyclictest0-21swapper/219:20:172
476951991613,2cyclictest732601-21kthreadcore23:15:192
476951991611,3cyclictest555042-21apt-get20:25:122
47695199161,13cyclictest503652-21grep19:35:132
47695199161,13cyclictest1-21systemd00:10:002
47695199161,12cyclictest524450-21sed19:55:182
47695199160,5cyclictest809587-21apt-get00:30:152
47695199160,3cyclictest533408-21sensors20:00:232
47695199160,2cyclictest637520-21seq21:40:572
47695199160,15cyclictest570315-21cron20:40:002
47695199160,14cyclictest720968-21cron23:05:012
47695199160,14cyclictest518622-21apt19:50:002
47695199160,13cyclictest669753-21cpuspeed_turbos22:15:122
47695199160,13cyclictest560238-21apt20:30:112
47695199160,13cyclictest508713-21cut19:40:132
476948991613,2cyclictest596506-21kworker/u8:3+flush-259:021:20:041
476948991612,3cyclictest617276-21kworker/u8:0+flush-259:021:25:261
476948991612,3cyclictest513464-21kworker/u8:1+flush-259:019:50:001
476948991612,2cyclictest0-21swapper/100:05:191
476948991611,3cyclictest513464-21kworker/u8:1+flush-259:019:50:101
476948991611,3cyclictest335557-21systemd-journal21:56:321
476941991613,2cyclictest648476-21kworker/u8:0+events_unbound22:15:130
476941991613,2cyclictest596506-21kworker/u8:3+events_unbound21:20:340
476941991613,2cyclictest507920-21kworker/u8:3+flush-259:020:25:290
476941991613,2cyclictest2630397-21kworker/u8:2+flush-259:020:00:190
476941991612,3cyclictest814541-21kworker/u8:0+events_unbound00:39:180
476941991611,3cyclictest7991922sleep000:20:110
476955991512,2cyclictest674534-21kworker/u8:1+flush-259:022:55:213
476955991512,2cyclictest507920-21kworker/u8:3+flush-259:020:30:183
476955991512,2cyclictest2630397-21kworker/u8:2+flush-259:021:05:203
476955991512,2cyclictest2630397-21kworker/u8:2+events_unbound19:10:153
476955991510,3cyclictest695187-21kworker/u8:3+flush-259:022:45:263
47695199159,4cyclictest335557-21systemd-journal19:32:272
47695199158,6cyclictest0-21swapper/220:15:152
47695199151,12cyclictest746275-21grep23:25:242
47695199151,12cyclictest652982-21grep21:55:262
47695199151,11cyclictest705680-21latency_hist22:50:012
47695199150,8cyclictest832-21runrttasks22:30:472
47695199150,13cyclictest782955-21idleruntime-cro00:05:002
47695199150,13cyclictest782955-21idleruntime-cro00:04:592
47695199150,13cyclictest777785-21true00:00:002
47695199150,13cyclictest777785-21true00:00:002
47695199150,13cyclictest741587-21cron23:25:002
47695199150,13cyclictest643758-21sed21:50:192
47695199150,13cyclictest631409-21grep21:35:182
47695199150,12cyclictest799326-21tr00:20:122
47695199150,12cyclictest762614-21tr23:45:132
47695199150,12cyclictest721652-21grep23:05:162
47695199150,12cyclictest539999-21tr20:10:162
47694899159,4cyclictest715794-21awk23:00:001
476948991512,2cyclictest492375-21basename19:25:001
476948991511,3cyclictest695187-21kworker/u8:3+flush-259:023:30:101
476941991512,2cyclictest2630397-21kworker/u8:2+flush-259:020:20:050
476941991511,3cyclictest2630397-21kworker/u8:2+events_unbound21:05:510
476955991411,3cyclictest482296-21kworker/u8:1+flush-259:019:24:393
476955991410,3cyclictest601979-21kworker/u8:1+flush-259:021:20:013
476955991410,3cyclictest2630397-21kworker/u8:2+flush-259:020:20:213
47695199141,11cyclictest550302-21irqcore20:20:172
47695199140,12cyclictest747117-21cpuspeed_turbos23:30:182
47695199140,12cyclictest534498-21tr20:05:142
47695199140,11cyclictest726451-21grep23:10:152
47694899148,4cyclictest674511-21latency_hist22:20:001
476948991411,2cyclictest813622-21ntp_kernel_pll_00:30:241
476948991410,2cyclictest580713-21idleruntime-cro20:50:001
476941991412,1cyclictest60350irq/132-enp0s29f1:rx-023:05:120
476941991411,2cyclictest674534-21kworker/u8:1+events_unbound22:55:150
47695599139,3cyclictest637893-21kworker/u8:2+events_unbound22:05:163
47695599139,3cyclictest601979-21kworker/u8:1+flush-259:021:20:293
47695599139,2cyclictest544459-21idleruntime-cro20:15:003
47695599139,2cyclictest0-21swapper/323:15:173
47695599138,3cyclictest767864-21diskstats23:50:163
47695599138,3cyclictest674534-21kworker/u8:1+flush-259:000:22:373
476955991310,2cyclictest673662-21ntp_offset22:15:213
47694899137,4cyclictest658738-21gpgv22:05:001
476948991310,2cyclictest776878-21ntp_kernel_pll_23:55:231
476948991310,2cyclictest776878-21ntp_kernel_pll_23:55:221
476948991310,2cyclictest623119-21irqcore21:30:211
476948991310,2cyclictest2630397-21kworker/u8:2+flush-259:020:05:181
47695599128,3cyclictest674534-21kworker/u8:1+flush-259:000:25:313
47695599128,3cyclictest2630397-21kworker/u8:2+flush-259:020:55:163
47694899129,2cyclictest725687-21unixbench_multi23:05:231
47694899129,2cyclictest596506-21kworker/u8:3+events_unbound21:45:241
47694899129,2cyclictest477311-21cpuspeed_turbos19:10:121
47694899128,3cyclictest637893-21kworker/u8:2+flush-259:021:50:261
47694899127,4cyclictest799187-21apt-get00:20:101
47694899127,3cyclictest685082-21apt-get22:30:161
47694899126,4cyclictest586070-21cp20:55:011
47695599119,1cyclictest747096-21cpuspeed_turbos23:30:183
47695599119,1cyclictest0-21swapper/319:35:203
47695599118,2cyclictest637893-21kworker/u8:2+flush-259:021:50:273
47695599118,2cyclictest581037-21cpuspeed_turbos20:50:123
47695599117,3cyclictest751932-21kworker/u8:2+flush-259:023:48:393
47695599117,3cyclictest751932-21kworker/u8:2+flush-259:023:40:303
47695599117,3cyclictest507920-21kworker/u8:3+flush-259:020:39:153
47695599111,8cyclictest788187-21latency_hist00:10:013
47694899119,1cyclictest0-21swapper/122:40:191
47694899118,2cyclictest752238-21cpuspeed_turbos23:35:141
47694899118,2cyclictest674969-21fschecks_count22:20:151
47694899117,3cyclictest482296-21kworker/u8:1+flush-259:019:35:091
47694899116,3cyclictest664161-21cron22:10:011
47694899111,8cyclictest632735-21awk21:40:001
47695599107,2cyclictest0-21swapper/321:05:003
47695599100,8cyclictest782957-21awk00:05:003
47695599100,8cyclictest782957-21awk00:04:593
47694899105,4cyclictest751932-21kworker/u8:2+flush-259:023:45:241
4769559991,4cyclictest524437-21/usr/sbin/munin19:55:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional