You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 14:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Mon Apr 27, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316297995044,4cyclictest326528-21latency_hist19:20:011
316297994945,3cyclictest591361-21kworker/u8:1+flush-259:000:15:001
316306994845,2cyclictest591361-21kworker/u8:1+flush-259:000:00:233
316292994845,2cyclictest512901-21kworker/u8:3+events_unbound00:15:250
316292994742,4cyclictest316461-21/usr/sbin/munin19:10:140
316302994640,4cyclictest611064-21apt-get23:50:272
316306994336,5cyclictest564784-21kworker/u8:0+flush-259:023:35:163
316292994337,5cyclictest336803-21latency_hist19:30:010
316306994138,2cyclictest347197-21kworker/u8:0+events_unbound20:55:173
316292994033,5cyclictest439586-21ntpq21:05:210
316306993936,2cyclictest321410-21kworker/u8:1+events_unbound20:10:233
316306993935,3cyclictest321410-21kworker/u8:1+events_unbound22:15:143
316297993936,2cyclictest321410-21kworker/u8:1+flush-259:019:49:591
316306993834,3cyclictest591361-21kworker/u8:1+flush-259:000:35:233
316292993831,5cyclictest506823-21ntpq22:10:200
316306993733,3cyclictest512901-21kworker/u8:3+flush-259:000:10:233
316297993730,4cyclictest362495-21ntpq19:50:231
316302993629,5cyclictest600694-21latency_hist23:45:012
316306993531,3cyclictest512901-21kworker/u8:3+flush-259:022:40:263
316306993529,3cyclictest347197-21kworker/u8:0+flush-259:020:00:203
316306993529,3cyclictest347197-21kworker/u8:0+flush-259:020:00:193
316292993533,2cyclictest300387-21kworker/u8:2+events_unbound19:30:170
316306993431,2cyclictest512901-21kworker/u8:3+flush-259:023:05:233
316306993430,3cyclictest512901-21kworker/u8:3+flush-259:022:30:003
316302993428,4cyclictest252-21systemd-journal21:20:012
316302993427,5cyclictest316195-21latency_hist19:10:002
316297993430,3cyclictest321410-21kworker/u8:1+flush-259:021:55:171
316292993432,2cyclictest347197-21kworker/u8:0+events_unbound20:56:510
316292993431,2cyclictest533430-21kworker/u8:2+events_unbound22:55:130
316292993431,2cyclictest512901-21kworker/u8:3+events_unbound00:13:280
316292993431,2cyclictest347197-21kworker/u8:0+events_unbound20:21:330
316292993431,2cyclictest347197-21kworker/u8:0+events_unbound20:09:330
316306993330,2cyclictest321410-21kworker/u8:1+flush-259:021:00:193
316297993329,3cyclictest300387-21kworker/u8:2+flush-259:019:35:201
316297993325,5cyclictest470411-21ntpq21:35:201
316292993331,2cyclictest321410-21kworker/u8:1+events_unbound19:48:330
316292993330,3cyclictest564784-21kworker/u8:0+events_unbound23:22:350
316292993330,2cyclictest347197-21kworker/u8:0+events_unbound20:12:340
316292993330,2cyclictest321410-21kworker/u8:1+events_unbound22:34:330
316292993330,2cyclictest321410-21kworker/u8:1+events_unbound21:53:330
316292993330,2cyclictest321410-21kworker/u8:1+events_unbound21:00:280
316292993330,2cyclictest321410-21kworker/u8:1+events_unbound20:31:350
316292993326,6cyclictest610614-21ntpq23:50:220
316302993220,4cyclictest559620-21latency_hist23:05:012
316297993225,5cyclictest528529-21/usr/sbin/munin22:35:141
316292993230,2cyclictest591361-21kworker/u8:1+events_unbound23:35:260
316292993230,2cyclictest321410-21kworker/u8:1+events_unbound19:50:170
316292993229,2cyclictest347197-21kworker/u8:0+events_unbound21:24:340
316292993228,3cyclictest512901-21kworker/u8:3+events_unbound22:24:340
316292993226,5cyclictest574076-21ntpq23:15:200
316292993225,5cyclictest491436-21ntpq21:55:220
316306993127,3cyclictest591361-21kworker/u8:1+flush-259:000:25:233
316306993127,3cyclictest321410-21kworker/u8:1+flush-259:019:55:143
316292993128,3cyclictest564784-21kworker/u8:0+events_unbound23:33:330
316292993128,2cyclictest347197-21kworker/u8:0+events_unbound21:40:250
316292993128,2cyclictest347197-21kworker/u8:0+events_unbound20:17:340
316306993026,3cyclictest564784-21kworker/u8:0+flush-259:023:10:163
316306993025,3cyclictest300387-21kworker/u8:2+flush-259:019:30:193
316302993024,4cyclictest554428-21latency_hist23:00:012
316302993023,5cyclictest461065-21latency_hist21:30:012
316297993026,3cyclictest321410-21kworker/u8:1+flush-259:021:50:251
316297993025,3cyclictest300387-21kworker/u8:2+flush-259:019:30:221
316292993028,2cyclictest321410-21kworker/u8:1+events_unbound20:48:350
316292993027,2cyclictest404516-21kworker/u8:2+events_unbound20:41:470
316292993025,2cyclictest321410-21kworker/u8:1+events_unbound20:25:160
316306992926,2cyclictest591361-21kworker/u8:1+flush-259:023:50:133
316306992926,2cyclictest347197-21kworker/u8:0+events_unbound21:54:593
316306992925,3cyclictest347197-21kworker/u8:0+events_unbound21:10:213
316297992925,2cyclictest409917-21apt-get20:40:121
316292992926,2cyclictest321410-21kworker/u8:1+events_unbound21:25:260
316292992926,2cyclictest300387-21kworker/u8:2+events_unbound19:35:280
316306992825,2cyclictest321410-21kworker/u8:1+flush-259:021:35:233
316306992823,3cyclictest533430-21kworker/u8:2+flush-259:022:55:213
316292992825,2cyclictest512901-21kworker/u8:3+events_unbound23:40:320
316292992823,4cyclictest512901-21kworker/u8:3+flush-259:000:10:000
316306992724,2cyclictest564784-21kworker/u8:0+events_unbound23:25:263
316306992724,2cyclictest321410-21kworker/u8:1+flush-259:020:45:203
316306992723,3cyclictest591361-21kworker/u8:1+events_unbound23:45:143
316306992723,3cyclictest347197-21kworker/u8:0+events_unbound20:51:483
316306992723,3cyclictest300387-21kworker/u8:2+flush-259:019:25:183
316306992722,3cyclictest512901-21kworker/u8:3+events_unbound23:55:113
316297992719,6cyclictest601100-21apt-key23:45:011
316306992623,2cyclictest321410-21kworker/u8:1+flush-259:020:20:003
316306992623,2cyclictest321410-21kworker/u8:1+events_unbound20:30:263
316306992622,3cyclictest591361-21kworker/u8:1+flush-259:000:20:183
316306992619,5cyclictest538829-21/usr/sbin/munin22:45:153
316297992623,2cyclictest347197-21kworker/u8:0+events_unbound22:10:171
316297992622,3cyclictest347197-21kworker/u8:0+flush-259:020:55:001
316297992622,3cyclictest347197-21kworker/u8:0+flush-259:019:40:181
316297992620,4cyclictest252-21systemd-journal19:27:331
316292992623,2cyclictest512901-21kworker/u8:3+events_unbound22:26:330
316292992623,2cyclictest321410-21kworker/u8:1+events_unbound21:36:580
316306992522,2cyclictest512901-21kworker/u8:3+flush-259:022:20:233
316306992521,3cyclictest591361-21kworker/u8:1+events_unbound00:05:213
316306992521,3cyclictest321410-21kworker/u8:1+events_unbound21:25:163
316302992519,4cyclictest252-21systemd-journal21:24:552
316297992521,3cyclictest512901-21kworker/u8:3+flush-259:023:55:231
316297992517,5cyclictest584409-21ntpq23:25:231
316292992522,2cyclictest591361-21kworker/u8:1+events_unbound00:34:440
316292992522,2cyclictest512901-21kworker/u8:3+events_unbound23:08:340
316292992522,2cyclictest347197-21kworker/u8:0+events_unbound20:01:340
316292992522,2cyclictest347197-21kworker/u8:0+events_unbound20:01:340
316306992421,2cyclictest430252-21kworker/u8:2+events_unbound21:15:233
316306992420,3cyclictest347197-21kworker/u8:0+events_unbound22:10:213
316306992418,4cyclictest394198-21latency_hist20:25:013
316302992419,3cyclictest497714-21apt-get22:05:122
316297992420,3cyclictest321410-21kworker/u8:1+flush-259:022:25:251
316297992418,4cyclictest564968-21/usr/sbin/munin23:10:201
316297992418,4cyclictest549530-21/usr/sbin/munin22:55:141
316292992422,2cyclictest321410-21kworker/u8:1+events_unbound20:52:350
316292992420,3cyclictest512901-21kworker/u8:3+events_unbound23:55:250
316306992320,2cyclictest321410-21kworker/u8:1+flush-259:021:55:233
316306992319,3cyclictest300387-21kworker/u8:2+flush-259:019:15:253
316297992318,3cyclictest389343-21apt-get20:20:131
316297992317,4cyclictest533673-21apt-get22:40:131
316297992315,5cyclictest528296-21latency_hist22:35:011
316292992321,2cyclictest512901-21kworker/u8:3+events_unbound22:45:320
316292992321,2cyclictest512901-21kworker/u8:3+events_unbound22:43:330
316292992321,2cyclictest321410-21kworker/u8:1+events_unbound21:34:280
316292992320,2cyclictest347197-21kworker/u8:0+events_unbound20:38:330
316292992320,2cyclictest321410-21kworker/u8:1+events_unbound19:19:330
316306992219,2cyclictest512901-21kworker/u8:3+events_unbound00:16:433
316306992218,3cyclictest509-21rs:main3
316306992217,4cyclictest574994-21latency_hist23:20:013
316302992217,4cyclictest347197-21kworker/u8:0+flush-259:021:40:212
316302992216,4cyclictest353303-21apt-get19:45:102
316297992218,3cyclictest404516-21kworker/u8:2+flush-259:020:40:011
316297992216,4cyclictest384363-21diskstats20:15:141
316292992219,2cyclictest591361-21kworker/u8:1+events_unbound23:45:280
316306992118,2cyclictest321410-21kworker/u8:1+flush-259:022:05:253
316306992118,2cyclictest321410-21kworker/u8:1+events_unbound19:51:333
316306992118,2cyclictest300387-21kworker/u8:2+flush-259:019:35:193
316306992117,3cyclictest591361-21kworker/u8:1+events_unbound00:34:163
316306992116,4cyclictest394459-21apt-get20:25:133
316302992115,4cyclictest471340-21latency_hist21:40:002
316302992113,6cyclictest399352-21latency_hist20:30:002
316297992117,3cyclictest652498-21kworker/u8:0+flush-259:000:35:011
316297992117,3cyclictest321410-21kworker/u8:1+flush-259:022:20:171
316297992114,5cyclictest331666-21latency_hist19:25:001
316297992114,5cyclictest252-21systemd-journal00:25:001
316292992118,2cyclictest591361-21kworker/u8:1+events_unbound00:24:550
316292992118,2cyclictest512901-21kworker/u8:3+events_unbound22:54:570
316292992118,2cyclictest321410-21kworker/u8:1+events_unbound19:41:350
316292992117,3cyclictest347197-21kworker/u8:0+events_unbound19:59:210
316306992017,2cyclictest512901-21kworker/u8:3+events_unbound22:50:243
316306992017,2cyclictest347197-21kworker/u8:0+flush-259:020:05:193
316306992017,2cyclictest321410-21kworker/u8:1+events_unbound19:20:213
316306992016,3cyclictest512901-21kworker/u8:3+events_unbound23:40:143
316302992017,2cyclictest533430-21kworker/u8:2+flush-259:022:45:232
316302992015,4cyclictest321410-21kworker/u8:1+flush-259:020:10:252
316302992015,3cyclictest321410-21kworker/u8:1+flush-259:019:20:132
316302992014,4cyclictest647745-21apt-get00:30:132
316302992014,4cyclictest321383-21latency_hist19:15:012
316302992013,5cyclictest430232-21latency_hist21:00:012
316297992016,3cyclictest591361-21kworker/u8:1+events_unbound00:25:261
316297992015,4cyclictest347197-21kworker/u8:0+flush-259:020:35:011
316292992017,2cyclictest554477-21kworker/u8:1+events_unbound23:04:350
316292992017,2cyclictest347197-21kworker/u8:0+events_unbound21:49:240
316306991916,2cyclictest347197-21kworker/u8:0+events_unbound21:40:213
316306991913,3cyclictest533430-21kworker/u8:2+events_unbound23:00:153
316302991915,3cyclictest347197-21kworker/u8:0+flush-259:020:50:242
316302991915,2cyclictest606292-21sh23:49:592
316302991914,3cyclictest353044-21latency_hist19:45:012
316302991913,4cyclictest252-21systemd-journal20:00:342
316302991913,4cyclictest252-21systemd-journal20:00:342
316297991913,4cyclictest508012-21apt-get22:15:111
316292991916,3cyclictest611529-21kworker/u8:2+events_unbound00:39:440
316306991815,2cyclictest430252-21kworker/u8:2+flush-259:021:05:263
316306991814,3cyclictest564784-21kworker/u8:0+events_unbound23:20:213
316306991814,3cyclictest321410-21kworker/u8:1+flush-259:019:40:153
316302991813,4cyclictest549067-21gpgv22:55:012
316302991812,4cyclictest252-21systemd-journal23:10:002
316297991813,4cyclictest492554-21apt-get22:00:121
316292991817,1cyclictest347197-21kworker/u8:0+events_unbound22:01:470
316292991815,2cyclictest512901-21kworker/u8:3+events_unbound23:14:340
316292991815,2cyclictest347197-21kworker/u8:0+events_unbound22:09:110
316292991815,2cyclictest347197-21kworker/u8:0+events_unbound21:18:360
316292991815,2cyclictest321410-21kworker/u8:1+events_unbound22:36:440
316292991813,4cyclictest326792-21apt-get19:20:130
316306991714,2cyclictest347197-21kworker/u8:0+flush-259:021:46:573
316306991714,2cyclictest321410-21kworker/u8:1+events_unbound22:00:173
316302991714,2cyclictest619172-21kthreadcore00:00:202
316302991713,3cyclictest512901-21kworker/u8:3+flush-259:022:25:002
316302991712,4cyclictest321410-21kworker/u8:1+flush-259:022:35:252
316302991711,4cyclictest461302-21/usr/sbin/munin21:30:252
316302991710,5cyclictest444755-21ntpq21:10:202
316297991714,1cyclictest0-21swapper/123:45:011
316297991710,4cyclictest455949-21latency_hist21:25:011
316292991715,2cyclictest347197-21kworker/u8:0+events_unbound21:11:580
316292991714,2cyclictest60350irq/132-enp0s29f1:rx-000:25:170
316292991714,2cyclictest512901-21kworker/u8:3+events_unbound23:26:030
316292991714,2cyclictest512901-21kworker/u8:3+events_unbound00:00:020
316306991613,2cyclictest347197-21kworker/u8:0+events_unbound21:20:223
316306991613,2cyclictest321410-21kworker/u8:1+flush-259:019:45:213
316306991613,2cyclictest300387-21kworker/u8:2+flush-259:019:10:143
316302991612,3cyclictest564784-21kworker/u8:0+flush-259:023:15:262
316302991612,3cyclictest507-21in:imuxsock23:30:002
316302991612,3cyclictest321410-21kworker/u8:1+flush-259:019:55:222
316302991612,3cyclictest300387-21kworker/u8:2+flush-259:019:15:222
316297991610,4cyclictest252-21systemd-journal21:45:001
31629299165,5cyclictest0-21swapper/022:15:320
316306991512,2cyclictest321410-21kworker/u8:1+events_unbound22:35:173
316306991512,2cyclictest321410-21kworker/u8:1+events_unbound22:30:493
316306991511,3cyclictest347197-21kworker/u8:0+events_unbound20:38:563
31630299155,5cyclictest626914-21basename00:09:592
316302991511,3cyclictest347197-21kworker/u8:0+flush-259:022:10:332
316302991511,2cyclictest0-21swapper/219:35:012
316302991510,3cyclictest404516-21kworker/u8:2+flush-259:020:40:162
316297991513,1cyclictest381353-21kthreadcore20:10:181
316297991511,3cyclictest430252-21kworker/u8:2+flush-259:021:05:151
316297991510,4cyclictest512901-21kworker/u8:3+flush-259:023:30:211
316297991510,3cyclictest321410-21kworker/u8:1+flush-259:021:00:181
316306991411,2cyclictest321410-21kworker/u8:1+events_unbound21:30:143
316306991410,3cyclictest564784-21kworker/u8:0+events_unbound23:31:203
31630299148,4cyclictest252-21systemd-journal20:10:002
316302991412,1cyclictest430896-21irqcore21:00:182
31629799147,5cyclictest652883-21/usr/sbin/munin00:35:201
316297991411,2cyclictest621770-21sh00:05:001
31629299143,3cyclictest16-21ksoftirqd/019:10:010
316302991310,2cyclictest579219-21ntp_kernel_pll_23:20:232
316302991310,2cyclictest404074-21unixbench_singl20:30:262
31629799139,2cyclictest0-21swapper/123:25:001
31629799135,5cyclictest252-21systemd-journal21:35:001
316297991310,2cyclictest636192-21needreboot00:15:221
316297991310,2cyclictest594711-21ntp_offset23:35:211
31630299129,1cyclictest0-21swapper/222:35:002
31630299127,3cyclictest509-21rs:main2
316302991210,1cyclictest0-21swapper/219:50:222
31629799129,2cyclictest558788-21ntp_offset23:00:221
31629799129,2cyclictest544393-21sed22:50:181
31629799129,2cyclictest444744-21ntp_kernel_pll_21:10:201
31629799129,1cyclictest0-21swapper/122:50:001
31629799129,1cyclictest0-21swapper/121:49:591
31629799128,3cyclictest626446-21unixbench_multi00:05:241
31629799128,3cyclictest591361-21kworker/u8:1+flush-259:023:50:161
31629799128,2cyclictest3944332sleep120:25:141
31629799121,10cyclictest0-21swapper/120:00:001
31630299118,2cyclictest492619-21cpuspeed_turbos22:00:142
31630299117,3cyclictest591361-21kworker/u8:1+flush-259:000:20:162
31629799119,1cyclictest374345-21sed20:05:161
31629799119,1cyclictest0-21swapper/120:55:181
31629799118,2cyclictest415167-21cpuspeed_turbos20:45:131
31629799117,3cyclictest321410-21kworker/u8:1+flush-259:020:00:351
31629799117,3cyclictest321410-21kworker/u8:1+flush-259:020:00:341
31629799117,2cyclictest0-21swapper/121:25:181
31629799111,8cyclictest502589-21latency_hist22:10:001
31630299108,1cyclictest384613-21irqcore20:15:172
31630299108,1cyclictest316287-21cyclictest23:30:172
31630299108,1cyclictest0-21swapper/200:15:142
31630299107,2cyclictest0-21swapper/222:40:182
31630299105,4cyclictest569896-21latency_hist23:15:022
31629799106,2cyclictest320515-21ntpq19:10:211
3163029997,1cyclictest0-21swapper/200:35:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional